2023-12-16T03:08:18.864 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T03:08:18.864 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --archive /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532 --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532/orig.config.yaml 2023-12-16T03:08:18.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:08:19.009 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532 branch: main description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: yweinste@redhat.com first_in_suite: false job_id: '7493532' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 5996 sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFln36APw+xm15YbhTjWav4mY1GGbpxKLumHaIcAY4YUneS0m9dZQrrSXn+/OXxU2hT9f3WsPFrKlunQRPqBKYQ= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCZ0b5AAnhOimDpW28qjtqag5ceUU7/3lI05yIiYwjCzJ7qAd3w3LcEyXtNru1afyXKvWELQFzRTL06rEgO5MHA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-16_00:09:48 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-16T03:08:19.009 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa; will attempt to use it 2023-12-16T03:08:19.010 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks 2023-12-16T03:08:19.010 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-16T03:08:19.012 INFO:teuthology.task.internal:Checking packages... 2023-12-16T03:08:19.035 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6d933094a156ec7587742e5aa25fba5ba27ec678' 2023-12-16T03:08:19.035 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-16T03:08:19.035 INFO:teuthology.packaging:ref: None 2023-12-16T03:08:19.035 INFO:teuthology.packaging:tag: None 2023-12-16T03:08:19.035 INFO:teuthology.packaging:branch: main 2023-12-16T03:08:19.035 INFO:teuthology.packaging:sha1: 6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:08:19.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2023-12-16T03:08:19.261 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-196-g85fe3c65-1jammy 2023-12-16T03:08:19.263 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-16T03:08:19.269 INFO:teuthology.task.internal:no buildpackages task found 2023-12-16T03:08:19.269 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-16T03:08:19.309 INFO:teuthology.task.internal:Saving configuration 2023-12-16T03:08:19.325 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-16T03:08:19.334 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T03:08:19.360 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 03:02:32.179988', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIALLrZKDo7TvZ7JFcAbT481GVPZB9Pg8bSPcqWmbdz6h'} 2023-12-16T03:08:19.386 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 03:02:32.181744', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPv0lgF3K8/uv4fBJ97jUX77T0zO2siWBFp2odbR1jI/'} 2023-12-16T03:08:19.386 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-16T03:08:19.395 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-16T03:08:19.395 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-12-16T03:08:19.395 INFO:teuthology.run_tasks:Running task console_log... 2023-12-16T03:08:19.491 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe8825d0c10>, signals=[15]) 2023-12-16T03:08:19.492 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-16T03:08:19.500 INFO:teuthology.task.internal:Opening connections... 2023-12-16T03:08:19.500 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:08:19.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:08:19.580 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:08:19.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:08:19.657 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-16T03:08:19.667 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2023-12-16T03:08:19.672 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2023-12-16T03:08:19.672 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2023-12-16T03:08:19.719 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-16T03:08:19.719 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="Ubuntu" 2023-12-16T03:08:19.719 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="22.04" 2023-12-16T03:08:19.719 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-16T03:08:19.719 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_CODENAME=jammy 2023-12-16T03:08:19.719 INFO:teuthology.orchestra.run.smithi028.stdout:ID=ubuntu 2023-12-16T03:08:19.719 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE=debian 2023-12-16T03:08:19.719 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-16T03:08:19.719 INFO:teuthology.orchestra.run.smithi028.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-16T03:08:19.719 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-16T03:08:19.720 INFO:teuthology.orchestra.run.smithi028.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-16T03:08:19.720 INFO:teuthology.orchestra.run.smithi028.stdout:UBUNTU_CODENAME=jammy 2023-12-16T03:08:19.720 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2023-12-16T03:08:19.780 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-12-16T03:08:19.785 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-12-16T03:08:19.785 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-12-16T03:08:19.831 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-16T03:08:19.831 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2023-12-16T03:08:19.831 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="22.04" 2023-12-16T03:08:19.831 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-16T03:08:19.831 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=jammy 2023-12-16T03:08:19.831 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2023-12-16T03:08:19.831 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2023-12-16T03:08:19.831 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-16T03:08:19.831 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-16T03:08:19.831 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-16T03:08:19.831 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-16T03:08:19.832 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=jammy 2023-12-16T03:08:19.832 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-12-16T03:08:19.930 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-16T03:08:19.941 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-16T03:08:19.962 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-16T03:08:19.962 DEBUG:teuthology.orchestra.run.smithi028:> test '!' -e /home/ubuntu/cephtest 2023-12-16T03:08:19.965 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2023-12-16T03:08:19.969 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-16T03:08:19.981 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-16T03:08:19.982 DEBUG:teuthology.orchestra.run.smithi028:> test -z $(ls -A /var/lib/ceph) 2023-12-16T03:08:20.012 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2023-12-16T03:08:20.021 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-16T03:08:20.077 INFO:teuthology.run_tasks:Running task kernel... 2023-12-16T03:08:20.096 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-12-16T03:08:20.096 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-12-16T03:08:20.096 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-16T03:08:20.097 DEBUG:teuthology.orchestra.run.smithi028:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T03:08:20.097 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-16T03:08:20.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:08:20.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:08:20.103 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-16T03:08:20.104 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-16T03:08:20.419 DEBUG:teuthology.task.kernel:sha1 for client.1 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-16T03:08:20.419 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-16T03:08:20.419 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2023-12-16T03:08:20.425 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-56-generic 2023-12-16T03:08:20.425 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-16T03:08:20.425 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-16T03:08:20.426 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-12-16T03:08:20.426 DEBUG:teuthology.orchestra.run.smithi134:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-16T03:08:20.430 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-16T03:08:20.430 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-16T03:08:20.430 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2023-12-16T03:08:20.436 INFO:teuthology.orchestra.run.smithi028.stdout:5.15.0-56-generic 2023-12-16T03:08:20.436 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-16T03:08:20.436 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-16T03:08:20.437 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-12-16T03:08:20.437 DEBUG:teuthology.orchestra.run.smithi028:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-16T03:08:20.491 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-16T03:08:20.497 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-16T03:08:20.624 INFO:teuthology.orchestra.run.smithi134.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-16T03:08:20.624 INFO:teuthology.orchestra.run.smithi134.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-16T03:08:20.624 INFO:teuthology.orchestra.run.smithi134.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-16T03:08:20.624 INFO:teuthology.orchestra.run.smithi134.stderr:hint: 2023-12-16T03:08:20.624 INFO:teuthology.orchestra.run.smithi134.stderr:hint: git config --global init.defaultBranch 2023-12-16T03:08:20.625 INFO:teuthology.orchestra.run.smithi134.stderr:hint: 2023-12-16T03:08:20.625 INFO:teuthology.orchestra.run.smithi134.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-16T03:08:20.625 INFO:teuthology.orchestra.run.smithi134.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-16T03:08:20.625 INFO:teuthology.orchestra.run.smithi134.stderr:hint: 2023-12-16T03:08:20.625 INFO:teuthology.orchestra.run.smithi134.stderr:hint: git branch -m 2023-12-16T03:08:20.625 INFO:teuthology.orchestra.run.smithi134.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-16T03:08:20.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-16T03:08:20.630 INFO:teuthology.orchestra.run.smithi028.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-16T03:08:20.631 INFO:teuthology.orchestra.run.smithi028.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-16T03:08:20.631 INFO:teuthology.orchestra.run.smithi028.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-16T03:08:20.631 INFO:teuthology.orchestra.run.smithi028.stderr:hint: 2023-12-16T03:08:20.631 INFO:teuthology.orchestra.run.smithi028.stderr:hint: git config --global init.defaultBranch 2023-12-16T03:08:20.631 INFO:teuthology.orchestra.run.smithi028.stderr:hint: 2023-12-16T03:08:20.631 INFO:teuthology.orchestra.run.smithi028.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-16T03:08:20.631 INFO:teuthology.orchestra.run.smithi028.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-16T03:08:20.631 INFO:teuthology.orchestra.run.smithi028.stderr:hint: 2023-12-16T03:08:20.631 INFO:teuthology.orchestra.run.smithi028.stderr:hint: git branch -m 2023-12-16T03:08:20.632 INFO:teuthology.orchestra.run.smithi028.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-16T03:08:20.634 DEBUG:teuthology.orchestra.run.smithi028:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-16T03:08:20.694 DEBUG:teuthology.orchestra.run.smithi134:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-16T03:08:20.699 DEBUG:teuthology.orchestra.run.smithi028:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-16T03:08:20.746 DEBUG:teuthology.orchestra.run.smithi134:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-16T03:08:20.754 DEBUG:teuthology.orchestra.run.smithi028:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-16T03:09:39.602 INFO:teuthology.orchestra.run.smithi134.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-16T03:09:39.602 INFO:teuthology.orchestra.run.smithi134.stderr: * [new branch] main -> origin/main 2023-12-16T03:09:39.625 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190312 -> 20190312 2023-12-16T03:09:39.626 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190416 -> 20190416 2023-12-16T03:09:39.626 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190514 -> 20190514 2023-12-16T03:09:39.626 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190618 -> 20190618 2023-12-16T03:09:39.626 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190717 -> 20190717 2023-12-16T03:09:39.626 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190815 -> 20190815 2023-12-16T03:09:39.626 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190923 -> 20190923 2023-12-16T03:09:39.627 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20191022 -> 20191022 2023-12-16T03:09:39.627 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20191215 -> 20191215 2023-12-16T03:09:39.627 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200122 -> 20200122 2023-12-16T03:09:39.627 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200316 -> 20200316 2023-12-16T03:09:39.627 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200421 -> 20200421 2023-12-16T03:09:39.628 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200519 -> 20200519 2023-12-16T03:09:39.628 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200619 -> 20200619 2023-12-16T03:09:39.628 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200721 -> 20200721 2023-12-16T03:09:39.628 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200817 -> 20200817 2023-12-16T03:09:39.630 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200918 -> 20200918 2023-12-16T03:09:39.630 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20201022 -> 20201022 2023-12-16T03:09:39.630 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20201118 -> 20201118 2023-12-16T03:09:39.630 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20201218 -> 20201218 2023-12-16T03:09:39.630 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210208 -> 20210208 2023-12-16T03:09:39.630 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210315 -> 20210315 2023-12-16T03:09:39.630 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210511 -> 20210511 2023-12-16T03:09:39.630 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210716 -> 20210716 2023-12-16T03:09:39.630 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210818 -> 20210818 2023-12-16T03:09:39.631 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210919 -> 20210919 2023-12-16T03:09:39.631 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20211027 -> 20211027 2023-12-16T03:09:39.631 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20211216 -> 20211216 2023-12-16T03:09:39.631 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220209 -> 20220209 2023-12-16T03:09:39.631 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220310 -> 20220310 2023-12-16T03:09:39.631 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220411 -> 20220411 2023-12-16T03:09:39.631 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220509 -> 20220509 2023-12-16T03:09:39.631 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220610 -> 20220610 2023-12-16T03:09:39.631 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220708 -> 20220708 2023-12-16T03:09:39.631 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220815 -> 20220815 2023-12-16T03:09:39.631 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220913 -> 20220913 2023-12-16T03:09:39.633 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20221012 -> 20221012 2023-12-16T03:09:39.633 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20221109 -> 20221109 2023-12-16T03:09:39.633 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20221214 -> 20221214 2023-12-16T03:09:39.633 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230117 -> 20230117 2023-12-16T03:09:39.633 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230210 -> 20230210 2023-12-16T03:09:39.633 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230310 -> 20230310 2023-12-16T03:09:39.633 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230404 -> 20230404 2023-12-16T03:09:39.633 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230515 -> 20230515 2023-12-16T03:09:39.633 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230625 -> 20230625 2023-12-16T03:09:39.633 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230804 -> 20230804 2023-12-16T03:09:39.634 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230919 -> 20230919 2023-12-16T03:09:39.634 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20231030 -> 20231030 2023-12-16T03:09:39.634 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20231111 -> 20231111 2023-12-16T03:09:39.634 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20231211 -> 20231211 2023-12-16T03:09:41.998 INFO:teuthology.orchestra.run.smithi028.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-16T03:09:41.998 INFO:teuthology.orchestra.run.smithi028.stderr: * [new branch] main -> origin/main 2023-12-16T03:09:42.032 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190312 -> 20190312 2023-12-16T03:09:42.032 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190416 -> 20190416 2023-12-16T03:09:42.032 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190514 -> 20190514 2023-12-16T03:09:42.032 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190618 -> 20190618 2023-12-16T03:09:42.032 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190717 -> 20190717 2023-12-16T03:09:42.032 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190815 -> 20190815 2023-12-16T03:09:42.033 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190923 -> 20190923 2023-12-16T03:09:42.033 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20191022 -> 20191022 2023-12-16T03:09:42.034 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20191215 -> 20191215 2023-12-16T03:09:42.034 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200122 -> 20200122 2023-12-16T03:09:42.034 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200316 -> 20200316 2023-12-16T03:09:42.034 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200421 -> 20200421 2023-12-16T03:09:42.034 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200519 -> 20200519 2023-12-16T03:09:42.034 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200619 -> 20200619 2023-12-16T03:09:42.034 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200721 -> 20200721 2023-12-16T03:09:42.034 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200817 -> 20200817 2023-12-16T03:09:42.034 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200918 -> 20200918 2023-12-16T03:09:42.034 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20201022 -> 20201022 2023-12-16T03:09:42.036 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20201118 -> 20201118 2023-12-16T03:09:42.036 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20201218 -> 20201218 2023-12-16T03:09:42.036 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210208 -> 20210208 2023-12-16T03:09:42.036 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210315 -> 20210315 2023-12-16T03:09:42.036 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210511 -> 20210511 2023-12-16T03:09:42.036 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210716 -> 20210716 2023-12-16T03:09:42.036 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210818 -> 20210818 2023-12-16T03:09:42.036 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210919 -> 20210919 2023-12-16T03:09:42.036 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20211027 -> 20211027 2023-12-16T03:09:42.037 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20211216 -> 20211216 2023-12-16T03:09:42.037 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220209 -> 20220209 2023-12-16T03:09:42.037 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220310 -> 20220310 2023-12-16T03:09:42.037 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220411 -> 20220411 2023-12-16T03:09:42.037 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220509 -> 20220509 2023-12-16T03:09:42.037 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220610 -> 20220610 2023-12-16T03:09:42.037 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220708 -> 20220708 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220815 -> 20220815 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220913 -> 20220913 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20221012 -> 20221012 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20221109 -> 20221109 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20221214 -> 20221214 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230117 -> 20230117 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230210 -> 20230210 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230310 -> 20230310 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230404 -> 20230404 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230515 -> 20230515 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230625 -> 20230625 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230804 -> 20230804 2023-12-16T03:09:42.039 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230919 -> 20230919 2023-12-16T03:09:42.040 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20231030 -> 20231030 2023-12-16T03:09:42.040 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20231111 -> 20231111 2023-12-16T03:09:42.040 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20231211 -> 20231211 2023-12-16T03:09:43.626 INFO:teuthology.orchestra.run.smithi134.stderr:Updating files: 51% (1672/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 64% (2116/3256) Updating files: 65% (2117/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2653/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-16T03:09:43.631 INFO:teuthology.orchestra.run.smithi134.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-16T03:09:43.652 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-16T03:09:43.652 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-16T03:09:43.874 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-16T03:09:43.875 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-16T03:09:43.877 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi134.front.sepia.ceph.com to complete... 2023-12-16T03:09:45.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16 03:09:45 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-16T03:09:45.398 INFO:teuthology.orchestra.run.smithi134.stderr:FINISHED --2023-12-16 03:09:45-- 2023-12-16T03:09:45.398 INFO:teuthology.orchestra.run.smithi134.stderr:Total wall clock time: 1.5s 2023-12-16T03:09:45.398 INFO:teuthology.orchestra.run.smithi134.stderr:Downloaded: 1 files, 37M in 1.4s (27.4 MB/s) 2023-12-16T03:09:45.402 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-16T03:09:45.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo dpkg -i /tmp/linux-image.deb 2023-12-16T03:09:45.705 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-16T03:09:46.275 INFO:teuthology.orchestra.run.smithi028.stderr:Updating files: 48% (1574/3256) Updating files: 49% (1596/3256) Updating files: 50% (1628/3256) Updating files: 51% (1661/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 63% (2067/3256) Updating files: 64% (2084/3256) Updating files: 65% (2117/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 78% (2555/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-16T03:09:46.280 INFO:teuthology.orchestra.run.smithi028.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-16T03:09:46.302 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-16T03:09:46.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-16T03:09:46.439 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-16T03:09:46.439 DEBUG:teuthology.orchestra.run.smithi028:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-16T03:09:46.442 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi028.front.sepia.ceph.com to complete... 2023-12-16T03:09:47.664 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-16T03:09:47.669 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-16T03:09:47.872 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-16T03:09:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16 03:09:48 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-16T03:09:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:FINISHED --2023-12-16 03:09:48-- 2023-12-16T03:09:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:Total wall clock time: 1.5s 2023-12-16T03:09:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:Downloaded: 1 files, 37M in 1.4s (27.3 MB/s) 2023-12-16T03:09:47.940 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-16T03:09:47.940 DEBUG:teuthology.orchestra.run.smithi028:> sudo dpkg -i /tmp/linux-image.deb 2023-12-16T03:09:48.195 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-16T03:09:50.171 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-16T03:09:50.175 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-16T03:09:50.290 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-16T03:09:51.378 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-16T03:09:51.485 INFO:teuthology.orchestra.run.smithi134.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-16T03:09:53.554 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-16T03:09:53.664 INFO:teuthology.orchestra.run.smithi028.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-16T03:10:13.502 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2023-12-16T03:10:13.518 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-16T03:10:13.550 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2023-12-16T03:10:13.859 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-16T03:10:13.883 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-16T03:10:14.199 INFO:teuthology.orchestra.run.smithi028.stderr:Sourcing file `/etc/default/grub' 2023-12-16T03:10:14.214 INFO:teuthology.orchestra.run.smithi028.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-16T03:10:14.235 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-16T03:10:14.242 INFO:teuthology.orchestra.run.smithi028.stderr:Generating grub configuration file ... 2023-12-16T03:10:14.249 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-16T03:10:14.307 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-16T03:10:14.313 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-16T03:10:14.481 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-16T03:10:14.482 INFO:teuthology.orchestra.run.smithi134.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-16T03:10:14.482 INFO:teuthology.orchestra.run.smithi134.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-16T03:10:14.533 INFO:teuthology.orchestra.run.smithi134.stderr:done 2023-12-16T03:10:14.572 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-16T03:10:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-16T03:10:14.727 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-deb -c /tmp/linux-image.deb 2023-12-16T03:10:14.734 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-16T03:10:14.734 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-16T03:10:14.734 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-16T03:10:14.744 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-16T03:10:14.744 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-16T03:10:14.763 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-16T03:10:14.764 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-16T03:10:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-16T03:10:14.766 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-16T03:10:14.767 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-16T03:10:14.767 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-16T03:10:14.767 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-16T03:10:14.834 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-16T03:10:14.835 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-16T03:10:14.836 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-16T03:10:14.837 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-16T03:10:14.838 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-16T03:10:14.839 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-16T03:10:14.840 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-16T03:10:14.841 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-16T03:10:14.842 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-16T03:10:14.843 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-16T03:10:14.844 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-16T03:10:14.845 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-16T03:10:14.846 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-16T03:10:14.847 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-16T03:10:14.848 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-16T03:10:14.849 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-16T03:10:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-16T03:10:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-16T03:10:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-16T03:10:14.853 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-16T03:10:14.854 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-16T03:10:14.855 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-16T03:10:14.856 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-16T03:10:14.857 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-16T03:10:14.858 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-16T03:10:14.859 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-16T03:10:14.860 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-16T03:10:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-16T03:10:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-16T03:10:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-16T03:10:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-16T03:10:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-16T03:10:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-16T03:10:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-16T03:10:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-16T03:10:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-16T03:10:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-16T03:10:14.861 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-16T03:10:14.862 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-16T03:10:14.863 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-16T03:10:14.864 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-16T03:10:14.865 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-16T03:10:14.866 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-16T03:10:14.867 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-16T03:10:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-16T03:10:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-16T03:10:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-16T03:10:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-16T03:10:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-16T03:10:14.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-16T03:10:14.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-16T03:10:14.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-16T03:10:14.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-16T03:10:14.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-16T03:10:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-16T03:10:14.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-16T03:10:14.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-16T03:10:14.881 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-16T03:10:14.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-16T03:10:14.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-16T03:10:14.884 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-16T03:10:14.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-16T03:10:14.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-16T03:10:14.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-16T03:10:14.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-16T03:10:14.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-16T03:10:14.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-16T03:10:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-16T03:10:14.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-16T03:10:14.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-16T03:10:14.894 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-16T03:10:14.895 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-16T03:10:14.895 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-16T03:10:14.896 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-16T03:10:14.896 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-16T03:10:14.943 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-16T03:10:14.943 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-16T03:10:14.973 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-16T03:10:14.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-16T03:10:14.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-16T03:10:14.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-16T03:10:14.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-16T03:10:14.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-16T03:10:14.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-16T03:10:14.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-16T03:10:14.981 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-16T03:10:14.982 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-16T03:10:14.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-16T03:10:14.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-16T03:10:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-16T03:10:14.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-16T03:10:14.987 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-16T03:10:14.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-16T03:10:14.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-16T03:10:14.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-16T03:10:14.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-16T03:10:14.992 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-16T03:10:14.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-16T03:10:14.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-16T03:10:14.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-16T03:10:14.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-16T03:10:14.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-16T03:10:14.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-16T03:10:14.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-16T03:10:15.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-16T03:10:15.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-16T03:10:15.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-16T03:10:15.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-16T03:10:15.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-16T03:10:15.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-16T03:10:15.006 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-16T03:10:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-16T03:10:15.008 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-16T03:10:15.009 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-16T03:10:15.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-16T03:10:15.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-16T03:10:15.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-16T03:10:15.013 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-16T03:10:15.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-16T03:10:15.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-16T03:10:15.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-16T03:10:15.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-16T03:10:15.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-16T03:10:15.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-16T03:10:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-16T03:10:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-16T03:10:15.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-16T03:10:15.023 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-16T03:10:15.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-16T03:10:15.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-16T03:10:15.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-16T03:10:15.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-16T03:10:15.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-16T03:10:15.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-16T03:10:15.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-16T03:10:15.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-16T03:10:15.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-16T03:10:15.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-16T03:10:15.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-16T03:10:15.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-16T03:10:15.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-16T03:10:15.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-16T03:10:15.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-16T03:10:15.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-16T03:10:15.031 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-16T03:10:15.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-16T03:10:15.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-16T03:10:15.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-16T03:10:15.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-16T03:10:15.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-16T03:10:15.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-16T03:10:15.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-16T03:10:15.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-16T03:10:15.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-16T03:10:15.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-16T03:10:15.042 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-16T03:10:15.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-16T03:10:15.043 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-16T03:10:15.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-16T03:10:15.043 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-16T03:10:15.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-16T03:10:15.043 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-16T03:10:15.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-16T03:10:15.043 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-16T03:10:15.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-16T03:10:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-16T03:10:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-16T03:10:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-16T03:10:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-16T03:10:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-16T03:10:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-16T03:10:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-16T03:10:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-16T03:10:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-16T03:10:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-16T03:10:15.081 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-16T03:10:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-16T03:10:15.083 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-16T03:10:15.084 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-16T03:10:15.085 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-16T03:10:15.086 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-16T03:10:15.087 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-16T03:10:15.088 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-16T03:10:15.089 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-16T03:10:15.090 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-16T03:10:15.091 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-16T03:10:15.092 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-16T03:10:15.093 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-16T03:10:15.094 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-16T03:10:15.095 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-16T03:10:15.096 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-16T03:10:15.097 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-16T03:10:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-16T03:10:15.099 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-16T03:10:15.100 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-16T03:10:15.101 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-16T03:10:15.102 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-16T03:10:15.103 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-16T03:10:15.104 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-16T03:10:15.105 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-16T03:10:15.106 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-16T03:10:15.107 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-16T03:10:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-16T03:10:15.109 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-16T03:10:15.110 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-16T03:10:15.111 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-16T03:10:15.112 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-16T03:10:15.113 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-16T03:10:15.114 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-16T03:10:15.115 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-16T03:10:15.115 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-16T03:10:15.115 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-16T03:10:15.115 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-16T03:10:15.115 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-16T03:10:15.116 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-16T03:10:15.116 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-16T03:10:15.116 DEBUG:teuthology.orchestra.run.smithi134:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-16T03:10:15.117 INFO:teuthology.orchestra.run.smithi028.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-16T03:10:15.117 INFO:teuthology.orchestra.run.smithi028.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-16T03:10:15.117 INFO:teuthology.orchestra.run.smithi028.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-16T03:10:15.123 INFO:teuthology.orchestra.run.smithi134.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-16T03:10:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-16T03:10:15.123 INFO:teuthology.orchestra.run.smithi134.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-16T03:10:15.123 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-16T03:10:15.123 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-16T03:10:15.124 DEBUG:teuthology.orchestra.run.smithi134:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-16T03:10:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:done 2023-12-16T03:10:15.167 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi134.front.sepia.ceph.com to complete... 2023-12-16T03:10:15.304 DEBUG:teuthology.orchestra.run.smithi028:> dpkg-deb -c /tmp/linux-image.deb 2023-12-16T03:10:15.311 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-16T03:10:15.312 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-16T03:10:15.312 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-16T03:10:15.322 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-16T03:10:15.322 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-16T03:10:15.343 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-16T03:10:15.344 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-16T03:10:15.345 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-16T03:10:15.346 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-16T03:10:15.346 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-16T03:10:15.346 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-16T03:10:15.346 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-16T03:10:15.346 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-16T03:10:15.410 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-16T03:10:15.410 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-16T03:10:15.410 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-16T03:10:15.410 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-16T03:10:15.410 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-16T03:10:15.410 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-16T03:10:15.410 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-16T03:10:15.410 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-16T03:10:15.410 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-16T03:10:15.410 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-16T03:10:15.411 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-16T03:10:15.412 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-16T03:10:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-16T03:10:15.414 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-16T03:10:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-16T03:10:15.416 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-16T03:10:15.417 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-16T03:10:15.418 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-16T03:10:15.419 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-16T03:10:15.420 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-16T03:10:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-16T03:10:15.422 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-16T03:10:15.423 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-16T03:10:15.424 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-16T03:10:15.425 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-16T03:10:15.426 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-16T03:10:15.427 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-16T03:10:15.428 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-16T03:10:15.429 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-16T03:10:15.430 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-16T03:10:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-16T03:10:15.432 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-16T03:10:15.433 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-16T03:10:15.434 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-16T03:10:15.434 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-16T03:10:15.434 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-16T03:10:15.434 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-16T03:10:15.434 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-16T03:10:15.434 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-16T03:10:15.434 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-16T03:10:15.436 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-16T03:10:15.436 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-16T03:10:15.436 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-16T03:10:15.437 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-16T03:10:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-16T03:10:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-16T03:10:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-16T03:10:15.441 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-16T03:10:15.442 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-16T03:10:15.443 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-16T03:10:15.444 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-16T03:10:15.445 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-16T03:10:15.446 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-16T03:10:15.447 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-16T03:10:15.448 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-16T03:10:15.449 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-16T03:10:15.450 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-16T03:10:15.451 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-16T03:10:15.452 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-16T03:10:15.453 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-16T03:10:15.454 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-16T03:10:15.455 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-16T03:10:15.456 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-16T03:10:15.457 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-16T03:10:15.458 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-16T03:10:15.459 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-16T03:10:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-16T03:10:15.461 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-16T03:10:15.462 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-16T03:10:15.463 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-16T03:10:15.464 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-16T03:10:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-16T03:10:15.466 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-16T03:10:15.467 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-16T03:10:15.468 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-16T03:10:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-16T03:10:15.470 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-16T03:10:15.471 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-16T03:10:15.471 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-16T03:10:15.471 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-16T03:10:15.544 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-16T03:10:15.544 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-16T03:10:15.544 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-16T03:10:15.545 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-16T03:10:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-16T03:10:15.547 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-16T03:10:15.548 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-16T03:10:15.549 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-16T03:10:15.550 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-16T03:10:15.551 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-16T03:10:15.552 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-16T03:10:15.553 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-16T03:10:15.554 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-16T03:10:15.555 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-16T03:10:15.556 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-16T03:10:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-16T03:10:15.558 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-16T03:10:15.559 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-16T03:10:15.560 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-16T03:10:15.561 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-16T03:10:15.562 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-16T03:10:15.563 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-16T03:10:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-16T03:10:15.565 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-16T03:10:15.566 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-16T03:10:15.567 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-16T03:10:15.568 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-16T03:10:15.569 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-16T03:10:15.570 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-16T03:10:15.571 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-16T03:10:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-16T03:10:15.573 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-16T03:10:15.574 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-16T03:10:15.575 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-16T03:10:15.576 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-16T03:10:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-16T03:10:15.578 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-16T03:10:15.579 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-16T03:10:15.580 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-16T03:10:15.581 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-16T03:10:15.582 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-16T03:10:15.583 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-16T03:10:15.584 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-16T03:10:15.585 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-16T03:10:15.586 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-16T03:10:15.587 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-16T03:10:15.588 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-16T03:10:15.589 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-16T03:10:15.590 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-16T03:10:15.591 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-16T03:10:15.592 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-16T03:10:15.593 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-16T03:10:15.594 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-16T03:10:15.595 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-16T03:10:15.596 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-16T03:10:15.597 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-16T03:10:15.598 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-16T03:10:15.599 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-16T03:10:15.600 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-16T03:10:15.601 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-16T03:10:15.601 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-16T03:10:15.601 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-16T03:10:15.601 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-16T03:10:15.601 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-16T03:10:15.601 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-16T03:10:15.601 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-16T03:10:15.601 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-16T03:10:15.601 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-16T03:10:15.601 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-16T03:10:15.601 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-16T03:10:15.602 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-16T03:10:15.603 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-16T03:10:15.604 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-16T03:10:15.605 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-16T03:10:15.606 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-16T03:10:15.607 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-16T03:10:15.608 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-16T03:10:15.609 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-16T03:10:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-16T03:10:15.611 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-16T03:10:15.612 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-16T03:10:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-16T03:10:15.614 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-16T03:10:15.615 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-16T03:10:15.615 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-16T03:10:15.615 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-16T03:10:15.622 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2023-12-16T03:10:15.622 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-16T03:10:15.648 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2023-12-16T03:10:15.661 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-16T03:10:15.661 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-16T03:10:15.661 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-16T03:10:15.661 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-16T03:10:15.661 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-16T03:10:15.661 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-16T03:10:15.662 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-16T03:10:15.662 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-16T03:10:15.662 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-16T03:10:15.662 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-16T03:10:15.662 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-16T03:10:15.662 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-16T03:10:15.662 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-16T03:10:15.662 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-16T03:10:15.662 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-16T03:10:15.662 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-16T03:10:15.663 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-16T03:10:15.664 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-16T03:10:15.665 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-16T03:10:15.665 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-16T03:10:15.665 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-16T03:10:15.665 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-16T03:10:15.665 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-16T03:10:15.665 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-16T03:10:15.665 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-16T03:10:15.665 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-16T03:10:15.665 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-16T03:10:15.665 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-16T03:10:15.666 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-16T03:10:15.667 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-16T03:10:15.668 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-16T03:10:15.669 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-16T03:10:15.669 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-16T03:10:15.669 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-16T03:10:15.669 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-16T03:10:15.669 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-16T03:10:15.669 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-16T03:10:15.669 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-16T03:10:15.669 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-16T03:10:15.669 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-16T03:10:15.669 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-16T03:10:15.669 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-16T03:10:15.670 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-16T03:10:15.671 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-16T03:10:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-16T03:10:15.673 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-16T03:10:15.674 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-16T03:10:15.675 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-16T03:10:15.676 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-16T03:10:15.677 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-16T03:10:15.678 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-16T03:10:15.679 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-16T03:10:15.680 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-16T03:10:15.681 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-16T03:10:15.682 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-16T03:10:15.683 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-16T03:10:15.684 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-16T03:10:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-16T03:10:15.686 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-16T03:10:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-16T03:10:15.688 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-16T03:10:15.689 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-16T03:10:15.690 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-16T03:10:15.691 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-16T03:10:15.692 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-16T03:10:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-16T03:10:15.694 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-16T03:10:15.695 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-16T03:10:15.696 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-16T03:10:15.697 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-16T03:10:15.698 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-16T03:10:15.698 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-16T03:10:15.698 DEBUG:teuthology.orchestra.run.smithi028:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-16T03:10:15.715 INFO:teuthology.orchestra.run.smithi028.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-16T03:10:15.715 INFO:teuthology.orchestra.run.smithi028.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-16T03:10:15.715 INFO:teuthology.orchestra.run.smithi028.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-16T03:10:15.716 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-16T03:10:15.716 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-16T03:10:15.716 DEBUG:teuthology.orchestra.run.smithi028:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-16T03:10:15.759 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi028.front.sepia.ceph.com to complete... 2023-12-16T03:10:15.889 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-16T03:10:15.895 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-16T03:10:16.127 INFO:teuthology.orchestra.run.smithi028.stderr:Sourcing file `/etc/default/grub' 2023-12-16T03:10:16.128 INFO:teuthology.orchestra.run.smithi028.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-16T03:10:16.138 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-16T03:10:16.143 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-16T03:10:16.148 INFO:teuthology.orchestra.run.smithi028.stderr:Generating grub configuration file ... 2023-12-16T03:10:16.183 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-16T03:10:16.187 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-16T03:10:16.306 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-16T03:10:16.306 INFO:teuthology.orchestra.run.smithi134.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-16T03:10:16.306 INFO:teuthology.orchestra.run.smithi134.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-16T03:10:16.325 INFO:teuthology.orchestra.run.smithi134.stderr:done 2023-12-16T03:10:16.338 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-16T03:10:16.344 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-16T03:10:16.593 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-16T03:10:16.599 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-16T03:10:16.641 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-16T03:10:16.646 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-16T03:10:16.790 INFO:teuthology.orchestra.run.smithi028.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-16T03:10:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-16T03:10:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-16T03:10:16.815 INFO:teuthology.orchestra.run.smithi028.stderr:done 2023-12-16T03:10:47.477 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-16T03:10:47.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-16T03:10:47.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:10:47.924 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-16T03:10:47.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-12-16T03:10:47.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:11:47.538 DEBUG:teuthology.orchestra.remote:timed out 2023-12-16T03:11:47.927 DEBUG:teuthology.orchestra.remote:timed out 2023-12-16T03:11:56.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-16T03:11:56.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:11:56.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-12-16T03:11:56.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:11:57.203 DEBUG:teuthology.orchestra.run.smithi028:> true 2023-12-16T03:11:57.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-12-16T03:11:57.868 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gcd68252d7b4d"... 2023-12-16T03:11:57.868 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2023-12-16T03:11:57.916 INFO:teuthology.orchestra.run.smithi028.stdout:6.6.0-gcd68252d7b4d 2023-12-16T03:11:57.917 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-16T03:11:57.917 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T03:11:57.917 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-16T03:11:58.920 DEBUG:teuthology.parallel:result is None 2023-12-16T03:11:59.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-16T03:12:11.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-16T03:12:11.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:12:14.673 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-16T03:12:29.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-16T03:12:29.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:12:29.891 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-12-16T03:12:30.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-16T03:12:30.555 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gcd68252d7b4d"... 2023-12-16T03:12:30.555 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2023-12-16T03:12:30.610 INFO:teuthology.orchestra.run.smithi134.stdout:6.6.0-gcd68252d7b4d 2023-12-16T03:12:30.610 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-16T03:12:30.611 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-16T03:12:30.611 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-16T03:12:31.612 DEBUG:teuthology.parallel:result is None 2023-12-16T03:12:31.612 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-16T03:12:31.621 INFO:teuthology.task.internal:Creating test directory... 2023-12-16T03:12:31.622 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T03:12:31.626 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-16T03:12:31.635 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-16T03:12:31.642 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-16T03:12:31.673 INFO:teuthology.task.internal:Creating archive directory... 2023-12-16T03:12:31.673 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T03:12:31.679 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-16T03:12:31.706 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-16T03:12:31.713 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-16T03:12:31.713 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T03:12:31.739 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-16T03:12:31.832 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T03:12:31.837 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T03:12:31.852 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T03:12:31.856 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-16T03:12:31.859 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-16T03:12:31.866 INFO:teuthology.task.internal:Configuring sudo... 2023-12-16T03:12:31.866 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T03:12:31.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-16T03:12:31.891 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-16T03:12:31.900 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-16T03:12:31.900 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T03:12:31.935 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-16T03:12:31.944 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T03:12:31.993 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T03:12:32.046 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:12:32.046 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T03:12:32.114 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-16T03:12:32.123 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-16T03:12:32.175 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:12:32.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-16T03:12:32.249 DEBUG:teuthology.orchestra.run.smithi028:> sudo service rsyslog restart 2023-12-16T03:12:32.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2023-12-16T03:12:32.388 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-16T03:12:32.396 INFO:teuthology.task.internal:Starting timer... 2023-12-16T03:12:32.397 INFO:teuthology.run_tasks:Running task pcp... 2023-12-16T03:12:32.443 INFO:teuthology.run_tasks:Running task selinux... 2023-12-16T03:12:32.478 DEBUG:teuthology.task.selinux:Excluding smithi028: OS 'ubuntu' does not support SELinux 2023-12-16T03:12:32.478 DEBUG:teuthology.task.selinux:Excluding smithi134: OS 'ubuntu' does not support SELinux 2023-12-16T03:12:32.478 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-16T03:12:32.478 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-16T03:12:32.478 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-16T03:12:32.478 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-16T03:12:32.509 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-16T03:12:32.509 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-16T03:12:32.526 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-16T03:12:32.527 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi028.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-16T03:21:12.482 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi028.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2023-12-16T03:21:12.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-12-16T03:21:12.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:21:12.565 DEBUG:teuthology.orchestra.run.smithi028:> true 2023-12-16T03:21:12.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-12-16T03:21:12.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-16T03:21:12.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T03:21:12.788 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-12-16T03:21:12.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-16T03:21:12.909 INFO:teuthology.run_tasks:Running task clock... 2023-12-16T03:21:12.921 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-16T03:21:12.922 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T03:21:12.922 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T03:21:12.926 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-16T03:21:12.926 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T03:21:12.963 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-16T03:21:12.963 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: Command line: ntpd -gq 2023-12-16T03:21:12.963 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: ---------------------------------------------------- 2023-12-16T03:21:12.964 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: ntp-4 is maintained by Network Time Foundation, 2023-12-16T03:21:12.964 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-16T03:21:12.964 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: corporation. Support and training for ntp-4 are 2023-12-16T03:21:12.964 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: available at https://www.nwtime.org/support 2023-12-16T03:21:12.964 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: ---------------------------------------------------- 2023-12-16T03:21:12.964 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: proto: precision = 0.043 usec (-24) 2023-12-16T03:21:12.965 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: basedate set to 2022-02-04 2023-12-16T03:21:12.965 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: gps base set to 2022-02-06 (week 2196) 2023-12-16T03:21:12.965 INFO:teuthology.orchestra.run.smithi028.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-16T03:21:12.965 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-16T03:21:12.965 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: restrict ::: KOD does nothing without LIMITED. 2023-12-16T03:21:12.966 INFO:teuthology.orchestra.run.smithi028.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-16T03:21:12.967 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: Listen and drop on 0 v6wildcard [::]:123 2023-12-16T03:21:12.967 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-16T03:21:12.967 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: Listen normally on 2 lo 127.0.0.1:123 2023-12-16T03:21:12.967 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: Listen normally on 3 ens1f0 172.21.15.28:123 2023-12-16T03:21:12.967 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: Listen normally on 4 lo [::1]:123 2023-12-16T03:21:12.967 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:ca3c%4]:123 2023-12-16T03:21:12.967 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:12 ntpd[27880]: Listening on routing socket on fd #22 for interface updates 2023-12-16T03:21:12.990 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-16T03:21:13.021 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: Command line: ntpd -gq 2023-12-16T03:21:13.021 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: ---------------------------------------------------- 2023-12-16T03:21:13.021 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: ntp-4 is maintained by Network Time Foundation, 2023-12-16T03:21:13.021 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-16T03:21:13.021 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: corporation. Support and training for ntp-4 are 2023-12-16T03:21:13.021 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: available at https://www.nwtime.org/support 2023-12-16T03:21:13.021 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: ---------------------------------------------------- 2023-12-16T03:21:13.022 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: proto: precision = 0.043 usec (-24) 2023-12-16T03:21:13.022 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: basedate set to 2022-02-04 2023-12-16T03:21:13.022 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: gps base set to 2022-02-06 (week 2196) 2023-12-16T03:21:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-16T03:21:13.023 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-16T03:21:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-16T03:21:13.024 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: restrict ::: KOD does nothing without LIMITED. 2023-12-16T03:21:13.025 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: Listen and drop on 0 v6wildcard [::]:123 2023-12-16T03:21:13.025 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-16T03:21:13.025 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: Listen normally on 2 lo 127.0.0.1:123 2023-12-16T03:21:13.025 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: Listen normally on 3 enp3s0f1 172.21.15.134:123 2023-12-16T03:21:13.025 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: Listen normally on 4 lo [::1]:123 2023-12-16T03:21:13.025 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de9%5]:123 2023-12-16T03:21:13.025 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:12 ntpd[27983]: Listening on routing socket on fd #22 for interface updates 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:13.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:13.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:13.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:13.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:13.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:13.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:13 ntpd[27880]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:14.990 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:14 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:14.991 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:14 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:15.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:15.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:15.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:15.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:15.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:15.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:15.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:15.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:15.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:15.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:15.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:15.967 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:15 ntpd[27880]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:15.991 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:15.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:15.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:15.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:15.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:15.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:15.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:15.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:15.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:15 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:17.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:17 ntpd[27880]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:17.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:17.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:17 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:19.964 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:19.964 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:19.964 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:19.964 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:19.964 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:19.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:19.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:19.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:19.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:19.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:19.965 INFO:teuthology.orchestra.run.smithi028.stdout:16 Dec 03:21:19 ntpd[27880]: ntpd: time slew -0.001928 s 2023-12-16T03:21:19.965 INFO:teuthology.orchestra.run.smithi028.stdout:ntpd: time slew -0.001928s 2023-12-16T03:21:19.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-16T03:21:19.965 INFO:teuthology.orchestra.run.smithi028.stderr:16 Dec 03:21:19 ntpd[27880]: can't open /var/log/ntpstats/loopstats.20231216: Permission denied 2023-12-16T03:21:19.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:19.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:19.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:19.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:19.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:19.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:19.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:19.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:19.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:19.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:19.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:19.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:19.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:19.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:19.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:19.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:19.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:19.994 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:19 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:20.065 INFO:teuthology.orchestra.run.smithi028.stdout: remote refid st t when poll reach delay offset jitter 2023-12-16T03:21:20.065 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================== 2023-12-16T03:21:20.066 INFO:teuthology.orchestra.run.smithi028.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-16T03:21:20.066 INFO:teuthology.orchestra.run.smithi028.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-16T03:21:20.066 INFO:teuthology.orchestra.run.smithi028.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-16T03:21:20.066 INFO:teuthology.orchestra.run.smithi028.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-16T03:21:21.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:21.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:21.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:21.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:21.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:21.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:21.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:21.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:21.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:21.992 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:21.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-16T03:21:21.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231216: Permission denied 2023-12-16T03:21:21.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-16T03:21:21.993 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231216: Permission denied 2023-12-16T03:21:21.993 INFO:teuthology.orchestra.run.smithi134.stdout:16 Dec 03:21:21 ntpd[27983]: ntpd: time slew -0.001102 s 2023-12-16T03:21:21.993 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time slew -0.001102s 2023-12-16T03:21:21.994 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-16T03:21:21.994 INFO:teuthology.orchestra.run.smithi134.stderr:16 Dec 03:21:21 ntpd[27983]: can't open /var/log/ntpstats/loopstats.20231216: Permission denied 2023-12-16T03:21:22.097 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2023-12-16T03:21:22.097 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2023-12-16T03:21:22.098 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-16T03:21:22.098 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-16T03:21:22.098 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-16T03:21:22.098 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-16T03:21:22.099 INFO:teuthology.run_tasks:Running task install... 2023-12-16T03:21:22.111 DEBUG:teuthology.task.install:project ceph 2023-12-16T03:21:22.111 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}} 2023-12-16T03:21:22.111 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'} 2023-12-16T03:21:22.111 INFO:teuthology.task.install:Using flavor: default 2023-12-16T03:21:22.119 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-16T03:21:22.119 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-16T03:21:22.120 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-key list | grep Ceph 2023-12-16T03:21:22.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-key list | grep Ceph 2023-12-16T03:21:22.233 INFO:teuthology.orchestra.run.smithi028.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-16T03:21:22.248 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-16T03:21:22.289 INFO:teuthology.orchestra.run.smithi028.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-16T03:21:22.289 INFO:teuthology.orchestra.run.smithi028.stdout:uid [ unknown] Ceph.com (release key) 2023-12-16T03:21:22.290 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-16T03:21:22.290 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-16T03:21:22.290 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:21:22.301 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-16T03:21:22.301 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph.com (release key) 2023-12-16T03:21:22.302 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-16T03:21:22.302 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-16T03:21:22.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:21:22.516 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default/ 2023-12-16T03:21:22.517 INFO:teuthology.task.install.deb:Package version is 19.0.0-191-g6d933094-1jammy 2023-12-16T03:21:22.532 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default/ 2023-12-16T03:21:22.533 INFO:teuthology.task.install.deb:Package version is 19.0.0-191-g6d933094-1jammy 2023-12-16T03:21:22.640 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:21:22.640 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-16T03:21:22.662 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-get update 2023-12-16T03:21:22.695 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:21:22.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-16T03:21:22.715 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2023-12-16T03:21:22.861 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-16T03:21:22.865 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-16T03:21:22.869 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-16T03:21:22.888 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-16T03:21:22.898 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-16T03:21:22.898 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-16T03:21:22.912 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-16T03:21:22.931 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-16T03:21:22.966 INFO:teuthology.orchestra.run.smithi028.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy InRelease 2023-12-16T03:21:23.062 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-16T03:21:23.062 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy InRelease 2023-12-16T03:21:23.098 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-16T03:21:23.099 INFO:teuthology.orchestra.run.smithi028.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-16T03:21:23.135 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,401 B] 2023-12-16T03:21:23.136 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-16T03:21:23.172 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-16T03:21:23.183 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-16T03:21:23.256 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,401 B] 2023-12-16T03:21:23.491 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 28.5 kB in 1s (47.8 kB/s) 2023-12-16T03:21:23.506 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 28.5 kB in 1s (49.8 kB/s) 2023-12-16T03:21:24.435 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2023-12-16T03:21:24.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-191-g6d933094-1jammy cephadm=19.0.0-191-g6d933094-1jammy ceph-mds=19.0.0-191-g6d933094-1jammy ceph-mgr=19.0.0-191-g6d933094-1jammy ceph-common=19.0.0-191-g6d933094-1jammy ceph-fuse=19.0.0-191-g6d933094-1jammy ceph-test=19.0.0-191-g6d933094-1jammy ceph-volume=19.0.0-191-g6d933094-1jammy radosgw=19.0.0-191-g6d933094-1jammy python3-rados=19.0.0-191-g6d933094-1jammy python3-rgw=19.0.0-191-g6d933094-1jammy python3-cephfs=19.0.0-191-g6d933094-1jammy python3-rbd=19.0.0-191-g6d933094-1jammy libcephfs2=19.0.0-191-g6d933094-1jammy libcephfs-dev=19.0.0-191-g6d933094-1jammy librados2=19.0.0-191-g6d933094-1jammy librbd1=19.0.0-191-g6d933094-1jammy rbd-fuse=19.0.0-191-g6d933094-1jammy python3-cephfs=19.0.0-191-g6d933094-1jammy cephfs-shell=19.0.0-191-g6d933094-1jammy cephfs-top=19.0.0-191-g6d933094-1jammy cephfs-mirror=19.0.0-191-g6d933094-1jammy 2023-12-16T03:21:24.475 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2023-12-16T03:21:24.489 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-191-g6d933094-1jammy cephadm=19.0.0-191-g6d933094-1jammy ceph-mds=19.0.0-191-g6d933094-1jammy ceph-mgr=19.0.0-191-g6d933094-1jammy ceph-common=19.0.0-191-g6d933094-1jammy ceph-fuse=19.0.0-191-g6d933094-1jammy ceph-test=19.0.0-191-g6d933094-1jammy ceph-volume=19.0.0-191-g6d933094-1jammy radosgw=19.0.0-191-g6d933094-1jammy python3-rados=19.0.0-191-g6d933094-1jammy python3-rgw=19.0.0-191-g6d933094-1jammy python3-cephfs=19.0.0-191-g6d933094-1jammy python3-rbd=19.0.0-191-g6d933094-1jammy libcephfs2=19.0.0-191-g6d933094-1jammy libcephfs-dev=19.0.0-191-g6d933094-1jammy librados2=19.0.0-191-g6d933094-1jammy librbd1=19.0.0-191-g6d933094-1jammy rbd-fuse=19.0.0-191-g6d933094-1jammy python3-cephfs=19.0.0-191-g6d933094-1jammy cephfs-shell=19.0.0-191-g6d933094-1jammy cephfs-top=19.0.0-191-g6d933094-1jammy cephfs-mirror=19.0.0-191-g6d933094-1jammy 2023-12-16T03:21:24.524 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2023-12-16T03:21:24.566 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2023-12-16T03:21:24.691 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2023-12-16T03:21:24.692 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2023-12-16T03:21:24.739 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2023-12-16T03:21:24.739 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2023-12-16T03:21:24.846 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2023-12-16T03:21:24.846 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-16T03:21:24.847 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-16T03:21:24.847 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-16T03:21:24.847 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-16T03:21:24.847 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-16T03:21:24.847 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-16T03:21:24.847 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2023-12-16T03:21:24.848 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-16T03:21:24.849 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-16T03:21:24.849 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-16T03:21:24.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-16T03:21:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-16T03:21:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-16T03:21:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-16T03:21:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-16T03:21:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-16T03:21:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-12-16T03:21:24.851 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2023-12-16T03:21:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-16T03:21:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-16T03:21:24.851 INFO:teuthology.orchestra.run.smithi134.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-16T03:21:24.852 INFO:teuthology.orchestra.run.smithi134.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-16T03:21:24.852 INFO:teuthology.orchestra.run.smithi134.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-16T03:21:24.852 INFO:teuthology.orchestra.run.smithi134.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-16T03:21:24.852 INFO:teuthology.orchestra.run.smithi134.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-16T03:21:24.852 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2023-12-16T03:21:24.852 INFO:teuthology.orchestra.run.smithi134.stdout: btrfs-tools 2023-12-16T03:21:24.901 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2023-12-16T03:21:24.901 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-16T03:21:24.901 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-16T03:21:24.901 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-16T03:21:24.901 INFO:teuthology.orchestra.run.smithi028.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-16T03:21:24.902 INFO:teuthology.orchestra.run.smithi028.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-16T03:21:24.902 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-16T03:21:24.902 INFO:teuthology.orchestra.run.smithi028.stdout:The following additional packages will be installed: 2023-12-16T03:21:24.902 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-16T03:21:24.902 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-16T03:21:24.902 INFO:teuthology.orchestra.run.smithi028.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-16T03:21:24.902 INFO:teuthology.orchestra.run.smithi028.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-16T03:21:24.904 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-16T03:21:24.904 INFO:teuthology.orchestra.run.smithi028.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-16T03:21:24.904 INFO:teuthology.orchestra.run.smithi028.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-16T03:21:24.904 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-16T03:21:24.904 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-16T03:21:24.904 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-16T03:21:24.904 INFO:teuthology.orchestra.run.smithi028.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-16T03:21:24.904 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-12-16T03:21:24.905 INFO:teuthology.orchestra.run.smithi028.stdout:Suggested packages: 2023-12-16T03:21:24.906 INFO:teuthology.orchestra.run.smithi028.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-16T03:21:24.906 INFO:teuthology.orchestra.run.smithi028.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-16T03:21:24.906 INFO:teuthology.orchestra.run.smithi028.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-16T03:21:24.906 INFO:teuthology.orchestra.run.smithi028.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-16T03:21:24.906 INFO:teuthology.orchestra.run.smithi028.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-16T03:21:24.906 INFO:teuthology.orchestra.run.smithi028.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-16T03:21:24.906 INFO:teuthology.orchestra.run.smithi028.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-16T03:21:24.906 INFO:teuthology.orchestra.run.smithi028.stdout:Recommended packages: 2023-12-16T03:21:24.906 INFO:teuthology.orchestra.run.smithi028.stdout: btrfs-tools 2023-12-16T03:21:24.998 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2023-12-16T03:21:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-16T03:21:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-16T03:21:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-16T03:21:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-16T03:21:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-16T03:21:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-16T03:21:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-16T03:21:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-16T03:21:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-16T03:21:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-16T03:21:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-16T03:21:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-16T03:21:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-16T03:21:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-16T03:21:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: socat unzip xmlstarlet zip 2023-12-16T03:21:25.057 INFO:teuthology.orchestra.run.smithi028.stdout:The following NEW packages will be installed: 2023-12-16T03:21:25.057 INFO:teuthology.orchestra.run.smithi028.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-16T03:21:25.057 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-16T03:21:25.057 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-16T03:21:25.057 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-16T03:21:25.059 INFO:teuthology.orchestra.run.smithi028.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-16T03:21:25.059 INFO:teuthology.orchestra.run.smithi028.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-16T03:21:25.059 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-12-16T03:21:25.059 INFO:teuthology.orchestra.run.smithi028.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-16T03:21:25.059 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-16T03:21:25.059 INFO:teuthology.orchestra.run.smithi028.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-16T03:21:25.059 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-16T03:21:25.059 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-16T03:21:25.059 INFO:teuthology.orchestra.run.smithi028.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-16T03:21:25.059 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-16T03:21:25.060 INFO:teuthology.orchestra.run.smithi028.stdout: socat unzip xmlstarlet zip 2023-12-16T03:21:25.074 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 124 newly installed, 0 to remove and 268 not upgraded. 2023-12-16T03:21:25.074 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 187 MB of archives. 2023-12-16T03:21:25.074 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 835 MB of additional disk space will be used. 2023-12-16T03:21:25.074 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-16T03:21:25.095 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-16T03:21:25.106 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-16T03:21:25.154 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-16T03:21:25.178 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-16T03:21:25.181 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-16T03:21:25.193 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-16T03:21:25.225 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-191-g6d933094-1jammy [3,468 kB] 2023-12-16T03:21:25.238 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-16T03:21:25.240 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-16T03:21:25.248 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-16T03:21:25.251 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-16T03:21:25.252 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-16T03:21:25.259 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-16T03:21:25.261 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-16T03:21:25.263 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-16T03:21:25.264 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-16T03:21:25.264 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-16T03:21:25.281 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-16T03:21:25.282 INFO:teuthology.orchestra.run.smithi028.stdout:0 upgraded, 124 newly installed, 0 to remove and 268 not upgraded. 2023-12-16T03:21:25.282 INFO:teuthology.orchestra.run.smithi028.stdout:Need to get 187 MB of archives. 2023-12-16T03:21:25.282 INFO:teuthology.orchestra.run.smithi028.stdout:After this operation, 835 MB of additional disk space will be used. 2023-12-16T03:21:25.282 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-16T03:21:25.283 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-16T03:21:25.284 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-16T03:21:25.284 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-16T03:21:25.286 INFO:teuthology.orchestra.run.smithi028.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-191-g6d933094-1jammy [3,468 kB] 2023-12-16T03:21:25.300 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-16T03:21:25.302 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-16T03:21:25.302 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-16T03:21:25.302 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-16T03:21:25.302 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-16T03:21:25.303 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-16T03:21:25.321 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-16T03:21:25.321 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-16T03:21:25.323 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-16T03:21:25.324 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-16T03:21:25.340 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-16T03:21:25.340 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-16T03:21:25.341 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-16T03:21:25.342 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-16T03:21:25.342 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-16T03:21:25.343 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-16T03:21:25.359 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-16T03:21:25.360 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-16T03:21:25.365 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-16T03:21:25.365 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-16T03:21:25.379 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-16T03:21:25.380 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-16T03:21:25.381 INFO:teuthology.orchestra.run.smithi134.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-16T03:21:25.383 INFO:teuthology.orchestra.run.smithi134.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-16T03:21:25.383 INFO:teuthology.orchestra.run.smithi134.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-16T03:21:25.385 INFO:teuthology.orchestra.run.smithi134.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-16T03:21:25.399 INFO:teuthology.orchestra.run.smithi134.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-16T03:21:25.401 INFO:teuthology.orchestra.run.smithi134.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-16T03:21:25.402 INFO:teuthology.orchestra.run.smithi134.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-16T03:21:25.403 INFO:teuthology.orchestra.run.smithi134.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-16T03:21:25.418 INFO:teuthology.orchestra.run.smithi134.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-16T03:21:25.471 INFO:teuthology.orchestra.run.smithi134.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-16T03:21:25.472 INFO:teuthology.orchestra.run.smithi134.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-16T03:21:25.473 INFO:teuthology.orchestra.run.smithi134.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-16T03:21:25.474 INFO:teuthology.orchestra.run.smithi134.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-16T03:21:25.475 INFO:teuthology.orchestra.run.smithi134.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-16T03:21:25.495 INFO:teuthology.orchestra.run.smithi134.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-16T03:21:25.498 INFO:teuthology.orchestra.run.smithi134.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-16T03:21:25.498 INFO:teuthology.orchestra.run.smithi134.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-16T03:21:25.517 INFO:teuthology.orchestra.run.smithi134.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-16T03:21:25.518 INFO:teuthology.orchestra.run.smithi134.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-16T03:21:25.529 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-16T03:21:25.529 INFO:teuthology.orchestra.run.smithi134.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-16T03:21:25.530 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-16T03:21:25.530 INFO:teuthology.orchestra.run.smithi134.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-16T03:21:25.530 INFO:teuthology.orchestra.run.smithi134.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-16T03:21:25.531 INFO:teuthology.orchestra.run.smithi134.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-16T03:21:25.532 INFO:teuthology.orchestra.run.smithi134.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-16T03:21:25.532 INFO:teuthology.orchestra.run.smithi134.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-16T03:21:25.536 INFO:teuthology.orchestra.run.smithi134.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-16T03:21:25.549 INFO:teuthology.orchestra.run.smithi134.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-16T03:21:25.550 INFO:teuthology.orchestra.run.smithi134.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-16T03:21:25.551 INFO:teuthology.orchestra.run.smithi134.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-16T03:21:25.569 INFO:teuthology.orchestra.run.smithi134.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-16T03:21:25.572 INFO:teuthology.orchestra.run.smithi134.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-16T03:21:25.572 INFO:teuthology.orchestra.run.smithi134.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-16T03:21:25.574 INFO:teuthology.orchestra.run.smithi134.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-16T03:21:25.575 INFO:teuthology.orchestra.run.smithi134.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-16T03:21:25.580 INFO:teuthology.orchestra.run.smithi134.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-16T03:21:25.580 INFO:teuthology.orchestra.run.smithi134.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-16T03:21:25.588 INFO:teuthology.orchestra.run.smithi134.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-16T03:21:25.588 INFO:teuthology.orchestra.run.smithi134.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-16T03:21:25.589 INFO:teuthology.orchestra.run.smithi134.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-16T03:21:25.608 INFO:teuthology.orchestra.run.smithi134.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-16T03:21:25.610 INFO:teuthology.orchestra.run.smithi134.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-16T03:21:25.611 INFO:teuthology.orchestra.run.smithi134.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-16T03:21:25.619 INFO:teuthology.orchestra.run.smithi134.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-16T03:21:25.619 INFO:teuthology.orchestra.run.smithi134.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-16T03:21:25.619 INFO:teuthology.orchestra.run.smithi134.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-16T03:21:25.622 INFO:teuthology.orchestra.run.smithi134.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-16T03:21:25.627 INFO:teuthology.orchestra.run.smithi134.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-16T03:21:25.697 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-16T03:21:25.736 INFO:teuthology.orchestra.run.smithi134.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-191-g6d933094-1jammy [3,109 kB] 2023-12-16T03:21:25.805 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-191-g6d933094-1jammy [3,109 kB] 2023-12-16T03:21:25.809 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-16T03:21:25.825 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-16T03:21:25.878 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-16T03:21:25.961 INFO:teuthology.orchestra.run.smithi134.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-191-g6d933094-1jammy [690 kB] 2023-12-16T03:21:25.996 INFO:teuthology.orchestra.run.smithi028.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-191-g6d933094-1jammy [690 kB] 2023-12-16T03:21:26.003 INFO:teuthology.orchestra.run.smithi134.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-191-g6d933094-1jammy [356 kB] 2023-12-16T03:21:26.014 INFO:teuthology.orchestra.run.smithi134.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-191-g6d933094-1jammy [32.8 kB] 2023-12-16T03:21:26.015 INFO:teuthology.orchestra.run.smithi134.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-191-g6d933094-1jammy [180 kB] 2023-12-16T03:21:26.039 INFO:teuthology.orchestra.run.smithi028.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-191-g6d933094-1jammy [356 kB] 2023-12-16T03:21:26.042 INFO:teuthology.orchestra.run.smithi134.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-191-g6d933094-1jammy [64.1 kB] 2023-12-16T03:21:26.044 INFO:teuthology.orchestra.run.smithi134.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-191-g6d933094-1jammy [330 kB] 2023-12-16T03:21:26.055 INFO:teuthology.orchestra.run.smithi134.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-191-g6d933094-1jammy [6,214 kB] 2023-12-16T03:21:26.061 INFO:teuthology.orchestra.run.smithi028.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-16T03:21:26.072 INFO:teuthology.orchestra.run.smithi028.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-16T03:21:26.072 INFO:teuthology.orchestra.run.smithi028.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-191-g6d933094-1jammy [32.8 kB] 2023-12-16T03:21:26.073 INFO:teuthology.orchestra.run.smithi028.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-191-g6d933094-1jammy [180 kB] 2023-12-16T03:21:26.078 INFO:teuthology.orchestra.run.smithi028.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-191-g6d933094-1jammy [64.1 kB] 2023-12-16T03:21:26.080 INFO:teuthology.orchestra.run.smithi028.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-191-g6d933094-1jammy [330 kB] 2023-12-16T03:21:26.100 INFO:teuthology.orchestra.run.smithi028.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-16T03:21:26.110 INFO:teuthology.orchestra.run.smithi028.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-16T03:21:26.115 INFO:teuthology.orchestra.run.smithi028.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-191-g6d933094-1jammy [6,214 kB] 2023-12-16T03:21:26.298 INFO:teuthology.orchestra.run.smithi028.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-16T03:21:26.469 INFO:teuthology.orchestra.run.smithi134.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-191-g6d933094-1jammy [112 kB] 2023-12-16T03:21:26.470 INFO:teuthology.orchestra.run.smithi134.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-191-g6d933094-1jammy [439 kB] 2023-12-16T03:21:26.484 INFO:teuthology.orchestra.run.smithi134.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-191-g6d933094-1jammy [22.7 MB] 2023-12-16T03:21:26.515 INFO:teuthology.orchestra.run.smithi028.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-191-g6d933094-1jammy [112 kB] 2023-12-16T03:21:26.517 INFO:teuthology.orchestra.run.smithi028.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-191-g6d933094-1jammy [439 kB] 2023-12-16T03:21:26.565 INFO:teuthology.orchestra.run.smithi028.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-191-g6d933094-1jammy [22.7 MB] 2023-12-16T03:21:27.058 INFO:teuthology.orchestra.run.smithi028.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-16T03:21:27.075 INFO:teuthology.orchestra.run.smithi028.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-16T03:21:27.092 INFO:teuthology.orchestra.run.smithi028.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-16T03:21:27.101 INFO:teuthology.orchestra.run.smithi028.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-16T03:21:27.102 INFO:teuthology.orchestra.run.smithi028.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-16T03:21:27.144 INFO:teuthology.orchestra.run.smithi028.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-16T03:21:27.161 INFO:teuthology.orchestra.run.smithi028.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-16T03:21:27.176 INFO:teuthology.orchestra.run.smithi028.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-16T03:21:27.181 INFO:teuthology.orchestra.run.smithi028.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-16T03:21:27.182 INFO:teuthology.orchestra.run.smithi028.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-16T03:21:27.357 INFO:teuthology.orchestra.run.smithi028.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-16T03:21:27.445 INFO:teuthology.orchestra.run.smithi028.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-16T03:21:27.469 INFO:teuthology.orchestra.run.smithi028.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-16T03:21:27.537 INFO:teuthology.orchestra.run.smithi028.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-16T03:21:27.584 INFO:teuthology.orchestra.run.smithi028.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-16T03:21:27.607 INFO:teuthology.orchestra.run.smithi028.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-16T03:21:27.634 INFO:teuthology.orchestra.run.smithi028.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-16T03:21:27.855 INFO:teuthology.orchestra.run.smithi028.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-16T03:21:27.878 INFO:teuthology.orchestra.run.smithi028.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-16T03:21:27.889 INFO:teuthology.orchestra.run.smithi028.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-16T03:21:27.896 INFO:teuthology.orchestra.run.smithi028.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-16T03:21:27.977 INFO:teuthology.orchestra.run.smithi134.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-191-g6d933094-1jammy [6,899 kB] 2023-12-16T03:21:28.085 INFO:teuthology.orchestra.run.smithi028.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-16T03:21:28.097 INFO:teuthology.orchestra.run.smithi028.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-191-g6d933094-1jammy [6,899 kB] 2023-12-16T03:21:28.168 INFO:teuthology.orchestra.run.smithi028.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-16T03:21:28.183 INFO:teuthology.orchestra.run.smithi028.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-16T03:21:28.370 INFO:teuthology.orchestra.run.smithi028.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-16T03:21:28.393 INFO:teuthology.orchestra.run.smithi134.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-191-g6d933094-1jammy [238 kB] 2023-12-16T03:21:28.421 INFO:teuthology.orchestra.run.smithi028.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-16T03:21:28.433 INFO:teuthology.orchestra.run.smithi028.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-16T03:21:28.438 INFO:teuthology.orchestra.run.smithi134.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-191-g6d933094-1jammy [124 kB] 2023-12-16T03:21:28.440 INFO:teuthology.orchestra.run.smithi134.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-191-g6d933094-1jammy [1,493 kB] 2023-12-16T03:21:28.540 INFO:teuthology.orchestra.run.smithi134.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-191-g6d933094-1jammy [9,959 kB] 2023-12-16T03:21:28.570 INFO:teuthology.orchestra.run.smithi028.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-191-g6d933094-1jammy [238 kB] 2023-12-16T03:21:28.572 INFO:teuthology.orchestra.run.smithi028.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-191-g6d933094-1jammy [124 kB] 2023-12-16T03:21:28.573 INFO:teuthology.orchestra.run.smithi028.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-191-g6d933094-1jammy [1,493 kB] 2023-12-16T03:21:28.599 INFO:teuthology.orchestra.run.smithi028.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-16T03:21:28.600 INFO:teuthology.orchestra.run.smithi028.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-16T03:21:28.605 INFO:teuthology.orchestra.run.smithi028.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-16T03:21:28.610 INFO:teuthology.orchestra.run.smithi028.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-16T03:21:28.626 INFO:teuthology.orchestra.run.smithi028.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-16T03:21:28.685 INFO:teuthology.orchestra.run.smithi028.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-191-g6d933094-1jammy [9,959 kB] 2023-12-16T03:21:28.828 INFO:teuthology.orchestra.run.smithi028.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-16T03:21:29.113 INFO:teuthology.orchestra.run.smithi028.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-16T03:21:29.163 INFO:teuthology.orchestra.run.smithi134.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-191-g6d933094-1jammy [31.9 MB] 2023-12-16T03:21:29.253 INFO:teuthology.orchestra.run.smithi028.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-16T03:21:29.300 INFO:teuthology.orchestra.run.smithi028.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-16T03:21:29.361 INFO:teuthology.orchestra.run.smithi028.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-191-g6d933094-1jammy [31.9 MB] 2023-12-16T03:21:29.395 INFO:teuthology.orchestra.run.smithi028.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-16T03:21:29.405 INFO:teuthology.orchestra.run.smithi028.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-16T03:21:29.419 INFO:teuthology.orchestra.run.smithi028.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-16T03:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-16T03:21:29.748 INFO:teuthology.orchestra.run.smithi028.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-16T03:21:29.749 INFO:teuthology.orchestra.run.smithi028.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-16T03:21:29.751 INFO:teuthology.orchestra.run.smithi028.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-16T03:21:29.945 INFO:teuthology.orchestra.run.smithi028.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-16T03:21:30.334 INFO:teuthology.orchestra.run.smithi028.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-16T03:21:30.761 INFO:teuthology.orchestra.run.smithi028.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-16T03:21:30.771 INFO:teuthology.orchestra.run.smithi028.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-16T03:21:30.771 INFO:teuthology.orchestra.run.smithi028.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-16T03:21:30.851 INFO:teuthology.orchestra.run.smithi028.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-16T03:21:30.852 INFO:teuthology.orchestra.run.smithi028.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-16T03:21:30.852 INFO:teuthology.orchestra.run.smithi028.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-16T03:21:30.853 INFO:teuthology.orchestra.run.smithi028.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-16T03:21:30.854 INFO:teuthology.orchestra.run.smithi028.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-16T03:21:30.855 INFO:teuthology.orchestra.run.smithi028.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-16T03:21:31.046 INFO:teuthology.orchestra.run.smithi028.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-16T03:21:31.218 INFO:teuthology.orchestra.run.smithi134.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-191-g6d933094-1jammy [14.1 kB] 2023-12-16T03:21:31.219 INFO:teuthology.orchestra.run.smithi134.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-191-g6d933094-1jammy [839 kB] 2023-12-16T03:21:31.256 INFO:teuthology.orchestra.run.smithi028.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-16T03:21:31.276 INFO:teuthology.orchestra.run.smithi134.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-191-g6d933094-1jammy [2,146 kB] 2023-12-16T03:21:31.399 INFO:teuthology.orchestra.run.smithi134.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-191-g6d933094-1jammy [836 kB] 2023-12-16T03:21:31.462 INFO:teuthology.orchestra.run.smithi028.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-191-g6d933094-1jammy [14.1 kB] 2023-12-16T03:21:31.463 INFO:teuthology.orchestra.run.smithi028.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-191-g6d933094-1jammy [839 kB] 2023-12-16T03:21:31.467 INFO:teuthology.orchestra.run.smithi134.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-191-g6d933094-1jammy [139 kB] 2023-12-16T03:21:31.477 INFO:teuthology.orchestra.run.smithi134.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-191-g6d933094-1jammy [1,905 kB] 2023-12-16T03:21:31.527 INFO:teuthology.orchestra.run.smithi028.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-191-g6d933094-1jammy [2,146 kB] 2023-12-16T03:21:31.601 INFO:teuthology.orchestra.run.smithi028.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-16T03:21:31.652 INFO:teuthology.orchestra.run.smithi028.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-16T03:21:31.669 INFO:teuthology.orchestra.run.smithi134.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-191-g6d933094-1jammy [8,625 kB] 2023-12-16T03:21:31.682 INFO:teuthology.orchestra.run.smithi028.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-16T03:21:31.692 INFO:teuthology.orchestra.run.smithi028.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-16T03:21:31.709 INFO:teuthology.orchestra.run.smithi028.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-191-g6d933094-1jammy [836 kB] 2023-12-16T03:21:31.716 INFO:teuthology.orchestra.run.smithi028.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-191-g6d933094-1jammy [139 kB] 2023-12-16T03:21:31.717 INFO:teuthology.orchestra.run.smithi028.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-191-g6d933094-1jammy [1,905 kB] 2023-12-16T03:21:31.744 INFO:teuthology.orchestra.run.smithi028.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-16T03:21:31.774 INFO:teuthology.orchestra.run.smithi028.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-16T03:21:31.777 INFO:teuthology.orchestra.run.smithi028.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-16T03:21:31.785 INFO:teuthology.orchestra.run.smithi028.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-16T03:21:31.789 INFO:teuthology.orchestra.run.smithi028.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-16T03:21:31.844 INFO:teuthology.orchestra.run.smithi028.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-191-g6d933094-1jammy [8,625 kB] 2023-12-16T03:21:32.024 INFO:teuthology.orchestra.run.smithi028.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-16T03:21:32.155 INFO:teuthology.orchestra.run.smithi134.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-191-g6d933094-1jammy [14.2 kB] 2023-12-16T03:21:32.156 INFO:teuthology.orchestra.run.smithi134.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-191-g6d933094-1jammy [48.6 MB] 2023-12-16T03:21:32.368 INFO:teuthology.orchestra.run.smithi028.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-16T03:21:32.415 INFO:teuthology.orchestra.run.smithi028.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-191-g6d933094-1jammy [14.2 kB] 2023-12-16T03:21:32.415 INFO:teuthology.orchestra.run.smithi028.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-191-g6d933094-1jammy [48.6 MB] 2023-12-16T03:21:32.641 INFO:teuthology.orchestra.run.smithi028.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-16T03:21:32.644 INFO:teuthology.orchestra.run.smithi028.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-16T03:21:32.662 INFO:teuthology.orchestra.run.smithi028.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-16T03:21:32.667 INFO:teuthology.orchestra.run.smithi028.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-16T03:21:32.708 INFO:teuthology.orchestra.run.smithi028.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-16T03:21:32.723 INFO:teuthology.orchestra.run.smithi028.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-16T03:21:32.826 INFO:teuthology.orchestra.run.smithi028.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-16T03:21:32.828 INFO:teuthology.orchestra.run.smithi028.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-16T03:21:32.829 INFO:teuthology.orchestra.run.smithi028.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-16T03:21:33.031 INFO:teuthology.orchestra.run.smithi028.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-16T03:21:33.382 INFO:teuthology.orchestra.run.smithi028.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-16T03:21:35.350 INFO:teuthology.orchestra.run.smithi134.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-191-g6d933094-1jammy [121 kB] 2023-12-16T03:21:35.351 INFO:teuthology.orchestra.run.smithi134.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-191-g6d933094-1jammy [225 kB] 2023-12-16T03:21:35.353 INFO:teuthology.orchestra.run.smithi134.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-191-g6d933094-1jammy [34.0 kB] 2023-12-16T03:21:35.353 INFO:teuthology.orchestra.run.smithi134.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-191-g6d933094-1jammy [23.4 kB] 2023-12-16T03:21:35.354 INFO:teuthology.orchestra.run.smithi134.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-191-g6d933094-1jammy [38.3 kB] 2023-12-16T03:21:35.354 INFO:teuthology.orchestra.run.smithi134.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-191-g6d933094-1jammy [12.3 MB] 2023-12-16T03:21:35.656 INFO:teuthology.orchestra.run.smithi028.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-191-g6d933094-1jammy [121 kB] 2023-12-16T03:21:35.657 INFO:teuthology.orchestra.run.smithi028.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-191-g6d933094-1jammy [225 kB] 2023-12-16T03:21:35.659 INFO:teuthology.orchestra.run.smithi028.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-191-g6d933094-1jammy [34.0 kB] 2023-12-16T03:21:35.660 INFO:teuthology.orchestra.run.smithi028.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-191-g6d933094-1jammy [23.4 kB] 2023-12-16T03:21:35.660 INFO:teuthology.orchestra.run.smithi028.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-191-g6d933094-1jammy [38.3 kB] 2023-12-16T03:21:35.660 INFO:teuthology.orchestra.run.smithi028.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-191-g6d933094-1jammy [12.3 MB] 2023-12-16T03:21:36.153 INFO:teuthology.orchestra.run.smithi134.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-191-g6d933094-1jammy [91.4 kB] 2023-12-16T03:21:36.322 INFO:teuthology.orchestra.run.smithi028.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/main/6d933094a156ec7587742e5aa25fba5ba27ec678/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-191-g6d933094-1jammy [91.4 kB] 2023-12-16T03:21:36.790 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 187 MB in 11s (16.8 MB/s) 2023-12-16T03:21:36.982 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 187 MB in 11s (16.6 MB/s) 2023-12-16T03:21:36.998 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-16T03:21:37.067 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-16T03:21:37.070 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-16T03:21:37.121 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-16T03:21:37.129 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-16T03:21:37.200 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-16T03:21:37.204 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-16T03:21:37.261 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-16T03:21:37.491 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-16T03:21:37.504 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-16T03:21:37.541 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-16T03:21:37.565 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-16T03:21:37.578 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-16T03:21:37.622 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-16T03:21:37.891 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cmd2. 2023-12-16T03:21:37.905 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-16T03:21:37.935 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cmd2. 2023-12-16T03:21:37.941 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-16T03:21:37.949 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-16T03:21:38.002 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-16T03:21:38.353 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-16T03:21:38.367 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-16T03:21:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-16T03:21:38.444 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-16T03:21:38.445 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-16T03:21:38.547 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-16T03:21:38.756 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-16T03:21:38.771 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-16T03:21:38.839 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-16T03:21:38.959 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-16T03:21:38.973 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-16T03:21:39.042 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-16T03:21:39.167 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-16T03:21:39.182 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-16T03:21:39.225 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-16T03:21:39.437 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-16T03:21:39.451 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-16T03:21:39.503 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-16T03:21:39.612 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-16T03:21:39.627 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-16T03:21:39.670 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:21:39.990 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-16T03:21:39.998 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-16T03:21:40.005 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-16T03:21:40.013 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-16T03:21:40.048 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:21:40.073 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:21:40.384 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-16T03:21:40.399 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-16T03:21:40.442 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:21:40.568 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-16T03:21:40.582 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-16T03:21:40.635 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:21:40.829 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-16T03:21:40.844 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-16T03:21:40.887 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-16T03:21:41.165 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librados2. 2023-12-16T03:21:41.180 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../010-librados2_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:41.213 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-16T03:21:41.223 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librados2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:41.227 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-16T03:21:41.279 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:21:41.634 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librbd1. 2023-12-16T03:21:41.649 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../011-librbd1_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:41.649 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-16T03:21:41.664 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-16T03:21:41.692 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librbd1 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:41.716 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-16T03:21:42.103 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libcephfs2. 2023-12-16T03:21:42.118 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:42.127 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librados2. 2023-12-16T03:21:42.142 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../010-librados2_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:42.153 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libcephfs2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:42.194 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librados2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:42.355 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rados. 2023-12-16T03:21:42.370 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../013-python3-rados_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:42.405 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rados (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:42.716 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-16T03:21:42.730 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librbd1. 2023-12-16T03:21:42.731 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:21:42.745 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../011-librbd1_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:42.774 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-ceph-argparse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:42.788 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librbd1 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:43.035 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cephfs. 2023-12-16T03:21:43.050 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:43.093 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cephfs (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:43.183 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs2. 2023-12-16T03:21:43.197 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:43.232 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:43.404 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-16T03:21:43.419 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:21:43.462 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-ceph-common (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:43.510 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rados. 2023-12-16T03:21:43.525 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../013-python3-rados_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:43.568 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rados (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:43.791 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-prettytable. 2023-12-16T03:21:43.806 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-16T03:21:43.840 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-16T03:21:43.904 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-16T03:21:43.919 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:21:43.962 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-argparse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:44.059 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rbd. 2023-12-16T03:21:44.074 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:44.118 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rbd (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:44.215 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cephfs. 2023-12-16T03:21:44.230 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:44.273 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cephfs (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:44.479 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-16T03:21:44.494 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-16T03:21:44.537 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-16T03:21:44.568 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-16T03:21:44.583 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:21:44.617 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-common (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:44.823 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-16T03:21:44.838 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-16T03:21:44.881 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-16T03:21:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-prettytable. 2023-12-16T03:21:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-16T03:21:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-16T03:21:45.184 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-16T03:21:45.199 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-16T03:21:45.234 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-16T03:21:45.298 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rbd. 2023-12-16T03:21:45.313 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:45.356 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rbd (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:45.562 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua5.1. 2023-12-16T03:21:45.578 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-16T03:21:45.620 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-16T03:21:45.659 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-16T03:21:45.674 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-16T03:21:45.717 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-16T03:21:45.907 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-any. 2023-12-16T03:21:45.921 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-16T03:21:45.956 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-16T03:21:46.128 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-16T03:21:46.143 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-16T03:21:46.189 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-16T03:21:46.192 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package zip. 2023-12-16T03:21:46.207 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-16T03:21:46.250 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking zip (3.0-12build2) ... 2023-12-16T03:21:46.489 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-16T03:21:46.504 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-16T03:21:46.547 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-16T03:21:46.570 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package unzip. 2023-12-16T03:21:46.585 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-16T03:21:46.653 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-16T03:21:46.876 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua5.1. 2023-12-16T03:21:46.891 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-16T03:21:46.926 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-16T03:21:47.099 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package luarocks. 2023-12-16T03:21:47.114 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-16T03:21:47.156 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-16T03:21:47.246 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-any. 2023-12-16T03:21:47.261 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-16T03:21:47.304 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-16T03:21:47.514 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librgw2. 2023-12-16T03:21:47.528 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../027-librgw2_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:47.539 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package zip. 2023-12-16T03:21:47.554 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-16T03:21:47.564 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librgw2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:47.598 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking zip (3.0-12build2) ... 2023-12-16T03:21:47.909 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package unzip. 2023-12-16T03:21:47.924 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-16T03:21:47.958 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rgw. 2023-12-16T03:21:47.972 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:47.993 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-16T03:21:48.016 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rgw (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:48.321 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package luarocks. 2023-12-16T03:21:48.336 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-16T03:21:48.371 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-16T03:21:48.385 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-16T03:21:48.400 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-16T03:21:48.452 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-16T03:21:48.705 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libradosstriper1. 2023-12-16T03:21:48.720 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:48.755 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libradosstriper1 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:48.787 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librgw2. 2023-12-16T03:21:48.801 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../027-librgw2_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:48.845 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librgw2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:49.149 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-common. 2023-12-16T03:21:49.165 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../031-ceph-common_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:49.208 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-common (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:49.272 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rgw. 2023-12-16T03:21:49.286 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:49.348 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rgw (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:49.684 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-16T03:21:49.698 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-16T03:21:49.751 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-16T03:21:50.089 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libradosstriper1. 2023-12-16T03:21:50.102 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:50.153 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libradosstriper1 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:50.246 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-base. 2023-12-16T03:21:50.261 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../032-ceph-base_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:50.305 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-base (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:50.515 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-common. 2023-12-16T03:21:50.529 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../031-ceph-common_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:50.564 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-common (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:51.250 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-16T03:21:51.266 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-16T03:21:51.308 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-16T03:21:51.636 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cheroot. 2023-12-16T03:21:51.651 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-16T03:21:51.694 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-16T03:21:51.788 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-base. 2023-12-16T03:21:51.803 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../032-ceph-base_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:21:51.856 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-base (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:21:52.006 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-16T03:21:52.021 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-16T03:21:52.064 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-16T03:21:52.308 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-16T03:21:52.323 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-16T03:21:52.358 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-16T03:21:52.550 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-16T03:21:52.565 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-16T03:21:52.609 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-16T03:21:52.644 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-16T03:21:52.659 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-16T03:21:52.703 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-16T03:21:52.928 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cheroot. 2023-12-16T03:21:52.943 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-16T03:21:52.979 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-16T03:21:53.030 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-tempora. 2023-12-16T03:21:53.045 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-16T03:21:53.088 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-16T03:21:53.265 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-16T03:21:53.280 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-16T03:21:53.323 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-16T03:21:53.350 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-portend. 2023-12-16T03:21:53.364 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-16T03:21:53.399 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-16T03:21:53.643 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-16T03:21:53.659 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-16T03:21:53.659 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-16T03:21:53.674 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-16T03:21:53.693 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-16T03:21:53.717 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-16T03:21:53.998 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-16T03:21:54.013 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-16T03:21:54.020 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-16T03:21:54.036 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-16T03:21:54.056 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-16T03:21:54.079 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-16T03:21:54.398 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempora. 2023-12-16T03:21:54.409 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-natsort. 2023-12-16T03:21:54.413 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-16T03:21:54.424 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-16T03:21:54.448 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-16T03:21:54.493 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-16T03:21:54.734 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-portend. 2023-12-16T03:21:54.749 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-16T03:21:54.792 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-16T03:21:54.821 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-logutils. 2023-12-16T03:21:54.836 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-16T03:21:54.879 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-16T03:21:55.129 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-16T03:21:55.144 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-16T03:21:55.165 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-16T03:21:55.181 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-16T03:21:55.186 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-16T03:21:55.215 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-16T03:21:55.451 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-mako. 2023-12-16T03:21:55.466 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-16T03:21:55.489 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-16T03:21:55.501 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-16T03:21:55.504 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-16T03:21:55.547 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-16T03:21:55.812 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-16T03:21:55.828 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-16T03:21:55.870 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-16T03:21:55.918 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-natsort. 2023-12-16T03:21:55.933 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-16T03:21:55.976 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-16T03:21:56.182 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-16T03:21:56.198 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-16T03:21:56.240 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-16T03:21:56.317 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-logutils. 2023-12-16T03:21:56.332 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-16T03:21:56.379 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-16T03:21:56.526 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-webob. 2023-12-16T03:21:56.542 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-16T03:21:56.584 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-16T03:21:56.657 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-16T03:21:56.672 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-16T03:21:56.707 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-16T03:21:56.903 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-waitress. 2023-12-16T03:21:56.919 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-16T03:21:56.956 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-16T03:21:57.009 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-mako. 2023-12-16T03:21:57.025 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-16T03:21:57.067 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-16T03:21:57.231 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-tempita. 2023-12-16T03:21:57.247 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-16T03:21:57.281 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-16T03:21:57.388 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-16T03:21:57.403 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-16T03:21:57.452 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-16T03:21:57.584 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-paste. 2023-12-16T03:21:57.600 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-16T03:21:57.650 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-16T03:21:57.774 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-16T03:21:57.789 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-16T03:21:57.832 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-16T03:21:57.903 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-16T03:21:57.919 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-16T03:21:57.953 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-16T03:21:58.248 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-16T03:21:58.264 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-16T03:21:58.306 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-16T03:21:58.609 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-webtest. 2023-12-16T03:21:58.624 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-16T03:21:58.667 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-16T03:21:58.785 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webob. 2023-12-16T03:21:58.800 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-16T03:21:58.843 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-16T03:21:58.978 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pecan. 2023-12-16T03:21:58.994 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-16T03:21:59.036 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-16T03:21:59.213 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-waitress. 2023-12-16T03:21:59.228 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-16T03:21:59.274 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-16T03:21:59.433 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-certifi. 2023-12-16T03:21:59.448 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-16T03:21:59.491 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-16T03:21:59.565 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempita. 2023-12-16T03:21:59.580 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-16T03:21:59.624 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-16T03:21:59.760 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-idna. 2023-12-16T03:21:59.776 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-16T03:21:59.810 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-16T03:21:59.977 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-paste. 2023-12-16T03:21:59.992 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-16T03:22:00.035 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-16T03:22:00.104 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-urllib3. 2023-12-16T03:22:00.119 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-16T03:22:00.162 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-16T03:22:00.346 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-16T03:22:00.361 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-16T03:22:00.405 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-16T03:22:00.482 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-requests. 2023-12-16T03:22:00.497 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-16T03:22:00.541 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-16T03:22:00.716 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-16T03:22:00.731 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-16T03:22:00.766 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-16T03:22:00.877 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-16T03:22:00.891 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-16T03:22:00.935 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-16T03:22:01.044 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webtest. 2023-12-16T03:22:01.059 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-16T03:22:01.102 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-16T03:22:01.213 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-16T03:22:01.227 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:01.271 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-modules-core (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:01.413 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pecan. 2023-12-16T03:22:01.428 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-16T03:22:01.463 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-16T03:22:01.667 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-16T03:22:01.682 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:01.725 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:02.009 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-certifi. 2023-12-16T03:22:02.025 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-16T03:22:02.028 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-16T03:22:02.043 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-16T03:22:02.059 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-16T03:22:02.086 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-16T03:22:02.379 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-idna. 2023-12-16T03:22:02.394 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-16T03:22:02.397 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-openssl. 2023-12-16T03:22:02.414 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-16T03:22:02.437 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-16T03:22:02.447 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-16T03:22:02.759 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr. 2023-12-16T03:22:02.773 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-urllib3. 2023-12-16T03:22:02.774 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:02.788 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-16T03:22:02.817 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:02.832 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-16T03:22:03.151 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests. 2023-12-16T03:22:03.166 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-16T03:22:03.186 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mon. 2023-12-16T03:22:03.202 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:03.209 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-16T03:22:03.245 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mon (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:03.563 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-16T03:22:03.577 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-16T03:22:03.620 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-16T03:22:03.907 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-16T03:22:03.922 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:03.965 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-modules-core (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:04.181 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-osd. 2023-12-16T03:22:04.197 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:04.231 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-osd (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:04.328 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-16T03:22:04.343 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:04.395 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:04.706 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-16T03:22:04.721 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-16T03:22:04.789 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-16T03:22:05.092 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-openssl. 2023-12-16T03:22:05.107 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-16T03:22:05.150 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-16T03:22:05.334 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph. 2023-12-16T03:22:05.350 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../068-ceph_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:05.393 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:05.512 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr. 2023-12-16T03:22:05.526 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:05.569 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:05.745 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-fuse. 2023-12-16T03:22:05.760 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:05.803 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-fuse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:05.923 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mon. 2023-12-16T03:22:05.938 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:05.981 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mon (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:06.156 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mds. 2023-12-16T03:22:06.171 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:06.214 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mds (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:06.692 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephadm. 2023-12-16T03:22:06.708 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../071-cephadm_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:06.742 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephadm (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:06.767 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-osd. 2023-12-16T03:22:06.782 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:06.842 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-osd (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:07.028 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-16T03:22:07.044 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-16T03:22:07.086 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-16T03:22:07.356 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-16T03:22:07.371 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-16T03:22:07.405 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-16T03:22:08.046 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph. 2023-12-16T03:22:08.061 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../068-ceph_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:08.112 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:08.393 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-babel. 2023-12-16T03:22:08.408 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-16T03:22:08.451 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-16T03:22:08.464 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-fuse. 2023-12-16T03:22:08.480 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:08.523 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-fuse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:08.788 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jinja2. 2023-12-16T03:22:08.802 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-16T03:22:08.845 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-16T03:22:08.934 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mds. 2023-12-16T03:22:08.949 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:08.993 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mds (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:09.207 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-16T03:22:09.222 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:09.265 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-cephadm (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:09.362 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephadm. 2023-12-16T03:22:09.377 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../071-cephadm_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:09.412 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephadm (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:09.577 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-16T03:22:09.591 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-16T03:22:09.626 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-16T03:22:09.740 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-16T03:22:09.755 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-16T03:22:09.798 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-16T03:22:09.879 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-routes. 2023-12-16T03:22:09.894 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-16T03:22:09.937 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-16T03:22:10.109 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-16T03:22:10.123 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-16T03:22:10.158 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-16T03:22:10.265 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-16T03:22:10.280 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:10.315 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-dashboard (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:10.693 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-16T03:22:10.707 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-16T03:22:10.751 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-16T03:22:11.222 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-babel. 2023-12-16T03:22:11.236 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-16T03:22:11.254 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-joblib. 2023-12-16T03:22:11.269 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-16T03:22:11.288 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-16T03:22:11.312 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-16T03:22:11.691 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jinja2. 2023-12-16T03:22:11.705 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-16T03:22:11.757 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-16T03:22:11.774 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-16T03:22:11.789 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-16T03:22:11.901 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-16T03:22:12.255 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-sklearn. 2023-12-16T03:22:12.270 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-16T03:22:12.304 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-16T03:22:12.344 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-16T03:22:12.358 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:12.394 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-cephadm (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:12.890 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-16T03:22:12.904 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-16T03:22:12.956 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-16T03:22:12.962 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-16T03:22:12.977 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:13.021 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:13.350 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-routes. 2023-12-16T03:22:13.365 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-16T03:22:13.408 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-16T03:22:13.778 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-16T03:22:13.794 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:13.845 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-dashboard (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:13.899 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cachetools. 2023-12-16T03:22:13.915 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-16T03:22:13.957 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-16T03:22:14.210 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-16T03:22:14.226 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-16T03:22:14.248 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-16T03:22:14.263 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-16T03:22:14.268 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-16T03:22:14.306 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-16T03:22:14.563 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-16T03:22:14.579 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-16T03:22:14.613 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-16T03:22:14.810 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-joblib. 2023-12-16T03:22:14.824 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-16T03:22:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-16T03:22:14.957 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rsa. 2023-12-16T03:22:14.973 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-16T03:22:15.015 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-16T03:22:15.238 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-16T03:22:15.253 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-16T03:22:15.373 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-16T03:22:15.469 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-google-auth. 2023-12-16T03:22:15.485 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-16T03:22:15.527 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-16T03:22:15.684 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn. 2023-12-16T03:22:15.700 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-16T03:22:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-16T03:22:15.847 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-16T03:22:15.863 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-16T03:22:15.905 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-16T03:22:16.192 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-websocket. 2023-12-16T03:22:16.207 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-16T03:22:16.241 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-16T03:22:16.435 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-16T03:22:16.449 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:16.485 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:16.561 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-16T03:22:16.577 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-16T03:22:16.619 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-16T03:22:17.291 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-16T03:22:17.306 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:17.341 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:17.488 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cachetools. 2023-12-16T03:22:17.503 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-16T03:22:17.546 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-16T03:22:17.602 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-16T03:22:17.616 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-16T03:22:17.660 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-16T03:22:17.849 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-16T03:22:17.864 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-16T03:22:17.932 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-16T03:22:17.996 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-16T03:22:18.011 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-16T03:22:18.071 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-16T03:22:18.269 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-16T03:22:18.285 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-16T03:22:18.341 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package jq. 2023-12-16T03:22:18.343 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-16T03:22:18.356 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-16T03:22:18.399 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-16T03:22:18.651 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package socat. 2023-12-16T03:22:18.667 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-16T03:22:18.680 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rsa. 2023-12-16T03:22:18.695 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-16T03:22:18.709 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-16T03:22:18.738 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-16T03:22:19.006 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package xmlstarlet. 2023-12-16T03:22:19.021 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-16T03:22:19.042 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-google-auth. 2023-12-16T03:22:19.058 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-16T03:22:19.062 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-16T03:22:19.100 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-16T03:22:19.409 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-test. 2023-12-16T03:22:19.423 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../099-ceph-test_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:19.444 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-16T03:22:19.460 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-16T03:22:19.466 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-test (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:19.503 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-16T03:22:19.789 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-websocket. 2023-12-16T03:22:19.804 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-16T03:22:19.847 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-16T03:22:20.201 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-16T03:22:20.216 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-16T03:22:20.259 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-16T03:22:20.914 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-16T03:22:20.928 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:20.972 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:21.220 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-volume. 2023-12-16T03:22:21.236 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:21.270 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-volume (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:21.291 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-16T03:22:21.306 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-16T03:22:21.366 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-16T03:22:21.599 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-16T03:22:21.615 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:21.649 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-mirror (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:21.703 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-16T03:22:21.717 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-16T03:22:21.761 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-16T03:22:21.968 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-colorama. 2023-12-16T03:22:21.985 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-16T03:22:22.022 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package jq. 2023-12-16T03:22:22.026 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-16T03:22:22.037 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-16T03:22:22.080 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-16T03:22:22.287 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-shell. 2023-12-16T03:22:22.303 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:22.316 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package socat. 2023-12-16T03:22:22.331 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-16T03:22:22.345 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-shell (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:22.374 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-16T03:22:22.606 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-top. 2023-12-16T03:22:22.623 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:22.664 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-top (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:22.713 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package xmlstarlet. 2023-12-16T03:22:22.727 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-16T03:22:22.769 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-16T03:22:22.942 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-16T03:22:22.958 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:23.000 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libcephfs-dev (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:23.073 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-test. 2023-12-16T03:22:23.087 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../099-ceph-test_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:23.123 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-test (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:23.328 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-16T03:22:23.344 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-16T03:22:23.394 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-16T03:22:23.740 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-16T03:22:23.756 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-16T03:22:23.798 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-16T03:22:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package nvme-cli. 2023-12-16T03:22:24.193 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-16T03:22:24.235 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-16T03:22:24.682 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package pkg-config. 2023-12-16T03:22:24.697 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-16T03:22:24.740 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-16T03:22:24.985 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-16T03:22:25.001 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-16T03:22:25.034 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-16T03:22:25.068 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-volume. 2023-12-16T03:22:25.084 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:25.127 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-volume (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:25.429 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-16T03:22:25.444 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-16T03:22:25.447 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-16T03:22:25.464 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:25.479 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-16T03:22:25.506 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-mirror (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:25.748 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pastescript. 2023-12-16T03:22:25.764 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-16T03:22:25.806 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-16T03:22:25.834 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-colorama. 2023-12-16T03:22:25.850 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-16T03:22:25.892 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-16T03:22:26.151 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pluggy. 2023-12-16T03:22:26.152 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-shell. 2023-12-16T03:22:26.167 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-16T03:22:26.168 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:26.209 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-16T03:22:26.210 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-shell (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:26.480 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-top. 2023-12-16T03:22:26.495 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-191-g6d933094-1jammy_all.deb ... 2023-12-16T03:22:26.520 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-psutil. 2023-12-16T03:22:26.536 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-16T03:22:26.538 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-top (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:26.578 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-16T03:22:26.790 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-16T03:22:26.805 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:26.840 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs-dev (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:27.160 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-16T03:22:27.175 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-16T03:22:27.198 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-py. 2023-12-16T03:22:27.214 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-16T03:22:27.217 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-16T03:22:27.256 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-16T03:22:27.609 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pygments. 2023-12-16T03:22:27.626 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-16T03:22:27.667 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-16T03:22:27.825 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-16T03:22:27.838 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-16T03:22:27.880 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-16T03:22:28.113 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-16T03:22:28.128 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-16T03:22:28.171 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-16T03:22:28.309 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package nvme-cli. 2023-12-16T03:22:28.325 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-16T03:22:28.393 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-16T03:22:28.482 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-toml. 2023-12-16T03:22:28.498 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-16T03:22:28.540 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-16T03:22:28.837 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pytest. 2023-12-16T03:22:28.853 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-16T03:22:28.873 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package pkg-config. 2023-12-16T03:22:28.888 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-16T03:22:28.894 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-16T03:22:28.939 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-16T03:22:29.240 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-simplejson. 2023-12-16T03:22:29.257 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-16T03:22:29.284 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-16T03:22:29.289 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-16T03:22:29.299 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-16T03:22:29.350 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-16T03:22:29.529 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-16T03:22:29.542 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-16T03:22:29.575 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-16T03:22:29.854 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-16T03:22:29.869 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-16T03:22:29.920 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-16T03:22:30.275 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastescript. 2023-12-16T03:22:30.288 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package radosgw. 2023-12-16T03:22:30.290 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-16T03:22:30.303 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../122-radosgw_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:30.341 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-16T03:22:30.346 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking radosgw (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:30.720 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pluggy. 2023-12-16T03:22:30.735 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-16T03:22:30.778 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-16T03:22:30.932 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package rbd-fuse. 2023-12-16T03:22:30.948 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:30.990 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking rbd-fuse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:31.064 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-psutil. 2023-12-16T03:22:31.079 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-16T03:22:31.115 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-16T03:22:31.277 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-16T03:22:31.492 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-py. 2023-12-16T03:22:31.509 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-16T03:22:31.546 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-16T03:22:31.550 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-16T03:22:31.672 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-16T03:22:31.887 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pygments. 2023-12-16T03:22:31.902 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-16T03:22:31.945 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-16T03:22:31.984 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-16T03:22:32.389 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-16T03:22:32.399 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-16T03:22:32.414 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-16T03:22:32.457 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-16T03:22:32.802 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-toml. 2023-12-16T03:22:32.817 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-16T03:22:32.860 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-16T03:22:33.060 INFO:teuthology.orchestra.run.smithi028.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-16T03:22:33.074 INFO:teuthology.orchestra.run.smithi028.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-16T03:22:33.115 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephadm (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:33.163 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pytest. 2023-12-16T03:22:33.179 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-16T03:22:33.237 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-16T03:22:33.583 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplejson. 2023-12-16T03:22:33.599 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-16T03:22:33.641 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-16T03:22:33.761 INFO:teuthology.orchestra.run.smithi028.stdout:Adding system user cephadm....done 2023-12-16T03:22:33.936 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-16T03:22:33.952 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-16T03:22:33.955 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-16T03:22:33.994 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-16T03:22:34.273 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-16T03:22:34.541 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-16T03:22:34.667 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-16T03:22:34.764 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package radosgw. 2023-12-16T03:22:34.779 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../122-radosgw_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:34.831 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking radosgw (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:34.943 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-16T03:22:35.219 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-16T03:22:35.320 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-16T03:22:35.426 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package rbd-fuse. 2023-12-16T03:22:35.441 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-191-g6d933094-1jammy_amd64.deb ... 2023-12-16T03:22:35.509 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking rbd-fuse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:35.672 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-16T03:22:35.795 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-16T03:22:36.066 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-16T03:22:36.097 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-16T03:22:36.224 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-16T03:22:36.333 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-16T03:22:36.489 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-16T03:22:36.610 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-16T03:22:36.866 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-16T03:22:36.911 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-16T03:22:37.321 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-16T03:22:37.437 INFO:teuthology.orchestra.run.smithi134.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-16T03:22:37.477 INFO:teuthology.orchestra.run.smithi134.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-16T03:22:37.525 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephadm (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:37.622 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-16T03:22:37.915 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-16T03:22:38.187 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user cephadm....done 2023-12-16T03:22:38.199 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-ceph-argparse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:38.348 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-16T03:22:38.492 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-16T03:22:38.633 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-16T03:22:38.643 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-16T03:22:38.752 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-16T03:22:38.884 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-16T03:22:39.010 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-16T03:22:39.012 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-16T03:22:39.155 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-16T03:22:39.278 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-16T03:22:39.439 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-16T03:22:39.538 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-16T03:22:39.663 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-16T03:22:39.813 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-16T03:22:39.845 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-16T03:22:39.926 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-16T03:22:39.990 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-16T03:22:40.077 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-16T03:22:40.359 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-16T03:22:40.478 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-16T03:22:40.579 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-16T03:22:40.652 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-16T03:22:40.864 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-16T03:22:40.912 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-16T03:22:41.156 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-16T03:22:41.180 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-16T03:22:41.448 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-16T03:22:41.474 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up zip (3.0-12build2) ... 2023-12-16T03:22:41.600 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-16T03:22:41.707 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-16T03:22:41.967 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-16T03:22:42.235 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-argparse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:42.360 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-16T03:22:42.502 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-16T03:22:42.620 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-16T03:22:42.637 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-16T03:22:42.754 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-16T03:22:42.754 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-16T03:22:42.905 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-16T03:22:43.039 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-16T03:22:43.165 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-16T03:22:43.273 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-16T03:22:43.433 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-16T03:22:43.691 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-16T03:22:43.797 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-16T03:22:43.830 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-16T03:22:43.894 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-16T03:22:43.975 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-16T03:22:44.042 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-16T03:22:44.386 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-16T03:22:44.413 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-16T03:22:44.531 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-16T03:22:44.687 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-16T03:22:44.807 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-16T03:22:45.013 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-16T03:22:45.083 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-16T03:22:45.373 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-16T03:22:45.393 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up zip (3.0-12build2) ... 2023-12-16T03:22:45.544 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-16T03:22:45.649 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-16T03:22:45.799 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-ceph-common (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:46.127 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-idna (3.3-1) ... 2023-12-16T03:22:46.238 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-16T03:22:46.478 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-16T03:22:46.489 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-16T03:22:46.615 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-16T03:22:46.763 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-16T03:22:47.075 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-16T03:22:47.476 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-16T03:22:47.744 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-16T03:22:47.758 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-16T03:22:48.068 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:22:48.163 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-16T03:22:48.211 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-16T03:22:48.455 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-16T03:22:48.504 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-16T03:22:48.655 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-16T03:22:48.806 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-16T03:22:48.815 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-16T03:22:49.132 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-16T03:22:49.166 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-16T03:22:49.417 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-16T03:22:49.418 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-16T03:22:49.593 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-common (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:49.735 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:22:49.836 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-16T03:22:49.895 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-idna (3.3-1) ... 2023-12-16T03:22:50.146 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-16T03:22:50.238 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-16T03:22:50.438 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-16T03:22:50.731 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-16T03:22:51.016 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-16T03:22:51.316 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-16T03:22:51.436 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-16T03:22:51.611 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-16T03:22:51.712 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:22:51.718 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-16T03:22:51.846 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-16T03:22:52.003 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-16T03:22:52.131 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-16T03:22:52.138 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-16T03:22:52.290 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-16T03:22:52.391 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-16T03:22:52.456 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-16T03:22:52.676 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-16T03:22:52.782 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-16T03:22:52.944 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-16T03:22:53.083 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-16T03:22:53.208 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-16T03:22:53.211 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:22:53.329 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-16T03:22:53.343 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-16T03:22:53.415 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-16T03:22:53.639 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-16T03:22:53.670 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-16T03:22:53.804 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-16T03:22:53.907 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-16T03:22:54.167 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-16T03:22:54.239 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-16T03:22:54.434 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-16T03:22:54.524 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-16T03:22:54.674 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-16T03:22:54.694 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-16T03:22:54.976 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:22:54.980 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-16T03:22:55.104 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-16T03:22:55.135 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-16T03:22:55.372 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-16T03:22:55.470 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-16T03:22:55.506 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-16T03:22:55.797 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-16T03:22:55.825 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-16T03:22:56.097 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-16T03:22:56.125 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-16T03:22:56.325 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-16T03:22:56.385 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-16T03:22:56.510 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-16T03:22:56.635 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-16T03:22:56.636 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-16T03:22:56.725 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-16T03:22:56.902 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-16T03:22:56.980 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-16T03:22:57.114 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-16T03:22:57.171 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-16T03:22:57.516 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-16T03:22:57.581 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-16T03:22:57.776 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-16T03:22:57.901 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-16T03:22:58.166 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-16T03:22:58.461 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-16T03:22:58.551 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-16T03:22:58.670 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-16T03:22:58.694 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librados2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:58.820 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libsqlite3-mod-ceph (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:58.988 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-16T03:22:59.005 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-16T03:22:59.323 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-16T03:22:59.391 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libcephfs2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:59.542 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libradosstriper1 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:22:59.616 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-16T03:22:59.693 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-16T03:22:59.810 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-16T03:23:00.019 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librbd1 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:00.120 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-16T03:23:00.137 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-modules-core (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:00.263 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-fuse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:00.379 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-16T03:23:00.480 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-16T03:23:00.480 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-16T03:23:00.656 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-16T03:23:01.041 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-16T03:23:01.148 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libcephfs-dev (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:01.299 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rados (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:01.326 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-16T03:23:01.450 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librgw2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:01.601 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-top (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:01.670 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-16T03:23:01.761 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-16T03:23:01.796 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librados2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:01.973 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libsqlite3-mod-ceph (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:02.098 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-16T03:23:02.393 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:02.519 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libradosstriper1 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:02.679 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-16T03:23:02.988 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librbd1 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:03.123 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rbd (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:03.123 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-modules-core (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:03.257 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up rbd-fuse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:03.274 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-fuse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:03.383 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rgw (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:03.477 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-16T03:23:03.477 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-16T03:23:03.509 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cephfs (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:03.651 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-shell (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:03.761 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-common (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:04.125 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs-dev (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:04.243 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rados (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:04.281 INFO:teuthology.orchestra.run.smithi028.stdout:Adding group ceph....done 2023-12-16T03:23:04.370 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librgw2 (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:04.495 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-top (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:04.641 INFO:teuthology.orchestra.run.smithi028.stdout:Adding system user ceph....done 2023-12-16T03:23:04.646 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-16T03:23:04.844 INFO:teuthology.orchestra.run.smithi028.stdout:Setting system user ceph properties....done 2023-12-16T03:23:04.864 INFO:teuthology.orchestra.run.smithi028.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-16T03:23:05.014 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-16T03:23:05.419 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-16T03:23:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rbd (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:06.051 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up rbd-fuse (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:06.095 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-mirror (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:06.177 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rgw (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:06.303 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cephfs (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:06.311 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-16T03:23:06.311 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-16T03:23:06.429 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-shell (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:06.555 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-common (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:06.947 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-test (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:07.098 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up radosgw (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:07.151 INFO:teuthology.orchestra.run.smithi134.stdout:Adding group ceph....done 2023-12-16T03:23:07.560 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user ceph....done 2023-12-16T03:23:07.678 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-16T03:23:07.678 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-16T03:23:07.746 INFO:teuthology.orchestra.run.smithi134.stdout:Setting system user ceph properties....done 2023-12-16T03:23:07.761 INFO:teuthology.orchestra.run.smithi134.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-16T03:23:07.903 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-16T03:23:08.295 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-16T03:23:08.375 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-base (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:08.725 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-16T03:23:08.948 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-mirror (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:09.157 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-16T03:23:09.157 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-16T03:23:09.394 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mds (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:09.625 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-16T03:23:09.625 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-16T03:23:09.708 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-test (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:09.817 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up radosgw (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:10.262 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:10.336 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-16T03:23:10.336 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-16T03:23:10.500 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-16T03:23:10.500 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-16T03:23:10.970 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-base (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:11.155 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-osd (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:11.330 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-16T03:23:11.519 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-16T03:23:11.519 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-16T03:23:11.962 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mds (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:12.149 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-k8sevents (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:12.219 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-16T03:23:12.219 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-16T03:23:12.275 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:12.443 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mon (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:12.642 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-16T03:23:12.643 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-16T03:23:12.823 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:13.036 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-16T03:23:13.036 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-16T03:23:13.302 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-cephadm (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:13.428 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:13.615 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-osd (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:13.630 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-dashboard (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:13.806 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-volume (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:13.916 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-16T03:23:13.916 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-16T03:23:14.200 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-16T03:23:14.309 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-16T03:23:14.445 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-16T03:23:14.509 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-k8sevents (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:14.619 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:14.753 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mon (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-16T03:23:14.985 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-16T03:23:15.538 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-16T03:23:15.604 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-cephadm (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:15.756 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-dashboard (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:16.024 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-volume (19.0.0-191-g6d933094-1jammy) ... 2023-12-16T03:23:16.223 INFO:teuthology.orchestra.run.smithi028.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-16T03:23:16.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-16T03:23:16.307 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2023-12-16T03:23:16.385 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-16T03:23:16.479 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2023-12-16T03:23:16.479 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2023-12-16T03:23:16.494 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-16T03:23:16.636 INFO:teuthology.orchestra.run.smithi028.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-16T03:23:16.637 INFO:teuthology.orchestra.run.smithi028.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-16T03:23:16.637 INFO:teuthology.orchestra.run.smithi028.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-16T03:23:16.637 INFO:teuthology.orchestra.run.smithi028.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-16T03:23:16.637 INFO:teuthology.orchestra.run.smithi028.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-16T03:23:16.637 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2023-12-16T03:23:16.637 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-16T03:23:16.637 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-16T03:23:16.637 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-16T03:23:16.637 INFO:teuthology.orchestra.run.smithi028.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-16T03:23:16.638 INFO:teuthology.orchestra.run.smithi028.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-16T03:23:16.638 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-16T03:23:16.638 INFO:teuthology.orchestra.run.smithi028.stdout:The following additional packages will be installed: 2023-12-16T03:23:16.638 INFO:teuthology.orchestra.run.smithi028.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-16T03:23:16.638 INFO:teuthology.orchestra.run.smithi028.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-16T03:23:16.639 INFO:teuthology.orchestra.run.smithi028.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-16T03:23:16.639 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-16T03:23:16.639 INFO:teuthology.orchestra.run.smithi028.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-16T03:23:16.639 INFO:teuthology.orchestra.run.smithi028.stdout:Suggested packages: 2023-12-16T03:23:16.640 INFO:teuthology.orchestra.run.smithi028.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-16T03:23:16.640 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-16T03:23:16.640 INFO:teuthology.orchestra.run.smithi028.stdout: libengine-pkcs11-openssl 2023-12-16T03:23:16.646 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-16T03:23:16.691 INFO:teuthology.orchestra.run.smithi028.stdout:The following NEW packages will be installed: 2023-12-16T03:23:16.692 INFO:teuthology.orchestra.run.smithi028.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-16T03:23:16.692 INFO:teuthology.orchestra.run.smithi028.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-16T03:23:16.692 INFO:teuthology.orchestra.run.smithi028.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-16T03:23:16.692 INFO:teuthology.orchestra.run.smithi028.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-16T03:23:16.692 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-16T03:23:16.692 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-16T03:23:16.692 INFO:teuthology.orchestra.run.smithi028.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-16T03:23:16.693 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages will be upgraded: 2023-12-16T03:23:16.693 INFO:teuthology.orchestra.run.smithi028.stdout: libssl3 2023-12-16T03:23:16.894 INFO:teuthology.orchestra.run.smithi028.stdout:1 upgraded, 39 newly installed, 0 to remove and 267 not upgraded. 2023-12-16T03:23:16.894 INFO:teuthology.orchestra.run.smithi028.stdout:Need to get 54.6 MB of archives. 2023-12-16T03:23:16.894 INFO:teuthology.orchestra.run.smithi028.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-16T03:23:16.895 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-16T03:23:17.449 INFO:teuthology.orchestra.run.smithi028.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-16T03:23:17.780 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-16T03:23:17.814 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-16T03:23:17.827 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-16T03:23:17.829 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-16T03:23:17.836 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-16T03:23:17.856 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-16T03:23:17.856 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-16T03:23:17.859 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-16T03:23:17.861 INFO:teuthology.orchestra.run.smithi028.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-16T03:23:17.862 INFO:teuthology.orchestra.run.smithi028.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-16T03:23:18.026 INFO:teuthology.orchestra.run.smithi028.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-16T03:23:18.369 INFO:teuthology.orchestra.run.smithi028.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-16T03:23:18.538 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-16T03:23:18.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-16T03:23:18.616 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2023-12-16T03:23:18.786 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2023-12-16T03:23:18.786 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2023-12-16T03:23:18.943 INFO:teuthology.orchestra.run.smithi134.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-16T03:23:18.943 INFO:teuthology.orchestra.run.smithi134.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-16T03:23:18.943 INFO:teuthology.orchestra.run.smithi134.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-16T03:23:18.943 INFO:teuthology.orchestra.run.smithi134.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-16T03:23:18.943 INFO:teuthology.orchestra.run.smithi134.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-16T03:23:18.943 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2023-12-16T03:23:18.943 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-16T03:23:18.944 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-16T03:23:18.944 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-16T03:23:18.944 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-16T03:23:18.944 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-16T03:23:18.944 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-16T03:23:18.945 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2023-12-16T03:23:18.945 INFO:teuthology.orchestra.run.smithi134.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-16T03:23:18.945 INFO:teuthology.orchestra.run.smithi134.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-16T03:23:18.945 INFO:teuthology.orchestra.run.smithi134.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-16T03:23:18.945 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-16T03:23:18.945 INFO:teuthology.orchestra.run.smithi134.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-16T03:23:18.946 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2023-12-16T03:23:18.946 INFO:teuthology.orchestra.run.smithi134.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-16T03:23:18.946 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-16T03:23:18.946 INFO:teuthology.orchestra.run.smithi134.stdout: libengine-pkcs11-openssl 2023-12-16T03:23:18.996 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2023-12-16T03:23:18.997 INFO:teuthology.orchestra.run.smithi134.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-16T03:23:18.997 INFO:teuthology.orchestra.run.smithi134.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-16T03:23:18.997 INFO:teuthology.orchestra.run.smithi134.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-16T03:23:18.997 INFO:teuthology.orchestra.run.smithi134.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-16T03:23:18.997 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-16T03:23:18.997 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-16T03:23:18.997 INFO:teuthology.orchestra.run.smithi134.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-16T03:23:18.998 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2023-12-16T03:23:18.999 INFO:teuthology.orchestra.run.smithi134.stdout: libssl3 2023-12-16T03:23:19.053 INFO:teuthology.orchestra.run.smithi134.stdout:1 upgraded, 39 newly installed, 0 to remove and 267 not upgraded. 2023-12-16T03:23:19.054 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 54.6 MB of archives. 2023-12-16T03:23:19.054 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-16T03:23:19.054 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-16T03:23:19.157 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-16T03:23:19.210 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-16T03:23:19.218 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-16T03:23:19.218 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-16T03:23:19.220 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-16T03:23:19.221 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-16T03:23:19.222 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-16T03:23:19.223 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-16T03:23:19.224 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-16T03:23:19.224 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-16T03:23:19.229 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-16T03:23:19.241 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-16T03:23:19.459 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-16T03:23:19.460 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-16T03:23:19.461 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-16T03:23:19.463 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-16T03:23:19.464 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-16T03:23:19.468 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-16T03:23:19.470 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-16T03:23:19.477 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-16T03:23:19.477 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-16T03:23:19.499 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-16T03:23:19.499 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-16T03:23:19.509 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-16T03:23:19.529 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-16T03:23:19.533 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-16T03:23:19.533 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-16T03:23:19.534 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-16T03:23:19.534 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-16T03:23:19.546 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-16T03:23:19.548 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-16T03:23:19.694 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-16T03:23:19.694 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-16T03:23:19.694 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-16T03:23:19.694 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-16T03:23:19.695 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-16T03:23:19.695 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-16T03:23:19.708 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-16T03:23:19.708 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-16T03:23:19.735 INFO:teuthology.orchestra.run.smithi028.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-16T03:23:19.737 INFO:teuthology.orchestra.run.smithi028.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-16T03:23:19.737 INFO:teuthology.orchestra.run.smithi028.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-16T03:23:19.740 INFO:teuthology.orchestra.run.smithi028.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-16T03:23:19.740 INFO:teuthology.orchestra.run.smithi028.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-16T03:23:19.744 INFO:teuthology.orchestra.run.smithi028.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-16T03:23:19.746 INFO:teuthology.orchestra.run.smithi028.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-16T03:23:19.761 INFO:teuthology.orchestra.run.smithi028.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-16T03:23:19.761 INFO:teuthology.orchestra.run.smithi028.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-16T03:23:20.014 INFO:teuthology.orchestra.run.smithi028.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-16T03:23:20.087 INFO:teuthology.orchestra.run.smithi134.stdout:Preconfiguring packages ... 2023-12-16T03:23:20.097 INFO:teuthology.orchestra.run.smithi028.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-16T03:23:20.239 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 54.6 MB in 1s (77.8 MB/s) 2023-12-16T03:23:20.414 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package flex. 2023-12-16T03:23:20.487 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-12-16T03:23:20.491 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-16T03:23:20.537 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-16T03:23:20.601 INFO:teuthology.orchestra.run.smithi028.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-16T03:23:20.748 INFO:teuthology.orchestra.run.smithi028.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-16T03:23:20.761 INFO:teuthology.orchestra.run.smithi028.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-16T03:23:20.763 INFO:teuthology.orchestra.run.smithi028.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-16T03:23:20.764 INFO:teuthology.orchestra.run.smithi028.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-16T03:23:20.765 INFO:teuthology.orchestra.run.smithi028.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-16T03:23:20.804 INFO:teuthology.orchestra.run.smithi028.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-16T03:23:20.809 INFO:teuthology.orchestra.run.smithi028.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-16T03:23:21.116 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-16T03:23:21.285 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-16T03:23:21.476 INFO:teuthology.orchestra.run.smithi028.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-16T03:23:21.645 INFO:teuthology.orchestra.run.smithi028.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-16T03:23:21.667 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-16T03:23:21.728 INFO:teuthology.orchestra.run.smithi028.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-16T03:23:21.728 INFO:teuthology.orchestra.run.smithi028.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-16T03:23:21.814 INFO:teuthology.orchestra.run.smithi028.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-16T03:23:21.823 INFO:teuthology.orchestra.run.smithi028.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-16T03:23:22.227 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package bison. 2023-12-16T03:23:22.301 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-12-16T03:23:22.304 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-16T03:23:22.372 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-16T03:23:22.409 INFO:teuthology.orchestra.run.smithi028.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-16T03:23:22.410 INFO:teuthology.orchestra.run.smithi028.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-16T03:23:22.748 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-16T03:23:22.762 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-16T03:23:22.805 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-16T03:23:22.818 INFO:teuthology.orchestra.run.smithi028.stdout:Preconfiguring packages ... 2023-12-16T03:23:22.972 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 54.6 MB in 6s (9,563 kB/s) 2023-12-16T03:23:23.120 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package flex. 2023-12-16T03:23:23.159 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package dump. 2023-12-16T03:23:23.174 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-16T03:23:23.196 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-12-16T03:23:23.199 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-16T03:23:23.217 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking dump (0.4b47-3) ... 2023-12-16T03:23:23.244 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-16T03:23:23.479 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package indent. 2023-12-16T03:23:23.494 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:23.537 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-16T03:23:23.815 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-16T03:23:23.831 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-16T03:23:23.840 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-16T03:23:23.864 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-16T03:23:24.017 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-16T03:23:24.320 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-16T03:23:24.336 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-16T03:23:24.393 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-16T03:23:24.403 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-16T03:23:24.656 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-16T03:23:24.671 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-16T03:23:24.708 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-16T03:23:24.959 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package bison. 2023-12-16T03:23:25.036 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-12-16T03:23:25.040 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-16T03:23:25.061 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-16T03:23:25.077 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-16T03:23:25.086 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-16T03:23:25.119 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-16T03:23:25.355 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-16T03:23:25.370 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-16T03:23:25.413 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-16T03:23:25.504 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-16T03:23:25.518 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-16T03:23:25.594 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-16T03:23:25.665 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjson-perl. 2023-12-16T03:23:25.681 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-16T03:23:25.715 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-16T03:23:25.932 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package dump. 2023-12-16T03:23:25.948 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-16T03:23:25.990 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking dump (0.4b47-3) ... 2023-12-16T03:23:26.026 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-16T03:23:26.042 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-16T03:23:26.085 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-16T03:23:26.236 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package indent. 2023-12-16T03:23:26.252 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:26.286 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-16T03:23:26.538 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-16T03:23:26.554 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-16T03:23:26.596 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-16T03:23:26.925 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-16T03:23:26.941 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-16T03:23:26.983 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-16T03:23:27.244 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-16T03:23:27.260 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-16T03:23:27.294 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-16T03:23:27.446 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-16T03:23:27.462 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-16T03:23:27.496 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-16T03:23:27.630 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-16T03:23:27.647 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-16T03:23:27.689 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-16T03:23:27.748 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-16T03:23:27.763 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-16T03:23:27.831 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-16T03:23:27.941 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-16T03:23:27.957 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-16T03:23:27.999 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-16T03:23:28.142 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-16T03:23:28.157 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-16T03:23:28.200 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-16T03:23:28.237 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libjson-perl. 2023-12-16T03:23:28.253 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-16T03:23:28.295 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-16T03:23:28.578 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-16T03:23:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-16T03:23:28.598 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-16T03:23:28.615 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-16T03:23:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-16T03:23:28.657 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-16T03:23:28.964 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-16T03:23:28.979 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-16T03:23:29.022 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-16T03:23:29.817 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-16T03:23:29.833 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:29.875 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:30.019 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-16T03:23:30.035 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-16T03:23:30.069 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-16T03:23:30.228 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-16T03:23:30.243 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:30.286 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-16T03:23:30.338 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-16T03:23:30.354 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-16T03:23:30.397 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-16T03:23:30.572 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-16T03:23:30.587 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:30.621 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-16T03:23:30.724 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-16T03:23:30.740 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-16T03:23:30.782 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-16T03:23:30.874 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-16T03:23:30.888 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-16T03:23:30.932 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-16T03:23:31.135 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-16T03:23:31.151 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-16T03:23:31.193 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-16T03:23:31.435 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-16T03:23:31.450 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-16T03:23:31.493 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-16T03:23:31.496 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-16T03:23:31.512 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-16T03:23:31.557 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-16T03:23:31.821 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package modemmanager. 2023-12-16T03:23:31.836 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-16T03:23:31.871 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-16T03:23:31.932 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-16T03:23:31.948 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:31.991 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:32.327 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-16T03:23:32.343 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:32.385 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-16T03:23:32.502 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package network-manager. 2023-12-16T03:23:32.517 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-16T03:23:32.561 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-16T03:23:32.654 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-16T03:23:32.670 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:32.712 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-16T03:23:32.956 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-16T03:23:32.972 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-16T03:23:33.014 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-16T03:23:33.192 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ppp. 2023-12-16T03:23:33.208 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-16T03:23:33.518 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-16T03:23:33.534 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-16T03:23:33.549 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-16T03:23:33.576 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-16T03:23:33.888 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package pptp-linux. 2023-12-16T03:23:33.902 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-16T03:23:33.921 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package modemmanager. 2023-12-16T03:23:33.938 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-16T03:23:33.946 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-16T03:23:33.979 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-16T03:23:34.215 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-16T03:23:34.229 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-16T03:23:34.290 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-16T03:23:34.620 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-16T03:23:34.635 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-16T03:23:34.678 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client-common (238) ... 2023-12-16T03:23:34.695 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package network-manager. 2023-12-16T03:23:34.711 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-16T03:23:34.771 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-16T03:23:35.006 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-16T03:23:35.022 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:35.064 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:35.537 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ppp. 2023-12-16T03:23:35.552 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-16T03:23:35.653 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-common. 2023-12-16T03:23:35.668 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-16T03:23:35.729 INFO:teuthology.orchestra.run.smithi134.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-16T03:23:35.760 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-common (238) ... 2023-12-16T03:23:35.916 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-16T03:23:36.232 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package pptp-linux. 2023-12-16T03:23:36.234 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-14. 2023-12-16T03:23:36.247 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-16T03:23:36.250 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:36.287 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:36.290 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-16T03:23:36.568 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-16T03:23:36.583 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-16T03:23:36.626 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-16T03:23:36.955 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-16T03:23:36.971 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-16T03:23:37.013 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client-common (238) ... 2023-12-16T03:23:37.266 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-16T03:23:37.282 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:37.316 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:37.387 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql. 2023-12-16T03:23:37.401 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-16T03:23:37.445 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql (14+238) ... 2023-12-16T03:23:37.680 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client. 2023-12-16T03:23:37.695 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-16T03:23:37.730 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client (14+238) ... 2023-12-16T03:23:37.888 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-common. 2023-12-16T03:23:37.904 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-16T03:23:37.957 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-16T03:23:37.965 INFO:teuthology.orchestra.run.smithi028.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-16T03:23:37.972 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-16T03:23:37.995 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-common (238) ... 2023-12-16T03:23:38.015 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-16T03:23:38.385 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package tcl8.6. 2023-12-16T03:23:38.399 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-16T03:23:38.443 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-16T03:23:38.478 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-14. 2023-12-16T03:23:38.495 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-16T03:23:38.531 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:38.712 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package tcl. 2023-12-16T03:23:38.727 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-16T03:23:38.775 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-16T03:23:39.106 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package wpasupplicant. 2023-12-16T03:23:39.122 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-16T03:23:39.156 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-16T03:23:39.723 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql. 2023-12-16T03:23:39.739 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-16T03:23:39.781 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql (14+238) ... 2023-12-16T03:23:39.870 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-16T03:23:39.887 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-16T03:23:39.928 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-16T03:23:40.000 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client. 2023-12-16T03:23:40.015 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-16T03:23:40.050 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client (14+238) ... 2023-12-16T03:23:40.294 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-16T03:23:40.306 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-16T03:23:40.309 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-16T03:23:40.322 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-16T03:23:40.352 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-16T03:23:40.373 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-16T03:23:40.667 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client-common (238) ... 2023-12-16T03:23:40.671 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package tcl8.6. 2023-12-16T03:23:40.687 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-16T03:23:40.730 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-16T03:23:40.853 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-16T03:23:40.971 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-16T03:23:40.999 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package tcl. 2023-12-16T03:23:41.016 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-16T03:23:41.062 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-16T03:23:41.097 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:41.256 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-16T03:23:41.382 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-16T03:23:41.402 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package wpasupplicant. 2023-12-16T03:23:41.419 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-16T03:23:41.460 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-16T03:23:41.508 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:41.790 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-16T03:23:41.809 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-16T03:23:41.848 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-16T03:23:42.243 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-16T03:23:42.259 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-16T03:23:42.310 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-16T03:23:42.521 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-16T03:23:42.587 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client-common (238) ... 2023-12-16T03:23:42.614 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-16T03:23:42.798 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-16T03:23:42.941 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-16T03:23:42.992 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-16T03:23:42.992 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-16T03:23:43.067 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:43.177 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-16T03:23:43.286 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-16T03:23:43.412 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:43.675 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-16T03:23:43.809 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-16T03:23:43.960 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-16T03:23:44.078 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-16T03:23:44.187 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-16T03:23:44.296 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-16T03:23:44.413 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-16T03:23:44.442 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-16T03:23:44.535 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-16T03:23:44.896 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-16T03:23:44.896 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-16T03:23:45.111 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-16T03:23:45.290 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up dump (0.4b47-3) ... 2023-12-16T03:23:45.390 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-16T03:23:45.455 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-16T03:23:45.572 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-16T03:23:45.579 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-16T03:23:45.673 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-16T03:23:45.705 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-16T03:23:45.799 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-16T03:23:45.823 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-16T03:23:45.924 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-16T03:23:45.975 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-16T03:23:46.058 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-16T03:23:46.065 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-16T03:23:46.127 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-16T03:23:46.176 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-16T03:23:46.253 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-16T03:23:46.302 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-16T03:23:46.429 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-16T03:23:46.555 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-16T03:23:46.706 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-16T03:23:46.849 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client (14+238) ... 2023-12-16T03:23:46.975 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-16T03:23:47.023 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-16T03:23:47.150 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up dump (0.4b47-3) ... 2023-12-16T03:23:47.245 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-16T03:23:47.309 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-16T03:23:47.435 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-16T03:23:47.564 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:23:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-16T03:23:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:which means they are currently configured by ifupdown: 2023-12-16T03:23:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:- enp3s0f1 2023-12-16T03:23:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-16T03:23:47.565 INFO:teuthology.orchestra.run.smithi134.stdout:remove their configuration from /etc/network/interfaces. 2023-12-16T03:23:47.565 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:23:47.595 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-16T03:23:47.697 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-16T03:23:47.729 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-16T03:23:47.855 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-16T03:23:47.945 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-16T03:23:48.015 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-16T03:23:48.096 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-16T03:23:48.116 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-16T03:23:48.259 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-16T03:23:48.386 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-16T03:23:48.485 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-16T03:23:48.511 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-16T03:23:48.679 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client (14+238) ... 2023-12-16T03:23:48.813 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-16T03:23:49.169 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-16T03:23:49.328 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-16T03:23:49.416 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:23:49.416 INFO:teuthology.orchestra.run.smithi028.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-16T03:23:49.416 INFO:teuthology.orchestra.run.smithi028.stdout:which means they are currently configured by ifupdown: 2023-12-16T03:23:49.416 INFO:teuthology.orchestra.run.smithi028.stdout:- ens1f0 2023-12-16T03:23:49.416 INFO:teuthology.orchestra.run.smithi028.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-16T03:23:49.416 INFO:teuthology.orchestra.run.smithi028.stdout:remove their configuration from /etc/network/interfaces. 2023-12-16T03:23:49.416 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:23:49.454 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-16T03:23:49.573 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-16T03:23:49.580 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-common (238) ... 2023-12-16T03:23:49.988 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-16T03:23:50.405 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-16T03:23:50.828 INFO:teuthology.orchestra.run.smithi134.stdout:Adding user postgres to group ssl-cert 2023-12-16T03:23:51.102 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:23:51.103 INFO:teuthology.orchestra.run.smithi134.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-16T03:23:51.108 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-16T03:23:51.226 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-16T03:23:51.352 INFO:teuthology.orchestra.run.smithi134.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-16T03:23:51.352 INFO:teuthology.orchestra.run.smithi134.stdout:Removing obsolete dictionary files: 2023-12-16T03:23:51.352 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-16T03:23:51.478 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-common (238) ... 2023-12-16T03:23:52.087 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-16T03:23:52.442 INFO:teuthology.orchestra.run.smithi028.stdout:Adding user postgres to group ssl-cert 2023-12-16T03:23:52.548 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:52.712 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:23:52.713 INFO:teuthology.orchestra.run.smithi028.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-16T03:23:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-16T03:23:52.927 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-16T03:23:52.970 INFO:teuthology.orchestra.run.smithi028.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-16T03:23:52.970 INFO:teuthology.orchestra.run.smithi028.stdout:Removing obsolete dictionary files: 2023-12-16T03:23:52.982 INFO:teuthology.orchestra.run.smithi134.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-16T03:23:52.982 INFO:teuthology.orchestra.run.smithi134.stdout:This user must also own the server process. 2023-12-16T03:23:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:23:52.982 INFO:teuthology.orchestra.run.smithi134.stdout:The database cluster will be initialized with locale "en_US". 2023-12-16T03:23:52.982 INFO:teuthology.orchestra.run.smithi134.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-16T03:23:52.982 INFO:teuthology.orchestra.run.smithi134.stdout:The default text search configuration will be set to "english". 2023-12-16T03:23:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:23:52.982 INFO:teuthology.orchestra.run.smithi134.stdout:Data page checksums are disabled. 2023-12-16T03:23:52.982 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:23:52.983 INFO:teuthology.orchestra.run.smithi134.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-16T03:23:52.983 INFO:teuthology.orchestra.run.smithi134.stdout:creating subdirectories ... ok 2023-12-16T03:23:52.983 INFO:teuthology.orchestra.run.smithi134.stdout:selecting dynamic shared memory implementation ... posix 2023-12-16T03:23:53.007 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default max_connections ... 100 2023-12-16T03:23:53.042 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default shared_buffers ... 128MB 2023-12-16T03:23:53.055 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default time zone ... Etc/UTC 2023-12-16T03:23:53.056 INFO:teuthology.orchestra.run.smithi134.stdout:creating configuration files ... ok 2023-12-16T03:23:53.225 INFO:teuthology.orchestra.run.smithi134.stdout:running bootstrap script ... ok 2023-12-16T03:23:53.724 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-16T03:23:53.894 INFO:teuthology.orchestra.run.smithi134.stdout:performing post-bootstrap initialization ... ok 2023-12-16T03:23:54.304 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-16T03:23:54.428 INFO:teuthology.orchestra.run.smithi134.stdout:syncing data to disk ... ok 2023-12-16T03:23:54.654 INFO:teuthology.orchestra.run.smithi028.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-16T03:23:54.676 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-16T03:23:54.732 INFO:teuthology.orchestra.run.smithi028.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-16T03:23:54.732 INFO:teuthology.orchestra.run.smithi028.stdout:This user must also own the server process. 2023-12-16T03:23:54.733 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:23:54.733 INFO:teuthology.orchestra.run.smithi028.stdout:The database cluster will be initialized with locale "en_US". 2023-12-16T03:23:54.733 INFO:teuthology.orchestra.run.smithi028.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-16T03:23:54.733 INFO:teuthology.orchestra.run.smithi028.stdout:The default text search configuration will be set to "english". 2023-12-16T03:23:54.733 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:23:54.733 INFO:teuthology.orchestra.run.smithi028.stdout:Data page checksums are disabled. 2023-12-16T03:23:54.733 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:23:54.733 INFO:teuthology.orchestra.run.smithi028.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-16T03:23:54.736 INFO:teuthology.orchestra.run.smithi028.stdout:creating subdirectories ... ok 2023-12-16T03:23:54.737 INFO:teuthology.orchestra.run.smithi028.stdout:selecting dynamic shared memory implementation ... posix 2023-12-16T03:23:54.759 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default max_connections ... 100 2023-12-16T03:23:54.797 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default shared_buffers ... 128MB 2023-12-16T03:23:54.811 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default time zone ... Etc/UTC 2023-12-16T03:23:54.811 INFO:teuthology.orchestra.run.smithi028.stdout:creating configuration files ... ok 2023-12-16T03:23:54.934 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-16T03:23:54.989 INFO:teuthology.orchestra.run.smithi028.stdout:running bootstrap script ... ok 2023-12-16T03:23:55.633 INFO:teuthology.orchestra.run.smithi028.stdout:performing post-bootstrap initialization ... ok 2023-12-16T03:23:56.145 INFO:teuthology.orchestra.run.smithi028.stdout:syncing data to disk ... ok 2023-12-16T03:23:56.693 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-16T03:23:57.980 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-16T03:23:58.106 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-16T03:23:58.232 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql (14+238) ... 2023-12-16T03:23:58.383 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-16T03:23:58.509 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-16T03:23:58.761 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-16T03:23:58.761 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-16T03:23:59.486 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-16T03:23:59.662 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-16T03:23:59.796 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-16T03:23:59.855 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-16T03:23:59.922 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql (14+238) ... 2023-12-16T03:23:59.998 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-16T03:24:00.048 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-16T03:24:00.191 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-16T03:24:00.455 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-16T03:24:00.455 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-16T03:24:01.260 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-16T03:24:01.562 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-16T03:24:01.722 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-16T03:24:01.870 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-16T03:24:01.976 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-16T03:24:02.521 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-16T03:24:02.528 DEBUG:teuthology.parallel:result is None 2023-12-16T03:24:03.441 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-16T03:24:03.542 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-16T03:24:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-16T03:24:04.085 DEBUG:teuthology.parallel:result is None 2023-12-16T03:24:04.085 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:24:04.304 DEBUG:teuthology.orchestra.run.smithi028:> dpkg-query -W -f '${Version}' ceph 2023-12-16T03:24:04.327 INFO:teuthology.orchestra.run.smithi028.stdout:19.0.0-191-g6d933094-1jammy 2023-12-16T03:24:04.328 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-191-g6d933094-1jammy 2023-12-16T03:24:04.328 INFO:teuthology.task.install:The correct ceph version 19.0.0-191-g6d933094-1jammy is installed. 2023-12-16T03:24:04.330 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6d933094a156ec7587742e5aa25fba5ba27ec678 2023-12-16T03:24:04.547 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-query -W -f '${Version}' ceph 2023-12-16T03:24:04.571 INFO:teuthology.orchestra.run.smithi134.stdout:19.0.0-191-g6d933094-1jammy 2023-12-16T03:24:04.571 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-191-g6d933094-1jammy 2023-12-16T03:24:04.571 INFO:teuthology.task.install:The correct ceph version 19.0.0-191-g6d933094-1jammy is installed. 2023-12-16T03:24:04.573 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-16T03:24:04.573 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:04.573 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T03:24:04.595 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:04.595 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-16T03:24:04.641 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-16T03:24:04.641 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:04.641 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T03:24:04.662 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T03:24:04.722 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:04.722 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2023-12-16T03:24:04.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-16T03:24:04.809 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-16T03:24:04.810 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:04.810 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T03:24:04.831 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T03:24:04.895 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:04.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-16T03:24:04.916 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-16T03:24:04.983 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-16T03:24:04.983 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:04.984 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T03:24:05.005 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T03:24:05.067 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:05.067 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2023-12-16T03:24:05.089 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-16T03:24:05.152 INFO:teuthology.run_tasks:Running task ceph... 2023-12-16T03:24:05.217 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-16T03:24:05.217 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 777 /var/log/ceph 2023-12-16T03:24:05.221 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2023-12-16T03:24:05.243 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-16T03:24:05.243 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-16T03:24:05.289 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-16T03:24:05.311 INFO:tasks.ceph:Creating extra log directories... 2023-12-16T03:24:05.311 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-16T03:24:05.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-16T03:24:05.385 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-16T03:24:05.386 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-16T03:24:05.386 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-16T03:24:05.386 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:05.386 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-16T03:24:05.431 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-16T03:24:05.529 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:05.529 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-16T03:24:05.539 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-16T03:24:05.639 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-16T03:24:05.639 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-16T03:24:05.639 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532', 'branch': 'main', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7493532', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 5996, 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi028.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFln36APw+xm15YbhTjWav4mY1GGbpxKLumHaIcAY4YUneS0m9dZQrrSXn+/OXxU2hT9f3WsPFrKlunQRPqBKYQ=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCZ0b5AAnhOimDpW28qjtqag5ceUU7/3lI05yIiYwjCzJ7qAd3w3LcEyXtNru1afyXKvWELQFzRTL06rEgO5MHA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '6d933094a156ec7587742e5aa25fba5ba27ec678', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-16_00:09:48', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-16T03:24:05.640 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-16T03:24:05.644 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-16T03:24:05.653 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/run/ceph 2023-12-16T03:24:05.693 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2023-12-16T03:24:05.715 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:05.715 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T03:24:05.767 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T03:24:05.767 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_1 2023-12-16T03:24:05.819 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T03:24:05.819 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:24:05.819 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 898 Links: 1 2023-12-16T03:24:05.820 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:24:05.820 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-12-16 03:17:39.539429138 +0000 2023-12-16T03:24:05.820 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-12-16 03:17:39.163432480 +0000 2023-12-16T03:24:05.820 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-12-16 03:17:39.163432480 +0000 2023-12-16T03:24:05.820 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2023-12-16 03:17:39.163432480 +0000 2023-12-16T03:24:05.820 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T03:24:05.882 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-12-16T03:24:05.882 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-12-16T03:24:05.882 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000262853 s, 1.9 MB/s 2023-12-16T03:24:05.884 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T03:24:05.937 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_2 2023-12-16T03:24:05.991 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T03:24:05.991 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:24:05.991 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-12-16T03:24:05.992 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:24:05.992 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-12-16 03:17:39.815426685 +0000 2023-12-16T03:24:05.992 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-12-16 03:17:39.811426719 +0000 2023-12-16T03:24:05.992 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-12-16 03:17:39.811426719 +0000 2023-12-16T03:24:05.992 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2023-12-16 03:17:39.811426719 +0000 2023-12-16T03:24:05.992 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T03:24:06.058 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-12-16T03:24:06.059 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-12-16T03:24:06.059 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.00027204 s, 1.9 MB/s 2023-12-16T03:24:06.060 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T03:24:06.113 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_3 2023-12-16T03:24:06.164 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T03:24:06.164 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:24:06.164 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-12-16T03:24:06.164 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:24:06.164 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-12-16 03:17:40.847417510 +0000 2023-12-16T03:24:06.164 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-12-16 03:17:40.447421066 +0000 2023-12-16T03:24:06.164 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-12-16 03:17:40.447421066 +0000 2023-12-16T03:24:06.164 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2023-12-16 03:17:40.447421066 +0000 2023-12-16T03:24:06.164 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T03:24:06.231 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-12-16T03:24:06.231 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-12-16T03:24:06.231 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.0002918 s, 1.8 MB/s 2023-12-16T03:24:06.233 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T03:24:06.286 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_4 2023-12-16T03:24:06.336 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T03:24:06.336 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:24:06.336 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-12-16T03:24:06.336 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:24:06.336 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-12-16 03:17:41.623410613 +0000 2023-12-16T03:24:06.336 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-12-16 03:17:41.207414311 +0000 2023-12-16T03:24:06.336 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-12-16 03:17:41.207414311 +0000 2023-12-16T03:24:06.336 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2023-12-16 03:17:41.207414311 +0000 2023-12-16T03:24:06.336 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T03:24:06.402 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-12-16T03:24:06.402 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-12-16T03:24:06.403 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000274471 s, 1.9 MB/s 2023-12-16T03:24:06.404 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T03:24:06.457 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T03:24:06.457 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:06.458 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2023-12-16T03:24:06.467 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-16T03:24:06.467 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2023-12-16T03:24:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-16T03:24:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:24:06.524 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 886 Links: 1 2023-12-16T03:24:06.524 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:24:06.524 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-16 03:17:34.431646450 +0000 2023-12-16T03:24:06.524 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-16 03:17:34.055649809 +0000 2023-12-16T03:24:06.524 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-16 03:17:34.055649809 +0000 2023-12-16T03:24:06.524 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2023-12-16 03:17:34.055649809 +0000 2023-12-16T03:24:06.524 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-16T03:24:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-16T03:24:06.590 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-16T03:24:06.591 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000640803 s, 799 kB/s 2023-12-16T03:24:06.592 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-16T03:24:06.649 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2023-12-16T03:24:06.699 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-16T03:24:06.699 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:24:06.700 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 906 Links: 1 2023-12-16T03:24:06.700 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:24:06.700 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-16 03:17:35.103640448 +0000 2023-12-16T03:24:06.700 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-16 03:17:34.691644127 +0000 2023-12-16T03:24:06.700 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-16 03:17:34.691644127 +0000 2023-12-16T03:24:06.700 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2023-12-16 03:17:34.691644127 +0000 2023-12-16T03:24:06.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-16T03:24:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-16T03:24:06.761 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-16T03:24:06.762 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00039827 s, 1.3 MB/s 2023-12-16T03:24:06.763 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-16T03:24:06.817 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2023-12-16T03:24:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-16T03:24:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:24:06.867 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 921 Links: 1 2023-12-16T03:24:06.867 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:24:06.867 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-16 03:17:35.751634660 +0000 2023-12-16T03:24:06.867 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-16 03:17:35.371638054 +0000 2023-12-16T03:24:06.867 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-16 03:17:35.371638054 +0000 2023-12-16T03:24:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2023-12-16 03:17:35.371638054 +0000 2023-12-16T03:24:06.868 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-16T03:24:06.930 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-16T03:24:06.930 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-16T03:24:06.930 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000382754 s, 1.3 MB/s 2023-12-16T03:24:06.932 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-16T03:24:06.987 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2023-12-16T03:24:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-16T03:24:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-16T03:24:07.039 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 940 Links: 1 2023-12-16T03:24:07.039 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-16T03:24:07.040 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-16 03:17:36.403628835 +0000 2023-12-16T03:24:07.040 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-16 03:17:36.015632301 +0000 2023-12-16T03:24:07.040 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-16 03:17:36.015632301 +0000 2023-12-16T03:24:07.040 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2023-12-16 03:17:36.015632301 +0000 2023-12-16T03:24:07.040 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-16T03:24:07.106 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-16T03:24:07.106 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-16T03:24:07.106 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000674165 s, 759 kB/s 2023-12-16T03:24:07.108 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-16T03:24:07.161 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T03:24:07.161 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-16T03:24:07.161 INFO:tasks.ceph:Generating config... 2023-12-16T03:24:07.162 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-16T03:24:07.163 INFO:tasks.ceph:[client] debug client = 20 2023-12-16T03:24:07.163 INFO:tasks.ceph:[client] debug ms = 1 2023-12-16T03:24:07.163 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-16T03:24:07.163 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-16T03:24:07.163 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-16T03:24:07.163 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-16T03:24:07.163 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-16T03:24:07.163 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-16T03:24:07.163 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-16T03:24:07.163 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-16T03:24:07.163 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-16T03:24:07.163 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-16T03:24:07.163 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-16T03:24:07.163 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-16T03:24:07.163 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-16T03:24:07.163 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-16T03:24:07.164 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-16T03:24:07.164 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-16T03:24:07.164 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-16T03:24:07.164 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-16T03:24:07.164 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-16T03:24:07.164 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-16T03:24:07.164 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-16T03:24:07.164 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-16T03:24:07.164 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-16T03:24:07.164 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-16T03:24:07.164 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-16T03:24:07.164 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-16T03:24:07.164 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-16T03:24:07.164 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-16T03:24:07.164 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-16T03:24:07.165 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-16T03:24:07.165 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-16T03:24:07.165 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-16T03:24:07.165 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-16T03:24:07.165 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-16T03:24:07.165 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-16T03:24:07.165 INFO:tasks.ceph:Setting up mon.a... 2023-12-16T03:24:07.165 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-16T03:24:07.213 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.keyring 2023-12-16T03:24:07.230 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-16T03:24:07.320 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T03:24:07.342 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.28'), ('mon.b', '172.21.15.134'), ('mon.c', '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]')] 2023-12-16T03:24:07.342 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.28,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-16T03:24:07.343 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:07.343 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-16T03:24:07.399 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.28 --add b 172.21.15.134 --addv c '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: generated fsid 96b65b79-be1d-4832-b923-85c874d6fb27 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:setting min_mon_release = pacific 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 0 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:fsid 96b65b79-be1d-4832-b923-85c874d6fb27 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:last_changed 2023-12-16T03:24:07.498063+0000 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:created 2023-12-16T03:24:07.498063+0000 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:min_mon_release 16 (pacific) 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:election_strategy: 1 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2023-12-16T03:24:07.496 INFO:teuthology.orchestra.run.smithi028.stdout:2: [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] mon.c 2023-12-16T03:24:07.497 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-16T03:24:07.499 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-16T03:24:07.507 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 96b65b79-be1d-4832-b923-85c874d6fb27... 2023-12-16T03:24:07.508 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-16T03:24:07.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout:[global] 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout: chdir = "" 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout: auth supported = cephx 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout: filestore xattr use omap = true 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout: mon clock drift allowed = 1.000 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout: osd crush chooseleaf type = 0 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout: auth debug = true 2023-12-16T03:24:07.596 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on old message = true 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on bug = true 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: mon pg warn max object skew = 0 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: # disable pg_autoscaler by default for new pools 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default size = 2 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow primary affinity = true 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow pg remap = true 2023-12-16T03:24:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on legacy crush tunables = false 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on crush straw calc version zero = false 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on no sortbitwise = false 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on osd down out interval zero = false 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on too few osds = false 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: mon_allow_pool_size_one = true 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: osd default data pool replay window = 5 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: mon allow pool delete = true 2023-12-16T03:24:07.598 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: mon cluster log file level = debug 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: debug asserts on shutdown = true 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: mon health detail to clog = false 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: mon host = "172.21.15.28,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on skipped message = False 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: fsid = 96b65b79-be1d-4832-b923-85c874d6fb27 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout:[osd] 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: osd journal size = 100 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub load threshold = 5.0 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub max interval = 600 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: osd mclock profile = high_recovery_ops 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: osd recover clone overlap = true 2023-12-16T03:24:07.599 INFO:teuthology.orchestra.run.smithi028.stdout: osd recovery max chunk = 1048576 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug shutdown = true 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug op order = true 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug verify stray on activate = true 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug trim objects = true 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: osd open classes on start = true 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug pg log writeout = true 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: osd deep scrub update digest min age = 30 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: osd map max advance = 10 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: journal zero on create = true 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.600 INFO:teuthology.orchestra.run.smithi028.stdout: filestore ondisk finisher threads = 3 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: filestore apply finisher threads = 3 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: bdev debug aio = true 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug misdirected ops = true 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: bdev async discard = True 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: bdev enable discard = True 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore allocator = bitmap 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore block size = 96636764160 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore fsck on mount = True 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluefs = 1/20 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluestore = 1/20 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: debug osd = 20 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: debug rocksdb = 4/10 2023-12-16T03:24:07.601 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd backfillfull_ratio = 0.85 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd full ratio = 0.9 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd nearfull ratio = 0.8 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: osd failsafe full ratio = 0.95 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: osd objectstore = bluestore 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: osd op complaint time = 180 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr] 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: debug mgr = 20 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: mgr/telemetry/nag = false 2023-12-16T03:24:07.602 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout:[mon] 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: debug paxos = 20 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: mon data avail warn = 5 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: mon mgr mkfs grace = 240 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd reporter subtree level = osd 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd prime pg temp = true 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: auth mon ticket ttl = 660 # 11m 2023-12-16T03:24:07.603 INFO:teuthology.orchestra.run.smithi028.stdout: auth service ticket ttl = 240 # 4m 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: # don't complain about insecure global_id in the test suite 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: # 1m isn't quite enough 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: mon_down_mkfs_grace = 2m 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_filestore_osds = false 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: mon op complaint time = 120 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout:[client] 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: rgw cache enabled = true 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable ops log = true 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable usage log = true 2023-12-16T03:24:07.604 INFO:teuthology.orchestra.run.smithi028.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout: client mount timeout = 600 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout: debug client = 20 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout: rados mon op timeout = 900 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout: rados osd op timeout = 900 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.a] 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.b] 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.c] 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a] 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c] 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b] 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.d] 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout:[mds] 2023-12-16T03:24:07.605 INFO:teuthology.orchestra.run.smithi028.stdout: debug mds = 20 2023-12-16T03:24:07.606 INFO:teuthology.orchestra.run.smithi028.stdout: debug mds balancer = 20 2023-12-16T03:24:07.606 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-12-16T03:24:07.606 INFO:teuthology.orchestra.run.smithi028.stdout: mds debug frag = True 2023-12-16T03:24:07.606 INFO:teuthology.orchestra.run.smithi028.stdout: mds debug scatterstat = True 2023-12-16T03:24:07.606 INFO:teuthology.orchestra.run.smithi028.stdout: mds op complaint time = 180 2023-12-16T03:24:07.606 INFO:teuthology.orchestra.run.smithi028.stdout: mds verify scatter = True 2023-12-16T03:24:07.606 INFO:teuthology.orchestra.run.smithi028.stdout: osd op complaint time = 180 2023-12-16T03:24:07.606 INFO:teuthology.orchestra.run.smithi028.stdout: rados mon op timeout = 900 2023-12-16T03:24:07.606 INFO:teuthology.orchestra.run.smithi028.stdout: rados osd op timeout = 900 2023-12-16T03:24:07.606 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2023-12-16T03:24:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2023-12-16T03:24:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.28,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2023-12-16T03:24:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on skipped message = False 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 96b65b79-be1d-4832-b923-85c874d6fb27 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2023-12-16T03:24:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = bitmap 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2023-12-16T03:24:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2023-12-16T03:24:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2023-12-16T03:24:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds balancer = 20 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2023-12-16T03:24:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2023-12-16T03:24:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2023-12-16T03:24:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2023-12-16T03:24:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2023-12-16T03:24:07.618 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-16T03:24:07.618 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-16T03:24:07.722 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-16T03:24:07.722 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:07.722 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-16T03:24:07.731 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:07.731 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-16T03:24:07.782 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:24:07.782 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:07.782 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-16T03:24:07.782 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T03:24:07.859 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:07.859 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:07.910 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:24:07.910 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:07.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-16T03:24:07.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-16T03:24:07.947 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:07.948 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:07.999 INFO:tasks.ceph:Setting up mon nodes... 2023-12-16T03:24:07.999 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-16T03:24:07.999 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-16T03:24:08.057 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-16T03:24:08.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-16T03:24:08.122 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-16T03:24:08.143 INFO:tasks.ceph:Setting up mds nodes... 2023-12-16T03:24:08.143 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-16T03:24:08.202 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-16T03:24:08.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-16T03:24:08.227 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-16T03:24:08.328 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-16T03:24:08.332 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-16T03:24:08.353 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-16T03:24:08.413 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-16T03:24:08.417 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-16T03:24:08.439 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-16T03:24:08.539 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-16T03:24:08.544 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-16T03:24:08.564 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-16T03:24:08.564 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-16T03:24:08.610 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-16T03:24:08.628 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-16T03:24:08.671 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-16T03:24:08.688 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-16T03:24:08.688 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-16T03:24:08.688 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-16T03:24:08.709 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T03:24:08.709 INFO:tasks.ceph:role: osd.0 2023-12-16T03:24:08.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:24:08.710 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-16T03:24:08.770 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:24:08.770 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:24:08.770 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:24:08.770 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-16T03:24:08.770 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:24:08.770 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:24:08.770 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:24:08.770 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-16T03:24:08.770 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:24:08.771 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:24:08.794 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-12-16T03:24:08.797 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-12-16T03:24:08.797 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-16T03:24:08.864 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-16T03:24:08.922 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-12-16T03:24:08.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:24:08.923 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-16T03:24:08.986 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T03:24:08.987 INFO:tasks.ceph:role: osd.1 2023-12-16T03:24:08.987 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:24:08.987 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-16T03:24:09.054 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:24:09.054 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:24:09.054 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:24:09.054 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-16T03:24:09.054 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:24:09.054 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:24:09.054 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:24:09.055 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-16T03:24:09.055 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:24:09.055 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:24:09.078 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-12-16T03:24:09.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-12-16T03:24:09.081 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-16T03:24:09.151 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-16T03:24:09.210 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-12-16T03:24:09.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:24:09.211 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-16T03:24:09.274 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T03:24:09.274 INFO:tasks.ceph:role: osd.2 2023-12-16T03:24:09.274 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:24:09.275 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-16T03:24:09.338 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:24:09.338 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:24:09.338 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:24:09.338 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-16T03:24:09.338 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:24:09.338 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:24:09.339 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:24:09.339 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-16T03:24:09.339 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:24:09.339 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:24:09.363 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-12-16T03:24:09.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-12-16T03:24:09.365 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-16T03:24:09.432 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-16T03:24:09.490 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-12-16T03:24:09.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:24:09.491 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-16T03:24:09.557 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-16T03:24:09.557 INFO:tasks.ceph:role: osd.3 2023-12-16T03:24:09.557 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:24:09.558 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-16T03:24:09.619 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:24:09.619 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:24:09.619 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:24:09.619 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-16T03:24:09.619 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:24:09.620 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:24:09.620 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:24:09.620 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-16T03:24:09.620 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:24:09.620 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:24:09.643 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-12-16T03:24:09.646 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-12-16T03:24:09.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-16T03:24:09.715 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-16T03:24:09.774 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-12-16T03:24:09.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:24:09.776 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:09.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:09.896+0000 7ff3c9065640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-16T03:24:09.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:09.896+0000 7ff3c9065640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-16T03:24:09.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:09.896+0000 7ff3c9065640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-16T03:24:09.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:09.896+0000 7ff3c9065640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-16T03:24:09.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:09.896+0000 7ff3c9065640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-16T03:24:09.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:09.896+0000 7ff3c9065640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-16T03:24:12.888 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-16T03:24:12.910 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:13.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:13.008+0000 7f6acc3a9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-16T03:24:13.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:13.012+0000 7f6acc3a9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-16T03:24:13.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:13.012+0000 7f6acc3a9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-16T03:24:13.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:13.012+0000 7f6acc3a9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-16T03:24:13.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:13.012+0000 7f6acc3a9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-16T03:24:13.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:13.012+0000 7f6acc3a9640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-16T03:24:15.994 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-16T03:24:16.016 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:16.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:16.120+0000 7fb0e6f03640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-16T03:24:16.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:16.120+0000 7fb0e6f03640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-16T03:24:16.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:16.120+0000 7fb0e6f03640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-16T03:24:16.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:16.120+0000 7fb0e6f03640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-16T03:24:16.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:16.120+0000 7fb0e6f03640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-16T03:24:16.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:16.120+0000 7fb0e6f03640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-16T03:24:19.118 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-16T03:24:19.141 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:19.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:19.236+0000 7ff7d5454640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-16T03:24:19.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:19.236+0000 7ff7d5454640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-16T03:24:19.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:19.236+0000 7ff7d5454640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-16T03:24:19.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:19.236+0000 7ff7d5454640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-16T03:24:19.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:19.236+0000 7ff7d5454640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-16T03:24:19.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:19.240+0000 7ff7d5454640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-16T03:24:22.231 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-16T03:24:22.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-16T03:24:22.277 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T03:24:22.277 INFO:tasks.ceph:role: osd.4 2023-12-16T03:24:22.277 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:24:22.277 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-16T03:24:22.347 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:24:22.348 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:24:22.348 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:24:22.348 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-16T03:24:22.348 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:24:22.348 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:24:22.348 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:24:22.348 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-16T03:24:22.348 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:24:22.348 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:24:22.817 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-12-16T03:24:22.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-12-16T03:24:22.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-16T03:24:22.978 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-16T03:24:22.996 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2023-12-16T03:24:22.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:24:22.997 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-16T03:24:23.059 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T03:24:23.059 INFO:tasks.ceph:role: osd.5 2023-12-16T03:24:23.060 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:24:23.060 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-16T03:24:23.130 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:24:23.131 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:24:23.561 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-12-16T03:24:23.565 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-12-16T03:24:23.565 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-16T03:24:23.666 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-16T03:24:23.684 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2023-12-16T03:24:23.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:24:23.685 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-16T03:24:23.750 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T03:24:23.751 INFO:tasks.ceph:role: osd.6 2023-12-16T03:24:23.751 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:24:23.751 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-16T03:24:23.823 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:24:23.823 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:24:23.823 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:24:23.823 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-16T03:24:23.823 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:24:23.823 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:24:23.823 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:24:23.823 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-16T03:24:23.823 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:24:23.823 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:24:24.287 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-12-16T03:24:24.290 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-12-16T03:24:24.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-16T03:24:24.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-16T03:24:24.458 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2023-12-16T03:24:24.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:24:24.460 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-16T03:24:24.523 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-16T03:24:24.523 INFO:tasks.ceph:role: osd.7 2023-12-16T03:24:24.523 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:24:24.523 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-16T03:24:24.596 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-16T03:24:24.596 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-16T03:24:24.596 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-16T03:24:24.596 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-16T03:24:24.596 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-16T03:24:24.596 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-12-16T03:24:24.596 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-16T03:24:24.597 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-16T03:24:24.597 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-16T03:24:24.597 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-16T03:24:25.085 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-12-16T03:24:25.088 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-12-16T03:24:25.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-16T03:24:25.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-16T03:24:25.271 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2023-12-16T03:24:25.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:24:25.272 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:25.419+0000 7fc7b9edc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-16T03:24:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:25.419+0000 7fc7b9edc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-16T03:24:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:25.419+0000 7fc7b9edc640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-16T03:24:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:25.419+0000 7fc7b9edc640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-16T03:24:25.421 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:25.419+0000 7fc7b9edc640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-16T03:24:25.423 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:25.423+0000 7fc7b9edc640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-16T03:24:28.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-16T03:24:28.463 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:28.561 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:28.559+0000 7f376c02b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-16T03:24:28.562 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:28.559+0000 7f376c02b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-16T03:24:28.562 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:28.559+0000 7f376c02b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-16T03:24:28.562 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:28.559+0000 7f376c02b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-16T03:24:28.562 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:28.559+0000 7f376c02b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-16T03:24:28.563 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:28.563+0000 7f376c02b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-16T03:24:31.542 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-16T03:24:31.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:31.659 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:31.659+0000 7fcb79d67640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-16T03:24:31.660 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:31.659+0000 7fcb79d67640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-16T03:24:31.660 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:31.659+0000 7fcb79d67640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-16T03:24:31.660 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:31.659+0000 7fcb79d67640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-16T03:24:31.660 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:31.659+0000 7fcb79d67640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-16T03:24:31.661 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:31.659+0000 7fcb79d67640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-16T03:24:34.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-16T03:24:34.670 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:34.771 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:34.770+0000 7f8b5530b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-16T03:24:34.772 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:34.770+0000 7f8b5530b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-16T03:24:34.772 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:34.770+0000 7f8b5530b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-16T03:24:34.772 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:34.770+0000 7f8b5530b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-16T03:24:34.772 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:34.770+0000 7f8b5530b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-16T03:24:34.774 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:34.770+0000 7f8b5530b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-16T03:24:35.641 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:24:35.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:24:37.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-16T03:24:37.783 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-16T03:24:37.783 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:37.783 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-16T03:24:37.807 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:37.807 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-16T03:24:37.872 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:37.872 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-16T03:24:37.936 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:37.936 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-16T03:24:38.003 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:38.003 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-16T03:24:38.071 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:38.072 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-16T03:24:38.135 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:38.135 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-16T03:24:38.203 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:38.203 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-16T03:24:38.225 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:38.226 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-16T03:24:38.291 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:38.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-16T03:24:38.355 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:38.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-16T03:24:38.418 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:38.418 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-16T03:24:38.482 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:38.482 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-16T03:24:38.546 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:38.546 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-16T03:24:38.610 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:38.610 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-16T03:24:38.620 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:38.621 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-16T03:24:38.662 INFO:tasks.ceph:Adding keys to all mons... 2023-12-16T03:24:38.662 DEBUG:teuthology.orchestra.run.smithi028:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-16T03:24:38.668 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-16T03:24:38.710 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.y] 2023-12-16T03:24:38.710 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1l2CKLAxAA1E6EQPvBVrOt77Tw/cAi3A== 2023-12-16T03:24:38.710 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a] 2023-12-16T03:24:38.710 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1lGdUuDBAA9e6veUuYLf2+kocAK6lSbA== 2023-12-16T03:24:38.710 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c] 2023-12-16T03:24:38.710 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1lhw+xExAA3bRuBx2ItsL1Rc8see+tCQ== 2023-12-16T03:24:38.710 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.0] 2023-12-16T03:24:38.710 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBZGH1l80qNNRAA0+mdmZ1tm0i6Jc4XYM4aCw== 2023-12-16T03:24:38.710 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.1] 2023-12-16T03:24:38.710 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBdGH1lJW/FABAAm5ylV9HO9EWb+06Y2OwfVw== 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.2] 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBgGH1l9x5DBxAAYGKOx8uO5Nf5KROP8dcugA== 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.3] 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBjGH1lEwhVDhAAA66C1s8baoujas3ncXfeiA== 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.x] 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1l0bdlBxAA/aAGpB8vk/Ggs6Mi6E57sw== 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b] 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1lVwi5GBAAaUcDHi9WGhRuJZxdAF2qFA== 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.d] 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1ljr1CIBAAkEkWnhykut5uG4ARAKJvRA== 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.4] 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBpGH1lUKgjGRAACZa14hbBnIoe+pU4Z38i0w== 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.5] 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBsGH1lzxWVIRAApu48WaE3/juZiozOmmbZnA== 2023-12-16T03:24:38.711 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.6] 2023-12-16T03:24:38.712 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBvGH1laENmJxAAmYE1mukqTgUzVp+h5pRYVw== 2023-12-16T03:24:38.712 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.7] 2023-12-16T03:24:38.712 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQByGH1lyEIXLhAAIfj8iGtpH2wLL/lvBoPkaA== 2023-12-16T03:24:38.712 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2023-12-16T03:24:38.712 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1lvVeHJBAAIUmgW3XLan0rUG31Cw+zwQ== 2023-12-16T03:24:38.712 INFO:teuthology.orchestra.run.smithi028.stdout:[client.1] 2023-12-16T03:24:38.712 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1lgMMbKBAACWizLH1wqYLfSHVjCwyqHQ== 2023-12-16T03:24:38.724 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2023-12-16T03:24:38.724 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBYGH1l2CKLAxAA1E6EQPvBVrOt77Tw/cAi3A== 2023-12-16T03:24:38.724 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2023-12-16T03:24:38.724 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBYGH1lGdUuDBAA9e6veUuYLf2+kocAK6lSbA== 2023-12-16T03:24:38.724 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2023-12-16T03:24:38.724 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBYGH1lhw+xExAA3bRuBx2ItsL1Rc8see+tCQ== 2023-12-16T03:24:38.724 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2023-12-16T03:24:38.724 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBZGH1l80qNNRAA0+mdmZ1tm0i6Jc4XYM4aCw== 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBdGH1lJW/FABAAm5ylV9HO9EWb+06Y2OwfVw== 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBgGH1l9x5DBxAAYGKOx8uO5Nf5KROP8dcugA== 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBjGH1lEwhVDhAAA66C1s8baoujas3ncXfeiA== 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBYGH1l0bdlBxAA/aAGpB8vk/Ggs6Mi6E57sw== 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBYGH1lVwi5GBAAaUcDHi9WGhRuJZxdAF2qFA== 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBYGH1ljr1CIBAAkEkWnhykut5uG4ARAKJvRA== 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2023-12-16T03:24:38.725 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBpGH1lUKgjGRAACZa14hbBnIoe+pU4Z38i0w== 2023-12-16T03:24:38.726 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2023-12-16T03:24:38.726 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBsGH1lzxWVIRAApu48WaE3/juZiozOmmbZnA== 2023-12-16T03:24:38.726 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2023-12-16T03:24:38.726 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBvGH1laENmJxAAmYE1mukqTgUzVp+h5pRYVw== 2023-12-16T03:24:38.726 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2023-12-16T03:24:38.726 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQByGH1lyEIXLhAAIfj8iGtpH2wLL/lvBoPkaA== 2023-12-16T03:24:38.726 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2023-12-16T03:24:38.726 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBYGH1lvVeHJBAAIUmgW3XLan0rUG31Cw+zwQ== 2023-12-16T03:24:38.726 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2023-12-16T03:24:38.726 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBYGH1lgMMbKBAACWizLH1wqYLfSHVjCwyqHQ== 2023-12-16T03:24:38.727 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T03:24:38.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T03:24:38.826 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T03:24:38.830 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T03:24:38.889 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T03:24:38.893 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T03:24:38.951 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:38.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.008 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.012 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.066 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.125 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.128 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.184 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T03:24:39.188 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-16T03:24:39.241 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T03:24:39.247 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T03:24:39.304 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T03:24:39.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-16T03:24:39.365 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.368 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.422 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.481 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.539 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-16T03:24:39.597 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-16T03:24:39.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-16T03:24:39.658 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-16T03:24:39.661 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-16T03:24:39.718 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-16T03:24:39.718 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-16T03:24:39.739 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-16T03:24:39.861 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-16T03:24:39.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-16T03:24:39.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-16T03:24:40.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-16T03:24:40.039 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-16T03:24:40.101 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-16T03:24:40.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-16T03:24:40.235 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:40.238 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-16T03:24:40.286 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-16T03:24:40.286 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-16T03:24:40.286 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-16T03:24:40.293 INFO:tasks.ceph.mon.a:Started 2023-12-16T03:24:40.293 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-16T03:24:40.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-16T03:24:40.329 INFO:tasks.ceph.mon.b:Started 2023-12-16T03:24:40.329 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-16T03:24:40.329 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-16T03:24:40.332 INFO:tasks.ceph.mon.c:Started 2023-12-16T03:24:40.332 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-16T03:24:40.333 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-16T03:24:40.333 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-16T03:24:40.336 INFO:tasks.ceph.mgr.y:Started 2023-12-16T03:24:40.336 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-16T03:24:40.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-16T03:24:40.340 INFO:tasks.ceph.mgr.x:Started 2023-12-16T03:24:40.340 INFO:tasks.ceph:Setting crush tunables to default 2023-12-16T03:24:40.340 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd crush tunables default 2023-12-16T03:24:40.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.479+0000 7fcfd4ed6640 1 Processor -- start 2023-12-16T03:24:40.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.479+0000 7fcfd4ed6640 1 -- start start 2023-12-16T03:24:40.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfd4ed6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:40.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfd4ed6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:40.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfd4ed6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd006c860 con 0x7fcfd00c7ea0 2023-12-16T03:24:40.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfd4ed6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00c8750 con 0x7fcfd00c4e60 2023-12-16T03:24:40.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfd4ed6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd01552d0 con 0x7fcfd0151e90 2023-12-16T03:24:40.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfced9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:40.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfced9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58232/0 (socket says 172.21.15.28:58232) 2023-12-16T03:24:40.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 learned_addr learned my addr 172.21.15.28:0/3251569172 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:24:40.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 msgr2=0x7fcfd006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-16T03:24:40.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 msgr2=0x7fcfd006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:40.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:40.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:40.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:24:40.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 msgr2=0x7fcfd00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:40.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 msgr2=0x7fcfd00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:40.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:40.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.483+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:24:40.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.687+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:40.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.687+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 msgr2=0x7fcfd006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-16T03:24:40.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.687+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 msgr2=0x7fcfd006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:40.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.687+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:40.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.687+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:40.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.687+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:24:40.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.687+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 msgr2=0x7fcfd00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:40.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.687+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 msgr2=0x7fcfd00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:40.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.687+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:40.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:40.687+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:24:41.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.091+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:41.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.091+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:41.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.091+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 msgr2=0x7fcfd006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-16T03:24:41.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.091+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 msgr2=0x7fcfd006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:41.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.091+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:41.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.091+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T03:24:41.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.091+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 msgr2=0x7fcfd00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:41.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.091+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 msgr2=0x7fcfd00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:41.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.091+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:41.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.091+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T03:24:41.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.895+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:41.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.895+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 msgr2=0x7fcfd006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-16T03:24:41.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.895+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 msgr2=0x7fcfd006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:41.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.895+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:41.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.895+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T03:24:41.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.895+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:41.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.895+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 msgr2=0x7fcfd00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:41.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.895+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 msgr2=0x7fcfd00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:41.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.895+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:41.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:41.895+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T03:24:43.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 msgr2=0x7fcfd00c4920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfccd99640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfd0151e90 0x7fcfd00c4920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 msgr2=0x7fcfd006bbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfccd99640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfd00c4e60 0x7fcfd006bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 >> v1:172.21.15.28:6789/0 conn(0x7fcfd00c7ea0 legacy=0x7fcfd006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfccd99640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd0154930 con 0x7fcfb0006200 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00c8750 con 0x7fcfb00036a0 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:43.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.483+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:24:43.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.687+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:43.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.687+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:43.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.687+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:43.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.687+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:43.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:43.687+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:24:44.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:44.091+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:44.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:44.091+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:44.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:44.091+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:44.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:44.091+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:44.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:44.091+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T03:24:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:44.895+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:44.895+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:44.895+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:44.895+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:44.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:44.895+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T03:24:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T03:24:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfccd99640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 >> v1:172.21.15.134:6789/0 conn(0x7fcfb0006200 legacy=0x7fcfb00086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfccd99640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 reap_dead start 2023-12-16T03:24:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfccd99640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb000b000 con 0x7fcfb000a060 2023-12-16T03:24:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00c8750 con 0x7fcfb0008e90 2023-12-16T03:24:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd01552d0 con 0x7fcfb00036a0 2023-12-16T03:24:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 msgr2=0x7fcfb00086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-16T03:24:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 msgr2=0x7fcfb00086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:24:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.482+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:24:46.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.686+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:46.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.686+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:46.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.686+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 msgr2=0x7fcfb00086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:46.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.686+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 msgr2=0x7fcfb00086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:46.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.686+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:46.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.686+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:24:46.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.686+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-16T03:24:46.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.686+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:46.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.686+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:46.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:46.686+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:24:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.090+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.090+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.090+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.090+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.090+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.090+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T03:24:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.090+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 msgr2=0x7fcfb00086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-16T03:24:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.090+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 msgr2=0x7fcfb00086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.090+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.090+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T03:24:47.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.894+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:47.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.894+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:47.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.894+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 msgr2=0x7fcfb00086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-16T03:24:47.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.894+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 msgr2=0x7fcfb00086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:47.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.894+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:47.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.894+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T03:24:47.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.894+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:47.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.894+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:47.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.894+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:47.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:47.894+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-16T03:24:49.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 msgr2=0x7fcfb0005ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfccd99640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfb00036a0 0x7fcfb0005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 msgr2=0x7fcfb00086c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfccd99640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.134:3300/0 conn(0x7fcfb0008e90 0x7fcfb00086c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 >> v1:172.21.15.134:6789/0 conn(0x7fcfb000a060 legacy=0x7fcfb000a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfccd99640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 0x7fcfb0010300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00092a0 con 0x7fcfb0009a80 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfccd99640 1 -- 172.21.15.28:0/3251569172 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00c8750 con 0x7fcfb00095e0 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 0x7fcfb0010300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 msgr2=0x7fcfb0010300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 msgr2=0x7fcfb0010300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 0x7fcfb0010300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:49.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.482+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 0x7fcfb0010300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-16T03:24:49.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.686+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 0x7fcfb0010300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:49.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.686+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 msgr2=0x7fcfb0010300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:49.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.686+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 msgr2=0x7fcfb0010300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:49.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.686+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 0x7fcfb0010300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:49.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:49.686+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 0x7fcfb0010300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-16T03:24:50.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.090+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 0x7fcfb0010300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:50.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.090+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 msgr2=0x7fcfb0010300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-16T03:24:50.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.090+0000 7fcfce59c640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 msgr2=0x7fcfb0010300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-16T03:24:50.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.090+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 0x7fcfb0010300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-16T03:24:50.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.090+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 0x7fcfb0010300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-16T03:24:50.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879736501 0 0) 0x7fcfb00092a0 con 0x7fcfb0009a80 2023-12-16T03:24:50.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfbc003530 con 0x7fcfb0009a80 2023-12-16T03:24:50.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1894371619 0 0) 0x7fcfbc003530 con 0x7fcfb0009a80 2023-12-16T03:24:50.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 msgr2=0x7fcfb0010300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T03:24:50.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 --2- 172.21.15.28:0/3251569172 >> v2:172.21.15.28:3300/0 conn(0x7fcfb00095e0 0x7fcfb0010300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0015140 con 0x7fcfb0009a80 2023-12-16T03:24:50.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fcfb80016c0 con 0x7fcfb0009a80 2023-12-16T03:24:50.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 >> v1:172.21.15.28:6789/0 conn(0x7fcfb0009a80 legacy=0x7fcfb0012850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:50.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfced9d640 1 -- 172.21.15.28:0/3251569172 reap_dead start 2023-12-16T03:24:50.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc003980 0x7fcfbc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:50.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc0047d0 0x7fcfbc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:50.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfbc005260 0x7fcfbc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:50.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00c8750 con 0x7fcfbc003980 2023-12-16T03:24:50.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc00c1b0 con 0x7fcfbc0047d0 2023-12-16T03:24:50.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc00c370 con 0x7fcfbc005260 2023-12-16T03:24:50.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc003980 0x7fcfbc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:50.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfc7fff640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc0047d0 0x7fcfbc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:50.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfced9d640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfbc005260 0x7fcfbc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:50.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfc7fff640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfbc005260 msgr2=0x7fcfbc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:24:50.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfc7fff640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfbc005260 0x7fcfbc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfc7fff640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc003980 msgr2=0x7fcfbc003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:24:50.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfc7fff640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc003980 0x7fcfbc003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfc7fff640 1 -- 172.21.15.28:0/3251569172 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc003530 con 0x7fcfbc0047d0 2023-12-16T03:24:50.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.650+0000 7fcfce59c640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc003980 0x7fcfbc003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:24:50.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfc7fff640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc0047d0 0x7fcfbc004c50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009ed0 tx=0x7fcfb801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94286cd70363deaa server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:50.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80a8620 con 0x7fcfbc0047d0 2023-12-16T03:24:50.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb80a8780 con 0x7fcfbc0047d0 2023-12-16T03:24:50.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfcdd9b640 1 -- 172.21.15.28:0/3251569172 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80a8b10 con 0x7fcfbc0047d0 2023-12-16T03:24:50.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc0047d0 msgr2=0x7fcfbc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:50.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfd4ed6640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc0047d0 0x7fcfbc004c50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009ed0 tx=0x7fcfb801c920 comp rx=0 tx=0).stop 2023-12-16T03:24:50.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/3251569172 shutdown_connections 2023-12-16T03:24:50.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfd4ed6640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfbc005260 0x7fcfbc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfd4ed6640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc0047d0 0x7fcfbc004c50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfd4ed6640 1 --2- 172.21.15.28:0/3251569172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc003980 0x7fcfbc003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/3251569172 >> 172.21.15.28:0/3251569172 conn(0x7fcfd00ca170 msgr2=0x7fcfd00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:50.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/3251569172 shutdown_connections 2023-12-16T03:24:50.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.654+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/3251569172 wait complete. 2023-12-16T03:24:50.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.658+0000 7fcfd4ed6640 1 Processor -- start 2023-12-16T03:24:50.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.658+0000 7fcfd4ed6640 1 -- start start 2023-12-16T03:24:50.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfd4ed6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc003980 0x7fcfd014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:50.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfd4ed6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfbc0047d0 0x7fcfd01ec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:50.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfd4ed6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc005260 0x7fcfd0070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:50.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfd4ed6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd01e90e0 con 0x7fcfbc005260 2023-12-16T03:24:50.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfd4ed6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd01e8830 con 0x7fcfbc003980 2023-12-16T03:24:50.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfd4ed6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd01eccf0 con 0x7fcfbc0047d0 2023-12-16T03:24:50.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfce59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc003980 0x7fcfd014d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:50.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfced9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc005260 0x7fcfd0070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:50.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfce59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc003980 0x7fcfd014d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:37144/0 (socket says 172.21.15.28:37144) 2023-12-16T03:24:50.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfce59c640 1 -- 172.21.15.28:0/907768804 learned_addr learned my addr 172.21.15.28:0/907768804 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:24:50.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfc7fff640 1 --2- 172.21.15.28:0/907768804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfbc0047d0 0x7fcfd01ec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfce59c640 1 -- 172.21.15.28:0/907768804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfbc0047d0 msgr2=0x7fcfd01ec7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfce59c640 1 --2- 172.21.15.28:0/907768804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfbc0047d0 0x7fcfd01ec7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfce59c640 1 -- 172.21.15.28:0/907768804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc005260 msgr2=0x7fcfd0070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfce59c640 1 --2- 172.21.15.28:0/907768804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc005260 0x7fcfd0070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfce59c640 1 -- 172.21.15.28:0/907768804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd014df90 con 0x7fcfbc003980 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfced9d640 1 --2- 172.21.15.28:0/907768804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc005260 0x7fcfd0070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfce59c640 1 --2- 172.21.15.28:0/907768804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc003980 0x7fcfd014d6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0004180 tx=0x7fcfc00188e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfc6ffd640 1 -- 172.21.15.28:0/907768804 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00258d0 con 0x7fcfbc003980 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfc6ffd640 1 -- 172.21.15.28:0/907768804 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc001e040 con 0x7fcfbc003980 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/907768804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd014dcb0 con 0x7fcfbc003980 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfc6ffd640 1 -- 172.21.15.28:0/907768804 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0025c30 con 0x7fcfbc003980 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/907768804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd01e8d00 con 0x7fcfbc003980 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfc6ffd640 1 -- 172.21.15.28:0/907768804 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcfc002e730 con 0x7fcfbc003980 2023-12-16T03:24:50.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfc6ffd640 1 -- 172.21.15.28:0/907768804 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcfc0016670 con 0x7fcfbc003980 2023-12-16T03:24:50.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.662+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/907768804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd0068400 con 0x7fcfbc003980 2023-12-16T03:24:50.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.666+0000 7fcfc6ffd640 1 -- 172.21.15.28:0/907768804 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fcfc0033060 con 0x7fcfbc003980 2023-12-16T03:24:50.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.730+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/907768804 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcfd00c9a20 con 0x7fcfbc003980 2023-12-16T03:24:50.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.738+0000 7fcfc6ffd640 1 -- 172.21.15.28:0/907768804 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcfc003c090 con 0x7fcfbc003980 2023-12-16T03:24:50.743 INFO:teuthology.orchestra.run.smithi028.stderr:adjusted tunables profile to default 2023-12-16T03:24:50.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.742+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/907768804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc003980 msgr2=0x7fcfd014d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:50.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.742+0000 7fcfd4ed6640 1 --2- 172.21.15.28:0/907768804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc003980 0x7fcfd014d6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0004180 tx=0x7fcfc00188e0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.742+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/907768804 shutdown_connections 2023-12-16T03:24:50.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.742+0000 7fcfd4ed6640 1 --2- 172.21.15.28:0/907768804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcfbc005260 0x7fcfd0070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.742+0000 7fcfd4ed6640 1 --2- 172.21.15.28:0/907768804 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfbc0047d0 0x7fcfd01ec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.742+0000 7fcfd4ed6640 1 --2- 172.21.15.28:0/907768804 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfbc003980 0x7fcfd014d6d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:50.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.742+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/907768804 >> 172.21.15.28:0/907768804 conn(0x7fcfd00ca170 msgr2=0x7fcfd014b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:50.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.742+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/907768804 shutdown_connections 2023-12-16T03:24:50.745 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:50.742+0000 7fcfd4ed6640 1 -- 172.21.15.28:0/907768804 wait complete. 2023-12-16T03:24:50.764 INFO:tasks.ceph:check_enable_crimson: False 2023-12-16T03:24:50.764 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-16T03:24:50.764 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:50.764 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-16T03:24:50.786 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:50.786 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-16T03:24:50.847 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:50.847 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-16T03:24:50.853 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:50.850+0000 7fa052ab9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-16T03:24:50.873 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:24:50.874 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-16T03:24:50.935 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:50.935 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-16T03:24:50.959 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:50.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-16T03:24:51.028 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:51.028 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-16T03:24:51.085 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:51.081+0000 7fc60aa13180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-16T03:24:51.091 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:24:51.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-16T03:24:51.155 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 7c758861-c64f-484f-80c0-31e01bc6e9e8 0 2023-12-16T03:24:51.334 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.329+0000 7fb182ff8640 1 Processor -- start 2023-12-16T03:24:51.334 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.329+0000 7fb182ff8640 1 -- start start 2023-12-16T03:24:51.335 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb182ff8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb17c0c7ea0 0x7fb17c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.335 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb182ff8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb17c06b9e0 0x7fb17c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.336 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb182ff8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c06c860 con 0x7fb17c151e90 2023-12-16T03:24:51.336 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb182ff8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c0c8750 con 0x7fb17c0c7ea0 2023-12-16T03:24:51.336 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb182ff8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c1552d0 con 0x7fb17c06b9e0 2023-12-16T03:24:51.336 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb181595640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb17c06b9e0 0x7fb17c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.336 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb181595640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb17c06b9e0 0x7fb17c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36676/0 (socket says 172.21.15.134:36676) 2023-12-16T03:24:51.336 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb181595640 1 -- 172.21.15.134:0/1252965572 learned_addr learned my addr 172.21.15.134:0/1252965572 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-16T03:24:51.336 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb17bfff640 1 --2- 172.21.15.134:0/1252965572 >> v2:172.21.15.28:3300/0 conn(0x7fb17c0c7ea0 0x7fb17c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.336 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb181595640 1 -- 172.21.15.134:0/1252965572 >> v2:172.21.15.28:3300/0 conn(0x7fb17c0c7ea0 msgr2=0x7fb17c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:24:51.336 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb181595640 1 --2- 172.21.15.134:0/1252965572 >> v2:172.21.15.28:3300/0 conn(0x7fb17c0c7ea0 0x7fb17c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.336 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb181595640 1 -- 172.21.15.134:0/1252965572 >> v1:172.21.15.28:6789/0 conn(0x7fb17c151e90 legacy=0x7fb17c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.336 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb181595640 1 -- 172.21.15.134:0/1252965572 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c154930 con 0x7fb17c06b9e0 2023-12-16T03:24:51.338 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb181595640 1 --2- 172.21.15.134:0/1252965572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb17c06b9e0 0x7fb17c15f0a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb17c08c190 tx=0x7fb17401c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2151bc9ef52646ca server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:51.339 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb17b7fe640 1 -- 172.21.15.134:0/1252965572 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740a5570 con 0x7fb17c06b9e0 2023-12-16T03:24:51.339 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb17b7fe640 1 -- 172.21.15.134:0/1252965572 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1740a56d0 con 0x7fb17c06b9e0 2023-12-16T03:24:51.339 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.333+0000 7fb17b7fe640 1 -- 172.21.15.134:0/1252965572 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740a5a60 con 0x7fb17c06b9e0 2023-12-16T03:24:51.340 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 -- 172.21.15.134:0/1252965572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb17c06b9e0 msgr2=0x7fb17c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.340 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 --2- 172.21.15.134:0/1252965572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb17c06b9e0 0x7fb17c15f0a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb17c08c190 tx=0x7fb17401c8b0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.340 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 -- 172.21.15.134:0/1252965572 shutdown_connections 2023-12-16T03:24:51.340 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 --2- 172.21.15.134:0/1252965572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb17c06b9e0 0x7fb17c15f0a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.340 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 --2- 172.21.15.134:0/1252965572 >> v2:172.21.15.28:3300/0 conn(0x7fb17c0c7ea0 0x7fb17c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.340 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 -- 172.21.15.134:0/1252965572 >> 172.21.15.134:0/1252965572 conn(0x7fb17c0ca170 msgr2=0x7fb17c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:51.340 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 -- 172.21.15.134:0/1252965572 shutdown_connections 2023-12-16T03:24:51.340 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 -- 172.21.15.134:0/1252965572 wait complete. 2023-12-16T03:24:51.341 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 Processor -- start 2023-12-16T03:24:51.341 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 -- start start 2023-12-16T03:24:51.343 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb17c06b9e0 0x7fb17c0ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.343 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb17c0c7ea0 0x7fb17c141410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.343 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb17c151e90 0x7fb17c0bc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.343 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c147a70 con 0x7fb17c0c7ea0 2023-12-16T03:24:51.343 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0ab000 con 0x7fb17c151e90 2023-12-16T03:24:51.343 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb182ff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0ac8f0 con 0x7fb17c06b9e0 2023-12-16T03:24:51.343 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb181595640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb17c151e90 0x7fb17c0bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.343 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb180d94640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb17c06b9e0 0x7fb17c0ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.343 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb181595640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb17c151e90 0x7fb17c0bc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36680/0 (socket says 172.21.15.134:36680) 2023-12-16T03:24:51.343 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb181595640 1 -- 172.21.15.134:0/947269744 learned_addr learned my addr 172.21.15.134:0/947269744 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-16T03:24:51.344 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb17bfff640 1 --2- 172.21.15.134:0/947269744 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb17c0c7ea0 0x7fb17c141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.344 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb181595640 1 -- 172.21.15.134:0/947269744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb17c06b9e0 msgr2=0x7fb17c0ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.344 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb181595640 1 --2- 172.21.15.134:0/947269744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb17c06b9e0 0x7fb17c0ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.344 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb181595640 1 -- 172.21.15.134:0/947269744 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb17c0c7ea0 msgr2=0x7fb17c141410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.344 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb181595640 1 --2- 172.21.15.134:0/947269744 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb17c0c7ea0 0x7fb17c141410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.344 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.337+0000 7fb181595640 1 -- 172.21.15.134:0/947269744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb174009b30 con 0x7fb17c151e90 2023-12-16T03:24:51.344 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.341+0000 7fb181595640 1 --2- 172.21.15.134:0/947269744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb17c151e90 0x7fb17c0bc910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb1740194c0 tx=0x7fb174019650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:51.345 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.341+0000 7fb1797fa640 1 -- 172.21.15.134:0/947269744 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740a5570 con 0x7fb17c151e90 2023-12-16T03:24:51.345 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.341+0000 7fb1797fa640 1 -- 172.21.15.134:0/947269744 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1740b8690 con 0x7fb17c151e90 2023-12-16T03:24:51.346 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.341+0000 7fb1797fa640 1 -- 172.21.15.134:0/947269744 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740b8a40 con 0x7fb17c151e90 2023-12-16T03:24:51.346 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.341+0000 7fb182ff8640 1 -- 172.21.15.134:0/947269744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c1edb70 con 0x7fb17c151e90 2023-12-16T03:24:51.346 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.341+0000 7fb182ff8640 1 -- 172.21.15.134:0/947269744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c141950 con 0x7fb17c151e90 2023-12-16T03:24:51.346 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.341+0000 7fb1797fa640 1 -- 172.21.15.134:0/947269744 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb1740c1400 con 0x7fb17c151e90 2023-12-16T03:24:51.346 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.341+0000 7fb1797fa640 1 -- 172.21.15.134:0/947269744 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb1740b6440 con 0x7fb17c151e90 2023-12-16T03:24:51.346 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.341+0000 7fb182ff8640 1 -- 172.21.15.134:0/947269744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c068400 con 0x7fb17c151e90 2023-12-16T03:24:51.347 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.345+0000 7fb1797fa640 1 -- 172.21.15.134:0/947269744 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fb1740dfcf0 con 0x7fb17c151e90 2023-12-16T03:24:51.435 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:51.430+0000 7fa052ab9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-16T03:24:51.441 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.437+0000 7fb182ff8640 1 -- 172.21.15.134:0/947269744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c758861-c64f-484f-80c0-31e01bc6e9e8", "id": 0} v 0) v1 -- 0x7fb17c06ca50 con 0x7fb17c151e90 2023-12-16T03:24:51.448 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.445+0000 7fb1797fa640 1 -- 172.21.15.134:0/947269744 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c758861-c64f-484f-80c0-31e01bc6e9e8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb1740ce030 con 0x7fb17c151e90 2023-12-16T03:24:51.448 INFO:teuthology.orchestra.run.smithi134.stdout:0 2023-12-16T03:24:51.449 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.445+0000 7fb182ff8640 1 -- 172.21.15.134:0/947269744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb17c151e90 msgr2=0x7fb17c0bc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.449 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.445+0000 7fb182ff8640 1 --2- 172.21.15.134:0/947269744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb17c151e90 0x7fb17c0bc910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb1740194c0 tx=0x7fb174019650 comp rx=0 tx=0).stop 2023-12-16T03:24:51.449 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.445+0000 7fb182ff8640 1 -- 172.21.15.134:0/947269744 shutdown_connections 2023-12-16T03:24:51.449 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.445+0000 7fb182ff8640 1 --2- 172.21.15.134:0/947269744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb17c151e90 0x7fb17c0bc910 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.449 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.445+0000 7fb182ff8640 1 --2- 172.21.15.134:0/947269744 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb17c0c7ea0 0x7fb17c141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.449 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.445+0000 7fb182ff8640 1 --2- 172.21.15.134:0/947269744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb17c06b9e0 0x7fb17c0ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.449 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.445+0000 7fb182ff8640 1 -- 172.21.15.134:0/947269744 >> 172.21.15.134:0/947269744 conn(0x7fb17c0ca170 msgr2=0x7fb17c1441c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:51.449 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.445+0000 7fb182ff8640 1 -- 172.21.15.134:0/947269744 shutdown_connections 2023-12-16T03:24:51.449 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.445+0000 7fb182ff8640 1 -- 172.21.15.134:0/947269744 wait complete. 2023-12-16T03:24:51.468 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 2c08dd20-c5b5-42fb-bc67-460a3767ff2e 1 2023-12-16T03:24:51.605 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.601+0000 7fdceaf80640 1 Processor -- start 2023-12-16T03:24:51.605 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.601+0000 7fdceaf80640 1 -- start start 2023-12-16T03:24:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.601+0000 7fdceaf80640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce40c7ea0 0x7fdce406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.601+0000 7fdceaf80640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdce406b9e0 0x7fdce415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.601+0000 7fdceaf80640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce406c860 con 0x7fdce4151e90 2023-12-16T03:24:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.601+0000 7fdceaf80640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce40c8750 con 0x7fdce406b9e0 2023-12-16T03:24:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.601+0000 7fdceaf80640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce41552d0 con 0x7fdce40c7ea0 2023-12-16T03:24:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.601+0000 7fdce8d1c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fdce4151e90 0x7fdce40c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38828/0 (socket says 172.21.15.134:38828) 2023-12-16T03:24:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.601+0000 7fdce8d1c640 1 -- 172.21.15.134:0/510815010 learned_addr learned my addr 172.21.15.134:0/510815010 (peer_addr_for_me v1:172.21.15.134:0/0) 2023-12-16T03:24:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.601+0000 7fdce951d640 1 --2- 172.21.15.134:0/510815010 >> v2:172.21.15.134:3300/0 conn(0x7fdce406b9e0 0x7fdce415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.601+0000 7fdce3fff640 1 --2- 172.21.15.134:0/510815010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce40c7ea0 0x7fdce406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.608 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdce37fe640 1 -- 172.21.15.134:0/510815010 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437754327 0 0) 0x7fdce406c860 con 0x7fdce4151e90 2023-12-16T03:24:51.608 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdce37fe640 1 -- 172.21.15.134:0/510815010 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd4003530 con 0x7fdce4151e90 2023-12-16T03:24:51.608 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdce951d640 1 -- 172.21.15.134:0/510815010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce40c7ea0 msgr2=0x7fdce406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:24:51.608 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdce951d640 1 --2- 172.21.15.134:0/510815010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce40c7ea0 0x7fdce406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.608 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdce951d640 1 -- 172.21.15.134:0/510815010 >> v1:172.21.15.134:6789/0 conn(0x7fdce4151e90 legacy=0x7fdce40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.608 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdce951d640 1 -- 172.21.15.134:0/510815010 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce4154930 con 0x7fdce406b9e0 2023-12-16T03:24:51.610 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdce951d640 1 --2- 172.21.15.134:0/510815010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce406b9e0 0x7fdce415f0a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009d90 tx=0x7fdcdc01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=840f934da4e38fe8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:51.610 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdce37fe640 1 -- 172.21.15.134:0/510815010 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0a6700 con 0x7fdce406b9e0 2023-12-16T03:24:51.610 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdce37fe640 1 -- 172.21.15.134:0/510815010 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc0a6860 con 0x7fdce406b9e0 2023-12-16T03:24:51.610 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdce37fe640 1 -- 172.21.15.134:0/510815010 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0a6bf0 con 0x7fdce406b9e0 2023-12-16T03:24:51.611 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdceaf80640 1 -- 172.21.15.134:0/510815010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce406b9e0 msgr2=0x7fdce415f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.612 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.605+0000 7fdceaf80640 1 --2- 172.21.15.134:0/510815010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce406b9e0 0x7fdce415f0a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009d90 tx=0x7fdcdc01c830 comp rx=0 tx=0).stop 2023-12-16T03:24:51.612 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 -- 172.21.15.134:0/510815010 shutdown_connections 2023-12-16T03:24:51.612 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 --2- 172.21.15.134:0/510815010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce406b9e0 0x7fdce415f0a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.612 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 --2- 172.21.15.134:0/510815010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce40c7ea0 0x7fdce406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.612 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 -- 172.21.15.134:0/510815010 >> 172.21.15.134:0/510815010 conn(0x7fdce40ca170 msgr2=0x7fdce40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:51.612 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 -- 172.21.15.134:0/510815010 shutdown_connections 2023-12-16T03:24:51.612 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 -- 172.21.15.134:0/510815010 wait complete. 2023-12-16T03:24:51.613 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 Processor -- start 2023-12-16T03:24:51.613 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 -- start start 2023-12-16T03:24:51.614 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce406b9e0 0x7fdce41f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce40c7ea0 0x7fdce41ee360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce4151e90 0x7fdce414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40aba90 con 0x7fdce40c7ea0 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40ab460 con 0x7fdce406b9e0 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdceaf80640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce41f1010 con 0x7fdce4151e90 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce8d1c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce406b9e0 0x7fdce41f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce951d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce4151e90 0x7fdce414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce951d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce4151e90 0x7fdce414b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:35666/0 (socket says 172.21.15.134:35666) 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce8d1c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce406b9e0 0x7fdce41f06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36704/0 (socket says 172.21.15.134:36704) 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce951d640 1 -- 172.21.15.134:0/2985517533 learned_addr learned my addr 172.21.15.134:0/2985517533 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce3fff640 1 --2- 172.21.15.134:0/2985517533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce40c7ea0 0x7fdce41ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce8d1c640 1 -- 172.21.15.134:0/2985517533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce4151e90 msgr2=0x7fdce414b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.615 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce8d1c640 1 --2- 172.21.15.134:0/2985517533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce4151e90 0x7fdce414b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.616 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce8d1c640 1 -- 172.21.15.134:0/2985517533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce40c7ea0 msgr2=0x7fdce41ee360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.616 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce8d1c640 1 --2- 172.21.15.134:0/2985517533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce40c7ea0 0x7fdce41ee360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.616 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce8d1c640 1 -- 172.21.15.134:0/2985517533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc009a70 con 0x7fdce406b9e0 2023-12-16T03:24:51.616 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce3fff640 1 --2- 172.21.15.134:0/2985517533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce40c7ea0 0x7fdce41ee360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:24:51.616 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.609+0000 7fdce8d1c640 1 --2- 172.21.15.134:0/2985517533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce406b9e0 0x7fdce41f06c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c400 tx=0x7fdcd800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:51.617 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.613+0000 7fdce17fa640 1 -- 172.21.15.134:0/2985517533 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8005cf0 con 0x7fdce406b9e0 2023-12-16T03:24:51.617 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.613+0000 7fdce17fa640 1 -- 172.21.15.134:0/2985517533 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8005e50 con 0x7fdce406b9e0 2023-12-16T03:24:51.617 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.613+0000 7fdceaf80640 1 -- 172.21.15.134:0/2985517533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce40ab720 con 0x7fdce406b9e0 2023-12-16T03:24:51.617 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.613+0000 7fdce17fa640 1 -- 172.21.15.134:0/2985517533 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd80072d0 con 0x7fdce406b9e0 2023-12-16T03:24:51.617 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.613+0000 7fdceaf80640 1 -- 172.21.15.134:0/2985517533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce40af8c0 con 0x7fdce406b9e0 2023-12-16T03:24:51.617 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.613+0000 7fdce17fa640 1 -- 172.21.15.134:0/2985517533 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdcd801c440 con 0x7fdce406b9e0 2023-12-16T03:24:51.617 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.613+0000 7fdce17fa640 1 -- 172.21.15.134:0/2985517533 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fdcd8012840 con 0x7fdce406b9e0 2023-12-16T03:24:51.617 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.613+0000 7fdceaf80640 1 -- 172.21.15.134:0/2985517533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce4158c80 con 0x7fdce406b9e0 2023-12-16T03:24:51.618 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.613+0000 7fdce17fa640 1 -- 172.21.15.134:0/2985517533 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fdcd8021060 con 0x7fdce406b9e0 2023-12-16T03:24:51.652 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:51.650+0000 7fa052ab9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-16T03:24:51.707 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:51.705+0000 7fc60aa13180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-16T03:24:51.745 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.741+0000 7fdceaf80640 1 -- 172.21.15.134:0/2985517533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2c08dd20-c5b5-42fb-bc67-460a3767ff2e", "id": 1} v 0) v1 -- 0x7fdce4068400 con 0x7fdce406b9e0 2023-12-16T03:24:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.745+0000 7fdce17fa640 1 -- 172.21.15.134:0/2985517533 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c08dd20-c5b5-42fb-bc67-460a3767ff2e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdcd8017070 con 0x7fdce406b9e0 2023-12-16T03:24:51.751 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-12-16T03:24:51.753 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.749+0000 7fdceaf80640 1 -- 172.21.15.134:0/2985517533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce406b9e0 msgr2=0x7fdce41f06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.753 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.749+0000 7fdceaf80640 1 --2- 172.21.15.134:0/2985517533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce406b9e0 0x7fdce41f06c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c400 tx=0x7fdcd800c8c0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.753 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.749+0000 7fdceaf80640 1 -- 172.21.15.134:0/2985517533 shutdown_connections 2023-12-16T03:24:51.753 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.749+0000 7fdceaf80640 1 --2- 172.21.15.134:0/2985517533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce4151e90 0x7fdce414b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.753 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.749+0000 7fdceaf80640 1 --2- 172.21.15.134:0/2985517533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce40c7ea0 0x7fdce41ee360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.753 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.749+0000 7fdceaf80640 1 --2- 172.21.15.134:0/2985517533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce406b9e0 0x7fdce41f06c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.753 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.749+0000 7fdceaf80640 1 -- 172.21.15.134:0/2985517533 >> 172.21.15.134:0/2985517533 conn(0x7fdce40ca170 msgr2=0x7fdce40c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:51.753 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.749+0000 7fdceaf80640 1 -- 172.21.15.134:0/2985517533 shutdown_connections 2023-12-16T03:24:51.753 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.749+0000 7fdceaf80640 1 -- 172.21.15.134:0/2985517533 wait complete. 2023-12-16T03:24:51.778 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 5b3ff722-6a02-495f-a5a9-9804cfb03c73 2 2023-12-16T03:24:51.915 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd42a817640 1 Processor -- start 2023-12-16T03:24:51.915 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd42a817640 1 -- start start 2023-12-16T03:24:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd42a817640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd424151e90 0x7fd4240c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd42a817640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd4240c7ea0 0x7fd42406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd42a817640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd4240c4e60 0x7fd42406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd42a817640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4240c8750 con 0x7fd4240c4e60 2023-12-16T03:24:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd42a817640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4241552d0 con 0x7fd4240c7ea0 2023-12-16T03:24:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd42a817640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240c5c60 con 0x7fd424151e90 2023-12-16T03:24:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd423fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd424151e90 0x7fd4240c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd4237fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd4240c7ea0 0x7fd42406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd423fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd424151e90 0x7fd4240c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:35682/0 (socket says 172.21.15.134:35682) 2023-12-16T03:24:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd423fff640 1 -- 172.21.15.134:0/3572903986 learned_addr learned my addr 172.21.15.134:0/3572903986 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-16T03:24:51.917 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd428db4640 1 --2- 172.21.15.134:0/3572903986 >> v2:172.21.15.28:3300/0 conn(0x7fd4240c4e60 0x7fd42406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.918 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd423fff640 1 -- 172.21.15.134:0/3572903986 >> v2:172.21.15.134:3300/0 conn(0x7fd4240c7ea0 msgr2=0x7fd42406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:24:51.918 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd423fff640 1 --2- 172.21.15.134:0/3572903986 >> v2:172.21.15.134:3300/0 conn(0x7fd4240c7ea0 0x7fd42406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.918 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd423fff640 1 -- 172.21.15.134:0/3572903986 >> v2:172.21.15.28:3300/0 conn(0x7fd4240c4e60 msgr2=0x7fd42406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:24:51.918 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd423fff640 1 --2- 172.21.15.134:0/3572903986 >> v2:172.21.15.28:3300/0 conn(0x7fd4240c4e60 0x7fd42406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.919 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd423fff640 1 -- 172.21.15.134:0/3572903986 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42406c860 con 0x7fd424151e90 2023-12-16T03:24:51.919 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd4237fe640 1 --2- 172.21.15.134:0/3572903986 >> v2:172.21.15.134:3300/0 conn(0x7fd4240c7ea0 0x7fd42406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:24:51.919 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.913+0000 7fd428db4640 1 --2- 172.21.15.134:0/3572903986 >> v2:172.21.15.28:3300/0 conn(0x7fd4240c4e60 0x7fd42406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:24:51.920 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd423fff640 1 --2- 172.21.15.134:0/3572903986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd424151e90 0x7fd4240c4920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd42408b230 tx=0x7fd41401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=478a5e6a7c511a44 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:51.920 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd422ffd640 1 -- 172.21.15.134:0/3572903986 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140ab600 con 0x7fd424151e90 2023-12-16T03:24:51.920 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd422ffd640 1 -- 172.21.15.134:0/3572903986 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4140a7050 con 0x7fd424151e90 2023-12-16T03:24:51.920 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd422ffd640 1 -- 172.21.15.134:0/3572903986 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140ab980 con 0x7fd424151e90 2023-12-16T03:24:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd42a817640 1 -- 172.21.15.134:0/3572903986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd424151e90 msgr2=0x7fd4240c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.921 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd42a817640 1 --2- 172.21.15.134:0/3572903986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd424151e90 0x7fd4240c4920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd42408b230 tx=0x7fd41401c3e0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd42a817640 1 -- 172.21.15.134:0/3572903986 shutdown_connections 2023-12-16T03:24:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd42a817640 1 --2- 172.21.15.134:0/3572903986 >> v2:172.21.15.28:3300/0 conn(0x7fd4240c4e60 0x7fd42406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd42a817640 1 --2- 172.21.15.134:0/3572903986 >> v2:172.21.15.134:3300/0 conn(0x7fd4240c7ea0 0x7fd42406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd42a817640 1 --2- 172.21.15.134:0/3572903986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd424151e90 0x7fd4240c4920 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd42a817640 1 -- 172.21.15.134:0/3572903986 >> 172.21.15.134:0/3572903986 conn(0x7fd4240ca170 msgr2=0x7fd4240ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd42a817640 1 -- 172.21.15.134:0/3572903986 shutdown_connections 2023-12-16T03:24:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd42a817640 1 -- 172.21.15.134:0/3572903986 wait complete. 2023-12-16T03:24:51.922 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.917+0000 7fd42a817640 1 Processor -- start 2023-12-16T03:24:51.923 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd42a817640 1 -- start start 2023-12-16T03:24:51.925 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd42a817640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4240c4e60 0x7fd4240acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.925 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd42a817640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4240c7ea0 0x7fd4240c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd42a817640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd424151e90 0x7fd4240c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd42a817640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42414fbf0 con 0x7fd4240c7ea0 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd42a817640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240c2270 con 0x7fd424151e90 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd42a817640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42414f910 con 0x7fd4240c4e60 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd428db4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd424151e90 0x7fd4240c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd423fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4240c4e60 0x7fd4240acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd428db4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd424151e90 0x7fd4240c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36716/0 (socket says 172.21.15.134:36716) 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd428db4640 1 -- 172.21.15.134:0/3072570366 learned_addr learned my addr 172.21.15.134:0/3072570366 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd4237fe640 1 --2- 172.21.15.134:0/3072570366 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4240c7ea0 0x7fd4240c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd428db4640 1 -- 172.21.15.134:0/3072570366 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4240c4e60 msgr2=0x7fd4240acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd428db4640 1 --2- 172.21.15.134:0/3072570366 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4240c4e60 0x7fd4240acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd428db4640 1 -- 172.21.15.134:0/3072570366 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4240c7ea0 msgr2=0x7fd4240c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd428db4640 1 --2- 172.21.15.134:0/3072570366 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4240c7ea0 0x7fd4240c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:51.926 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd428db4640 1 -- 172.21.15.134:0/3072570366 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd418009420 con 0x7fd424151e90 2023-12-16T03:24:51.927 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd423fff640 1 --2- 172.21.15.134:0/3072570366 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4240c4e60 0x7fd4240acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:24:51.927 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd4237fe640 1 --2- 172.21.15.134:0/3072570366 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4240c7ea0 0x7fd4240c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:24:51.927 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd428db4640 1 --2- 172.21.15.134:0/3072570366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd424151e90 0x7fd4240c39d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd41c007db0 tx=0x7fd41c00d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:51.927 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd420ff9640 1 -- 172.21.15.134:0/3072570366 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c0039a0 con 0x7fd424151e90 2023-12-16T03:24:51.927 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd420ff9640 1 -- 172.21.15.134:0/3072570366 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c00f040 con 0x7fd424151e90 2023-12-16T03:24:51.927 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd42a817640 1 -- 172.21.15.134:0/3072570366 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4140094d0 con 0x7fd424151e90 2023-12-16T03:24:51.927 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd420ff9640 1 -- 172.21.15.134:0/3072570366 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c003d60 con 0x7fd424151e90 2023-12-16T03:24:51.927 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd42a817640 1 -- 172.21.15.134:0/3072570366 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4240c1f00 con 0x7fd424151e90 2023-12-16T03:24:51.927 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd420ff9640 1 -- 172.21.15.134:0/3072570366 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd41c004330 con 0x7fd424151e90 2023-12-16T03:24:51.927 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd420ff9640 1 -- 172.21.15.134:0/3072570366 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd41c01f440 con 0x7fd424151e90 2023-12-16T03:24:51.928 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.921+0000 7fd42a817640 1 -- 172.21.15.134:0/3072570366 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4240c1a80 con 0x7fd424151e90 2023-12-16T03:24:51.928 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.925+0000 7fd420ff9640 1 -- 172.21.15.134:0/3072570366 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fd4240c1a80 con 0x7fd424151e90 2023-12-16T03:24:51.940 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:51.937+0000 7fc60aa13180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-16T03:24:51.995 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.989+0000 7fd42a817640 1 -- 172.21.15.134:0/3072570366 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5b3ff722-6a02-495f-a5a9-9804cfb03c73", "id": 2} v 0) v1 -- 0x7fd4240c23e0 con 0x7fd424151e90 2023-12-16T03:24:52.000 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.997+0000 7fd420ff9640 1 -- 172.21.15.134:0/3072570366 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b3ff722-6a02-495f-a5a9-9804cfb03c73", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd41c01a070 con 0x7fd424151e90 2023-12-16T03:24:52.000 INFO:teuthology.orchestra.run.smithi134.stdout:2 2023-12-16T03:24:52.000 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.997+0000 7fd42a817640 1 -- 172.21.15.134:0/3072570366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd424151e90 msgr2=0x7fd4240c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.001 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.997+0000 7fd42a817640 1 --2- 172.21.15.134:0/3072570366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd424151e90 0x7fd4240c39d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd41c007db0 tx=0x7fd41c00d4a0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.001 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.997+0000 7fd42a817640 1 -- 172.21.15.134:0/3072570366 shutdown_connections 2023-12-16T03:24:52.001 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.997+0000 7fd42a817640 1 --2- 172.21.15.134:0/3072570366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd424151e90 0x7fd4240c39d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.001 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.997+0000 7fd42a817640 1 --2- 172.21.15.134:0/3072570366 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4240c7ea0 0x7fd4240c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.001 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.997+0000 7fd42a817640 1 --2- 172.21.15.134:0/3072570366 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd4240c4e60 0x7fd4240acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.001 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.997+0000 7fd42a817640 1 -- 172.21.15.134:0/3072570366 >> 172.21.15.134:0/3072570366 conn(0x7fd4240ca170 msgr2=0x7fd42406b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:52.001 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.997+0000 7fd42a817640 1 -- 172.21.15.134:0/3072570366 shutdown_connections 2023-12-16T03:24:52.002 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:51.997+0000 7fd42a817640 1 -- 172.21.15.134:0/3072570366 wait complete. 2023-12-16T03:24:52.020 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 16f8408f-46b5-4722-b43b-97e37f042433 3 2023-12-16T03:24:52.157 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.153+0000 7fefa26c9640 1 Processor -- start 2023-12-16T03:24:52.157 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.153+0000 7fefa26c9640 1 -- start start 2023-12-16T03:24:52.158 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.153+0000 7fefa26c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 0x7fef9c1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.158 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.153+0000 7fefa26c9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c06c860 con 0x7fef9c151e90 2023-12-16T03:24:52.158 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.153+0000 7fefa26c9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c06c040 con 0x7fef9c0c7ea0 2023-12-16T03:24:52.158 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.153+0000 7fefa26c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0c8750 con 0x7fef9c06bbb0 2023-12-16T03:24:52.159 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.153+0000 7fef9b7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fef9c0c7ea0 0x7fef9c06b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38842/0 (socket says 172.21.15.134:38842) 2023-12-16T03:24:52.159 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.153+0000 7fef9b7fe640 1 -- 172.21.15.134:0/2672646678 learned_addr learned my addr 172.21.15.134:0/2672646678 (peer_addr_for_me v1:172.21.15.134:0/0) 2023-12-16T03:24:52.159 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.153+0000 7fefa0c66640 1 --2- 172.21.15.134:0/2672646678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 0x7fef9c1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.159 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.153+0000 7fef9affd640 1 -- 172.21.15.134:0/2672646678 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168509978 0 0) 0x7fef9c06c040 con 0x7fef9c0c7ea0 2023-12-16T03:24:52.159 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.157+0000 7fef9affd640 1 -- 172.21.15.134:0/2672646678 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef84003530 con 0x7fef9c0c7ea0 2023-12-16T03:24:52.160 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.157+0000 7fefa0c66640 1 -- 172.21.15.134:0/2672646678 >> v1:172.21.15.134:6789/0 conn(0x7fef9c0c7ea0 legacy=0x7fef9c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.160 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.157+0000 7fefa0c66640 1 -- 172.21.15.134:0/2672646678 >> v1:172.21.15.28:6789/0 conn(0x7fef9c151e90 legacy=0x7fef9c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.160 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.157+0000 7fefa0c66640 1 -- 172.21.15.134:0/2672646678 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c154930 con 0x7fef9c06bbb0 2023-12-16T03:24:52.162 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.157+0000 7fefa0c66640 1 --2- 172.21.15.134:0/2672646678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 0x7fef9c1600b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fef94009dc0 tx=0x7fef9401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fc932ab05177ede server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:52.162 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.157+0000 7fef9affd640 1 -- 172.21.15.134:0/2672646678 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940a5710 con 0x7fef9c06bbb0 2023-12-16T03:24:52.162 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.157+0000 7fef9affd640 1 -- 172.21.15.134:0/2672646678 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef940a5870 con 0x7fef9c06bbb0 2023-12-16T03:24:52.163 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.157+0000 7fef9affd640 1 -- 172.21.15.134:0/2672646678 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940a5c00 con 0x7fef9c06bbb0 2023-12-16T03:24:52.163 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.157+0000 7fefa26c9640 1 -- 172.21.15.134:0/2672646678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 msgr2=0x7fef9c1600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.163 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.157+0000 7fefa26c9640 1 --2- 172.21.15.134:0/2672646678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 0x7fef9c1600b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fef94009dc0 tx=0x7fef9401c850 comp rx=0 tx=0).stop 2023-12-16T03:24:52.164 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 -- 172.21.15.134:0/2672646678 shutdown_connections 2023-12-16T03:24:52.164 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 --2- 172.21.15.134:0/2672646678 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 0x7fef9c1600b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.164 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 -- 172.21.15.134:0/2672646678 >> 172.21.15.134:0/2672646678 conn(0x7fef9c0ca170 msgr2=0x7fef9c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:52.164 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 -- 172.21.15.134:0/2672646678 shutdown_connections 2023-12-16T03:24:52.164 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 -- 172.21.15.134:0/2672646678 wait complete. 2023-12-16T03:24:52.164 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 Processor -- start 2023-12-16T03:24:52.165 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 -- start start 2023-12-16T03:24:52.167 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 0x7fef9c144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.167 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef9c0c7ea0 0x7fef9c153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.167 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef9c151e90 0x7fef9c1ef970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.167 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1552d0 con 0x7fef9c0c7ea0 2023-12-16T03:24:52.167 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c140290 con 0x7fef9c151e90 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa26c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1ee4e0 con 0x7fef9c06bbb0 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fef9bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 0x7fef9c144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fefa0c66640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef9c151e90 0x7fef9c1ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fef9bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 0x7fef9c144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:35702/0 (socket says 172.21.15.134:35702) 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fef9bfff640 1 -- 172.21.15.134:0/2478174807 learned_addr learned my addr 172.21.15.134:0/2478174807 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fef9b7fe640 1 --2- 172.21.15.134:0/2478174807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef9c0c7ea0 0x7fef9c153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fef9bfff640 1 -- 172.21.15.134:0/2478174807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef9c151e90 msgr2=0x7fef9c1ef970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fef9bfff640 1 --2- 172.21.15.134:0/2478174807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef9c151e90 0x7fef9c1ef970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fef9bfff640 1 -- 172.21.15.134:0/2478174807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef9c0c7ea0 msgr2=0x7fef9c153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fef9bfff640 1 --2- 172.21.15.134:0/2478174807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef9c0c7ea0 0x7fef9c153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fef9bfff640 1 -- 172.21.15.134:0/2478174807 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94009a70 con 0x7fef9c06bbb0 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fef9bfff640 1 --2- 172.21.15.134:0/2478174807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 0x7fef9c144ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00c500 tx=0x7fef8c00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.161+0000 7fef98ff9640 1 -- 172.21.15.134:0/2478174807 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c005220 con 0x7fef9c06bbb0 2023-12-16T03:24:52.168 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.165+0000 7fef98ff9640 1 -- 172.21.15.134:0/2478174807 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c005380 con 0x7fef9c06bbb0 2023-12-16T03:24:52.169 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.165+0000 7fefa26c9640 1 -- 172.21.15.134:0/2478174807 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c145410 con 0x7fef9c06bbb0 2023-12-16T03:24:52.169 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.165+0000 7fef98ff9640 1 -- 172.21.15.134:0/2478174807 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c007270 con 0x7fef9c06bbb0 2023-12-16T03:24:52.169 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.165+0000 7fefa26c9640 1 -- 172.21.15.134:0/2478174807 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c146aa0 con 0x7fef9c06bbb0 2023-12-16T03:24:52.169 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.165+0000 7fef98ff9640 1 -- 172.21.15.134:0/2478174807 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fef8c0067e0 con 0x7fef9c06bbb0 2023-12-16T03:24:52.169 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.165+0000 7fef98ff9640 1 -- 172.21.15.134:0/2478174807 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fef8c0129a0 con 0x7fef9c06bbb0 2023-12-16T03:24:52.169 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.165+0000 7fefa26c9640 1 -- 172.21.15.134:0/2478174807 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c1ee6e0 con 0x7fef9c06bbb0 2023-12-16T03:24:52.170 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.165+0000 7fef98ff9640 1 -- 172.21.15.134:0/2478174807 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fef8c016020 con 0x7fef9c06bbb0 2023-12-16T03:24:52.236 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.233+0000 7fefa26c9640 1 -- 172.21.15.134:0/2478174807 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "16f8408f-46b5-4722-b43b-97e37f042433", "id": 3} v 0) v1 -- 0x7fef9c068400 con 0x7fef9c06bbb0 2023-12-16T03:24:52.241 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.237+0000 7fef98ff9640 1 -- 172.21.15.134:0/2478174807 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16f8408f-46b5-4722-b43b-97e37f042433", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fef8c02a0b0 con 0x7fef9c06bbb0 2023-12-16T03:24:52.241 INFO:teuthology.orchestra.run.smithi134.stdout:3 2023-12-16T03:24:52.242 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.237+0000 7fefa26c9640 1 -- 172.21.15.134:0/2478174807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 msgr2=0x7fef9c144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.242 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.237+0000 7fefa26c9640 1 --2- 172.21.15.134:0/2478174807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 0x7fef9c144ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00c500 tx=0x7fef8c00c9c0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.242 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.237+0000 7fefa26c9640 1 -- 172.21.15.134:0/2478174807 shutdown_connections 2023-12-16T03:24:52.242 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.237+0000 7fefa26c9640 1 --2- 172.21.15.134:0/2478174807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef9c151e90 0x7fef9c1ef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.242 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.237+0000 7fefa26c9640 1 --2- 172.21.15.134:0/2478174807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef9c0c7ea0 0x7fef9c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.243 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.237+0000 7fefa26c9640 1 --2- 172.21.15.134:0/2478174807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c06bbb0 0x7fef9c144ed0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.243 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.237+0000 7fefa26c9640 1 -- 172.21.15.134:0/2478174807 >> 172.21.15.134:0/2478174807 conn(0x7fef9c0ca170 msgr2=0x7fef9c1431b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:52.243 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.237+0000 7fefa26c9640 1 -- 172.21.15.134:0/2478174807 shutdown_connections 2023-12-16T03:24:52.243 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.237+0000 7fefa26c9640 1 -- 172.21.15.134:0/2478174807 wait complete. 2023-12-16T03:24:52.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new d354bb87-427d-4acb-b08f-15f068397edd 4 2023-12-16T03:24:52.318 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:52.314+0000 7fa052ab9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-16T03:24:52.383 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:52.382+0000 7fa052ab9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-16T03:24:52.397 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.393+0000 7f344946b640 1 Processor -- start 2023-12-16T03:24:52.398 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.393+0000 7f344946b640 1 -- start start 2023-12-16T03:24:52.399 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.393+0000 7f344946b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3444151e90 0x7f34440c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.393+0000 7f344946b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 0x7f344406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.393+0000 7f344946b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344406c860 con 0x7f34440c7ea0 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.393+0000 7f344946b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34440c8750 con 0x7f3444151e90 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.393+0000 7f344946b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34441552d0 con 0x7f34440c4e60 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.397+0000 7f3442ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3444151e90 0x7f34440c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.397+0000 7f34437fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 0x7f344406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.397+0000 7f3442ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3444151e90 0x7f34440c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.134:35064/0 (socket says 172.21.15.134:35064) 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.397+0000 7f3442ffd640 1 -- 172.21.15.134:0/280754121 learned_addr learned my addr 172.21.15.134:0/280754121 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.397+0000 7f343bfff640 1 --1- 172.21.15.134:0/280754121 >> v1:172.21.15.28:6789/0 conn(0x7f34440c7ea0 0x7f344406b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.134:55330/0 (socket says 172.21.15.134:55330) 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.397+0000 7f34437fe640 1 -- 172.21.15.134:0/280754121 >> v2:172.21.15.28:3300/0 conn(0x7f3444151e90 msgr2=0x7f34440c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.397+0000 7f34437fe640 1 --2- 172.21.15.134:0/280754121 >> v2:172.21.15.28:3300/0 conn(0x7f3444151e90 0x7f34440c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.397+0000 7f34437fe640 1 -- 172.21.15.134:0/280754121 >> v1:172.21.15.28:6789/0 conn(0x7f34440c7ea0 legacy=0x7f344406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.400 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.397+0000 7f34437fe640 1 -- 172.21.15.134:0/280754121 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3444154930 con 0x7f34440c4e60 2023-12-16T03:24:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f34437fe640 1 --2- 172.21.15.134:0/280754121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 0x7f344406bbb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f343c009d90 tx=0x7f343c01c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e75710eaecd6e45d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f34427fc640 1 -- 172.21.15.134:0/280754121 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0a6700 con 0x7f34440c4e60 2023-12-16T03:24:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f34427fc640 1 -- 172.21.15.134:0/280754121 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c0a6860 con 0x7f34440c4e60 2023-12-16T03:24:52.405 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f34427fc640 1 -- 172.21.15.134:0/280754121 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0a6bf0 con 0x7f34440c4e60 2023-12-16T03:24:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f344946b640 1 -- 172.21.15.134:0/280754121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 msgr2=0x7f344406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f344946b640 1 --2- 172.21.15.134:0/280754121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 0x7f344406bbb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f343c009d90 tx=0x7f343c01c830 comp rx=0 tx=0).stop 2023-12-16T03:24:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f344946b640 1 -- 172.21.15.134:0/280754121 shutdown_connections 2023-12-16T03:24:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f344946b640 1 --2- 172.21.15.134:0/280754121 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 0x7f344406bbb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f344946b640 1 --2- 172.21.15.134:0/280754121 >> v2:172.21.15.28:3300/0 conn(0x7f3444151e90 0x7f34440c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f344946b640 1 -- 172.21.15.134:0/280754121 >> 172.21.15.134:0/280754121 conn(0x7f34440ca170 msgr2=0x7f34440ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f344946b640 1 -- 172.21.15.134:0/280754121 shutdown_connections 2023-12-16T03:24:52.406 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.401+0000 7f344946b640 1 -- 172.21.15.134:0/280754121 wait complete. 2023-12-16T03:24:52.407 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f344946b640 1 Processor -- start 2023-12-16T03:24:52.407 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f344946b640 1 -- start start 2023-12-16T03:24:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f344946b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 0x7f34440aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.409 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f344946b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34440c7ea0 0x7f34440af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f344946b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3444151e90 0x7f34441ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f344946b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344414f190 con 0x7f3444151e90 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f344946b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34440c09b0 con 0x7f34440c7ea0 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f344946b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344414eeb0 con 0x7f34440c4e60 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f3442ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 0x7f34440aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f3442ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 0x7f34440aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:35722/0 (socket says 172.21.15.134:35722) 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f3442ffd640 1 -- 172.21.15.134:0/2709051463 learned_addr learned my addr 172.21.15.134:0/2709051463 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f343bfff640 1 --2- 172.21.15.134:0/2709051463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34440c7ea0 0x7f34440af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f34437fe640 1 --2- 172.21.15.134:0/2709051463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3444151e90 0x7f34441ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f3442ffd640 1 -- 172.21.15.134:0/2709051463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34440c7ea0 msgr2=0x7f34440af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f3442ffd640 1 --2- 172.21.15.134:0/2709051463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34440c7ea0 0x7f34440af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f3442ffd640 1 -- 172.21.15.134:0/2709051463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3444151e90 msgr2=0x7f34441ee1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f3442ffd640 1 --2- 172.21.15.134:0/2709051463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3444151e90 0x7f34441ee1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.410 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f3442ffd640 1 -- 172.21.15.134:0/2709051463 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c009a70 con 0x7f34440c4e60 2023-12-16T03:24:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f34437fe640 1 --2- 172.21.15.134:0/2709051463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3444151e90 0x7f34441ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:24:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f3442ffd640 1 --2- 172.21.15.134:0/2709051463 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 0x7f34440aeec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f343400e8c0 tx=0x7f343400ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f343b7fe640 1 -- 172.21.15.134:0/2709051463 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434009620 con 0x7f34440c4e60 2023-12-16T03:24:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f343b7fe640 1 -- 172.21.15.134:0/2709051463 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343400c940 con 0x7f34440c4e60 2023-12-16T03:24:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f344946b640 1 -- 172.21.15.134:0/2709051463 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34440be640 con 0x7f34440c4e60 2023-12-16T03:24:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f343b7fe640 1 -- 172.21.15.134:0/2709051463 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343400ccf0 con 0x7f34440c4e60 2023-12-16T03:24:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f344946b640 1 -- 172.21.15.134:0/2709051463 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34440bec00 con 0x7f34440c4e60 2023-12-16T03:24:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f343b7fe640 1 -- 172.21.15.134:0/2709051463 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3434005ca0 con 0x7f34440c4e60 2023-12-16T03:24:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f343b7fe640 1 -- 172.21.15.134:0/2709051463 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f3434013470 con 0x7f34440c4e60 2023-12-16T03:24:52.411 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.405+0000 7f344946b640 1 -- 172.21.15.134:0/2709051463 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3444068400 con 0x7f34440c4e60 2023-12-16T03:24:52.413 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.409+0000 7f343b7fe640 1 -- 172.21.15.134:0/2709051463 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f3434021060 con 0x7f34440c4e60 2023-12-16T03:24:52.447 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:52.446+0000 7fa052ab9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-16T03:24:52.479 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.477+0000 7f344946b640 1 -- 172.21.15.134:0/2709051463 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d354bb87-427d-4acb-b08f-15f068397edd", "id": 4} v 0) v1 -- 0x7f34440be430 con 0x7f34440c4e60 2023-12-16T03:24:52.483 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.481+0000 7f343b7fe640 1 -- 172.21.15.134:0/2709051463 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d354bb87-427d-4acb-b08f-15f068397edd", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3434029020 con 0x7f34440c4e60 2023-12-16T03:24:52.484 INFO:teuthology.orchestra.run.smithi134.stdout:4 2023-12-16T03:24:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.481+0000 7f344946b640 1 -- 172.21.15.134:0/2709051463 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 msgr2=0x7f34440aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.481+0000 7f344946b640 1 --2- 172.21.15.134:0/2709051463 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 0x7f34440aeec0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f343400e8c0 tx=0x7f343400ed80 comp rx=0 tx=0).stop 2023-12-16T03:24:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.481+0000 7f344946b640 1 -- 172.21.15.134:0/2709051463 shutdown_connections 2023-12-16T03:24:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.481+0000 7f344946b640 1 --2- 172.21.15.134:0/2709051463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3444151e90 0x7f34441ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.481+0000 7f344946b640 1 --2- 172.21.15.134:0/2709051463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34440c7ea0 0x7f34440af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.481+0000 7f344946b640 1 --2- 172.21.15.134:0/2709051463 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34440c4e60 0x7f34440aeec0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.481+0000 7f344946b640 1 -- 172.21.15.134:0/2709051463 >> 172.21.15.134:0/2709051463 conn(0x7f34440ca170 msgr2=0x7f34440a9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:52.486 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.481+0000 7f344946b640 1 -- 172.21.15.134:0/2709051463 shutdown_connections 2023-12-16T03:24:52.486 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.481+0000 7f344946b640 1 -- 172.21.15.134:0/2709051463 wait complete. 2023-12-16T03:24:52.504 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 707772ca-b702-40ed-891c-f03b89d7256e 5 2023-12-16T03:24:52.541 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:52.538+0000 7fa052ab9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-16T03:24:52.604 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:52.602+0000 7fa052ab9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-16T03:24:52.630 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:52.625+0000 7fc60aa13180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-16T03:24:52.644 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88c71f8640 1 Processor -- start 2023-12-16T03:24:52.644 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88c71f8640 1 -- start start 2023-12-16T03:24:52.645 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88c71f8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88c0151e90 0x7f88c00c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.645 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88c71f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c00c7ea0 0x7f88c006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.645 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88c71f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c006c860 con 0x7f88c00c4e60 2023-12-16T03:24:52.645 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88c71f8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c00c8750 con 0x7f88c0151e90 2023-12-16T03:24:52.645 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88c71f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01552d0 con 0x7f88c00c7ea0 2023-12-16T03:24:52.645 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88bffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c00c7ea0 0x7f88c006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.645 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88c5795640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f88c00c4e60 0x7f88c006b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38848/0 (socket says 172.21.15.134:38848) 2023-12-16T03:24:52.646 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88c4f94640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88c0151e90 0x7f88c00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.646 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88c5795640 1 -- 172.21.15.134:0/880155738 learned_addr learned my addr 172.21.15.134:0/880155738 (peer_addr_for_me v1:172.21.15.134:0/0) 2023-12-16T03:24:52.646 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88bffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c00c7ea0 0x7f88c006b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:35732/0 (socket says 172.21.15.134:35732) 2023-12-16T03:24:52.646 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88bffff640 1 -- 172.21.15.134:0/880155738 >> v2:172.21.15.134:3300/0 conn(0x7f88c0151e90 msgr2=0x7f88c00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:24:52.646 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88bffff640 1 --2- 172.21.15.134:0/880155738 >> v2:172.21.15.134:3300/0 conn(0x7f88c0151e90 0x7f88c00c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.646 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88bffff640 1 -- 172.21.15.134:0/880155738 >> v1:172.21.15.134:6789/0 conn(0x7f88c00c4e60 legacy=0x7f88c006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.646 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88bffff640 1 -- 172.21.15.134:0/880155738 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c0154930 con 0x7f88c00c7ea0 2023-12-16T03:24:52.646 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.641+0000 7f88c4f94640 1 --2- 172.21.15.134:0/880155738 >> v2:172.21.15.134:3300/0 conn(0x7f88c0151e90 0x7f88c00c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:24:52.650 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.645+0000 7f88bffff640 1 --2- 172.21.15.134:0/880155738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c00c7ea0 0x7f88c006b4a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0097c0 tx=0x7f88ac01c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89e06ab13179c322 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:52.650 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.645+0000 7f88bf7fe640 1 -- 172.21.15.134:0/880155738 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0ab600 con 0x7f88c00c7ea0 2023-12-16T03:24:52.650 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.645+0000 7f88bf7fe640 1 -- 172.21.15.134:0/880155738 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac0a7050 con 0x7f88c00c7ea0 2023-12-16T03:24:52.651 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.645+0000 7f88bf7fe640 1 -- 172.21.15.134:0/880155738 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0ab980 con 0x7f88c00c7ea0 2023-12-16T03:24:52.651 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 -- 172.21.15.134:0/880155738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c00c7ea0 msgr2=0x7f88c006b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.651 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 --2- 172.21.15.134:0/880155738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c00c7ea0 0x7f88c006b4a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0097c0 tx=0x7f88ac01c360 comp rx=0 tx=0).stop 2023-12-16T03:24:52.652 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 -- 172.21.15.134:0/880155738 shutdown_connections 2023-12-16T03:24:52.652 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 --2- 172.21.15.134:0/880155738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c00c7ea0 0x7f88c006b4a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.652 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 --2- 172.21.15.134:0/880155738 >> v2:172.21.15.134:3300/0 conn(0x7f88c0151e90 0x7f88c00c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.652 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 -- 172.21.15.134:0/880155738 >> 172.21.15.134:0/880155738 conn(0x7f88c00ca170 msgr2=0x7f88c00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:52.652 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 -- 172.21.15.134:0/880155738 shutdown_connections 2023-12-16T03:24:52.652 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 -- 172.21.15.134:0/880155738 wait complete. 2023-12-16T03:24:52.653 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 Processor -- start 2023-12-16T03:24:52.653 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 -- start start 2023-12-16T03:24:52.655 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c00c4e60 0x7f88c01535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.655 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c00c7ea0 0x7f88c014dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.655 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c0151e90 0x7f88c014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.655 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c014cb80 con 0x7f88c00c7ea0 2023-12-16T03:24:52.655 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01ed850 con 0x7f88c00c4e60 2023-12-16T03:24:52.655 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c71f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c014c1e0 con 0x7f88c0151e90 2023-12-16T03:24:52.655 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c4f94640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c00c4e60 0x7f88c01535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.655 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c4f94640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c00c4e60 0x7f88c01535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36762/0 (socket says 172.21.15.134:36762) 2023-12-16T03:24:52.655 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c4f94640 1 -- 172.21.15.134:0/3563142272 learned_addr learned my addr 172.21.15.134:0/3563142272 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-16T03:24:52.655 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c5795640 1 --2- 172.21.15.134:0/3563142272 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c0151e90 0x7f88c014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.655 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88bffff640 1 --2- 172.21.15.134:0/3563142272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c00c7ea0 0x7f88c014dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.656 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c4f94640 1 -- 172.21.15.134:0/3563142272 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c0151e90 msgr2=0x7f88c014e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.656 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c4f94640 1 --2- 172.21.15.134:0/3563142272 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c0151e90 0x7f88c014e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.656 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c4f94640 1 -- 172.21.15.134:0/3563142272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c00c7ea0 msgr2=0x7f88c014dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.656 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c4f94640 1 --2- 172.21.15.134:0/3563142272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c00c7ea0 0x7f88c014dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.656 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.649+0000 7f88c4f94640 1 -- 172.21.15.134:0/3563142272 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4009420 con 0x7f88c00c4e60 2023-12-16T03:24:52.656 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.653+0000 7f88c4f94640 1 --2- 172.21.15.134:0/3563142272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c00c4e60 0x7f88c01535a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f88b400ebe0 tx=0x7f88b400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:52.657 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.653+0000 7f88bd7fa640 1 -- 172.21.15.134:0/3563142272 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400eee0 con 0x7f88c00c4e60 2023-12-16T03:24:52.657 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.653+0000 7f88bd7fa640 1 -- 172.21.15.134:0/3563142272 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b400cc30 con 0x7f88c00c4e60 2023-12-16T03:24:52.657 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.653+0000 7f88bd7fa640 1 -- 172.21.15.134:0/3563142272 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4013470 con 0x7f88c00c4e60 2023-12-16T03:24:52.657 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.653+0000 7f88c71f8640 1 -- 172.21.15.134:0/3563142272 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac009420 con 0x7f88c00c4e60 2023-12-16T03:24:52.657 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.653+0000 7f88c71f8640 1 -- 172.21.15.134:0/3563142272 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c014c7a0 con 0x7f88c00c4e60 2023-12-16T03:24:52.657 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.653+0000 7f88bd7fa640 1 -- 172.21.15.134:0/3563142272 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f88b4005ca0 con 0x7f88c00c4e60 2023-12-16T03:24:52.657 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.653+0000 7f88bd7fa640 1 -- 172.21.15.134:0/3563142272 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f88b40135d0 con 0x7f88c00c4e60 2023-12-16T03:24:52.657 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.653+0000 7f88c71f8640 1 -- 172.21.15.134:0/3563142272 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c014cdf0 con 0x7f88c00c4e60 2023-12-16T03:24:52.658 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.653+0000 7f88bd7fa640 1 -- 172.21.15.134:0/3563142272 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f88b4021060 con 0x7f88c00c4e60 2023-12-16T03:24:52.697 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:52.693+0000 7fc60aa13180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-16T03:24:52.697 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:52.694+0000 7fa052ab9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-16T03:24:52.724 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.721+0000 7f88c71f8640 1 -- 172.21.15.134:0/3563142272 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "707772ca-b702-40ed-891c-f03b89d7256e", "id": 5} v 0) v1 -- 0x7f88c0068400 con 0x7f88c00c4e60 2023-12-16T03:24:52.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.725+0000 7f88bd7fa640 1 -- 172.21.15.134:0/3563142272 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "707772ca-b702-40ed-891c-f03b89d7256e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f88b4029020 con 0x7f88c00c4e60 2023-12-16T03:24:52.729 INFO:teuthology.orchestra.run.smithi134.stdout:5 2023-12-16T03:24:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.725+0000 7f88c71f8640 1 -- 172.21.15.134:0/3563142272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c00c4e60 msgr2=0x7f88c01535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.729 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.725+0000 7f88c71f8640 1 --2- 172.21.15.134:0/3563142272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c00c4e60 0x7f88c01535a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f88b400ebe0 tx=0x7f88b400c520 comp rx=0 tx=0).stop 2023-12-16T03:24:52.730 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.725+0000 7f88c71f8640 1 -- 172.21.15.134:0/3563142272 shutdown_connections 2023-12-16T03:24:52.730 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.725+0000 7f88c71f8640 1 --2- 172.21.15.134:0/3563142272 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c0151e90 0x7f88c014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.730 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.725+0000 7f88c71f8640 1 --2- 172.21.15.134:0/3563142272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c00c7ea0 0x7f88c014dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.730 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.725+0000 7f88c71f8640 1 --2- 172.21.15.134:0/3563142272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c00c4e60 0x7f88c01535a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.730 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.725+0000 7f88c71f8640 1 -- 172.21.15.134:0/3563142272 >> 172.21.15.134:0/3563142272 conn(0x7f88c00ca170 msgr2=0x7f88c00ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:52.730 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.725+0000 7f88c71f8640 1 -- 172.21.15.134:0/3563142272 shutdown_connections 2023-12-16T03:24:52.730 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.725+0000 7f88c71f8640 1 -- 172.21.15.134:0/3563142272 wait complete. 2023-12-16T03:24:52.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new c19b5836-4a60-4c30-8e28-6cf6cdbc88af 6 2023-12-16T03:24:52.762 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:52.757+0000 7fc60aa13180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-16T03:24:52.764 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:52.762+0000 7fa052ab9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-16T03:24:52.853 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:52.849+0000 7fc60aa13180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-16T03:24:52.886 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.881+0000 7f3b415aa640 1 Processor -- start 2023-12-16T03:24:52.887 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.881+0000 7f3b415aa640 1 -- start start 2023-12-16T03:24:52.887 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.885+0000 7f3b415aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 0x7f3b3c0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.888 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.885+0000 7f3b415aa640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c0c6bc0 con 0x7f3b3c0c31c0 2023-12-16T03:24:52.888 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.885+0000 7f3b415aa640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c0c6970 con 0x7f3b3c0c6050 2023-12-16T03:24:52.888 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.885+0000 7f3b415aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c8d90 con 0x7f3b3c155730 2023-12-16T03:24:52.888 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.885+0000 7f3b3b7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 0x7f3b3c0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.888 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.885+0000 7f3b3affd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3b3c0c6050 0x7f3b3c155020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38860/0 (socket says 172.21.15.134:38860) 2023-12-16T03:24:52.888 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.885+0000 7f3b3affd640 1 -- 172.21.15.134:0/3870119206 learned_addr learned my addr 172.21.15.134:0/3870119206 (peer_addr_for_me v1:172.21.15.134:0/0) 2023-12-16T03:24:52.888 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.885+0000 7f3b3b7fe640 1 -- 172.21.15.134:0/3870119206 >> v1:172.21.15.134:6789/0 conn(0x7f3b3c0c6050 legacy=0x7f3b3c155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.889 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.885+0000 7f3b3a7fc640 1 -- 172.21.15.134:0/3870119206 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212414935 0 0) 0x7f3b3c0c6970 con 0x7f3b3c0c6050 2023-12-16T03:24:52.889 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.885+0000 7f3b3b7fe640 1 -- 172.21.15.134:0/3870119206 >> v1:172.21.15.28:6789/0 conn(0x7f3b3c0c31c0 legacy=0x7f3b3c0c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.889 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.885+0000 7f3b3b7fe640 1 -- 172.21.15.134:0/3870119206 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c0c1d40 con 0x7f3b3c155730 2023-12-16T03:24:52.891 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b3b7fe640 1 --2- 172.21.15.134:0/3870119206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 0x7f3b3c0c6430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009dc0 tx=0x7f3b3401c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d159692744be3ed server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:52.891 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b3a7fc640 1 -- 172.21.15.134:0/3870119206 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b340a58e0 con 0x7f3b3c155730 2023-12-16T03:24:52.891 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b3a7fc640 1 -- 172.21.15.134:0/3870119206 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b340a5a40 con 0x7f3b3c155730 2023-12-16T03:24:52.891 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b3a7fc640 1 -- 172.21.15.134:0/3870119206 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b340a5dd0 con 0x7f3b3c155730 2023-12-16T03:24:52.892 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 -- 172.21.15.134:0/3870119206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 msgr2=0x7f3b3c0c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.892 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 --2- 172.21.15.134:0/3870119206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 0x7f3b3c0c6430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009dc0 tx=0x7f3b3401c820 comp rx=0 tx=0).stop 2023-12-16T03:24:52.892 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 -- 172.21.15.134:0/3870119206 shutdown_connections 2023-12-16T03:24:52.893 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 --2- 172.21.15.134:0/3870119206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 0x7f3b3c0c6430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.893 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 -- 172.21.15.134:0/3870119206 >> 172.21.15.134:0/3870119206 conn(0x7f3b3c0a9b80 msgr2=0x7f3b3c0a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:52.893 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 -- 172.21.15.134:0/3870119206 shutdown_connections 2023-12-16T03:24:52.893 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 -- 172.21.15.134:0/3870119206 wait complete. 2023-12-16T03:24:52.894 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 Processor -- start 2023-12-16T03:24:52.894 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 -- start start 2023-12-16T03:24:52.896 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b3c0c31c0 0x7f3b3c1500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.896 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b3c0c6050 0x7f3b3c1f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.896 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 0x7f3b3c1f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:52.896 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c3c80 con 0x7f3b3c0c31c0 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c1f0780 con 0x7f3b3c0c6050 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b415aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c1548c0 con 0x7f3b3c155730 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.889+0000 7f3b3b7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 0x7f3b3c1f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b33fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b3c0c6050 0x7f3b3c1f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b3b7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 0x7f3b3c1f1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:35772/0 (socket says 172.21.15.134:35772) 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b3b7fe640 1 -- 172.21.15.134:0/3206474446 learned_addr learned my addr 172.21.15.134:0/3206474446 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b3affd640 1 --2- 172.21.15.134:0/3206474446 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b3c0c31c0 0x7f3b3c1500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b33fff640 1 -- 172.21.15.134:0/3206474446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 msgr2=0x7f3b3c1f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b33fff640 1 --2- 172.21.15.134:0/3206474446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 0x7f3b3c1f1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b33fff640 1 -- 172.21.15.134:0/3206474446 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b3c0c31c0 msgr2=0x7f3b3c1500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b33fff640 1 --2- 172.21.15.134:0/3206474446 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b3c0c31c0 0x7f3b3c1500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b33fff640 1 -- 172.21.15.134:0/3206474446 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b34009a70 con 0x7f3b3c0c6050 2023-12-16T03:24:52.897 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b3affd640 1 --2- 172.21.15.134:0/3206474446 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b3c0c31c0 0x7f3b3c1500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:24:52.898 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b33fff640 1 --2- 172.21.15.134:0/3206474446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b3c0c6050 0x7f3b3c1f0c10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b24000f70 tx=0x7f3b2400c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:52.898 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b337fe640 1 -- 172.21.15.134:0/3206474446 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240052d0 con 0x7f3b3c0c6050 2023-12-16T03:24:52.898 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b337fe640 1 -- 172.21.15.134:0/3206474446 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24005430 con 0x7f3b3c0c6050 2023-12-16T03:24:52.898 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b415aa640 1 -- 172.21.15.134:0/3206474446 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c14d250 con 0x7f3b3c0c6050 2023-12-16T03:24:52.898 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b337fe640 1 -- 172.21.15.134:0/3206474446 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24003840 con 0x7f3b3c0c6050 2023-12-16T03:24:52.898 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b415aa640 1 -- 172.21.15.134:0/3206474446 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c1505e0 con 0x7f3b3c0c6050 2023-12-16T03:24:52.898 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b337fe640 1 -- 172.21.15.134:0/3206474446 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3b24003ca0 con 0x7f3b3c0c6050 2023-12-16T03:24:52.898 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b337fe640 1 -- 172.21.15.134:0/3206474446 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3b24011b80 con 0x7f3b3c0c6050 2023-12-16T03:24:52.898 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.893+0000 7f3b415aa640 1 -- 172.21.15.134:0/3206474446 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c1f08f0 con 0x7f3b3c0c6050 2023-12-16T03:24:52.899 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.897+0000 7f3b337fe640 1 -- 172.21.15.134:0/3206474446 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f3b24017070 con 0x7f3b3c0c6050 2023-12-16T03:24:52.917 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:52.913+0000 7fc60aa13180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-16T03:24:52.925 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:52.922+0000 7fa052ab9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-16T03:24:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.961+0000 7f3b415aa640 1 -- 172.21.15.134:0/3206474446 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c19b5836-4a60-4c30-8e28-6cf6cdbc88af", "id": 6} v 0) v1 -- 0x7f3b3c068400 con 0x7f3b3c0c6050 2023-12-16T03:24:52.970 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.965+0000 7f3b337fe640 1 -- 172.21.15.134:0/3206474446 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c19b5836-4a60-4c30-8e28-6cf6cdbc88af", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3b24011590 con 0x7f3b3c0c6050 2023-12-16T03:24:52.970 INFO:teuthology.orchestra.run.smithi134.stdout:6 2023-12-16T03:24:52.972 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.969+0000 7f3b415aa640 1 -- 172.21.15.134:0/3206474446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b3c0c6050 msgr2=0x7f3b3c1f0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:52.972 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.969+0000 7f3b415aa640 1 --2- 172.21.15.134:0/3206474446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b3c0c6050 0x7f3b3c1f0c10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b24000f70 tx=0x7f3b2400c820 comp rx=0 tx=0).stop 2023-12-16T03:24:52.972 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.969+0000 7f3b415aa640 1 -- 172.21.15.134:0/3206474446 shutdown_connections 2023-12-16T03:24:52.972 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.969+0000 7f3b415aa640 1 --2- 172.21.15.134:0/3206474446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b3c155730 0x7f3b3c1f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.972 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.969+0000 7f3b415aa640 1 --2- 172.21.15.134:0/3206474446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b3c0c6050 0x7f3b3c1f0c10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.972 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.969+0000 7f3b415aa640 1 --2- 172.21.15.134:0/3206474446 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b3c0c31c0 0x7f3b3c1500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:52.972 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.969+0000 7f3b415aa640 1 -- 172.21.15.134:0/3206474446 >> 172.21.15.134:0/3206474446 conn(0x7f3b3c0a9b80 msgr2=0x7f3b3c0c7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:52.972 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.969+0000 7f3b415aa640 1 -- 172.21.15.134:0/3206474446 shutdown_connections 2023-12-16T03:24:52.972 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:52.969+0000 7f3b415aa640 1 -- 172.21.15.134:0/3206474446 wait complete. 2023-12-16T03:24:52.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new d4633ecb-f56c-4e72-9bda-63405bdee774 7 2023-12-16T03:24:52.998 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:52.994+0000 7fa052ab9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-16T03:24:53.008 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:53.005+0000 7fc60aa13180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-16T03:24:53.073 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:53.069+0000 7fc60aa13180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-16T03:24:53.143 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20d1f80640 1 Processor -- start 2023-12-16T03:24:53.144 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20d1f80640 1 -- start start 2023-12-16T03:24:53.145 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20d1f80640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f20cc0c7ea0 0x7f20cc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:53.145 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20d1f80640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc06c860 con 0x7f20cc151e90 2023-12-16T03:24:53.145 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20d1f80640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc154930 con 0x7f20cc06b9e0 2023-12-16T03:24:53.145 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20d1f80640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20cc0c8750 con 0x7f20cc0c7ea0 2023-12-16T03:24:53.145 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20caffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f20cc0c7ea0 0x7f20cc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:53.145 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20cbfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f20cc06b9e0 0x7f20cc15f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:38866/0 (socket says 172.21.15.134:38866) 2023-12-16T03:24:53.145 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20cbfff640 1 -- 172.21.15.134:0/1902353980 learned_addr learned my addr 172.21.15.134:0/1902353980 (peer_addr_for_me v1:172.21.15.134:0/0) 2023-12-16T03:24:53.146 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20caffd640 1 -- 172.21.15.134:0/1902353980 >> v1:172.21.15.134:6789/0 conn(0x7f20cc06b9e0 legacy=0x7f20cc15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:53.146 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20caffd640 1 -- 172.21.15.134:0/1902353980 >> v1:172.21.15.28:6789/0 conn(0x7f20cc151e90 legacy=0x7f20cc0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:24:53.146 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20ca7fc640 1 -- 172.21.15.134:0/1902353980 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74966708 0 0) 0x7f20cc154930 con 0x7f20cc06b9e0 2023-12-16T03:24:53.146 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.141+0000 7f20caffd640 1 -- 172.21.15.134:0/1902353980 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc154c10 con 0x7f20cc0c7ea0 2023-12-16T03:24:53.148 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20caffd640 1 --2- 172.21.15.134:0/1902353980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20cc0c7ea0 0x7f20cc06b4a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20c00097c0 tx=0x7f20c001c320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3c1d3270517ba08 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:53.148 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20ca7fc640 1 -- 172.21.15.134:0/1902353980 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c00ab600 con 0x7f20cc0c7ea0 2023-12-16T03:24:53.148 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20ca7fc640 1 -- 172.21.15.134:0/1902353980 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c00a7050 con 0x7f20cc0c7ea0 2023-12-16T03:24:53.148 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20ca7fc640 1 -- 172.21.15.134:0/1902353980 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c00ab980 con 0x7f20cc0c7ea0 2023-12-16T03:24:53.149 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20d1f80640 1 -- 172.21.15.134:0/1902353980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20cc0c7ea0 msgr2=0x7f20cc06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:53.149 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20d1f80640 1 --2- 172.21.15.134:0/1902353980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20cc0c7ea0 0x7f20cc06b4a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20c00097c0 tx=0x7f20c001c320 comp rx=0 tx=0).stop 2023-12-16T03:24:53.149 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20d1f80640 1 -- 172.21.15.134:0/1902353980 shutdown_connections 2023-12-16T03:24:53.149 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20d1f80640 1 --2- 172.21.15.134:0/1902353980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20cc0c7ea0 0x7f20cc06b4a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.149 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20d1f80640 1 -- 172.21.15.134:0/1902353980 >> 172.21.15.134:0/1902353980 conn(0x7f20cc0ca170 msgr2=0x7f20cc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:53.150 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20d1f80640 1 -- 172.21.15.134:0/1902353980 shutdown_connections 2023-12-16T03:24:53.150 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20d1f80640 1 -- 172.21.15.134:0/1902353980 wait complete. 2023-12-16T03:24:53.151 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.145+0000 7f20d1f80640 1 Processor -- start 2023-12-16T03:24:53.151 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20d1f80640 1 -- start start 2023-12-16T03:24:53.153 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20d1f80640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20cc06b9e0 0x7f20cc0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:53.153 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20d1f80640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20cc0c7ea0 0x7f20cc14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:53.153 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20d1f80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20cc151e90 0x7f20cc0ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:53.153 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20d1f80640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc1552d0 con 0x7f20cc0c7ea0 2023-12-16T03:24:53.153 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20d1f80640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc14f080 con 0x7f20cc151e90 2023-12-16T03:24:53.153 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20d1f80640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc14e750 con 0x7f20cc06b9e0 2023-12-16T03:24:53.153 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20cb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20cc06b9e0 0x7f20cc0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:53.153 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20cbfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20cc151e90 0x7f20cc0ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:53.153 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20cb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20cc06b9e0 0x7f20cc0af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:35782/0 (socket says 172.21.15.134:35782) 2023-12-16T03:24:53.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20cb7fe640 1 -- 172.21.15.134:0/2527529507 learned_addr learned my addr 172.21.15.134:0/2527529507 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-16T03:24:53.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20caffd640 1 --2- 172.21.15.134:0/2527529507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20cc0c7ea0 0x7f20cc14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:53.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20cb7fe640 1 -- 172.21.15.134:0/2527529507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20cc151e90 msgr2=0x7f20cc0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:53.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20cb7fe640 1 --2- 172.21.15.134:0/2527529507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20cc151e90 0x7f20cc0ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20cb7fe640 1 -- 172.21.15.134:0/2527529507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20cc0c7ea0 msgr2=0x7f20cc14b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:53.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20cb7fe640 1 --2- 172.21.15.134:0/2527529507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20cc0c7ea0 0x7f20cc14b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20cb7fe640 1 -- 172.21.15.134:0/2527529507 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c0009420 con 0x7f20cc06b9e0 2023-12-16T03:24:53.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20caffd640 1 --2- 172.21.15.134:0/2527529507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20cc0c7ea0 0x7f20cc14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:24:53.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20cbfff640 1 --2- 172.21.15.134:0/2527529507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20cc151e90 0x7f20cc0ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:24:53.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20cb7fe640 1 --2- 172.21.15.134:0/2527529507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20cc06b9e0 0x7f20cc0af710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00c480 tx=0x7f20bc00c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20b3fff640 1 -- 172.21.15.134:0/2527529507 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc012830 con 0x7f20cc06b9e0 2023-12-16T03:24:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20b3fff640 1 -- 172.21.15.134:0/2527529507 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc0129b0 con 0x7f20cc06b9e0 2023-12-16T03:24:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20b3fff640 1 -- 172.21.15.134:0/2527529507 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc012d60 con 0x7f20cc06b9e0 2023-12-16T03:24:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20d1f80640 1 -- 172.21.15.134:0/2527529507 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc14ea30 con 0x7f20cc06b9e0 2023-12-16T03:24:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20d1f80640 1 -- 172.21.15.134:0/2527529507 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc14b700 con 0x7f20cc06b9e0 2023-12-16T03:24:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20b3fff640 1 -- 172.21.15.134:0/2527529507 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f20bc01c760 con 0x7f20cc06b9e0 2023-12-16T03:24:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20b3fff640 1 -- 172.21.15.134:0/2527529507 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f20bc01bd90 con 0x7f20cc06b9e0 2023-12-16T03:24:53.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.149+0000 7f20d1f80640 1 -- 172.21.15.134:0/2527529507 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20cc0adb90 con 0x7f20cc06b9e0 2023-12-16T03:24:53.156 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.153+0000 7f20b3fff640 1 -- 172.21.15.134:0/2527529507 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f20bc01b730 con 0x7f20cc06b9e0 2023-12-16T03:24:53.222 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.217+0000 7f20d1f80640 1 -- 172.21.15.134:0/2527529507 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d4633ecb-f56c-4e72-9bda-63405bdee774", "id": 7} v 0) v1 -- 0x7f20cc068400 con 0x7f20cc06b9e0 2023-12-16T03:24:53.226 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.221+0000 7f20b3fff640 1 -- 172.21.15.134:0/2527529507 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4633ecb-f56c-4e72-9bda-63405bdee774", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f20bc01b8d0 con 0x7f20cc06b9e0 2023-12-16T03:24:53.227 INFO:teuthology.orchestra.run.smithi134.stdout:7 2023-12-16T03:24:53.228 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.225+0000 7f20d1f80640 1 -- 172.21.15.134:0/2527529507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20cc06b9e0 msgr2=0x7f20cc0af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:53.228 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.225+0000 7f20d1f80640 1 --2- 172.21.15.134:0/2527529507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20cc06b9e0 0x7f20cc0af710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00c480 tx=0x7f20bc00c940 comp rx=0 tx=0).stop 2023-12-16T03:24:53.228 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.225+0000 7f20d1f80640 1 -- 172.21.15.134:0/2527529507 shutdown_connections 2023-12-16T03:24:53.228 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.225+0000 7f20d1f80640 1 --2- 172.21.15.134:0/2527529507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20cc151e90 0x7f20cc0ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.228 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.225+0000 7f20d1f80640 1 --2- 172.21.15.134:0/2527529507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f20cc0c7ea0 0x7f20cc14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.228 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.225+0000 7f20d1f80640 1 --2- 172.21.15.134:0/2527529507 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20cc06b9e0 0x7f20cc0af710 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.228 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.225+0000 7f20d1f80640 1 -- 172.21.15.134:0/2527529507 >> 172.21.15.134:0/2527529507 conn(0x7f20cc0ca170 msgr2=0x7f20cc0c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:53.228 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.225+0000 7f20d1f80640 1 -- 172.21.15.134:0/2527529507 shutdown_connections 2023-12-16T03:24:53.228 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-16T03:24:53.225+0000 7f20d1f80640 1 -- 172.21.15.134:0/2527529507 wait complete. 2023-12-16T03:24:53.232 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:53.229+0000 7fc60aa13180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-16T03:24:53.246 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-16T03:24:53.246 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-16T03:24:53.250 INFO:tasks.ceph.osd.0:Started 2023-12-16T03:24:53.250 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-16T03:24:53.250 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-16T03:24:53.253 INFO:tasks.ceph.osd.1:Started 2023-12-16T03:24:53.254 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-16T03:24:53.254 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-16T03:24:53.257 INFO:tasks.ceph.osd.2:Started 2023-12-16T03:24:53.257 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-16T03:24:53.257 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-16T03:24:53.261 INFO:tasks.ceph.osd.3:Started 2023-12-16T03:24:53.261 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-16T03:24:53.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-16T03:24:53.266 INFO:tasks.ceph.osd.4:Started 2023-12-16T03:24:53.266 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-16T03:24:53.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-16T03:24:53.271 INFO:tasks.ceph.osd.5:Started 2023-12-16T03:24:53.271 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-16T03:24:53.271 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-16T03:24:53.276 INFO:tasks.ceph.osd.6:Started 2023-12-16T03:24:53.276 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-16T03:24:53.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-16T03:24:53.281 INFO:tasks.ceph.osd.7:Started 2023-12-16T03:24:53.281 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:24:53.312 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:53.309+0000 7fc60aa13180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-16T03:24:53.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.486+0000 7ff2e0279640 1 Processor -- start 2023-12-16T03:24:53.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.486+0000 7ff2e0279640 1 -- start start 2023-12-16T03:24:53.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.486+0000 7ff2e0279640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2d80c5260 0x7ff2d806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:53.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.486+0000 7ff2e0279640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff2d8155de0 0x7ff2d8156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:53.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.486+0000 7ff2e0279640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d80c2580 con 0x7ff2d80c5640 2023-12-16T03:24:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.486+0000 7ff2e0279640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d8153510 con 0x7ff2d8155de0 2023-12-16T03:24:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.486+0000 7ff2e0279640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80c17f0 con 0x7ff2d80c5260 2023-12-16T03:24:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.486+0000 7ff2de816640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff2d8155de0 0x7ff2d8156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.486+0000 7ff2de015640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2d80c5260 0x7ff2d806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:53.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.490+0000 7ff2de816640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff2d8155de0 0x7ff2d8156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:37182/0 (socket says 172.21.15.28:37182) 2023-12-16T03:24:53.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.490+0000 7ff2de816640 1 -- 172.21.15.28:0/563592107 learned_addr learned my addr 172.21.15.28:0/563592107 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:24:53.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.490+0000 7ff2dd814640 1 --1- 172.21.15.28:0/563592107 >> v1:172.21.15.134:6789/0 conn(0x7ff2d80c5640 0x7ff2d80c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53612/0 (socket says 172.21.15.28:53612) 2023-12-16T03:24:53.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.490+0000 7ff2de816640 1 -- 172.21.15.28:0/563592107 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2d80c5260 msgr2=0x7ff2d806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:24:53.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.490+0000 7ff2de816640 1 --2- 172.21.15.28:0/563592107 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2d80c5260 0x7ff2d806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.490+0000 7ff2de816640 1 -- 172.21.15.28:0/563592107 >> v1:172.21.15.134:6789/0 conn(0x7ff2d80c5640 legacy=0x7ff2d80c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:53.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.490+0000 7ff2de816640 1 -- 172.21.15.28:0/563592107 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80c1a00 con 0x7ff2d8155de0 2023-12-16T03:24:53.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.490+0000 7ff2de816640 1 --2- 172.21.15.28:0/563592107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d8155de0 0x7ff2d8156250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80c1930 tx=0x7ff2d001c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=531bfd6958c598d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.490+0000 7ff2dd013640 1 -- 172.21.15.28:0/563592107 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00a57f0 con 0x7ff2d8155de0 2023-12-16T03:24:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.490+0000 7ff2dd013640 1 -- 172.21.15.28:0/563592107 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d00a5950 con 0x7ff2d8155de0 2023-12-16T03:24:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.490+0000 7ff2dd013640 1 -- 172.21.15.28:0/563592107 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00a5ce0 con 0x7ff2d8155de0 2023-12-16T03:24:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 -- 172.21.15.28:0/563592107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d8155de0 msgr2=0x7ff2d8156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 --2- 172.21.15.28:0/563592107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d8155de0 0x7ff2d8156250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80c1930 tx=0x7ff2d001c930 comp rx=0 tx=0).stop 2023-12-16T03:24:53.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 -- 172.21.15.28:0/563592107 shutdown_connections 2023-12-16T03:24:53.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 --2- 172.21.15.28:0/563592107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d8155de0 0x7ff2d8156250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 --2- 172.21.15.28:0/563592107 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2d80c5260 0x7ff2d806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 -- 172.21.15.28:0/563592107 >> 172.21.15.28:0/563592107 conn(0x7ff2d806a5b0 msgr2=0x7ff2d806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:53.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 -- 172.21.15.28:0/563592107 shutdown_connections 2023-12-16T03:24:53.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 -- 172.21.15.28:0/563592107 wait complete. 2023-12-16T03:24:53.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 Processor -- start 2023-12-16T03:24:53.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 -- start start 2023-12-16T03:24:53.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d80c5260 0x7ff2d814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2d80c5640 0x7ff2d8151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2d8155de0 0x7ff2d81eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d81ef2c0 con 0x7ff2d80c5640 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80bbda0 con 0x7ff2d80c5260 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2e0279640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80bc080 con 0x7ff2d8155de0 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2dd814640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2d80c5640 0x7ff2d8151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2de015640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d80c5260 0x7ff2d814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2dd814640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2d80c5640 0x7ff2d8151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50026/0 (socket says 172.21.15.28:50026) 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2dd814640 1 -- 172.21.15.28:0/3904739523 learned_addr learned my addr 172.21.15.28:0/3904739523 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2de816640 1 --2- 172.21.15.28:0/3904739523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2d8155de0 0x7ff2d81eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2dd814640 1 -- 172.21.15.28:0/3904739523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2d8155de0 msgr2=0x7ff2d81eb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2dd814640 1 --2- 172.21.15.28:0/3904739523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2d8155de0 0x7ff2d81eb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2dd814640 1 -- 172.21.15.28:0/3904739523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d80c5260 msgr2=0x7ff2d814f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2dd814640 1 --2- 172.21.15.28:0/3904739523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d80c5260 0x7ff2d814f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2dd814640 1 -- 172.21.15.28:0/3904739523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d0009b30 con 0x7ff2d80c5640 2023-12-16T03:24:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.494+0000 7ff2de015640 1 --2- 172.21.15.28:0/3904739523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d80c5260 0x7ff2d814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:24:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.498+0000 7ff2dd814640 1 --2- 172.21.15.28:0/3904739523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2d80c5640 0x7ff2d8151730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c430 tx=0x7ff2c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.498+0000 7ff2ceffd640 1 -- 172.21.15.28:0/3904739523 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80074e0 con 0x7ff2d80c5640 2023-12-16T03:24:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.498+0000 7ff2ceffd640 1 -- 172.21.15.28:0/3904739523 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c8007640 con 0x7ff2d80c5640 2023-12-16T03:24:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.498+0000 7ff2ceffd640 1 -- 172.21.15.28:0/3904739523 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8004a10 con 0x7ff2d80c5640 2023-12-16T03:24:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.498+0000 7ff2e0279640 1 -- 172.21.15.28:0/3904739523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d80bc360 con 0x7ff2d80c5640 2023-12-16T03:24:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.498+0000 7ff2e0279640 1 -- 172.21.15.28:0/3904739523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d81eae40 con 0x7ff2d80c5640 2023-12-16T03:24:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.498+0000 7ff2ceffd640 1 -- 172.21.15.28:0/3904739523 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff2c8013400 con 0x7ff2d80c5640 2023-12-16T03:24:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.498+0000 7ff2ceffd640 1 -- 172.21.15.28:0/3904739523 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff2c8013d80 con 0x7ff2d80c5640 2023-12-16T03:24:53.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.498+0000 7ff2e0279640 1 -- 172.21.15.28:0/3904739523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d8068400 con 0x7ff2d80c5640 2023-12-16T03:24:53.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.510+0000 7ff2ceffd640 1 -- 172.21.15.28:0/3904739523 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7ff2c80136b0 con 0x7ff2d80c5640 2023-12-16T03:24:53.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.570+0000 7ff2e0279640 1 -- 172.21.15.28:0/3904739523 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2d8072570 con 0x7ff2d80c5640 2023-12-16T03:24:53.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.570+0000 7ff2ceffd640 1 -- 172.21.15.28:0/3904739523 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff2c8013850 con 0x7ff2d80c5640 2023-12-16T03:24:53.572 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:24:53.572 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":10,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:24:53.224642+0000","last_up_change":"0.000000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:24:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.570+0000 7ff2e0279640 1 -- 172.21.15.28:0/3904739523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2d80c5640 msgr2=0x7ff2d8151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.570+0000 7ff2e0279640 1 --2- 172.21.15.28:0/3904739523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2d80c5640 0x7ff2d8151730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c430 tx=0x7ff2c800c8f0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.570+0000 7ff2e0279640 1 -- 172.21.15.28:0/3904739523 shutdown_connections 2023-12-16T03:24:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.570+0000 7ff2e0279640 1 --2- 172.21.15.28:0/3904739523 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2d8155de0 0x7ff2d81eb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.570+0000 7ff2e0279640 1 --2- 172.21.15.28:0/3904739523 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2d80c5640 0x7ff2d8151730 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.570+0000 7ff2e0279640 1 --2- 172.21.15.28:0/3904739523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d80c5260 0x7ff2d814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.570+0000 7ff2e0279640 1 -- 172.21.15.28:0/3904739523 >> 172.21.15.28:0/3904739523 conn(0x7ff2d806a5b0 msgr2=0x7ff2d806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.570+0000 7ff2e0279640 1 -- 172.21.15.28:0/3904739523 shutdown_connections 2023-12-16T03:24:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:24:53.570+0000 7ff2e0279640 1 -- 172.21.15.28:0/3904739523 wait complete. 2023-12-16T03:24:53.591 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-16T03:24:53.592 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-16T03:24:53.668 INFO:tasks.ceph.mgr.y.smithi028.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-16T03:24:53.669 INFO:tasks.ceph.mgr.y.smithi028.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-16T03:24:53.669 INFO:tasks.ceph.mgr.y.smithi028.stderr: from numpy import show_config as show_numpy_config 2023-12-16T03:24:53.716 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:53.714+0000 7fa052ab9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-16T03:24:53.858 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:53.854+0000 7fa052ab9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-16T03:24:53.936 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-12-16T03:24:53.934+0000 7f50d3775640 -1 Falling back to public interface 2023-12-16T03:24:53.940 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-12-16T03:24:53.938+0000 7f3e13755640 -1 Falling back to public interface 2023-12-16T03:24:53.952 INFO:tasks.ceph.osd.5.smithi134.stderr:2023-12-16T03:24:53.949+0000 7efc3bc36640 -1 Falling back to public interface 2023-12-16T03:24:53.956 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-12-16T03:24:53.954+0000 7fce9739d640 -1 Falling back to public interface 2023-12-16T03:24:53.964 INFO:tasks.ceph.osd.7.smithi134.stderr:2023-12-16T03:24:53.961+0000 7f48af9c2640 -1 Falling back to public interface 2023-12-16T03:24:53.968 INFO:tasks.ceph.mgr.x.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-16T03:24:53.968 INFO:tasks.ceph.mgr.x.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-16T03:24:53.968 INFO:tasks.ceph.mgr.x.smithi134.stderr: from numpy import show_config as show_numpy_config 2023-12-16T03:24:53.980 INFO:tasks.ceph.osd.4.smithi134.stderr:2023-12-16T03:24:53.977+0000 7fed9bae2640 -1 Falling back to public interface 2023-12-16T03:24:53.980 INFO:tasks.ceph.osd.6.smithi134.stderr:2023-12-16T03:24:53.977+0000 7f27f7cba640 -1 Falling back to public interface 2023-12-16T03:24:53.992 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-12-16T03:24:53.990+0000 7f1c07f19640 -1 Falling back to public interface 2023-12-16T03:24:54.023 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:54.017+0000 7fc60aa13180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-16T03:24:54.040 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:54.038+0000 7fa052ab9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-16T03:24:54.116 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:54.114+0000 7fa052ab9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-16T03:24:54.157 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:54.153+0000 7fc60aa13180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-16T03:24:54.262 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:54.258+0000 7fa052ab9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-16T03:24:54.347 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:54.345+0000 7fc60aa13180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-16T03:24:54.397 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-16T03:24:54.420 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:54.417+0000 7fc60aa13180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-16T03:24:54.529 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43c0868640 1 Processor -- start 2023-12-16T03:24:54.529 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43c0868640 1 -- start start 2023-12-16T03:24:54.530 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43c0868640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43bc0c7e90 0x7f43bc0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:54.530 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43c0868640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc158b60 con 0x7f43bc0c4910 2023-12-16T03:24:54.531 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43c0868640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc0ac660 con 0x7f43bc0bd620 2023-12-16T03:24:54.531 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43c0868640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0c5970 con 0x7f43bc0c7e90 2023-12-16T03:24:54.531 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43ba59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f43bc0c4910 0x7f43bc1547e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:34744/0 (socket says 172.21.15.28:34744) 2023-12-16T03:24:54.531 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43ba59c640 1 -- 172.21.15.28:0/1730007301 learned_addr learned my addr 172.21.15.28:0/1730007301 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:24:54.531 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43bad9d640 1 --2- 172.21.15.28:0/1730007301 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43bc0c7e90 0x7f43bc0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:54.532 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43b959a640 1 -- 172.21.15.28:0/1730007301 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045575733 0 0) 0x7f43ac001120 con 0x7f43bc0c4910 2023-12-16T03:24:54.533 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43b959a640 1 -- 172.21.15.28:0/1730007301 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a4003530 con 0x7f43bc0c4910 2023-12-16T03:24:54.533 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43b959a640 1 -- 172.21.15.28:0/1730007301 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002587079 0 0) 0x7f43bc0ac660 con 0x7f43bc0bd620 2023-12-16T03:24:54.533 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43b959a640 1 -- 172.21.15.28:0/1730007301 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ac001120 con 0x7f43bc0bd620 2023-12-16T03:24:54.533 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43bad9d640 1 -- 172.21.15.28:0/1730007301 >> v1:172.21.15.134:6789/0 conn(0x7f43bc0bd620 legacy=0x7f43bc154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:54.533 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43bad9d640 1 -- 172.21.15.28:0/1730007301 >> v1:172.21.15.28:6789/0 conn(0x7f43bc0c4910 legacy=0x7f43bc1547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:54.533 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.526+0000 7f43bad9d640 1 -- 172.21.15.28:0/1730007301 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc06cd50 con 0x7f43bc0c7e90 2023-12-16T03:24:54.535 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.530+0000 7f43bad9d640 1 --2- 172.21.15.28:0/1730007301 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43bc0c7e90 0x7f43bc0c4cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009dc0 tx=0x7f43b401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c22381ca49c747d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:54.535 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.530+0000 7f43b959a640 1 -- 172.21.15.28:0/1730007301 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40a5910 con 0x7f43bc0c7e90 2023-12-16T03:24:54.536 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.530+0000 7f43b959a640 1 -- 172.21.15.28:0/1730007301 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b40a5a70 con 0x7f43bc0c7e90 2023-12-16T03:24:54.536 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.530+0000 7f43b959a640 1 -- 172.21.15.28:0/1730007301 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40a5e00 con 0x7f43bc0c7e90 2023-12-16T03:24:54.536 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.530+0000 7f43c0868640 1 -- 172.21.15.28:0/1730007301 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43bc0c7e90 msgr2=0x7f43bc0c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:54.536 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.530+0000 7f43c0868640 1 --2- 172.21.15.28:0/1730007301 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43bc0c7e90 0x7f43bc0c4cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009dc0 tx=0x7f43b401c850 comp rx=0 tx=0).stop 2023-12-16T03:24:54.536 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 -- 172.21.15.28:0/1730007301 shutdown_connections 2023-12-16T03:24:54.536 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 --2- 172.21.15.28:0/1730007301 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43bc0c7e90 0x7f43bc0c4cf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:54.536 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 -- 172.21.15.28:0/1730007301 >> 172.21.15.28:0/1730007301 conn(0x7f43bc071e60 msgr2=0x7f43bc072270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:54.536 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 -- 172.21.15.28:0/1730007301 shutdown_connections 2023-12-16T03:24:54.537 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 -- 172.21.15.28:0/1730007301 wait complete. 2023-12-16T03:24:54.539 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 Processor -- start 2023-12-16T03:24:54.539 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 -- start start 2023-12-16T03:24:54.539 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43bc0bd620 0x7f43bc1ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:54.539 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43bc0c4910 0x7f43bc0c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:54.539 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43bc0c7e90 0x7f43bc143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0bf260 con 0x7f43bc0bd620 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc152290 con 0x7f43bc0c4910 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43c0868640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc1ed580 con 0x7f43bc0c7e90 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43ba59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43bc0bd620 0x7f43bc1ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43ba59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43bc0bd620 0x7f43bc1ecd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50028/0 (socket says 172.21.15.28:50028) 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43ba59c640 1 -- 172.21.15.28:0/839920856 learned_addr learned my addr 172.21.15.28:0/839920856 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43bad9d640 1 --2- 172.21.15.28:0/839920856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43bc0c7e90 0x7f43bc143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43b9d9b640 1 --2- 172.21.15.28:0/839920856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43bc0c4910 0x7f43bc0c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43ba59c640 1 -- 172.21.15.28:0/839920856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43bc0c7e90 msgr2=0x7f43bc143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43ba59c640 1 --2- 172.21.15.28:0/839920856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43bc0c7e90 0x7f43bc143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43ba59c640 1 -- 172.21.15.28:0/839920856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43bc0c4910 msgr2=0x7f43bc0c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:54.540 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43ba59c640 1 --2- 172.21.15.28:0/839920856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43bc0c4910 0x7f43bc0c0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:54.541 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43ba59c640 1 -- 172.21.15.28:0/839920856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b4009a70 con 0x7f43bc0bd620 2023-12-16T03:24:54.541 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.534+0000 7f43ba59c640 1 --2- 172.21.15.28:0/839920856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43bc0bd620 0x7f43bc1ecd30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00c650 tx=0x7f43ac00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:24:54.542 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.538+0000 7f43aaffd640 1 -- 172.21.15.28:0/839920856 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac005ac0 con 0x7f43bc0bd620 2023-12-16T03:24:54.542 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.538+0000 7f43aaffd640 1 -- 172.21.15.28:0/839920856 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac005c20 con 0x7f43bc0bd620 2023-12-16T03:24:54.542 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.538+0000 7f43aaffd640 1 -- 172.21.15.28:0/839920856 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac007070 con 0x7f43bc0bd620 2023-12-16T03:24:54.542 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.538+0000 7f43c0868640 1 -- 172.21.15.28:0/839920856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc1ed860 con 0x7f43bc0bd620 2023-12-16T03:24:54.542 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.538+0000 7f43c0868640 1 -- 172.21.15.28:0/839920856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc1524e0 con 0x7f43bc0bd620 2023-12-16T03:24:54.542 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.538+0000 7f43aaffd640 1 -- 172.21.15.28:0/839920856 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f43ac0074d0 con 0x7f43bc0bd620 2023-12-16T03:24:54.542 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.538+0000 7f43aaffd640 1 -- 172.21.15.28:0/839920856 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f43ac01cb10 con 0x7f43bc0bd620 2023-12-16T03:24:54.542 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.538+0000 7f43c0868640 1 -- 172.21.15.28:0/839920856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc0683a0 con 0x7f43bc0bd620 2023-12-16T03:24:54.543 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.538+0000 7f43aaffd640 1 -- 172.21.15.28:0/839920856 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f43ac021060 con 0x7f43bc0bd620 2023-12-16T03:24:54.558 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:54.553+0000 7fc60aa13180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-16T03:24:54.603 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.598+0000 7f43c0868640 1 -- 172.21.15.28:0/839920856 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43bc06c910 con 0x7f43bc0bd620 2023-12-16T03:24:54.603 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.602+0000 7f43aaffd640 1 -- 172.21.15.28:0/839920856 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f43ac017070 con 0x7f43bc0bd620 2023-12-16T03:24:54.603 INFO:teuthology.misc.health.smithi028.stdout: 2023-12-16T03:24:54.603 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":10,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:24:53.224642+0000","last_up_change":"0.000000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:24:54.604 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.602+0000 7f43c0868640 1 -- 172.21.15.28:0/839920856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43bc0bd620 msgr2=0x7f43bc1ecd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:24:54.604 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.602+0000 7f43c0868640 1 --2- 172.21.15.28:0/839920856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43bc0bd620 0x7f43bc1ecd30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00c650 tx=0x7f43ac00cb10 comp rx=0 tx=0).stop 2023-12-16T03:24:54.604 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.602+0000 7f43c0868640 1 -- 172.21.15.28:0/839920856 shutdown_connections 2023-12-16T03:24:54.605 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.602+0000 7f43c0868640 1 --2- 172.21.15.28:0/839920856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43bc0c7e90 0x7f43bc143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:54.605 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.602+0000 7f43c0868640 1 --2- 172.21.15.28:0/839920856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43bc0c4910 0x7f43bc0c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:54.605 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.602+0000 7f43c0868640 1 --2- 172.21.15.28:0/839920856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43bc0bd620 0x7f43bc1ecd30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:24:54.605 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.602+0000 7f43c0868640 1 -- 172.21.15.28:0/839920856 >> 172.21.15.28:0/839920856 conn(0x7f43bc071e60 msgr2=0x7f43bc0c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:24:54.605 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.602+0000 7f43c0868640 1 -- 172.21.15.28:0/839920856 shutdown_connections 2023-12-16T03:24:54.605 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:24:54.602+0000 7f43c0868640 1 -- 172.21.15.28:0/839920856 wait complete. 2023-12-16T03:24:54.622 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-16T03:24:54.974 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:54.969+0000 7fa052ab9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-16T03:24:55.065 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:55.061+0000 7fa052ab9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-16T03:24:55.247 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:55.245+0000 7fc60aa13180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-16T03:24:55.266 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:55.261+0000 7fa052ab9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-16T03:24:55.334 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:55.329+0000 7fc60aa13180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-16T03:24:55.356 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:55.353+0000 7fa052ab9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-16T03:24:55.526 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:55.521+0000 7fc60aa13180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-16T03:24:55.611 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:55.609+0000 7fc60aa13180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-16T03:24:55.702 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:55.697+0000 7fa052ab9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-16T03:24:55.774 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:55.769+0000 7fa052ab9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-16T03:24:55.946 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:55.941+0000 7fc60aa13180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-16T03:24:56.015 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-16T03:24:56.009+0000 7fc60aa13180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-16T03:24:56.797 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:56.793+0000 7f9ffa140640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-16T03:24:56.798 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-12-16T03:24:56.793+0000 7f9ffa140640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-16T03:24:57.814 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-12-16T03:24:57.809+0000 7fce9739d640 -1 osd.1 0 log_to_monitors true 2023-12-16T03:24:57.827 INFO:tasks.ceph.osd.5.smithi134.stderr:2023-12-16T03:24:57.821+0000 7efc3bc36640 -1 osd.5 0 log_to_monitors true 2023-12-16T03:24:57.866 INFO:tasks.ceph.osd.4.smithi134.stderr:2023-12-16T03:24:57.861+0000 7fed9bae2640 -1 osd.4 0 log_to_monitors true 2023-12-16T03:24:57.905 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-12-16T03:24:57.901+0000 7f3e13755640 -1 osd.0 0 log_to_monitors true 2023-12-16T03:24:57.906 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-12-16T03:24:57.901+0000 7f50d3775640 -1 osd.3 0 log_to_monitors true 2023-12-16T03:24:57.980 INFO:tasks.ceph.osd.7.smithi134.stderr:2023-12-16T03:24:57.977+0000 7f48af9c2640 -1 osd.7 0 log_to_monitors true 2023-12-16T03:24:57.996 INFO:tasks.ceph.osd.6.smithi134.stderr:2023-12-16T03:24:57.993+0000 7f27f7cba640 -1 osd.6 0 log_to_monitors true 2023-12-16T03:24:57.998 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-12-16T03:24:57.993+0000 7f1c07f19640 -1 osd.2 0 log_to_monitors true 2023-12-16T03:25:01.429 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:01.584 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-12-16T03:25:01.581+0000 7fce92b23640 -1 osd.1 0 waiting for initial osdmap 2023-12-16T03:25:01.627 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-12-16T03:25:01.621+0000 7f50d0731640 -1 osd.3 0 waiting for initial osdmap 2023-12-16T03:25:01.630 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-12-16T03:25:01.625+0000 7fce8b170640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:25:01.635 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.629+0000 7f01fad65640 1 Processor -- start 2023-12-16T03:25:01.635 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.629+0000 7f01fad65640 1 -- start start 2023-12-16T03:25:01.637 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01fad65640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f01f406a7c0 0x7f01f415c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:01.638 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01fad65640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40cdcd0 0x7f01f415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:01.638 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01fad65640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f40cc960 con 0x7f01f40cc3e0 2023-12-16T03:25:01.638 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01fad65640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40ccc40 con 0x7f01f406a7c0 2023-12-16T03:25:01.638 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01fad65640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40ccf20 con 0x7f01f40cdcd0 2023-12-16T03:25:01.638 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01f8b01640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f01f406a7c0 0x7f01f415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:01.638 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01f8b01640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f01f406a7c0 0x7f01f415c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40802/0 (socket says 172.21.15.28:40802) 2023-12-16T03:25:01.638 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01f8b01640 1 -- 172.21.15.28:0/3916358401 learned_addr learned my addr 172.21.15.28:0/3916358401 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:01.638 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01f9302640 1 --2- 172.21.15.28:0/3916358401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40cdcd0 0x7f01f415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:01.638 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01f8b01640 1 -- 172.21.15.28:0/3916358401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40cdcd0 msgr2=0x7f01f415cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:01.638 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01f8b01640 1 --2- 172.21.15.28:0/3916358401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40cdcd0 0x7f01f415cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:01.638 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01f8b01640 1 -- 172.21.15.28:0/3916358401 >> v1:172.21.15.134:6789/0 conn(0x7f01f40cc3e0 legacy=0x7f01f40702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:01.639 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.633+0000 7f01f8b01640 1 -- 172.21.15.28:0/3916358401 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40cd200 con 0x7f01f406a7c0 2023-12-16T03:25:01.641 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01f8b01640 1 --2- 172.21.15.28:0/3916358401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f406a7c0 0x7f01f415c870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009870 tx=0x7f01e801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55477bc73b023c3e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:01.641 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01f37fe640 1 -- 172.21.15.28:0/3916358401 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e80ab600 con 0x7f01f406a7c0 2023-12-16T03:25:01.642 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01f37fe640 1 -- 172.21.15.28:0/3916358401 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e80a7050 con 0x7f01f406a7c0 2023-12-16T03:25:01.642 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01f37fe640 1 -- 172.21.15.28:0/3916358401 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e80ab980 con 0x7f01f406a7c0 2023-12-16T03:25:01.642 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01fad65640 1 -- 172.21.15.28:0/3916358401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f406a7c0 msgr2=0x7f01f415c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:01.643 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01fad65640 1 --2- 172.21.15.28:0/3916358401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f406a7c0 0x7f01f415c870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009870 tx=0x7f01e801c500 comp rx=0 tx=0).stop 2023-12-16T03:25:01.643 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01fad65640 1 -- 172.21.15.28:0/3916358401 shutdown_connections 2023-12-16T03:25:01.643 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01fad65640 1 --2- 172.21.15.28:0/3916358401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40cdcd0 0x7f01f415cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:01.643 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01fad65640 1 --2- 172.21.15.28:0/3916358401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f406a7c0 0x7f01f415c870 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:01.643 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01fad65640 1 -- 172.21.15.28:0/3916358401 >> 172.21.15.28:0/3916358401 conn(0x7f01f406bd30 msgr2=0x7f01f406c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:01.643 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01fad65640 1 -- 172.21.15.28:0/3916358401 shutdown_connections 2023-12-16T03:25:01.643 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.637+0000 7f01fad65640 1 -- 172.21.15.28:0/3916358401 wait complete. 2023-12-16T03:25:01.644 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01fad65640 1 Processor -- start 2023-12-16T03:25:01.644 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01fad65640 1 -- start start 2023-12-16T03:25:01.646 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01fad65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f406a7c0 0x7f01f40b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:01.646 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01fad65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f40cc3e0 0x7f01f40c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:01.646 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01fad65640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40cdcd0 0x7f01f41f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:01.646 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01fad65640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40b3540 con 0x7f01f40cc3e0 2023-12-16T03:25:01.646 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01fad65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40b44d0 con 0x7f01f406a7c0 2023-12-16T03:25:01.646 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01fad65640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40c83f0 con 0x7f01f40cdcd0 2023-12-16T03:25:01.646 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f40cc3e0 0x7f01f40c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:01.646 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f8b01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f406a7c0 0x7f01f40b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:01.647 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f40cc3e0 0x7f01f40c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40806/0 (socket says 172.21.15.28:40806) 2023-12-16T03:25:01.647 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f3fff640 1 -- 172.21.15.28:0/2902466473 learned_addr learned my addr 172.21.15.28:0/2902466473 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:01.647 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f9302640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40cdcd0 0x7f01f41f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:01.648 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f3fff640 1 -- 172.21.15.28:0/2902466473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40cdcd0 msgr2=0x7f01f41f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:01.648 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f3fff640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40cdcd0 0x7f01f41f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:01.648 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f3fff640 1 -- 172.21.15.28:0/2902466473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f406a7c0 msgr2=0x7f01f40b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:01.648 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f3fff640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f406a7c0 0x7f01f40b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:01.648 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f3fff640 1 -- 172.21.15.28:0/2902466473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e80094d0 con 0x7f01f40cc3e0 2023-12-16T03:25:01.648 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f3fff640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f40cc3e0 0x7f01f40c4610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c450 tx=0x7f01e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:01.648 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f17fa640 1 -- 172.21.15.28:0/2902466473 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0012830 con 0x7f01f40cc3e0 2023-12-16T03:25:01.648 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f17fa640 1 -- 172.21.15.28:0/2902466473 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e00129b0 con 0x7f01f40cc3e0 2023-12-16T03:25:01.648 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01f17fa640 1 -- 172.21.15.28:0/2902466473 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0012d60 con 0x7f01f40cc3e0 2023-12-16T03:25:01.649 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01fad65640 1 -- 172.21.15.28:0/2902466473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f40c4b50 con 0x7f01f40cc3e0 2023-12-16T03:25:01.649 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.641+0000 7f01fad65640 1 -- 172.21.15.28:0/2902466473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f40c3880 con 0x7f01f40cc3e0 2023-12-16T03:25:01.649 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.645+0000 7f01fad65640 1 -- 172.21.15.28:0/2902466473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f40b3cb0 con 0x7f01f40cc3e0 2023-12-16T03:25:01.651 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.645+0000 7f01f17fa640 1 -- 172.21.15.28:0/2902466473 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) v1 ==== 85798+0+0 (secure 0 0 0) 0x7f01e001c460 con 0x7f01f40cc3e0 2023-12-16T03:25:01.651 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.645+0000 7f01f17fa640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01d80663e0 0x7f01d80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:01.651 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.645+0000 7f01f17fa640 1 -- 172.21.15.28:0/2902466473 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f01e0083540 con 0x7f01f40cc3e0 2023-12-16T03:25:01.652 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.649+0000 7f01f8b01640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01d80663e0 0x7f01d80688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:01.652 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.649+0000 7f01f8b01640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01d80663e0 0x7f01d80688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f01e80ad000 tx=0x7f01e80a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:01.661 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.657+0000 7f01f17fa640 1 -- 172.21.15.28:0/2902466473 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f01e0051a50 con 0x7f01f40cc3e0 2023-12-16T03:25:01.681 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-12-16T03:25:01.677+0000 7f50c7548640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:25:01.698 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-12-16T03:25:01.693+0000 7f3e10711640 -1 osd.0 0 waiting for initial osdmap 2023-12-16T03:25:01.732 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-12-16T03:25:01.725+0000 7f1c0369f640 -1 osd.2 0 waiting for initial osdmap 2023-12-16T03:25:01.737 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-12-16T03:25:01.733+0000 7f3e07528640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:25:01.781 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-12-16T03:25:01.777+0000 7f1bfbcec640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:25:01.851 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.845+0000 7f01fad65640 1 -- 172.21.15.28:0/2902466473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01f40b3cb0 con 0x7f01f40cc3e0 2023-12-16T03:25:01.852 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01f17fa640 1 -- 172.21.15.28:0/2902466473 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f01f40b3cb0 con 0x7f01f40cc3e0 2023-12-16T03:25:01.852 INFO:teuthology.misc.health.smithi028.stdout: 2023-12-16T03:25:01.852 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":12,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:24:59.799426+0000","last_up_change":"0.000000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:01.854 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 -- 172.21.15.28:0/2902466473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01d80663e0 msgr2=0x7f01d80688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:01.854 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01d80663e0 0x7f01d80688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f01e80ad000 tx=0x7f01e80a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:01.854 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 -- 172.21.15.28:0/2902466473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f40cc3e0 msgr2=0x7f01f40c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:01.854 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f40cc3e0 0x7f01f40c4610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c450 tx=0x7f01e000c910 comp rx=0 tx=0).stop 2023-12-16T03:25:01.854 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 -- 172.21.15.28:0/2902466473 shutdown_connections 2023-12-16T03:25:01.854 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40cdcd0 0x7f01f41f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:01.854 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01d80663e0 0x7f01d80688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:01.854 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f40cc3e0 0x7f01f40c4610 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:01.855 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 --2- 172.21.15.28:0/2902466473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f406a7c0 0x7f01f40b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:01.855 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 -- 172.21.15.28:0/2902466473 >> 172.21.15.28:0/2902466473 conn(0x7f01f406bd30 msgr2=0x7f01f40702b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:01.855 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 -- 172.21.15.28:0/2902466473 shutdown_connections 2023-12-16T03:25:01.855 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:01.849+0000 7f01fad65640 1 -- 172.21.15.28:0/2902466473 wait complete. 2023-12-16T03:25:01.872 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-16T03:25:02.240 INFO:tasks.ceph.osd.4.smithi134.stderr:2023-12-16T03:25:02.237+0000 7fed97268640 -1 osd.4 0 waiting for initial osdmap 2023-12-16T03:25:02.248 INFO:tasks.ceph.osd.5.smithi134.stderr:2023-12-16T03:25:02.245+0000 7efc373bc640 -1 osd.5 0 waiting for initial osdmap 2023-12-16T03:25:02.249 INFO:tasks.ceph.osd.6.smithi134.stderr:2023-12-16T03:25:02.245+0000 7f27f3442640 -1 osd.6 0 waiting for initial osdmap 2023-12-16T03:25:02.269 INFO:tasks.ceph.osd.4.smithi134.stderr:2023-12-16T03:25:02.265+0000 7fed8f8b5640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:25:02.269 INFO:tasks.ceph.osd.7.smithi134.stderr:2023-12-16T03:25:02.265+0000 7f48ab148640 -1 osd.7 0 waiting for initial osdmap 2023-12-16T03:25:02.285 INFO:tasks.ceph.osd.6.smithi134.stderr:2023-12-16T03:25:02.281+0000 7f27eba8f640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:25:02.288 INFO:tasks.ceph.osd.5.smithi134.stderr:2023-12-16T03:25:02.285+0000 7efc2fa09640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:25:02.320 INFO:tasks.ceph.osd.7.smithi134.stderr:2023-12-16T03:25:02.317+0000 7f48a3795640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-16T03:25:05.713 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:25:05.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:25:08.677 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:08.820 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.816+0000 7f5e55bdf640 1 Processor -- start 2023-12-16T03:25:08.820 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.816+0000 7f5e55bdf640 1 -- start start 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e55bdf640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5e5014fbe0 0x7f5e50152520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e55bdf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5e500c06d0 0x7f5e50152a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e55bdf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5006d980 con 0x7f5e500c5520 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e55bdf640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5006dc60 con 0x7f5e5014fbe0 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e55bdf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5006df40 con 0x7f5e500c06d0 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e4effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5e5014fbe0 0x7f5e50152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e4effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5e5014fbe0 0x7f5e50152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40846/0 (socket says 172.21.15.28:40846) 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e4effd640 1 -- 172.21.15.28:0/3507127572 learned_addr learned my addr 172.21.15.28:0/3507127572 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e4ffff640 1 --2- 172.21.15.28:0/3507127572 >> v2:172.21.15.134:3300/0 conn(0x7f5e500c06d0 0x7f5e50152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e4effd640 1 -- 172.21.15.28:0/3507127572 >> v2:172.21.15.134:3300/0 conn(0x7f5e500c06d0 msgr2=0x7f5e50152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e4effd640 1 --2- 172.21.15.28:0/3507127572 >> v2:172.21.15.134:3300/0 conn(0x7f5e500c06d0 0x7f5e50152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:08.822 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e4effd640 1 -- 172.21.15.28:0/3507127572 >> v1:172.21.15.134:6789/0 conn(0x7f5e500c5520 legacy=0x7f5e5014f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:08.823 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e4effd640 1 -- 172.21.15.28:0/3507127572 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5006e220 con 0x7f5e5014fbe0 2023-12-16T03:25:08.823 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.820+0000 7f5e4ffff640 1 --2- 172.21.15.28:0/3507127572 >> v2:172.21.15.134:3300/0 conn(0x7f5e500c06d0 0x7f5e50152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:08.824 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e4effd640 1 --2- 172.21.15.28:0/3507127572 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e5014fbe0 0x7f5e50152520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e5006e630 tx=0x7f5e4401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e8c38c715bd16d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:08.825 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e4e7fc640 1 -- 172.21.15.28:0/3507127572 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440ab620 con 0x7f5e5014fbe0 2023-12-16T03:25:08.825 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e4e7fc640 1 -- 172.21.15.28:0/3507127572 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e440ab780 con 0x7f5e5014fbe0 2023-12-16T03:25:08.825 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e4e7fc640 1 -- 172.21.15.28:0/3507127572 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440abb10 con 0x7f5e5014fbe0 2023-12-16T03:25:08.826 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e55bdf640 1 -- 172.21.15.28:0/3507127572 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e5014fbe0 msgr2=0x7f5e50152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:08.826 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e55bdf640 1 --2- 172.21.15.28:0/3507127572 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e5014fbe0 0x7f5e50152520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e5006e630 tx=0x7f5e4401c400 comp rx=0 tx=0).stop 2023-12-16T03:25:08.826 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e55bdf640 1 -- 172.21.15.28:0/3507127572 shutdown_connections 2023-12-16T03:25:08.826 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e55bdf640 1 --2- 172.21.15.28:0/3507127572 >> v2:172.21.15.134:3300/0 conn(0x7f5e500c06d0 0x7f5e50152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:08.826 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e55bdf640 1 --2- 172.21.15.28:0/3507127572 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e5014fbe0 0x7f5e50152520 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:08.826 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e55bdf640 1 -- 172.21.15.28:0/3507127572 >> 172.21.15.28:0/3507127572 conn(0x7f5e500c5cd0 msgr2=0x7f5e500c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:08.826 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e55bdf640 1 -- 172.21.15.28:0/3507127572 shutdown_connections 2023-12-16T03:25:08.826 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e55bdf640 1 -- 172.21.15.28:0/3507127572 wait complete. 2023-12-16T03:25:08.827 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e55bdf640 1 Processor -- start 2023-12-16T03:25:08.827 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.824+0000 7f5e55bdf640 1 -- start start 2023-12-16T03:25:08.830 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e55bdf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e500c06d0 0x7f5e50150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:08.830 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e55bdf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e500c5520 0x7f5e500aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:08.830 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e55bdf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e5014fbe0 0x7f5e50144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:08.831 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e55bdf640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e50152350 con 0x7f5e5014fbe0 2023-12-16T03:25:08.831 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e55bdf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e501f2210 con 0x7f5e500c5520 2023-12-16T03:25:08.831 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e55bdf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e50151080 con 0x7f5e500c06d0 2023-12-16T03:25:08.831 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e4ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e5014fbe0 0x7f5e50144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:08.831 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e4ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e5014fbe0 0x7f5e50144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40854/0 (socket says 172.21.15.28:40854) 2023-12-16T03:25:08.831 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e4ffff640 1 -- 172.21.15.28:0/1617760907 learned_addr learned my addr 172.21.15.28:0/1617760907 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:08.831 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e4effd640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e500c5520 0x7f5e500aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:08.831 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e4f7fe640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e500c06d0 0x7f5e50150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:08.831 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e4ffff640 1 -- 172.21.15.28:0/1617760907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e500c06d0 msgr2=0x7f5e50150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:08.831 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e4ffff640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e500c06d0 0x7f5e50150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:08.831 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e4ffff640 1 -- 172.21.15.28:0/1617760907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e500c5520 msgr2=0x7f5e500aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:08.832 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e4ffff640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e500c5520 0x7f5e500aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:08.832 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e4ffff640 1 -- 172.21.15.28:0/1617760907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440094d0 con 0x7f5e5014fbe0 2023-12-16T03:25:08.832 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e4ffff640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e5014fbe0 0x7f5e50144470 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800cd50 tx=0x7f5e4800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:08.832 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e37fff640 1 -- 172.21.15.28:0/1617760907 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800f680 con 0x7f5e5014fbe0 2023-12-16T03:25:08.832 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e37fff640 1 -- 172.21.15.28:0/1617760907 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4800f800 con 0x7f5e5014fbe0 2023-12-16T03:25:08.832 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e37fff640 1 -- 172.21.15.28:0/1617760907 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800fbb0 con 0x7f5e5014fbe0 2023-12-16T03:25:08.832 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e55bdf640 1 -- 172.21.15.28:0/1617760907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e50151e00 con 0x7f5e5014fbe0 2023-12-16T03:25:08.832 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e55bdf640 1 -- 172.21.15.28:0/1617760907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e501449b0 con 0x7f5e5014fbe0 2023-12-16T03:25:08.832 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.828+0000 7f5e55bdf640 1 -- 172.21.15.28:0/1617760907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e501f1fe0 con 0x7f5e5014fbe0 2023-12-16T03:25:08.833 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.832+0000 7f5e37fff640 1 -- 172.21.15.28:0/1617760907 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5e4800b040 con 0x7f5e5014fbe0 2023-12-16T03:25:08.833 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.832+0000 7f5e37fff640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5e3c066470 0x7f5e3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:08.834 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.832+0000 7f5e37fff640 1 -- 172.21.15.28:0/1617760907 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5e48084510 con 0x7f5e5014fbe0 2023-12-16T03:25:08.834 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.832+0000 7f5e4f7fe640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5e3c066470 0x7f5e3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:08.834 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.832+0000 7f5e4f7fe640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5e3c066470 0x7f5e3c068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e40007fd0 tx=0x7f5e40007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:08.838 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:08.836+0000 7f5e37fff640 1 -- 172.21.15.28:0/1617760907 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5e501f1fe0 con 0x7f5e5014fbe0 2023-12-16T03:25:09.003 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.000+0000 7f5e55bdf640 1 -- 172.21.15.28:0/1617760907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e501f1fe0 con 0x7f5e5014fbe0 2023-12-16T03:25:09.004 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.000+0000 7f5e37fff640 1 -- 172.21.15.28:0/1617760907 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f5e501f1fe0 con 0x7f5e5014fbe0 2023-12-16T03:25:09.004 INFO:teuthology.misc.health.smithi028.stdout: 2023-12-16T03:25:09.004 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":16,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:05.871676+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:09.006 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 -- 172.21.15.28:0/1617760907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5e3c066470 msgr2=0x7f5e3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.006 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5e3c066470 0x7f5e3c068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e40007fd0 tx=0x7f5e40007e40 comp rx=0 tx=0).stop 2023-12-16T03:25:09.006 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 -- 172.21.15.28:0/1617760907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e5014fbe0 msgr2=0x7f5e50144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.006 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e5014fbe0 0x7f5e50144470 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800cd50 tx=0x7f5e4800a650 comp rx=0 tx=0).stop 2023-12-16T03:25:09.006 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 -- 172.21.15.28:0/1617760907 shutdown_connections 2023-12-16T03:25:09.006 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5e3c066470 0x7f5e3c068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.006 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e5014fbe0 0x7f5e50144470 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.006 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e500c5520 0x7f5e500aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.006 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 --2- 172.21.15.28:0/1617760907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e500c06d0 0x7f5e50150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.007 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 -- 172.21.15.28:0/1617760907 >> 172.21.15.28:0/1617760907 conn(0x7f5e500c5cd0 msgr2=0x7f5e500c38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:09.007 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 -- 172.21.15.28:0/1617760907 shutdown_connections 2023-12-16T03:25:09.007 INFO:teuthology.misc.health.smithi028.stderr:2023-12-16T03:25:09.004+0000 7f5e55bdf640 1 -- 172.21.15.28:0/1617760907 wait complete. 2023-12-16T03:25:09.023 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-16T03:25:09.024 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-16T03:25:09.024 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-16T03:25:09.024 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-16T03:25:09.028 INFO:tasks.ceph.mds.a:Started 2023-12-16T03:25:09.028 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-16T03:25:09.028 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-16T03:25:09.031 INFO:tasks.ceph.mds.c:Started 2023-12-16T03:25:09.031 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-16T03:25:09.032 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-16T03:25:09.036 INFO:tasks.ceph.mds.b:Started 2023-12-16T03:25:09.036 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-16T03:25:09.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-16T03:25:09.039 INFO:tasks.ceph.mds.d:Started 2023-12-16T03:25:09.040 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-16T03:25:09.040 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:09.144 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-12-16T03:25:09.145 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2023-12-16T03:25:09.148 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-12-16T03:25:09.149 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2023-12-16T03:25:09.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0be72a640 1 Processor -- start 2023-12-16T03:25:09.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0be72a640 1 -- start start 2023-12-16T03:25:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0be72a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd0b80c7ea0 0x7fd0b806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0be72a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd0b806b9e0 0x7fd0b815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0be72a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b806c860 con 0x7fd0b8151e90 2023-12-16T03:25:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0be72a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b80c8750 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0be72a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b81552d0 con 0x7fd0b806b9e0 2023-12-16T03:25:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0b77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd0b80c7ea0 0x7fd0b806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0b7fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd0b8151e90 0x7fd0b80c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:46236/0 (socket says 172.21.15.28:46236) 2023-12-16T03:25:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0b77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd0b80c7ea0 0x7fd0b806b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40902/0 (socket says 172.21.15.28:40902) 2023-12-16T03:25:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0b7fff640 1 -- 172.21.15.28:0/2187932450 learned_addr learned my addr 172.21.15.28:0/2187932450 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.188+0000 7fd0bccc7640 1 --2- 172.21.15.28:0/2187932450 >> v2:172.21.15.134:3300/0 conn(0x7fd0b806b9e0 0x7fd0b815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0b77fe640 1 -- 172.21.15.28:0/2187932450 >> v2:172.21.15.134:3300/0 conn(0x7fd0b806b9e0 msgr2=0x7fd0b815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0b77fe640 1 --2- 172.21.15.28:0/2187932450 >> v2:172.21.15.134:3300/0 conn(0x7fd0b806b9e0 0x7fd0b815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0b77fe640 1 -- 172.21.15.28:0/2187932450 >> v1:172.21.15.28:6789/0 conn(0x7fd0b8151e90 legacy=0x7fd0b80c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0b77fe640 1 -- 172.21.15.28:0/2187932450 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b8154930 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0b77fe640 1 --2- 172.21.15.28:0/2187932450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b80c7ea0 0x7fd0b806b4a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0b808c190 tx=0x7fd0ac01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a2f8d65073c581 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:09.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0b6ffd640 1 -- 172.21.15.28:0/2187932450 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0ab600 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0b6ffd640 1 -- 172.21.15.28:0/2187932450 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac0a7050 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0b6ffd640 1 -- 172.21.15.28:0/2187932450 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0ab980 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0be72a640 1 -- 172.21.15.28:0/2187932450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b80c7ea0 msgr2=0x7fd0b806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0be72a640 1 --2- 172.21.15.28:0/2187932450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b80c7ea0 0x7fd0b806b4a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0b808c190 tx=0x7fd0ac01c340 comp rx=0 tx=0).stop 2023-12-16T03:25:09.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0be72a640 1 -- 172.21.15.28:0/2187932450 shutdown_connections 2023-12-16T03:25:09.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0be72a640 1 --2- 172.21.15.28:0/2187932450 >> v2:172.21.15.134:3300/0 conn(0x7fd0b806b9e0 0x7fd0b815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0be72a640 1 --2- 172.21.15.28:0/2187932450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b80c7ea0 0x7fd0b806b4a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0be72a640 1 -- 172.21.15.28:0/2187932450 >> 172.21.15.28:0/2187932450 conn(0x7fd0b80ca170 msgr2=0x7fd0b80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:09.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0be72a640 1 -- 172.21.15.28:0/2187932450 shutdown_connections 2023-12-16T03:25:09.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.192+0000 7fd0be72a640 1 -- 172.21.15.28:0/2187932450 wait complete. 2023-12-16T03:25:09.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0be72a640 1 Processor -- start 2023-12-16T03:25:09.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0be72a640 1 -- start start 2023-12-16T03:25:09.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0be72a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0b806b9e0 0x7fd0b814e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0be72a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b80c7ea0 0x7fd0b80ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0be72a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0b8151e90 0x7fd0b80a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0be72a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b814e570 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0be72a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80ab7d0 con 0x7fd0b8151e90 2023-12-16T03:25:09.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0be72a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80abd70 con 0x7fd0b806b9e0 2023-12-16T03:25:09.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b80c7ea0 0x7fd0b80ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b80c7ea0 0x7fd0b80ac200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40914/0 (socket says 172.21.15.28:40914) 2023-12-16T03:25:09.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b77fe640 1 -- 172.21.15.28:0/2673067211 learned_addr learned my addr 172.21.15.28:0/2673067211 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:09.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0bccc7640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0b8151e90 0x7fd0b80a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b7fff640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0b806b9e0 0x7fd0b814e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b77fe640 1 -- 172.21.15.28:0/2673067211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0b806b9e0 msgr2=0x7fd0b814e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b77fe640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0b806b9e0 0x7fd0b814e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b77fe640 1 -- 172.21.15.28:0/2673067211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0b8151e90 msgr2=0x7fd0b80a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b77fe640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0b8151e90 0x7fd0b80a9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b77fe640 1 -- 172.21.15.28:0/2673067211 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac009420 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b77fe640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b80c7ea0 0x7fd0b80ac200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac019f70 tx=0x7fd0ac0190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:09.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b4ff9640 1 -- 172.21.15.28:0/2673067211 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0b4840 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b4ff9640 1 -- 172.21.15.28:0/2673067211 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac0b49c0 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0be72a640 1 -- 172.21.15.28:0/2673067211 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b80bd6b0 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0b4ff9640 1 -- 172.21.15.28:0/2673067211 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0b4d70 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.196+0000 7fd0be72a640 1 -- 172.21.15.28:0/2673067211 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b81ed100 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.200+0000 7fd0be72a640 1 -- 172.21.15.28:0/2673067211 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b81ed2f0 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.200+0000 7fd0b4ff9640 1 -- 172.21.15.28:0/2673067211 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd0ac0b2040 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.200+0000 7fd0b4ff9640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0a40664a0 0x7fd0a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.200+0000 7fd0b4ff9640 1 -- 172.21.15.28:0/2673067211 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0ac11df00 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.200+0000 7fd0b7fff640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0a40664a0 0x7fd0a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.200+0000 7fd0b7fff640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0a40664a0 0x7fd0a4068960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8005890 tx=0x7fd0a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:09.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.204+0000 7fd0b4ff9640 1 -- 172.21.15.28:0/2673067211 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd0ac0eb630 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 -- 172.21.15.28:0/2673067211 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0b8068400 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0b4ff9640 1 -- 172.21.15.28:0/2673067211 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fd0ac0b8090 con 0x7fd0b80c7ea0 2023-12-16T03:25:09.365 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:09.366 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":16,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:05.871676+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:09.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 -- 172.21.15.28:0/2673067211 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0a40664a0 msgr2=0x7fd0a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0a40664a0 0x7fd0a4068960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8005890 tx=0x7fd0a8009040 comp rx=0 tx=0).stop 2023-12-16T03:25:09.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 -- 172.21.15.28:0/2673067211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b80c7ea0 msgr2=0x7fd0b80ac200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b80c7ea0 0x7fd0b80ac200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac019f70 tx=0x7fd0ac0190e0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 -- 172.21.15.28:0/2673067211 shutdown_connections 2023-12-16T03:25:09.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0b8151e90 0x7fd0b80a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0a40664a0 0x7fd0a4068960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0b80c7ea0 0x7fd0b80ac200 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 --2- 172.21.15.28:0/2673067211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0b806b9e0 0x7fd0b814e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 -- 172.21.15.28:0/2673067211 >> 172.21.15.28:0/2673067211 conn(0x7fd0b80ca170 msgr2=0x7fd0b8150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:09.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 -- 172.21.15.28:0/2673067211 shutdown_connections 2023-12-16T03:25:09.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.364+0000 7fd0be72a640 1 -- 172.21.15.28:0/2673067211 wait complete. 2023-12-16T03:25:09.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:09.388 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:09.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f826dcfe640 1 Processor -- start 2023-12-16T03:25:09.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f826dcfe640 1 -- start start 2023-12-16T03:25:09.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f826dcfe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f82680c7ea0 0x7f826806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f826dcfe640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826806c860 con 0x7f826806b9e0 2023-12-16T03:25:09.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f826dcfe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8268154930 con 0x7f8268151e90 2023-12-16T03:25:09.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f826dcfe640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82680c8750 con 0x7f82680c7ea0 2023-12-16T03:25:09.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f8266ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f82680c7ea0 0x7f826806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f8267fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f826806b9e0 0x7f826815f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45198/0 (socket says 172.21.15.28:45198) 2023-12-16T03:25:09.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f8267fff640 1 -- 172.21.15.28:0/2559774768 learned_addr learned my addr 172.21.15.28:0/2559774768 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:09.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f8266ffd640 1 -- 172.21.15.28:0/2559774768 >> v1:172.21.15.134:6789/0 conn(0x7f8268151e90 legacy=0x7f82680c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f8266ffd640 1 -- 172.21.15.28:0/2559774768 >> v1:172.21.15.28:6789/0 conn(0x7f826806b9e0 legacy=0x7f826815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f8266ffd640 1 -- 172.21.15.28:0/2559774768 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8268154c10 con 0x7f82680c7ea0 2023-12-16T03:25:09.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.532+0000 7f82667fc640 1 -- 172.21.15.28:0/2559774768 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697096725 0 0) 0x7f826806c860 con 0x7f826806b9e0 2023-12-16T03:25:09.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.536+0000 7f8266ffd640 1 --2- 172.21.15.28:0/2559774768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82680c7ea0 0x7f826806b4a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f825c0097c0 tx=0x7f825c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16213daf686980a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:09.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.536+0000 7f82667fc640 1 -- 172.21.15.28:0/2559774768 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0ab600 con 0x7f82680c7ea0 2023-12-16T03:25:09.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.536+0000 7f82667fc640 1 -- 172.21.15.28:0/2559774768 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c0a7050 con 0x7f82680c7ea0 2023-12-16T03:25:09.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.536+0000 7f82667fc640 1 -- 172.21.15.28:0/2559774768 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0ab980 con 0x7f82680c7ea0 2023-12-16T03:25:09.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.536+0000 7f826dcfe640 1 -- 172.21.15.28:0/2559774768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82680c7ea0 msgr2=0x7f826806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.536+0000 7f826dcfe640 1 --2- 172.21.15.28:0/2559774768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82680c7ea0 0x7f826806b4a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f825c0097c0 tx=0x7f825c01c360 comp rx=0 tx=0).stop 2023-12-16T03:25:09.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.536+0000 7f826dcfe640 1 -- 172.21.15.28:0/2559774768 shutdown_connections 2023-12-16T03:25:09.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.536+0000 7f826dcfe640 1 --2- 172.21.15.28:0/2559774768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82680c7ea0 0x7f826806b4a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.536+0000 7f826dcfe640 1 -- 172.21.15.28:0/2559774768 >> 172.21.15.28:0/2559774768 conn(0x7f82680ca170 msgr2=0x7f82680ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:09.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.536+0000 7f826dcfe640 1 -- 172.21.15.28:0/2559774768 shutdown_connections 2023-12-16T03:25:09.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.536+0000 7f826dcfe640 1 -- 172.21.15.28:0/2559774768 wait complete. 2023-12-16T03:25:09.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f826dcfe640 1 Processor -- start 2023-12-16T03:25:09.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f826dcfe640 1 -- start start 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f826dcfe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f826806b9e0 0x7f82680af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f826dcfe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82680c7ea0 0x7f82681f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f826dcfe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8268151e90 0x7f82681f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f826dcfe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82681552d0 con 0x7f82680c7ea0 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f826dcfe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82681ee5a0 con 0x7f826806b9e0 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f826dcfe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82681ef120 con 0x7f8268151e90 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f8266ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82680c7ea0 0x7f82681f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f8266ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82680c7ea0 0x7f82681f0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60426/0 (socket says 172.21.15.28:60426) 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f8266ffd640 1 -- 172.21.15.28:0/2120160349 learned_addr learned my addr 172.21.15.28:0/2120160349 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f8267fff640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8268151e90 0x7f82681f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f82677fe640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f826806b9e0 0x7f82680af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f8266ffd640 1 -- 172.21.15.28:0/2120160349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8268151e90 msgr2=0x7f82681f0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f8266ffd640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8268151e90 0x7f82681f0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f8266ffd640 1 -- 172.21.15.28:0/2120160349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f826806b9e0 msgr2=0x7f82680af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f8266ffd640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f826806b9e0 0x7f82680af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f8266ffd640 1 -- 172.21.15.28:0/2120160349 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c009420 con 0x7f82680c7ea0 2023-12-16T03:25:09.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f8266ffd640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82680c7ea0 0x7f82681f0900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f825c019f90 tx=0x7f825c019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:09.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f824ffff640 1 -- 172.21.15.28:0/2120160349 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0abde0 con 0x7f82680c7ea0 2023-12-16T03:25:09.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f824ffff640 1 -- 172.21.15.28:0/2120160349 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c004020 con 0x7f82680c7ea0 2023-12-16T03:25:09.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f824ffff640 1 -- 172.21.15.28:0/2120160349 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c004390 con 0x7f82680c7ea0 2023-12-16T03:25:09.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f826dcfe640 1 -- 172.21.15.28:0/2120160349 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82681f1380 con 0x7f82680c7ea0 2023-12-16T03:25:09.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.540+0000 7f826dcfe640 1 -- 172.21.15.28:0/2120160349 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82681eead0 con 0x7f82680c7ea0 2023-12-16T03:25:09.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.544+0000 7f826dcfe640 1 -- 172.21.15.28:0/2120160349 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8268068400 con 0x7f82680c7ea0 2023-12-16T03:25:09.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.544+0000 7f824ffff640 1 -- 172.21.15.28:0/2120160349 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f825c0b2040 con 0x7f82680c7ea0 2023-12-16T03:25:09.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.544+0000 7f824ffff640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8254066470 0x7f8254068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.544+0000 7f824ffff640 1 -- 172.21.15.28:0/2120160349 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f825c11d830 con 0x7f82680c7ea0 2023-12-16T03:25:09.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.544+0000 7f82677fe640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8254066470 0x7f8254068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.544+0000 7f82677fe640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8254066470 0x7f8254068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8258000f70 tx=0x7f8258009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:09.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.548+0000 7f824ffff640 1 -- 172.21.15.28:0/2120160349 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f825c0eb090 con 0x7f82680c7ea0 2023-12-16T03:25:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 -- 172.21.15.28:0/2120160349 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8268150270 con 0x7f82680c7ea0 2023-12-16T03:25:09.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f824ffff640 1 -- 172.21.15.28:0/2120160349 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f825c0b00a0 con 0x7f82680c7ea0 2023-12-16T03:25:09.709 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 -- 172.21.15.28:0/2120160349 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8254066470 msgr2=0x7f8254068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8254066470 0x7f8254068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8258000f70 tx=0x7f8258009040 comp rx=0 tx=0).stop 2023-12-16T03:25:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 -- 172.21.15.28:0/2120160349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82680c7ea0 msgr2=0x7f82681f0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82680c7ea0 0x7f82681f0900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f825c019f90 tx=0x7f825c019100 comp rx=0 tx=0).stop 2023-12-16T03:25:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 -- 172.21.15.28:0/2120160349 shutdown_connections 2023-12-16T03:25:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8268151e90 0x7f82681f0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8254066470 0x7f8254068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82680c7ea0 0x7f82681f0900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 --2- 172.21.15.28:0/2120160349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f826806b9e0 0x7f82680af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 -- 172.21.15.28:0/2120160349 >> 172.21.15.28:0/2120160349 conn(0x7f82680ca170 msgr2=0x7f8268152f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 -- 172.21.15.28:0/2120160349 shutdown_connections 2023-12-16T03:25:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.708+0000 7f826dcfe640 1 -- 172.21.15.28:0/2120160349 wait complete. 2023-12-16T03:25:09.730 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:25:09.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b8172640 1 Processor -- start 2023-12-16T03:25:09.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b8172640 1 -- start start 2023-12-16T03:25:09.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b8172640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b0151dc0 0x7f65b00c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b8172640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b00ac4f0 con 0x7f65b00c7ed0 2023-12-16T03:25:09.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b8172640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b0158780 con 0x7f65b00bd660 2023-12-16T03:25:09.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b8172640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b0158a60 con 0x7f65b0151dc0 2023-12-16T03:25:09.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b570d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f65b00c7ed0 0x7f65b0154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45200/0 (socket says 172.21.15.28:45200) 2023-12-16T03:25:09.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b570d640 1 -- 172.21.15.28:0/2499465671 learned_addr learned my addr 172.21.15.28:0/2499465671 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:09.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b5f0e640 1 --2- 172.21.15.28:0/2499465671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b0151dc0 0x7f65b00c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b4f0c640 1 -- 172.21.15.28:0/2499465671 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970227121 0 0) 0x7f65b00ac4f0 con 0x7f65b00c7ed0 2023-12-16T03:25:09.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b4f0c640 1 -- 172.21.15.28:0/2499465671 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f659c003530 con 0x7f65b00c7ed0 2023-12-16T03:25:09.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b4f0c640 1 -- 172.21.15.28:0/2499465671 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192318119 0 0) 0x7f65b0158780 con 0x7f65b00bd660 2023-12-16T03:25:09.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b4f0c640 1 -- 172.21.15.28:0/2499465671 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65b00ac4f0 con 0x7f65b00bd660 2023-12-16T03:25:09.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b5f0e640 1 -- 172.21.15.28:0/2499465671 >> v1:172.21.15.134:6789/0 conn(0x7f65b00bd660 legacy=0x7f65b0154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b4f0c640 1 -- 172.21.15.28:0/2499465671 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1846293437 0 0) 0x7f659c003530 con 0x7f65b00c7ed0 2023-12-16T03:25:09.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b5f0e640 1 -- 172.21.15.28:0/2499465671 >> v1:172.21.15.28:6789/0 conn(0x7f65b00c7ed0 legacy=0x7f65b0154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.872+0000 7f65b5f0e640 1 -- 172.21.15.28:0/2499465671 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00ac180 con 0x7f65b0151dc0 2023-12-16T03:25:09.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.876+0000 7f65b5f0e640 1 --2- 172.21.15.28:0/2499465671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b0151dc0 0x7f65b00c4950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0097f0 tx=0x7f65ac01c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1154e5f27435e307 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:09.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.876+0000 7f65b4f0c640 1 -- 172.21.15.28:0/2499465671 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a0001680 con 0x7f65b0151dc0 2023-12-16T03:25:09.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.876+0000 7f65b4f0c640 1 -- 172.21.15.28:0/2499465671 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac0a7050 con 0x7f65b0151dc0 2023-12-16T03:25:09.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.876+0000 7f65b4f0c640 1 -- 172.21.15.28:0/2499465671 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0ab620 con 0x7f65b0151dc0 2023-12-16T03:25:09.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.876+0000 7f65b8172640 1 -- 172.21.15.28:0/2499465671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b0151dc0 msgr2=0x7f65b00c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.876+0000 7f65b8172640 1 --2- 172.21.15.28:0/2499465671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b0151dc0 0x7f65b00c4950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0097f0 tx=0x7f65ac01c2c0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.876+0000 7f65b8172640 1 -- 172.21.15.28:0/2499465671 shutdown_connections 2023-12-16T03:25:09.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.876+0000 7f65b8172640 1 --2- 172.21.15.28:0/2499465671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b0151dc0 0x7f65b00c4950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.876+0000 7f65b8172640 1 -- 172.21.15.28:0/2499465671 >> 172.21.15.28:0/2499465671 conn(0x7f65b0071eb0 msgr2=0x7f65b00722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:09.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.876+0000 7f65b8172640 1 -- 172.21.15.28:0/2499465671 shutdown_connections 2023-12-16T03:25:09.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.876+0000 7f65b8172640 1 -- 172.21.15.28:0/2499465671 wait complete. 2023-12-16T03:25:09.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b8172640 1 Processor -- start 2023-12-16T03:25:09.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b8172640 1 -- start start 2023-12-16T03:25:09.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b8172640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65b00bd660 0x7f65b01537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b8172640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65b00c7ed0 0x7f65b01f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b8172640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b0151dc0 0x7f65b01f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b8172640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00bfb30 con 0x7f65b00bd660 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b8172640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b01f11c0 con 0x7f65b00c7ed0 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b8172640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b0154820 con 0x7f65b0151dc0 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b5f0e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65b00bd660 0x7f65b01537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b5f0e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65b00bd660 0x7f65b01537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60432/0 (socket says 172.21.15.28:60432) 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b5f0e640 1 -- 172.21.15.28:0/2352196174 learned_addr learned my addr 172.21.15.28:0/2352196174 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b5f0e640 1 -- 172.21.15.28:0/2352196174 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b0151dc0 msgr2=0x7f65b01f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b5f0e640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b0151dc0 0x7f65b01f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b5f0e640 1 -- 172.21.15.28:0/2352196174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65b00c7ed0 msgr2=0x7f65b01f0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b570d640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65b00c7ed0 0x7f65b01f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b5f0e640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65b00c7ed0 0x7f65b01f0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:09.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b5f0e640 1 -- 172.21.15.28:0/2352196174 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac009420 con 0x7f65b00bd660 2023-12-16T03:25:09.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b570d640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65b00c7ed0 0x7f65b01f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:09.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b5f0e640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65b00bd660 0x7f65b01537f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0097f0 tx=0x7f65ac019060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:09.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65a67fc640 1 -- 172.21.15.28:0/2352196174 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0abd10 con 0x7f65b00bd660 2023-12-16T03:25:09.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65a67fc640 1 -- 172.21.15.28:0/2352196174 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac0abe70 con 0x7f65b00bd660 2023-12-16T03:25:09.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b8172640 1 -- 172.21.15.28:0/2352196174 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b00c0540 con 0x7f65b00bd660 2023-12-16T03:25:09.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65a67fc640 1 -- 172.21.15.28:0/2352196174 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac004220 con 0x7f65b00bd660 2023-12-16T03:25:09.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.880+0000 7f65b8172640 1 -- 172.21.15.28:0/2352196174 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b0154260 con 0x7f65b00bd660 2023-12-16T03:25:09.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.884+0000 7f65b8172640 1 -- 172.21.15.28:0/2352196174 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b0067a00 con 0x7f65b00bd660 2023-12-16T03:25:09.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.884+0000 7f65a67fc640 1 -- 172.21.15.28:0/2352196174 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f65ac0b2040 con 0x7f65b00bd660 2023-12-16T03:25:09.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.884+0000 7f65a67fc640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6594066470 0x7f6594068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:09.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.884+0000 7f65a67fc640 1 -- 172.21.15.28:0/2352196174 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f65ac11de10 con 0x7f65b00bd660 2023-12-16T03:25:09.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.884+0000 7f65b570d640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6594066470 0x7f6594068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:09.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.884+0000 7f65b570d640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6594066470 0x7f6594068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65a0000fc0 tx=0x7f65a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:09.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:09.888+0000 7f65a67fc640 1 -- 172.21.15.28:0/2352196174 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f65ac121030 con 0x7f65b00bd660 2023-12-16T03:25:10.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 -- 172.21.15.28:0/2352196174 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65b00c3ae0 con 0x7f65b00bd660 2023-12-16T03:25:10.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65a67fc640 1 -- 172.21.15.28:0/2352196174 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f65ac0bc090 con 0x7f65b00bd660 2023-12-16T03:25:10.086 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:10.086 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/146686059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":146686059},{"type":"v1","addr":"172.21.15.28:6836","nonce":146686059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-16T03:25:10.086 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 2 2023-12-16T03:25:10.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 -- 172.21.15.28:0/2352196174 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6594066470 msgr2=0x7f6594068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:10.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6594066470 0x7f6594068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65a0000fc0 tx=0x7f65a0009040 comp rx=0 tx=0).stop 2023-12-16T03:25:10.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 -- 172.21.15.28:0/2352196174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65b00bd660 msgr2=0x7f65b01537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:10.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65b00bd660 0x7f65b01537f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0097f0 tx=0x7f65ac019060 comp rx=0 tx=0).stop 2023-12-16T03:25:10.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 -- 172.21.15.28:0/2352196174 shutdown_connections 2023-12-16T03:25:10.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65b0151dc0 0x7f65b01f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:10.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65b00c7ed0 0x7f65b01f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:10.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6594066470 0x7f6594068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:10.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 --2- 172.21.15.28:0/2352196174 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65b00bd660 0x7f65b01537f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:10.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 -- 172.21.15.28:0/2352196174 >> 172.21.15.28:0/2352196174 conn(0x7f65b0071eb0 msgr2=0x7f65b014d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:10.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 -- 172.21.15.28:0/2352196174 shutdown_connections 2023-12-16T03:25:10.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:10.084+0000 7f65b8172640 1 -- 172.21.15.28:0/2352196174 wait complete. 2023-12-16T03:25:12.107 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:25:12.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.260+0000 7f6e12372640 1 Processor -- start 2023-12-16T03:25:12.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.260+0000 7f6e12372640 1 -- start start 2023-12-16T03:25:12.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.260+0000 7f6e12372640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e0c0c7ea0 0x7f6e0c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.260+0000 7f6e12372640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c06c860 con 0x7f6e0c06b9e0 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.260+0000 7f6e12372640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c154930 con 0x7f6e0c151e90 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.260+0000 7f6e12372640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0c8750 con 0x7f6e0c0c7ea0 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.260+0000 7f6e1090f640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6e0c06b9e0 0x7f6e0c15f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45212/0 (socket says 172.21.15.28:45212) 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.260+0000 7f6e1090f640 1 -- 172.21.15.28:0/3347784901 learned_addr learned my addr 172.21.15.28:0/3347784901 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.260+0000 7f6e0b7fe640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e0c0c7ea0 0x7f6e0c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.260+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301261552 0 0) 0x7f6e0c06c860 con 0x7f6e0c06b9e0 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.260+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6df4003530 con 0x7f6e0c06b9e0 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3082874493 0 0) 0x7f6df4003530 con 0x7f6e0c06b9e0 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e0c0c7ea0 msgr2=0x7f6e0c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e0c0c7ea0 0x7f6e0c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 >> v1:172.21.15.134:6789/0 conn(0x7f6e0c151e90 legacy=0x7f6e0c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c154c10 con 0x7f6e0c06b9e0 2023-12-16T03:25:12.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f6e04001a00 con 0x7f6e0c06b9e0 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 >> v1:172.21.15.28:6789/0 conn(0x7f6e0c06b9e0 legacy=0x7f6e0c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df40039b0 0x7f6df4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e0c0c7ea0 0x7f6df40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df4004d10 0x7f6df4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0c8750 con 0x7f6df40039b0 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df400bb20 con 0x7f6df4004d10 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df400bce0 con 0x7f6e0c0c7ea0 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0bfff640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df40039b0 0x7f6df4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0b7fe640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e0c0c7ea0 0x7f6df40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e1090f640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df4004d10 0x7f6df4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0bfff640 1 -- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e0c0c7ea0 msgr2=0x7f6df40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0bfff640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e0c0c7ea0 0x7f6df40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0bfff640 1 -- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df4004d10 msgr2=0x7f6df4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:12.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0bfff640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df4004d10 0x7f6df4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0bfff640 1 -- 172.21.15.28:0/3347784901 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df4003530 con 0x7f6df40039b0 2023-12-16T03:25:12.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e1090f640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df4004d10 0x7f6df4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:12.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.264+0000 7f6e0bfff640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df40039b0 0x7f6df4003d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc001860 tx=0x7f6dfc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14202359c3619c50 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:12.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0ab600 con 0x7f6df40039b0 2023-12-16T03:25:12.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc0a7050 con 0x7f6df40039b0 2023-12-16T03:25:12.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e0affd640 1 -- 172.21.15.28:0/3347784901 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0ab9a0 con 0x7f6df40039b0 2023-12-16T03:25:12.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 -- 172.21.15.28:0/3347784901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df40039b0 msgr2=0x7f6df4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 --2- 172.21.15.28:0/3347784901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df40039b0 0x7f6df4003d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc001860 tx=0x7f6dfc01c500 comp rx=0 tx=0).stop 2023-12-16T03:25:12.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e1090f640 1 -- 172.21.15.28:0/3347784901 reap_dead start 2023-12-16T03:25:12.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 -- 172.21.15.28:0/3347784901 shutdown_connections 2023-12-16T03:25:12.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 -- 172.21.15.28:0/3347784901 >> 172.21.15.28:0/3347784901 conn(0x7f6e0c0ca170 msgr2=0x7f6e0c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:12.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 -- 172.21.15.28:0/3347784901 shutdown_connections 2023-12-16T03:25:12.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 -- 172.21.15.28:0/3347784901 wait complete. 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 Processor -- start 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 -- start start 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df40039b0 0x7f6e0c14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e0c158820 0x7f6e0c0c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1602d0 0x7f6e0c0c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c1552d0 con 0x7f6e0c1602d0 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c1ed740 con 0x7f6e0c158820 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.268+0000 7f6e12372640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c158400 con 0x7f6df40039b0 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e1090f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1602d0 0x7f6e0c0c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e1090f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1602d0 0x7f6e0c0c3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60450/0 (socket says 172.21.15.28:60450) 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e1090f640 1 -- 172.21.15.28:0/1058615917 learned_addr learned my addr 172.21.15.28:0/1058615917 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e0b7fe640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e0c158820 0x7f6e0c0c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e0bfff640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df40039b0 0x7f6e0c14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e1090f640 1 -- 172.21.15.28:0/1058615917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df40039b0 msgr2=0x7f6e0c14a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e1090f640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df40039b0 0x7f6e0c14a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e1090f640 1 -- 172.21.15.28:0/1058615917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e0c158820 msgr2=0x7f6e0c0c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e1090f640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e0c158820 0x7f6e0c0c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e1090f640 1 -- 172.21.15.28:0/1058615917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c1f16a0 con 0x7f6e0c1602d0 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e0b7fe640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e0c158820 0x7f6e0c0c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e0bfff640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df40039b0 0x7f6e0c14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e1090f640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1602d0 0x7f6e0c0c3ce0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0c45a0 tx=0x7f6e04007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e08ff9640 1 -- 172.21.15.28:0/1058615917 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400e960 con 0x7f6e0c1602d0 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e08ff9640 1 -- 172.21.15.28:0/1058615917 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0400eac0 con 0x7f6e0c1602d0 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e08ff9640 1 -- 172.21.15.28:0/1058615917 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400ee30 con 0x7f6e0c1602d0 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e12372640 1 -- 172.21.15.28:0/1058615917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0c14a9b0 con 0x7f6e0c1602d0 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e12372640 1 -- 172.21.15.28:0/1058615917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c0afdf0 con 0x7f6e0c1602d0 2023-12-16T03:25:12.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e12372640 1 -- 172.21.15.28:0/1058615917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0c068400 con 0x7f6e0c1602d0 2023-12-16T03:25:12.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.272+0000 7f6e08ff9640 1 -- 172.21.15.28:0/1058615917 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6e0401d460 con 0x7f6e0c1602d0 2023-12-16T03:25:12.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.276+0000 7f6e08ff9640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6df80664a0 0x7f6df8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.276+0000 7f6e08ff9640 1 -- 172.21.15.28:0/1058615917 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e04083e10 con 0x7f6e0c1602d0 2023-12-16T03:25:12.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.276+0000 7f6e0bfff640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6df80664a0 0x7f6df8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.276+0000 7f6e0bfff640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6df80664a0 0x7f6df8068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0ad000 tx=0x7f6dfc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:12.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.280+0000 7f6e08ff9640 1 -- 172.21.15.28:0/1058615917 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6e04087030 con 0x7f6e0c1602d0 2023-12-16T03:25:12.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e12372640 1 -- 172.21.15.28:0/1058615917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e0c0c0750 con 0x7f6e0c1602d0 2023-12-16T03:25:12.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e08ff9640 1 -- 172.21.15.28:0/1058615917 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f6e040515d0 con 0x7f6e0c1602d0 2023-12-16T03:25:12.470 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:12.471 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/2517100030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2517100030},{"type":"v1","addr":"172.21.15.134:6835","nonce":2517100030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/146686059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":146686059},{"type":"v1","addr":"172.21.15.28:6836","nonce":146686059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1280024314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1280024314},{"type":"v1","addr":"172.21.15.28:6837","nonce":1280024314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/199412786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":199412786},{"type":"v1","addr":"172.21.15.134:6834","nonce":199412786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-16T03:25:12.471 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 3 2023-12-16T03:25:12.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e12372640 1 -- 172.21.15.28:0/1058615917 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6df80664a0 msgr2=0x7f6df8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e12372640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6df80664a0 0x7f6df8068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0ad000 tx=0x7f6dfc0a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:12.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e12372640 1 -- 172.21.15.28:0/1058615917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1602d0 msgr2=0x7f6e0c0c3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e12372640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1602d0 0x7f6e0c0c3ce0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0c45a0 tx=0x7f6e04007af0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e12372640 1 -- 172.21.15.28:0/1058615917 shutdown_connections 2023-12-16T03:25:12.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e12372640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6df80664a0 0x7f6df8068960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e12372640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1602d0 0x7f6e0c0c3ce0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e12372640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e0c158820 0x7f6e0c0c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e12372640 1 --2- 172.21.15.28:0/1058615917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df40039b0 0x7f6e0c14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.468+0000 7f6e12372640 1 -- 172.21.15.28:0/1058615917 >> 172.21.15.28:0/1058615917 conn(0x7f6e0c0ca170 msgr2=0x7f6e0c0c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:12.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.472+0000 7f6e12372640 1 -- 172.21.15.28:0/1058615917 shutdown_connections 2023-12-16T03:25:12.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.472+0000 7f6e12372640 1 -- 172.21.15.28:0/1058615917 wait complete. 2023-12-16T03:25:12.492 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:12.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.632+0000 7f329b50f640 1 Processor -- start 2023-12-16T03:25:12.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.632+0000 7f329b50f640 1 -- start start 2023-12-16T03:25:12.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.632+0000 7f329b50f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32940c7ed0 0x7f3294154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.632+0000 7f329b50f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32940ac4f0 con 0x7f3294151dc0 2023-12-16T03:25:12.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.632+0000 7f329b50f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3294158780 con 0x7f32940bd660 2023-12-16T03:25:12.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.632+0000 7f329b50f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3294158a60 con 0x7f32940c7ed0 2023-12-16T03:25:12.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.632+0000 7f32992ab640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3294151dc0 0x7f32940c4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45220/0 (socket says 172.21.15.28:45220) 2023-12-16T03:25:12.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.632+0000 7f32992ab640 1 -- 172.21.15.28:0/3591178161 learned_addr learned my addr 172.21.15.28:0/3591178161 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:12.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f3298aaa640 1 --2- 172.21.15.28:0/3591178161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32940c7ed0 0x7f3294154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f328bfff640 1 -- 172.21.15.28:0/3591178161 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330780324 0 0) 0x7f32940ac4f0 con 0x7f3294151dc0 2023-12-16T03:25:12.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f328bfff640 1 -- 172.21.15.28:0/3591178161 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3280003530 con 0x7f3294151dc0 2023-12-16T03:25:12.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f328bfff640 1 -- 172.21.15.28:0/3591178161 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674270805 0 0) 0x7f3294158780 con 0x7f32940bd660 2023-12-16T03:25:12.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f328bfff640 1 -- 172.21.15.28:0/3591178161 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32940ac4f0 con 0x7f32940bd660 2023-12-16T03:25:12.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f3298aaa640 1 -- 172.21.15.28:0/3591178161 >> v1:172.21.15.134:6789/0 conn(0x7f32940bd660 legacy=0x7f3294154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f3298aaa640 1 -- 172.21.15.28:0/3591178161 >> v1:172.21.15.28:6789/0 conn(0x7f3294151dc0 legacy=0x7f32940c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f3298aaa640 1 -- 172.21.15.28:0/3591178161 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32940ac180 con 0x7f32940c7ed0 2023-12-16T03:25:12.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f3298aaa640 1 --2- 172.21.15.28:0/3591178161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32940c7ed0 0x7f3294154650 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f32840097f0 tx=0x7f328401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3f8e05a60c2f60d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:12.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f328bfff640 1 -- 172.21.15.28:0/3591178161 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32840ab600 con 0x7f32940c7ed0 2023-12-16T03:25:12.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f328bfff640 1 -- 172.21.15.28:0/3591178161 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32840a7050 con 0x7f32940c7ed0 2023-12-16T03:25:12.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.636+0000 7f328bfff640 1 -- 172.21.15.28:0/3591178161 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32840ab960 con 0x7f32940c7ed0 2023-12-16T03:25:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 -- 172.21.15.28:0/3591178161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32940c7ed0 msgr2=0x7f3294154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 --2- 172.21.15.28:0/3591178161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32940c7ed0 0x7f3294154650 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f32840097f0 tx=0x7f328401c3a0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 -- 172.21.15.28:0/3591178161 shutdown_connections 2023-12-16T03:25:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 --2- 172.21.15.28:0/3591178161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32940c7ed0 0x7f3294154650 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 -- 172.21.15.28:0/3591178161 >> 172.21.15.28:0/3591178161 conn(0x7f3294071eb0 msgr2=0x7f32940722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 -- 172.21.15.28:0/3591178161 shutdown_connections 2023-12-16T03:25:12.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 -- 172.21.15.28:0/3591178161 wait complete. 2023-12-16T03:25:12.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 Processor -- start 2023-12-16T03:25:12.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 -- start start 2023-12-16T03:25:12.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32940bd660 0x7f32940be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32940c7ed0 0x7f329415f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3294151dc0 0x7f32941eccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32940bea10 con 0x7f3294151dc0 2023-12-16T03:25:12.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32940c09b0 con 0x7f32940bd660 2023-12-16T03:25:12.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f329b50f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32941ec6e0 con 0x7f32940c7ed0 2023-12-16T03:25:12.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f3299aac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3294151dc0 0x7f32941eccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f3299aac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3294151dc0 0x7f32941eccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60462/0 (socket says 172.21.15.28:60462) 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f3299aac640 1 -- 172.21.15.28:0/2293710267 learned_addr learned my addr 172.21.15.28:0/2293710267 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f3298aaa640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32940c7ed0 0x7f329415f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f32992ab640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32940bd660 0x7f32940be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f3299aac640 1 -- 172.21.15.28:0/2293710267 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32940c7ed0 msgr2=0x7f329415f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f3299aac640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32940c7ed0 0x7f329415f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f3299aac640 1 -- 172.21.15.28:0/2293710267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32940bd660 msgr2=0x7f32940be1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f3299aac640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32940bd660 0x7f32940be1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.640+0000 7f3299aac640 1 -- 172.21.15.28:0/2293710267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284009420 con 0x7f3294151dc0 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.644+0000 7f3299aac640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3294151dc0 0x7f32941eccc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f328c00c6c0 tx=0x7f328c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.644+0000 7f3289ffb640 1 -- 172.21.15.28:0/2293710267 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c003b80 con 0x7f3294151dc0 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.644+0000 7f3289ffb640 1 -- 172.21.15.28:0/2293710267 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c003ce0 con 0x7f3294151dc0 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.644+0000 7f329b50f640 1 -- 172.21.15.28:0/2293710267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32940bfe70 con 0x7f3294151dc0 2023-12-16T03:25:12.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.644+0000 7f3289ffb640 1 -- 172.21.15.28:0/2293710267 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c0052f0 con 0x7f3294151dc0 2023-12-16T03:25:12.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.644+0000 7f329b50f640 1 -- 172.21.15.28:0/2293710267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32940c03f0 con 0x7f3294151dc0 2023-12-16T03:25:12.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.644+0000 7f329b50f640 1 -- 172.21.15.28:0/2293710267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3294068400 con 0x7f3294151dc0 2023-12-16T03:25:12.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.644+0000 7f3289ffb640 1 -- 172.21.15.28:0/2293710267 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f328c005450 con 0x7f3294151dc0 2023-12-16T03:25:12.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.644+0000 7f3289ffb640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3278066470 0x7f3278068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.644+0000 7f3289ffb640 1 -- 172.21.15.28:0/2293710267 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f328c083870 con 0x7f3294151dc0 2023-12-16T03:25:12.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.644+0000 7f32992ab640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3278066470 0x7f3278068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.648+0000 7f32992ab640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3278066470 0x7f3278068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32900011f0 tx=0x7f3290007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:12.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.648+0000 7f3289ffb640 1 -- 172.21.15.28:0/2293710267 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f328c051050 con 0x7f3294151dc0 2023-12-16T03:25:12.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f329b50f640 1 -- 172.21.15.28:0/2293710267 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f329406c9a0 con 0x7f3294151dc0 2023-12-16T03:25:12.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f3289ffb640 1 -- 172.21.15.28:0/2293710267 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f328c054670 con 0x7f3294151dc0 2023-12-16T03:25:12.810 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:12.810 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":16,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:05.871676+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:12.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f329b50f640 1 -- 172.21.15.28:0/2293710267 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3278066470 msgr2=0x7f3278068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f329b50f640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3278066470 0x7f3278068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32900011f0 tx=0x7f3290007d40 comp rx=0 tx=0).stop 2023-12-16T03:25:12.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f329b50f640 1 -- 172.21.15.28:0/2293710267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3294151dc0 msgr2=0x7f32941eccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f329b50f640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3294151dc0 0x7f32941eccc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f328c00c6c0 tx=0x7f328c00cb80 comp rx=0 tx=0).stop 2023-12-16T03:25:12.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f329b50f640 1 -- 172.21.15.28:0/2293710267 shutdown_connections 2023-12-16T03:25:12.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f329b50f640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3278066470 0x7f3278068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f329b50f640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3294151dc0 0x7f32941eccc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f329b50f640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32940c7ed0 0x7f329415f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f329b50f640 1 --2- 172.21.15.28:0/2293710267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32940bd660 0x7f32940be1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.808+0000 7f329b50f640 1 -- 172.21.15.28:0/2293710267 >> 172.21.15.28:0/2293710267 conn(0x7f3294071eb0 msgr2=0x7f3294150280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:12.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.812+0000 7f329b50f640 1 -- 172.21.15.28:0/2293710267 shutdown_connections 2023-12-16T03:25:12.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.812+0000 7f329b50f640 1 -- 172.21.15.28:0/2293710267 wait complete. 2023-12-16T03:25:12.832 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:12.832 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:12.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f808a3d8640 1 Processor -- start 2023-12-16T03:25:12.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f808a3d8640 1 -- start start 2023-12-16T03:25:12.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f808a3d8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8084151e90 0x7f80840c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f808a3d8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80840c4e60 0x7f808406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f808a3d8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808406c860 con 0x7f80840c7ea0 2023-12-16T03:25:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f808a3d8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80840c8750 con 0x7f80840c4e60 2023-12-16T03:25:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f808a3d8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80841552d0 con 0x7f8084151e90 2023-12-16T03:25:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f8088975640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80840c4e60 0x7f808406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f8088975640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80840c4e60 0x7f808406bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60478/0 (socket says 172.21.15.28:60478) 2023-12-16T03:25:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f8088975640 1 -- 172.21.15.28:0/407739446 learned_addr learned my addr 172.21.15.28:0/407739446 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f8083fff640 1 --2- 172.21.15.28:0/407739446 >> v2:172.21.15.134:3300/0 conn(0x7f8084151e90 0x7f80840c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f8088975640 1 -- 172.21.15.28:0/407739446 >> v2:172.21.15.134:3300/0 conn(0x7f8084151e90 msgr2=0x7f80840c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f8088975640 1 --2- 172.21.15.28:0/407739446 >> v2:172.21.15.134:3300/0 conn(0x7f8084151e90 0x7f80840c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f8088975640 1 -- 172.21.15.28:0/407739446 >> v1:172.21.15.134:6789/0 conn(0x7f80840c7ea0 legacy=0x7f808406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:12.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.976+0000 7f8088975640 1 -- 172.21.15.28:0/407739446 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8084154930 con 0x7f80840c4e60 2023-12-16T03:25:12.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f8088975640 1 --2- 172.21.15.28:0/407739446 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80840c4e60 0x7f808406bbb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f808408b410 tx=0x7f807c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f5d18f594e6cea server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:12.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f8082ffd640 1 -- 172.21.15.28:0/407739446 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c0a5530 con 0x7f80840c4e60 2023-12-16T03:25:12.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f8082ffd640 1 -- 172.21.15.28:0/407739446 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c0a5690 con 0x7f80840c4e60 2023-12-16T03:25:12.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f8082ffd640 1 -- 172.21.15.28:0/407739446 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c0a5a20 con 0x7f80840c4e60 2023-12-16T03:25:12.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f808a3d8640 1 -- 172.21.15.28:0/407739446 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80840c4e60 msgr2=0x7f808406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f808a3d8640 1 --2- 172.21.15.28:0/407739446 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80840c4e60 0x7f808406bbb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f808408b410 tx=0x7f807c01c870 comp rx=0 tx=0).stop 2023-12-16T03:25:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f808a3d8640 1 -- 172.21.15.28:0/407739446 shutdown_connections 2023-12-16T03:25:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f808a3d8640 1 --2- 172.21.15.28:0/407739446 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80840c4e60 0x7f808406bbb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f808a3d8640 1 --2- 172.21.15.28:0/407739446 >> v2:172.21.15.134:3300/0 conn(0x7f8084151e90 0x7f80840c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f808a3d8640 1 -- 172.21.15.28:0/407739446 >> 172.21.15.28:0/407739446 conn(0x7f80840ca170 msgr2=0x7f80840ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f808a3d8640 1 -- 172.21.15.28:0/407739446 shutdown_connections 2023-12-16T03:25:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.980+0000 7f808a3d8640 1 -- 172.21.15.28:0/407739446 wait complete. 2023-12-16T03:25:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f808a3d8640 1 Processor -- start 2023-12-16T03:25:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f808a3d8640 1 -- start start 2023-12-16T03:25:12.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f808a3d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80840c4e60 0x7f80840aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f808a3d8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80840c7ea0 0x7f808414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f808a3d8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8084151e90 0x7f808414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f808a3d8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80840ae9f0 con 0x7f8084151e90 2023-12-16T03:25:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f808a3d8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808414c550 con 0x7f80840c4e60 2023-12-16T03:25:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f808a3d8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808414f1a0 con 0x7f80840c7ea0 2023-12-16T03:25:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8088975640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8084151e90 0x7f808414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8088975640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8084151e90 0x7f808414cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60482/0 (socket says 172.21.15.28:60482) 2023-12-16T03:25:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8088975640 1 -- 172.21.15.28:0/3577721626 learned_addr learned my addr 172.21.15.28:0/3577721626 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8083fff640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80840c4e60 0x7f80840aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f80837fe640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80840c7ea0 0x7f808414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8088975640 1 -- 172.21.15.28:0/3577721626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80840c7ea0 msgr2=0x7f808414c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8088975640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80840c7ea0 0x7f808414c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8088975640 1 -- 172.21.15.28:0/3577721626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80840c4e60 msgr2=0x7f80840aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:12.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8088975640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80840c4e60 0x7f80840aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:12.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8088975640 1 -- 172.21.15.28:0/3577721626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c009b30 con 0x7f8084151e90 2023-12-16T03:25:12.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8083fff640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80840c4e60 0x7f80840aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:12.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8088975640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8084151e90 0x7f808414cf20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f807c0af040 tx=0x7f807c019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:12.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8080ff9640 1 -- 172.21.15.28:0/3577721626 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c0a5530 con 0x7f8084151e90 2023-12-16T03:25:12.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8080ff9640 1 -- 172.21.15.28:0/3577721626 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c0b8670 con 0x7f8084151e90 2023-12-16T03:25:12.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f808a3d8640 1 -- 172.21.15.28:0/3577721626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808414dd10 con 0x7f8084151e90 2023-12-16T03:25:12.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f8080ff9640 1 -- 172.21.15.28:0/3577721626 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c0b8a20 con 0x7f8084151e90 2023-12-16T03:25:12.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.984+0000 7f808a3d8640 1 -- 172.21.15.28:0/3577721626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808414e2d0 con 0x7f8084151e90 2023-12-16T03:25:12.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.988+0000 7f808a3d8640 1 -- 172.21.15.28:0/3577721626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8084068400 con 0x7f8084151e90 2023-12-16T03:25:12.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.988+0000 7f8080ff9640 1 -- 172.21.15.28:0/3577721626 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f807c0b8b80 con 0x7f8084151e90 2023-12-16T03:25:12.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.988+0000 7f8080ff9640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8070066470 0x7f8070068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.988+0000 7f8080ff9640 1 -- 172.21.15.28:0/3577721626 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f807c11ee30 con 0x7f8084151e90 2023-12-16T03:25:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.988+0000 7f8083fff640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8070066470 0x7f8070068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.988+0000 7f8083fff640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8070066470 0x7f8070068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80840ca730 tx=0x7f8074008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:12.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:12.992+0000 7f8080ff9640 1 -- 172.21.15.28:0/3577721626 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f807c0ec710 con 0x7f8084151e90 2023-12-16T03:25:13.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.152+0000 7f808a3d8640 1 -- 172.21.15.28:0/3577721626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f808414c690 con 0x7f8084151e90 2023-12-16T03:25:13.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.152+0000 7f8080ff9640 1 -- 172.21.15.28:0/3577721626 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f807c0bc0a0 con 0x7f8084151e90 2023-12-16T03:25:13.154 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:13.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.152+0000 7f808a3d8640 1 -- 172.21.15.28:0/3577721626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8070066470 msgr2=0x7f8070068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.152+0000 7f808a3d8640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8070066470 0x7f8070068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80840ca730 tx=0x7f8074008040 comp rx=0 tx=0).stop 2023-12-16T03:25:13.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.152+0000 7f808a3d8640 1 -- 172.21.15.28:0/3577721626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8084151e90 msgr2=0x7f808414cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.152+0000 7f808a3d8640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8084151e90 0x7f808414cf20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f807c0af040 tx=0x7f807c019610 comp rx=0 tx=0).stop 2023-12-16T03:25:13.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.156+0000 7f808a3d8640 1 -- 172.21.15.28:0/3577721626 shutdown_connections 2023-12-16T03:25:13.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.156+0000 7f808a3d8640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8070066470 0x7f8070068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.156+0000 7f808a3d8640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8084151e90 0x7f808414cf20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.156+0000 7f808a3d8640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80840c7ea0 0x7f808414c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.156+0000 7f808a3d8640 1 --2- 172.21.15.28:0/3577721626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80840c4e60 0x7f80840aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.156+0000 7f808a3d8640 1 -- 172.21.15.28:0/3577721626 >> 172.21.15.28:0/3577721626 conn(0x7f80840ca170 msgr2=0x7f808414b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:13.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.156+0000 7f808a3d8640 1 -- 172.21.15.28:0/3577721626 shutdown_connections 2023-12-16T03:25:13.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.156+0000 7f808a3d8640 1 -- 172.21.15.28:0/3577721626 wait complete. 2023-12-16T03:25:13.176 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-16T03:25:13.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.316+0000 7f09b07d1640 1 Processor -- start 2023-12-16T03:25:13.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.316+0000 7f09b07d1640 1 -- start start 2023-12-16T03:25:13.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09b07d1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f09a80c4100 0x7f09a80c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09b07d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a80c06d0 0x7f09a80a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09b07d1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a80c31c0 con 0x7f09a80c63c0 2023-12-16T03:25:13.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09b07d1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a80c34a0 con 0x7f09a80c4100 2023-12-16T03:25:13.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09b07d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80c1030 con 0x7f09a80c06d0 2023-12-16T03:25:13.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ae56d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f09a80c63c0 0x7f09a80c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45224/0 (socket says 172.21.15.28:45224) 2023-12-16T03:25:13.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ae56d640 1 -- 172.21.15.28:0/1704918693 learned_addr learned my addr 172.21.15.28:0/1704918693 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:13.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585677799 0 0) 0x7f09a80c31c0 con 0x7f09a80c63c0 2023-12-16T03:25:13.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09aed6e640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a80c06d0 0x7f09a80a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09add6c640 1 --2- 172.21.15.28:0/1704918693 >> v2:172.21.15.134:3300/0 conn(0x7f09a80c4100 0x7f09a80c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0994003530 con 0x7f09a80c63c0 2023-12-16T03:25:13.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4052365173 0 0) 0x7f0994003530 con 0x7f09a80c63c0 2023-12-16T03:25:13.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a80c06d0 msgr2=0x7f09a80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:13.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a80c06d0 0x7f09a80a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 >> v2:172.21.15.134:3300/0 conn(0x7f09a80c4100 msgr2=0x7f09a80c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:13.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 --2- 172.21.15.28:0/1704918693 >> v2:172.21.15.134:3300/0 conn(0x7f09a80c4100 0x7f09a80c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80c1310 con 0x7f09a80c63c0 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f09a4001680 con 0x7f09a80c63c0 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 >> v1:172.21.15.28:6789/0 conn(0x7f09a80c63c0 legacy=0x7f09a80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a80c06d0 0x7f0994003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0994003f00 0x7f09940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0994004d10 0x7f0994005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80c34a0 con 0x7f0994004d10 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80c1030 con 0x7f0994003f00 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099400ba70 con 0x7f09a80c06d0 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09aed6e640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0994004d10 0x7f0994005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09add6c640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0994003f00 0x7f09940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09ae56d640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a80c06d0 0x7f0994003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09aed6e640 1 -- 172.21.15.28:0/1704918693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a80c06d0 msgr2=0x7f0994003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09aed6e640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09a80c06d0 0x7f0994003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09aed6e640 1 -- 172.21.15.28:0/1704918693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0994003f00 msgr2=0x7f09940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:13.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09aed6e640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0994003f00 0x7f09940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.320+0000 7f09aed6e640 1 -- 172.21.15.28:0/1704918693 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994003530 con 0x7f0994004d10 2023-12-16T03:25:13.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09aed6e640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0994004d10 0x7f0994005190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009fc0 tx=0x7f09a001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601ba603edf37256 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:13.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a00a5b60 con 0x7f0994004d10 2023-12-16T03:25:13.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a000f040 con 0x7f0994004d10 2023-12-16T03:25:13.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09ad56b640 1 -- 172.21.15.28:0/1704918693 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a00ad440 con 0x7f0994004d10 2023-12-16T03:25:13.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09b07d1640 1 -- 172.21.15.28:0/1704918693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0994004d10 msgr2=0x7f0994005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09b07d1640 1 --2- 172.21.15.28:0/1704918693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0994004d10 0x7f0994005190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009fc0 tx=0x7f09a001cc60 comp rx=0 tx=0).stop 2023-12-16T03:25:13.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09aed6e640 1 -- 172.21.15.28:0/1704918693 reap_dead start 2023-12-16T03:25:13.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09b07d1640 1 -- 172.21.15.28:0/1704918693 shutdown_connections 2023-12-16T03:25:13.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09b07d1640 1 -- 172.21.15.28:0/1704918693 >> 172.21.15.28:0/1704918693 conn(0x7f09a806a5b0 msgr2=0x7f09a806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:13.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09b07d1640 1 -- 172.21.15.28:0/1704918693 shutdown_connections 2023-12-16T03:25:13.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09b07d1640 1 -- 172.21.15.28:0/1704918693 wait complete. 2023-12-16T03:25:13.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09b07d1640 1 Processor -- start 2023-12-16T03:25:13.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.324+0000 7f09b07d1640 1 -- start start 2023-12-16T03:25:13.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09b07d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0994004d10 0x7f09a814f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09b07d1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09a8071b10 0x7f09a814df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09b07d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a814e440 0x7f09a8157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09b07d1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80a6e40 con 0x7f09a8071b10 2023-12-16T03:25:13.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09b07d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a814ee90 con 0x7f09a814e440 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09b07d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a814f170 con 0x7f0994004d10 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09add6c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09a8071b10 0x7f09a814df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09add6c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09a8071b10 0x7f09a814df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60506/0 (socket says 172.21.15.28:60506) 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09ae56d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0994004d10 0x7f09a814f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09add6c640 1 -- 172.21.15.28:0/3928583602 learned_addr learned my addr 172.21.15.28:0/3928583602 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09aed6e640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a814e440 0x7f09a8157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09add6c640 1 -- 172.21.15.28:0/3928583602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0994004d10 msgr2=0x7f09a814f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09add6c640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0994004d10 0x7f09a814f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09add6c640 1 -- 172.21.15.28:0/3928583602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a814e440 msgr2=0x7f09a8157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09add6c640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a814e440 0x7f09a8157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09add6c640 1 -- 172.21.15.28:0/3928583602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80aa3a0 con 0x7f09a8071b10 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09add6c640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09a8071b10 0x7f09a814df00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0998006d50 tx=0x7f0998011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f099effd640 1 -- 172.21.15.28:0/3928583602 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099800faf0 con 0x7f09a8071b10 2023-12-16T03:25:13.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f099effd640 1 -- 172.21.15.28:0/3928583602 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099800fc50 con 0x7f09a8071b10 2023-12-16T03:25:13.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09b07d1640 1 -- 172.21.15.28:0/3928583602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a814f450 con 0x7f09a8071b10 2023-12-16T03:25:13.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f099effd640 1 -- 172.21.15.28:0/3928583602 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998004030 con 0x7f09a8071b10 2023-12-16T03:25:13.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09b07d1640 1 -- 172.21.15.28:0/3928583602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a8156340 con 0x7f09a8071b10 2023-12-16T03:25:13.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.328+0000 7f09b07d1640 1 -- 172.21.15.28:0/3928583602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a8068400 con 0x7f09a8071b10 2023-12-16T03:25:13.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.332+0000 7f099effd640 1 -- 172.21.15.28:0/3928583602 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0998004190 con 0x7f09a8071b10 2023-12-16T03:25:13.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.332+0000 7f099effd640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f098c066490 0x7f098c068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.332+0000 7f099effd640 1 -- 172.21.15.28:0/3928583602 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0998084100 con 0x7f09a8071b10 2023-12-16T03:25:13.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.332+0000 7f09ae56d640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f098c066490 0x7f098c068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.332+0000 7f09ae56d640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f098c066490 0x7f098c068950 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f09a4001cd0 tx=0x7f09a4007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:13.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.336+0000 7f099effd640 1 -- 172.21.15.28:0/3928583602 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0998051960 con 0x7f09a8071b10 2023-12-16T03:25:13.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.492+0000 7f09b07d1640 1 -- 172.21.15.28:0/3928583602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f09a80c3e70 con 0x7f09a8071b10 2023-12-16T03:25:13.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f099effd640 1 -- 172.21.15.28:0/3928583602 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0998022090 con 0x7f09a8071b10 2023-12-16T03:25:13.497 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:13.497 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2023-12-16T03:25:13.497 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:13.497 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2023-12-16T03:25:13.497 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2023-12-16T03:25:13.497 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:13.497 INFO:teuthology.orchestra.run.smithi028.stdout:] 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 -- 172.21.15.28:0/3928583602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f098c066490 msgr2=0x7f098c068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f098c066490 0x7f098c068950 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f09a4001cd0 tx=0x7f09a4007900 comp rx=0 tx=0).stop 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 -- 172.21.15.28:0/3928583602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09a8071b10 msgr2=0x7f09a814df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09a8071b10 0x7f09a814df00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0998006d50 tx=0x7f0998011de0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 -- 172.21.15.28:0/3928583602 shutdown_connections 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09a814e440 0x7f09a8157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f098c066490 0x7f098c068950 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09a8071b10 0x7f09a814df00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 --2- 172.21.15.28:0/3928583602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0994004d10 0x7f09a814f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 -- 172.21.15.28:0/3928583602 >> 172.21.15.28:0/3928583602 conn(0x7f09a806a5b0 msgr2=0x7f09a81591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 -- 172.21.15.28:0/3928583602 shutdown_connections 2023-12-16T03:25:13.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.496+0000 7f09b07d1640 1 -- 172.21.15.28:0/3928583602 wait complete. 2023-12-16T03:25:13.518 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-16T03:25:13.518 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-16T03:25:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4ab17f5640 1 Processor -- start 2023-12-16T03:25:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4ab17f5640 1 -- start start 2023-12-16T03:25:13.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4ab17f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4aac0c0dd0 0x7f4aac1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4ab17f5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4aac0c2590 0x7f4aac1555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4ab17f5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4aac0a9140 0x7f4aac0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4ab17f5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac0c61b0 con 0x7f4aac0a9140 2023-12-16T03:25:13.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4ab17f5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac0c35f0 con 0x7f4aac0c2590 2023-12-16T03:25:13.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4ab17f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac0c6640 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4aab7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4aac0a9140 0x7f4aac0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4aab7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4aac0a9140 0x7f4aac0a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60512/0 (socket says 172.21.15.28:60512) 2023-12-16T03:25:13.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4aab7fe640 1 -- 172.21.15.28:0/1142111186 learned_addr learned my addr 172.21.15.28:0/1142111186 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:13.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4aaaffd640 1 --2- 172.21.15.28:0/1142111186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4aac0c0dd0 0x7f4aac1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4aaa7fc640 1 --2- 172.21.15.28:0/1142111186 >> v2:172.21.15.134:3300/0 conn(0x7f4aac0c2590 0x7f4aac1555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4aab7fe640 1 -- 172.21.15.28:0/1142111186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4aac0c0dd0 msgr2=0x7f4aac1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:13.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4aab7fe640 1 --2- 172.21.15.28:0/1142111186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4aac0c0dd0 0x7f4aac1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4aab7fe640 1 -- 172.21.15.28:0/1142111186 >> v2:172.21.15.134:3300/0 conn(0x7f4aac0c2590 msgr2=0x7f4aac1555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:13.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4aab7fe640 1 --2- 172.21.15.28:0/1142111186 >> v2:172.21.15.134:3300/0 conn(0x7f4aac0c2590 0x7f4aac1555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.664+0000 7f4aab7fe640 1 -- 172.21.15.28:0/1142111186 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0c55a0 con 0x7f4aac0a9140 2023-12-16T03:25:13.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4aab7fe640 1 --2- 172.21.15.28:0/1142111186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aac0a9140 0x7f4aac0a95b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4aac06e5a0 tx=0x7f4aa401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdcba0c2903960b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:13.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4aa9ffb640 1 -- 172.21.15.28:0/1142111186 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40a5790 con 0x7f4aac0a9140 2023-12-16T03:25:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4aa9ffb640 1 -- 172.21.15.28:0/1142111186 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa40a58f0 con 0x7f4aac0a9140 2023-12-16T03:25:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4aa9ffb640 1 -- 172.21.15.28:0/1142111186 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40a5c80 con 0x7f4aac0a9140 2023-12-16T03:25:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4ab17f5640 1 -- 172.21.15.28:0/1142111186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aac0a9140 msgr2=0x7f4aac0a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4ab17f5640 1 --2- 172.21.15.28:0/1142111186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aac0a9140 0x7f4aac0a95b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4aac06e5a0 tx=0x7f4aa401c910 comp rx=0 tx=0).stop 2023-12-16T03:25:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4ab17f5640 1 -- 172.21.15.28:0/1142111186 shutdown_connections 2023-12-16T03:25:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4ab17f5640 1 --2- 172.21.15.28:0/1142111186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aac0a9140 0x7f4aac0a95b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4ab17f5640 1 --2- 172.21.15.28:0/1142111186 >> v2:172.21.15.134:3300/0 conn(0x7f4aac0c2590 0x7f4aac1555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4ab17f5640 1 --2- 172.21.15.28:0/1142111186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4aac0c0dd0 0x7f4aac1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4ab17f5640 1 -- 172.21.15.28:0/1142111186 >> 172.21.15.28:0/1142111186 conn(0x7f4aac06a5b0 msgr2=0x7f4aac06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4ab17f5640 1 -- 172.21.15.28:0/1142111186 shutdown_connections 2023-12-16T03:25:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.668+0000 7f4ab17f5640 1 -- 172.21.15.28:0/1142111186 wait complete. 2023-12-16T03:25:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4ab17f5640 1 Processor -- start 2023-12-16T03:25:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4ab17f5640 1 -- start start 2023-12-16T03:25:13.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4ab17f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4aac0a9140 0x7f4aac1f0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4ab17f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aac0c0dd0 0x7f4aac0bf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4ab17f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4aac0c2590 0x7f4aac154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4ab17f5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac09b690 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4ab17f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac15bb20 con 0x7f4aac0c2590 2023-12-16T03:25:13.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4ab17f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac1f0d40 con 0x7f4aac0a9140 2023-12-16T03:25:13.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4aaa7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aac0c0dd0 0x7f4aac0bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4aaa7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aac0c0dd0 0x7f4aac0bf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60514/0 (socket says 172.21.15.28:60514) 2023-12-16T03:25:13.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4aaa7fc640 1 -- 172.21.15.28:0/3269149902 learned_addr learned my addr 172.21.15.28:0/3269149902 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:13.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4aaaffd640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4aac0a9140 0x7f4aac1f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4aab7fe640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4aac0c2590 0x7f4aac154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4aaa7fc640 1 -- 172.21.15.28:0/3269149902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4aac0a9140 msgr2=0x7f4aac1f0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4aaa7fc640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4aac0a9140 0x7f4aac1f0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4aaa7fc640 1 -- 172.21.15.28:0/3269149902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4aac0c2590 msgr2=0x7f4aac154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4aaa7fc640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4aac0c2590 0x7f4aac154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4aaa7fc640 1 -- 172.21.15.28:0/3269149902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa4009b30 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4aaa7fc640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aac0c0dd0 0x7f4aac0bf640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000d800 tx=0x7f4aa000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:13.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4a937fe640 1 -- 172.21.15.28:0/3269149902 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000b6c0 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4a937fe640 1 -- 172.21.15.28:0/3269149902 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa000b820 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4ab17f5640 1 -- 172.21.15.28:0/3269149902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac159280 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4a937fe640 1 -- 172.21.15.28:0/3269149902 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000bb90 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4ab17f5640 1 -- 172.21.15.28:0/3269149902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aac15b840 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.672+0000 7f4ab17f5640 1 -- 172.21.15.28:0/3269149902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aac068080 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.676+0000 7f4a937fe640 1 -- 172.21.15.28:0/3269149902 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4aa000bcf0 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.676+0000 7f4a937fe640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a98066470 0x7f4a98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:13.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.676+0000 7f4a937fe640 1 -- 172.21.15.28:0/3269149902 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4aa0083f40 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.676+0000 7f4aaaffd640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a98066470 0x7f4a98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:13.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.676+0000 7f4aaaffd640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a98066470 0x7f4a98068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0045f0 tx=0x7f4a9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:13.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.680+0000 7f4a937fe640 1 -- 172.21.15.28:0/3269149902 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4aa00517b0 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.836+0000 7f4ab17f5640 1 -- 172.21.15.28:0/3269149902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4aac04e850 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4a937fe640 1 -- 172.21.15.28:0/3269149902 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4aa0054dd0 con 0x7f4aac0c0dd0 2023-12-16T03:25:13.906 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2023-12-16T03:25:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 -- 172.21.15.28:0/3269149902 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a98066470 msgr2=0x7f4a98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a98066470 0x7f4a98068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0045f0 tx=0x7f4a9c008040 comp rx=0 tx=0).stop 2023-12-16T03:25:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 -- 172.21.15.28:0/3269149902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aac0c0dd0 msgr2=0x7f4aac0bf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aac0c0dd0 0x7f4aac0bf640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000d800 tx=0x7f4aa000dcc0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 -- 172.21.15.28:0/3269149902 shutdown_connections 2023-12-16T03:25:13.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4aac0c2590 0x7f4aac154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a98066470 0x7f4a98068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4aac0c0dd0 0x7f4aac0bf640 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 --2- 172.21.15.28:0/3269149902 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4aac0a9140 0x7f4aac1f0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:13.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 -- 172.21.15.28:0/3269149902 >> 172.21.15.28:0/3269149902 conn(0x7f4aac06a5b0 msgr2=0x7f4aac0c2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:13.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 -- 172.21.15.28:0/3269149902 shutdown_connections 2023-12-16T03:25:13.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:13.904+0000 7f4ab17f5640 1 -- 172.21.15.28:0/3269149902 wait complete. 2023-12-16T03:25:13.934 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-16T03:25:14.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe7bd1640 1 Processor -- start 2023-12-16T03:25:14.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe7bd1640 1 -- start start 2023-12-16T03:25:14.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe7bd1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fe00c5260 0x7f0fe006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:14.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe7bd1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0fe00c5640 0x7f0fe00c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:14.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe7bd1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0fe00c60f0 0x7f0fe0155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:14.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe7bd1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe00c17f0 con 0x7f0fe00c60f0 2023-12-16T03:25:14.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe7bd1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe00c2580 con 0x7f0fe00c5640 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe7bd1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00c1a00 con 0x7f0fe00c5260 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe616e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0fe00c60f0 0x7f0fe0155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe616e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0fe00c60f0 0x7f0fe0155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60518/0 (socket says 172.21.15.28:60518) 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe616e640 1 -- 172.21.15.28:0/1227392323 learned_addr learned my addr 172.21.15.28:0/1227392323 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe596d640 1 --2- 172.21.15.28:0/1227392323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fe00c5260 0x7f0fe006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe516c640 1 --2- 172.21.15.28:0/1227392323 >> v2:172.21.15.134:3300/0 conn(0x7f0fe00c5640 0x7f0fe00c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe616e640 1 -- 172.21.15.28:0/1227392323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fe00c5260 msgr2=0x7f0fe006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe616e640 1 --2- 172.21.15.28:0/1227392323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fe00c5260 0x7f0fe006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe616e640 1 -- 172.21.15.28:0/1227392323 >> v2:172.21.15.134:3300/0 conn(0x7f0fe00c5640 msgr2=0x7f0fe00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe616e640 1 --2- 172.21.15.28:0/1227392323 >> v2:172.21.15.134:3300/0 conn(0x7f0fe00c5640 0x7f0fe00c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe616e640 1 -- 172.21.15.28:0/1227392323 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe00c1ce0 con 0x7f0fe00c60f0 2023-12-16T03:25:14.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.084+0000 7f0fe596d640 1 --2- 172.21.15.28:0/1227392323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fe00c5260 0x7f0fe006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:14.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe616e640 1 --2- 172.21.15.28:0/1227392323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fe00c60f0 0x7f0fe0155de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00c3870 tx=0x7f0fd801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13da9ed81c7ac874 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:14.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe496b640 1 -- 172.21.15.28:0/1227392323 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd80a5790 con 0x7f0fe00c60f0 2023-12-16T03:25:14.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe496b640 1 -- 172.21.15.28:0/1227392323 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd80a58f0 con 0x7f0fe00c60f0 2023-12-16T03:25:14.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe496b640 1 -- 172.21.15.28:0/1227392323 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd80a5c80 con 0x7f0fe00c60f0 2023-12-16T03:25:14.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1227392323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fe00c60f0 msgr2=0x7f0fe0155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:14.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe7bd1640 1 --2- 172.21.15.28:0/1227392323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fe00c60f0 0x7f0fe0155de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00c3870 tx=0x7f0fd801c910 comp rx=0 tx=0).stop 2023-12-16T03:25:14.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1227392323 shutdown_connections 2023-12-16T03:25:14.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe7bd1640 1 --2- 172.21.15.28:0/1227392323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fe00c60f0 0x7f0fe0155de0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe7bd1640 1 --2- 172.21.15.28:0/1227392323 >> v2:172.21.15.134:3300/0 conn(0x7f0fe00c5640 0x7f0fe00c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe7bd1640 1 --2- 172.21.15.28:0/1227392323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fe00c5260 0x7f0fe006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1227392323 >> 172.21.15.28:0/1227392323 conn(0x7f0fe006a5b0 msgr2=0x7f0fe006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:14.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1227392323 shutdown_connections 2023-12-16T03:25:14.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1227392323 wait complete. 2023-12-16T03:25:14.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe7bd1640 1 Processor -- start 2023-12-16T03:25:14.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.088+0000 7f0fe7bd1640 1 -- start start 2023-12-16T03:25:14.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe7bd1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fe00c5260 0x7f0fe01531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:14.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe7bd1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fe00c5640 0x7f0fe01f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:14.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe7bd1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe00c60f0 0x7f0fe0151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:14.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe7bd1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe01579a0 con 0x7f0fe00c5260 2023-12-16T03:25:14.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe7bd1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe0157cf0 con 0x7f0fe00c60f0 2023-12-16T03:25:14.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe7bd1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe01f1170 con 0x7f0fe00c5640 2023-12-16T03:25:14.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe596d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fe00c5260 0x7f0fe01531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:14.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe596d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fe00c5260 0x7f0fe01531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60534/0 (socket says 172.21.15.28:60534) 2023-12-16T03:25:14.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe596d640 1 -- 172.21.15.28:0/1372258690 learned_addr learned my addr 172.21.15.28:0/1372258690 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:14.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe596d640 1 -- 172.21.15.28:0/1372258690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fe00c5640 msgr2=0x7f0fe01f0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:14.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe596d640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fe00c5640 0x7f0fe01f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe596d640 1 -- 172.21.15.28:0/1372258690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe00c60f0 msgr2=0x7f0fe0151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe596d640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe00c60f0 0x7f0fe0151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe596d640 1 -- 172.21.15.28:0/1372258690 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd8009b30 con 0x7f0fe00c5260 2023-12-16T03:25:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe596d640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fe00c5260 0x7f0fe01531d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00d800 tx=0x7f0fdc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fd67fc640 1 -- 172.21.15.28:0/1372258690 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc004030 con 0x7f0fe00c5260 2023-12-16T03:25:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fd67fc640 1 -- 172.21.15.28:0/1372258690 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc004190 con 0x7f0fe00c5260 2023-12-16T03:25:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fd67fc640 1 -- 172.21.15.28:0/1372258690 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc004520 con 0x7f0fe00c5260 2023-12-16T03:25:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1372258690 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe014f410 con 0x7f0fe00c5260 2023-12-16T03:25:14.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1372258690 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe0157220 con 0x7f0fe00c5260 2023-12-16T03:25:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.092+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1372258690 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe0068400 con 0x7f0fe00c5260 2023-12-16T03:25:14.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.096+0000 7f0fd67fc640 1 -- 172.21.15.28:0/1372258690 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0fdc0096a0 con 0x7f0fe00c5260 2023-12-16T03:25:14.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.096+0000 7f0fd67fc640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0fc4066470 0x7f0fc4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:14.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.096+0000 7f0fd67fc640 1 -- 172.21.15.28:0/1372258690 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0fdc083f40 con 0x7f0fe00c5260 2023-12-16T03:25:14.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.096+0000 7f0fe516c640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0fc4066470 0x7f0fc4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:14.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.096+0000 7f0fe516c640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0fc4066470 0x7f0fc4068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0fe006aa00 tx=0x7f0fd0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:14.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.100+0000 7f0fd67fc640 1 -- 172.21.15.28:0/1372258690 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0fdc051590 con 0x7f0fe00c5260 2023-12-16T03:25:14.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.260+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1372258690 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0fe0156040 con 0x7f0fe00c5260 2023-12-16T03:25:14.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.912+0000 7f0fd67fc640 1 -- 172.21.15.28:0/1372258690 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0fdc018020 con 0x7f0fe00c5260 2023-12-16T03:25:14.914 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2023-12-16T03:25:14.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.912+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1372258690 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0fc4066470 msgr2=0x7f0fc4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:14.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.912+0000 7f0fe7bd1640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0fc4066470 0x7f0fc4068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0fe006aa00 tx=0x7f0fd0008040 comp rx=0 tx=0).stop 2023-12-16T03:25:14.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.912+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1372258690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fe00c5260 msgr2=0x7f0fe01531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:14.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.912+0000 7f0fe7bd1640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fe00c5260 0x7f0fe01531d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00d800 tx=0x7f0fdc00dcc0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.912+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1372258690 shutdown_connections 2023-12-16T03:25:14.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.912+0000 7f0fe7bd1640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fe00c60f0 0x7f0fe0151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.912+0000 7f0fe7bd1640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fe00c5640 0x7f0fe01f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.912+0000 7f0fe7bd1640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0fc4066470 0x7f0fc4068930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.912+0000 7f0fe7bd1640 1 --2- 172.21.15.28:0/1372258690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fe00c5260 0x7f0fe01531d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:14.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.912+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1372258690 >> 172.21.15.28:0/1372258690 conn(0x7f0fe006a5b0 msgr2=0x7f0fe0066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:14.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.916+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1372258690 shutdown_connections 2023-12-16T03:25:14.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:14.916+0000 7f0fe7bd1640 1 -- 172.21.15.28:0/1372258690 wait complete. 2023-12-16T03:25:14.962 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-16T03:25:15.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d4432640 1 Processor -- start 2023-12-16T03:25:15.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d4432640 1 -- start start 2023-12-16T03:25:15.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d4432640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f50cc14fe50 0x7f50cc0c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:15.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d4432640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f50cc0acf50 0x7f50cc0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:15.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d4432640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50cc0acac0 con 0x7f50cc0c4020 2023-12-16T03:25:15.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d4432640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc070af0 con 0x7f50cc14fe50 2023-12-16T03:25:15.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d4432640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc156160 con 0x7f50cc0acf50 2023-12-16T03:25:15.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d21ce640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f50cc14fe50 0x7f50cc0c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:15.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d21ce640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f50cc14fe50 0x7f50cc0c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60536/0 (socket says 172.21.15.28:60536) 2023-12-16T03:25:15.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d21ce640 1 -- 172.21.15.28:0/565637643 learned_addr learned my addr 172.21.15.28:0/565637643 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:15.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d29cf640 1 --2- 172.21.15.28:0/565637643 >> v2:172.21.15.134:3300/0 conn(0x7f50cc0acf50 0x7f50cc0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:15.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d21ce640 1 -- 172.21.15.28:0/565637643 >> v2:172.21.15.134:3300/0 conn(0x7f50cc0acf50 msgr2=0x7f50cc0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:15.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d21ce640 1 --2- 172.21.15.28:0/565637643 >> v2:172.21.15.134:3300/0 conn(0x7f50cc0acf50 0x7f50cc0c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:15.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d21ce640 1 -- 172.21.15.28:0/565637643 >> v1:172.21.15.134:6789/0 conn(0x7f50cc0c4020 legacy=0x7f50cc155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:15.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.108+0000 7f50d21ce640 1 -- 172.21.15.28:0/565637643 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0c7930 con 0x7f50cc14fe50 2023-12-16T03:25:15.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d21ce640 1 --2- 172.21.15.28:0/565637643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50cc14fe50 0x7f50cc0c6d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009870 tx=0x7f50c801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33af38719a891d9f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:15.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d11cc640 1 -- 172.21.15.28:0/565637643 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c80ac630 con 0x7f50cc14fe50 2023-12-16T03:25:15.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d11cc640 1 -- 172.21.15.28:0/565637643 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c80ac790 con 0x7f50cc14fe50 2023-12-16T03:25:15.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d11cc640 1 -- 172.21.15.28:0/565637643 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c80acb20 con 0x7f50cc14fe50 2023-12-16T03:25:15.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d4432640 1 -- 172.21.15.28:0/565637643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50cc14fe50 msgr2=0x7f50cc0c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:15.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d4432640 1 --2- 172.21.15.28:0/565637643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50cc14fe50 0x7f50cc0c6d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009870 tx=0x7f50c801c4c0 comp rx=0 tx=0).stop 2023-12-16T03:25:15.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d4432640 1 -- 172.21.15.28:0/565637643 shutdown_connections 2023-12-16T03:25:15.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d4432640 1 --2- 172.21.15.28:0/565637643 >> v2:172.21.15.134:3300/0 conn(0x7f50cc0acf50 0x7f50cc0c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:15.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d4432640 1 --2- 172.21.15.28:0/565637643 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50cc14fe50 0x7f50cc0c6d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:15.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d4432640 1 -- 172.21.15.28:0/565637643 >> 172.21.15.28:0/565637643 conn(0x7f50cc0a9b80 msgr2=0x7f50cc0a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:15.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d4432640 1 -- 172.21.15.28:0/565637643 shutdown_connections 2023-12-16T03:25:15.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.112+0000 7f50d4432640 1 -- 172.21.15.28:0/565637643 wait complete. 2023-12-16T03:25:15.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d4432640 1 Processor -- start 2023-12-16T03:25:15.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d4432640 1 -- start start 2023-12-16T03:25:15.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d4432640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50cc0acf50 0x7f50cc153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:15.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d4432640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50cc0c4020 0x7f50cc14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:15.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d4432640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50cc14fe50 0x7f50cc06f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:15.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d4432640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0a7410 con 0x7f50cc14fe50 2023-12-16T03:25:15.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d4432640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc1542c0 con 0x7f50cc0c4020 2023-12-16T03:25:15.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d4432640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc14b770 con 0x7f50cc0acf50 2023-12-16T03:25:15.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d29cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50cc14fe50 0x7f50cc06f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:15.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d29cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50cc14fe50 0x7f50cc06f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60546/0 (socket says 172.21.15.28:60546) 2023-12-16T03:25:15.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d29cf640 1 -- 172.21.15.28:0/371505302 learned_addr learned my addr 172.21.15.28:0/371505302 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:15.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d21ce640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50cc0acf50 0x7f50cc153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:15.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d19cd640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50cc0c4020 0x7f50cc14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:15.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d29cf640 1 -- 172.21.15.28:0/371505302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50cc0acf50 msgr2=0x7f50cc153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:15.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d29cf640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50cc0acf50 0x7f50cc153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:15.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d29cf640 1 -- 172.21.15.28:0/371505302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50cc0c4020 msgr2=0x7f50cc14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:15.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d29cf640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50cc0c4020 0x7f50cc14b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:15.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d29cf640 1 -- 172.21.15.28:0/371505302 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c80094d0 con 0x7f50cc14fe50 2023-12-16T03:25:15.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d19cd640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50cc0c4020 0x7f50cc14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:15.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d29cf640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50cc14fe50 0x7f50cc06f4c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50c4007e90 tx=0x7f50c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:15.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50c2ffd640 1 -- 172.21.15.28:0/371505302 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4014420 con 0x7f50cc14fe50 2023-12-16T03:25:15.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50c2ffd640 1 -- 172.21.15.28:0/371505302 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c4014580 con 0x7f50cc14fe50 2023-12-16T03:25:15.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50c2ffd640 1 -- 172.21.15.28:0/371505302 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4014930 con 0x7f50cc14fe50 2023-12-16T03:25:15.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d4432640 1 -- 172.21.15.28:0/371505302 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc152270 con 0x7f50cc14fe50 2023-12-16T03:25:15.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.116+0000 7f50d4432640 1 -- 172.21.15.28:0/371505302 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc151f00 con 0x7f50cc14fe50 2023-12-16T03:25:15.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.120+0000 7f50d4432640 1 -- 172.21.15.28:0/371505302 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc151d60 con 0x7f50cc14fe50 2023-12-16T03:25:15.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.120+0000 7f50c2ffd640 1 -- 172.21.15.28:0/371505302 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f50c4014a90 con 0x7f50cc14fe50 2023-12-16T03:25:15.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.120+0000 7f50c2ffd640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b00664a0 0x7f50b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:15.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.120+0000 7f50c2ffd640 1 -- 172.21.15.28:0/371505302 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f50c4085380 con 0x7f50cc14fe50 2023-12-16T03:25:15.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.120+0000 7f50d21ce640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b00664a0 0x7f50b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:15.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.124+0000 7f50d21ce640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b00664a0 0x7f50b0068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50c80ae000 tx=0x7f50c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:15.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.124+0000 7f50c2ffd640 1 -- 172.21.15.28:0/371505302 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f50c40528d0 con 0x7f50cc14fe50 2023-12-16T03:25:15.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.316+0000 7f50d4432640 1 -- 172.21.15.28:0/371505302 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f50cc151d60 con 0x7f50cc14fe50 2023-12-16T03:25:15.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.912+0000 7f50c2ffd640 1 -- 172.21.15.28:0/371505302 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f50cc151d60 con 0x7f50cc14fe50 2023-12-16T03:25:15.917 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 2 and data pool 3 2023-12-16T03:25:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 -- 172.21.15.28:0/371505302 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b00664a0 msgr2=0x7f50b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b00664a0 0x7f50b0068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50c80ae000 tx=0x7f50c8008040 comp rx=0 tx=0).stop 2023-12-16T03:25:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 -- 172.21.15.28:0/371505302 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50cc14fe50 msgr2=0x7f50cc06f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50cc14fe50 0x7f50cc06f4c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50c4007e90 tx=0x7f50c400e4b0 comp rx=0 tx=0).stop 2023-12-16T03:25:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 -- 172.21.15.28:0/371505302 shutdown_connections 2023-12-16T03:25:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b00664a0 0x7f50b0068960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50cc14fe50 0x7f50cc06f4c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50cc0c4020 0x7f50cc14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 --2- 172.21.15.28:0/371505302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50cc0acf50 0x7f50cc153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 -- 172.21.15.28:0/371505302 >> 172.21.15.28:0/371505302 conn(0x7f50cc0a9b80 msgr2=0x7f50cc0c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 -- 172.21.15.28:0/371505302 shutdown_connections 2023-12-16T03:25:15.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:15.916+0000 7f50d4432640 1 -- 172.21.15.28:0/371505302 wait complete. 2023-12-16T03:25:15.950 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:16.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.096+0000 7f7fca92a640 1 Processor -- start 2023-12-16T03:25:16.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.096+0000 7f7fca92a640 1 -- start start 2023-12-16T03:25:16.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.096+0000 7f7fca92a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7fc40c5640 0x7f7fc40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.096+0000 7f7fca92a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc40c2580 con 0x7f7fc40c60f0 2023-12-16T03:25:16.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.096+0000 7f7fca92a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc40c1a00 con 0x7f7fc40c5260 2023-12-16T03:25:16.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.096+0000 7f7fca92a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc4153510 con 0x7f7fc40c5640 2023-12-16T03:25:16.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.100+0000 7f7fc37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7fc40c5640 0x7f7fc40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.100+0000 7f7fc8ec7640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7fc40c60f0 0x7f7fc4155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45238/0 (socket says 172.21.15.28:45238) 2023-12-16T03:25:16.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.100+0000 7f7fc8ec7640 1 -- 172.21.15.28:0/1989404061 learned_addr learned my addr 172.21.15.28:0/1989404061 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:16.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.100+0000 7f7fc37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7fc40c5640 0x7f7fc40c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60552/0 (socket says 172.21.15.28:60552) 2023-12-16T03:25:16.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.100+0000 7f7fc2ffd640 1 -- 172.21.15.28:0/1989404061 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792193105 0 0) 0x7f7fc40c2580 con 0x7f7fc40c60f0 2023-12-16T03:25:16.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.100+0000 7f7fc37fe640 1 -- 172.21.15.28:0/1989404061 >> v1:172.21.15.134:6789/0 conn(0x7f7fc40c5260 legacy=0x7f7fc406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.100+0000 7f7fc37fe640 1 -- 172.21.15.28:0/1989404061 >> v1:172.21.15.28:6789/0 conn(0x7f7fc40c60f0 legacy=0x7f7fc4155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.100+0000 7f7fc37fe640 1 -- 172.21.15.28:0/1989404061 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40c1ce0 con 0x7f7fc40c5640 2023-12-16T03:25:16.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.100+0000 7f7fc37fe640 1 --2- 172.21.15.28:0/1989404061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fc40c5640 0x7f7fc40c5bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80097c0 tx=0x7f7fb801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35a4feaaf037228 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:16.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fc2ffd640 1 -- 172.21.15.28:0/1989404061 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80ab600 con 0x7f7fc40c5640 2023-12-16T03:25:16.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fc2ffd640 1 -- 172.21.15.28:0/1989404061 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb80a7050 con 0x7f7fc40c5640 2023-12-16T03:25:16.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fc2ffd640 1 -- 172.21.15.28:0/1989404061 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80ab980 con 0x7f7fc40c5640 2023-12-16T03:25:16.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fca92a640 1 -- 172.21.15.28:0/1989404061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fc40c5640 msgr2=0x7f7fc40c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fca92a640 1 --2- 172.21.15.28:0/1989404061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fc40c5640 0x7f7fc40c5bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80097c0 tx=0x7f7fb801c3f0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fca92a640 1 -- 172.21.15.28:0/1989404061 shutdown_connections 2023-12-16T03:25:16.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fca92a640 1 --2- 172.21.15.28:0/1989404061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fc40c5640 0x7f7fc40c5bb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fca92a640 1 -- 172.21.15.28:0/1989404061 >> 172.21.15.28:0/1989404061 conn(0x7f7fc406a5b0 msgr2=0x7f7fc406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:16.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fca92a640 1 -- 172.21.15.28:0/1989404061 shutdown_connections 2023-12-16T03:25:16.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fca92a640 1 -- 172.21.15.28:0/1989404061 wait complete. 2023-12-16T03:25:16.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fca92a640 1 Processor -- start 2023-12-16T03:25:16.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fca92a640 1 -- start start 2023-12-16T03:25:16.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fca92a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fc40c5260 0x7f7fc40a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.104+0000 7f7fca92a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc40c5640 0x7f7fc40711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fca92a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fc40c60f0 0x7f7fc41ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fca92a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40a8900 con 0x7f7fc40c5260 2023-12-16T03:25:16.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fca92a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc41f0510 con 0x7f7fc40c5640 2023-12-16T03:25:16.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fca92a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc41f0db0 con 0x7f7fc40c60f0 2023-12-16T03:25:16.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fc40c5260 0x7f7fc40a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fc40c5260 0x7f7fc40a9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60558/0 (socket says 172.21.15.28:60558) 2023-12-16T03:25:16.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc3fff640 1 -- 172.21.15.28:0/4245149747 learned_addr learned my addr 172.21.15.28:0/4245149747 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:16.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc37fe640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc40c5640 0x7f7fc40711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc8ec7640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fc40c60f0 0x7f7fc41ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc3fff640 1 -- 172.21.15.28:0/4245149747 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fc40c60f0 msgr2=0x7f7fc41ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc3fff640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fc40c60f0 0x7f7fc41ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc3fff640 1 -- 172.21.15.28:0/4245149747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc40c5640 msgr2=0x7f7fc40711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc3fff640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc40c5640 0x7f7fc40711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc3fff640 1 -- 172.21.15.28:0/4245149747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb8009420 con 0x7f7fc40c5260 2023-12-16T03:25:16.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc3fff640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fc40c5260 0x7f7fc40a9870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400c3c0 tx=0x7f7fb400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:16.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc0ff9640 1 -- 172.21.15.28:0/4245149747 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40052d0 con 0x7f7fc40c5260 2023-12-16T03:25:16.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc0ff9640 1 -- 172.21.15.28:0/4245149747 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb4005430 con 0x7f7fc40c5260 2023-12-16T03:25:16.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc0ff9640 1 -- 172.21.15.28:0/4245149747 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4003840 con 0x7f7fc40c5260 2023-12-16T03:25:16.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fca92a640 1 -- 172.21.15.28:0/4245149747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc40a9db0 con 0x7f7fc40c5260 2023-12-16T03:25:16.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fca92a640 1 -- 172.21.15.28:0/4245149747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc41f0760 con 0x7f7fc40c5260 2023-12-16T03:25:16.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fca92a640 1 -- 172.21.15.28:0/4245149747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc4068400 con 0x7f7fc40c5260 2023-12-16T03:25:16.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.108+0000 7f7fc0ff9640 1 -- 172.21.15.28:0/4245149747 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7fb40039a0 con 0x7f7fc40c5260 2023-12-16T03:25:16.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.112+0000 7f7fc0ff9640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fb0066470 0x7f7fb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.112+0000 7f7fc0ff9640 1 -- 172.21.15.28:0/4245149747 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fb4083330 con 0x7f7fc40c5260 2023-12-16T03:25:16.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.112+0000 7f7fc37fe640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fb0066470 0x7f7fb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.112+0000 7f7fc37fe640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fb0066470 0x7f7fb0068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80ad000 tx=0x7f7fb80a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:16.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.116+0000 7f7fc0ff9640 1 -- 172.21.15.28:0/4245149747 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7fb4050850 con 0x7f7fc40c5260 2023-12-16T03:25:16.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.272+0000 7f7fca92a640 1 -- 172.21.15.28:0/4245149747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fc406d390 con 0x7f7fc40c5260 2023-12-16T03:25:16.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fc0ff9640 1 -- 172.21.15.28:0/4245149747 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16518 (secure 0 0 0) 0x7f7fb4053e70 con 0x7f7fc40c5260 2023-12-16T03:25:16.277 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:16.277 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":19,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:15.321155+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:16.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 -- 172.21.15.28:0/4245149747 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fb0066470 msgr2=0x7f7fb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fb0066470 0x7f7fb0068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80ad000 tx=0x7f7fb80a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:16.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 -- 172.21.15.28:0/4245149747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fc40c5260 msgr2=0x7f7fc40a9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fc40c5260 0x7f7fc40a9870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400c3c0 tx=0x7f7fb400c880 comp rx=0 tx=0).stop 2023-12-16T03:25:16.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 -- 172.21.15.28:0/4245149747 shutdown_connections 2023-12-16T03:25:16.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fc40c60f0 0x7f7fc41ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc40c5640 0x7f7fc40711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fb0066470 0x7f7fb0068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 --2- 172.21.15.28:0/4245149747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7fc40c5260 0x7f7fc40a9870 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 -- 172.21.15.28:0/4245149747 >> 172.21.15.28:0/4245149747 conn(0x7f7fc406a5b0 msgr2=0x7f7fc41541a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:16.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 -- 172.21.15.28:0/4245149747 shutdown_connections 2023-12-16T03:25:16.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.276+0000 7f7fca92a640 1 -- 172.21.15.28:0/4245149747 wait complete. 2023-12-16T03:25:16.298 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:16.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f874bac9640 1 Processor -- start 2023-12-16T03:25:16.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f874bac9640 1 -- start start 2023-12-16T03:25:16.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f874bac9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8744151e90 0x7f87440c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f874bac9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 0x7f874406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f874bac9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874406c860 con 0x7f87440c4e60 2023-12-16T03:25:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f874bac9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87440c8750 con 0x7f8744151e90 2023-12-16T03:25:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f874bac9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87441552d0 con 0x7f87440c7ea0 2023-12-16T03:25:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f874a066640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f87440c4e60 0x7f874406b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45246/0 (socket says 172.21.15.28:45246) 2023-12-16T03:25:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f874a066640 1 -- 172.21.15.28:0/1049127304 learned_addr learned my addr 172.21.15.28:0/1049127304 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f8749865640 1 --2- 172.21.15.28:0/1049127304 >> v2:172.21.15.134:3300/0 conn(0x7f8744151e90 0x7f87440c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f8749064640 1 --2- 172.21.15.28:0/1049127304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 0x7f874406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f8748863640 1 -- 172.21.15.28:0/1049127304 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538737551 0 0) 0x7f874406c860 con 0x7f87440c4e60 2023-12-16T03:25:16.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f8748863640 1 -- 172.21.15.28:0/1049127304 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8730003530 con 0x7f87440c4e60 2023-12-16T03:25:16.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f8749064640 1 -- 172.21.15.28:0/1049127304 >> v2:172.21.15.134:3300/0 conn(0x7f8744151e90 msgr2=0x7f87440c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:16.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f8749064640 1 --2- 172.21.15.28:0/1049127304 >> v2:172.21.15.134:3300/0 conn(0x7f8744151e90 0x7f87440c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f8749064640 1 -- 172.21.15.28:0/1049127304 >> v1:172.21.15.28:6789/0 conn(0x7f87440c4e60 legacy=0x7f874406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f8749064640 1 -- 172.21.15.28:0/1049127304 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744154930 con 0x7f87440c7ea0 2023-12-16T03:25:16.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.444+0000 7f8749865640 1 --2- 172.21.15.28:0/1049127304 >> v2:172.21.15.134:3300/0 conn(0x7f8744151e90 0x7f87440c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:16.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f8749064640 1 --2- 172.21.15.28:0/1049127304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 0x7f874406b4a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f87340097c0 tx=0x7f873401c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0fe642d76cf5275 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f8748863640 1 -- 172.21.15.28:0/1049127304 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87340ab600 con 0x7f87440c7ea0 2023-12-16T03:25:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f8748863640 1 -- 172.21.15.28:0/1049127304 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87340a7050 con 0x7f87440c7ea0 2023-12-16T03:25:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f8748863640 1 -- 172.21.15.28:0/1049127304 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87340ab980 con 0x7f87440c7ea0 2023-12-16T03:25:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f874bac9640 1 -- 172.21.15.28:0/1049127304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 msgr2=0x7f874406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f874bac9640 1 --2- 172.21.15.28:0/1049127304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 0x7f874406b4a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f87340097c0 tx=0x7f873401c360 comp rx=0 tx=0).stop 2023-12-16T03:25:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f874bac9640 1 -- 172.21.15.28:0/1049127304 shutdown_connections 2023-12-16T03:25:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f874bac9640 1 --2- 172.21.15.28:0/1049127304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 0x7f874406b4a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f874bac9640 1 --2- 172.21.15.28:0/1049127304 >> v2:172.21.15.134:3300/0 conn(0x7f8744151e90 0x7f87440c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f874bac9640 1 -- 172.21.15.28:0/1049127304 >> 172.21.15.28:0/1049127304 conn(0x7f87440ca170 msgr2=0x7f87440ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f874bac9640 1 -- 172.21.15.28:0/1049127304 shutdown_connections 2023-12-16T03:25:16.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.448+0000 7f874bac9640 1 -- 172.21.15.28:0/1049127304 wait complete. 2023-12-16T03:25:16.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874bac9640 1 Processor -- start 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874bac9640 1 -- start start 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874bac9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87440c4e60 0x7f87441f0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874bac9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 0x7f874414a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874bac9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8744151e90 0x7f8744145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874bac9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874414e490 con 0x7f8744151e90 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874bac9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874414e770 con 0x7f87440c4e60 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874bac9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874414ea50 con 0x7f87440c7ea0 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874a066640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8744151e90 0x7f8744145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874a066640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8744151e90 0x7f8744145f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60570/0 (socket says 172.21.15.28:60570) 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874a066640 1 -- 172.21.15.28:0/110200116 learned_addr learned my addr 172.21.15.28:0/110200116 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f8749865640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87440c4e60 0x7f87441f0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f8749064640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 0x7f874414a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874a066640 1 -- 172.21.15.28:0/110200116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 msgr2=0x7f874414a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874a066640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 0x7f874414a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874a066640 1 -- 172.21.15.28:0/110200116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87440c4e60 msgr2=0x7f87441f0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874a066640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87440c4e60 0x7f87441f0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874a066640 1 -- 172.21.15.28:0/110200116 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8740009420 con 0x7f8744151e90 2023-12-16T03:25:16.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f8749865640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87440c4e60 0x7f87441f0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:16.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f8749064640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 0x7f874414a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:16.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874a066640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8744151e90 0x7f8744145f50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f873c00caa0 tx=0x7f873c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:16.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f873a7fc640 1 -- 172.21.15.28:0/110200116 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00ac00 con 0x7f8744151e90 2023-12-16T03:25:16.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f873a7fc640 1 -- 172.21.15.28:0/110200116 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00ad60 con 0x7f8744151e90 2023-12-16T03:25:16.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f873a7fc640 1 -- 172.21.15.28:0/110200116 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c012620 con 0x7f8744151e90 2023-12-16T03:25:16.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874bac9640 1 -- 172.21.15.28:0/110200116 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8734009420 con 0x7f8744151e90 2023-12-16T03:25:16.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874bac9640 1 -- 172.21.15.28:0/110200116 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8744150f50 con 0x7f8744151e90 2023-12-16T03:25:16.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.452+0000 7f874bac9640 1 -- 172.21.15.28:0/110200116 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8744068400 con 0x7f8744151e90 2023-12-16T03:25:16.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.456+0000 7f873a7fc640 1 -- 172.21.15.28:0/110200116 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f873c007070 con 0x7f8744151e90 2023-12-16T03:25:16.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.456+0000 7f873a7fc640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8728066470 0x7f8728068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.456+0000 7f873a7fc640 1 -- 172.21.15.28:0/110200116 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f873c083e80 con 0x7f8744151e90 2023-12-16T03:25:16.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.456+0000 7f8749865640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8728066470 0x7f8728068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.456+0000 7f8749865640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8728066470 0x7f8728068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f87440af5a0 tx=0x7f8740008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:16.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.460+0000 7f873a7fc640 1 -- 172.21.15.28:0/110200116 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f873c0512f0 con 0x7f8744151e90 2023-12-16T03:25:16.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.620+0000 7f874bac9640 1 -- 172.21.15.28:0/110200116 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f874414e5d0 con 0x7f8744151e90 2023-12-16T03:25:16.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f873a7fc640 1 -- 172.21.15.28:0/110200116 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f874414e5d0 con 0x7f8744151e90 2023-12-16T03:25:16.625 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:16.625 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:16.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 -- 172.21.15.28:0/110200116 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8728066470 msgr2=0x7f8728068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8728066470 0x7f8728068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f87440af5a0 tx=0x7f8740008040 comp rx=0 tx=0).stop 2023-12-16T03:25:16.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 -- 172.21.15.28:0/110200116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8744151e90 msgr2=0x7f8744145f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8744151e90 0x7f8744145f50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f873c00caa0 tx=0x7f873c00cf60 comp rx=0 tx=0).stop 2023-12-16T03:25:16.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 -- 172.21.15.28:0/110200116 shutdown_connections 2023-12-16T03:25:16.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8728066470 0x7f8728068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8744151e90 0x7f8744145f50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f87440c7ea0 0x7f874414a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 --2- 172.21.15.28:0/110200116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87440c4e60 0x7f87441f0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 -- 172.21.15.28:0/110200116 >> 172.21.15.28:0/110200116 conn(0x7f87440ca170 msgr2=0x7f874414f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:16.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 -- 172.21.15.28:0/110200116 shutdown_connections 2023-12-16T03:25:16.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.624+0000 7f874bac9640 1 -- 172.21.15.28:0/110200116 wait complete. 2023-12-16T03:25:16.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-16T03:25:16.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.788+0000 7f0be1e5a640 1 Processor -- start 2023-12-16T03:25:16.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.788+0000 7f0be1e5a640 1 -- start start 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0be1e5a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bdc1578f0 0x7f0bdc0c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0be1e5a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0bdc0c2840 0x7f0bdc0c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0be1e5a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc157cd0 con 0x7f0bdc0a6c60 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0be1e5a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc0c2e00 con 0x7f0bdc0c2840 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0be1e5a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc158850 con 0x7f0bdc1578f0 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0bdbfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0bdc0c2840 0x7f0bdc0c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0bdbfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0bdc0c2840 0x7f0bdc0c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60574/0 (socket says 172.21.15.28:60574) 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0bdbfff640 1 -- 172.21.15.28:0/3435425015 learned_addr learned my addr 172.21.15.28:0/3435425015 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0bdaffd640 1 --1- 172.21.15.28:0/3435425015 >> v1:172.21.15.28:6789/0 conn(0x7f0bdc0a6c60 0x7f0bdc0c1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45258/0 (socket says 172.21.15.28:45258) 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0bdb7fe640 1 --2- 172.21.15.28:0/3435425015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bdc1578f0 0x7f0bdc0c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0bdbfff640 1 -- 172.21.15.28:0/3435425015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bdc1578f0 msgr2=0x7f0bdc0c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0bdbfff640 1 --2- 172.21.15.28:0/3435425015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bdc1578f0 0x7f0bdc0c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0bdbfff640 1 -- 172.21.15.28:0/3435425015 >> v1:172.21.15.28:6789/0 conn(0x7f0bdc0a6c60 legacy=0x7f0bdc0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.792+0000 7f0bdbfff640 1 -- 172.21.15.28:0/3435425015 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc157f20 con 0x7f0bdc0c2840 2023-12-16T03:25:16.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0bdbfff640 1 --2- 172.21.15.28:0/3435425015 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bdc0c2840 0x7f0bdc0c3620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009e50 tx=0x7f0bd401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ab3ffd3942015e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:16.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0bda7fc640 1 -- 172.21.15.28:0/3435425015 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40a5750 con 0x7f0bdc0c2840 2023-12-16T03:25:16.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0bda7fc640 1 -- 172.21.15.28:0/3435425015 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd40a58b0 con 0x7f0bdc0c2840 2023-12-16T03:25:16.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0bda7fc640 1 -- 172.21.15.28:0/3435425015 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40a5c40 con 0x7f0bdc0c2840 2023-12-16T03:25:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0be1e5a640 1 -- 172.21.15.28:0/3435425015 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bdc0c2840 msgr2=0x7f0bdc0c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0be1e5a640 1 --2- 172.21.15.28:0/3435425015 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bdc0c2840 0x7f0bdc0c3620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009e50 tx=0x7f0bd401c980 comp rx=0 tx=0).stop 2023-12-16T03:25:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0be1e5a640 1 -- 172.21.15.28:0/3435425015 shutdown_connections 2023-12-16T03:25:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0be1e5a640 1 --2- 172.21.15.28:0/3435425015 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bdc0c2840 0x7f0bdc0c3620 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0be1e5a640 1 --2- 172.21.15.28:0/3435425015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bdc1578f0 0x7f0bdc0c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0be1e5a640 1 -- 172.21.15.28:0/3435425015 >> 172.21.15.28:0/3435425015 conn(0x7f0bdc0c7e40 msgr2=0x7f0bdc0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0be1e5a640 1 -- 172.21.15.28:0/3435425015 shutdown_connections 2023-12-16T03:25:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0be1e5a640 1 -- 172.21.15.28:0/3435425015 wait complete. 2023-12-16T03:25:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0be1e5a640 1 Processor -- start 2023-12-16T03:25:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.796+0000 7f0be1e5a640 1 -- start start 2023-12-16T03:25:16.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0be1e5a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bdc0a6c60 0x7f0bdc156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0be1e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bdc0c2840 0x7f0bdc1f0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0be1e5a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bdc1578f0 0x7f0bdc1f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0be1e5a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc1535c0 con 0x7f0bdc0c2840 2023-12-16T03:25:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0be1e5a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc152d50 con 0x7f0bdc1578f0 2023-12-16T03:25:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0be1e5a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc1f13b0 con 0x7f0bdc0a6c60 2023-12-16T03:25:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bdaffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bdc0c2840 0x7f0bdc1f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bdaffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bdc0c2840 0x7f0bdc1f0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60588/0 (socket says 172.21.15.28:60588) 2023-12-16T03:25:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bdaffd640 1 -- 172.21.15.28:0/1626670229 learned_addr learned my addr 172.21.15.28:0/1626670229 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bdb7fe640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bdc0a6c60 0x7f0bdc156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bdbfff640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bdc1578f0 0x7f0bdc1f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bdaffd640 1 -- 172.21.15.28:0/1626670229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bdc0a6c60 msgr2=0x7f0bdc156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bdaffd640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bdc0a6c60 0x7f0bdc156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bdaffd640 1 -- 172.21.15.28:0/1626670229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bdc1578f0 msgr2=0x7f0bdc1f0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bdaffd640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bdc1578f0 0x7f0bdc1f0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bdaffd640 1 -- 172.21.15.28:0/1626670229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4009b30 con 0x7f0bdc0c2840 2023-12-16T03:25:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bdaffd640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bdc0c2840 0x7f0bdc1f0800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000c500 tx=0x7f0bd000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bc3fff640 1 -- 172.21.15.28:0/1626670229 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00074e0 con 0x7f0bdc0c2840 2023-12-16T03:25:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bc3fff640 1 -- 172.21.15.28:0/1626670229 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd0007640 con 0x7f0bdc0c2840 2023-12-16T03:25:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bc3fff640 1 -- 172.21.15.28:0/1626670229 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00049f0 con 0x7f0bdc0c2840 2023-12-16T03:25:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0be1e5a640 1 -- 172.21.15.28:0/1626670229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc153270 con 0x7f0bdc0c2840 2023-12-16T03:25:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0be1e5a640 1 -- 172.21.15.28:0/1626670229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc1539d0 con 0x7f0bdc0c2840 2023-12-16T03:25:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0be1e5a640 1 -- 172.21.15.28:0/1626670229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc0c7c10 con 0x7f0bdc0c2840 2023-12-16T03:25:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bc3fff640 1 -- 172.21.15.28:0/1626670229 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0bd0004b50 con 0x7f0bdc0c2840 2023-12-16T03:25:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.800+0000 7f0bc3fff640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0bc8066470 0x7f0bc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.804+0000 7f0bc3fff640 1 -- 172.21.15.28:0/1626670229 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bd00838b0 con 0x7f0bdc0c2840 2023-12-16T03:25:16.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.804+0000 7f0bdb7fe640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0bc8066470 0x7f0bc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:16.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.804+0000 7f0bdb7fe640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0bc8066470 0x7f0bc8068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc15ef70 tx=0x7f0bcc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:16.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.804+0000 7f0bc3fff640 1 -- 172.21.15.28:0/1626670229 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0bd0050d40 con 0x7f0bdc0c2840 2023-12-16T03:25:16.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:16.996+0000 7f0be1e5a640 1 -- 172.21.15.28:0/1626670229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0bdc1ed2c0 con 0x7f0bdc0c2840 2023-12-16T03:25:17.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.940+0000 7f0bc3fff640 1 -- 172.21.15.28:0/1626670229 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0bd0054360 con 0x7f0bdc0c2840 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 -- 172.21.15.28:0/1626670229 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0bc8066470 msgr2=0x7f0bc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0bc8066470 0x7f0bc8068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc15ef70 tx=0x7f0bcc008040 comp rx=0 tx=0).stop 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 -- 172.21.15.28:0/1626670229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bdc0c2840 msgr2=0x7f0bdc1f0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bdc0c2840 0x7f0bdc1f0800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000c500 tx=0x7f0bd000c9c0 comp rx=0 tx=0).stop 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 -- 172.21.15.28:0/1626670229 shutdown_connections 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bdc1578f0 0x7f0bdc1f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0bc8066470 0x7f0bc8068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bdc0c2840 0x7f0bdc1f0800 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 --2- 172.21.15.28:0/1626670229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0bdc0a6c60 0x7f0bdc156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 -- 172.21.15.28:0/1626670229 >> 172.21.15.28:0/1626670229 conn(0x7f0bdc0c7e40 msgr2=0x7f0bdc06bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 -- 172.21.15.28:0/1626670229 shutdown_connections 2023-12-16T03:25:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:17.944+0000 7f0be1e5a640 1 -- 172.21.15.28:0/1626670229 wait complete. 2023-12-16T03:25:17.968 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-16T03:25:17.968 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-16T03:25:18.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.116+0000 7f1977980640 1 Processor -- start 2023-12-16T03:25:18.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.116+0000 7f1977980640 1 -- start start 2023-12-16T03:25:18.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1977980640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f19700c7ea0 0x7f197006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:18.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1977980640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f197006b9e0 0x7f197015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:18.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1977980640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197006c860 con 0x7f1970151e90 2023-12-16T03:25:18.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1977980640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19700c8750 con 0x7f19700c7ea0 2023-12-16T03:25:18.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1977980640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19701552d0 con 0x7f197006b9e0 2023-12-16T03:25:18.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1974f1b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f19700c7ea0 0x7f197006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:18.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1974f1b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f19700c7ea0 0x7f197006b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60592/0 (socket says 172.21.15.28:60592) 2023-12-16T03:25:18.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1974f1b640 1 -- 172.21.15.28:0/4269629046 learned_addr learned my addr 172.21.15.28:0/4269629046 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:18.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1974f1b640 1 -- 172.21.15.28:0/4269629046 >> v2:172.21.15.134:3300/0 conn(0x7f197006b9e0 msgr2=0x7f197015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:18.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1974f1b640 1 --2- 172.21.15.28:0/4269629046 >> v2:172.21.15.134:3300/0 conn(0x7f197006b9e0 0x7f197015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:18.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1974f1b640 1 -- 172.21.15.28:0/4269629046 >> v1:172.21.15.134:6789/0 conn(0x7f1970151e90 legacy=0x7f19700c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:18.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1974f1b640 1 -- 172.21.15.28:0/4269629046 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1970154930 con 0x7f19700c7ea0 2023-12-16T03:25:18.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1974f1b640 1 --2- 172.21.15.28:0/4269629046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19700c7ea0 0x7f197006b4a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f197008c190 tx=0x7f196001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d3300fbea67cee server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:18.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.120+0000 7f1967fff640 1 -- 172.21.15.28:0/4269629046 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19600ab600 con 0x7f19700c7ea0 2023-12-16T03:25:18.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1967fff640 1 -- 172.21.15.28:0/4269629046 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19600a7050 con 0x7f19700c7ea0 2023-12-16T03:25:18.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1967fff640 1 -- 172.21.15.28:0/4269629046 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19600ab980 con 0x7f19700c7ea0 2023-12-16T03:25:18.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 -- 172.21.15.28:0/4269629046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19700c7ea0 msgr2=0x7f197006b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:18.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 --2- 172.21.15.28:0/4269629046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19700c7ea0 0x7f197006b4a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f197008c190 tx=0x7f196001c3a0 comp rx=0 tx=0).stop 2023-12-16T03:25:18.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 -- 172.21.15.28:0/4269629046 shutdown_connections 2023-12-16T03:25:18.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 --2- 172.21.15.28:0/4269629046 >> v2:172.21.15.134:3300/0 conn(0x7f197006b9e0 0x7f197015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:18.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 --2- 172.21.15.28:0/4269629046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19700c7ea0 0x7f197006b4a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:18.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 -- 172.21.15.28:0/4269629046 >> 172.21.15.28:0/4269629046 conn(0x7f19700ca170 msgr2=0x7f19700ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:18.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 -- 172.21.15.28:0/4269629046 shutdown_connections 2023-12-16T03:25:18.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 -- 172.21.15.28:0/4269629046 wait complete. 2023-12-16T03:25:18.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 Processor -- start 2023-12-16T03:25:18.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 -- start start 2023-12-16T03:25:18.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197006b9e0 0x7f197014b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:18.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19700c7ea0 0x7f19701ece80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:18.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1970151e90 0x7f19701ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:18.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19701ed900 con 0x7f19700c7ea0 2023-12-16T03:25:18.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19701f0d00 con 0x7f197006b9e0 2023-12-16T03:25:18.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1977980640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19701f03f0 con 0x7f1970151e90 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1974f1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19700c7ea0 0x7f19701ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1974f1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19700c7ea0 0x7f19701ece80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60598/0 (socket says 172.21.15.28:60598) 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.124+0000 7f1974f1b640 1 -- 172.21.15.28:0/1956915449 learned_addr learned my addr 172.21.15.28:0/1956915449 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1974f1b640 1 -- 172.21.15.28:0/1956915449 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1970151e90 msgr2=0x7f19701ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1974f1b640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1970151e90 0x7f19701ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1974f1b640 1 -- 172.21.15.28:0/1956915449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197006b9e0 msgr2=0x7f197014b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f197571c640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197006b9e0 0x7f197014b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1974f1b640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197006b9e0 0x7f197014b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1974f1b640 1 -- 172.21.15.28:0/1956915449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19600094d0 con 0x7f19700c7ea0 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f197571c640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197006b9e0 0x7f197014b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1974f1b640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19700c7ea0 0x7f19701ece80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19600ae040 tx=0x7f196001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1965ffb640 1 -- 172.21.15.28:0/1956915449 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19600b6620 con 0x7f19700c7ea0 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1965ffb640 1 -- 172.21.15.28:0/1956915449 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19600b67a0 con 0x7f19700c7ea0 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1977980640 1 -- 172.21.15.28:0/1956915449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197014f000 con 0x7f19700c7ea0 2023-12-16T03:25:18.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1965ffb640 1 -- 172.21.15.28:0/1956915449 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19600b6b50 con 0x7f19700c7ea0 2023-12-16T03:25:18.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1977980640 1 -- 172.21.15.28:0/1956915449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19701f0990 con 0x7f19700c7ea0 2023-12-16T03:25:18.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1977980640 1 -- 172.21.15.28:0/1956915449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19701f0e90 con 0x7f19700c7ea0 2023-12-16T03:25:18.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1965ffb640 1 -- 172.21.15.28:0/1956915449 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f19600b2040 con 0x7f19700c7ea0 2023-12-16T03:25:18.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1965ffb640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19540664a0 0x7f1954068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:18.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.128+0000 7f1965ffb640 1 -- 172.21.15.28:0/1956915449 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f196011e2f0 con 0x7f19700c7ea0 2023-12-16T03:25:18.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.132+0000 7f197571c640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19540664a0 0x7f1954068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:18.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.132+0000 7f197571c640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19540664a0 0x7f1954068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f196c003e40 tx=0x7f196c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.132+0000 7f1965ffb640 1 -- 172.21.15.28:0/1956915449 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f19600eb800 con 0x7f19700c7ea0 2023-12-16T03:25:18.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.324+0000 7f1977980640 1 -- 172.21.15.28:0/1956915449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1970068400 con 0x7f19700c7ea0 2023-12-16T03:25:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.940+0000 7f1965ffb640 1 -- 172.21.15.28:0/1956915449 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f19600eee20 con 0x7f19700c7ea0 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 -- 172.21.15.28:0/1956915449 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19540664a0 msgr2=0x7f1954068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19540664a0 0x7f1954068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f196c003e40 tx=0x7f196c009040 comp rx=0 tx=0).stop 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 -- 172.21.15.28:0/1956915449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19700c7ea0 msgr2=0x7f19701ece80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19700c7ea0 0x7f19701ece80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19600ae040 tx=0x7f196001abe0 comp rx=0 tx=0).stop 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 -- 172.21.15.28:0/1956915449 shutdown_connections 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1970151e90 0x7f19701ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19540664a0 0x7f1954068960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19700c7ea0 0x7f19701ece80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 --2- 172.21.15.28:0/1956915449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f197006b9e0 0x7f197014b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 -- 172.21.15.28:0/1956915449 >> 172.21.15.28:0/1956915449 conn(0x7f19700ca170 msgr2=0x7f1970148dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 -- 172.21.15.28:0/1956915449 shutdown_connections 2023-12-16T03:25:18.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:18.944+0000 7f1977980640 1 -- 172.21.15.28:0/1956915449 wait complete. 2023-12-16T03:25:18.970 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-16T03:25:18.971 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:25:19.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.116+0000 7f3bcbd55640 1 Processor -- start 2023-12-16T03:25:19.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.116+0000 7f3bcbd55640 1 -- start start 2023-12-16T03:25:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.116+0000 7f3bcbd55640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3bc40c63c0 0x7f3bc40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.116+0000 7f3bcbd55640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3bc40c4100 0x7f3bc40c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.116+0000 7f3bcbd55640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc40c31c0 con 0x7f3bc40c29e0 2023-12-16T03:25:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.116+0000 7f3bcbd55640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc40c34a0 con 0x7f3bc40c63c0 2023-12-16T03:25:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.116+0000 7f3bcbd55640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc40c1030 con 0x7f3bc40c4100 2023-12-16T03:25:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.120+0000 7f3bc9af1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3bc40c63c0 0x7f3bc40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.120+0000 7f3bc9af1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3bc40c63c0 0x7f3bc40c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60602/0 (socket says 172.21.15.28:60602) 2023-12-16T03:25:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.120+0000 7f3bc9af1640 1 -- 172.21.15.28:0/7689100 learned_addr learned my addr 172.21.15.28:0/7689100 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.120+0000 7f3bc9af1640 1 -- 172.21.15.28:0/7689100 >> v2:172.21.15.134:3300/0 conn(0x7f3bc40c4100 msgr2=0x7f3bc40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.120+0000 7f3bc9af1640 1 --2- 172.21.15.28:0/7689100 >> v2:172.21.15.134:3300/0 conn(0x7f3bc40c4100 0x7f3bc40c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.120+0000 7f3bc9af1640 1 -- 172.21.15.28:0/7689100 >> v1:172.21.15.134:6789/0 conn(0x7f3bc40c29e0 legacy=0x7f3bc40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:19.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.120+0000 7f3bc9af1640 1 -- 172.21.15.28:0/7689100 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc40c1310 con 0x7f3bc40c63c0 2023-12-16T03:25:19.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.120+0000 7f3bc9af1640 1 --2- 172.21.15.28:0/7689100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3bc40c63c0 0x7f3bc40c06d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40a8b40 tx=0x7f3bc001ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cd48aec78ba432 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:19.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.120+0000 7f3bc8aef640 1 -- 172.21.15.28:0/7689100 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc00a7a30 con 0x7f3bc40c63c0 2023-12-16T03:25:19.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.120+0000 7f3bc8aef640 1 -- 172.21.15.28:0/7689100 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc00a7b90 con 0x7f3bc40c63c0 2023-12-16T03:25:19.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.120+0000 7f3bc8aef640 1 -- 172.21.15.28:0/7689100 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc00af440 con 0x7f3bc40c63c0 2023-12-16T03:25:19.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 -- 172.21.15.28:0/7689100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3bc40c63c0 msgr2=0x7f3bc40c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 --2- 172.21.15.28:0/7689100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3bc40c63c0 0x7f3bc40c06d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40a8b40 tx=0x7f3bc001ea40 comp rx=0 tx=0).stop 2023-12-16T03:25:19.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 -- 172.21.15.28:0/7689100 shutdown_connections 2023-12-16T03:25:19.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 --2- 172.21.15.28:0/7689100 >> v2:172.21.15.134:3300/0 conn(0x7f3bc40c4100 0x7f3bc40c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 --2- 172.21.15.28:0/7689100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3bc40c63c0 0x7f3bc40c06d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 -- 172.21.15.28:0/7689100 >> 172.21.15.28:0/7689100 conn(0x7f3bc406a5b0 msgr2=0x7f3bc406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:19.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 -- 172.21.15.28:0/7689100 shutdown_connections 2023-12-16T03:25:19.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 -- 172.21.15.28:0/7689100 wait complete. 2023-12-16T03:25:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 Processor -- start 2023-12-16T03:25:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 -- start start 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bc40c29e0 0x7f3bc41f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3bc40c4100 0x7f3bc4158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bc40c63c0 0x7f3bc4155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc4099ca0 con 0x7f3bc40c4100 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc41f1840 con 0x7f3bc40c29e0 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bcbd55640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc41ed890 con 0x7f3bc40c63c0 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bc92f0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3bc40c4100 0x7f3bc4158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bc92f0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3bc40c4100 0x7f3bc4158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60614/0 (socket says 172.21.15.28:60614) 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bc92f0640 1 -- 172.21.15.28:0/2372675698 learned_addr learned my addr 172.21.15.28:0/2372675698 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bc9af1640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bc40c29e0 0x7f3bc41f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bc92f0640 1 -- 172.21.15.28:0/2372675698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bc40c63c0 msgr2=0x7f3bc4155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bca2f2640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bc40c63c0 0x7f3bc4155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bc92f0640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bc40c63c0 0x7f3bc4155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bc92f0640 1 -- 172.21.15.28:0/2372675698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bc40c29e0 msgr2=0x7f3bc41f1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bc92f0640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bc40c29e0 0x7f3bc41f1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bc92f0640 1 -- 172.21.15.28:0/2372675698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc000b770 con 0x7f3bc40c4100 2023-12-16T03:25:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bc9af1640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bc40c29e0 0x7f3bc41f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bca2f2640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bc40c63c0 0x7f3bc4155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.124+0000 7f3bc92f0640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3bc40c4100 0x7f3bc4158fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400b550 tx=0x7f3bb400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.128+0000 7f3bba7fc640 1 -- 172.21.15.28:0/2372675698 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4010870 con 0x7f3bc40c4100 2023-12-16T03:25:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.128+0000 7f3bba7fc640 1 -- 172.21.15.28:0/2372675698 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb40109f0 con 0x7f3bc40c4100 2023-12-16T03:25:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.128+0000 7f3bba7fc640 1 -- 172.21.15.28:0/2372675698 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4010da0 con 0x7f3bc40c4100 2023-12-16T03:25:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.128+0000 7f3bcbd55640 1 -- 172.21.15.28:0/2372675698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc4159520 con 0x7f3bc40c4100 2023-12-16T03:25:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.128+0000 7f3bcbd55640 1 -- 172.21.15.28:0/2372675698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc4158810 con 0x7f3bc40c4100 2023-12-16T03:25:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.128+0000 7f3bcbd55640 1 -- 172.21.15.28:0/2372675698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc4068400 con 0x7f3bc40c4100 2023-12-16T03:25:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.128+0000 7f3bba7fc640 1 -- 172.21.15.28:0/2372675698 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3bb400f3c0 con 0x7f3bc40c4100 2023-12-16T03:25:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.128+0000 7f3bba7fc640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ba80664a0 0x7f3ba8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.128+0000 7f3bba7fc640 1 -- 172.21.15.28:0/2372675698 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bb4083ef0 con 0x7f3bc40c4100 2023-12-16T03:25:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.128+0000 7f3bc9af1640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ba80664a0 0x7f3ba8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.128+0000 7f3bc9af1640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ba80664a0 0x7f3ba8068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00b1000 tx=0x7f3bc0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:19.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.132+0000 7f3bba7fc640 1 -- 172.21.15.28:0/2372675698 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3bb4051360 con 0x7f3bc40c4100 2023-12-16T03:25:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.320+0000 7f3bcbd55640 1 -- 172.21.15.28:0/2372675698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bc41ed9d0 con 0x7f3bc40c4100 2023-12-16T03:25:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.320+0000 7f3bba7fc640 1 -- 172.21.15.28:0/2372675698 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f3bb4054980 con 0x7f3bc40c4100 2023-12-16T03:25:19.324 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:19.324 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/2517100030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2517100030},{"type":"v1","addr":"172.21.15.134:6835","nonce":2517100030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/146686059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":146686059},{"type":"v1","addr":"172.21.15.28:6836","nonce":146686059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1280024314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1280024314},{"type":"v1","addr":"172.21.15.28:6837","nonce":1280024314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:25:15.321507+0000","modified":"2023-12-16T03:25:18.328454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/199412786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":199412786},{"type":"v1","addr":"172.21.15.134:6834","nonce":199412786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T03:25:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-12-16T03:25:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 -- 172.21.15.28:0/2372675698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ba80664a0 msgr2=0x7f3ba8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ba80664a0 0x7f3ba8068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00b1000 tx=0x7f3bc0008040 comp rx=0 tx=0).stop 2023-12-16T03:25:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 -- 172.21.15.28:0/2372675698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3bc40c4100 msgr2=0x7f3bc4158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3bc40c4100 0x7f3bc4158fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400b550 tx=0x7f3bb400ba10 comp rx=0 tx=0).stop 2023-12-16T03:25:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 -- 172.21.15.28:0/2372675698 shutdown_connections 2023-12-16T03:25:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3bc40c63c0 0x7f3bc4155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ba80664a0 0x7f3ba8068960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3bc40c4100 0x7f3bc4158fe0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 --2- 172.21.15.28:0/2372675698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bc40c29e0 0x7f3bc41f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 -- 172.21.15.28:0/2372675698 >> 172.21.15.28:0/2372675698 conn(0x7f3bc406a5b0 msgr2=0x7f3bc4152b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 -- 172.21.15.28:0/2372675698 shutdown_connections 2023-12-16T03:25:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.324+0000 7f3bcbd55640 1 -- 172.21.15.28:0/2372675698 wait complete. 2023-12-16T03:25:19.345 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:19.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.484+0000 7fa714757640 1 Processor -- start 2023-12-16T03:25:19.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.484+0000 7fa714757640 1 -- start start 2023-12-16T03:25:19.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa714757640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa70c151e90 0x7fa70c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa714757640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa70c0c7ea0 0x7fa70c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa714757640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa70c0c4e60 0x7fa70c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa714757640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70c0c8750 con 0x7fa70c151e90 2023-12-16T03:25:19.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa714757640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70c1552d0 con 0x7fa70c0c4e60 2023-12-16T03:25:19.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa714757640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0c5c60 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa7124f3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa70c151e90 0x7fa70c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa7124f3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa70c151e90 0x7fa70c0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60630/0 (socket says 172.21.15.28:60630) 2023-12-16T03:25:19.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa7124f3640 1 -- 172.21.15.28:0/1609517146 learned_addr learned my addr 172.21.15.28:0/1609517146 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:19.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa711cf2640 1 --2- 172.21.15.28:0/1609517146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa70c0c7ea0 0x7fa70c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa712cf4640 1 --2- 172.21.15.28:0/1609517146 >> v2:172.21.15.134:3300/0 conn(0x7fa70c0c4e60 0x7fa70c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa7124f3640 1 -- 172.21.15.28:0/1609517146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa70c0c7ea0 msgr2=0x7fa70c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:19.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa7124f3640 1 --2- 172.21.15.28:0/1609517146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa70c0c7ea0 0x7fa70c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa7124f3640 1 -- 172.21.15.28:0/1609517146 >> v2:172.21.15.134:3300/0 conn(0x7fa70c0c4e60 msgr2=0x7fa70c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:19.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa7124f3640 1 --2- 172.21.15.28:0/1609517146 >> v2:172.21.15.134:3300/0 conn(0x7fa70c0c4e60 0x7fa70c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.488+0000 7fa7124f3640 1 -- 172.21.15.28:0/1609517146 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c06c860 con 0x7fa70c151e90 2023-12-16T03:25:19.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa7124f3640 1 --2- 172.21.15.28:0/1609517146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa70c151e90 0x7fa70c0c4920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0bd660 tx=0x7fa70801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1aeb851e4d65337 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:19.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa7114f1640 1 -- 172.21.15.28:0/1609517146 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080ab600 con 0x7fa70c151e90 2023-12-16T03:25:19.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa7114f1640 1 -- 172.21.15.28:0/1609517146 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7080a7050 con 0x7fa70c151e90 2023-12-16T03:25:19.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa7114f1640 1 -- 172.21.15.28:0/1609517146 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080ab980 con 0x7fa70c151e90 2023-12-16T03:25:19.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa714757640 1 -- 172.21.15.28:0/1609517146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa70c151e90 msgr2=0x7fa70c0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa714757640 1 --2- 172.21.15.28:0/1609517146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa70c151e90 0x7fa70c0c4920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0bd660 tx=0x7fa70801c3e0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa714757640 1 -- 172.21.15.28:0/1609517146 shutdown_connections 2023-12-16T03:25:19.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa714757640 1 --2- 172.21.15.28:0/1609517146 >> v2:172.21.15.134:3300/0 conn(0x7fa70c0c4e60 0x7fa70c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa714757640 1 --2- 172.21.15.28:0/1609517146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa70c0c7ea0 0x7fa70c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa714757640 1 --2- 172.21.15.28:0/1609517146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa70c151e90 0x7fa70c0c4920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa714757640 1 -- 172.21.15.28:0/1609517146 >> 172.21.15.28:0/1609517146 conn(0x7fa70c0ca170 msgr2=0x7fa70c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:19.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa714757640 1 -- 172.21.15.28:0/1609517146 shutdown_connections 2023-12-16T03:25:19.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa714757640 1 -- 172.21.15.28:0/1609517146 wait complete. 2023-12-16T03:25:19.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa714757640 1 Processor -- start 2023-12-16T03:25:19.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.492+0000 7fa714757640 1 -- start start 2023-12-16T03:25:19.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa714757640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa70c0c4e60 0x7fa70c0bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa714757640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa70c0c7ea0 0x7fa70c0c0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa714757640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa70c151e90 0x7fa70c1f0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa714757640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0afbd0 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa714757640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0bdb50 con 0x7fa70c151e90 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa714757640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0bef20 con 0x7fa70c0c4e60 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa711cf2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa70c0c7ea0 0x7fa70c0c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa711cf2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa70c0c7ea0 0x7fa70c0c0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60646/0 (socket says 172.21.15.28:60646) 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa711cf2640 1 -- 172.21.15.28:0/746638195 learned_addr learned my addr 172.21.15.28:0/746638195 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa711cf2640 1 -- 172.21.15.28:0/746638195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa70c0c4e60 msgr2=0x7fa70c0bffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa711cf2640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa70c0c4e60 0x7fa70c0bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa711cf2640 1 -- 172.21.15.28:0/746638195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa70c151e90 msgr2=0x7fa70c1f0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa711cf2640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa70c151e90 0x7fa70c1f0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa711cf2640 1 -- 172.21.15.28:0/746638195 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7080094d0 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa711cf2640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa70c0c7ea0 0x7fa70c0c0520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00e870 tx=0x7fa6fc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa702ffd640 1 -- 172.21.15.28:0/746638195 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc009510 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa702ffd640 1 -- 172.21.15.28:0/746638195 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc00ee60 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa714757640 1 -- 172.21.15.28:0/746638195 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70c0bdfe0 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa702ffd640 1 -- 172.21.15.28:0/746638195 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc00cb80 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa714757640 1 -- 172.21.15.28:0/746638195 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c0af610 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa714757640 1 -- 172.21.15.28:0/746638195 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70c068400 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.496+0000 7fa702ffd640 1 -- 172.21.15.28:0/746638195 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa6fc00cce0 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.500+0000 7fa702ffd640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa6f00664a0 0x7fa6f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.500+0000 7fa702ffd640 1 -- 172.21.15.28:0/746638195 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6fc083f30 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.500+0000 7fa7124f3640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa6f00664a0 0x7fa6f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.500+0000 7fa7124f3640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa6f00664a0 0x7fa6f0068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa7080ad000 tx=0x7fa708008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.504+0000 7fa702ffd640 1 -- 172.21.15.28:0/746638195 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa6fc051310 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.664+0000 7fa714757640 1 -- 172.21.15.28:0/746638195 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa70c0bd920 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.664+0000 7fa702ffd640 1 -- 172.21.15.28:0/746638195 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fa6fc059e60 con 0x7fa70c0c7ea0 2023-12-16T03:25:19.668 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:19.668 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:19.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 -- 172.21.15.28:0/746638195 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa6f00664a0 msgr2=0x7fa6f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa6f00664a0 0x7fa6f0068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa7080ad000 tx=0x7fa708008040 comp rx=0 tx=0).stop 2023-12-16T03:25:19.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 -- 172.21.15.28:0/746638195 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa70c0c7ea0 msgr2=0x7fa70c0c0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa70c0c7ea0 0x7fa70c0c0520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00e870 tx=0x7fa6fc00ec70 comp rx=0 tx=0).stop 2023-12-16T03:25:19.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 -- 172.21.15.28:0/746638195 shutdown_connections 2023-12-16T03:25:19.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa70c151e90 0x7fa70c1f0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa6f00664a0 0x7fa6f0068960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa70c0c7ea0 0x7fa70c0c0520 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 --2- 172.21.15.28:0/746638195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa70c0c4e60 0x7fa70c0bffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 -- 172.21.15.28:0/746638195 >> 172.21.15.28:0/746638195 conn(0x7fa70c0ca170 msgr2=0x7fa70c0c6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:19.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 -- 172.21.15.28:0/746638195 shutdown_connections 2023-12-16T03:25:19.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.668+0000 7fa714757640 1 -- 172.21.15.28:0/746638195 wait complete. 2023-12-16T03:25:19.690 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-16T03:25:19.690 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:25:19.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff76d209640 1 Processor -- start 2023-12-16T03:25:19.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff76d209640 1 -- start start 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff76d209640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff768151e90 0x7ff7680c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff76d209640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76806c860 con 0x7ff7680c4e60 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff76d209640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff768154930 con 0x7ff7680c7ea0 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff76d209640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7680c8750 con 0x7ff768151e90 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff76759e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff7680c4e60 0x7ff76815f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57776/0 (socket says 172.21.15.28:57776) 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff76759e640 1 -- 172.21.15.28:0/3446032625 learned_addr learned my addr 172.21.15.28:0/3446032625 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff766d9d640 1 --2- 172.21.15.28:0/3446032625 >> v2:172.21.15.134:3300/0 conn(0x7ff768151e90 0x7ff7680c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff76659c640 1 -- 172.21.15.28:0/3446032625 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732979126 0 0) 0x7ff76806c860 con 0x7ff7680c4e60 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff76659c640 1 -- 172.21.15.28:0/3446032625 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff754003530 con 0x7ff7680c4e60 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff766d9d640 1 -- 172.21.15.28:0/3446032625 >> v1:172.21.15.134:6789/0 conn(0x7ff7680c7ea0 legacy=0x7ff76806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff766d9d640 1 -- 172.21.15.28:0/3446032625 >> v1:172.21.15.28:6789/0 conn(0x7ff7680c4e60 legacy=0x7ff76815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.832+0000 7ff766d9d640 1 -- 172.21.15.28:0/3446032625 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff768154c10 con 0x7ff768151e90 2023-12-16T03:25:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.836+0000 7ff766d9d640 1 --2- 172.21.15.28:0/3446032625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff768151e90 0x7ff7680c4920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7580097c0 tx=0x7ff75801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=194be173244da17d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.836+0000 7ff76659c640 1 -- 172.21.15.28:0/3446032625 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7580ab600 con 0x7ff768151e90 2023-12-16T03:25:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.836+0000 7ff76659c640 1 -- 172.21.15.28:0/3446032625 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7580a7050 con 0x7ff768151e90 2023-12-16T03:25:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.836+0000 7ff76659c640 1 -- 172.21.15.28:0/3446032625 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7580ab980 con 0x7ff768151e90 2023-12-16T03:25:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.836+0000 7ff76d209640 1 -- 172.21.15.28:0/3446032625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff768151e90 msgr2=0x7ff7680c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.836+0000 7ff76d209640 1 --2- 172.21.15.28:0/3446032625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff768151e90 0x7ff7680c4920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7580097c0 tx=0x7ff75801c360 comp rx=0 tx=0).stop 2023-12-16T03:25:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.836+0000 7ff76d209640 1 -- 172.21.15.28:0/3446032625 shutdown_connections 2023-12-16T03:25:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.836+0000 7ff76d209640 1 --2- 172.21.15.28:0/3446032625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff768151e90 0x7ff7680c4920 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.836+0000 7ff76d209640 1 -- 172.21.15.28:0/3446032625 >> 172.21.15.28:0/3446032625 conn(0x7ff7680ca170 msgr2=0x7ff7680ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.836+0000 7ff76d209640 1 -- 172.21.15.28:0/3446032625 shutdown_connections 2023-12-16T03:25:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.836+0000 7ff76d209640 1 -- 172.21.15.28:0/3446032625 wait complete. 2023-12-16T03:25:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76d209640 1 Processor -- start 2023-12-16T03:25:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76d209640 1 -- start start 2023-12-16T03:25:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76d209640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7680c4e60 0x7ff76814a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76d209640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7680c7ea0 0x7ff7680c1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76d209640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff768151e90 0x7ff7681f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76d209640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7681552d0 con 0x7ff768151e90 2023-12-16T03:25:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76d209640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7680c2410 con 0x7ff7680c4e60 2023-12-16T03:25:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76d209640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76814ce90 con 0x7ff7680c7ea0 2023-12-16T03:25:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff768151e90 0x7ff7681f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff768151e90 0x7ff7681f05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38426/0 (socket says 172.21.15.28:38426) 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76759e640 1 -- 172.21.15.28:0/1376333337 learned_addr learned my addr 172.21.15.28:0/1376333337 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff766d9d640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7680c4e60 0x7ff76814a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff75ffff640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7680c7ea0 0x7ff7680c1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76759e640 1 -- 172.21.15.28:0/1376333337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7680c7ea0 msgr2=0x7ff7680c1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76759e640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7680c7ea0 0x7ff7680c1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76759e640 1 -- 172.21.15.28:0/1376333337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7680c4e60 msgr2=0x7ff76814a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76759e640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7680c4e60 0x7ff76814a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76759e640 1 -- 172.21.15.28:0/1376333337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff758009420 con 0x7ff768151e90 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76759e640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff768151e90 0x7ff7681f05c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff76000caa0 tx=0x7ff76000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff75f7fe640 1 -- 172.21.15.28:0/1376333337 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76000ac00 con 0x7ff768151e90 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff75f7fe640 1 -- 172.21.15.28:0/1376333337 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76000ad60 con 0x7ff768151e90 2023-12-16T03:25:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff75f7fe640 1 -- 172.21.15.28:0/1376333337 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760012620 con 0x7ff768151e90 2023-12-16T03:25:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76d209640 1 -- 172.21.15.28:0/1376333337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76814cbb0 con 0x7ff768151e90 2023-12-16T03:25:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.840+0000 7ff76d209640 1 -- 172.21.15.28:0/1376333337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff768149ae0 con 0x7ff768151e90 2023-12-16T03:25:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.844+0000 7ff76d209640 1 -- 172.21.15.28:0/1376333337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff768068400 con 0x7ff768151e90 2023-12-16T03:25:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.844+0000 7ff75f7fe640 1 -- 172.21.15.28:0/1376333337 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff760007070 con 0x7ff768151e90 2023-12-16T03:25:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.844+0000 7ff75f7fe640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7480664a0 0x7ff748068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.844+0000 7ff75f7fe640 1 -- 172.21.15.28:0/1376333337 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff760083d60 con 0x7ff768151e90 2023-12-16T03:25:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.844+0000 7ff766d9d640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7480664a0 0x7ff748068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.844+0000 7ff766d9d640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7480664a0 0x7ff748068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7580ad000 tx=0x7ff7580a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:19.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:19.848+0000 7ff75f7fe640 1 -- 172.21.15.28:0/1376333337 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff760051280 con 0x7ff768151e90 2023-12-16T03:25:20.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.004+0000 7ff76d209640 1 -- 172.21.15.28:0/1376333337 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7681556f0 con 0x7ff7480664a0 2023-12-16T03:25:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.012+0000 7ff75f7fe640 1 -- 172.21.15.28:0/1376333337 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264672 (secure 0 0 0) 0x7ff7580ab760 con 0x7ff7480664a0 2023-12-16T03:25:20.019 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:25:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 -- 172.21.15.28:0/1376333337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7480664a0 msgr2=0x7ff748068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7480664a0 0x7ff748068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7580ad000 tx=0x7ff7580a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 -- 172.21.15.28:0/1376333337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff768151e90 msgr2=0x7ff7681f05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff768151e90 0x7ff7681f05c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff76000caa0 tx=0x7ff76000cf60 comp rx=0 tx=0).stop 2023-12-16T03:25:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 -- 172.21.15.28:0/1376333337 shutdown_connections 2023-12-16T03:25:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7480664a0 0x7ff748068960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff768151e90 0x7ff7681f05c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7680c7ea0 0x7ff7680c1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 --2- 172.21.15.28:0/1376333337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7680c4e60 0x7ff76814a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 -- 172.21.15.28:0/1376333337 >> 172.21.15.28:0/1376333337 conn(0x7ff7680ca170 msgr2=0x7ff76814f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 -- 172.21.15.28:0/1376333337 shutdown_connections 2023-12-16T03:25:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.016+0000 7ff76d209640 1 -- 172.21.15.28:0/1376333337 wait complete. 2023-12-16T03:25:20.039 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-16T03:25:19.794219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235624,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739096,"statfs":{"total":773094113280,"available":772852834304,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.887472"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437358+0000","last_change":"2023-12-16T03:25:15.452175+0000","last_active":"2023-12-16T03:25:16.437358+0000","last_peered":"2023-12-16T03:25:16.437358+0000","last_clean":"2023-12-16T03:25:16.437358+0000","last_became_active":"2023-12-16T03:25:15.451916+0000","last_became_peered":"2023-12-16T03:25:15.451916+0000","last_unstale":"2023-12-16T03:25:16.437358+0000","last_undegraded":"2023-12-16T03:25:16.437358+0000","last_fullsized":"2023-12-16T03:25:16.437358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:43.581686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420315+0000","last_change":"2023-12-16T03:25:15.425458+0000","last_active":"2023-12-16T03:25:16.420315+0000","last_peered":"2023-12-16T03:25:16.420315+0000","last_clean":"2023-12-16T03:25:16.420315+0000","last_became_active":"2023-12-16T03:25:15.425194+0000","last_became_peered":"2023-12-16T03:25:15.425194+0000","last_unstale":"2023-12-16T03:25:16.420315+0000","last_undegraded":"2023-12-16T03:25:16.420315+0000","last_fullsized":"2023-12-16T03:25:16.420315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437452+0000","last_change":"2023-12-16T03:25:15.425638+0000","last_active":"2023-12-16T03:25:16.437452+0000","last_peered":"2023-12-16T03:25:16.437452+0000","last_clean":"2023-12-16T03:25:16.437452+0000","last_became_active":"2023-12-16T03:25:15.425353+0000","last_became_peered":"2023-12-16T03:25:15.425353+0000","last_unstale":"2023-12-16T03:25:16.437452+0000","last_undegraded":"2023-12-16T03:25:16.437452+0000","last_fullsized":"2023-12-16T03:25:16.437452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422853+0000","last_change":"2023-12-16T03:25:15.434050+0000","last_active":"2023-12-16T03:25:16.422853+0000","last_peered":"2023-12-16T03:25:16.422853+0000","last_clean":"2023-12-16T03:25:16.422853+0000","last_became_active":"2023-12-16T03:25:15.433643+0000","last_became_peered":"2023-12-16T03:25:15.433643+0000","last_unstale":"2023-12-16T03:25:16.422853+0000","last_undegraded":"2023-12-16T03:25:16.422853+0000","last_fullsized":"2023-12-16T03:25:16.422853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436512+0000","last_change":"2023-12-16T03:25:15.445800+0000","last_active":"2023-12-16T03:25:16.436512+0000","last_peered":"2023-12-16T03:25:16.436512+0000","last_clean":"2023-12-16T03:25:16.436512+0000","last_became_active":"2023-12-16T03:25:15.445496+0000","last_became_peered":"2023-12-16T03:25:15.445496+0000","last_unstale":"2023-12-16T03:25:16.436512+0000","last_undegraded":"2023-12-16T03:25:16.436512+0000","last_fullsized":"2023-12-16T03:25:16.436512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422916+0000","last_change":"2023-12-16T03:25:15.433130+0000","last_active":"2023-12-16T03:25:16.422916+0000","last_peered":"2023-12-16T03:25:16.422916+0000","last_clean":"2023-12-16T03:25:16.422916+0000","last_became_active":"2023-12-16T03:25:15.432783+0000","last_became_peered":"2023-12-16T03:25:15.432783+0000","last_unstale":"2023-12-16T03:25:16.422916+0000","last_undegraded":"2023-12-16T03:25:16.422916+0000","last_fullsized":"2023-12-16T03:25:16.422916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:55.217497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436380+0000","last_change":"2023-12-16T03:25:15.443935+0000","last_active":"2023-12-16T03:25:16.436380+0000","last_peered":"2023-12-16T03:25:16.436380+0000","last_clean":"2023-12-16T03:25:16.436380+0000","last_became_active":"2023-12-16T03:25:15.443601+0000","last_became_peered":"2023-12-16T03:25:15.443601+0000","last_unstale":"2023-12-16T03:25:16.436380+0000","last_undegraded":"2023-12-16T03:25:16.436380+0000","last_fullsized":"2023-12-16T03:25:16.436380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436427+0000","last_change":"2023-12-16T03:25:15.431879+0000","last_active":"2023-12-16T03:25:16.436427+0000","last_peered":"2023-12-16T03:25:16.436427+0000","last_clean":"2023-12-16T03:25:16.436427+0000","last_became_active":"2023-12-16T03:25:15.431564+0000","last_became_peered":"2023-12-16T03:25:15.431564+0000","last_unstale":"2023-12-16T03:25:16.436427+0000","last_undegraded":"2023-12-16T03:25:16.436427+0000","last_fullsized":"2023-12-16T03:25:16.436427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437342+0000","last_change":"2023-12-16T03:25:15.446906+0000","last_active":"2023-12-16T03:25:16.437342+0000","last_peered":"2023-12-16T03:25:16.437342+0000","last_clean":"2023-12-16T03:25:16.437342+0000","last_became_active":"2023-12-16T03:25:15.446136+0000","last_became_peered":"2023-12-16T03:25:15.446136+0000","last_unstale":"2023-12-16T03:25:16.437342+0000","last_undegraded":"2023-12-16T03:25:16.437342+0000","last_fullsized":"2023-12-16T03:25:16.437342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:54:38.927177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436922+0000","last_change":"2023-12-16T03:25:15.437274+0000","last_active":"2023-12-16T03:25:16.436922+0000","last_peered":"2023-12-16T03:25:16.436922+0000","last_clean":"2023-12-16T03:25:16.436922+0000","last_became_active":"2023-12-16T03:25:15.436993+0000","last_became_peered":"2023-12-16T03:25:15.436993+0000","last_unstale":"2023-12-16T03:25:16.436922+0000","last_undegraded":"2023-12-16T03:25:16.436922+0000","last_fullsized":"2023-12-16T03:25:16.436922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436247+0000","last_change":"2023-12-16T03:25:15.439228+0000","last_active":"2023-12-16T03:25:16.436247+0000","last_peered":"2023-12-16T03:25:16.436247+0000","last_clean":"2023-12-16T03:25:16.436247+0000","last_became_active":"2023-12-16T03:25:15.437550+0000","last_became_peered":"2023-12-16T03:25:15.437550+0000","last_unstale":"2023-12-16T03:25:16.436247+0000","last_undegraded":"2023-12-16T03:25:16.436247+0000","last_fullsized":"2023-12-16T03:25:16.436247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422787+0000","last_change":"2023-12-16T03:25:15.442026+0000","last_active":"2023-12-16T03:25:16.422787+0000","last_peered":"2023-12-16T03:25:16.422787+0000","last_clean":"2023-12-16T03:25:16.422787+0000","last_became_active":"2023-12-16T03:25:15.441374+0000","last_became_peered":"2023-12-16T03:25:15.441374+0000","last_unstale":"2023-12-16T03:25:16.422787+0000","last_undegraded":"2023-12-16T03:25:16.422787+0000","last_fullsized":"2023-12-16T03:25:16.422787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:21.931497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437544+0000","last_change":"2023-12-16T03:25:15.431327+0000","last_active":"2023-12-16T03:25:16.437544+0000","last_peered":"2023-12-16T03:25:16.437544+0000","last_clean":"2023-12-16T03:25:16.437544+0000","last_became_active":"2023-12-16T03:25:15.430973+0000","last_became_peered":"2023-12-16T03:25:15.430973+0000","last_unstale":"2023-12-16T03:25:16.437544+0000","last_undegraded":"2023-12-16T03:25:16.437544+0000","last_fullsized":"2023-12-16T03:25:16.437544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436524+0000","last_change":"2023-12-16T03:25:15.426240+0000","last_active":"2023-12-16T03:25:16.436524+0000","last_peered":"2023-12-16T03:25:16.436524+0000","last_clean":"2023-12-16T03:25:16.436524+0000","last_became_active":"2023-12-16T03:25:15.425045+0000","last_became_peered":"2023-12-16T03:25:15.425045+0000","last_unstale":"2023-12-16T03:25:16.436524+0000","last_undegraded":"2023-12-16T03:25:16.436524+0000","last_fullsized":"2023-12-16T03:25:16.436524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:11.236920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420099+0000","last_change":"2023-12-16T03:25:15.449282+0000","last_active":"2023-12-16T03:25:16.420099+0000","last_peered":"2023-12-16T03:25:16.420099+0000","last_clean":"2023-12-16T03:25:16.420099+0000","last_became_active":"2023-12-16T03:25:15.449009+0000","last_became_peered":"2023-12-16T03:25:15.449009+0000","last_unstale":"2023-12-16T03:25:16.420099+0000","last_undegraded":"2023-12-16T03:25:16.420099+0000","last_fullsized":"2023-12-16T03:25:16.420099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422703+0000","last_change":"2023-12-16T03:25:15.433001+0000","last_active":"2023-12-16T03:25:16.422703+0000","last_peered":"2023-12-16T03:25:16.422703+0000","last_clean":"2023-12-16T03:25:16.422703+0000","last_became_active":"2023-12-16T03:25:15.432331+0000","last_became_peered":"2023-12-16T03:25:15.432331+0000","last_unstale":"2023-12-16T03:25:16.422703+0000","last_undegraded":"2023-12-16T03:25:16.422703+0000","last_fullsized":"2023-12-16T03:25:16.422703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423697+0000","last_change":"2023-12-16T03:25:15.446721+0000","last_active":"2023-12-16T03:25:16.423697+0000","last_peered":"2023-12-16T03:25:16.423697+0000","last_clean":"2023-12-16T03:25:16.423697+0000","last_became_active":"2023-12-16T03:25:15.446449+0000","last_became_peered":"2023-12-16T03:25:15.446449+0000","last_unstale":"2023-12-16T03:25:16.423697+0000","last_undegraded":"2023-12-16T03:25:16.423697+0000","last_fullsized":"2023-12-16T03:25:16.423697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:00.341013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437037+0000","last_change":"2023-12-16T03:25:15.440602+0000","last_active":"2023-12-16T03:25:16.437037+0000","last_peered":"2023-12-16T03:25:16.437037+0000","last_clean":"2023-12-16T03:25:16.437037+0000","last_became_active":"2023-12-16T03:25:15.440121+0000","last_became_peered":"2023-12-16T03:25:15.440121+0000","last_unstale":"2023-12-16T03:25:16.437037+0000","last_undegraded":"2023-12-16T03:25:16.437037+0000","last_fullsized":"2023-12-16T03:25:16.437037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:07.619534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437099+0000","last_change":"2023-12-16T03:25:15.445828+0000","last_active":"2023-12-16T03:25:16.437099+0000","last_peered":"2023-12-16T03:25:16.437099+0000","last_clean":"2023-12-16T03:25:16.437099+0000","last_became_active":"2023-12-16T03:25:15.445531+0000","last_became_peered":"2023-12-16T03:25:15.445531+0000","last_unstale":"2023-12-16T03:25:16.437099+0000","last_undegraded":"2023-12-16T03:25:16.437099+0000","last_fullsized":"2023-12-16T03:25:16.437099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:59.239833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436366+0000","last_change":"2023-12-16T03:25:15.449537+0000","last_active":"2023-12-16T03:25:16.436366+0000","last_peered":"2023-12-16T03:25:16.436366+0000","last_clean":"2023-12-16T03:25:16.436366+0000","last_became_active":"2023-12-16T03:25:15.449070+0000","last_became_peered":"2023-12-16T03:25:15.449070+0000","last_unstale":"2023-12-16T03:25:16.436366+0000","last_undegraded":"2023-12-16T03:25:16.436366+0000","last_fullsized":"2023-12-16T03:25:16.436366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436601+0000","last_change":"2023-12-16T03:25:15.432034+0000","last_active":"2023-12-16T03:25:16.436601+0000","last_peered":"2023-12-16T03:25:16.436601+0000","last_clean":"2023-12-16T03:25:16.436601+0000","last_became_active":"2023-12-16T03:25:15.431749+0000","last_became_peered":"2023-12-16T03:25:15.431749+0000","last_unstale":"2023-12-16T03:25:16.436601+0000","last_undegraded":"2023-12-16T03:25:16.436601+0000","last_fullsized":"2023-12-16T03:25:16.436601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:37:00.957991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423015+0000","last_change":"2023-12-16T03:25:15.444757+0000","last_active":"2023-12-16T03:25:16.423015+0000","last_peered":"2023-12-16T03:25:16.423015+0000","last_clean":"2023-12-16T03:25:16.423015+0000","last_became_active":"2023-12-16T03:25:15.443767+0000","last_became_peered":"2023-12-16T03:25:15.443767+0000","last_unstale":"2023-12-16T03:25:16.423015+0000","last_undegraded":"2023-12-16T03:25:16.423015+0000","last_fullsized":"2023-12-16T03:25:16.423015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436894+0000","last_change":"2023-12-16T03:25:15.442263+0000","last_active":"2023-12-16T03:25:16.436894+0000","last_peered":"2023-12-16T03:25:16.436894+0000","last_clean":"2023-12-16T03:25:16.436894+0000","last_became_active":"2023-12-16T03:25:15.441740+0000","last_became_peered":"2023-12-16T03:25:15.441740+0000","last_unstale":"2023-12-16T03:25:16.436894+0000","last_undegraded":"2023-12-16T03:25:16.436894+0000","last_fullsized":"2023-12-16T03:25:16.436894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422740+0000","last_change":"2023-12-16T03:25:15.433490+0000","last_active":"2023-12-16T03:25:16.422740+0000","last_peered":"2023-12-16T03:25:16.422740+0000","last_clean":"2023-12-16T03:25:16.422740+0000","last_became_active":"2023-12-16T03:25:15.431932+0000","last_became_peered":"2023-12-16T03:25:15.431932+0000","last_unstale":"2023-12-16T03:25:16.422740+0000","last_undegraded":"2023-12-16T03:25:16.422740+0000","last_fullsized":"2023-12-16T03:25:16.422740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437338+0000","last_change":"2023-12-16T03:25:15.450545+0000","last_active":"2023-12-16T03:25:16.437338+0000","last_peered":"2023-12-16T03:25:16.437338+0000","last_clean":"2023-12-16T03:25:16.437338+0000","last_became_active":"2023-12-16T03:25:15.450331+0000","last_became_peered":"2023-12-16T03:25:15.450331+0000","last_unstale":"2023-12-16T03:25:16.437338+0000","last_undegraded":"2023-12-16T03:25:16.437338+0000","last_fullsized":"2023-12-16T03:25:16.437338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436987+0000","last_change":"2023-12-16T03:25:15.439606+0000","last_active":"2023-12-16T03:25:16.436987+0000","last_peered":"2023-12-16T03:25:16.436987+0000","last_clean":"2023-12-16T03:25:16.436987+0000","last_became_active":"2023-12-16T03:25:15.439192+0000","last_became_peered":"2023-12-16T03:25:15.439192+0000","last_unstale":"2023-12-16T03:25:16.436987+0000","last_undegraded":"2023-12-16T03:25:16.436987+0000","last_fullsized":"2023-12-16T03:25:16.436987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420282+0000","last_change":"2023-12-16T03:25:15.432802+0000","last_active":"2023-12-16T03:25:16.420282+0000","last_peered":"2023-12-16T03:25:16.420282+0000","last_clean":"2023-12-16T03:25:16.420282+0000","last_became_active":"2023-12-16T03:25:15.432545+0000","last_became_peered":"2023-12-16T03:25:15.432545+0000","last_unstale":"2023-12-16T03:25:16.420282+0000","last_undegraded":"2023-12-16T03:25:16.420282+0000","last_fullsized":"2023-12-16T03:25:16.420282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437287+0000","last_change":"2023-12-16T03:25:15.441487+0000","last_active":"2023-12-16T03:25:16.437287+0000","last_peered":"2023-12-16T03:25:16.437287+0000","last_clean":"2023-12-16T03:25:16.437287+0000","last_became_active":"2023-12-16T03:25:15.441150+0000","last_became_peered":"2023-12-16T03:25:15.441150+0000","last_unstale":"2023-12-16T03:25:16.437287+0000","last_undegraded":"2023-12-16T03:25:16.437287+0000","last_fullsized":"2023-12-16T03:25:16.437287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436778+0000","last_change":"2023-12-16T03:25:15.427812+0000","last_active":"2023-12-16T03:25:16.436778+0000","last_peered":"2023-12-16T03:25:16.436778+0000","last_clean":"2023-12-16T03:25:16.436778+0000","last_became_active":"2023-12-16T03:25:15.427532+0000","last_became_peered":"2023-12-16T03:25:15.427532+0000","last_unstale":"2023-12-16T03:25:16.436778+0000","last_undegraded":"2023-12-16T03:25:16.436778+0000","last_fullsized":"2023-12-16T03:25:16.436778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423136+0000","last_change":"2023-12-16T03:25:15.431187+0000","last_active":"2023-12-16T03:25:16.423136+0000","last_peered":"2023-12-16T03:25:16.423136+0000","last_clean":"2023-12-16T03:25:16.423136+0000","last_became_active":"2023-12-16T03:25:15.430884+0000","last_became_peered":"2023-12-16T03:25:15.430884+0000","last_unstale":"2023-12-16T03:25:16.423136+0000","last_undegraded":"2023-12-16T03:25:16.423136+0000","last_fullsized":"2023-12-16T03:25:16.423136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436280+0000","last_change":"2023-12-16T03:25:15.432854+0000","last_active":"2023-12-16T03:25:16.436280+0000","last_peered":"2023-12-16T03:25:16.436280+0000","last_clean":"2023-12-16T03:25:16.436280+0000","last_became_active":"2023-12-16T03:25:15.432566+0000","last_became_peered":"2023-12-16T03:25:15.432566+0000","last_unstale":"2023-12-16T03:25:16.436280+0000","last_undegraded":"2023-12-16T03:25:16.436280+0000","last_fullsized":"2023-12-16T03:25:16.436280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:39.322218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436057+0000","last_change":"2023-12-16T03:25:15.430509+0000","last_active":"2023-12-16T03:25:16.436057+0000","last_peered":"2023-12-16T03:25:16.436057+0000","last_clean":"2023-12-16T03:25:16.436057+0000","last_became_active":"2023-12-16T03:25:15.430160+0000","last_became_peered":"2023-12-16T03:25:15.430160+0000","last_unstale":"2023-12-16T03:25:16.436057+0000","last_undegraded":"2023-12-16T03:25:16.436057+0000","last_fullsized":"2023-12-16T03:25:16.436057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422522+0000","last_change":"2023-12-16T03:25:15.441852+0000","last_active":"2023-12-16T03:25:16.422522+0000","last_peered":"2023-12-16T03:25:16.422522+0000","last_clean":"2023-12-16T03:25:16.422522+0000","last_became_active":"2023-12-16T03:25:15.441128+0000","last_became_peered":"2023-12-16T03:25:15.441128+0000","last_unstale":"2023-12-16T03:25:16.422522+0000","last_undegraded":"2023-12-16T03:25:16.422522+0000","last_fullsized":"2023-12-16T03:25:16.422522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:37.465934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437593+0000","last_change":"2023-12-16T03:25:14.944628+0000","last_active":"2023-12-16T03:25:16.437593+0000","last_peered":"2023-12-16T03:25:16.437593+0000","last_clean":"2023-12-16T03:25:16.437593+0000","last_became_active":"2023-12-16T03:25:14.944278+0000","last_became_peered":"2023-12-16T03:25:14.944278+0000","last_unstale":"2023-12-16T03:25:16.437593+0000","last_undegraded":"2023-12-16T03:25:16.437593+0000","last_fullsized":"2023-12-16T03:25:16.437593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436947+0000","last_change":"2023-12-16T03:25:15.438299+0000","last_active":"2023-12-16T03:25:16.436947+0000","last_peered":"2023-12-16T03:25:16.436947+0000","last_clean":"2023-12-16T03:25:16.436947+0000","last_became_active":"2023-12-16T03:25:15.437923+0000","last_became_peered":"2023-12-16T03:25:15.437923+0000","last_unstale":"2023-12-16T03:25:16.436947+0000","last_undegraded":"2023-12-16T03:25:16.436947+0000","last_fullsized":"2023-12-16T03:25:16.436947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436200+0000","last_change":"2023-12-16T03:25:14.952619+0000","last_active":"2023-12-16T03:25:16.436200+0000","last_peered":"2023-12-16T03:25:16.436200+0000","last_clean":"2023-12-16T03:25:16.436200+0000","last_became_active":"2023-12-16T03:25:14.951351+0000","last_became_peered":"2023-12-16T03:25:14.951351+0000","last_unstale":"2023-12-16T03:25:16.436200+0000","last_undegraded":"2023-12-16T03:25:16.436200+0000","last_fullsized":"2023-12-16T03:25:16.436200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437048+0000","last_change":"2023-12-16T03:25:14.939694+0000","last_active":"2023-12-16T03:25:16.437048+0000","last_peered":"2023-12-16T03:25:16.437048+0000","last_clean":"2023-12-16T03:25:16.437048+0000","last_became_active":"2023-12-16T03:25:14.939359+0000","last_became_peered":"2023-12-16T03:25:14.939359+0000","last_unstale":"2023-12-16T03:25:16.437048+0000","last_undegraded":"2023-12-16T03:25:16.437048+0000","last_fullsized":"2023-12-16T03:25:16.437048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436550+0000","last_change":"2023-12-16T03:25:15.426946+0000","last_active":"2023-12-16T03:25:16.436550+0000","last_peered":"2023-12-16T03:25:16.436550+0000","last_clean":"2023-12-16T03:25:16.436550+0000","last_became_active":"2023-12-16T03:25:15.426548+0000","last_became_peered":"2023-12-16T03:25:15.426548+0000","last_unstale":"2023-12-16T03:25:16.436550+0000","last_undegraded":"2023-12-16T03:25:16.436550+0000","last_fullsized":"2023-12-16T03:25:16.436550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422798+0000","last_change":"2023-12-16T03:25:14.942071+0000","last_active":"2023-12-16T03:25:16.422798+0000","last_peered":"2023-12-16T03:25:16.422798+0000","last_clean":"2023-12-16T03:25:16.422798+0000","last_became_active":"2023-12-16T03:25:14.941786+0000","last_became_peered":"2023-12-16T03:25:14.941786+0000","last_unstale":"2023-12-16T03:25:16.422798+0000","last_undegraded":"2023-12-16T03:25:16.422798+0000","last_fullsized":"2023-12-16T03:25:16.422798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:34.131498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420100+0000","last_change":"2023-12-16T03:25:15.429804+0000","last_active":"2023-12-16T03:25:16.420100+0000","last_peered":"2023-12-16T03:25:16.420100+0000","last_clean":"2023-12-16T03:25:16.420100+0000","last_became_active":"2023-12-16T03:25:15.429063+0000","last_became_peered":"2023-12-16T03:25:15.429063+0000","last_unstale":"2023-12-16T03:25:16.420100+0000","last_undegraded":"2023-12-16T03:25:16.420100+0000","last_fullsized":"2023-12-16T03:25:16.420100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437091+0000","last_change":"2023-12-16T03:25:14.946494+0000","last_active":"2023-12-16T03:25:16.437091+0000","last_peered":"2023-12-16T03:25:16.437091+0000","last_clean":"2023-12-16T03:25:16.437091+0000","last_became_active":"2023-12-16T03:25:14.946193+0000","last_became_peered":"2023-12-16T03:25:14.946193+0000","last_unstale":"2023-12-16T03:25:16.437091+0000","last_undegraded":"2023-12-16T03:25:16.437091+0000","last_fullsized":"2023-12-16T03:25:16.437091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423512+0000","last_change":"2023-12-16T03:25:15.444625+0000","last_active":"2023-12-16T03:25:16.423512+0000","last_peered":"2023-12-16T03:25:16.423512+0000","last_clean":"2023-12-16T03:25:16.423512+0000","last_became_active":"2023-12-16T03:25:15.444322+0000","last_became_peered":"2023-12-16T03:25:15.444322+0000","last_unstale":"2023-12-16T03:25:16.423512+0000","last_undegraded":"2023-12-16T03:25:16.423512+0000","last_fullsized":"2023-12-16T03:25:16.423512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:07.831312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423548+0000","last_change":"2023-12-16T03:25:14.943434+0000","last_active":"2023-12-16T03:25:16.423548+0000","last_peered":"2023-12-16T03:25:16.423548+0000","last_clean":"2023-12-16T03:25:16.423548+0000","last_became_active":"2023-12-16T03:25:14.942914+0000","last_became_peered":"2023-12-16T03:25:14.942914+0000","last_unstale":"2023-12-16T03:25:16.423548+0000","last_undegraded":"2023-12-16T03:25:16.423548+0000","last_fullsized":"2023-12-16T03:25:16.423548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437746+0000","last_change":"2023-12-16T03:25:15.433507+0000","last_active":"2023-12-16T03:25:16.437746+0000","last_peered":"2023-12-16T03:25:16.437746+0000","last_clean":"2023-12-16T03:25:16.437746+0000","last_became_active":"2023-12-16T03:25:15.433228+0000","last_became_peered":"2023-12-16T03:25:15.433228+0000","last_unstale":"2023-12-16T03:25:16.437746+0000","last_undegraded":"2023-12-16T03:25:16.437746+0000","last_fullsized":"2023-12-16T03:25:16.437746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420270+0000","last_change":"2023-12-16T03:25:14.948029+0000","last_active":"2023-12-16T03:25:16.420270+0000","last_peered":"2023-12-16T03:25:16.420270+0000","last_clean":"2023-12-16T03:25:16.420270+0000","last_became_active":"2023-12-16T03:25:14.947608+0000","last_became_peered":"2023-12-16T03:25:14.947608+0000","last_unstale":"2023-12-16T03:25:16.420270+0000","last_undegraded":"2023-12-16T03:25:16.420270+0000","last_fullsized":"2023-12-16T03:25:16.420270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422868+0000","last_change":"2023-12-16T03:25:15.448886+0000","last_active":"2023-12-16T03:25:16.422868+0000","last_peered":"2023-12-16T03:25:16.422868+0000","last_clean":"2023-12-16T03:25:16.422868+0000","last_became_active":"2023-12-16T03:25:15.448576+0000","last_became_peered":"2023-12-16T03:25:15.448576+0000","last_unstale":"2023-12-16T03:25:16.422868+0000","last_undegraded":"2023-12-16T03:25:16.422868+0000","last_fullsized":"2023-12-16T03:25:16.422868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:39.322218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436460+0000","last_change":"2023-12-16T03:25:14.938057+0000","last_active":"2023-12-16T03:25:16.436460+0000","last_peered":"2023-12-16T03:25:16.436460+0000","last_clean":"2023-12-16T03:25:16.436460+0000","last_became_active":"2023-12-16T03:25:14.937091+0000","last_became_peered":"2023-12-16T03:25:14.937091+0000","last_unstale":"2023-12-16T03:25:16.436460+0000","last_undegraded":"2023-12-16T03:25:16.436460+0000","last_fullsized":"2023-12-16T03:25:16.436460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436738+0000","last_change":"2023-12-16T03:25:15.444073+0000","last_active":"2023-12-16T03:25:16.436738+0000","last_peered":"2023-12-16T03:25:16.436738+0000","last_clean":"2023-12-16T03:25:16.436738+0000","last_became_active":"2023-12-16T03:25:15.443746+0000","last_became_peered":"2023-12-16T03:25:15.443746+0000","last_unstale":"2023-12-16T03:25:16.436738+0000","last_undegraded":"2023-12-16T03:25:16.436738+0000","last_fullsized":"2023-12-16T03:25:16.436738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:20:54.316492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437145+0000","last_change":"2023-12-16T03:25:14.945151+0000","last_active":"2023-12-16T03:25:16.437145+0000","last_peered":"2023-12-16T03:25:16.437145+0000","last_clean":"2023-12-16T03:25:16.437145+0000","last_became_active":"2023-12-16T03:25:14.937913+0000","last_became_peered":"2023-12-16T03:25:14.937913+0000","last_unstale":"2023-12-16T03:25:16.437145+0000","last_undegraded":"2023-12-16T03:25:16.437145+0000","last_fullsized":"2023-12-16T03:25:16.437145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:36.459150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436602+0000","last_change":"2023-12-16T03:25:15.443554+0000","last_active":"2023-12-16T03:25:16.436602+0000","last_peered":"2023-12-16T03:25:16.436602+0000","last_clean":"2023-12-16T03:25:16.436602+0000","last_became_active":"2023-12-16T03:25:15.443275+0000","last_became_peered":"2023-12-16T03:25:15.443275+0000","last_unstale":"2023-12-16T03:25:16.436602+0000","last_undegraded":"2023-12-16T03:25:16.436602+0000","last_fullsized":"2023-12-16T03:25:16.436602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423115+0000","last_change":"2023-12-16T03:25:14.948755+0000","last_active":"2023-12-16T03:25:16.423115+0000","last_peered":"2023-12-16T03:25:16.423115+0000","last_clean":"2023-12-16T03:25:16.423115+0000","last_became_active":"2023-12-16T03:25:14.948399+0000","last_became_peered":"2023-12-16T03:25:14.948399+0000","last_unstale":"2023-12-16T03:25:16.423115+0000","last_undegraded":"2023-12-16T03:25:16.423115+0000","last_fullsized":"2023-12-16T03:25:16.423115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436672+0000","last_change":"2023-12-16T03:25:15.454032+0000","last_active":"2023-12-16T03:25:16.436672+0000","last_peered":"2023-12-16T03:25:16.436672+0000","last_clean":"2023-12-16T03:25:16.436672+0000","last_became_active":"2023-12-16T03:25:15.453722+0000","last_became_peered":"2023-12-16T03:25:15.453722+0000","last_unstale":"2023-12-16T03:25:16.436672+0000","last_undegraded":"2023-12-16T03:25:16.436672+0000","last_fullsized":"2023-12-16T03:25:16.436672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:07.831312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436040+0000","last_change":"2023-12-16T03:25:14.938917+0000","last_active":"2023-12-16T03:25:16.436040+0000","last_peered":"2023-12-16T03:25:16.436040+0000","last_clean":"2023-12-16T03:25:16.436040+0000","last_became_active":"2023-12-16T03:25:14.938389+0000","last_became_peered":"2023-12-16T03:25:14.938389+0000","last_unstale":"2023-12-16T03:25:16.436040+0000","last_undegraded":"2023-12-16T03:25:16.436040+0000","last_fullsized":"2023-12-16T03:25:16.436040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436799+0000","last_change":"2023-12-16T03:25:15.431222+0000","last_active":"2023-12-16T03:25:16.436799+0000","last_peered":"2023-12-16T03:25:16.436799+0000","last_clean":"2023-12-16T03:25:16.436799+0000","last_became_active":"2023-12-16T03:25:15.430884+0000","last_became_peered":"2023-12-16T03:25:15.430884+0000","last_unstale":"2023-12-16T03:25:16.436799+0000","last_undegraded":"2023-12-16T03:25:16.436799+0000","last_fullsized":"2023-12-16T03:25:16.436799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436272+0000","last_change":"2023-12-16T03:25:14.937196+0000","last_active":"2023-12-16T03:25:16.436272+0000","last_peered":"2023-12-16T03:25:16.436272+0000","last_clean":"2023-12-16T03:25:16.436272+0000","last_became_active":"2023-12-16T03:25:14.935102+0000","last_became_peered":"2023-12-16T03:25:14.935102+0000","last_unstale":"2023-12-16T03:25:16.436272+0000","last_undegraded":"2023-12-16T03:25:16.436272+0000","last_fullsized":"2023-12-16T03:25:16.436272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:39:22.295470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436578+0000","last_change":"2023-12-16T03:25:15.455089+0000","last_active":"2023-12-16T03:25:16.436578+0000","last_peered":"2023-12-16T03:25:16.436578+0000","last_clean":"2023-12-16T03:25:16.436578+0000","last_became_active":"2023-12-16T03:25:15.454725+0000","last_became_peered":"2023-12-16T03:25:15.454725+0000","last_unstale":"2023-12-16T03:25:16.436578+0000","last_undegraded":"2023-12-16T03:25:16.436578+0000","last_fullsized":"2023-12-16T03:25:16.436578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:29.020229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422895+0000","last_change":"2023-12-16T03:25:14.941188+0000","last_active":"2023-12-16T03:25:16.422895+0000","last_peered":"2023-12-16T03:25:16.422895+0000","last_clean":"2023-12-16T03:25:16.422895+0000","last_became_active":"2023-12-16T03:25:14.940811+0000","last_became_peered":"2023-12-16T03:25:14.940811+0000","last_unstale":"2023-12-16T03:25:16.422895+0000","last_undegraded":"2023-12-16T03:25:16.422895+0000","last_fullsized":"2023-12-16T03:25:16.422895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:08.626152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436563+0000","last_change":"2023-12-16T03:25:15.452042+0000","last_active":"2023-12-16T03:25:16.436563+0000","last_peered":"2023-12-16T03:25:16.436563+0000","last_clean":"2023-12-16T03:25:16.436563+0000","last_became_active":"2023-12-16T03:25:15.451737+0000","last_became_peered":"2023-12-16T03:25:15.451737+0000","last_unstale":"2023-12-16T03:25:16.436563+0000","last_undegraded":"2023-12-16T03:25:16.436563+0000","last_fullsized":"2023-12-16T03:25:16.436563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437165+0000","last_change":"2023-12-16T03:25:14.938664+0000","last_active":"2023-12-16T03:25:16.437165+0000","last_peered":"2023-12-16T03:25:16.437165+0000","last_clean":"2023-12-16T03:25:16.437165+0000","last_became_active":"2023-12-16T03:25:14.938324+0000","last_became_peered":"2023-12-16T03:25:14.938324+0000","last_unstale":"2023-12-16T03:25:16.437165+0000","last_undegraded":"2023-12-16T03:25:16.437165+0000","last_fullsized":"2023-12-16T03:25:16.437165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:36.459150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437416+0000","last_change":"2023-12-16T03:25:15.455016+0000","last_active":"2023-12-16T03:25:16.437416+0000","last_peered":"2023-12-16T03:25:16.437416+0000","last_clean":"2023-12-16T03:25:16.437416+0000","last_became_active":"2023-12-16T03:25:15.454715+0000","last_became_peered":"2023-12-16T03:25:15.454715+0000","last_unstale":"2023-12-16T03:25:16.437416+0000","last_undegraded":"2023-12-16T03:25:16.437416+0000","last_fullsized":"2023-12-16T03:25:16.437416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:02:53.965844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420363+0000","last_change":"2023-12-16T03:25:14.942353+0000","last_active":"2023-12-16T03:25:16.420363+0000","last_peered":"2023-12-16T03:25:16.420363+0000","last_clean":"2023-12-16T03:25:16.420363+0000","last_became_active":"2023-12-16T03:25:14.942088+0000","last_became_peered":"2023-12-16T03:25:14.942088+0000","last_unstale":"2023-12-16T03:25:16.420363+0000","last_undegraded":"2023-12-16T03:25:16.420363+0000","last_fullsized":"2023-12-16T03:25:16.420363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:36:59.951207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423137+0000","last_change":"2023-12-16T03:25:15.433902+0000","last_active":"2023-12-16T03:25:16.423137+0000","last_peered":"2023-12-16T03:25:16.423137+0000","last_clean":"2023-12-16T03:25:16.423137+0000","last_became_active":"2023-12-16T03:25:15.432579+0000","last_became_peered":"2023-12-16T03:25:15.432579+0000","last_unstale":"2023-12-16T03:25:16.423137+0000","last_undegraded":"2023-12-16T03:25:16.423137+0000","last_fullsized":"2023-12-16T03:25:16.423137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:29.020229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436825+0000","last_change":"2023-12-16T03:25:14.949089+0000","last_active":"2023-12-16T03:25:16.436825+0000","last_peered":"2023-12-16T03:25:16.436825+0000","last_clean":"2023-12-16T03:25:16.436825+0000","last_became_active":"2023-12-16T03:25:14.948668+0000","last_became_peered":"2023-12-16T03:25:14.948668+0000","last_unstale":"2023-12-16T03:25:16.436825+0000","last_undegraded":"2023-12-16T03:25:16.436825+0000","last_fullsized":"2023-12-16T03:25:16.436825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:06.962968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436870+0000","last_change":"2023-12-16T03:25:15.445232+0000","last_active":"2023-12-16T03:25:16.436870+0000","last_peered":"2023-12-16T03:25:16.436870+0000","last_clean":"2023-12-16T03:25:16.436870+0000","last_became_active":"2023-12-16T03:25:15.444929+0000","last_became_peered":"2023-12-16T03:25:15.444929+0000","last_unstale":"2023-12-16T03:25:16.436870+0000","last_undegraded":"2023-12-16T03:25:16.436870+0000","last_fullsized":"2023-12-16T03:25:16.436870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:00.341013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-16T03:25:15.435898+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:25:15.435898+0000","last_peered":"2023-12-16T03:25:15.435898+0000","last_clean":"2023-12-16T03:25:15.435898+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:25:15.435898+0000","last_undegraded":"2023-12-16T03:25:15.435898+0000","last_fullsized":"2023-12-16T03:25:15.435898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423217+0000","last_change":"2023-12-16T03:25:14.941508+0000","last_active":"2023-12-16T03:25:16.423217+0000","last_peered":"2023-12-16T03:25:16.423217+0000","last_clean":"2023-12-16T03:25:16.423217+0000","last_became_active":"2023-12-16T03:25:14.941128+0000","last_became_peered":"2023-12-16T03:25:14.941128+0000","last_unstale":"2023-12-16T03:25:16.423217+0000","last_undegraded":"2023-12-16T03:25:16.423217+0000","last_fullsized":"2023-12-16T03:25:16.423217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:34.241901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437288+0000","last_change":"2023-12-16T03:25:15.433356+0000","last_active":"2023-12-16T03:25:16.437288+0000","last_peered":"2023-12-16T03:25:16.437288+0000","last_clean":"2023-12-16T03:25:16.437288+0000","last_became_active":"2023-12-16T03:25:15.433010+0000","last_became_peered":"2023-12-16T03:25:15.433010+0000","last_unstale":"2023-12-16T03:25:16.437288+0000","last_undegraded":"2023-12-16T03:25:16.437288+0000","last_fullsized":"2023-12-16T03:25:16.437288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436448+0000","last_change":"2023-12-16T03:25:14.951710+0000","last_active":"2023-12-16T03:25:16.436448+0000","last_peered":"2023-12-16T03:25:16.436448+0000","last_clean":"2023-12-16T03:25:16.436448+0000","last_became_active":"2023-12-16T03:25:14.951249+0000","last_became_peered":"2023-12-16T03:25:14.951249+0000","last_unstale":"2023-12-16T03:25:16.436448+0000","last_undegraded":"2023-12-16T03:25:16.436448+0000","last_fullsized":"2023-12-16T03:25:16.436448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:20.924714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436461+0000","last_change":"2023-12-16T03:25:15.449196+0000","last_active":"2023-12-16T03:25:16.436461+0000","last_peered":"2023-12-16T03:25:16.436461+0000","last_clean":"2023-12-16T03:25:16.436461+0000","last_became_active":"2023-12-16T03:25:15.448896+0000","last_became_peered":"2023-12-16T03:25:15.448896+0000","last_unstale":"2023-12-16T03:25:16.436461+0000","last_undegraded":"2023-12-16T03:25:16.436461+0000","last_fullsized":"2023-12-16T03:25:16.436461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:06.946403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436387+0000","last_change":"2023-12-16T03:25:14.931491+0000","last_active":"2023-12-16T03:25:16.436387+0000","last_peered":"2023-12-16T03:25:16.436387+0000","last_clean":"2023-12-16T03:25:16.436387+0000","last_became_active":"2023-12-16T03:25:14.931114+0000","last_became_peered":"2023-12-16T03:25:14.931114+0000","last_unstale":"2023-12-16T03:25:16.436387+0000","last_undegraded":"2023-12-16T03:25:16.436387+0000","last_fullsized":"2023-12-16T03:25:16.436387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:34.241901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420119+0000","last_change":"2023-12-16T03:25:15.428698+0000","last_active":"2023-12-16T03:25:16.420119+0000","last_peered":"2023-12-16T03:25:16.420119+0000","last_clean":"2023-12-16T03:25:16.420119+0000","last_became_active":"2023-12-16T03:25:15.424710+0000","last_became_peered":"2023-12-16T03:25:15.424710+0000","last_unstale":"2023-12-16T03:25:16.420119+0000","last_undegraded":"2023-12-16T03:25:16.420119+0000","last_fullsized":"2023-12-16T03:25:16.420119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423180+0000","last_change":"2023-12-16T03:25:14.942839+0000","last_active":"2023-12-16T03:25:16.423180+0000","last_peered":"2023-12-16T03:25:16.423180+0000","last_clean":"2023-12-16T03:25:16.423180+0000","last_became_active":"2023-12-16T03:25:14.942596+0000","last_became_peered":"2023-12-16T03:25:14.942596+0000","last_unstale":"2023-12-16T03:25:16.423180+0000","last_undegraded":"2023-12-16T03:25:16.423180+0000","last_fullsized":"2023-12-16T03:25:16.423180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:36:59.951207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423043+0000","last_change":"2023-12-16T03:25:15.437137+0000","last_active":"2023-12-16T03:25:16.423043+0000","last_peered":"2023-12-16T03:25:16.423043+0000","last_clean":"2023-12-16T03:25:16.423043+0000","last_became_active":"2023-12-16T03:25:15.436800+0000","last_became_peered":"2023-12-16T03:25:15.436800+0000","last_unstale":"2023-12-16T03:25:16.423043+0000","last_undegraded":"2023-12-16T03:25:16.423043+0000","last_fullsized":"2023-12-16T03:25:16.423043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:07.619534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420344+0000","last_change":"2023-12-16T03:25:14.937971+0000","last_active":"2023-12-16T03:25:16.420344+0000","last_peered":"2023-12-16T03:25:16.420344+0000","last_clean":"2023-12-16T03:25:16.420344+0000","last_became_active":"2023-12-16T03:25:14.937684+0000","last_became_peered":"2023-12-16T03:25:14.937684+0000","last_unstale":"2023-12-16T03:25:16.420344+0000","last_undegraded":"2023-12-16T03:25:16.420344+0000","last_fullsized":"2023-12-16T03:25:16.420344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423696+0000","last_change":"2023-12-16T03:25:15.433590+0000","last_active":"2023-12-16T03:25:16.423696+0000","last_peered":"2023-12-16T03:25:16.423696+0000","last_clean":"2023-12-16T03:25:16.423696+0000","last_became_active":"2023-12-16T03:25:15.433276+0000","last_became_peered":"2023-12-16T03:25:15.433276+0000","last_unstale":"2023-12-16T03:25:16.423696+0000","last_undegraded":"2023-12-16T03:25:16.423696+0000","last_fullsized":"2023-12-16T03:25:16.423696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:59.239833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437138+0000","last_change":"2023-12-16T03:25:14.953294+0000","last_active":"2023-12-16T03:25:16.437138+0000","last_peered":"2023-12-16T03:25:16.437138+0000","last_clean":"2023-12-16T03:25:16.437138+0000","last_became_active":"2023-12-16T03:25:14.952984+0000","last_became_peered":"2023-12-16T03:25:14.952984+0000","last_unstale":"2023-12-16T03:25:16.437138+0000","last_undegraded":"2023-12-16T03:25:16.437138+0000","last_fullsized":"2023-12-16T03:25:16.437138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:24.531152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420255+0000","last_change":"2023-12-16T03:25:15.429623+0000","last_active":"2023-12-16T03:25:16.420255+0000","last_peered":"2023-12-16T03:25:16.420255+0000","last_clean":"2023-12-16T03:25:16.420255+0000","last_became_active":"2023-12-16T03:25:15.428854+0000","last_became_peered":"2023-12-16T03:25:15.428854+0000","last_unstale":"2023-12-16T03:25:16.420255+0000","last_undegraded":"2023-12-16T03:25:16.420255+0000","last_fullsized":"2023-12-16T03:25:16.420255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420276+0000","last_change":"2023-12-16T03:25:14.939501+0000","last_active":"2023-12-16T03:25:16.420276+0000","last_peered":"2023-12-16T03:25:16.420276+0000","last_clean":"2023-12-16T03:25:16.420276+0000","last_became_active":"2023-12-16T03:25:14.939114+0000","last_became_peered":"2023-12-16T03:25:14.939114+0000","last_unstale":"2023-12-16T03:25:16.420276+0000","last_undegraded":"2023-12-16T03:25:16.420276+0000","last_fullsized":"2023-12-16T03:25:16.420276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437431+0000","last_change":"2023-12-16T03:25:15.448503+0000","last_active":"2023-12-16T03:25:16.437431+0000","last_peered":"2023-12-16T03:25:16.437431+0000","last_clean":"2023-12-16T03:25:16.437431+0000","last_became_active":"2023-12-16T03:25:15.448186+0000","last_became_peered":"2023-12-16T03:25:15.448186+0000","last_unstale":"2023-12-16T03:25:16.437431+0000","last_undegraded":"2023-12-16T03:25:16.437431+0000","last_fullsized":"2023-12-16T03:25:16.437431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:55.217497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437182+0000","last_change":"2023-12-16T03:25:14.939279+0000","last_active":"2023-12-16T03:25:16.437182+0000","last_peered":"2023-12-16T03:25:16.437182+0000","last_clean":"2023-12-16T03:25:16.437182+0000","last_became_active":"2023-12-16T03:25:14.938540+0000","last_became_peered":"2023-12-16T03:25:14.938540+0000","last_unstale":"2023-12-16T03:25:16.437182+0000","last_undegraded":"2023-12-16T03:25:16.437182+0000","last_fullsized":"2023-12-16T03:25:16.437182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437699+0000","last_change":"2023-12-16T03:25:15.427756+0000","last_active":"2023-12-16T03:25:16.437699+0000","last_peered":"2023-12-16T03:25:16.437699+0000","last_clean":"2023-12-16T03:25:16.437699+0000","last_became_active":"2023-12-16T03:25:15.427401+0000","last_became_peered":"2023-12-16T03:25:15.427401+0000","last_unstale":"2023-12-16T03:25:16.437699+0000","last_undegraded":"2023-12-16T03:25:16.437699+0000","last_fullsized":"2023-12-16T03:25:16.437699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436329+0000","last_change":"2023-12-16T03:25:14.947007+0000","last_active":"2023-12-16T03:25:16.436329+0000","last_peered":"2023-12-16T03:25:16.436329+0000","last_clean":"2023-12-16T03:25:16.436329+0000","last_became_active":"2023-12-16T03:25:14.946763+0000","last_became_peered":"2023-12-16T03:25:14.946763+0000","last_unstale":"2023-12-16T03:25:16.436329+0000","last_undegraded":"2023-12-16T03:25:16.436329+0000","last_fullsized":"2023-12-16T03:25:16.436329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:06.962968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422510+0000","last_change":"2023-12-16T03:25:15.439566+0000","last_active":"2023-12-16T03:25:16.422510+0000","last_peered":"2023-12-16T03:25:16.422510+0000","last_clean":"2023-12-16T03:25:16.422510+0000","last_became_active":"2023-12-16T03:25:15.437769+0000","last_became_peered":"2023-12-16T03:25:15.437769+0000","last_unstale":"2023-12-16T03:25:16.422510+0000","last_undegraded":"2023-12-16T03:25:16.422510+0000","last_fullsized":"2023-12-16T03:25:16.422510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:07.969752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420174+0000","last_change":"2023-12-16T03:25:14.946813+0000","last_active":"2023-12-16T03:25:16.420174+0000","last_peered":"2023-12-16T03:25:16.420174+0000","last_clean":"2023-12-16T03:25:16.420174+0000","last_became_active":"2023-12-16T03:25:14.945910+0000","last_became_peered":"2023-12-16T03:25:14.945910+0000","last_unstale":"2023-12-16T03:25:16.420174+0000","last_undegraded":"2023-12-16T03:25:16.420174+0000","last_fullsized":"2023-12-16T03:25:16.420174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436674+0000","last_change":"2023-12-16T03:25:15.429536+0000","last_active":"2023-12-16T03:25:16.436674+0000","last_peered":"2023-12-16T03:25:16.436674+0000","last_clean":"2023-12-16T03:25:16.436674+0000","last_became_active":"2023-12-16T03:25:15.429171+0000","last_became_peered":"2023-12-16T03:25:15.429171+0000","last_unstale":"2023-12-16T03:25:16.436674+0000","last_undegraded":"2023-12-16T03:25:16.436674+0000","last_fullsized":"2023-12-16T03:25:16.436674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420262+0000","last_change":"2023-12-16T03:25:14.947177+0000","last_active":"2023-12-16T03:25:16.420262+0000","last_peered":"2023-12-16T03:25:16.420262+0000","last_clean":"2023-12-16T03:25:16.420262+0000","last_became_active":"2023-12-16T03:25:14.946894+0000","last_became_peered":"2023-12-16T03:25:14.946894+0000","last_unstale":"2023-12-16T03:25:16.420262+0000","last_undegraded":"2023-12-16T03:25:16.420262+0000","last_fullsized":"2023-12-16T03:25:16.420262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437502+0000","last_change":"2023-12-16T03:25:15.428105+0000","last_active":"2023-12-16T03:25:16.437502+0000","last_peered":"2023-12-16T03:25:16.437502+0000","last_clean":"2023-12-16T03:25:16.437502+0000","last_became_active":"2023-12-16T03:25:15.426561+0000","last_became_peered":"2023-12-16T03:25:15.426561+0000","last_unstale":"2023-12-16T03:25:16.437502+0000","last_undegraded":"2023-12-16T03:25:16.437502+0000","last_fullsized":"2023-12-16T03:25:16.437502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436841+0000","last_change":"2023-12-16T03:25:14.952976+0000","last_active":"2023-12-16T03:25:16.436841+0000","last_peered":"2023-12-16T03:25:16.436841+0000","last_clean":"2023-12-16T03:25:16.436841+0000","last_became_active":"2023-12-16T03:25:14.952639+0000","last_became_peered":"2023-12-16T03:25:14.952639+0000","last_unstale":"2023-12-16T03:25:16.436841+0000","last_undegraded":"2023-12-16T03:25:16.436841+0000","last_fullsized":"2023-12-16T03:25:16.436841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:34.131498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436490+0000","last_change":"2023-12-16T03:25:15.450361+0000","last_active":"2023-12-16T03:25:16.436490+0000","last_peered":"2023-12-16T03:25:16.436490+0000","last_clean":"2023-12-16T03:25:16.436490+0000","last_became_active":"2023-12-16T03:25:15.450027+0000","last_became_peered":"2023-12-16T03:25:15.450027+0000","last_unstale":"2023-12-16T03:25:16.436490+0000","last_undegraded":"2023-12-16T03:25:16.436490+0000","last_fullsized":"2023-12-16T03:25:16.436490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423578+0000","last_change":"2023-12-16T03:25:15.442370+0000","last_active":"2023-12-16T03:25:16.423578+0000","last_peered":"2023-12-16T03:25:16.423578+0000","last_clean":"2023-12-16T03:25:16.423578+0000","last_became_active":"2023-12-16T03:25:15.442003+0000","last_became_peered":"2023-12-16T03:25:15.442003+0000","last_unstale":"2023-12-16T03:25:16.423578+0000","last_undegraded":"2023-12-16T03:25:16.423578+0000","last_fullsized":"2023-12-16T03:25:16.423578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:20:54.316492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437042+0000","last_change":"2023-12-16T03:25:14.955054+0000","last_active":"2023-12-16T03:25:16.437042+0000","last_peered":"2023-12-16T03:25:16.437042+0000","last_clean":"2023-12-16T03:25:16.437042+0000","last_became_active":"2023-12-16T03:25:14.954769+0000","last_became_peered":"2023-12-16T03:25:14.954769+0000","last_unstale":"2023-12-16T03:25:16.437042+0000","last_undegraded":"2023-12-16T03:25:16.437042+0000","last_fullsized":"2023-12-16T03:25:16.437042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423008+0000","last_change":"2023-12-16T03:25:15.447590+0000","last_active":"2023-12-16T03:25:16.423008+0000","last_peered":"2023-12-16T03:25:16.423008+0000","last_clean":"2023-12-16T03:25:16.423008+0000","last_became_active":"2023-12-16T03:25:15.447289+0000","last_became_peered":"2023-12-16T03:25:15.447289+0000","last_unstale":"2023-12-16T03:25:16.423008+0000","last_undegraded":"2023-12-16T03:25:16.423008+0000","last_fullsized":"2023-12-16T03:25:16.423008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436960+0000","last_change":"2023-12-16T03:25:14.953280+0000","last_active":"2023-12-16T03:25:16.436960+0000","last_peered":"2023-12-16T03:25:16.436960+0000","last_clean":"2023-12-16T03:25:16.436960+0000","last_became_active":"2023-12-16T03:25:14.952971+0000","last_became_peered":"2023-12-16T03:25:14.952971+0000","last_unstale":"2023-12-16T03:25:16.436960+0000","last_undegraded":"2023-12-16T03:25:16.436960+0000","last_fullsized":"2023-12-16T03:25:16.436960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437747+0000","last_change":"2023-12-16T03:25:15.433498+0000","last_active":"2023-12-16T03:25:16.437747+0000","last_peered":"2023-12-16T03:25:16.437747+0000","last_clean":"2023-12-16T03:25:16.437747+0000","last_became_active":"2023-12-16T03:25:15.433191+0000","last_became_peered":"2023-12-16T03:25:15.433191+0000","last_unstale":"2023-12-16T03:25:16.437747+0000","last_undegraded":"2023-12-16T03:25:16.437747+0000","last_fullsized":"2023-12-16T03:25:16.437747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437453+0000","last_change":"2023-12-16T03:25:14.938585+0000","last_active":"2023-12-16T03:25:16.437453+0000","last_peered":"2023-12-16T03:25:16.437453+0000","last_clean":"2023-12-16T03:25:16.437453+0000","last_became_active":"2023-12-16T03:25:14.938292+0000","last_became_peered":"2023-12-16T03:25:14.938292+0000","last_unstale":"2023-12-16T03:25:16.437453+0000","last_undegraded":"2023-12-16T03:25:16.437453+0000","last_fullsized":"2023-12-16T03:25:16.437453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437584+0000","last_change":"2023-12-16T03:25:15.440625+0000","last_active":"2023-12-16T03:25:16.437584+0000","last_peered":"2023-12-16T03:25:16.437584+0000","last_clean":"2023-12-16T03:25:16.437584+0000","last_became_active":"2023-12-16T03:25:15.440302+0000","last_became_peered":"2023-12-16T03:25:15.440302+0000","last_unstale":"2023-12-16T03:25:16.437584+0000","last_undegraded":"2023-12-16T03:25:16.437584+0000","last_fullsized":"2023-12-16T03:25:16.437584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437844+0000","last_change":"2023-12-16T03:25:14.942593+0000","last_active":"2023-12-16T03:25:16.437844+0000","last_peered":"2023-12-16T03:25:16.437844+0000","last_clean":"2023-12-16T03:25:16.437844+0000","last_became_active":"2023-12-16T03:25:14.942331+0000","last_became_peered":"2023-12-16T03:25:14.942331+0000","last_unstale":"2023-12-16T03:25:16.437844+0000","last_undegraded":"2023-12-16T03:25:16.437844+0000","last_fullsized":"2023-12-16T03:25:16.437844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:25:20.044 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:25:20.180 INFO:tasks.ceph.mds.b.smithi134.stderr:2023-12-16T03:25:20.176+0000 7f8e45f9a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:25:20.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.224+0000 7f04c4a79640 1 Processor -- start 2023-12-16T03:25:20.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.224+0000 7f04c4a79640 1 -- start start 2023-12-16T03:25:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.224+0000 7f04c4a79640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f04c01560e0 0x7f04c015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.224+0000 7f04c4a79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c00bffc0 0x7f04c00c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.224+0000 7f04c4a79640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c015c600 con 0x7f04c006d520 2023-12-16T03:25:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.224+0000 7f04c4a79640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c015a5c0 con 0x7f04c01560e0 2023-12-16T03:25:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.224+0000 7f04c4a79640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c01594e0 con 0x7f04c00bffc0 2023-12-16T03:25:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.224+0000 7f04bdd9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f04c006d520 0x7f04c0159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57784/0 (socket says 172.21.15.28:57784) 2023-12-16T03:25:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.224+0000 7f04bdd9b640 1 -- 172.21.15.28:0/4194365610 learned_addr learned my addr 172.21.15.28:0/4194365610 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04be59c640 1 --2- 172.21.15.28:0/4194365610 >> v2:172.21.15.134:3300/0 conn(0x7f04c01560e0 0x7f04c015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bed9d640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c00bffc0 0x7f04c00c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811658386 0 0) 0x7f04c015c600 con 0x7f04c006d520 2023-12-16T03:25:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04a8003530 con 0x7f04c006d520 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4143316471 0 0) 0x7f04a8003530 con 0x7f04c006d520 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c00bffc0 msgr2=0x7f04c00c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c00bffc0 0x7f04c00c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 >> v2:172.21.15.134:3300/0 conn(0x7f04c01560e0 msgr2=0x7f04c015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 --2- 172.21.15.28:0/4194365610 >> v2:172.21.15.134:3300/0 conn(0x7f04c01560e0 0x7f04c015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c01597c0 con 0x7f04c006d520 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f04b4001680 con 0x7f04c006d520 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 >> v1:172.21.15.28:6789/0 conn(0x7f04c006d520 legacy=0x7f04c0159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04a8003980 0x7f04a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04a80047d0 0x7f04a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c00bffc0 0x7f04a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c015a5c0 con 0x7f04a80047d0 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c01594e0 con 0x7f04a8003980 2023-12-16T03:25:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a800b990 con 0x7f04c00bffc0 2023-12-16T03:25:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bdd9b640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04a80047d0 0x7f04a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04be59c640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04a8003980 0x7f04a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bed9d640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c00bffc0 0x7f04a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bdd9b640 1 -- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c00bffc0 msgr2=0x7f04a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bdd9b640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c00bffc0 0x7f04a8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bdd9b640 1 -- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04a8003980 msgr2=0x7f04a8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bdd9b640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04a8003980 0x7f04a8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bdd9b640 1 -- 172.21.15.28:0/4194365610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a8003530 con 0x7f04a80047d0 2023-12-16T03:25:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.228+0000 7f04bed9d640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c00bffc0 0x7f04a8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04bdd9b640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04a80047d0 0x7f04a8004c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c210 tx=0x7f04b401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac4bfd60b0cb237 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40a8cb0 con 0x7f04a80047d0 2023-12-16T03:25:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b40a8e10 con 0x7f04a80047d0 2023-12-16T03:25:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04bd59a640 1 -- 172.21.15.28:0/4194365610 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4005b00 con 0x7f04a80047d0 2023-12-16T03:25:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04c4a79640 1 -- 172.21.15.28:0/4194365610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04a80047d0 msgr2=0x7f04a8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04c4a79640 1 --2- 172.21.15.28:0/4194365610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04a80047d0 0x7f04a8004c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c210 tx=0x7f04b401f390 comp rx=0 tx=0).stop 2023-12-16T03:25:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04bed9d640 1 -- 172.21.15.28:0/4194365610 reap_dead start 2023-12-16T03:25:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04c4a79640 1 -- 172.21.15.28:0/4194365610 shutdown_connections 2023-12-16T03:25:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04c4a79640 1 -- 172.21.15.28:0/4194365610 >> 172.21.15.28:0/4194365610 conn(0x7f04c006a5b0 msgr2=0x7f04c006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04c4a79640 1 -- 172.21.15.28:0/4194365610 shutdown_connections 2023-12-16T03:25:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04c4a79640 1 -- 172.21.15.28:0/4194365610 wait complete. 2023-12-16T03:25:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04c4a79640 1 Processor -- start 2023-12-16T03:25:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.232+0000 7f04c4a79640 1 -- start start 2023-12-16T03:25:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04c4a79640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04a80047d0 0x7f04c00c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04c4a79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04c0155740 0x7f04c014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04c4a79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c014b310 0x7f04c01ee720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04c4a79640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c00a40c0 con 0x7f04c0155740 2023-12-16T03:25:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04c4a79640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c01ee2f0 con 0x7f04a80047d0 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04c4a79640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c00a2280 con 0x7f04c014b310 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04bdd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04c0155740 0x7f04c014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04bdd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04c0155740 0x7f04c014add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38434/0 (socket says 172.21.15.28:38434) 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04bdd9b640 1 -- 172.21.15.28:0/3165756136 learned_addr learned my addr 172.21.15.28:0/3165756136 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04be59c640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04a80047d0 0x7f04c00c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04bed9d640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c014b310 0x7f04c01ee720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04bdd9b640 1 -- 172.21.15.28:0/3165756136 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c014b310 msgr2=0x7f04c01ee720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04bdd9b640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c014b310 0x7f04c01ee720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04bdd9b640 1 -- 172.21.15.28:0/3165756136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04a80047d0 msgr2=0x7f04c00c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04bdd9b640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04a80047d0 0x7f04c00c51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04bdd9b640 1 -- 172.21.15.28:0/3165756136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c014b7c0 con 0x7f04c0155740 2023-12-16T03:25:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04bdd9b640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04c0155740 0x7f04c014add0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c210 tx=0x7f04a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:20.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04aeffd640 1 -- 172.21.15.28:0/3165756136 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40049f0 con 0x7f04c0155740 2023-12-16T03:25:20.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04aeffd640 1 -- 172.21.15.28:0/3165756136 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b40b6070 con 0x7f04c0155740 2023-12-16T03:25:20.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04aeffd640 1 -- 172.21.15.28:0/3165756136 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4004d70 con 0x7f04c0155740 2023-12-16T03:25:20.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04c4a79640 1 -- 172.21.15.28:0/3165756136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c00aa0a0 con 0x7f04c0155740 2023-12-16T03:25:20.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04c4a79640 1 -- 172.21.15.28:0/3165756136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c00aa360 con 0x7f04c0155740 2023-12-16T03:25:20.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04c4a79640 1 -- 172.21.15.28:0/3165756136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c01ee440 con 0x7f04c0155740 2023-12-16T03:25:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.236+0000 7f04aeffd640 1 -- 172.21.15.28:0/3165756136 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f04b40070d0 con 0x7f04c0155740 2023-12-16T03:25:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.240+0000 7f04aeffd640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04a00664a0 0x7f04a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.240+0000 7f04aeffd640 1 -- 172.21.15.28:0/3165756136 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04b40b8070 con 0x7f04c0155740 2023-12-16T03:25:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.240+0000 7f04be59c640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04a00664a0 0x7f04a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.240+0000 7f04be59c640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04a00664a0 0x7f04a0068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009be0 tx=0x7f04b0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:20.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.244+0000 7f04aeffd640 1 -- 172.21.15.28:0/3165756136 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f04c01ee440 con 0x7f04c0155740 2023-12-16T03:25:20.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.400+0000 7f04c4a79640 1 -- 172.21.15.28:0/3165756136 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04c015a840 con 0x7f04a00664a0 2023-12-16T03:25:20.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.404+0000 7f04aeffd640 1 -- 172.21.15.28:0/3165756136 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264672 (secure 0 0 0) 0x7f04c015a840 con 0x7f04a00664a0 2023-12-16T03:25:20.411 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:25:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 -- 172.21.15.28:0/3165756136 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04a00664a0 msgr2=0x7f04a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04a00664a0 0x7f04a0068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009be0 tx=0x7f04b0009190 comp rx=0 tx=0).stop 2023-12-16T03:25:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 -- 172.21.15.28:0/3165756136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04c0155740 msgr2=0x7f04c014add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04c0155740 0x7f04c014add0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c210 tx=0x7f04a8005800 comp rx=0 tx=0).stop 2023-12-16T03:25:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 -- 172.21.15.28:0/3165756136 shutdown_connections 2023-12-16T03:25:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04c014b310 0x7f04c01ee720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04a00664a0 0x7f04a0068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04c0155740 0x7f04c014add0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 --2- 172.21.15.28:0/3165756136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04a80047d0 0x7f04c00c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 -- 172.21.15.28:0/3165756136 >> 172.21.15.28:0/3165756136 conn(0x7f04c006a5b0 msgr2=0x7f04c00a5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 -- 172.21.15.28:0/3165756136 shutdown_connections 2023-12-16T03:25:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.408+0000 7f04c4a79640 1 -- 172.21.15.28:0/3165756136 wait complete. 2023-12-16T03:25:20.431 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-16T03:25:19.794219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235624,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739096,"statfs":{"total":773094113280,"available":772852834304,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.887472"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437358+0000","last_change":"2023-12-16T03:25:15.452175+0000","last_active":"2023-12-16T03:25:16.437358+0000","last_peered":"2023-12-16T03:25:16.437358+0000","last_clean":"2023-12-16T03:25:16.437358+0000","last_became_active":"2023-12-16T03:25:15.451916+0000","last_became_peered":"2023-12-16T03:25:15.451916+0000","last_unstale":"2023-12-16T03:25:16.437358+0000","last_undegraded":"2023-12-16T03:25:16.437358+0000","last_fullsized":"2023-12-16T03:25:16.437358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:43.581686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420315+0000","last_change":"2023-12-16T03:25:15.425458+0000","last_active":"2023-12-16T03:25:16.420315+0000","last_peered":"2023-12-16T03:25:16.420315+0000","last_clean":"2023-12-16T03:25:16.420315+0000","last_became_active":"2023-12-16T03:25:15.425194+0000","last_became_peered":"2023-12-16T03:25:15.425194+0000","last_unstale":"2023-12-16T03:25:16.420315+0000","last_undegraded":"2023-12-16T03:25:16.420315+0000","last_fullsized":"2023-12-16T03:25:16.420315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437452+0000","last_change":"2023-12-16T03:25:15.425638+0000","last_active":"2023-12-16T03:25:16.437452+0000","last_peered":"2023-12-16T03:25:16.437452+0000","last_clean":"2023-12-16T03:25:16.437452+0000","last_became_active":"2023-12-16T03:25:15.425353+0000","last_became_peered":"2023-12-16T03:25:15.425353+0000","last_unstale":"2023-12-16T03:25:16.437452+0000","last_undegraded":"2023-12-16T03:25:16.437452+0000","last_fullsized":"2023-12-16T03:25:16.437452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422853+0000","last_change":"2023-12-16T03:25:15.434050+0000","last_active":"2023-12-16T03:25:16.422853+0000","last_peered":"2023-12-16T03:25:16.422853+0000","last_clean":"2023-12-16T03:25:16.422853+0000","last_became_active":"2023-12-16T03:25:15.433643+0000","last_became_peered":"2023-12-16T03:25:15.433643+0000","last_unstale":"2023-12-16T03:25:16.422853+0000","last_undegraded":"2023-12-16T03:25:16.422853+0000","last_fullsized":"2023-12-16T03:25:16.422853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436512+0000","last_change":"2023-12-16T03:25:15.445800+0000","last_active":"2023-12-16T03:25:16.436512+0000","last_peered":"2023-12-16T03:25:16.436512+0000","last_clean":"2023-12-16T03:25:16.436512+0000","last_became_active":"2023-12-16T03:25:15.445496+0000","last_became_peered":"2023-12-16T03:25:15.445496+0000","last_unstale":"2023-12-16T03:25:16.436512+0000","last_undegraded":"2023-12-16T03:25:16.436512+0000","last_fullsized":"2023-12-16T03:25:16.436512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422916+0000","last_change":"2023-12-16T03:25:15.433130+0000","last_active":"2023-12-16T03:25:16.422916+0000","last_peered":"2023-12-16T03:25:16.422916+0000","last_clean":"2023-12-16T03:25:16.422916+0000","last_became_active":"2023-12-16T03:25:15.432783+0000","last_became_peered":"2023-12-16T03:25:15.432783+0000","last_unstale":"2023-12-16T03:25:16.422916+0000","last_undegraded":"2023-12-16T03:25:16.422916+0000","last_fullsized":"2023-12-16T03:25:16.422916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:55.217497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436380+0000","last_change":"2023-12-16T03:25:15.443935+0000","last_active":"2023-12-16T03:25:16.436380+0000","last_peered":"2023-12-16T03:25:16.436380+0000","last_clean":"2023-12-16T03:25:16.436380+0000","last_became_active":"2023-12-16T03:25:15.443601+0000","last_became_peered":"2023-12-16T03:25:15.443601+0000","last_unstale":"2023-12-16T03:25:16.436380+0000","last_undegraded":"2023-12-16T03:25:16.436380+0000","last_fullsized":"2023-12-16T03:25:16.436380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436427+0000","last_change":"2023-12-16T03:25:15.431879+0000","last_active":"2023-12-16T03:25:16.436427+0000","last_peered":"2023-12-16T03:25:16.436427+0000","last_clean":"2023-12-16T03:25:16.436427+0000","last_became_active":"2023-12-16T03:25:15.431564+0000","last_became_peered":"2023-12-16T03:25:15.431564+0000","last_unstale":"2023-12-16T03:25:16.436427+0000","last_undegraded":"2023-12-16T03:25:16.436427+0000","last_fullsized":"2023-12-16T03:25:16.436427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437342+0000","last_change":"2023-12-16T03:25:15.446906+0000","last_active":"2023-12-16T03:25:16.437342+0000","last_peered":"2023-12-16T03:25:16.437342+0000","last_clean":"2023-12-16T03:25:16.437342+0000","last_became_active":"2023-12-16T03:25:15.446136+0000","last_became_peered":"2023-12-16T03:25:15.446136+0000","last_unstale":"2023-12-16T03:25:16.437342+0000","last_undegraded":"2023-12-16T03:25:16.437342+0000","last_fullsized":"2023-12-16T03:25:16.437342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:54:38.927177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436922+0000","last_change":"2023-12-16T03:25:15.437274+0000","last_active":"2023-12-16T03:25:16.436922+0000","last_peered":"2023-12-16T03:25:16.436922+0000","last_clean":"2023-12-16T03:25:16.436922+0000","last_became_active":"2023-12-16T03:25:15.436993+0000","last_became_peered":"2023-12-16T03:25:15.436993+0000","last_unstale":"2023-12-16T03:25:16.436922+0000","last_undegraded":"2023-12-16T03:25:16.436922+0000","last_fullsized":"2023-12-16T03:25:16.436922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436247+0000","last_change":"2023-12-16T03:25:15.439228+0000","last_active":"2023-12-16T03:25:16.436247+0000","last_peered":"2023-12-16T03:25:16.436247+0000","last_clean":"2023-12-16T03:25:16.436247+0000","last_became_active":"2023-12-16T03:25:15.437550+0000","last_became_peered":"2023-12-16T03:25:15.437550+0000","last_unstale":"2023-12-16T03:25:16.436247+0000","last_undegraded":"2023-12-16T03:25:16.436247+0000","last_fullsized":"2023-12-16T03:25:16.436247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422787+0000","last_change":"2023-12-16T03:25:15.442026+0000","last_active":"2023-12-16T03:25:16.422787+0000","last_peered":"2023-12-16T03:25:16.422787+0000","last_clean":"2023-12-16T03:25:16.422787+0000","last_became_active":"2023-12-16T03:25:15.441374+0000","last_became_peered":"2023-12-16T03:25:15.441374+0000","last_unstale":"2023-12-16T03:25:16.422787+0000","last_undegraded":"2023-12-16T03:25:16.422787+0000","last_fullsized":"2023-12-16T03:25:16.422787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:21.931497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437544+0000","last_change":"2023-12-16T03:25:15.431327+0000","last_active":"2023-12-16T03:25:16.437544+0000","last_peered":"2023-12-16T03:25:16.437544+0000","last_clean":"2023-12-16T03:25:16.437544+0000","last_became_active":"2023-12-16T03:25:15.430973+0000","last_became_peered":"2023-12-16T03:25:15.430973+0000","last_unstale":"2023-12-16T03:25:16.437544+0000","last_undegraded":"2023-12-16T03:25:16.437544+0000","last_fullsized":"2023-12-16T03:25:16.437544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436524+0000","last_change":"2023-12-16T03:25:15.426240+0000","last_active":"2023-12-16T03:25:16.436524+0000","last_peered":"2023-12-16T03:25:16.436524+0000","last_clean":"2023-12-16T03:25:16.436524+0000","last_became_active":"2023-12-16T03:25:15.425045+0000","last_became_peered":"2023-12-16T03:25:15.425045+0000","last_unstale":"2023-12-16T03:25:16.436524+0000","last_undegraded":"2023-12-16T03:25:16.436524+0000","last_fullsized":"2023-12-16T03:25:16.436524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:11.236920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420099+0000","last_change":"2023-12-16T03:25:15.449282+0000","last_active":"2023-12-16T03:25:16.420099+0000","last_peered":"2023-12-16T03:25:16.420099+0000","last_clean":"2023-12-16T03:25:16.420099+0000","last_became_active":"2023-12-16T03:25:15.449009+0000","last_became_peered":"2023-12-16T03:25:15.449009+0000","last_unstale":"2023-12-16T03:25:16.420099+0000","last_undegraded":"2023-12-16T03:25:16.420099+0000","last_fullsized":"2023-12-16T03:25:16.420099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422703+0000","last_change":"2023-12-16T03:25:15.433001+0000","last_active":"2023-12-16T03:25:16.422703+0000","last_peered":"2023-12-16T03:25:16.422703+0000","last_clean":"2023-12-16T03:25:16.422703+0000","last_became_active":"2023-12-16T03:25:15.432331+0000","last_became_peered":"2023-12-16T03:25:15.432331+0000","last_unstale":"2023-12-16T03:25:16.422703+0000","last_undegraded":"2023-12-16T03:25:16.422703+0000","last_fullsized":"2023-12-16T03:25:16.422703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423697+0000","last_change":"2023-12-16T03:25:15.446721+0000","last_active":"2023-12-16T03:25:16.423697+0000","last_peered":"2023-12-16T03:25:16.423697+0000","last_clean":"2023-12-16T03:25:16.423697+0000","last_became_active":"2023-12-16T03:25:15.446449+0000","last_became_peered":"2023-12-16T03:25:15.446449+0000","last_unstale":"2023-12-16T03:25:16.423697+0000","last_undegraded":"2023-12-16T03:25:16.423697+0000","last_fullsized":"2023-12-16T03:25:16.423697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:00.341013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437037+0000","last_change":"2023-12-16T03:25:15.440602+0000","last_active":"2023-12-16T03:25:16.437037+0000","last_peered":"2023-12-16T03:25:16.437037+0000","last_clean":"2023-12-16T03:25:16.437037+0000","last_became_active":"2023-12-16T03:25:15.440121+0000","last_became_peered":"2023-12-16T03:25:15.440121+0000","last_unstale":"2023-12-16T03:25:16.437037+0000","last_undegraded":"2023-12-16T03:25:16.437037+0000","last_fullsized":"2023-12-16T03:25:16.437037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:07.619534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437099+0000","last_change":"2023-12-16T03:25:15.445828+0000","last_active":"2023-12-16T03:25:16.437099+0000","last_peered":"2023-12-16T03:25:16.437099+0000","last_clean":"2023-12-16T03:25:16.437099+0000","last_became_active":"2023-12-16T03:25:15.445531+0000","last_became_peered":"2023-12-16T03:25:15.445531+0000","last_unstale":"2023-12-16T03:25:16.437099+0000","last_undegraded":"2023-12-16T03:25:16.437099+0000","last_fullsized":"2023-12-16T03:25:16.437099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:59.239833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436366+0000","last_change":"2023-12-16T03:25:15.449537+0000","last_active":"2023-12-16T03:25:16.436366+0000","last_peered":"2023-12-16T03:25:16.436366+0000","last_clean":"2023-12-16T03:25:16.436366+0000","last_became_active":"2023-12-16T03:25:15.449070+0000","last_became_peered":"2023-12-16T03:25:15.449070+0000","last_unstale":"2023-12-16T03:25:16.436366+0000","last_undegraded":"2023-12-16T03:25:16.436366+0000","last_fullsized":"2023-12-16T03:25:16.436366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436601+0000","last_change":"2023-12-16T03:25:15.432034+0000","last_active":"2023-12-16T03:25:16.436601+0000","last_peered":"2023-12-16T03:25:16.436601+0000","last_clean":"2023-12-16T03:25:16.436601+0000","last_became_active":"2023-12-16T03:25:15.431749+0000","last_became_peered":"2023-12-16T03:25:15.431749+0000","last_unstale":"2023-12-16T03:25:16.436601+0000","last_undegraded":"2023-12-16T03:25:16.436601+0000","last_fullsized":"2023-12-16T03:25:16.436601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:37:00.957991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423015+0000","last_change":"2023-12-16T03:25:15.444757+0000","last_active":"2023-12-16T03:25:16.423015+0000","last_peered":"2023-12-16T03:25:16.423015+0000","last_clean":"2023-12-16T03:25:16.423015+0000","last_became_active":"2023-12-16T03:25:15.443767+0000","last_became_peered":"2023-12-16T03:25:15.443767+0000","last_unstale":"2023-12-16T03:25:16.423015+0000","last_undegraded":"2023-12-16T03:25:16.423015+0000","last_fullsized":"2023-12-16T03:25:16.423015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436894+0000","last_change":"2023-12-16T03:25:15.442263+0000","last_active":"2023-12-16T03:25:16.436894+0000","last_peered":"2023-12-16T03:25:16.436894+0000","last_clean":"2023-12-16T03:25:16.436894+0000","last_became_active":"2023-12-16T03:25:15.441740+0000","last_became_peered":"2023-12-16T03:25:15.441740+0000","last_unstale":"2023-12-16T03:25:16.436894+0000","last_undegraded":"2023-12-16T03:25:16.436894+0000","last_fullsized":"2023-12-16T03:25:16.436894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422740+0000","last_change":"2023-12-16T03:25:15.433490+0000","last_active":"2023-12-16T03:25:16.422740+0000","last_peered":"2023-12-16T03:25:16.422740+0000","last_clean":"2023-12-16T03:25:16.422740+0000","last_became_active":"2023-12-16T03:25:15.431932+0000","last_became_peered":"2023-12-16T03:25:15.431932+0000","last_unstale":"2023-12-16T03:25:16.422740+0000","last_undegraded":"2023-12-16T03:25:16.422740+0000","last_fullsized":"2023-12-16T03:25:16.422740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437338+0000","last_change":"2023-12-16T03:25:15.450545+0000","last_active":"2023-12-16T03:25:16.437338+0000","last_peered":"2023-12-16T03:25:16.437338+0000","last_clean":"2023-12-16T03:25:16.437338+0000","last_became_active":"2023-12-16T03:25:15.450331+0000","last_became_peered":"2023-12-16T03:25:15.450331+0000","last_unstale":"2023-12-16T03:25:16.437338+0000","last_undegraded":"2023-12-16T03:25:16.437338+0000","last_fullsized":"2023-12-16T03:25:16.437338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436987+0000","last_change":"2023-12-16T03:25:15.439606+0000","last_active":"2023-12-16T03:25:16.436987+0000","last_peered":"2023-12-16T03:25:16.436987+0000","last_clean":"2023-12-16T03:25:16.436987+0000","last_became_active":"2023-12-16T03:25:15.439192+0000","last_became_peered":"2023-12-16T03:25:15.439192+0000","last_unstale":"2023-12-16T03:25:16.436987+0000","last_undegraded":"2023-12-16T03:25:16.436987+0000","last_fullsized":"2023-12-16T03:25:16.436987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420282+0000","last_change":"2023-12-16T03:25:15.432802+0000","last_active":"2023-12-16T03:25:16.420282+0000","last_peered":"2023-12-16T03:25:16.420282+0000","last_clean":"2023-12-16T03:25:16.420282+0000","last_became_active":"2023-12-16T03:25:15.432545+0000","last_became_peered":"2023-12-16T03:25:15.432545+0000","last_unstale":"2023-12-16T03:25:16.420282+0000","last_undegraded":"2023-12-16T03:25:16.420282+0000","last_fullsized":"2023-12-16T03:25:16.420282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437287+0000","last_change":"2023-12-16T03:25:15.441487+0000","last_active":"2023-12-16T03:25:16.437287+0000","last_peered":"2023-12-16T03:25:16.437287+0000","last_clean":"2023-12-16T03:25:16.437287+0000","last_became_active":"2023-12-16T03:25:15.441150+0000","last_became_peered":"2023-12-16T03:25:15.441150+0000","last_unstale":"2023-12-16T03:25:16.437287+0000","last_undegraded":"2023-12-16T03:25:16.437287+0000","last_fullsized":"2023-12-16T03:25:16.437287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436778+0000","last_change":"2023-12-16T03:25:15.427812+0000","last_active":"2023-12-16T03:25:16.436778+0000","last_peered":"2023-12-16T03:25:16.436778+0000","last_clean":"2023-12-16T03:25:16.436778+0000","last_became_active":"2023-12-16T03:25:15.427532+0000","last_became_peered":"2023-12-16T03:25:15.427532+0000","last_unstale":"2023-12-16T03:25:16.436778+0000","last_undegraded":"2023-12-16T03:25:16.436778+0000","last_fullsized":"2023-12-16T03:25:16.436778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423136+0000","last_change":"2023-12-16T03:25:15.431187+0000","last_active":"2023-12-16T03:25:16.423136+0000","last_peered":"2023-12-16T03:25:16.423136+0000","last_clean":"2023-12-16T03:25:16.423136+0000","last_became_active":"2023-12-16T03:25:15.430884+0000","last_became_peered":"2023-12-16T03:25:15.430884+0000","last_unstale":"2023-12-16T03:25:16.423136+0000","last_undegraded":"2023-12-16T03:25:16.423136+0000","last_fullsized":"2023-12-16T03:25:16.423136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436280+0000","last_change":"2023-12-16T03:25:15.432854+0000","last_active":"2023-12-16T03:25:16.436280+0000","last_peered":"2023-12-16T03:25:16.436280+0000","last_clean":"2023-12-16T03:25:16.436280+0000","last_became_active":"2023-12-16T03:25:15.432566+0000","last_became_peered":"2023-12-16T03:25:15.432566+0000","last_unstale":"2023-12-16T03:25:16.436280+0000","last_undegraded":"2023-12-16T03:25:16.436280+0000","last_fullsized":"2023-12-16T03:25:16.436280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:39.322218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436057+0000","last_change":"2023-12-16T03:25:15.430509+0000","last_active":"2023-12-16T03:25:16.436057+0000","last_peered":"2023-12-16T03:25:16.436057+0000","last_clean":"2023-12-16T03:25:16.436057+0000","last_became_active":"2023-12-16T03:25:15.430160+0000","last_became_peered":"2023-12-16T03:25:15.430160+0000","last_unstale":"2023-12-16T03:25:16.436057+0000","last_undegraded":"2023-12-16T03:25:16.436057+0000","last_fullsized":"2023-12-16T03:25:16.436057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422522+0000","last_change":"2023-12-16T03:25:15.441852+0000","last_active":"2023-12-16T03:25:16.422522+0000","last_peered":"2023-12-16T03:25:16.422522+0000","last_clean":"2023-12-16T03:25:16.422522+0000","last_became_active":"2023-12-16T03:25:15.441128+0000","last_became_peered":"2023-12-16T03:25:15.441128+0000","last_unstale":"2023-12-16T03:25:16.422522+0000","last_undegraded":"2023-12-16T03:25:16.422522+0000","last_fullsized":"2023-12-16T03:25:16.422522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:37.465934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437593+0000","last_change":"2023-12-16T03:25:14.944628+0000","last_active":"2023-12-16T03:25:16.437593+0000","last_peered":"2023-12-16T03:25:16.437593+0000","last_clean":"2023-12-16T03:25:16.437593+0000","last_became_active":"2023-12-16T03:25:14.944278+0000","last_became_peered":"2023-12-16T03:25:14.944278+0000","last_unstale":"2023-12-16T03:25:16.437593+0000","last_undegraded":"2023-12-16T03:25:16.437593+0000","last_fullsized":"2023-12-16T03:25:16.437593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436947+0000","last_change":"2023-12-16T03:25:15.438299+0000","last_active":"2023-12-16T03:25:16.436947+0000","last_peered":"2023-12-16T03:25:16.436947+0000","last_clean":"2023-12-16T03:25:16.436947+0000","last_became_active":"2023-12-16T03:25:15.437923+0000","last_became_peered":"2023-12-16T03:25:15.437923+0000","last_unstale":"2023-12-16T03:25:16.436947+0000","last_undegraded":"2023-12-16T03:25:16.436947+0000","last_fullsized":"2023-12-16T03:25:16.436947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436200+0000","last_change":"2023-12-16T03:25:14.952619+0000","last_active":"2023-12-16T03:25:16.436200+0000","last_peered":"2023-12-16T03:25:16.436200+0000","last_clean":"2023-12-16T03:25:16.436200+0000","last_became_active":"2023-12-16T03:25:14.951351+0000","last_became_peered":"2023-12-16T03:25:14.951351+0000","last_unstale":"2023-12-16T03:25:16.436200+0000","last_undegraded":"2023-12-16T03:25:16.436200+0000","last_fullsized":"2023-12-16T03:25:16.436200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437048+0000","last_change":"2023-12-16T03:25:14.939694+0000","last_active":"2023-12-16T03:25:16.437048+0000","last_peered":"2023-12-16T03:25:16.437048+0000","last_clean":"2023-12-16T03:25:16.437048+0000","last_became_active":"2023-12-16T03:25:14.939359+0000","last_became_peered":"2023-12-16T03:25:14.939359+0000","last_unstale":"2023-12-16T03:25:16.437048+0000","last_undegraded":"2023-12-16T03:25:16.437048+0000","last_fullsized":"2023-12-16T03:25:16.437048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436550+0000","last_change":"2023-12-16T03:25:15.426946+0000","last_active":"2023-12-16T03:25:16.436550+0000","last_peered":"2023-12-16T03:25:16.436550+0000","last_clean":"2023-12-16T03:25:16.436550+0000","last_became_active":"2023-12-16T03:25:15.426548+0000","last_became_peered":"2023-12-16T03:25:15.426548+0000","last_unstale":"2023-12-16T03:25:16.436550+0000","last_undegraded":"2023-12-16T03:25:16.436550+0000","last_fullsized":"2023-12-16T03:25:16.436550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422798+0000","last_change":"2023-12-16T03:25:14.942071+0000","last_active":"2023-12-16T03:25:16.422798+0000","last_peered":"2023-12-16T03:25:16.422798+0000","last_clean":"2023-12-16T03:25:16.422798+0000","last_became_active":"2023-12-16T03:25:14.941786+0000","last_became_peered":"2023-12-16T03:25:14.941786+0000","last_unstale":"2023-12-16T03:25:16.422798+0000","last_undegraded":"2023-12-16T03:25:16.422798+0000","last_fullsized":"2023-12-16T03:25:16.422798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:34.131498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420100+0000","last_change":"2023-12-16T03:25:15.429804+0000","last_active":"2023-12-16T03:25:16.420100+0000","last_peered":"2023-12-16T03:25:16.420100+0000","last_clean":"2023-12-16T03:25:16.420100+0000","last_became_active":"2023-12-16T03:25:15.429063+0000","last_became_peered":"2023-12-16T03:25:15.429063+0000","last_unstale":"2023-12-16T03:25:16.420100+0000","last_undegraded":"2023-12-16T03:25:16.420100+0000","last_fullsized":"2023-12-16T03:25:16.420100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437091+0000","last_change":"2023-12-16T03:25:14.946494+0000","last_active":"2023-12-16T03:25:16.437091+0000","last_peered":"2023-12-16T03:25:16.437091+0000","last_clean":"2023-12-16T03:25:16.437091+0000","last_became_active":"2023-12-16T03:25:14.946193+0000","last_became_peered":"2023-12-16T03:25:14.946193+0000","last_unstale":"2023-12-16T03:25:16.437091+0000","last_undegraded":"2023-12-16T03:25:16.437091+0000","last_fullsized":"2023-12-16T03:25:16.437091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423512+0000","last_change":"2023-12-16T03:25:15.444625+0000","last_active":"2023-12-16T03:25:16.423512+0000","last_peered":"2023-12-16T03:25:16.423512+0000","last_clean":"2023-12-16T03:25:16.423512+0000","last_became_active":"2023-12-16T03:25:15.444322+0000","last_became_peered":"2023-12-16T03:25:15.444322+0000","last_unstale":"2023-12-16T03:25:16.423512+0000","last_undegraded":"2023-12-16T03:25:16.423512+0000","last_fullsized":"2023-12-16T03:25:16.423512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:07.831312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423548+0000","last_change":"2023-12-16T03:25:14.943434+0000","last_active":"2023-12-16T03:25:16.423548+0000","last_peered":"2023-12-16T03:25:16.423548+0000","last_clean":"2023-12-16T03:25:16.423548+0000","last_became_active":"2023-12-16T03:25:14.942914+0000","last_became_peered":"2023-12-16T03:25:14.942914+0000","last_unstale":"2023-12-16T03:25:16.423548+0000","last_undegraded":"2023-12-16T03:25:16.423548+0000","last_fullsized":"2023-12-16T03:25:16.423548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437746+0000","last_change":"2023-12-16T03:25:15.433507+0000","last_active":"2023-12-16T03:25:16.437746+0000","last_peered":"2023-12-16T03:25:16.437746+0000","last_clean":"2023-12-16T03:25:16.437746+0000","last_became_active":"2023-12-16T03:25:15.433228+0000","last_became_peered":"2023-12-16T03:25:15.433228+0000","last_unstale":"2023-12-16T03:25:16.437746+0000","last_undegraded":"2023-12-16T03:25:16.437746+0000","last_fullsized":"2023-12-16T03:25:16.437746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420270+0000","last_change":"2023-12-16T03:25:14.948029+0000","last_active":"2023-12-16T03:25:16.420270+0000","last_peered":"2023-12-16T03:25:16.420270+0000","last_clean":"2023-12-16T03:25:16.420270+0000","last_became_active":"2023-12-16T03:25:14.947608+0000","last_became_peered":"2023-12-16T03:25:14.947608+0000","last_unstale":"2023-12-16T03:25:16.420270+0000","last_undegraded":"2023-12-16T03:25:16.420270+0000","last_fullsized":"2023-12-16T03:25:16.420270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422868+0000","last_change":"2023-12-16T03:25:15.448886+0000","last_active":"2023-12-16T03:25:16.422868+0000","last_peered":"2023-12-16T03:25:16.422868+0000","last_clean":"2023-12-16T03:25:16.422868+0000","last_became_active":"2023-12-16T03:25:15.448576+0000","last_became_peered":"2023-12-16T03:25:15.448576+0000","last_unstale":"2023-12-16T03:25:16.422868+0000","last_undegraded":"2023-12-16T03:25:16.422868+0000","last_fullsized":"2023-12-16T03:25:16.422868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:39.322218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436460+0000","last_change":"2023-12-16T03:25:14.938057+0000","last_active":"2023-12-16T03:25:16.436460+0000","last_peered":"2023-12-16T03:25:16.436460+0000","last_clean":"2023-12-16T03:25:16.436460+0000","last_became_active":"2023-12-16T03:25:14.937091+0000","last_became_peered":"2023-12-16T03:25:14.937091+0000","last_unstale":"2023-12-16T03:25:16.436460+0000","last_undegraded":"2023-12-16T03:25:16.436460+0000","last_fullsized":"2023-12-16T03:25:16.436460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436738+0000","last_change":"2023-12-16T03:25:15.444073+0000","last_active":"2023-12-16T03:25:16.436738+0000","last_peered":"2023-12-16T03:25:16.436738+0000","last_clean":"2023-12-16T03:25:16.436738+0000","last_became_active":"2023-12-16T03:25:15.443746+0000","last_became_peered":"2023-12-16T03:25:15.443746+0000","last_unstale":"2023-12-16T03:25:16.436738+0000","last_undegraded":"2023-12-16T03:25:16.436738+0000","last_fullsized":"2023-12-16T03:25:16.436738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:20:54.316492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437145+0000","last_change":"2023-12-16T03:25:14.945151+0000","last_active":"2023-12-16T03:25:16.437145+0000","last_peered":"2023-12-16T03:25:16.437145+0000","last_clean":"2023-12-16T03:25:16.437145+0000","last_became_active":"2023-12-16T03:25:14.937913+0000","last_became_peered":"2023-12-16T03:25:14.937913+0000","last_unstale":"2023-12-16T03:25:16.437145+0000","last_undegraded":"2023-12-16T03:25:16.437145+0000","last_fullsized":"2023-12-16T03:25:16.437145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:36.459150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436602+0000","last_change":"2023-12-16T03:25:15.443554+0000","last_active":"2023-12-16T03:25:16.436602+0000","last_peered":"2023-12-16T03:25:16.436602+0000","last_clean":"2023-12-16T03:25:16.436602+0000","last_became_active":"2023-12-16T03:25:15.443275+0000","last_became_peered":"2023-12-16T03:25:15.443275+0000","last_unstale":"2023-12-16T03:25:16.436602+0000","last_undegraded":"2023-12-16T03:25:16.436602+0000","last_fullsized":"2023-12-16T03:25:16.436602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423115+0000","last_change":"2023-12-16T03:25:14.948755+0000","last_active":"2023-12-16T03:25:16.423115+0000","last_peered":"2023-12-16T03:25:16.423115+0000","last_clean":"2023-12-16T03:25:16.423115+0000","last_became_active":"2023-12-16T03:25:14.948399+0000","last_became_peered":"2023-12-16T03:25:14.948399+0000","last_unstale":"2023-12-16T03:25:16.423115+0000","last_undegraded":"2023-12-16T03:25:16.423115+0000","last_fullsized":"2023-12-16T03:25:16.423115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436672+0000","last_change":"2023-12-16T03:25:15.454032+0000","last_active":"2023-12-16T03:25:16.436672+0000","last_peered":"2023-12-16T03:25:16.436672+0000","last_clean":"2023-12-16T03:25:16.436672+0000","last_became_active":"2023-12-16T03:25:15.453722+0000","last_became_peered":"2023-12-16T03:25:15.453722+0000","last_unstale":"2023-12-16T03:25:16.436672+0000","last_undegraded":"2023-12-16T03:25:16.436672+0000","last_fullsized":"2023-12-16T03:25:16.436672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:07.831312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436040+0000","last_change":"2023-12-16T03:25:14.938917+0000","last_active":"2023-12-16T03:25:16.436040+0000","last_peered":"2023-12-16T03:25:16.436040+0000","last_clean":"2023-12-16T03:25:16.436040+0000","last_became_active":"2023-12-16T03:25:14.938389+0000","last_became_peered":"2023-12-16T03:25:14.938389+0000","last_unstale":"2023-12-16T03:25:16.436040+0000","last_undegraded":"2023-12-16T03:25:16.436040+0000","last_fullsized":"2023-12-16T03:25:16.436040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436799+0000","last_change":"2023-12-16T03:25:15.431222+0000","last_active":"2023-12-16T03:25:16.436799+0000","last_peered":"2023-12-16T03:25:16.436799+0000","last_clean":"2023-12-16T03:25:16.436799+0000","last_became_active":"2023-12-16T03:25:15.430884+0000","last_became_peered":"2023-12-16T03:25:15.430884+0000","last_unstale":"2023-12-16T03:25:16.436799+0000","last_undegraded":"2023-12-16T03:25:16.436799+0000","last_fullsized":"2023-12-16T03:25:16.436799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436272+0000","last_change":"2023-12-16T03:25:14.937196+0000","last_active":"2023-12-16T03:25:16.436272+0000","last_peered":"2023-12-16T03:25:16.436272+0000","last_clean":"2023-12-16T03:25:16.436272+0000","last_became_active":"2023-12-16T03:25:14.935102+0000","last_became_peered":"2023-12-16T03:25:14.935102+0000","last_unstale":"2023-12-16T03:25:16.436272+0000","last_undegraded":"2023-12-16T03:25:16.436272+0000","last_fullsized":"2023-12-16T03:25:16.436272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:39:22.295470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436578+0000","last_change":"2023-12-16T03:25:15.455089+0000","last_active":"2023-12-16T03:25:16.436578+0000","last_peered":"2023-12-16T03:25:16.436578+0000","last_clean":"2023-12-16T03:25:16.436578+0000","last_became_active":"2023-12-16T03:25:15.454725+0000","last_became_peered":"2023-12-16T03:25:15.454725+0000","last_unstale":"2023-12-16T03:25:16.436578+0000","last_undegraded":"2023-12-16T03:25:16.436578+0000","last_fullsized":"2023-12-16T03:25:16.436578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:29.020229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422895+0000","last_change":"2023-12-16T03:25:14.941188+0000","last_active":"2023-12-16T03:25:16.422895+0000","last_peered":"2023-12-16T03:25:16.422895+0000","last_clean":"2023-12-16T03:25:16.422895+0000","last_became_active":"2023-12-16T03:25:14.940811+0000","last_became_peered":"2023-12-16T03:25:14.940811+0000","last_unstale":"2023-12-16T03:25:16.422895+0000","last_undegraded":"2023-12-16T03:25:16.422895+0000","last_fullsized":"2023-12-16T03:25:16.422895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:08.626152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436563+0000","last_change":"2023-12-16T03:25:15.452042+0000","last_active":"2023-12-16T03:25:16.436563+0000","last_peered":"2023-12-16T03:25:16.436563+0000","last_clean":"2023-12-16T03:25:16.436563+0000","last_became_active":"2023-12-16T03:25:15.451737+0000","last_became_peered":"2023-12-16T03:25:15.451737+0000","last_unstale":"2023-12-16T03:25:16.436563+0000","last_undegraded":"2023-12-16T03:25:16.436563+0000","last_fullsized":"2023-12-16T03:25:16.436563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437165+0000","last_change":"2023-12-16T03:25:14.938664+0000","last_active":"2023-12-16T03:25:16.437165+0000","last_peered":"2023-12-16T03:25:16.437165+0000","last_clean":"2023-12-16T03:25:16.437165+0000","last_became_active":"2023-12-16T03:25:14.938324+0000","last_became_peered":"2023-12-16T03:25:14.938324+0000","last_unstale":"2023-12-16T03:25:16.437165+0000","last_undegraded":"2023-12-16T03:25:16.437165+0000","last_fullsized":"2023-12-16T03:25:16.437165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:36.459150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437416+0000","last_change":"2023-12-16T03:25:15.455016+0000","last_active":"2023-12-16T03:25:16.437416+0000","last_peered":"2023-12-16T03:25:16.437416+0000","last_clean":"2023-12-16T03:25:16.437416+0000","last_became_active":"2023-12-16T03:25:15.454715+0000","last_became_peered":"2023-12-16T03:25:15.454715+0000","last_unstale":"2023-12-16T03:25:16.437416+0000","last_undegraded":"2023-12-16T03:25:16.437416+0000","last_fullsized":"2023-12-16T03:25:16.437416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:02:53.965844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420363+0000","last_change":"2023-12-16T03:25:14.942353+0000","last_active":"2023-12-16T03:25:16.420363+0000","last_peered":"2023-12-16T03:25:16.420363+0000","last_clean":"2023-12-16T03:25:16.420363+0000","last_became_active":"2023-12-16T03:25:14.942088+0000","last_became_peered":"2023-12-16T03:25:14.942088+0000","last_unstale":"2023-12-16T03:25:16.420363+0000","last_undegraded":"2023-12-16T03:25:16.420363+0000","last_fullsized":"2023-12-16T03:25:16.420363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:36:59.951207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423137+0000","last_change":"2023-12-16T03:25:15.433902+0000","last_active":"2023-12-16T03:25:16.423137+0000","last_peered":"2023-12-16T03:25:16.423137+0000","last_clean":"2023-12-16T03:25:16.423137+0000","last_became_active":"2023-12-16T03:25:15.432579+0000","last_became_peered":"2023-12-16T03:25:15.432579+0000","last_unstale":"2023-12-16T03:25:16.423137+0000","last_undegraded":"2023-12-16T03:25:16.423137+0000","last_fullsized":"2023-12-16T03:25:16.423137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:29.020229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436825+0000","last_change":"2023-12-16T03:25:14.949089+0000","last_active":"2023-12-16T03:25:16.436825+0000","last_peered":"2023-12-16T03:25:16.436825+0000","last_clean":"2023-12-16T03:25:16.436825+0000","last_became_active":"2023-12-16T03:25:14.948668+0000","last_became_peered":"2023-12-16T03:25:14.948668+0000","last_unstale":"2023-12-16T03:25:16.436825+0000","last_undegraded":"2023-12-16T03:25:16.436825+0000","last_fullsized":"2023-12-16T03:25:16.436825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:06.962968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436870+0000","last_change":"2023-12-16T03:25:15.445232+0000","last_active":"2023-12-16T03:25:16.436870+0000","last_peered":"2023-12-16T03:25:16.436870+0000","last_clean":"2023-12-16T03:25:16.436870+0000","last_became_active":"2023-12-16T03:25:15.444929+0000","last_became_peered":"2023-12-16T03:25:15.444929+0000","last_unstale":"2023-12-16T03:25:16.436870+0000","last_undegraded":"2023-12-16T03:25:16.436870+0000","last_fullsized":"2023-12-16T03:25:16.436870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:00.341013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-16T03:25:15.435898+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:25:15.435898+0000","last_peered":"2023-12-16T03:25:15.435898+0000","last_clean":"2023-12-16T03:25:15.435898+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:25:15.435898+0000","last_undegraded":"2023-12-16T03:25:15.435898+0000","last_fullsized":"2023-12-16T03:25:15.435898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423217+0000","last_change":"2023-12-16T03:25:14.941508+0000","last_active":"2023-12-16T03:25:16.423217+0000","last_peered":"2023-12-16T03:25:16.423217+0000","last_clean":"2023-12-16T03:25:16.423217+0000","last_became_active":"2023-12-16T03:25:14.941128+0000","last_became_peered":"2023-12-16T03:25:14.941128+0000","last_unstale":"2023-12-16T03:25:16.423217+0000","last_undegraded":"2023-12-16T03:25:16.423217+0000","last_fullsized":"2023-12-16T03:25:16.423217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:34.241901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437288+0000","last_change":"2023-12-16T03:25:15.433356+0000","last_active":"2023-12-16T03:25:16.437288+0000","last_peered":"2023-12-16T03:25:16.437288+0000","last_clean":"2023-12-16T03:25:16.437288+0000","last_became_active":"2023-12-16T03:25:15.433010+0000","last_became_peered":"2023-12-16T03:25:15.433010+0000","last_unstale":"2023-12-16T03:25:16.437288+0000","last_undegraded":"2023-12-16T03:25:16.437288+0000","last_fullsized":"2023-12-16T03:25:16.437288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436448+0000","last_change":"2023-12-16T03:25:14.951710+0000","last_active":"2023-12-16T03:25:16.436448+0000","last_peered":"2023-12-16T03:25:16.436448+0000","last_clean":"2023-12-16T03:25:16.436448+0000","last_became_active":"2023-12-16T03:25:14.951249+0000","last_became_peered":"2023-12-16T03:25:14.951249+0000","last_unstale":"2023-12-16T03:25:16.436448+0000","last_undegraded":"2023-12-16T03:25:16.436448+0000","last_fullsized":"2023-12-16T03:25:16.436448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:20.924714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436461+0000","last_change":"2023-12-16T03:25:15.449196+0000","last_active":"2023-12-16T03:25:16.436461+0000","last_peered":"2023-12-16T03:25:16.436461+0000","last_clean":"2023-12-16T03:25:16.436461+0000","last_became_active":"2023-12-16T03:25:15.448896+0000","last_became_peered":"2023-12-16T03:25:15.448896+0000","last_unstale":"2023-12-16T03:25:16.436461+0000","last_undegraded":"2023-12-16T03:25:16.436461+0000","last_fullsized":"2023-12-16T03:25:16.436461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:06.946403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436387+0000","last_change":"2023-12-16T03:25:14.931491+0000","last_active":"2023-12-16T03:25:16.436387+0000","last_peered":"2023-12-16T03:25:16.436387+0000","last_clean":"2023-12-16T03:25:16.436387+0000","last_became_active":"2023-12-16T03:25:14.931114+0000","last_became_peered":"2023-12-16T03:25:14.931114+0000","last_unstale":"2023-12-16T03:25:16.436387+0000","last_undegraded":"2023-12-16T03:25:16.436387+0000","last_fullsized":"2023-12-16T03:25:16.436387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:34.241901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420119+0000","last_change":"2023-12-16T03:25:15.428698+0000","last_active":"2023-12-16T03:25:16.420119+0000","last_peered":"2023-12-16T03:25:16.420119+0000","last_clean":"2023-12-16T03:25:16.420119+0000","last_became_active":"2023-12-16T03:25:15.424710+0000","last_became_peered":"2023-12-16T03:25:15.424710+0000","last_unstale":"2023-12-16T03:25:16.420119+0000","last_undegraded":"2023-12-16T03:25:16.420119+0000","last_fullsized":"2023-12-16T03:25:16.420119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423180+0000","last_change":"2023-12-16T03:25:14.942839+0000","last_active":"2023-12-16T03:25:16.423180+0000","last_peered":"2023-12-16T03:25:16.423180+0000","last_clean":"2023-12-16T03:25:16.423180+0000","last_became_active":"2023-12-16T03:25:14.942596+0000","last_became_peered":"2023-12-16T03:25:14.942596+0000","last_unstale":"2023-12-16T03:25:16.423180+0000","last_undegraded":"2023-12-16T03:25:16.423180+0000","last_fullsized":"2023-12-16T03:25:16.423180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:36:59.951207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423043+0000","last_change":"2023-12-16T03:25:15.437137+0000","last_active":"2023-12-16T03:25:16.423043+0000","last_peered":"2023-12-16T03:25:16.423043+0000","last_clean":"2023-12-16T03:25:16.423043+0000","last_became_active":"2023-12-16T03:25:15.436800+0000","last_became_peered":"2023-12-16T03:25:15.436800+0000","last_unstale":"2023-12-16T03:25:16.423043+0000","last_undegraded":"2023-12-16T03:25:16.423043+0000","last_fullsized":"2023-12-16T03:25:16.423043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:07.619534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420344+0000","last_change":"2023-12-16T03:25:14.937971+0000","last_active":"2023-12-16T03:25:16.420344+0000","last_peered":"2023-12-16T03:25:16.420344+0000","last_clean":"2023-12-16T03:25:16.420344+0000","last_became_active":"2023-12-16T03:25:14.937684+0000","last_became_peered":"2023-12-16T03:25:14.937684+0000","last_unstale":"2023-12-16T03:25:16.420344+0000","last_undegraded":"2023-12-16T03:25:16.420344+0000","last_fullsized":"2023-12-16T03:25:16.420344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423696+0000","last_change":"2023-12-16T03:25:15.433590+0000","last_active":"2023-12-16T03:25:16.423696+0000","last_peered":"2023-12-16T03:25:16.423696+0000","last_clean":"2023-12-16T03:25:16.423696+0000","last_became_active":"2023-12-16T03:25:15.433276+0000","last_became_peered":"2023-12-16T03:25:15.433276+0000","last_unstale":"2023-12-16T03:25:16.423696+0000","last_undegraded":"2023-12-16T03:25:16.423696+0000","last_fullsized":"2023-12-16T03:25:16.423696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:59.239833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437138+0000","last_change":"2023-12-16T03:25:14.953294+0000","last_active":"2023-12-16T03:25:16.437138+0000","last_peered":"2023-12-16T03:25:16.437138+0000","last_clean":"2023-12-16T03:25:16.437138+0000","last_became_active":"2023-12-16T03:25:14.952984+0000","last_became_peered":"2023-12-16T03:25:14.952984+0000","last_unstale":"2023-12-16T03:25:16.437138+0000","last_undegraded":"2023-12-16T03:25:16.437138+0000","last_fullsized":"2023-12-16T03:25:16.437138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:24.531152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420255+0000","last_change":"2023-12-16T03:25:15.429623+0000","last_active":"2023-12-16T03:25:16.420255+0000","last_peered":"2023-12-16T03:25:16.420255+0000","last_clean":"2023-12-16T03:25:16.420255+0000","last_became_active":"2023-12-16T03:25:15.428854+0000","last_became_peered":"2023-12-16T03:25:15.428854+0000","last_unstale":"2023-12-16T03:25:16.420255+0000","last_undegraded":"2023-12-16T03:25:16.420255+0000","last_fullsized":"2023-12-16T03:25:16.420255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420276+0000","last_change":"2023-12-16T03:25:14.939501+0000","last_active":"2023-12-16T03:25:16.420276+0000","last_peered":"2023-12-16T03:25:16.420276+0000","last_clean":"2023-12-16T03:25:16.420276+0000","last_became_active":"2023-12-16T03:25:14.939114+0000","last_became_peered":"2023-12-16T03:25:14.939114+0000","last_unstale":"2023-12-16T03:25:16.420276+0000","last_undegraded":"2023-12-16T03:25:16.420276+0000","last_fullsized":"2023-12-16T03:25:16.420276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437431+0000","last_change":"2023-12-16T03:25:15.448503+0000","last_active":"2023-12-16T03:25:16.437431+0000","last_peered":"2023-12-16T03:25:16.437431+0000","last_clean":"2023-12-16T03:25:16.437431+0000","last_became_active":"2023-12-16T03:25:15.448186+0000","last_became_peered":"2023-12-16T03:25:15.448186+0000","last_unstale":"2023-12-16T03:25:16.437431+0000","last_undegraded":"2023-12-16T03:25:16.437431+0000","last_fullsized":"2023-12-16T03:25:16.437431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:55.217497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437182+0000","last_change":"2023-12-16T03:25:14.939279+0000","last_active":"2023-12-16T03:25:16.437182+0000","last_peered":"2023-12-16T03:25:16.437182+0000","last_clean":"2023-12-16T03:25:16.437182+0000","last_became_active":"2023-12-16T03:25:14.938540+0000","last_became_peered":"2023-12-16T03:25:14.938540+0000","last_unstale":"2023-12-16T03:25:16.437182+0000","last_undegraded":"2023-12-16T03:25:16.437182+0000","last_fullsized":"2023-12-16T03:25:16.437182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437699+0000","last_change":"2023-12-16T03:25:15.427756+0000","last_active":"2023-12-16T03:25:16.437699+0000","last_peered":"2023-12-16T03:25:16.437699+0000","last_clean":"2023-12-16T03:25:16.437699+0000","last_became_active":"2023-12-16T03:25:15.427401+0000","last_became_peered":"2023-12-16T03:25:15.427401+0000","last_unstale":"2023-12-16T03:25:16.437699+0000","last_undegraded":"2023-12-16T03:25:16.437699+0000","last_fullsized":"2023-12-16T03:25:16.437699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436329+0000","last_change":"2023-12-16T03:25:14.947007+0000","last_active":"2023-12-16T03:25:16.436329+0000","last_peered":"2023-12-16T03:25:16.436329+0000","last_clean":"2023-12-16T03:25:16.436329+0000","last_became_active":"2023-12-16T03:25:14.946763+0000","last_became_peered":"2023-12-16T03:25:14.946763+0000","last_unstale":"2023-12-16T03:25:16.436329+0000","last_undegraded":"2023-12-16T03:25:16.436329+0000","last_fullsized":"2023-12-16T03:25:16.436329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:06.962968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422510+0000","last_change":"2023-12-16T03:25:15.439566+0000","last_active":"2023-12-16T03:25:16.422510+0000","last_peered":"2023-12-16T03:25:16.422510+0000","last_clean":"2023-12-16T03:25:16.422510+0000","last_became_active":"2023-12-16T03:25:15.437769+0000","last_became_peered":"2023-12-16T03:25:15.437769+0000","last_unstale":"2023-12-16T03:25:16.422510+0000","last_undegraded":"2023-12-16T03:25:16.422510+0000","last_fullsized":"2023-12-16T03:25:16.422510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:07.969752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420174+0000","last_change":"2023-12-16T03:25:14.946813+0000","last_active":"2023-12-16T03:25:16.420174+0000","last_peered":"2023-12-16T03:25:16.420174+0000","last_clean":"2023-12-16T03:25:16.420174+0000","last_became_active":"2023-12-16T03:25:14.945910+0000","last_became_peered":"2023-12-16T03:25:14.945910+0000","last_unstale":"2023-12-16T03:25:16.420174+0000","last_undegraded":"2023-12-16T03:25:16.420174+0000","last_fullsized":"2023-12-16T03:25:16.420174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436674+0000","last_change":"2023-12-16T03:25:15.429536+0000","last_active":"2023-12-16T03:25:16.436674+0000","last_peered":"2023-12-16T03:25:16.436674+0000","last_clean":"2023-12-16T03:25:16.436674+0000","last_became_active":"2023-12-16T03:25:15.429171+0000","last_became_peered":"2023-12-16T03:25:15.429171+0000","last_unstale":"2023-12-16T03:25:16.436674+0000","last_undegraded":"2023-12-16T03:25:16.436674+0000","last_fullsized":"2023-12-16T03:25:16.436674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420262+0000","last_change":"2023-12-16T03:25:14.947177+0000","last_active":"2023-12-16T03:25:16.420262+0000","last_peered":"2023-12-16T03:25:16.420262+0000","last_clean":"2023-12-16T03:25:16.420262+0000","last_became_active":"2023-12-16T03:25:14.946894+0000","last_became_peered":"2023-12-16T03:25:14.946894+0000","last_unstale":"2023-12-16T03:25:16.420262+0000","last_undegraded":"2023-12-16T03:25:16.420262+0000","last_fullsized":"2023-12-16T03:25:16.420262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437502+0000","last_change":"2023-12-16T03:25:15.428105+0000","last_active":"2023-12-16T03:25:16.437502+0000","last_peered":"2023-12-16T03:25:16.437502+0000","last_clean":"2023-12-16T03:25:16.437502+0000","last_became_active":"2023-12-16T03:25:15.426561+0000","last_became_peered":"2023-12-16T03:25:15.426561+0000","last_unstale":"2023-12-16T03:25:16.437502+0000","last_undegraded":"2023-12-16T03:25:16.437502+0000","last_fullsized":"2023-12-16T03:25:16.437502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436841+0000","last_change":"2023-12-16T03:25:14.952976+0000","last_active":"2023-12-16T03:25:16.436841+0000","last_peered":"2023-12-16T03:25:16.436841+0000","last_clean":"2023-12-16T03:25:16.436841+0000","last_became_active":"2023-12-16T03:25:14.952639+0000","last_became_peered":"2023-12-16T03:25:14.952639+0000","last_unstale":"2023-12-16T03:25:16.436841+0000","last_undegraded":"2023-12-16T03:25:16.436841+0000","last_fullsized":"2023-12-16T03:25:16.436841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:34.131498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436490+0000","last_change":"2023-12-16T03:25:15.450361+0000","last_active":"2023-12-16T03:25:16.436490+0000","last_peered":"2023-12-16T03:25:16.436490+0000","last_clean":"2023-12-16T03:25:16.436490+0000","last_became_active":"2023-12-16T03:25:15.450027+0000","last_became_peered":"2023-12-16T03:25:15.450027+0000","last_unstale":"2023-12-16T03:25:16.436490+0000","last_undegraded":"2023-12-16T03:25:16.436490+0000","last_fullsized":"2023-12-16T03:25:16.436490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423578+0000","last_change":"2023-12-16T03:25:15.442370+0000","last_active":"2023-12-16T03:25:16.423578+0000","last_peered":"2023-12-16T03:25:16.423578+0000","last_clean":"2023-12-16T03:25:16.423578+0000","last_became_active":"2023-12-16T03:25:15.442003+0000","last_became_peered":"2023-12-16T03:25:15.442003+0000","last_unstale":"2023-12-16T03:25:16.423578+0000","last_undegraded":"2023-12-16T03:25:16.423578+0000","last_fullsized":"2023-12-16T03:25:16.423578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:20:54.316492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437042+0000","last_change":"2023-12-16T03:25:14.955054+0000","last_active":"2023-12-16T03:25:16.437042+0000","last_peered":"2023-12-16T03:25:16.437042+0000","last_clean":"2023-12-16T03:25:16.437042+0000","last_became_active":"2023-12-16T03:25:14.954769+0000","last_became_peered":"2023-12-16T03:25:14.954769+0000","last_unstale":"2023-12-16T03:25:16.437042+0000","last_undegraded":"2023-12-16T03:25:16.437042+0000","last_fullsized":"2023-12-16T03:25:16.437042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423008+0000","last_change":"2023-12-16T03:25:15.447590+0000","last_active":"2023-12-16T03:25:16.423008+0000","last_peered":"2023-12-16T03:25:16.423008+0000","last_clean":"2023-12-16T03:25:16.423008+0000","last_became_active":"2023-12-16T03:25:15.447289+0000","last_became_peered":"2023-12-16T03:25:15.447289+0000","last_unstale":"2023-12-16T03:25:16.423008+0000","last_undegraded":"2023-12-16T03:25:16.423008+0000","last_fullsized":"2023-12-16T03:25:16.423008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436960+0000","last_change":"2023-12-16T03:25:14.953280+0000","last_active":"2023-12-16T03:25:16.436960+0000","last_peered":"2023-12-16T03:25:16.436960+0000","last_clean":"2023-12-16T03:25:16.436960+0000","last_became_active":"2023-12-16T03:25:14.952971+0000","last_became_peered":"2023-12-16T03:25:14.952971+0000","last_unstale":"2023-12-16T03:25:16.436960+0000","last_undegraded":"2023-12-16T03:25:16.436960+0000","last_fullsized":"2023-12-16T03:25:16.436960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437747+0000","last_change":"2023-12-16T03:25:15.433498+0000","last_active":"2023-12-16T03:25:16.437747+0000","last_peered":"2023-12-16T03:25:16.437747+0000","last_clean":"2023-12-16T03:25:16.437747+0000","last_became_active":"2023-12-16T03:25:15.433191+0000","last_became_peered":"2023-12-16T03:25:15.433191+0000","last_unstale":"2023-12-16T03:25:16.437747+0000","last_undegraded":"2023-12-16T03:25:16.437747+0000","last_fullsized":"2023-12-16T03:25:16.437747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437453+0000","last_change":"2023-12-16T03:25:14.938585+0000","last_active":"2023-12-16T03:25:16.437453+0000","last_peered":"2023-12-16T03:25:16.437453+0000","last_clean":"2023-12-16T03:25:16.437453+0000","last_became_active":"2023-12-16T03:25:14.938292+0000","last_became_peered":"2023-12-16T03:25:14.938292+0000","last_unstale":"2023-12-16T03:25:16.437453+0000","last_undegraded":"2023-12-16T03:25:16.437453+0000","last_fullsized":"2023-12-16T03:25:16.437453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437584+0000","last_change":"2023-12-16T03:25:15.440625+0000","last_active":"2023-12-16T03:25:16.437584+0000","last_peered":"2023-12-16T03:25:16.437584+0000","last_clean":"2023-12-16T03:25:16.437584+0000","last_became_active":"2023-12-16T03:25:15.440302+0000","last_became_peered":"2023-12-16T03:25:15.440302+0000","last_unstale":"2023-12-16T03:25:16.437584+0000","last_undegraded":"2023-12-16T03:25:16.437584+0000","last_fullsized":"2023-12-16T03:25:16.437584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437844+0000","last_change":"2023-12-16T03:25:14.942593+0000","last_active":"2023-12-16T03:25:16.437844+0000","last_peered":"2023-12-16T03:25:16.437844+0000","last_clean":"2023-12-16T03:25:16.437844+0000","last_became_active":"2023-12-16T03:25:14.942331+0000","last_became_peered":"2023-12-16T03:25:14.942331+0000","last_unstale":"2023-12-16T03:25:16.437844+0000","last_undegraded":"2023-12-16T03:25:16.437844+0000","last_fullsized":"2023-12-16T03:25:16.437844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:25:20.436 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-16T03:25:20.436 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-16T03:25:20.436 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-16T03:25:20.436 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-16T03:25:20.437 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-16T03:25:20.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.612+0000 7f190a606640 1 Processor -- start 2023-12-16T03:25:20.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.612+0000 7f190a606640 1 -- start start 2023-12-16T03:25:20.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.616+0000 7f190a606640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f19040c1010 0x7f19040aa830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.616+0000 7f190a606640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19040c01f0 con 0x7f190406e360 2023-12-16T03:25:20.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.616+0000 7f190a606640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19040c04d0 con 0x7f1904158240 2023-12-16T03:25:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.616+0000 7f190a606640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1904154850 con 0x7f19040c1010 2023-12-16T03:25:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.616+0000 7f1909604640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f19040c1010 0x7f19040aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.616+0000 7f1908e03640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f190406e360 0x7f1904157b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57792/0 (socket says 172.21.15.28:57792) 2023-12-16T03:25:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.616+0000 7f1908e03640 1 -- 172.21.15.28:0/615353072 learned_addr learned my addr 172.21.15.28:0/615353072 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.616+0000 7f1909604640 1 -- 172.21.15.28:0/615353072 >> v1:172.21.15.134:6789/0 conn(0x7f1904158240 legacy=0x7f190415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.616+0000 7f1909604640 1 -- 172.21.15.28:0/615353072 >> v1:172.21.15.28:6789/0 conn(0x7f190406e360 legacy=0x7f1904157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.616+0000 7f1909604640 1 -- 172.21.15.28:0/615353072 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1904154b30 con 0x7f19040c1010 2023-12-16T03:25:20.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.616+0000 7f1909604640 1 --2- 172.21.15.28:0/615353072 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19040c1010 0x7f19040aa830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19000097c0 tx=0x7f190001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de085a9e74efe37 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:20.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f18fbfff640 1 -- 172.21.15.28:0/615353072 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000ab600 con 0x7f19040c1010 2023-12-16T03:25:20.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f18fbfff640 1 -- 172.21.15.28:0/615353072 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19000a7050 con 0x7f19040c1010 2023-12-16T03:25:20.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f18fbfff640 1 -- 172.21.15.28:0/615353072 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000ab980 con 0x7f19040c1010 2023-12-16T03:25:20.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 -- 172.21.15.28:0/615353072 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19040c1010 msgr2=0x7f19040aa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 --2- 172.21.15.28:0/615353072 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19040c1010 0x7f19040aa830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19000097c0 tx=0x7f190001c360 comp rx=0 tx=0).stop 2023-12-16T03:25:20.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 -- 172.21.15.28:0/615353072 shutdown_connections 2023-12-16T03:25:20.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 --2- 172.21.15.28:0/615353072 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19040c1010 0x7f19040aa830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 -- 172.21.15.28:0/615353072 >> 172.21.15.28:0/615353072 conn(0x7f19040c63b0 msgr2=0x7f19040c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 -- 172.21.15.28:0/615353072 shutdown_connections 2023-12-16T03:25:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 -- 172.21.15.28:0/615353072 wait complete. 2023-12-16T03:25:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 Processor -- start 2023-12-16T03:25:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 -- start start 2023-12-16T03:25:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f190406e360 0x7f1904157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19040c1010 0x7f19041505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1904150b10 0x7f19041f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190414f4e0 con 0x7f1904150b10 2023-12-16T03:25:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190414b080 con 0x7f190406e360 2023-12-16T03:25:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f190a606640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1904071fb0 con 0x7f19040c1010 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.620+0000 7f1909e05640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1904150b10 0x7f19041f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f1909e05640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1904150b10 0x7f19041f0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38452/0 (socket says 172.21.15.28:38452) 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f1909e05640 1 -- 172.21.15.28:0/975466249 learned_addr learned my addr 172.21.15.28:0/975466249 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f1909604640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f190406e360 0x7f1904157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f1908e03640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19040c1010 0x7f19041505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f1909e05640 1 -- 172.21.15.28:0/975466249 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19040c1010 msgr2=0x7f19041505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f1909e05640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19040c1010 0x7f19041505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f1909e05640 1 -- 172.21.15.28:0/975466249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f190406e360 msgr2=0x7f1904157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f1909e05640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f190406e360 0x7f1904157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f1909e05640 1 -- 172.21.15.28:0/975466249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900009420 con 0x7f1904150b10 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f1908e03640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19040c1010 0x7f19041505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f1909e05640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1904150b10 0x7f19041f0d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00c730 tx=0x7f18fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f18f9ffb640 1 -- 172.21.15.28:0/975466249 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc003b80 con 0x7f1904150b10 2023-12-16T03:25:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f18f9ffb640 1 -- 172.21.15.28:0/975466249 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc003ce0 con 0x7f1904150b10 2023-12-16T03:25:20.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f18f9ffb640 1 -- 172.21.15.28:0/975466249 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc005310 con 0x7f1904150b10 2023-12-16T03:25:20.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f190a606640 1 -- 172.21.15.28:0/975466249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1904072290 con 0x7f1904150b10 2023-12-16T03:25:20.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f190a606640 1 -- 172.21.15.28:0/975466249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1904151b00 con 0x7f1904150b10 2023-12-16T03:25:20.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f190a606640 1 -- 172.21.15.28:0/975466249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190414ae70 con 0x7f1904150b10 2023-12-16T03:25:20.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.624+0000 7f18f9ffb640 1 -- 172.21.15.28:0/975466249 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f18fc005680 con 0x7f1904150b10 2023-12-16T03:25:20.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.628+0000 7f18f9ffb640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18e8066470 0x7f18e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:20.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.628+0000 7f18f9ffb640 1 -- 172.21.15.28:0/975466249 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18fc083d00 con 0x7f1904150b10 2023-12-16T03:25:20.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.628+0000 7f1909604640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18e8066470 0x7f18e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:20.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.628+0000 7f1909604640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18e8066470 0x7f18e8068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19000ad000 tx=0x7f19000a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:20.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.632+0000 7f18f9ffb640 1 -- 172.21.15.28:0/975466249 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f18fc051210 con 0x7f1904150b10 2023-12-16T03:25:20.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.828+0000 7f190a606640 1 -- 172.21.15.28:0/975466249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f190404e850 con 0x7f1904150b10 2023-12-16T03:25:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f18f9ffb640 1 -- 172.21.15.28:0/975466249 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164434 (secure 0 0 0) 0x7f18fc054830 con 0x7f1904150b10 2023-12-16T03:25:20.836 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 -- 172.21.15.28:0/975466249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18e8066470 msgr2=0x7f18e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18e8066470 0x7f18e8068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19000ad000 tx=0x7f19000a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 -- 172.21.15.28:0/975466249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1904150b10 msgr2=0x7f19041f0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1904150b10 0x7f19041f0d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00c730 tx=0x7f18fc00cbf0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 -- 172.21.15.28:0/975466249 shutdown_connections 2023-12-16T03:25:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18e8066470 0x7f18e8068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1904150b10 0x7f19041f0d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f19040c1010 0x7f19041505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 --2- 172.21.15.28:0/975466249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f190406e360 0x7f1904157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:20.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 -- 172.21.15.28:0/975466249 >> 172.21.15.28:0/975466249 conn(0x7f19040c63b0 msgr2=0x7f190414e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:20.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 -- 172.21.15.28:0/975466249 shutdown_connections 2023-12-16T03:25:20.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:20.832+0000 7f190a606640 1 -- 172.21.15.28:0/975466249 wait complete. 2023-12-16T03:25:20.855 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":5,"active_gid":4102,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":2582326308},{"type":"v1","addr":"172.21.15.28:6833","nonce":2582326308}]},"active_addr":"172.21.15.28:6833/2582326308","active_change":"2023-12-16T03:24:55.778553+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":3476407794}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":1019022906}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":2486473045}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":2556634801}]}]} 2023-12-16T03:25:20.859 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-16T03:25:20.859 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-16T03:25:20.859 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:21.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.000+0000 7f7ebaafe640 1 Processor -- start 2023-12-16T03:25:21.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.000+0000 7f7ebaafe640 1 -- start start 2023-12-16T03:25:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.000+0000 7f7ebaafe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7eb40c4100 0x7f7eb40c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.000+0000 7f7ebaafe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7eb40c06d0 0x7f7eb40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.000+0000 7f7ebaafe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb40c31c0 con 0x7f7eb40c63c0 2023-12-16T03:25:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.000+0000 7f7ebaafe640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40c34a0 con 0x7f7eb40c4100 2023-12-16T03:25:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.000+0000 7f7ebaafe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40c1030 con 0x7f7eb40c06d0 2023-12-16T03:25:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.000+0000 7f7eb3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7eb40c4100 0x7f7eb40c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.000+0000 7f7eb3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7eb40c4100 0x7f7eb40c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38466/0 (socket says 172.21.15.28:38466) 2023-12-16T03:25:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.000+0000 7f7eb3fff640 1 -- 172.21.15.28:0/2252627463 learned_addr learned my addr 172.21.15.28:0/2252627463 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.000+0000 7f7eb909b640 1 --2- 172.21.15.28:0/2252627463 >> v2:172.21.15.134:3300/0 conn(0x7f7eb40c06d0 0x7f7eb40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7eb3fff640 1 -- 172.21.15.28:0/2252627463 >> v2:172.21.15.134:3300/0 conn(0x7f7eb40c06d0 msgr2=0x7f7eb40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7eb3fff640 1 --2- 172.21.15.28:0/2252627463 >> v2:172.21.15.134:3300/0 conn(0x7f7eb40c06d0 0x7f7eb40a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7eb3fff640 1 -- 172.21.15.28:0/2252627463 >> v1:172.21.15.134:6789/0 conn(0x7f7eb40c63c0 legacy=0x7f7eb40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7eb3fff640 1 -- 172.21.15.28:0/2252627463 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40c1310 con 0x7f7eb40c4100 2023-12-16T03:25:21.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7eb3fff640 1 --2- 172.21.15.28:0/2252627463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eb40c4100 0x7f7eb40c2bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40c0ee0 tx=0x7f7ea001eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89485e71b741b9ab server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7eb37fe640 1 -- 172.21.15.28:0/2252627463 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40aa3d0 con 0x7f7eb40c4100 2023-12-16T03:25:21.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7eb37fe640 1 -- 172.21.15.28:0/2252627463 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea00a7a90 con 0x7f7eb40c4100 2023-12-16T03:25:21.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7eb37fe640 1 -- 172.21.15.28:0/2252627463 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00a7e20 con 0x7f7eb40c4100 2023-12-16T03:25:21.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7ebaafe640 1 -- 172.21.15.28:0/2252627463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eb40c4100 msgr2=0x7f7eb40c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7ebaafe640 1 --2- 172.21.15.28:0/2252627463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eb40c4100 0x7f7eb40c2bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40c0ee0 tx=0x7f7ea001eab0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7ebaafe640 1 -- 172.21.15.28:0/2252627463 shutdown_connections 2023-12-16T03:25:21.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7ebaafe640 1 --2- 172.21.15.28:0/2252627463 >> v2:172.21.15.134:3300/0 conn(0x7f7eb40c06d0 0x7f7eb40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7ebaafe640 1 --2- 172.21.15.28:0/2252627463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eb40c4100 0x7f7eb40c2bb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7ebaafe640 1 -- 172.21.15.28:0/2252627463 >> 172.21.15.28:0/2252627463 conn(0x7f7eb406a5b0 msgr2=0x7f7eb406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7ebaafe640 1 -- 172.21.15.28:0/2252627463 shutdown_connections 2023-12-16T03:25:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.004+0000 7f7ebaafe640 1 -- 172.21.15.28:0/2252627463 wait complete. 2023-12-16T03:25:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7ebaafe640 1 Processor -- start 2023-12-16T03:25:21.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7ebaafe640 1 -- start start 2023-12-16T03:25:21.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7ebaafe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eb40c06d0 0x7f7eb414f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7ebaafe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7eb40c4100 0x7f7eb414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7ebaafe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eb40c63c0 0x7f7eb414d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7ebaafe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40c0510 con 0x7f7eb40c63c0 2023-12-16T03:25:21.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7ebaafe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb414ce60 con 0x7f7eb40c4100 2023-12-16T03:25:21.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7ebaafe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4155970 con 0x7f7eb40c06d0 2023-12-16T03:25:21.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb909b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eb40c63c0 0x7f7eb414d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb909b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eb40c63c0 0x7f7eb414d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38470/0 (socket says 172.21.15.28:38470) 2023-12-16T03:25:21.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb909b640 1 -- 172.21.15.28:0/927419505 learned_addr learned my addr 172.21.15.28:0/927419505 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb889a640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eb40c06d0 0x7f7eb414f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb3fff640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7eb40c4100 0x7f7eb414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb909b640 1 -- 172.21.15.28:0/927419505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eb40c06d0 msgr2=0x7f7eb414f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb909b640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eb40c06d0 0x7f7eb414f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb909b640 1 -- 172.21.15.28:0/927419505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7eb40c4100 msgr2=0x7f7eb414d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb909b640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7eb40c4100 0x7f7eb414d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb909b640 1 -- 172.21.15.28:0/927419505 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea000b770 con 0x7f7eb40c63c0 2023-12-16T03:25:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb909b640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eb40c63c0 0x7f7eb414d830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7eac007e40 tx=0x7f7eac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb17fa640 1 -- 172.21.15.28:0/927419505 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac014620 con 0x7f7eb40c63c0 2023-12-16T03:25:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb17fa640 1 -- 172.21.15.28:0/927419505 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac00ee90 con 0x7f7eb40c63c0 2023-12-16T03:25:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7ebaafe640 1 -- 172.21.15.28:0/927419505 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb41ed8a0 con 0x7f7eb40c63c0 2023-12-16T03:25:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.008+0000 7f7eb17fa640 1 -- 172.21.15.28:0/927419505 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0149e0 con 0x7f7eb40c63c0 2023-12-16T03:25:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.012+0000 7f7ebaafe640 1 -- 172.21.15.28:0/927419505 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb415a830 con 0x7f7eb40c63c0 2023-12-16T03:25:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.012+0000 7f7ebaafe640 1 -- 172.21.15.28:0/927419505 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb41eddc0 con 0x7f7eb40c63c0 2023-12-16T03:25:21.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.012+0000 7f7eb17fa640 1 -- 172.21.15.28:0/927419505 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7eac014b40 con 0x7f7eb40c63c0 2023-12-16T03:25:21.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.012+0000 7f7eb17fa640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e980664a0 0x7f7e98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.012+0000 7f7eb17fa640 1 -- 172.21.15.28:0/927419505 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7eac0846b0 con 0x7f7eb40c63c0 2023-12-16T03:25:21.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.012+0000 7f7eb889a640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e980664a0 0x7f7e98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.012+0000 7f7eb889a640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e980664a0 0x7f7e98068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8007fd0 tx=0x7f7ea8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.016+0000 7f7eb17fa640 1 -- 172.21.15.28:0/927419505 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7eac051bd0 con 0x7f7eb40c63c0 2023-12-16T03:25:21.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.176+0000 7f7ebaafe640 1 -- 172.21.15.28:0/927419505 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7eb414cfd0 con 0x7f7eb40c63c0 2023-12-16T03:25:21.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7eb17fa640 1 -- 172.21.15.28:0/927419505 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f7eac0551f0 con 0x7f7eb40c63c0 2023-12-16T03:25:21.181 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:21.181 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 -- 172.21.15.28:0/927419505 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e980664a0 msgr2=0x7f7e98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e980664a0 0x7f7e98068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8007fd0 tx=0x7f7ea8009040 comp rx=0 tx=0).stop 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 -- 172.21.15.28:0/927419505 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eb40c63c0 msgr2=0x7f7eb414d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eb40c63c0 0x7f7eb414d830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7eac007e40 tx=0x7f7eac00e4b0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 -- 172.21.15.28:0/927419505 shutdown_connections 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e980664a0 0x7f7e98068960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eb40c63c0 0x7f7eb414d830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7eb40c4100 0x7f7eb414d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 --2- 172.21.15.28:0/927419505 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eb40c06d0 0x7f7eb414f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 -- 172.21.15.28:0/927419505 >> 172.21.15.28:0/927419505 conn(0x7f7eb406a5b0 msgr2=0x7f7eb406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 -- 172.21.15.28:0/927419505 shutdown_connections 2023-12-16T03:25:21.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.180+0000 7f7ebaafe640 1 -- 172.21.15.28:0/927419505 wait complete. 2023-12-16T03:25:21.202 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-16T03:25:21.202 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:21.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc41468640 1 Processor -- start 2023-12-16T03:25:21.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc41468640 1 -- start start 2023-12-16T03:25:21.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc41468640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3c0c7ea0 0x7efc3c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc41468640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc3c06b9e0 0x7efc3c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc41468640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c06c860 con 0x7efc3c151e90 2023-12-16T03:25:21.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc41468640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c0c8750 con 0x7efc3c06b9e0 2023-12-16T03:25:21.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc41468640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c1552d0 con 0x7efc3c0c7ea0 2023-12-16T03:25:21.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc3affd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efc3c151e90 0x7efc3c0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57796/0 (socket says 172.21.15.28:57796) 2023-12-16T03:25:21.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc3affd640 1 -- 172.21.15.28:0/588757030 learned_addr learned my addr 172.21.15.28:0/588757030 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:21.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc3b7fe640 1 --2- 172.21.15.28:0/588757030 >> v2:172.21.15.134:3300/0 conn(0x7efc3c06b9e0 0x7efc3c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc33fff640 1 --2- 172.21.15.28:0/588757030 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3c0c7ea0 0x7efc3c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc3a7fc640 1 -- 172.21.15.28:0/588757030 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230685872 0 0) 0x7efc3c06c860 con 0x7efc3c151e90 2023-12-16T03:25:21.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc3a7fc640 1 -- 172.21.15.28:0/588757030 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc28003530 con 0x7efc3c151e90 2023-12-16T03:25:21.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc3b7fe640 1 -- 172.21.15.28:0/588757030 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3c0c7ea0 msgr2=0x7efc3c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc3b7fe640 1 --2- 172.21.15.28:0/588757030 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3c0c7ea0 0x7efc3c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc3b7fe640 1 -- 172.21.15.28:0/588757030 >> v1:172.21.15.28:6789/0 conn(0x7efc3c151e90 legacy=0x7efc3c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.344+0000 7efc3b7fe640 1 -- 172.21.15.28:0/588757030 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c154930 con 0x7efc3c06b9e0 2023-12-16T03:25:21.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc3b7fe640 1 --2- 172.21.15.28:0/588757030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc3c06b9e0 0x7efc3c15f0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc34009d90 tx=0x7efc3401c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b54cfad4ccc3b87 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc3a7fc640 1 -- 172.21.15.28:0/588757030 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc340a6700 con 0x7efc3c06b9e0 2023-12-16T03:25:21.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc3a7fc640 1 -- 172.21.15.28:0/588757030 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc340a6860 con 0x7efc3c06b9e0 2023-12-16T03:25:21.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc3a7fc640 1 -- 172.21.15.28:0/588757030 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc340a6bf0 con 0x7efc3c06b9e0 2023-12-16T03:25:21.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc41468640 1 -- 172.21.15.28:0/588757030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc3c06b9e0 msgr2=0x7efc3c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc41468640 1 --2- 172.21.15.28:0/588757030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc3c06b9e0 0x7efc3c15f0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc34009d90 tx=0x7efc3401c830 comp rx=0 tx=0).stop 2023-12-16T03:25:21.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc41468640 1 -- 172.21.15.28:0/588757030 shutdown_connections 2023-12-16T03:25:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc41468640 1 --2- 172.21.15.28:0/588757030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc3c06b9e0 0x7efc3c15f0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc41468640 1 --2- 172.21.15.28:0/588757030 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3c0c7ea0 0x7efc3c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc41468640 1 -- 172.21.15.28:0/588757030 >> 172.21.15.28:0/588757030 conn(0x7efc3c0ca170 msgr2=0x7efc3c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc41468640 1 -- 172.21.15.28:0/588757030 shutdown_connections 2023-12-16T03:25:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.348+0000 7efc41468640 1 -- 172.21.15.28:0/588757030 wait complete. 2023-12-16T03:25:21.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc41468640 1 Processor -- start 2023-12-16T03:25:21.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc41468640 1 -- start start 2023-12-16T03:25:21.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc41468640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b9e0 0x7efc3c1f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc41468640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3c0c7ea0 0x7efc3c1ee360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc41468640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc3c151e90 0x7efc3c14b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc41468640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0aba90 con 0x7efc3c06b9e0 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc41468640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0ab460 con 0x7efc3c151e90 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc41468640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c1f1010 con 0x7efc3c0c7ea0 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc3affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b9e0 0x7efc3c1f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc3affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b9e0 0x7efc3c1f06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38482/0 (socket says 172.21.15.28:38482) 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc3affd640 1 -- 172.21.15.28:0/2273119149 learned_addr learned my addr 172.21.15.28:0/2273119149 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc3b7fe640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc3c151e90 0x7efc3c14b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc3affd640 1 -- 172.21.15.28:0/2273119149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3c0c7ea0 msgr2=0x7efc3c1ee360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc33fff640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3c0c7ea0 0x7efc3c1ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc3affd640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3c0c7ea0 0x7efc3c1ee360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc3affd640 1 -- 172.21.15.28:0/2273119149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc3c151e90 msgr2=0x7efc3c14b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc3affd640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc3c151e90 0x7efc3c14b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc3affd640 1 -- 172.21.15.28:0/2273119149 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc34009a70 con 0x7efc3c06b9e0 2023-12-16T03:25:21.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc33fff640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3c0c7ea0 0x7efc3c1ee360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:21.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc3affd640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b9e0 0x7efc3c1f06c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00c4d0 tx=0x7efc2c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc337fe640 1 -- 172.21.15.28:0/2273119149 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c005cf0 con 0x7efc3c06b9e0 2023-12-16T03:25:21.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc337fe640 1 -- 172.21.15.28:0/2273119149 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c005e50 con 0x7efc3c06b9e0 2023-12-16T03:25:21.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc41468640 1 -- 172.21.15.28:0/2273119149 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c0ab720 con 0x7efc3c06b9e0 2023-12-16T03:25:21.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc337fe640 1 -- 172.21.15.28:0/2273119149 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c007270 con 0x7efc3c06b9e0 2023-12-16T03:25:21.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc41468640 1 -- 172.21.15.28:0/2273119149 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c0af8c0 con 0x7efc3c06b9e0 2023-12-16T03:25:21.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.352+0000 7efc41468640 1 -- 172.21.15.28:0/2273119149 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c0ab8b0 con 0x7efc3c06b9e0 2023-12-16T03:25:21.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.356+0000 7efc337fe640 1 -- 172.21.15.28:0/2273119149 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7efc2c0073d0 con 0x7efc3c06b9e0 2023-12-16T03:25:21.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.356+0000 7efc337fe640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc1c066470 0x7efc1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.356+0000 7efc337fe640 1 -- 172.21.15.28:0/2273119149 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc2c0833e0 con 0x7efc3c06b9e0 2023-12-16T03:25:21.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.356+0000 7efc33fff640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc1c066470 0x7efc1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.356+0000 7efc33fff640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc1c066470 0x7efc1c068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0c0ac0 tx=0x7efc24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.360+0000 7efc337fe640 1 -- 172.21.15.28:0/2273119149 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7efc2c050900 con 0x7efc3c06b9e0 2023-12-16T03:25:21.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.520+0000 7efc41468640 1 -- 172.21.15.28:0/2273119149 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc3c158c80 con 0x7efc3c06b9e0 2023-12-16T03:25:21.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.520+0000 7efc337fe640 1 -- 172.21.15.28:0/2273119149 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7efc2c053f20 con 0x7efc3c06b9e0 2023-12-16T03:25:21.523 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:21.523 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:21.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 -- 172.21.15.28:0/2273119149 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc1c066470 msgr2=0x7efc1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc1c066470 0x7efc1c068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0c0ac0 tx=0x7efc24008040 comp rx=0 tx=0).stop 2023-12-16T03:25:21.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 -- 172.21.15.28:0/2273119149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b9e0 msgr2=0x7efc3c1f06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b9e0 0x7efc3c1f06c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00c4d0 tx=0x7efc2c00c990 comp rx=0 tx=0).stop 2023-12-16T03:25:21.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 -- 172.21.15.28:0/2273119149 shutdown_connections 2023-12-16T03:25:21.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc3c151e90 0x7efc3c14b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3c0c7ea0 0x7efc3c1ee360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc1c066470 0x7efc1c068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 --2- 172.21.15.28:0/2273119149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc3c06b9e0 0x7efc3c1f06c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 -- 172.21.15.28:0/2273119149 >> 172.21.15.28:0/2273119149 conn(0x7efc3c0ca170 msgr2=0x7efc3c0c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 -- 172.21.15.28:0/2273119149 shutdown_connections 2023-12-16T03:25:21.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.524+0000 7efc41468640 1 -- 172.21.15.28:0/2273119149 wait complete. 2023-12-16T03:25:21.545 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-16T03:25:21.546 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-16T03:25:21.547 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-16T03:25:21.547 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-16T03:25:21.548 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-16T03:25:21.548 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-16T03:25:21.549 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-16T03:25:21.550 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-16T03:25:21.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.796+0000 7f2bbb432640 1 Processor -- start 2023-12-16T03:25:21.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.796+0000 7f2bbb432640 1 -- start start 2023-12-16T03:25:21.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.796+0000 7fac9fcd6640 1 Processor -- start 2023-12-16T03:25:21.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bbb432640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2bb406e3f0 0x7f2bb40c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bbb432640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2bb40c22b0 0x7f2bb406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bbb432640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb4152490 con 0x7f2bb40725f0 2023-12-16T03:25:21.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bbb432640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb40a4d30 con 0x7f2bb40c22b0 2023-12-16T03:25:21.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bbb432640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb40a5010 con 0x7f2bb406e3f0 2023-12-16T03:25:21.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7ff09809a640 1 Processor -- start 2023-12-16T03:25:21.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bb89cd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2bb406e3f0 0x7f2bb40c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7ff09809a640 1 -- start start 2023-12-16T03:25:21.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bb89cd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2bb406e3f0 0x7f2bb40c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60342/0 (socket says 172.21.15.28:60342) 2023-12-16T03:25:21.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bb89cd640 1 -- 172.21.15.28:0/4101770738 learned_addr learned my addr 172.21.15.28:0/4101770738 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bb99cf640 1 --2- 172.21.15.28:0/4101770738 >> v2:172.21.15.134:3300/0 conn(0x7f2bb40c22b0 0x7f2bb406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7fac9fcd6640 1 -- start start 2023-12-16T03:25:21.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7ff09809a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff09006a5b0 0x7ff0900c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7ff09809a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0900a5d40 0x7ff090152d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7ff09809a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09014fca0 con 0x7ff09006a990 2023-12-16T03:25:21.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7ff09809a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09006ae40 con 0x7ff09006a5b0 2023-12-16T03:25:21.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7ff09809a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff090071580 con 0x7ff0900a5d40 2023-12-16T03:25:21.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7ff095e36640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff09006a5b0 0x7ff0900c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7ff095635640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0900a5d40 0x7ff090152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7ff096637640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff09006a990 0x7ff090070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53804/0 (socket says 172.21.15.28:53804) 2023-12-16T03:25:21.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7ff096637640 1 -- 172.21.15.28:0/1911477867 learned_addr learned my addr 172.21.15.28:0/1911477867 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:21.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7fac9fcd6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac9004a440 0x7fac90007320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7fac9fcd6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9004ac90 con 0x7fac900d46e0 2023-12-16T03:25:21.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9d271640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fac90006eb0 0x7fac90049d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53806/0 (socket says 172.21.15.28:53806) 2023-12-16T03:25:21.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9d271640 1 -- 172.21.15.28:0/830631383 learned_addr learned my addr 172.21.15.28:0/830631383 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:21.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9fcd6640 1 -- 172.21.15.28:0/830631383 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9004af70 con 0x7fac90006eb0 2023-12-16T03:25:21.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9fcd6640 1 -- 172.21.15.28:0/830631383 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9004b530 con 0x7fac9004a440 2023-12-16T03:25:21.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7ff094e34640 1 -- 172.21.15.28:0/1911477867 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228856061 0 0) 0x7ff09014fca0 con 0x7ff09006a990 2023-12-16T03:25:21.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9e273640 1 --2- 172.21.15.28:0/830631383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac9004a440 0x7fac90007320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9ca70640 1 -- 172.21.15.28:0/830631383 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116686170 0 0) 0x7fac9004af70 con 0x7fac90006eb0 2023-12-16T03:25:21.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9ca70640 1 -- 172.21.15.28:0/830631383 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac84003530 con 0x7fac90006eb0 2023-12-16T03:25:21.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bb89cd640 1 -- 172.21.15.28:0/4101770738 >> v2:172.21.15.134:3300/0 conn(0x7f2bb40c22b0 msgr2=0x7f2bb406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bb89cd640 1 --2- 172.21.15.28:0/4101770738 >> v2:172.21.15.134:3300/0 conn(0x7f2bb40c22b0 0x7f2bb406ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bb89cd640 1 -- 172.21.15.28:0/4101770738 >> v1:172.21.15.134:6789/0 conn(0x7f2bb40725f0 legacy=0x7f2bb4152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.800+0000 7f2bb89cd640 1 -- 172.21.15.28:0/4101770738 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb40a52f0 con 0x7f2bb406e3f0 2023-12-16T03:25:21.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9ca70640 1 -- 172.21.15.28:0/830631383 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538254008 0 0) 0x7fac9004ac90 con 0x7fac900d46e0 2023-12-16T03:25:21.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9ca70640 1 -- 172.21.15.28:0/830631383 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac9004af70 con 0x7fac900d46e0 2023-12-16T03:25:21.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7f2bb89cd640 1 --2- 172.21.15.28:0/4101770738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2bb406e3f0 0x7f2bb40c2760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009870 tx=0x7f2bb001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f12a9ea285995d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9e273640 1 -- 172.21.15.28:0/830631383 >> v1:172.21.15.134:6789/0 conn(0x7fac90006eb0 legacy=0x7fac90049d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9e273640 1 -- 172.21.15.28:0/830631383 >> v1:172.21.15.28:6789/0 conn(0x7fac900d46e0 legacy=0x7fac900d7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7fac9e273640 1 -- 172.21.15.28:0/830631383 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9004b250 con 0x7fac9004a440 2023-12-16T03:25:21.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7ff095e36640 1 -- 172.21.15.28:0/1911477867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0900a5d40 msgr2=0x7ff090152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7ff095e36640 1 --2- 172.21.15.28:0/1911477867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0900a5d40 0x7ff090152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7ff095e36640 1 -- 172.21.15.28:0/1911477867 >> v1:172.21.15.134:6789/0 conn(0x7ff09006a990 legacy=0x7ff090070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.804+0000 7ff095e36640 1 -- 172.21.15.28:0/1911477867 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0901528d0 con 0x7ff09006a5b0 2023-12-16T03:25:21.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2babfff640 1 -- 172.21.15.28:0/4101770738 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00ab600 con 0x7f2bb406e3f0 2023-12-16T03:25:21.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2babfff640 1 -- 172.21.15.28:0/4101770738 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb00a7050 con 0x7f2bb406e3f0 2023-12-16T03:25:21.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2babfff640 1 -- 172.21.15.28:0/4101770738 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00ab980 con 0x7f2bb406e3f0 2023-12-16T03:25:21.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2bbb432640 1 -- 172.21.15.28:0/4101770738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2bb406e3f0 msgr2=0x7f2bb40c2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2bbb432640 1 --2- 172.21.15.28:0/4101770738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2bb406e3f0 0x7f2bb40c2760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009870 tx=0x7f2bb001c3b0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2bbb432640 1 -- 172.21.15.28:0/4101770738 shutdown_connections 2023-12-16T03:25:21.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2bbb432640 1 --2- 172.21.15.28:0/4101770738 >> v2:172.21.15.134:3300/0 conn(0x7f2bb40c22b0 0x7f2bb406ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2bbb432640 1 --2- 172.21.15.28:0/4101770738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2bb406e3f0 0x7f2bb40c2760 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2bbb432640 1 -- 172.21.15.28:0/4101770738 >> 172.21.15.28:0/4101770738 conn(0x7f2bb40c5cd0 msgr2=0x7f2bb40c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7ff095e36640 1 --2- 172.21.15.28:0/1911477867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff09006a5b0 0x7ff0900c2fd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff088009dc0 tx=0x7ff08801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b64aacd468097b1a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2bbb432640 1 -- 172.21.15.28:0/4101770738 shutdown_connections 2023-12-16T03:25:21.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7ff094e34640 1 -- 172.21.15.28:0/1911477867 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0880a5760 con 0x7ff09006a5b0 2023-12-16T03:25:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7ff094e34640 1 -- 172.21.15.28:0/1911477867 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0880a58c0 con 0x7ff09006a5b0 2023-12-16T03:25:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7ff094e34640 1 -- 172.21.15.28:0/1911477867 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0880a5c50 con 0x7ff09006a5b0 2023-12-16T03:25:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2ed5dd1640 1 Processor -- start 2023-12-16T03:25:21.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2ed5dd1640 1 -- start start 2023-12-16T03:25:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.808+0000 7f2bbb432640 1 -- 172.21.15.28:0/4101770738 wait complete. 2023-12-16T03:25:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7ff09809a640 1 -- 172.21.15.28:0/1911477867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff09006a5b0 msgr2=0x7ff0900c2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7ff09809a640 1 --2- 172.21.15.28:0/1911477867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff09006a5b0 0x7ff0900c2fd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff088009dc0 tx=0x7ff08801c8e0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7ff09809a640 1 -- 172.21.15.28:0/1911477867 shutdown_connections 2023-12-16T03:25:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7ff09809a640 1 --2- 172.21.15.28:0/1911477867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0900a5d40 0x7ff090152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7ff09809a640 1 --2- 172.21.15.28:0/1911477867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff09006a5b0 0x7ff0900c2fd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7ff09809a640 1 -- 172.21.15.28:0/1911477867 >> 172.21.15.28:0/1911477867 conn(0x7ff0900a8880 msgr2=0x7ff0900a8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7fac9e273640 1 --2- 172.21.15.28:0/830631383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac9004a440 0x7fac90007320 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fac98064280 tx=0x7fac98096ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=761133fd6e958121 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7ff09809a640 1 -- 172.21.15.28:0/1911477867 shutdown_connections 2023-12-16T03:25:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7ff09809a640 1 -- 172.21.15.28:0/1911477867 wait complete. 2023-12-16T03:25:21.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7fac9ca70640 1 -- 172.21.15.28:0/830631383 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9811f800 con 0x7fac9004a440 2023-12-16T03:25:21.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7fac9ca70640 1 -- 172.21.15.28:0/830631383 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9811f960 con 0x7fac9004a440 2023-12-16T03:25:21.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2ed5dd1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 0x7f2ed00c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2ed5dd1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ed00a5430 0x7f2ed0071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2ed5dd1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed00c2500 con 0x7f2ed00c2760 2023-12-16T03:25:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2ed5dd1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed0071d80 con 0x7f2ed00a5430 2023-12-16T03:25:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2ed5dd1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00c2220 con 0x7f2ed006da00 2023-12-16T03:25:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2eceffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 0x7f2ed00c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2eceffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 0x7f2ed00c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60366/0 (socket says 172.21.15.28:60366) 2023-12-16T03:25:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2eceffd640 1 -- 172.21.15.28:0/767787421 learned_addr learned my addr 172.21.15.28:0/767787421 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7fac9fcd6640 1 -- 172.21.15.28:0/830631383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac9004a440 msgr2=0x7fac90007320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7fac9fcd6640 1 --2- 172.21.15.28:0/830631383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac9004a440 0x7fac90007320 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fac98064280 tx=0x7fac98096ab0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2eceffd640 1 -- 172.21.15.28:0/767787421 >> v2:172.21.15.134:3300/0 conn(0x7f2ed00a5430 msgr2=0x7f2ed0071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2eceffd640 1 --2- 172.21.15.28:0/767787421 >> v2:172.21.15.134:3300/0 conn(0x7f2ed00a5430 0x7f2ed0071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2eceffd640 1 -- 172.21.15.28:0/767787421 >> v1:172.21.15.134:6789/0 conn(0x7f2ed00c2760 legacy=0x7f2ed00c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2eceffd640 1 -- 172.21.15.28:0/767787421 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed00c0800 con 0x7f2ed006da00 2023-12-16T03:25:21.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7fac9fcd6640 1 -- 172.21.15.28:0/830631383 shutdown_connections 2023-12-16T03:25:21.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7fac9fcd6640 1 --2- 172.21.15.28:0/830631383 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac9004a440 0x7fac90007320 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2bbb432640 1 Processor -- start 2023-12-16T03:25:21.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7fac9fcd6640 1 -- 172.21.15.28:0/830631383 >> 172.21.15.28:0/830631383 conn(0x7fac90048260 msgr2=0x7fac90048670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7ff09809a640 1 Processor -- start 2023-12-16T03:25:21.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f2bbb432640 1 -- start start 2023-12-16T03:25:21.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7ff09809a640 1 -- start start 2023-12-16T03:25:21.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.812+0000 7f12e759e640 1 Processor -- start 2023-12-16T03:25:21.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7fac9fcd6640 1 -- 172.21.15.28:0/830631383 shutdown_connections 2023-12-16T03:25:21.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7fac9fcd6640 1 -- 172.21.15.28:0/830631383 wait complete. 2023-12-16T03:25:21.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bbb432640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bb406e3f0 0x7f2bb40a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bbb432640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bb40725f0 0x7f2bb414ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bbb432640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2bb40c22b0 0x7f2bb414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bbb432640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb40a6930 con 0x7f2bb40725f0 2023-12-16T03:25:21.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bbb432640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb414f900 con 0x7f2bb406e3f0 2023-12-16T03:25:21.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bbb432640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb40a5fa0 con 0x7f2bb40c22b0 2023-12-16T03:25:21.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff09809a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff09006a5b0 0x7ff090154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bb91ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bb406e3f0 0x7f2bb40a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bb91ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bb406e3f0 0x7f2bb40a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60060/0 (socket says 172.21.15.28:60060) 2023-12-16T03:25:21.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bb91ce640 1 -- 172.21.15.28:0/2172838229 learned_addr learned my addr 172.21.15.28:0/2172838229 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bb99cf640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2bb40c22b0 0x7f2bb414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff09809a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff09006a990 0x7ff0901ec610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff09809a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0900a9970 0x7ff0901556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f12e759e640 1 -- start start 2023-12-16T03:25:21.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f12e759e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12e000ed90 0x7f12e000f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff095e36640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff09006a5b0 0x7ff090154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff09809a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0901544d0 con 0x7ff09006a990 2023-12-16T03:25:21.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff095e36640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff09006a5b0 0x7ff090154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60390/0 (socket says 172.21.15.28:60390) 2023-12-16T03:25:21.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff095e36640 1 -- 172.21.15.28:0/814953728 learned_addr learned my addr 172.21.15.28:0/814953728 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff09809a640 1 -- 172.21.15.28:0/814953728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900ac960 con 0x7ff0900a9970 2023-12-16T03:25:21.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff09809a640 1 -- 172.21.15.28:0/814953728 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0901ecef0 con 0x7ff09006a5b0 2023-12-16T03:25:21.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f12e759e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f12e00073d0 0x7f12e00dad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7fac9fcd6640 1 Processor -- start 2023-12-16T03:25:21.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bb91ce640 1 -- 172.21.15.28:0/2172838229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2bb40c22b0 msgr2=0x7f2bb414f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bb91ce640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2bb40c22b0 0x7f2bb414f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bb91ce640 1 -- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bb40725f0 msgr2=0x7f2bb414ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bb91ce640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bb40725f0 0x7f2bb414ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bb91ce640 1 -- 172.21.15.28:0/2172838229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb00094d0 con 0x7f2bb406e3f0 2023-12-16T03:25:21.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7fac9fcd6640 1 -- start start 2023-12-16T03:25:21.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f12e759e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e00d4a30 con 0x7f12e000fc50 2023-12-16T03:25:21.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f12e759e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e00ddc10 con 0x7f12e00073d0 2023-12-16T03:25:21.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f12e759e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e00ddef0 con 0x7f12e000ed90 2023-12-16T03:25:21.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff096637640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0900a9970 0x7ff0901556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff095635640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff09006a990 0x7ff0901ec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff095e36640 1 -- 172.21.15.28:0/814953728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0900a9970 msgr2=0x7ff0901556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff095e36640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0900a9970 0x7ff0901556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff095e36640 1 -- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff09006a990 msgr2=0x7ff0901ec610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff095e36640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff09006a990 0x7ff0901ec610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7ff095e36640 1 -- 172.21.15.28:0/814953728 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088009a70 con 0x7ff09006a5b0 2023-12-16T03:25:21.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f12e659c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12e000ed90 0x7f12e000f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f12e659c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12e000ed90 0x7f12e000f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60084/0 (socket says 172.21.15.28:60084) 2023-12-16T03:25:21.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f12e659c640 1 -- 172.21.15.28:0/429518042 learned_addr learned my addr 172.21.15.28:0/429518042 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.816+0000 7f2bb91ce640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bb406e3f0 0x7f2bb40a9df0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00c7c0 tx=0x7f2bac00cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ba9ffb640 1 -- 172.21.15.28:0/2172838229 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac00aa50 con 0x7f2bb406e3f0 2023-12-16T03:25:21.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ba9ffb640 1 -- 172.21.15.28:0/2172838229 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac00abb0 con 0x7f2bb406e3f0 2023-12-16T03:25:21.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ba9ffb640 1 -- 172.21.15.28:0/2172838229 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac012420 con 0x7f2bb406e3f0 2023-12-16T03:25:21.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2bbb432640 1 -- 172.21.15.28:0/2172838229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb41e78f0 con 0x7f2bb406e3f0 2023-12-16T03:25:21.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2bbb432640 1 -- 172.21.15.28:0/2172838229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb41e7580 con 0x7f2bb406e3f0 2023-12-16T03:25:21.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7ff095e36640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff09006a5b0 0x7ff090154960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff0880194f0 tx=0x7ff088019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7ff0867fc640 1 -- 172.21.15.28:0/814953728 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0880ad650 con 0x7ff09006a5b0 2023-12-16T03:25:21.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7ff0867fc640 1 -- 172.21.15.28:0/814953728 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0880ad7b0 con 0x7ff09006a5b0 2023-12-16T03:25:21.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2eceffd640 1 --2- 172.21.15.28:0/767787421 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 0x7f2ed00c2b40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009870 tx=0x7f2ec001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1c42828c3435a63 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f12e6d9d640 1 --2- 172.21.15.28:0/429518042 >> v2:172.21.15.28:3300/0 conn(0x7f12e00073d0 0x7f12e00dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f565eff8640 1 Processor -- start 2023-12-16T03:25:21.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ece7fc640 1 -- 172.21.15.28:0/767787421 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00ab600 con 0x7f2ed006da00 2023-12-16T03:25:21.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9fcd6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac90006eb0 0x7fac900d6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ece7fc640 1 -- 172.21.15.28:0/767787421 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec00a7050 con 0x7f2ed006da00 2023-12-16T03:25:21.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ece7fc640 1 -- 172.21.15.28:0/767787421 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00ab980 con 0x7f2ed006da00 2023-12-16T03:25:21.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f12e659c640 1 -- 172.21.15.28:0/429518042 >> v2:172.21.15.28:3300/0 conn(0x7f12e00073d0 msgr2=0x7f12e00dad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f12e659c640 1 --2- 172.21.15.28:0/429518042 >> v2:172.21.15.28:3300/0 conn(0x7f12e00073d0 0x7f12e00dad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f12e659c640 1 -- 172.21.15.28:0/429518042 >> v1:172.21.15.28:6789/0 conn(0x7f12e000fc50 legacy=0x7f12e00da630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f565eff8640 1 -- start start 2023-12-16T03:25:21.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7ff0867fc640 1 -- 172.21.15.28:0/814953728 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0880adb20 con 0x7ff09006a5b0 2023-12-16T03:25:21.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7ff09809a640 1 -- 172.21.15.28:0/814953728 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0901ed1d0 con 0x7ff09006a5b0 2023-12-16T03:25:21.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9fcd6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac9004a440 0x7fac900ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9fcd6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac900d46e0 0x7fac900cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9fcd6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac90044880 con 0x7fac9004a440 2023-12-16T03:25:21.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9fcd6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac900d1240 con 0x7fac90006eb0 2023-12-16T03:25:21.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9fcd6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac900d0630 con 0x7fac900d46e0 2023-12-16T03:25:21.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9da72640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac90006eb0 0x7fac900d6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9da72640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac90006eb0 0x7fac900d6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60096/0 (socket says 172.21.15.28:60096) 2023-12-16T03:25:21.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9da72640 1 -- 172.21.15.28:0/931695073 learned_addr learned my addr 172.21.15.28:0/931695073 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9e273640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac900d46e0 0x7fac900cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/767787421 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 msgr2=0x7f2ed00c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ed5dd1640 1 --2- 172.21.15.28:0/767787421 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 0x7f2ed00c2b40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009870 tx=0x7f2ec001c470 comp rx=0 tx=0).stop 2023-12-16T03:25:21.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7ff09809a640 1 -- 172.21.15.28:0/814953728 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff090154160 con 0x7ff09006a5b0 2023-12-16T03:25:21.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/767787421 shutdown_connections 2023-12-16T03:25:21.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ed5dd1640 1 --2- 172.21.15.28:0/767787421 >> v2:172.21.15.134:3300/0 conn(0x7f2ed00a5430 0x7f2ed0071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ed5dd1640 1 --2- 172.21.15.28:0/767787421 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 0x7f2ed00c2b40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/767787421 >> 172.21.15.28:0/767787421 conn(0x7f2ed006a5b0 msgr2=0x7f2ed006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f12e659c640 1 -- 172.21.15.28:0/429518042 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e00de1d0 con 0x7f12e000ed90 2023-12-16T03:25:21.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9da72640 1 -- 172.21.15.28:0/931695073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac900d46e0 msgr2=0x7fac900cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9da72640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac900d46e0 0x7fac900cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9da72640 1 -- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac9004a440 msgr2=0x7fac900ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9da72640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac9004a440 0x7fac900ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7fac9da72640 1 -- 172.21.15.28:0/931695073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9804f7e0 con 0x7fac90006eb0 2023-12-16T03:25:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f565eff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5658155dd0 0x7f56580c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f565eff8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f565806e0b0 0x7f565815be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f565eff8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5658158a90 con 0x7f565806c980 2023-12-16T03:25:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f565eff8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56581588a0 con 0x7f565806e0b0 2023-12-16T03:25:21.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f565eff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5658158d70 con 0x7f5658155dd0 2023-12-16T03:25:21.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/767787421 shutdown_connections 2023-12-16T03:25:21.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.820+0000 7f2bbb432640 1 -- 172.21.15.28:0/2172838229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bb4153340 con 0x7f2bb406e3f0 2023-12-16T03:25:21.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7ff073fff640 1 -- 172.21.15.28:0/814953728 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff090151690 con 0x7ff09006a5b0 2023-12-16T03:25:21.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f2ba9ffb640 1 -- 172.21.15.28:0/2172838229 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2bac012580 con 0x7f2bb406e3f0 2023-12-16T03:25:21.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7fac9da72640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac90006eb0 0x7fac900d6640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac9400c430 tx=0x7fac9400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f661ddf8640 1 Processor -- start 2023-12-16T03:25:21.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7fac8e7fc640 1 -- 172.21.15.28:0/931695073 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac940052d0 con 0x7fac90006eb0 2023-12-16T03:25:21.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7fac8e7fc640 1 -- 172.21.15.28:0/931695073 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac94005430 con 0x7fac90006eb0 2023-12-16T03:25:21.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7fac8e7fc640 1 -- 172.21.15.28:0/931695073 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94003840 con 0x7fac90006eb0 2023-12-16T03:25:21.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7fac9fcd6640 1 -- 172.21.15.28:0/931695073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac900d0910 con 0x7fac90006eb0 2023-12-16T03:25:21.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7fac9fcd6640 1 -- 172.21.15.28:0/931695073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac900d0ed0 con 0x7fac90006eb0 2023-12-16T03:25:21.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f2ba9ffb640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2b98066540 0x7f2b98068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7fac9fcd6640 1 -- 172.21.15.28:0/931695073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac900e5590 con 0x7fac90006eb0 2023-12-16T03:25:21.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7ff0867fc640 1 -- 172.21.15.28:0/814953728 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff0880adc80 con 0x7ff09006a5b0 2023-12-16T03:25:21.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/767787421 wait complete. 2023-12-16T03:25:21.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f2ed5dd1640 1 Processor -- start 2023-12-16T03:25:21.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f565dff6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5658155dd0 0x7f56580c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f565dff6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5658155dd0 0x7f56580c1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60414/0 (socket says 172.21.15.28:60414) 2023-12-16T03:25:21.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f565dff6640 1 -- 172.21.15.28:0/2774165930 learned_addr learned my addr 172.21.15.28:0/2774165930 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f565d7f5640 1 --2- 172.21.15.28:0/2774165930 >> v2:172.21.15.28:3300/0 conn(0x7f565806e0b0 0x7f565815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f565dff6640 1 -- 172.21.15.28:0/2774165930 >> v2:172.21.15.28:3300/0 conn(0x7f565806e0b0 msgr2=0x7f565815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f565dff6640 1 --2- 172.21.15.28:0/2774165930 >> v2:172.21.15.28:3300/0 conn(0x7f565806e0b0 0x7f565815be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f565dff6640 1 -- 172.21.15.28:0/2774165930 >> v1:172.21.15.28:6789/0 conn(0x7f565806c980 legacy=0x7f565815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f565dff6640 1 -- 172.21.15.28:0/2774165930 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5658159050 con 0x7f5658155dd0 2023-12-16T03:25:21.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7fd7dc1f5640 1 Processor -- start 2023-12-16T03:25:21.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f661ddf8640 1 -- start start 2023-12-16T03:25:21.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f661ddf8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f66180c7ea0 0x7f661806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f661ddf8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661806c860 con 0x7f6618151e90 2023-12-16T03:25:21.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f661ddf8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6618154930 con 0x7f661806b9e0 2023-12-16T03:25:21.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f661ddf8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66180c8750 con 0x7f66180c7ea0 2023-12-16T03:25:21.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f6617fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f661806b9e0 0x7f661815f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53818/0 (socket says 172.21.15.28:53818) 2023-12-16T03:25:21.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f6617fff640 1 -- 172.21.15.28:0/538014124 learned_addr learned my addr 172.21.15.28:0/538014124 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:21.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f2ba9ffb640 1 -- 172.21.15.28:0/2172838229 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bac083fd0 con 0x7f2bb406e3f0 2023-12-16T03:25:21.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f2ba9ffb640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] conn(0x7f2b9806e6e0 0x7f2b98070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f2ba9ffb640 1 -- 172.21.15.28:0/2172838229 --> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b980711b0 con 0x7f2b9806e6e0 2023-12-16T03:25:21.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f2ba9ffb640 1 -- 172.21.15.28:0/2172838229 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bac0514c0 con 0x7f2bb406e3f0 2023-12-16T03:25:21.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f2bb99cf640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] conn(0x7f2b9806e6e0 0x7f2b98070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f2bb99cf640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] conn(0x7f2b9806e6e0 0x7f2b98070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f2bb89cd640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2b98066540 0x7f2b98068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fac8e7fc640 1 -- 172.21.15.28:0/931695073 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fac940039a0 con 0x7fac90006eb0 2023-12-16T03:25:21.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fac8e7fc640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fac7c066540 0x7fac7c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fac8e7fc640 1 -- 172.21.15.28:0/931695073 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac940833d0 con 0x7fac90006eb0 2023-12-16T03:25:21.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fac8e7fc640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] conn(0x7fac7c06e760 0x7fac7c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fac8e7fc640 1 -- 172.21.15.28:0/931695073 --> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac7c071230 con 0x7fac7c06e760 2023-12-16T03:25:21.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fac8e7fc640 1 -- 172.21.15.28:0/931695073 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac94085930 con 0x7fac90006eb0 2023-12-16T03:25:21.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fac9d271640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fac7c066540 0x7fac7c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fac9e273640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] conn(0x7fac7c06e760 0x7fac7c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fac9d271640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fac7c066540 0x7fac7c068a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac90005990 tx=0x7fac88007990 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7ff0867fc640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff0740664f0 0x7ff0740689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7ff0867fc640 1 -- 172.21.15.28:0/814953728 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff08811e520 con 0x7ff09006a5b0 2023-12-16T03:25:21.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7ff0867fc640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] conn(0x7ff07406e710 0x7ff074070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7ff0867fc640 1 -- 172.21.15.28:0/814953728 --> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0740711e0 con 0x7ff07406e710 2023-12-16T03:25:21.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7ff0867fc640 1 -- 172.21.15.28:0/814953728 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff08811e8a0 con 0x7ff09006a5b0 2023-12-16T03:25:21.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7ff096637640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] conn(0x7ff07406e710 0x7ff074070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7ff095635640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff0740664f0 0x7ff0740689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7ff096637640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] conn(0x7ff07406e710 0x7ff074070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f2ed5dd1640 1 -- start start 2023-12-16T03:25:21.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.824+0000 7f565d7f5640 1 --2- 172.21.15.28:0/2774165930 >> v2:172.21.15.28:3300/0 conn(0x7f565806e0b0 0x7f565815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:21.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f565dff6640 1 --2- 172.21.15.28:0/2774165930 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5658155dd0 0x7f56580c1920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5650009870 tx=0x7f565001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc05950834e33c03 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f565cff4640 1 -- 172.21.15.28:0/2774165930 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500ab600 con 0x7f5658155dd0 2023-12-16T03:25:21.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f565cff4640 1 -- 172.21.15.28:0/2774165930 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56500a7050 con 0x7f5658155dd0 2023-12-16T03:25:21.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549016494 0 0) 0x7f661806c860 con 0x7f6618151e90 2023-12-16T03:25:21.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6600003530 con 0x7f6618151e90 2023-12-16T03:25:21.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f6616ffd640 1 --2- 172.21.15.28:0/538014124 >> v2:172.21.15.134:3300/0 conn(0x7f66180c7ea0 0x7f661806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501119955 0 0) 0x7f6618154930 con 0x7f661806b9e0 2023-12-16T03:25:21.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f661806c860 con 0x7f661806b9e0 2023-12-16T03:25:21.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 230478224 0 0) 0x7f6600003530 con 0x7f6618151e90 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 >> v2:172.21.15.134:3300/0 conn(0x7f66180c7ea0 msgr2=0x7f661806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 --2- 172.21.15.28:0/538014124 >> v2:172.21.15.134:3300/0 conn(0x7f66180c7ea0 0x7f661806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 >> v1:172.21.15.134:6789/0 conn(0x7f661806b9e0 legacy=0x7f661815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618154c10 con 0x7f6618151e90 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f6608001680 con 0x7f6618151e90 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f6616ffd640 1 --2- 172.21.15.28:0/538014124 >> v2:172.21.15.134:3300/0 conn(0x7f66180c7ea0 0x7f661806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 >> v1:172.21.15.28:6789/0 conn(0x7f6618151e90 legacy=0x7f66180c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6600003b40 0x7f6600003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66000047d0 0x7f6600004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000052b0 0x7f660000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100015c0 con 0x7f66000052b0 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66180c8750 con 0x7f66000047d0 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660000c230 con 0x7f6600003b40 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f66177fe640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6600003b40 0x7f6600003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f6616ffd640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66000047d0 0x7f6600004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f6617fff640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000052b0 0x7f660000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f6616ffd640 1 -- 172.21.15.28:0/538014124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6600003b40 msgr2=0x7f6600003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f6616ffd640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6600003b40 0x7f6600003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f6616ffd640 1 -- 172.21.15.28:0/538014124 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000052b0 msgr2=0x7f660000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:21.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f6616ffd640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000052b0 0x7f660000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f565cff4640 1 -- 172.21.15.28:0/2774165930 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500ab980 con 0x7f5658155dd0 2023-12-16T03:25:21.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fd7dc1f5640 1 -- start start 2023-12-16T03:25:21.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7fac9e273640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] conn(0x7fac7c06e760 0x7fac7c070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fd7dc1f5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd7d406b6c0 0x7fd7d415c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fd7dc1f5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d40c7b30 con 0x7fd7d41560c0 2023-12-16T03:25:21.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fd7dc1f5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d40c6810 con 0x7fd7d406d370 2023-12-16T03:25:21.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7fd7dc1f5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d40c6af0 con 0x7fd7d406b6c0 2023-12-16T03:25:21.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ba9ffb640 1 -- 172.21.15.28:0/2172838229 <== osd.0 v2:172.21.15.28:6808/3810367397 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2b980711b0 con 0x7f2b9806e6e0 2023-12-16T03:25:21.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f6616ffd640 1 -- 172.21.15.28:0/538014124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618154c10 con 0x7f66000047d0 2023-12-16T03:25:21.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e659c640 1 --2- 172.21.15.28:0/429518042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e000ed90 0x7f12e000f170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f12e80690d0 tx=0x7f12e8096b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fba143f9c26a6883 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f66177fe640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6600003b40 0x7f6600003f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:21.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f2ed5dd1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 0x7f2ed00a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f2ed5dd1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed00a5430 0x7f2ed00aa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.828+0000 7f2ed5dd1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ed00c2760 0x7f2ed01f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ecf7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 0x7f2ed00a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ecf7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 0x7f2ed00a9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60426/0 (socket says 172.21.15.28:60426) 2023-12-16T03:25:21.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f6617fff640 1 -- 172.21.15.28:0/538014124 reap_dead start 2023-12-16T03:25:21.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f565eff8640 1 -- 172.21.15.28:0/2774165930 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5658155dd0 msgr2=0x7f56580c1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f565eff8640 1 --2- 172.21.15.28:0/2774165930 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5658155dd0 0x7f56580c1920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5650009870 tx=0x7f565001c400 comp rx=0 tx=0).stop 2023-12-16T03:25:21.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f565eff8640 1 -- 172.21.15.28:0/2774165930 shutdown_connections 2023-12-16T03:25:21.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f565eff8640 1 --2- 172.21.15.28:0/2774165930 >> v2:172.21.15.28:3300/0 conn(0x7f565806e0b0 0x7f565815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f565eff8640 1 --2- 172.21.15.28:0/2774165930 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5658155dd0 0x7f56580c1920 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f565eff8640 1 -- 172.21.15.28:0/2774165930 >> 172.21.15.28:0/2774165930 conn(0x7f56580a7800 msgr2=0x7f56580a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7fd7da792640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd7d406b6c0 0x7fd7d415c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e559a640 1 -- 172.21.15.28:0/429518042 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e811f8a0 con 0x7f12e000ed90 2023-12-16T03:25:21.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7ff0867fc640 1 -- 172.21.15.28:0/814953728 <== osd.2 v2:172.21.15.28:6824/1763403352 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff0740711e0 con 0x7ff07406e710 2023-12-16T03:25:21.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7fd7da792640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd7d406b6c0 0x7fd7d415c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38560/0 (socket says 172.21.15.28:38560) 2023-12-16T03:25:21.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7fd7da792640 1 -- 172.21.15.28:0/1601876829 learned_addr learned my addr 172.21.15.28:0/1601876829 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2eceffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed00a5430 0x7f2ed00aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2eceffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed00a5430 0x7f2ed00aa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60124/0 (socket says 172.21.15.28:60124) 2023-12-16T03:25:21.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e559a640 1 -- 172.21.15.28:0/429518042 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e811fa00 con 0x7f12e000ed90 2023-12-16T03:25:21.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7fac8e7fc640 1 -- 172.21.15.28:0/931695073 <== osd.1 v2:172.21.15.28:6816/3014445182 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fac7c071230 con 0x7fac7c06e760 2023-12-16T03:25:21.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e559a640 1 -- 172.21.15.28:0/429518042 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e811fe30 con 0x7f12e000ed90 2023-12-16T03:25:21.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7ff095635640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff0740664f0 0x7ff0740689b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff0900c1410 tx=0x7ff080008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f565eff8640 1 -- 172.21.15.28:0/2774165930 shutdown_connections 2023-12-16T03:25:21.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7fd7da792640 1 -- 172.21.15.28:0/1601876829 >> v1:172.21.15.134:6789/0 conn(0x7fd7d406d370 legacy=0x7fd7d415c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7fd7da792640 1 -- 172.21.15.28:0/1601876829 >> v1:172.21.15.28:6789/0 conn(0x7fd7d41560c0 legacy=0x7fd7d4159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7fd7da792640 1 -- 172.21.15.28:0/1601876829 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40c74e0 con 0x7fd7d406b6c0 2023-12-16T03:25:21.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2bb89cd640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2b98066540 0x7f2b98068a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00ad000 tx=0x7f2bb0004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e759e640 1 -- 172.21.15.28:0/429518042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e000ed90 msgr2=0x7f12e000f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e759e640 1 --2- 172.21.15.28:0/429518042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e000ed90 0x7f12e000f170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f12e80690d0 tx=0x7f12e8096b20 comp rx=0 tx=0).stop 2023-12-16T03:25:21.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ed5dd1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00aa5c0 con 0x7f2ed00c2760 2023-12-16T03:25:21.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed015b5a0 con 0x7f2ed00a5430 2023-12-16T03:25:21.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ecf7fe640 1 -- 172.21.15.28:0/3959899740 learned_addr learned my addr 172.21.15.28:0/3959899740 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed015b880 con 0x7f2ed006da00 2023-12-16T03:25:21.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ecffff640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ed00c2760 0x7f2ed01f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ecf7fe640 1 -- 172.21.15.28:0/3959899740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed00a5430 msgr2=0x7f2ed00aa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ecf7fe640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed00a5430 0x7f2ed00aa080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ecf7fe640 1 -- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ed00c2760 msgr2=0x7f2ed01f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ecf7fe640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ed00c2760 0x7f2ed01f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ecf7fe640 1 -- 172.21.15.28:0/3959899740 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00094d0 con 0x7f2ed006da00 2023-12-16T03:25:21.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2ecffff640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ed00c2760 0x7f2ed01f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:21.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f2eceffd640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed00a5430 0x7f2ed00aa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:21.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e759e640 1 -- 172.21.15.28:0/429518042 shutdown_connections 2023-12-16T03:25:21.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e759e640 1 --2- 172.21.15.28:0/429518042 >> v2:172.21.15.28:3300/0 conn(0x7f12e00073d0 0x7f12e00dad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e759e640 1 --2- 172.21.15.28:0/429518042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e000ed90 0x7f12e000f170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e759e640 1 -- 172.21.15.28:0/429518042 >> 172.21.15.28:0/429518042 conn(0x7f12e004fbe0 msgr2=0x7f12e004fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e759e640 1 -- 172.21.15.28:0/429518042 shutdown_connections 2023-12-16T03:25:21.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.832+0000 7f12e759e640 1 -- 172.21.15.28:0/429518042 wait complete. 2023-12-16T03:25:21.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f2ecf7fe640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 0x7f2ed00a9b40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400b410 tx=0x7f2ec400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f565eff8640 1 -- 172.21.15.28:0/2774165930 wait complete. 2023-12-16T03:25:21.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f2eb7fff640 1 -- 172.21.15.28:0/3959899740 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4004020 con 0x7f2ed006da00 2023-12-16T03:25:21.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f2eb7fff640 1 -- 172.21.15.28:0/3959899740 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec4004180 con 0x7f2ed006da00 2023-12-16T03:25:21.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f6616ffd640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66000047d0 0x7f6600004c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f660c0098d0 tx=0x7f660c01c570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3c33e341f4800bc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed014b7c0 con 0x7f2ed006da00 2023-12-16T03:25:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed014bd80 con 0x7f2ed006da00 2023-12-16T03:25:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c0ad660 con 0x7f66000047d0 2023-12-16T03:25:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c0ad7c0 con 0x7f66000047d0 2023-12-16T03:25:21.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f66167fc640 1 -- 172.21.15.28:0/538014124 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c0ad660 con 0x7f66000047d0 2023-12-16T03:25:21.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f2eb7fff640 1 -- 172.21.15.28:0/3959899740 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4011630 con 0x7f2ed006da00 2023-12-16T03:25:21.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f12e759e640 1 Processor -- start 2023-12-16T03:25:21.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f661ddf8640 1 -- 172.21.15.28:0/538014124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66000047d0 msgr2=0x7f6600004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f661ddf8640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66000047d0 0x7f6600004c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f660c0098d0 tx=0x7f660c01c570 comp rx=0 tx=0).stop 2023-12-16T03:25:21.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f565eff8640 1 Processor -- start 2023-12-16T03:25:21.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f565eff8640 1 -- start start 2023-12-16T03:25:21.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2eb0000fd0 con 0x7f2ed006da00 2023-12-16T03:25:21.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7f12e759e640 1 -- start start 2023-12-16T03:25:21.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.836+0000 7fd7da792640 1 --2- 172.21.15.28:0/1601876829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7d406b6c0 0x7fd7d415c740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009e50 tx=0x7fd7cc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00671fe2e34af2b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f661ddf8640 1 -- 172.21.15.28:0/538014124 shutdown_connections 2023-12-16T03:25:21.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f661ddf8640 1 --2- 172.21.15.28:0/538014124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66000047d0 0x7f6600004c50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f661ddf8640 1 -- 172.21.15.28:0/538014124 >> 172.21.15.28:0/538014124 conn(0x7f66180ca170 msgr2=0x7f66180ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565eff8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f565806c980 0x7f5658152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565eff8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565806e0b0 0x7f5658153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565eff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5658155dd0 0x7f56580aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565eff8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5658153560 con 0x7f565806c980 2023-12-16T03:25:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565eff8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56580a7180 con 0x7f565806e0b0 2023-12-16T03:25:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565eff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56580a68e0 con 0x7f5658155dd0 2023-12-16T03:25:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7fd7d8f8f640 1 -- 172.21.15.28:0/1601876829 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0a5830 con 0x7fd7d406b6c0 2023-12-16T03:25:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7fd7d8f8f640 1 -- 172.21.15.28:0/1601876829 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc0a5990 con 0x7fd7d406b6c0 2023-12-16T03:25:21.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7fd7d8f8f640 1 -- 172.21.15.28:0/1601876829 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0a5d20 con 0x7fd7d406b6c0 2023-12-16T03:25:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565dff6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f565806c980 0x7f5658152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565dff6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f565806c980 0x7f5658152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38566/0 (socket says 172.21.15.28:38566) 2023-12-16T03:25:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565dff6640 1 -- 172.21.15.28:0/3922383319 learned_addr learned my addr 172.21.15.28:0/3922383319 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565d7f5640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565806e0b0 0x7f5658153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565e7f7640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5658155dd0 0x7f56580aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/1601876829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7d406b6c0 msgr2=0x7fd7d415c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7fd7dc1f5640 1 --2- 172.21.15.28:0/1601876829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7d406b6c0 0x7fd7d415c740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009e50 tx=0x7fd7cc01c970 comp rx=0 tx=0).stop 2023-12-16T03:25:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565dff6640 1 -- 172.21.15.28:0/3922383319 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5658155dd0 msgr2=0x7f56580aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565dff6640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5658155dd0 0x7f56580aacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565dff6640 1 -- 172.21.15.28:0/3922383319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565806e0b0 msgr2=0x7f5658153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565dff6640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f565806e0b0 0x7f5658153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565dff6640 1 -- 172.21.15.28:0/3922383319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500094d0 con 0x7f565806c980 2023-12-16T03:25:21.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/1601876829 shutdown_connections 2023-12-16T03:25:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7fd7dc1f5640 1 --2- 172.21.15.28:0/1601876829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7d406b6c0 0x7fd7d415c740 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/1601876829 >> 172.21.15.28:0/1601876829 conn(0x7fd7d40c7dd0 msgr2=0x7fd7d40c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/1601876829 shutdown_connections 2023-12-16T03:25:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/1601876829 wait complete. 2023-12-16T03:25:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e00073d0 0x7f12e00c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e759e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e000ed90 0x7f12e00c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12e000fc50 0x7f12e0030d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e759e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0032790 con 0x7f12e000fc50 2023-12-16T03:25:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e759e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e017b930 con 0x7f12e00073d0 2023-12-16T03:25:21.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e759e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00c9700 con 0x7f12e000ed90 2023-12-16T03:25:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e00073d0 0x7f12e00c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e00073d0 0x7f12e00c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60142/0 (socket says 172.21.15.28:60142) 2023-12-16T03:25:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e659c640 1 -- 172.21.15.28:0/2057153168 learned_addr learned my addr 172.21.15.28:0/2057153168 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e659c640 1 -- 172.21.15.28:0/2057153168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e000ed90 msgr2=0x7f12e00c8740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:25:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e659c640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e000ed90 0x7f12e00c8740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e659c640 1 -- 172.21.15.28:0/2057153168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12e000fc50 msgr2=0x7f12e0030d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e659c640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12e000fc50 0x7f12e0030d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e659c640 1 -- 172.21.15.28:0/2057153168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e804f7e0 con 0x7f12e00073d0 2023-12-16T03:25:21.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f12e659c640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e00073d0 0x7f12e00c91c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12e8069410 tx=0x7f12e80939c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f565dff6640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f565806c980 0x7f5658152ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f565001aab0 tx=0x7f56500191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f661ddf8640 1 -- 172.21.15.28:0/538014124 shutdown_connections 2023-12-16T03:25:21.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.840+0000 7f661ddf8640 1 -- 172.21.15.28:0/538014124 wait complete. 2023-12-16T03:25:21.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f2eb7fff640 1 -- 172.21.15.28:0/3959899740 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2ec4011790 con 0x7f2ed006da00 2023-12-16T03:25:21.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f12d6ffd640 1 -- 172.21.15.28:0/2057153168 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8135070 con 0x7f12e00073d0 2023-12-16T03:25:21.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f12d6ffd640 1 -- 172.21.15.28:0/2057153168 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e81287a0 con 0x7f12e00073d0 2023-12-16T03:25:21.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f12d6ffd640 1 -- 172.21.15.28:0/2057153168 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8128910 con 0x7f12e00073d0 2023-12-16T03:25:21.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f12e759e640 1 -- 172.21.15.28:0/2057153168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e017adb0 con 0x7f12e00073d0 2023-12-16T03:25:21.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f12e759e640 1 -- 172.21.15.28:0/2057153168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e017b370 con 0x7f12e00073d0 2023-12-16T03:25:21.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f564e7fc640 1 -- 172.21.15.28:0/3922383319 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500b5610 con 0x7f565806c980 2023-12-16T03:25:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f661ddf8640 1 Processor -- start 2023-12-16T03:25:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f564e7fc640 1 -- 172.21.15.28:0/3922383319 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56500b5790 con 0x7f565806c980 2023-12-16T03:25:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f564e7fc640 1 -- 172.21.15.28:0/3922383319 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500b5b40 con 0x7f565806c980 2023-12-16T03:25:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f565eff8640 1 -- 172.21.15.28:0/3922383319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56580a6bc0 con 0x7f565806c980 2023-12-16T03:25:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f565eff8640 1 -- 172.21.15.28:0/3922383319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56580a8950 con 0x7f565806c980 2023-12-16T03:25:21.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f12e759e640 1 -- 172.21.15.28:0/2057153168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12e00db280 con 0x7f12e00073d0 2023-12-16T03:25:21.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f565eff8640 1 -- 172.21.15.28:0/3922383319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f565815cae0 con 0x7f565806c980 2023-12-16T03:25:21.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f2eb7fff640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2ebc066540 0x7f2ebc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7fd7dc1f5640 1 Processor -- start 2023-12-16T03:25:21.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7fd7dc1f5640 1 -- start start 2023-12-16T03:25:21.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f2eb7fff640 1 -- 172.21.15.28:0/3959899740 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ec4083b50 con 0x7f2ed006da00 2023-12-16T03:25:21.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.844+0000 7f2eb7fff640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] conn(0x7f2ebc06e760 0x7f2ebc070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f2eb7fff640 1 -- 172.21.15.28:0/3959899740 --> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ebc071230 con 0x7f2ebc06e760 2023-12-16T03:25:21.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7fd7dc1f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7d406b6c0 0x7fd7d4155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f2eb7fff640 1 -- 172.21.15.28:0/3959899740 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ec40882a0 con 0x7f2ed006da00 2023-12-16T03:25:21.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7fd7dc1f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7d406d370 0x7fd7d4155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f2ecffff640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] conn(0x7f2ebc06e760 0x7f2ebc070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7fd7d9f91640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7d406b6c0 0x7fd7d4155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7fd7d9f91640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7d406b6c0 0x7fd7d4155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60448/0 (socket says 172.21.15.28:60448) 2023-12-16T03:25:21.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f661ddf8640 1 -- start start 2023-12-16T03:25:21.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f661ddf8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000047d0 0x7f66181ec640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f661ddf8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f661814c140 0x7f6618156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f661ddf8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f661814d190 0x7f6618156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f661ddf8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66181552d0 con 0x7f66000047d0 2023-12-16T03:25:21.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f661ddf8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661814f020 con 0x7f661814c140 2023-12-16T03:25:21.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f661ddf8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66181ecf20 con 0x7f661814d190 2023-12-16T03:25:21.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f2ecffff640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] conn(0x7f2ebc06e760 0x7f2ebc070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f2eceffd640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2ebc066540 0x7f2ebc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f6616ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f661814c140 0x7f6618156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f6616ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f661814c140 0x7f6618156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60148/0 (socket says 172.21.15.28:60148) 2023-12-16T03:25:21.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f6616ffd640 1 -- 172.21.15.28:0/1476672842 learned_addr learned my addr 172.21.15.28:0/1476672842 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7fd7dc1f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7d41560c0 0x7fd7d40ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7fd7d9f91640 1 -- 172.21.15.28:0/2585711811 learned_addr learned my addr 172.21.15.28:0/2585711811 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:21.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7fd7d9790640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7d406d370 0x7fd7d4155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7fd7da792640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7d41560c0 0x7fd7d40ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41f1f90 con 0x7fd7d406d370 2023-12-16T03:25:21.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41f1380 con 0x7fd7d41560c0 2023-12-16T03:25:21.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41f1660 con 0x7fd7d406b6c0 2023-12-16T03:25:21.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f66177fe640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000047d0 0x7f66181ec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f12d6ffd640 1 -- 172.21.15.28:0/2057153168 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f12e8128a70 con 0x7f12e00073d0 2023-12-16T03:25:21.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f12d6ffd640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f12c8066540 0x7f12c8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.848+0000 7f12d6ffd640 1 -- 172.21.15.28:0/2057153168 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12e8198ad0 con 0x7f12e00073d0 2023-12-16T03:25:21.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f2eceffd640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2ebc066540 0x7f2ebc068a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00ad000 tx=0x7f2ec00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f66177fe640 1 -- 172.21.15.28:0/1476672842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f661814d190 msgr2=0x7f6618156940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-16T03:25:21.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f66177fe640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f661814d190 0x7f6618156940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f66177fe640 1 -- 172.21.15.28:0/1476672842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f661814c140 msgr2=0x7f6618156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f66177fe640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f661814c140 0x7f6618156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f66177fe640 1 -- 172.21.15.28:0/1476672842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66181ed200 con 0x7f66000047d0 2023-12-16T03:25:21.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f12e5d9b640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f12c8066540 0x7f12c8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f66177fe640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000047d0 0x7f66181ec640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f660800e700 tx=0x7f660800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f2eb7fff640 1 -- 172.21.15.28:0/3959899740 <== osd.3 v2:172.21.15.28:6800/886705045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2ebc071230 con 0x7f2ebc06e760 2023-12-16T03:25:21.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7fd7d9f91640 1 -- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7d41560c0 msgr2=0x7fd7d40ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7fd7d9f91640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7d41560c0 0x7fd7d40ad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7fd7d9f91640 1 -- 172.21.15.28:0/2585711811 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7d406d370 msgr2=0x7fd7d4155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7fd7d9f91640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7d406d370 0x7fd7d4155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7fd7d9f91640 1 -- 172.21.15.28:0/2585711811 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc009b30 con 0x7fd7d406b6c0 2023-12-16T03:25:21.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7fd7da792640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7d41560c0 0x7fd7d40ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:21.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f65fffff640 1 -- 172.21.15.28:0/1476672842 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080050d0 con 0x7f66000047d0 2023-12-16T03:25:21.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7fd7d9f91640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7d406b6c0 0x7fd7d4155210 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c500 tx=0x7fd7d000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f661ddf8640 1 -- 172.21.15.28:0/1476672842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661814e9d0 con 0x7f66000047d0 2023-12-16T03:25:21.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f12e5d9b640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f12c8066540 0x7f12c8068a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12d8006fd0 tx=0x7f12d8006b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f12d6ffd640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] conn(0x7f12c806e760 0x7f12c8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f12d6ffd640 1 -- 172.21.15.28:0/2057153168 --> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12c8071230 con 0x7f12c806e760 2023-12-16T03:25:21.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f12d6ffd640 1 -- 172.21.15.28:0/2057153168 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12e8198e80 con 0x7f12e00073d0 2023-12-16T03:25:21.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f12e6d9d640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] conn(0x7f12c806e760 0x7f12c8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f12e6d9d640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] conn(0x7f12c806e760 0x7f12c8070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f564e7fc640 1 -- 172.21.15.28:0/3922383319 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f56500b2050 con 0x7f565806c980 2023-12-16T03:25:21.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f564e7fc640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f563c0664c0 0x7f563c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f564e7fc640 1 -- 172.21.15.28:0/3922383319 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56500ef900 con 0x7f565806c980 2023-12-16T03:25:21.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f565d7f5640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f563c0664c0 0x7f563c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f564e7fc640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] conn(0x7f563c06f3c0 0x7f563c071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f564e7fc640 1 -- 172.21.15.28:0/3922383319 --> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f563c071f30 con 0x7f563c06f3c0 2023-12-16T03:25:21.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f564e7fc640 1 -- 172.21.15.28:0/3922383319 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56500ef6d0 con 0x7f565806c980 2023-12-16T03:25:21.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7fd7ca7fc640 1 -- 172.21.15.28:0/2585711811 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0005220 con 0x7fd7d406b6c0 2023-12-16T03:25:21.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7fd7ca7fc640 1 -- 172.21.15.28:0/2585711811 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d0005380 con 0x7fd7d406b6c0 2023-12-16T03:25:21.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f661ddf8640 1 -- 172.21.15.28:0/1476672842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66181ecb80 con 0x7f66000047d0 2023-12-16T03:25:21.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f65fffff640 1 -- 172.21.15.28:0/1476672842 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6608005230 con 0x7f66000047d0 2023-12-16T03:25:21.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f65fffff640 1 -- 172.21.15.28:0/1476672842 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800c6c0 con 0x7f66000047d0 2023-12-16T03:25:21.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.852+0000 7f661ddf8640 1 -- 172.21.15.28:0/1476672842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65f8000fd0 con 0x7f66000047d0 2023-12-16T03:25:21.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.856+0000 7fd7ca7fc640 1 -- 172.21.15.28:0/2585711811 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0007270 con 0x7fd7d406b6c0 2023-12-16T03:25:21.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.856+0000 7f565d7f5640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f563c0664c0 0x7f563c068980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5658070570 tx=0x7f5648008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.856+0000 7f565e7f7640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] conn(0x7f563c06f3c0 0x7f563c071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.856+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d41f1940 con 0x7fd7d406b6c0 2023-12-16T03:25:21.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.856+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d41f0f40 con 0x7fd7d406b6c0 2023-12-16T03:25:21.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.856+0000 7f12d6ffd640 1 -- 172.21.15.28:0/2057153168 <== osd.4 v2:172.21.15.134:6817/2998678416 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f12c8071230 con 0x7f12c806e760 2023-12-16T03:25:21.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.856+0000 7f565e7f7640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] conn(0x7f563c06f3c0 0x7f563c071860 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.856+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7d4068400 con 0x7fd7d406b6c0 2023-12-16T03:25:21.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.856+0000 7f564e7fc640 1 -- 172.21.15.28:0/3922383319 <== osd.5 v2:172.21.15.134:6800/3318283846 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f563c071f30 con 0x7f563c06f3c0 2023-12-16T03:25:21.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.856+0000 7fd7ca7fc640 1 -- 172.21.15.28:0/2585711811 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd7d00073d0 con 0x7fd7d406b6c0 2023-12-16T03:25:21.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.856+0000 7f65fffff640 1 -- 172.21.15.28:0/1476672842 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f660800c820 con 0x7f66000047d0 2023-12-16T03:25:21.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7f65fffff640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6604066500 0x7f66040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7f6616ffd640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6604066500 0x7f66040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7fd7ca7fc640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd7b8066540 0x7fd7b8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7fd7ca7fc640 1 -- 172.21.15.28:0/2585711811 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7d0083dc0 con 0x7fd7d406b6c0 2023-12-16T03:25:21.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7fd7ca7fc640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] conn(0x7fd7b806e760 0x7fd7b8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7fd7ca7fc640 1 -- 172.21.15.28:0/2585711811 --> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7b8071230 con 0x7fd7b806e760 2023-12-16T03:25:21.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7fd7ca7fc640 1 -- 172.21.15.28:0/2585711811 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7d0084170 con 0x7fd7d406b6c0 2023-12-16T03:25:21.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7fd7da792640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] conn(0x7fd7b806e760 0x7fd7b8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7f65fffff640 1 -- 172.21.15.28:0/1476672842 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66080845a0 con 0x7f66000047d0 2023-12-16T03:25:21.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7f65fffff640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] conn(0x7f660406e6a0 0x7f6604070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:21.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7fd7da792640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] conn(0x7fd7b806e760 0x7fd7b8070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7f65fffff640 1 -- 172.21.15.28:0/1476672842 --> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6604071170 con 0x7f660406e6a0 2023-12-16T03:25:21.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7f65fffff640 1 -- 172.21.15.28:0/1476672842 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f660800c6c0 con 0x7f66000047d0 2023-12-16T03:25:21.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7f2bbb432640 1 -- 172.21.15.28:0/2172838229 --> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2bb41e7370 con 0x7f2b9806e6e0 2023-12-16T03:25:21.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7fac9fcd6640 1 -- 172.21.15.28:0/931695073 --> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fac900d1380 con 0x7fac7c06e760 2023-12-16T03:25:21.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.860+0000 7f6617fff640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] conn(0x7f660406e6a0 0x7f6604070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7f6616ffd640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6604066500 0x7f66040689c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f66181562f0 tx=0x7f660c0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac8e7fc640 1 -- 172.21.15.28:0/931695073 <== osd.1 v2:172.21.15.28:6816/3014445182 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fac9811f720 con 0x7fac7c06e760 2023-12-16T03:25:21.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac9fcd6640 1 -- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] conn(0x7fac7c06e760 msgr2=0x7fac7c070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fd7d9790640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd7b8066540 0x7fd7b8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:21.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fd7ca7fc640 1 -- 172.21.15.28:0/2585711811 <== osd.6 v2:172.21.15.134:6816/1740691046 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd7b8071230 con 0x7fd7b806e760 2023-12-16T03:25:21.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7f6617fff640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] conn(0x7f660406e6a0 0x7f6604070ac0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac9fcd6640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] conn(0x7fac7c06e760 0x7fac7c070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac9fcd6640 1 -- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fac7c066540 msgr2=0x7fac7c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac9fcd6640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fac7c066540 0x7fac7c068a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac90005990 tx=0x7fac88007990 comp rx=0 tx=0).stop 2023-12-16T03:25:21.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac9fcd6640 1 -- 172.21.15.28:0/931695073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac90006eb0 msgr2=0x7fac900d6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac9fcd6640 1 --2- 172.21.15.28:0/931695073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac90006eb0 0x7fac900d6640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac9400c430 tx=0x7fac9400c8f0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac9e273640 1 -- 172.21.15.28:0/931695073 reap_dead start 2023-12-16T03:25:21.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac9fcd6640 1 -- 172.21.15.28:0/931695073 shutdown_connections 2023-12-16T03:25:21.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac9fcd6640 1 -- 172.21.15.28:0/931695073 >> 172.21.15.28:0/931695073 conn(0x7fac90048260 msgr2=0x7fac9002b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fd7d9790640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd7b8066540 0x7fd7b8068a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4007fd0 tx=0x7fd7c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:21.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7f65fffff640 1 -- 172.21.15.28:0/1476672842 <== osd.7 v2:172.21.15.134:6808/1504886822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6604071170 con 0x7f660406e6a0 2023-12-16T03:25:21.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac9fcd6640 1 -- 172.21.15.28:0/931695073 shutdown_connections 2023-12-16T03:25:21.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7fac9fcd6640 1 -- 172.21.15.28:0/931695073 wait complete. 2023-12-16T03:25:21.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.864+0000 7ff073fff640 1 -- 172.21.15.28:0/814953728 --> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff090067e20 con 0x7ff07406e710 2023-12-16T03:25:21.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2ba9ffb640 1 -- 172.21.15.28:0/2172838229 <== osd.0 v2:172.21.15.28:6808/3810367397 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2bb41e7370 con 0x7f2b9806e6e0 2023-12-16T03:25:21.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff0867fc640 1 -- 172.21.15.28:0/814953728 <== osd.2 v2:172.21.15.28:6824/1763403352 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff090067e20 con 0x7ff07406e710 2023-12-16T03:25:21.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2bbb432640 1 -- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] conn(0x7f2b9806e6e0 msgr2=0x7f2b98070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2bbb432640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] conn(0x7f2b9806e6e0 0x7f2b98070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2bbb432640 1 -- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2b98066540 msgr2=0x7f2b98068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2bbb432640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2b98066540 0x7f2b98068a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00ad000 tx=0x7f2bb0004740 comp rx=0 tx=0).stop 2023-12-16T03:25:21.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff073fff640 1 -- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] conn(0x7ff07406e710 msgr2=0x7ff074070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff073fff640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] conn(0x7ff07406e710 0x7ff074070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2bbb432640 1 -- 172.21.15.28:0/2172838229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bb406e3f0 msgr2=0x7f2bb40a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2bbb432640 1 --2- 172.21.15.28:0/2172838229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bb406e3f0 0x7f2bb40a9df0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00c7c0 tx=0x7f2bac00cc80 comp rx=0 tx=0).stop 2023-12-16T03:25:21.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2bb99cf640 1 -- 172.21.15.28:0/2172838229 reap_dead start 2023-12-16T03:25:21.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2bbb432640 1 -- 172.21.15.28:0/2172838229 shutdown_connections 2023-12-16T03:25:21.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2bbb432640 1 -- 172.21.15.28:0/2172838229 >> 172.21.15.28:0/2172838229 conn(0x7f2bb40c5cd0 msgr2=0x7f2bb40a4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff073fff640 1 -- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff0740664f0 msgr2=0x7ff0740689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff073fff640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff0740664f0 0x7ff0740689b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff0900c1410 tx=0x7ff080008040 comp rx=0 tx=0).stop 2023-12-16T03:25:21.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff073fff640 1 -- 172.21.15.28:0/814953728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff09006a5b0 msgr2=0x7ff090154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff073fff640 1 --2- 172.21.15.28:0/814953728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff09006a5b0 0x7ff090154960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff0880194f0 tx=0x7ff088019680 comp rx=0 tx=0).stop 2023-12-16T03:25:21.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff096637640 1 -- 172.21.15.28:0/814953728 reap_dead start 2023-12-16T03:25:21.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff073fff640 1 -- 172.21.15.28:0/814953728 shutdown_connections 2023-12-16T03:25:21.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff073fff640 1 -- 172.21.15.28:0/814953728 >> 172.21.15.28:0/814953728 conn(0x7ff0900a8880 msgr2=0x7ff0900c2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2bbb432640 1 -- 172.21.15.28:0/2172838229 shutdown_connections 2023-12-16T03:25:21.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7f2bbb432640 1 -- 172.21.15.28:0/2172838229 wait complete. 2023-12-16T03:25:21.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff073fff640 1 -- 172.21.15.28:0/814953728 shutdown_connections 2023-12-16T03:25:21.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.868+0000 7ff073fff640 1 -- 172.21.15.28:0/814953728 wait complete. 2023-12-16T03:25:21.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e759e640 1 -- 172.21.15.28:0/2057153168 --> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f12e00077e0 con 0x7f12c806e760 2023-12-16T03:25:21.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12d6ffd640 1 -- 172.21.15.28:0/2057153168 <== osd.4 v2:172.21.15.134:6817/2998678416 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f12dc009460 con 0x7f12c806e760 2023-12-16T03:25:21.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e759e640 1 -- 172.21.15.28:0/2057153168 >> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] conn(0x7f12c806e760 msgr2=0x7f12c8070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e759e640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] conn(0x7f12c806e760 0x7f12c8070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e759e640 1 -- 172.21.15.28:0/2057153168 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f12c8066540 msgr2=0x7f12c8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e759e640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f12c8066540 0x7f12c8068a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12d8006fd0 tx=0x7f12d8006b40 comp rx=0 tx=0).stop 2023-12-16T03:25:21.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e759e640 1 -- 172.21.15.28:0/2057153168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e00073d0 msgr2=0x7f12e00c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e759e640 1 --2- 172.21.15.28:0/2057153168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e00073d0 0x7f12e00c91c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12e8069410 tx=0x7f12e80939c0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e6d9d640 1 -- 172.21.15.28:0/2057153168 reap_dead start 2023-12-16T03:25:21.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e759e640 1 -- 172.21.15.28:0/2057153168 shutdown_connections 2023-12-16T03:25:21.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e759e640 1 -- 172.21.15.28:0/2057153168 >> 172.21.15.28:0/2057153168 conn(0x7f12e004fbe0 msgr2=0x7f12e00da9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 --> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2eb0002cc0 con 0x7f2ebc06e760 2023-12-16T03:25:21.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e759e640 1 -- 172.21.15.28:0/2057153168 shutdown_connections 2023-12-16T03:25:21.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.884+0000 7f12e759e640 1 -- 172.21.15.28:0/2057153168 wait complete. 2023-12-16T03:25:21.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565eff8640 1 -- 172.21.15.28:0/3922383319 --> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f565804e850 con 0x7f563c06f3c0 2023-12-16T03:25:21.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f564e7fc640 1 -- 172.21.15.28:0/3922383319 <== osd.5 v2:172.21.15.134:6800/3318283846 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f565804e850 con 0x7f563c06f3c0 2023-12-16T03:25:21.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f2eb7fff640 1 -- 172.21.15.28:0/3959899740 <== osd.3 v2:172.21.15.28:6800/886705045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2eb0002cc0 con 0x7f2ebc06e760 2023-12-16T03:25:21.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] conn(0x7f2ebc06e760 msgr2=0x7f2ebc070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565eff8640 1 -- 172.21.15.28:0/3922383319 >> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] conn(0x7f563c06f3c0 msgr2=0x7f563c071860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565eff8640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] conn(0x7f563c06f3c0 0x7f563c071860 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f2ed5dd1640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] conn(0x7f2ebc06e760 0x7f2ebc070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2ebc066540 msgr2=0x7f2ebc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f2ed5dd1640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2ebc066540 0x7f2ebc068a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00ad000 tx=0x7f2ec00a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:21.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 msgr2=0x7f2ed00a9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f2ed5dd1640 1 --2- 172.21.15.28:0/3959899740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ed006da00 0x7f2ed00a9b40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400b410 tx=0x7f2ec400b8d0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f2ecffff640 1 -- 172.21.15.28:0/3959899740 reap_dead start 2023-12-16T03:25:21.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565eff8640 1 -- 172.21.15.28:0/3922383319 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f563c0664c0 msgr2=0x7f563c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565eff8640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f563c0664c0 0x7f563c068980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5658070570 tx=0x7f5648008040 comp rx=0 tx=0).stop 2023-12-16T03:25:21.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565eff8640 1 -- 172.21.15.28:0/3922383319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f565806c980 msgr2=0x7f5658152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565eff8640 1 --2- 172.21.15.28:0/3922383319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f565806c980 0x7f5658152ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f565001aab0 tx=0x7f56500191a0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565e7f7640 1 -- 172.21.15.28:0/3922383319 reap_dead start 2023-12-16T03:25:21.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565eff8640 1 -- 172.21.15.28:0/3922383319 shutdown_connections 2023-12-16T03:25:21.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565eff8640 1 -- 172.21.15.28:0/3922383319 >> 172.21.15.28:0/3922383319 conn(0x7f56580a7800 msgr2=0x7f56580c24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565eff8640 1 -- 172.21.15.28:0/3922383319 shutdown_connections 2023-12-16T03:25:21.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 shutdown_connections 2023-12-16T03:25:21.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 >> 172.21.15.28:0/3959899740 conn(0x7f2ed006a5b0 msgr2=0x7f2ed0150e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.888+0000 7f565eff8640 1 -- 172.21.15.28:0/3922383319 wait complete. 2023-12-16T03:25:21.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.892+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 --> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7d4166df0 con 0x7fd7b806e760 2023-12-16T03:25:21.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.892+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 shutdown_connections 2023-12-16T03:25:21.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.892+0000 7f2ed5dd1640 1 -- 172.21.15.28:0/3959899740 wait complete. 2023-12-16T03:25:21.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.892+0000 7fd7ca7fc640 1 -- 172.21.15.28:0/2585711811 <== osd.6 v2:172.21.15.134:6816/1740691046 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7d4166df0 con 0x7fd7b806e760 2023-12-16T03:25:21.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f661ddf8640 1 -- 172.21.15.28:0/1476672842 --> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65f8002cc0 con 0x7f660406e6a0 2023-12-16T03:25:21.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] conn(0x7fd7b806e760 msgr2=0x7fd7b8070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7fd7dc1f5640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] conn(0x7fd7b806e760 0x7fd7b8070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd7b8066540 msgr2=0x7fd7b8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7fd7dc1f5640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd7b8066540 0x7fd7b8068a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4007fd0 tx=0x7fd7c4009040 comp rx=0 tx=0).stop 2023-12-16T03:25:21.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7d406b6c0 msgr2=0x7fd7d4155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7fd7dc1f5640 1 --2- 172.21.15.28:0/2585711811 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7d406b6c0 0x7fd7d4155210 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c500 tx=0x7fd7d000c9c0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f65fffff640 1 -- 172.21.15.28:0/1476672842 <== osd.7 v2:172.21.15.134:6808/1504886822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f65f8002cc0 con 0x7f660406e6a0 2023-12-16T03:25:21.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7fd7da792640 1 -- 172.21.15.28:0/2585711811 reap_dead start 2023-12-16T03:25:21.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 shutdown_connections 2023-12-16T03:25:21.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 >> 172.21.15.28:0/2585711811 conn(0x7fd7d40c7dd0 msgr2=0x7fd7d406fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f661ddf8640 1 -- 172.21.15.28:0/1476672842 >> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] conn(0x7f660406e6a0 msgr2=0x7f6604070ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f661ddf8640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] conn(0x7f660406e6a0 0x7f6604070ac0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 shutdown_connections 2023-12-16T03:25:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f661ddf8640 1 -- 172.21.15.28:0/1476672842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6604066500 msgr2=0x7f66040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f661ddf8640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6604066500 0x7f66040689c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f66181562f0 tx=0x7f660c0046d0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f661ddf8640 1 -- 172.21.15.28:0/1476672842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000047d0 msgr2=0x7f66181ec640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f661ddf8640 1 --2- 172.21.15.28:0/1476672842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000047d0 0x7f66181ec640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f660800e700 tx=0x7f660800ebc0 comp rx=0 tx=0).stop 2023-12-16T03:25:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f6617fff640 1 -- 172.21.15.28:0/1476672842 reap_dead start 2023-12-16T03:25:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f661ddf8640 1 -- 172.21.15.28:0/1476672842 shutdown_connections 2023-12-16T03:25:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f661ddf8640 1 -- 172.21.15.28:0/1476672842 >> 172.21.15.28:0/1476672842 conn(0x7f66180ca170 msgr2=0x7f6618150640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f661ddf8640 1 -- 172.21.15.28:0/1476672842 shutdown_connections 2023-12-16T03:25:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7fd7dc1f5640 1 -- 172.21.15.28:0/2585711811 wait complete. 2023-12-16T03:25:21.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:21.896+0000 7f661ddf8640 1 -- 172.21.15.28:0/1476672842 wait complete. 2023-12-16T03:25:21.904 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2023-12-16T03:25:21.905 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-16T03:25:21.913 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-12-16T03:25:21.917 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-12-16T03:25:21.918 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-16T03:25:21.918 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-16T03:25:21.924 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-12-16T03:25:21.925 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-16T03:25:21.928 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-12-16T03:25:21.928 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-16T03:25:21.934 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-12-16T03:25:21.934 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-16T03:25:21.935 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:21.935 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-16T03:25:21.943 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-12-16T03:25:21.943 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-16T03:25:22.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.136+0000 7f4cee2c8640 1 Processor -- start 2023-12-16T03:25:22.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.136+0000 7f4cee2c8640 1 -- start start 2023-12-16T03:25:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.136+0000 7f4cee2c8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce8151d00 0x7f4ce8155130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.136+0000 7f4cee2c8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce80bf7f0 con 0x7f4ce80bee80 2023-12-16T03:25:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.136+0000 7f4cee2c8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce8154ca0 con 0x7f4ce80c0450 2023-12-16T03:25:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.136+0000 7f4cee2c8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80bf300 con 0x7f4ce8151d00 2023-12-16T03:25:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.140+0000 7f4ced2c6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce8151d00 0x7f4ce8155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.140+0000 7f4ced2c6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce8151d00 0x7f4ce8155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60468/0 (socket says 172.21.15.28:60468) 2023-12-16T03:25:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.140+0000 7f4ced2c6640 1 -- 172.21.15.28:0/240002044 learned_addr learned my addr 172.21.15.28:0/240002044 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.140+0000 7f4ced2c6640 1 -- 172.21.15.28:0/240002044 >> v1:172.21.15.134:6789/0 conn(0x7f4ce80c0450 legacy=0x7f4ce80a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.140+0000 7f4ced2c6640 1 -- 172.21.15.28:0/240002044 >> v1:172.21.15.28:6789/0 conn(0x7f4ce80bee80 legacy=0x7f4ce80723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:22.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.140+0000 7f4ced2c6640 1 -- 172.21.15.28:0/240002044 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80bf510 con 0x7f4ce8151d00 2023-12-16T03:25:22.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7efd031aa640 1 Processor -- start 2023-12-16T03:25:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7efd031aa640 1 -- start start 2023-12-16T03:25:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7f4ced2c6640 1 --2- 172.21.15.28:0/240002044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce8151d00 0x7f4ce8155130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009e80 tx=0x7f4ce001c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ed9e6298bc477da server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7efd031aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf400aa20 0x7efcf4006eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7efd031aa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efcf40073f0 0x7efcf40db6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7f4cdffff640 1 -- 172.21.15.28:0/240002044 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00a6440 con 0x7f4ce8151d00 2023-12-16T03:25:22.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7efd00f46640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7efcf40d5780 0x7efcf40496e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53836/0 (socket says 172.21.15.28:53836) 2023-12-16T03:25:22.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7f4cdffff640 1 -- 172.21.15.28:0/240002044 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce00a65a0 con 0x7f4ce8151d00 2023-12-16T03:25:22.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7f4cdffff640 1 -- 172.21.15.28:0/240002044 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00a6930 con 0x7f4ce8151d00 2023-12-16T03:25:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7efd01747640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efcf40073f0 0x7efcf40db6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7efd01747640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efcf40073f0 0x7efcf40db6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38606/0 (socket says 172.21.15.28:38606) 2023-12-16T03:25:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7efcfbfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf400aa20 0x7efcf4006eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7efcfbfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf400aa20 0x7efcf4006eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60470/0 (socket says 172.21.15.28:60470) 2023-12-16T03:25:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7efd031aa640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf4049fe0 con 0x7efcf40d5780 2023-12-16T03:25:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7efd031aa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf4046480 con 0x7efcf40073f0 2023-12-16T03:25:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7efd031aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf404a2c0 con 0x7efcf400aa20 2023-12-16T03:25:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7f4cee2c8640 1 -- 172.21.15.28:0/240002044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce8151d00 msgr2=0x7f4ce8155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.144+0000 7f4cee2c8640 1 --2- 172.21.15.28:0/240002044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce8151d00 0x7f4ce8155130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009e80 tx=0x7f4ce001c7f0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7f4cee2c8640 1 -- 172.21.15.28:0/240002044 shutdown_connections 2023-12-16T03:25:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7f4cee2c8640 1 --2- 172.21.15.28:0/240002044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce8151d00 0x7f4ce8155130 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7f4cee2c8640 1 -- 172.21.15.28:0/240002044 >> 172.21.15.28:0/240002044 conn(0x7f4ce80a7800 msgr2=0x7f4ce80a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7f4cee2c8640 1 -- 172.21.15.28:0/240002044 shutdown_connections 2023-12-16T03:25:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7f4cee2c8640 1 -- 172.21.15.28:0/240002044 wait complete. 2023-12-16T03:25:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7efd00f46640 1 -- 172.21.15.28:0/3972045544 learned_addr learned my addr 172.21.15.28:0/3972045544 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7f4cee2c8640 1 Processor -- start 2023-12-16T03:25:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7f4cee2c8640 1 -- start start 2023-12-16T03:25:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7efcfbfff640 1 -- 172.21.15.28:0/3972045544 >> v2:172.21.15.28:3300/0 conn(0x7efcf40073f0 msgr2=0x7efcf40db6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7efcfbfff640 1 --2- 172.21.15.28:0/3972045544 >> v2:172.21.15.28:3300/0 conn(0x7efcf40073f0 0x7efcf40db6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7efcfbfff640 1 -- 172.21.15.28:0/3972045544 >> v1:172.21.15.134:6789/0 conn(0x7efcf40d5780 legacy=0x7efcf40496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.148+0000 7efcfbfff640 1 -- 172.21.15.28:0/3972045544 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf404a5d0 con 0x7efcf400aa20 2023-12-16T03:25:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f63e759e640 1 Processor -- start 2023-12-16T03:25:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4cee2c8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce80bee80 0x7f4ce814a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4cee2c8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce80c0450 0x7f4ce81f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f63e759e640 1 -- start start 2023-12-16T03:25:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4cee2c8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce8151d00 0x7f4ce81f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4ced2c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce80bee80 0x7f4ce814a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4ced2c6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce80bee80 0x7f4ce814a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60174/0 (socket says 172.21.15.28:60174) 2023-12-16T03:25:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4cee2c8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce81487a0 con 0x7f4ce8151d00 2023-12-16T03:25:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4cee2c8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce814fb00 con 0x7f4ce80bee80 2023-12-16T03:25:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4cee2c8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce814fd90 con 0x7f4ce80c0450 2023-12-16T03:25:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4cecac5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce80c0450 0x7f4ce81f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4ced2c6640 1 -- 172.21.15.28:0/441548482 learned_addr learned my addr 172.21.15.28:0/441548482 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4cedac7640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce8151d00 0x7f4ce81f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4ced2c6640 1 -- 172.21.15.28:0/441548482 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce80c0450 msgr2=0x7f4ce81f6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4ced2c6640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce80c0450 0x7f4ce81f6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4ced2c6640 1 -- 172.21.15.28:0/441548482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce8151d00 msgr2=0x7f4ce81f70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4ced2c6640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce8151d00 0x7f4ce81f70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4ced2c6640 1 -- 172.21.15.28:0/441548482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0009b30 con 0x7f4ce80bee80 2023-12-16T03:25:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4cedac7640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce8151d00 0x7f4ce81f70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f63e759e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63e80bf1f0 0x7f63e80c4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f63e759e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e80c54f0 con 0x7f63e80bfd70 2023-12-16T03:25:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f63e759e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e80c1880 con 0x7f63e8158060 2023-12-16T03:25:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f63e759e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80c5a20 con 0x7f63e80bf1f0 2023-12-16T03:25:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f4ced2c6640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce80bee80 0x7f4ce814a8d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ce001aea0 tx=0x7f4ce0019590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f63e5d9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f63e80bfd70 0x7f63e80c49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57846/0 (socket says 172.21.15.28:57846) 2023-12-16T03:25:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7f63e5d9b640 1 -- 172.21.15.28:0/2222096756 learned_addr learned my addr 172.21.15.28:0/2222096756 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.152+0000 7f63e659c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63e80bf1f0 0x7f63e80c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efcfbfff640 1 --2- 172.21.15.28:0/3972045544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf400aa20 0x7efcf4006eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efcf00097c0 tx=0x7efcf001c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb57f352a8f29c5a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7eff15809640 1 Processor -- start 2023-12-16T03:25:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7f4cddffb640 1 -- 172.21.15.28:0/441548482 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00a6d60 con 0x7f4ce80bee80 2023-12-16T03:25:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7f4cddffb640 1 -- 172.21.15.28:0/441548482 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce00bb440 con 0x7f4ce80bee80 2023-12-16T03:25:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7f63e659c640 1 -- 172.21.15.28:0/2222096756 >> v1:172.21.15.134:6789/0 conn(0x7f63e8158060 legacy=0x7f63e815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7f63e659c640 1 -- 172.21.15.28:0/2222096756 >> v1:172.21.15.28:6789/0 conn(0x7f63e80bfd70 legacy=0x7f63e80c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7f63e659c640 1 -- 172.21.15.28:0/2222096756 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80c50c0 con 0x7f63e80bf1f0 2023-12-16T03:25:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efcfb7fe640 1 -- 172.21.15.28:0/3972045544 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00ab600 con 0x7efcf400aa20 2023-12-16T03:25:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efcfb7fe640 1 -- 172.21.15.28:0/3972045544 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00a7050 con 0x7efcf400aa20 2023-12-16T03:25:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7eff15809640 1 -- start start 2023-12-16T03:25:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efcfb7fe640 1 -- 172.21.15.28:0/3972045544 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00ab980 con 0x7efcf400aa20 2023-12-16T03:25:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efd031aa640 1 -- 172.21.15.28:0/3972045544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf400aa20 msgr2=0x7efcf4006eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7f63e559a640 1 -- 172.21.15.28:0/2222096756 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149050043 0 0) 0x7f63e80c1880 con 0x7f63e8158060 2023-12-16T03:25:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efd031aa640 1 --2- 172.21.15.28:0/3972045544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf400aa20 0x7efcf4006eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efcf00097c0 tx=0x7efcf001c3d0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efd031aa640 1 -- 172.21.15.28:0/3972045544 shutdown_connections 2023-12-16T03:25:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efd031aa640 1 --2- 172.21.15.28:0/3972045544 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf400aa20 0x7efcf4006eb0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efcf00097c0 tx=0x7efcf001c3d0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efd031aa640 1 --2- 172.21.15.28:0/3972045544 >> v2:172.21.15.28:3300/0 conn(0x7efcf40073f0 0x7efcf40db6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efd031aa640 1 -- 172.21.15.28:0/3972045544 >> 172.21.15.28:0/3972045544 conn(0x7efcf4048260 msgr2=0x7efcf4048670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efd031aa640 1 -- 172.21.15.28:0/3972045544 shutdown_connections 2023-12-16T03:25:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7efd031aa640 1 -- 172.21.15.28:0/3972045544 wait complete. 2023-12-16T03:25:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7f4cddffb640 1 -- 172.21.15.28:0/441548482 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00bb7f0 con 0x7f4ce80bee80 2023-12-16T03:25:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7f4cee2c8640 1 -- 172.21.15.28:0/441548482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce8150070 con 0x7f4ce80bee80 2023-12-16T03:25:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7f4cee2c8640 1 -- 172.21.15.28:0/441548482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce8148410 con 0x7f4ce80bee80 2023-12-16T03:25:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7eff15809640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7eff100c45e0 0x7eff10155e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7eff15809640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1006e670 con 0x7eff100bf360 2023-12-16T03:25:22.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7eff15809640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff100bfbb0 con 0x7eff100c33a0 2023-12-16T03:25:22.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.156+0000 7eff15809640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff100c58b0 con 0x7eff100c45e0 2023-12-16T03:25:22.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7f4cee2c8640 1 -- 172.21.15.28:0/441548482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce804e850 con 0x7f4ce80bee80 2023-12-16T03:25:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7eff0effd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7eff100bf360 0x7eff100a4ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57854/0 (socket says 172.21.15.28:57854) 2023-12-16T03:25:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7eff0effd640 1 -- 172.21.15.28:0/3065898056 learned_addr learned my addr 172.21.15.28:0/3065898056 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7eff0e7fc640 1 --2- 172.21.15.28:0/3065898056 >> v2:172.21.15.28:3300/0 conn(0x7eff100c45e0 0x7eff10155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7f4cddffb640 1 -- 172.21.15.28:0/441548482 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4ce00bb950 con 0x7f4ce80bee80 2023-12-16T03:25:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7eff0dffb640 1 -- 172.21.15.28:0/3065898056 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325439751 0 0) 0x7eff1006e670 con 0x7eff100bf360 2023-12-16T03:25:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7efd031aa640 1 Processor -- start 2023-12-16T03:25:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7efd031aa640 1 -- start start 2023-12-16T03:25:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7eff0dffb640 1 -- 172.21.15.28:0/3065898056 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef8003530 con 0x7eff100bf360 2023-12-16T03:25:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7f63e659c640 1 --2- 172.21.15.28:0/2222096756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63e80bf1f0 0x7f63e80c4470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0097f0 tx=0x7f63dc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7450088793818d38 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7eff0dffb640 1 -- 172.21.15.28:0/3065898056 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1831432615 0 0) 0x7efef8003530 con 0x7eff100bf360 2023-12-16T03:25:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7eff0e7fc640 1 -- 172.21.15.28:0/3065898056 >> v1:172.21.15.134:6789/0 conn(0x7eff100c33a0 legacy=0x7eff10156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7efd031aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efcf40073f0 0x7efcf4042240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7f63e559a640 1 -- 172.21.15.28:0/2222096756 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0ab600 con 0x7f63e80bf1f0 2023-12-16T03:25:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7f63e559a640 1 -- 172.21.15.28:0/2222096756 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc0a7050 con 0x7f63e80bf1f0 2023-12-16T03:25:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7f63e559a640 1 -- 172.21.15.28:0/2222096756 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0ab980 con 0x7f63e80bf1f0 2023-12-16T03:25:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7efd031aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcf40d5780 0x7efcf40c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7efd031aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf40c4600 0x7efcf4176e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7f4cddffb640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4ccc066570 0x7f4ccc068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd031aa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40da5a0 con 0x7efcf40073f0 2023-12-16T03:25:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd031aa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf402b640 con 0x7efcf40d5780 2023-12-16T03:25:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd031aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf41769e0 con 0x7efcf40c4600 2023-12-16T03:25:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7f4cddffb640 1 -- 172.21.15.28:0/441548482 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ce011e0c0 con 0x7f4ce80bee80 2023-12-16T03:25:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd01747640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf40c4600 0x7efcf4176e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd01747640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf40c4600 0x7efcf4176e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60496/0 (socket says 172.21.15.28:60496) 2023-12-16T03:25:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd01747640 1 -- 172.21.15.28:0/1531985192 learned_addr learned my addr 172.21.15.28:0/1531985192 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7eff0e7fc640 1 -- 172.21.15.28:0/3065898056 >> v1:172.21.15.28:6789/0 conn(0x7eff100bf360 legacy=0x7eff100a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.160+0000 7eff0e7fc640 1 -- 172.21.15.28:0/3065898056 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100bfe50 con 0x7eff100c45e0 2023-12-16T03:25:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7f63e759e640 1 -- 172.21.15.28:0/2222096756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63e80bf1f0 msgr2=0x7f63e80c4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7f63e759e640 1 --2- 172.21.15.28:0/2222096756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63e80bf1f0 0x7f63e80c4470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0097f0 tx=0x7f63dc01c450 comp rx=0 tx=0).stop 2023-12-16T03:25:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd01747640 1 -- 172.21.15.28:0/1531985192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcf40d5780 msgr2=0x7efcf40c7070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-16T03:25:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd01747640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcf40d5780 0x7efcf40c7070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd01747640 1 -- 172.21.15.28:0/1531985192 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efcf40073f0 msgr2=0x7efcf4042240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd01747640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efcf40073f0 0x7efcf4042240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd01747640 1 -- 172.21.15.28:0/1531985192 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0009420 con 0x7efcf40c4600 2023-12-16T03:25:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7f4cecac5640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4ccc066570 0x7f4ccc068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7f63e759e640 1 -- 172.21.15.28:0/2222096756 shutdown_connections 2023-12-16T03:25:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efd01747640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf40c4600 0x7efcf4176e30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efcfc067b90 tx=0x7efcfc067fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7f63e759e640 1 --2- 172.21.15.28:0/2222096756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63e80bf1f0 0x7f63e80c4470 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7f63e759e640 1 -- 172.21.15.28:0/2222096756 >> 172.21.15.28:0/2222096756 conn(0x7f63e80a7910 msgr2=0x7f63e80a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7f63e759e640 1 -- 172.21.15.28:0/2222096756 shutdown_connections 2023-12-16T03:25:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7f4cecac5640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4ccc066570 0x7f4ccc068a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80becb0 tx=0x7f4cd8009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7f63e759e640 1 -- 172.21.15.28:0/2222096756 wait complete. 2023-12-16T03:25:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efcf97fa640 1 -- 172.21.15.28:0/1531985192 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc06bea0 con 0x7efcf40c4600 2023-12-16T03:25:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7eff0e7fc640 1 --2- 172.21.15.28:0/3065898056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff100c45e0 0x7eff10155e40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7eff040097c0 tx=0x7eff0401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d808e35afefd20f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.164+0000 7efcf97fa640 1 -- 172.21.15.28:0/1531985192 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc095480 con 0x7efcf40c4600 2023-12-16T03:25:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7efcf97fa640 1 -- 172.21.15.28:0/1531985192 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc06bea0 con 0x7efcf40c4600 2023-12-16T03:25:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7efd031aa640 1 -- 172.21.15.28:0/1531985192 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf40dc1b0 con 0x7efcf40c4600 2023-12-16T03:25:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7efd031aa640 1 -- 172.21.15.28:0/1531985192 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf402b110 con 0x7efcf40c4600 2023-12-16T03:25:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7eff0dffb640 1 -- 172.21.15.28:0/3065898056 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00001680 con 0x7eff100c45e0 2023-12-16T03:25:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7eff0dffb640 1 -- 172.21.15.28:0/3065898056 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff040a7050 con 0x7eff100c45e0 2023-12-16T03:25:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7eff0dffb640 1 -- 172.21.15.28:0/3065898056 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff040ab620 con 0x7eff100c45e0 2023-12-16T03:25:22.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7f63e759e640 1 Processor -- start 2023-12-16T03:25:22.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7f8202dd8640 1 Processor -- start 2023-12-16T03:25:22.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7f8202dd8640 1 -- start start 2023-12-16T03:25:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7f63e759e640 1 -- start start 2023-12-16T03:25:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7efd031aa640 1 -- 172.21.15.28:0/1531985192 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf400a4f0 con 0x7efcf40c4600 2023-12-16T03:25:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7eff15809640 1 -- 172.21.15.28:0/3065898056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff100c45e0 msgr2=0x7eff10155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7eff15809640 1 --2- 172.21.15.28:0/3065898056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff100c45e0 0x7eff10155e40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7eff040097c0 tx=0x7eff0401c310 comp rx=0 tx=0).stop 2023-12-16T03:25:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7eff15809640 1 -- 172.21.15.28:0/3065898056 shutdown_connections 2023-12-16T03:25:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7eff15809640 1 --2- 172.21.15.28:0/3065898056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff100c45e0 0x7eff10155e40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7eff15809640 1 -- 172.21.15.28:0/3065898056 >> 172.21.15.28:0/3065898056 conn(0x7eff100c5cd0 msgr2=0x7eff100c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7eff15809640 1 -- 172.21.15.28:0/3065898056 shutdown_connections 2023-12-16T03:25:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.168+0000 7eff15809640 1 -- 172.21.15.28:0/3065898056 wait complete. 2023-12-16T03:25:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7efcf97fa640 1 -- 172.21.15.28:0/1531985192 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7efcfc0955f0 con 0x7efcf40c4600 2023-12-16T03:25:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bf1f0 0x7f63e8145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e80bfd70 0x7f63e81f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e759e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63e8158060 0x7f63e8150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e759e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8151140 con 0x7f63e80bfd70 2023-12-16T03:25:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e759e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e806d230 con 0x7f63e80bf1f0 2023-12-16T03:25:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e759e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e81f0ec0 con 0x7f63e8158060 2023-12-16T03:25:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f8202dd8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f81fc151e90 0x7f81fc0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bf1f0 0x7f63e8145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bf1f0 0x7f63e8145e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60194/0 (socket says 172.21.15.28:60194) 2023-12-16T03:25:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e659c640 1 -- 172.21.15.28:0/3671906946 learned_addr learned my addr 172.21.15.28:0/3671906946 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e5d9b640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e80bfd70 0x7f63e81f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e6d9d640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63e8158060 0x7f63e8150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7efcf97fa640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efce0066560 0x7efce0068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f8202dd8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81fc0c7ea0 0x7f81fc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f8200b74640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f81fc151e90 0x7f81fc0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7eff15809640 1 Processor -- start 2023-12-16T03:25:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f8200b74640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f81fc151e90 0x7f81fc0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38630/0 (socket says 172.21.15.28:38630) 2023-12-16T03:25:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7efd00f46640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efce0066560 0x7efce0068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e659c640 1 -- 172.21.15.28:0/3671906946 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63e8158060 msgr2=0x7f63e8150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e659c640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63e8158060 0x7f63e8150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e659c640 1 -- 172.21.15.28:0/3671906946 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e80bfd70 msgr2=0x7f63e81f0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e659c640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e80bfd70 0x7f63e81f0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e659c640 1 -- 172.21.15.28:0/3671906946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc009420 con 0x7f63e80bf1f0 2023-12-16T03:25:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7efcf97fa640 1 -- 172.21.15.28:0/1531985192 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcfc090070 con 0x7efcf40c4600 2023-12-16T03:25:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f8202dd8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81fc06c860 con 0x7f81fc0c4e60 2023-12-16T03:25:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f63e659c640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bf1f0 0x7f63e8145e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0097f0 tx=0x7f63dc0191f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7eff15809640 1 -- start start 2023-12-16T03:25:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f8200b74640 1 -- 172.21.15.28:0/2889939464 learned_addr learned my addr 172.21.15.28:0/2889939464 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f8202dd8640 1 -- 172.21.15.28:0/2889939464 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc0c8750 con 0x7f81fc151e90 2023-12-16T03:25:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.172+0000 7f8202dd8640 1 -- 172.21.15.28:0/2889939464 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc1552d0 con 0x7f81fc0c7ea0 2023-12-16T03:25:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7efd00f46640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efce0066560 0x7efce0068a20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efce80096b0 tx=0x7efce8006be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff15809640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff100bf360 0x7eff100aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff15809640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff100c33a0 0x7eff101f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff15809640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7eff100c45e0 0x7eff101f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff15809640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff100a2c20 con 0x7eff100c33a0 2023-12-16T03:25:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff15809640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff101f0eb0 con 0x7eff100bf360 2023-12-16T03:25:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff15809640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff101f5370 con 0x7eff100c45e0 2023-12-16T03:25:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7f81f3fff640 1 --2- 172.21.15.28:0/2889939464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81fc0c7ea0 0x7f81fc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7f8200b74640 1 -- 172.21.15.28:0/2889939464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81fc0c7ea0 msgr2=0x7f81fc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff0e7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff100c33a0 0x7eff101f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff0e7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff100c33a0 0x7eff101f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38644/0 (socket says 172.21.15.28:38644) 2023-12-16T03:25:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff0e7fc640 1 -- 172.21.15.28:0/2761356152 learned_addr learned my addr 172.21.15.28:0/2761356152 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff0f7fe640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7eff100c45e0 0x7eff101f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7f8200b74640 1 --2- 172.21.15.28:0/2889939464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81fc0c7ea0 0x7f81fc06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7f8200b74640 1 -- 172.21.15.28:0/2889939464 >> v1:172.21.15.134:6789/0 conn(0x7f81fc0c4e60 legacy=0x7f81fc06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7f8200b74640 1 -- 172.21.15.28:0/2889939464 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc154930 con 0x7f81fc151e90 2023-12-16T03:25:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7f81f3fff640 1 --2- 172.21.15.28:0/2889939464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81fc0c7ea0 0x7f81fc06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff0e7fc640 1 -- 172.21.15.28:0/2761356152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7eff100c45e0 msgr2=0x7eff101f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff0e7fc640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7eff100c45e0 0x7eff101f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff0e7fc640 1 -- 172.21.15.28:0/2761356152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff100bf360 msgr2=0x7eff100aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff0e7fc640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff100bf360 0x7eff100aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff0e7fc640 1 -- 172.21.15.28:0/2761356152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04009420 con 0x7eff100c33a0 2023-12-16T03:25:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff0e7fc640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff100c33a0 0x7eff101f4e30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff04019f40 tx=0x7eff040190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7efef7fff640 1 -- 172.21.15.28:0/2761356152 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff040b4400 con 0x7eff100c33a0 2023-12-16T03:25:22.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7efef7fff640 1 -- 172.21.15.28:0/2761356152 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff040b4580 con 0x7eff100c33a0 2023-12-16T03:25:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff15809640 1 -- 172.21.15.28:0/2761356152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff101f1de0 con 0x7eff100c33a0 2023-12-16T03:25:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7efef7fff640 1 -- 172.21.15.28:0/2761356152 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff040b4930 con 0x7eff100c33a0 2023-12-16T03:25:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff15809640 1 -- 172.21.15.28:0/2761356152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff100aace0 con 0x7eff100c33a0 2023-12-16T03:25:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.176+0000 7eff15809640 1 -- 172.21.15.28:0/2761356152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff10068400 con 0x7eff100c33a0 2023-12-16T03:25:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.180+0000 7efef7fff640 1 -- 172.21.15.28:0/2761356152 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7eff040b2040 con 0x7eff100c33a0 2023-12-16T03:25:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.180+0000 7efcf97fa640 1 -- 172.21.15.28:0/1531985192 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7efcfc0cb6e0 con 0x7efcf40c4600 2023-12-16T03:25:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.180+0000 7efef7fff640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efefc066470 0x7efefc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.180+0000 7f63d6ffd640 1 -- 172.21.15.28:0/3671906946 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0b4600 con 0x7f63e80bf1f0 2023-12-16T03:25:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.180+0000 7f63d6ffd640 1 -- 172.21.15.28:0/3671906946 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc0b4780 con 0x7f63e80bf1f0 2023-12-16T03:25:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.180+0000 7f63d6ffd640 1 -- 172.21.15.28:0/3671906946 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0b4b30 con 0x7f63e80bf1f0 2023-12-16T03:25:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.180+0000 7f63e759e640 1 -- 172.21.15.28:0/3671906946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e806d4d0 con 0x7f63e80bf1f0 2023-12-16T03:25:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.180+0000 7f63e759e640 1 -- 172.21.15.28:0/3671906946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e8147a10 con 0x7f63e80bf1f0 2023-12-16T03:25:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.180+0000 7efef7fff640 1 -- 172.21.15.28:0/2761356152 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff0411dd40 con 0x7eff100c33a0 2023-12-16T03:25:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.180+0000 7eff0effd640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efefc066470 0x7efefc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.184+0000 7eff0effd640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efefc066470 0x7efefc068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff000011f0 tx=0x7eff00001060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.184+0000 7f4cddffb640 1 -- 172.21.15.28:0/441548482 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4ce00eb5d0 con 0x7f4ce80bee80 2023-12-16T03:25:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.184+0000 7f8200b74640 1 --2- 172.21.15.28:0/2889939464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81fc151e90 0x7f81fc0c4920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab67fcd1c2a8abd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.184+0000 7f63d6ffd640 1 -- 172.21.15.28:0/3671906946 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f63dc0b2040 con 0x7f63e80bf1f0 2023-12-16T03:25:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.184+0000 7f63d6ffd640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63c8066540 0x7f63c8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.188+0000 7f63d6ffd640 1 -- 172.21.15.28:0/3671906946 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63dc11dfa0 con 0x7f63e80bf1f0 2023-12-16T03:25:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.188+0000 7f63e759e640 1 -- 172.21.15.28:0/3671906946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e804e850 con 0x7f63e80bf1f0 2023-12-16T03:25:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.188+0000 7f63e5d9b640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63c8066540 0x7f63c8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.188+0000 7f81f37fe640 1 -- 172.21.15.28:0/2889939464 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0ab600 con 0x7f81fc151e90 2023-12-16T03:25:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.188+0000 7f63e5d9b640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63c8066540 0x7f63c8068a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f63e806e100 tx=0x7f63e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.188+0000 7f81f37fe640 1 -- 172.21.15.28:0/2889939464 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec0a7050 con 0x7f81fc151e90 2023-12-16T03:25:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.188+0000 7f81f37fe640 1 -- 172.21.15.28:0/2889939464 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0ab980 con 0x7f81fc151e90 2023-12-16T03:25:22.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.188+0000 7f8202dd8640 1 -- 172.21.15.28:0/2889939464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81fc151e90 msgr2=0x7f81fc0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.188+0000 7f8202dd8640 1 --2- 172.21.15.28:0/2889939464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81fc151e90 0x7f81fc0c4920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec01c420 comp rx=0 tx=0).stop 2023-12-16T03:25:22.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.188+0000 7efef7fff640 1 -- 172.21.15.28:0/2761356152 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7eff040eb120 con 0x7eff100c33a0 2023-12-16T03:25:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.192+0000 7f63d6ffd640 1 -- 172.21.15.28:0/3671906946 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f63dc0eb540 con 0x7f63e80bf1f0 2023-12-16T03:25:22.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.192+0000 7f8202dd8640 1 -- 172.21.15.28:0/2889939464 shutdown_connections 2023-12-16T03:25:22.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.192+0000 7f8202dd8640 1 --2- 172.21.15.28:0/2889939464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81fc0c7ea0 0x7f81fc06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.192+0000 7f8202dd8640 1 --2- 172.21.15.28:0/2889939464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81fc151e90 0x7f81fc0c4920 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.192+0000 7f8202dd8640 1 -- 172.21.15.28:0/2889939464 >> 172.21.15.28:0/2889939464 conn(0x7f81fc0ca170 msgr2=0x7f81fc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.196+0000 7f8202dd8640 1 -- 172.21.15.28:0/2889939464 shutdown_connections 2023-12-16T03:25:22.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.196+0000 7f8202dd8640 1 -- 172.21.15.28:0/2889939464 wait complete. 2023-12-16T03:25:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.196+0000 7f8202dd8640 1 Processor -- start 2023-12-16T03:25:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.196+0000 7f8202dd8640 1 -- start start 2023-12-16T03:25:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.200+0000 7f8202dd8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81fc0c4e60 0x7f81fc1ec940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.200+0000 7f8202dd8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81fc0c7ea0 0x7f81fc14acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.200+0000 7f8202dd8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81fc151e90 0x7f81fc0c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.200+0000 7f8202dd8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0c2a10 con 0x7f81fc0c4e60 2023-12-16T03:25:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.200+0000 7f8202dd8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc1ece80 con 0x7f81fc0c7ea0 2023-12-16T03:25:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.200+0000 7f8202dd8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0c24e0 con 0x7f81fc151e90 2023-12-16T03:25:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f81f3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81fc0c7ea0 0x7f81fc14acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f8200b74640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81fc0c4e60 0x7f81fc1ec940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f81f3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81fc0c7ea0 0x7f81fc14acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60220/0 (socket says 172.21.15.28:60220) 2023-12-16T03:25:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f81f3fff640 1 -- 172.21.15.28:0/2665858537 learned_addr learned my addr 172.21.15.28:0/2665858537 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f8200b74640 1 -- 172.21.15.28:0/2665858537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81fc151e90 msgr2=0x7f81fc0c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f8200b74640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81fc151e90 0x7f81fc0c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f8200b74640 1 -- 172.21.15.28:0/2665858537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81fc0c7ea0 msgr2=0x7f81fc14acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f8200b74640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81fc0c7ea0 0x7f81fc14acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f8200b74640 1 -- 172.21.15.28:0/2665858537 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec0094d0 con 0x7f81fc0c4e60 2023-12-16T03:25:22.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f81f3fff640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81fc0c7ea0 0x7f81fc14acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:22.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f8200b74640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81fc0c4e60 0x7f81fc1ec940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0ab000 tx=0x7f81ec0191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f81f17fa640 1 -- 172.21.15.28:0/2665858537 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0b5600 con 0x7f81fc0c4e60 2023-12-16T03:25:22.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f8202dd8640 1 -- 172.21.15.28:0/2665858537 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc1564b0 con 0x7f81fc0c4e60 2023-12-16T03:25:22.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f8202dd8640 1 -- 172.21.15.28:0/2665858537 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc14b230 con 0x7f81fc0c4e60 2023-12-16T03:25:22.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.204+0000 7f81f17fa640 1 -- 172.21.15.28:0/2665858537 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec0b5760 con 0x7f81fc0c4e60 2023-12-16T03:25:22.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.208+0000 7f81f17fa640 1 -- 172.21.15.28:0/2665858537 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0b5ad0 con 0x7f81fc0c4e60 2023-12-16T03:25:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.212+0000 7f8202dd8640 1 -- 172.21.15.28:0/2665858537 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc005260 con 0x7f81fc0c4e60 2023-12-16T03:25:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.212+0000 7f81f17fa640 1 -- 172.21.15.28:0/2665858537 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f81ec0b5c30 con 0x7f81fc0c4e60 2023-12-16T03:25:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.212+0000 7f81f17fa640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f81e80664d0 0x7f81e8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.212+0000 7f81f3fff640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f81e80664d0 0x7f81e8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.216+0000 7f81f3fff640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f81e80664d0 0x7f81e8068990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81fc1584a0 tx=0x7f81f8007850 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.220+0000 7f81f17fa640 1 -- 172.21.15.28:0/2665858537 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81ec0ef730 con 0x7f81fc0c4e60 2023-12-16T03:25:22.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.224+0000 7f81f17fa640 1 -- 172.21.15.28:0/2665858537 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f81ec0eba70 con 0x7f81fc0c4e60 2023-12-16T03:25:22.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.232+0000 7f05d7daa640 1 Processor -- start 2023-12-16T03:25:22.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.232+0000 7f05d7daa640 1 -- start start 2023-12-16T03:25:22.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d7daa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f05d00c1ce0 0x7f05d006c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d7daa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f05d00728f0 0x7f05d006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d7daa640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d00c5220 con 0x7f05d006c2b0 2023-12-16T03:25:22.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d7daa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d00c4610 con 0x7f05d00728f0 2023-12-16T03:25:22.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d7daa640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d00c48f0 con 0x7f05d00c1ce0 2023-12-16T03:25:22.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d5345640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f05d00c1ce0 0x7f05d006c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d5345640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f05d00c1ce0 0x7f05d006c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60222/0 (socket says 172.21.15.28:60222) 2023-12-16T03:25:22.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d5345640 1 -- 172.21.15.28:0/1522673971 learned_addr learned my addr 172.21.15.28:0/1522673971 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d5345640 1 -- 172.21.15.28:0/1522673971 >> v2:172.21.15.28:3300/0 conn(0x7f05d00728f0 msgr2=0x7f05d006ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:22.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d5345640 1 --2- 172.21.15.28:0/1522673971 >> v2:172.21.15.28:3300/0 conn(0x7f05d00728f0 0x7f05d006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d5345640 1 -- 172.21.15.28:0/1522673971 >> v1:172.21.15.28:6789/0 conn(0x7f05d006c2b0 legacy=0x7f05d00721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:22.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.236+0000 7f05d5345640 1 -- 172.21.15.28:0/1522673971 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00c4bd0 con 0x7f05d00c1ce0 2023-12-16T03:25:22.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.240+0000 7f4a7179d640 1 Processor -- start 2023-12-16T03:25:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.240+0000 7f4a7179d640 1 -- start start 2023-12-16T03:25:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d5345640 1 --2- 172.21.15.28:0/1522673971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05d00c1ce0 0x7f05d006c690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05d00c0a20 tx=0x7f05cc01e9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b8112ec5fffd1e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d4b44640 1 -- 172.21.15.28:0/1522673971 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0070d20 con 0x7f05d00c1ce0 2023-12-16T03:25:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f4a7179d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4a6c0c67f0 0x7f4a6c15c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f4a7179d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c06e490 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f4a7179d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c06e770 con 0x7f4a6c0c06d0 2023-12-16T03:25:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f4a7179d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c06e000 con 0x7f4a6c0c67f0 2023-12-16T03:25:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d4b44640 1 -- 172.21.15.28:0/1522673971 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc0ab070 con 0x7f05d00c1ce0 2023-12-16T03:25:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d4b44640 1 -- 172.21.15.28:0/1522673971 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0070d20 con 0x7f05d00c1ce0 2023-12-16T03:25:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d7daa640 1 -- 172.21.15.28:0/1522673971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05d00c1ce0 msgr2=0x7f05d006c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d7daa640 1 --2- 172.21.15.28:0/1522673971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05d00c1ce0 0x7f05d006c690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05d00c0a20 tx=0x7f05cc01e9a0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f4a6b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4a6c0c67f0 0x7f4a6c15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d7daa640 1 -- 172.21.15.28:0/1522673971 shutdown_connections 2023-12-16T03:25:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d7daa640 1 --2- 172.21.15.28:0/1522673971 >> v2:172.21.15.28:3300/0 conn(0x7f05d00728f0 0x7f05d006ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d7daa640 1 --2- 172.21.15.28:0/1522673971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05d00c1ce0 0x7f05d006c690 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d7daa640 1 -- 172.21.15.28:0/1522673971 >> 172.21.15.28:0/1522673971 conn(0x7f05d00a7910 msgr2=0x7f05d00a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f4a6b7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4a6c0c67f0 0x7f4a6c15c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60234/0 (socket says 172.21.15.28:60234) 2023-12-16T03:25:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f4a6b7fe640 1 -- 172.21.15.28:0/2324418260 learned_addr learned my addr 172.21.15.28:0/2324418260 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d7daa640 1 -- 172.21.15.28:0/1522673971 shutdown_connections 2023-12-16T03:25:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f05d7daa640 1 -- 172.21.15.28:0/1522673971 wait complete. 2023-12-16T03:25:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f4a69ffb640 1 -- 172.21.15.28:0/2324418260 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172341777 0 0) 0x7f4a6c06e490 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.244+0000 7f4a69ffb640 1 -- 172.21.15.28:0/2324418260 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a54003530 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.248+0000 7f05d7daa640 1 Processor -- start 2023-12-16T03:25:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.248+0000 7f05d7daa640 1 -- start start 2023-12-16T03:25:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.248+0000 7f4a6b7fe640 1 -- 172.21.15.28:0/2324418260 >> v1:172.21.15.134:6789/0 conn(0x7f4a6c0c06d0 legacy=0x7f4a6c1513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.248+0000 7f4a6b7fe640 1 -- 172.21.15.28:0/2324418260 >> v1:172.21.15.28:6789/0 conn(0x7f4a6c0c22c0 legacy=0x7f4a6c0a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.248+0000 7f4a6b7fe640 1 -- 172.21.15.28:0/2324418260 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c06cf70 con 0x7f4a6c0c67f0 2023-12-16T03:25:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.248+0000 7f05d7daa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05d006c2b0 0x7f05d0164c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.248+0000 7f05d7daa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05d00728f0 0x7f05d01651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d7daa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05d00c1ce0 0x7f05d01fb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d5345640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05d00728f0 0x7f05d01651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d5345640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05d00728f0 0x7f05d01651a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60238/0 (socket says 172.21.15.28:60238) 2023-12-16T03:25:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d5345640 1 -- 172.21.15.28:0/356929882 learned_addr learned my addr 172.21.15.28:0/356929882 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d7daa640 1 -- 172.21.15.28:0/356929882 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00bb260 con 0x7f05d006c2b0 2023-12-16T03:25:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d5b46640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05d006c2b0 0x7f05d0164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d7daa640 1 -- 172.21.15.28:0/356929882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01fdc60 con 0x7f05d00728f0 2023-12-16T03:25:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d7daa640 1 -- 172.21.15.28:0/356929882 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0168270 con 0x7f05d00c1ce0 2023-12-16T03:25:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d6347640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05d00c1ce0 0x7f05d01fb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d5345640 1 -- 172.21.15.28:0/356929882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05d00c1ce0 msgr2=0x7f05d01fb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d5345640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05d00c1ce0 0x7f05d01fb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d5345640 1 -- 172.21.15.28:0/356929882 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05d006c2b0 msgr2=0x7f05d0164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d5345640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05d006c2b0 0x7f05d0164c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d5345640 1 -- 172.21.15.28:0/356929882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc008550 con 0x7f05d00728f0 2023-12-16T03:25:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d6347640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05d00c1ce0 0x7f05d01fb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f4a6b7fe640 1 --2- 172.21.15.28:0/2324418260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a6c0c67f0 0x7f4a6c15c240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400d150 tx=0x7f4a6401eb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1562b958b3627651 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d5345640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05d00728f0 0x7f05d01651a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0b3040 tx=0x7f05cc01b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f4a69ffb640 1 -- 172.21.15.28:0/2324418260 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a640a7a90 con 0x7f4a6c0c67f0 2023-12-16T03:25:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f4a69ffb640 1 -- 172.21.15.28:0/2324418260 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a640ab070 con 0x7f4a6c0c67f0 2023-12-16T03:25:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f4a69ffb640 1 -- 172.21.15.28:0/2324418260 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a640a7df0 con 0x7f4a6c0c67f0 2023-12-16T03:25:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f4a7179d640 1 -- 172.21.15.28:0/2324418260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a6c0c67f0 msgr2=0x7f4a6c15c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05c67fc640 1 -- 172.21.15.28:0/356929882 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0a7e80 con 0x7f05d00728f0 2023-12-16T03:25:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d7daa640 1 -- 172.21.15.28:0/356929882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d0167f40 con 0x7f05d00728f0 2023-12-16T03:25:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f05d7daa640 1 -- 172.21.15.28:0/356929882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d01fe130 con 0x7f05d00728f0 2023-12-16T03:25:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.256+0000 7f05c67fc640 1 -- 172.21.15.28:0/356929882 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc0089e0 con 0x7f05d00728f0 2023-12-16T03:25:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.256+0000 7f05c67fc640 1 -- 172.21.15.28:0/356929882 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0a7e80 con 0x7f05d00728f0 2023-12-16T03:25:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.256+0000 7f05bbfff640 1 -- 172.21.15.28:0/356929882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d004e850 con 0x7f05d00728f0 2023-12-16T03:25:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.252+0000 7f4a7179d640 1 --2- 172.21.15.28:0/2324418260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a6c0c67f0 0x7f4a6c15c240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400d150 tx=0x7f4a6401eb10 comp rx=0 tx=0).stop 2023-12-16T03:25:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.256+0000 7f4a7179d640 1 -- 172.21.15.28:0/2324418260 shutdown_connections 2023-12-16T03:25:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.256+0000 7f4a7179d640 1 --2- 172.21.15.28:0/2324418260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a6c0c67f0 0x7f4a6c15c240 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.256+0000 7f4a7179d640 1 -- 172.21.15.28:0/2324418260 >> 172.21.15.28:0/2324418260 conn(0x7f4a6c0c5cd0 msgr2=0x7f4a6c0c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.256+0000 7f4a7179d640 1 -- 172.21.15.28:0/2324418260 shutdown_connections 2023-12-16T03:25:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.256+0000 7f4a7179d640 1 -- 172.21.15.28:0/2324418260 wait complete. 2023-12-16T03:25:22.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.256+0000 7f05c67fc640 1 -- 172.21.15.28:0/356929882 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f05cc008b50 con 0x7f05d00728f0 2023-12-16T03:25:22.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.260+0000 7f05c67fc640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f05b40664d0 0x7f05b4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.260+0000 7f4a7179d640 1 Processor -- start 2023-12-16T03:25:22.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.260+0000 7f4a7179d640 1 -- start start 2023-12-16T03:25:22.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.260+0000 7f05c67fc640 1 -- 172.21.15.28:0/356929882 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05cc0ffcd0 con 0x7f05d00728f0 2023-12-16T03:25:22.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.260+0000 7f05d5b46640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f05b40664d0 0x7f05b4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.260+0000 7f05d5b46640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f05b40664d0 0x7f05b4068990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f05d00c5720 tx=0x7f05c0001470 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a7179d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a6c0c22c0 0x7f4a6c1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a7179d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a6c0c67f0 0x7f4a6c14f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a6affd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a6c0c22c0 0x7f4a6c1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a6affd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a6c0c22c0 0x7f4a6c1484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60578/0 (socket says 172.21.15.28:60578) 2023-12-16T03:25:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a7179d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a6c154ae0 0x7f4a6c14d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a6affd640 1 -- 172.21.15.28:0/3618174960 learned_addr learned my addr 172.21.15.28:0/3618174960 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c14fe00 con 0x7f4a6c0c67f0 2023-12-16T03:25:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c1499a0 con 0x7f4a6c154ae0 2023-12-16T03:25:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c1537b0 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a6a7fc640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a6c0c67f0 0x7f4a6c14f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a6affd640 1 -- 172.21.15.28:0/3618174960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a6c154ae0 msgr2=0x7f4a6c14d2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-16T03:25:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a6affd640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a6c154ae0 0x7f4a6c14d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a6affd640 1 -- 172.21.15.28:0/3618174960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a6c0c67f0 msgr2=0x7f4a6c14f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a6affd640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a6c0c67f0 0x7f4a6c14f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a6affd640 1 -- 172.21.15.28:0/3618174960 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6400bd40 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a6affd640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a6c0c22c0 0x7f4a6c1484c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00c500 tx=0x7f4a5c00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a537fe640 1 -- 172.21.15.28:0/3618174960 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c005220 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c14cd50 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c14d810 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a537fe640 1 -- 172.21.15.28:0/3618174960 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5c005380 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.264+0000 7f4a537fe640 1 -- 172.21.15.28:0/3618174960 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c005220 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.268+0000 7f05c67fc640 1 -- 172.21.15.28:0/356929882 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f05cc0fc7a0 con 0x7f05d00728f0 2023-12-16T03:25:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.268+0000 7f4a537fe640 1 -- 172.21.15.28:0/3618174960 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4a5c007030 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.272+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c005260 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.272+0000 7f4a537fe640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a58066560 0x7f4a58068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.272+0000 7f4a537fe640 1 -- 172.21.15.28:0/3618174960 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a5c083360 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.272+0000 7f4a6a7fc640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a58066560 0x7f4a58068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.276+0000 7f4a6a7fc640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a58066560 0x7f4a58068a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c06e5b0 tx=0x7f4a60007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.276+0000 7f4a537fe640 1 -- 172.21.15.28:0/3618174960 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4a5c0507f0 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f83058bb640 1 Processor -- start 2023-12-16T03:25:22.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f83058bb640 1 -- start start 2023-12-16T03:25:22.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f83058bb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8300152940 0x7f830006c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f83058bb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f83000c08c0 0x7f83000c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f83058bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c1350 0x7f83000c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f83058bb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8300152d20 con 0x7f83000c08c0 2023-12-16T03:25:22.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f83058bb640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830006cbe0 con 0x7f8300152940 2023-12-16T03:25:22.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f83058bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8300158b30 con 0x7f83000c1350 2023-12-16T03:25:22.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f82fe7fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f83000c08c0 0x7f83000c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f82feffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8300152940 0x7f830006c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f82feffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8300152940 0x7f830006c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60270/0 (socket says 172.21.15.28:60270) 2023-12-16T03:25:22.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f82ff7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c1350 0x7f83000c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.307+0000 7f82feffd640 1 -- 172.21.15.28:0/2487345488 learned_addr learned my addr 172.21.15.28:0/2487345488 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.311+0000 7f82ff7fe640 1 -- 172.21.15.28:0/2487345488 >> v2:172.21.15.134:3300/0 conn(0x7f8300152940 msgr2=0x7f830006c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:22.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.311+0000 7f82ff7fe640 1 --2- 172.21.15.28:0/2487345488 >> v2:172.21.15.134:3300/0 conn(0x7f8300152940 0x7f830006c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.311+0000 7f82ff7fe640 1 -- 172.21.15.28:0/2487345488 >> v2:172.21.15.28:3300/0 conn(0x7f83000c08c0 msgr2=0x7f83000c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:22.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.311+0000 7f82ff7fe640 1 --2- 172.21.15.28:0/2487345488 >> v2:172.21.15.28:3300/0 conn(0x7f83000c08c0 0x7f83000c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.311+0000 7f82ff7fe640 1 -- 172.21.15.28:0/2487345488 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300158e10 con 0x7f83000c1350 2023-12-16T03:25:22.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.315+0000 7f82ff7fe640 1 --2- 172.21.15.28:0/2487345488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c1350 0x7f83000c3a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f830006f930 tx=0x7f82f001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=527891f2898aa2ca server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.315+0000 7f82fdffb640 1 -- 172.21.15.28:0/2487345488 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00ab600 con 0x7f83000c1350 2023-12-16T03:25:22.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.315+0000 7f82fdffb640 1 -- 172.21.15.28:0/2487345488 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f00a7050 con 0x7f83000c1350 2023-12-16T03:25:22.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.315+0000 7f83058bb640 1 -- 172.21.15.28:0/2487345488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c1350 msgr2=0x7f83000c3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.315+0000 7f82fdffb640 1 -- 172.21.15.28:0/2487345488 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00ab600 con 0x7f83000c1350 2023-12-16T03:25:22.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.315+0000 7f83058bb640 1 --2- 172.21.15.28:0/2487345488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c1350 0x7f83000c3a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f830006f930 tx=0x7f82f001c330 comp rx=0 tx=0).stop 2023-12-16T03:25:22.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.319+0000 7f83058bb640 1 -- 172.21.15.28:0/2487345488 shutdown_connections 2023-12-16T03:25:22.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.319+0000 7f83058bb640 1 --2- 172.21.15.28:0/2487345488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c1350 0x7f83000c3a60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.319+0000 7f83058bb640 1 --2- 172.21.15.28:0/2487345488 >> v2:172.21.15.28:3300/0 conn(0x7f83000c08c0 0x7f83000c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.319+0000 7f83058bb640 1 --2- 172.21.15.28:0/2487345488 >> v2:172.21.15.134:3300/0 conn(0x7f8300152940 0x7f830006c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.319+0000 7f83058bb640 1 -- 172.21.15.28:0/2487345488 >> 172.21.15.28:0/2487345488 conn(0x7f83000a7910 msgr2=0x7f83000a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.319+0000 7f83058bb640 1 -- 172.21.15.28:0/2487345488 shutdown_connections 2023-12-16T03:25:22.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.319+0000 7f83058bb640 1 -- 172.21.15.28:0/2487345488 wait complete. 2023-12-16T03:25:22.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.319+0000 7f83058bb640 1 Processor -- start 2023-12-16T03:25:22.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.323+0000 7f83058bb640 1 -- start start 2023-12-16T03:25:22.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.323+0000 7f83058bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c08c0 0x7f830014e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.323+0000 7f83058bb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83000c1350 0x7f83000ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.323+0000 7f82feffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c08c0 0x7f830014e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82feffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c08c0 0x7f830014e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60592/0 (socket says 172.21.15.28:60592) 2023-12-16T03:25:22.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82fe7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83000c1350 0x7f83000ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82fe7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83000c1350 0x7f83000ab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38688/0 (socket says 172.21.15.28:38688) 2023-12-16T03:25:22.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82feffd640 1 -- 172.21.15.28:0/3010800524 learned_addr learned my addr 172.21.15.28:0/3010800524 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:22.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f83058bb640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8300152940 0x7f830014ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830014e910 con 0x7f83000c1350 2023-12-16T03:25:22.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83000aae50 con 0x7f8300152940 2023-12-16T03:25:22.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83000aa870 con 0x7f83000c08c0 2023-12-16T03:25:22.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82ff7fe640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8300152940 0x7f830014ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82feffd640 1 -- 172.21.15.28:0/3010800524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8300152940 msgr2=0x7f830014ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82feffd640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8300152940 0x7f830014ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82feffd640 1 -- 172.21.15.28:0/3010800524 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83000c1350 msgr2=0x7f83000ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82feffd640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83000c1350 0x7f83000ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82feffd640 1 -- 172.21.15.28:0/3010800524 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0009420 con 0x7f83000c08c0 2023-12-16T03:25:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82feffd640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c08c0 0x7f830014e3d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f82f800efc0 tx=0x7f82f800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82e7fff640 1 -- 172.21.15.28:0/3010800524 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8009b60 con 0x7f83000c08c0 2023-12-16T03:25:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82e7fff640 1 -- 172.21.15.28:0/3010800524 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f800f040 con 0x7f83000c08c0 2023-12-16T03:25:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f82e7fff640 1 -- 172.21.15.28:0/3010800524 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f80092e0 con 0x7f83000c08c0 2023-12-16T03:25:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83000ab820 con 0x7f83000c08c0 2023-12-16T03:25:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.327+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83000729f0 con 0x7f83000c08c0 2023-12-16T03:25:22.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.331+0000 7f82e7fff640 1 -- 172.21.15.28:0/3010800524 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f82f8014480 con 0x7f83000c08c0 2023-12-16T03:25:22.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.331+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8300072be0 con 0x7f83000c08c0 2023-12-16T03:25:22.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.331+0000 7f82e7fff640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f82ec066470 0x7f82ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:22.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.331+0000 7f82fe7fc640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f82ec066470 0x7f82ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:22.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.331+0000 7f82e7fff640 1 -- 172.21.15.28:0/3010800524 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82f8084760 con 0x7f83000c08c0 2023-12-16T03:25:22.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.335+0000 7f82fe7fc640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f82ec066470 0x7f82ec068930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f83000a62c0 tx=0x7f82f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:22.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.339+0000 7f82e7fff640 1 -- 172.21.15.28:0/3010800524 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f82f8051b40 con 0x7f83000c08c0 2023-12-16T03:25:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.515+0000 7eff15809640 1 -- 172.21.15.28:0/2761356152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7eff100a5330 con 0x7eff100c33a0 2023-12-16T03:25:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.515+0000 7efef7fff640 1 -- 172.21.15.28:0/2761356152 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff040b9090 con 0x7eff100c33a0 2023-12-16T03:25:22.520 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.519+0000 7eff15809640 1 -- 172.21.15.28:0/2761356152 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efefc066470 msgr2=0x7efefc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.519+0000 7eff15809640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efefc066470 0x7efefc068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff000011f0 tx=0x7eff00001060 comp rx=0 tx=0).stop 2023-12-16T03:25:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.519+0000 7eff15809640 1 -- 172.21.15.28:0/2761356152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff100c33a0 msgr2=0x7eff101f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.519+0000 7eff15809640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff100c33a0 0x7eff101f4e30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff04019f40 tx=0x7eff040190b0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7eff15809640 1 -- 172.21.15.28:0/2761356152 shutdown_connections 2023-12-16T03:25:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7eff15809640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7eff100c45e0 0x7eff101f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7eff15809640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efefc066470 0x7efefc068930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7eff15809640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7eff100c33a0 0x7eff101f4e30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7eff15809640 1 --2- 172.21.15.28:0/2761356152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff100bf360 0x7eff100aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7eff15809640 1 -- 172.21.15.28:0/2761356152 >> 172.21.15.28:0/2761356152 conn(0x7eff100c5cd0 msgr2=0x7eff100c38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7eff15809640 1 -- 172.21.15.28:0/2761356152 shutdown_connections 2023-12-16T03:25:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7eff15809640 1 -- 172.21.15.28:0/2761356152 wait complete. 2023-12-16T03:25:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7f4cee2c8640 1 -- 172.21.15.28:0/441548482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4ce806e0e0 con 0x7f4ce80bee80 2023-12-16T03:25:22.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7f4cddffb640 1 -- 172.21.15.28:0/441548482 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ce00eebf0 con 0x7f4ce80bee80 2023-12-16T03:25:22.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7efd031aa640 1 -- 172.21.15.28:0/1531985192 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efcf4176b50 con 0x7efcf40c4600 2023-12-16T03:25:22.528 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:22.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.523+0000 7efcf97fa640 1 -- 172.21.15.28:0/1531985192 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efcfc09a020 con 0x7efcf40c4600 2023-12-16T03:25:22.533 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:22.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.527+0000 7f4cee2c8640 1 -- 172.21.15.28:0/441548482 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4ccc066570 msgr2=0x7f4ccc068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.527+0000 7f4cee2c8640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4ccc066570 0x7f4ccc068a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80becb0 tx=0x7f4cd8009060 comp rx=0 tx=0).stop 2023-12-16T03:25:22.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.527+0000 7f4cee2c8640 1 -- 172.21.15.28:0/441548482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce80bee80 msgr2=0x7f4ce814a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.527+0000 7f4cee2c8640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce80bee80 0x7f4ce814a8d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ce001aea0 tx=0x7f4ce0019590 comp rx=0 tx=0).stop 2023-12-16T03:25:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.527+0000 7f4cee2c8640 1 -- 172.21.15.28:0/441548482 shutdown_connections 2023-12-16T03:25:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.527+0000 7f4cee2c8640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4ccc066570 0x7f4ccc068a30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.527+0000 7f4cee2c8640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce8151d00 0x7f4ce81f70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.527+0000 7f4cee2c8640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce80c0450 0x7f4ce81f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.527+0000 7f4cee2c8640 1 --2- 172.21.15.28:0/441548482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce80bee80 0x7f4ce814a8d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.527+0000 7f4cee2c8640 1 -- 172.21.15.28:0/441548482 >> 172.21.15.28:0/441548482 conn(0x7f4ce80a7800 msgr2=0x7f4ce806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.527+0000 7f4cee2c8640 1 -- 172.21.15.28:0/441548482 shutdown_connections 2023-12-16T03:25:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7f4cee2c8640 1 -- 172.21.15.28:0/441548482 wait complete. 2023-12-16T03:25:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 -- 172.21.15.28:0/1531985192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efce0066560 msgr2=0x7efce0068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efce0066560 0x7efce0068a20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efce80096b0 tx=0x7efce8006be0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 -- 172.21.15.28:0/1531985192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf40c4600 msgr2=0x7efcf4176e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf40c4600 0x7efcf4176e30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efcfc067b90 tx=0x7efcfc067fc0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 -- 172.21.15.28:0/1531985192 shutdown_connections 2023-12-16T03:25:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efcf40c4600 0x7efcf4176e30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcf40d5780 0x7efcf40c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efce0066560 0x7efce0068a20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 --2- 172.21.15.28:0/1531985192 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efcf40073f0 0x7efcf4042240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 -- 172.21.15.28:0/1531985192 >> 172.21.15.28:0/1531985192 conn(0x7efcf4048260 msgr2=0x7efcf40d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 -- 172.21.15.28:0/1531985192 shutdown_connections 2023-12-16T03:25:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7efd031aa640 1 -- 172.21.15.28:0/1531985192 wait complete. 2023-12-16T03:25:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.531+0000 7f63e759e640 1 -- 172.21.15.28:0/3671906946 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f63e806e160 con 0x7f63e80bf1f0 2023-12-16T03:25:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.535+0000 7f63d6ffd640 1 -- 172.21.15.28:0/3671906946 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63dc0b0030 con 0x7f63e80bf1f0 2023-12-16T03:25:22.537 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-12-16T03:25:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.539+0000 7f63e759e640 1 -- 172.21.15.28:0/3671906946 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63c8066540 msgr2=0x7f63c8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.539+0000 7f63e759e640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63c8066540 0x7f63c8068a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f63e806e100 tx=0x7f63e0009040 comp rx=0 tx=0).stop 2023-12-16T03:25:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.539+0000 7f63e759e640 1 -- 172.21.15.28:0/3671906946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bf1f0 msgr2=0x7f63e8145e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.539+0000 7f63e759e640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bf1f0 0x7f63e8145e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0097f0 tx=0x7f63dc0191f0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.543+0000 7f63e759e640 1 -- 172.21.15.28:0/3671906946 shutdown_connections 2023-12-16T03:25:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.543+0000 7f63e759e640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63e8158060 0x7f63e8150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.543+0000 7f63e759e640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63c8066540 0x7f63c8068a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.543+0000 7f63e759e640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63e80bfd70 0x7f63e81f0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.543+0000 7f63e759e640 1 --2- 172.21.15.28:0/3671906946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bf1f0 0x7f63e8145e10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.543+0000 7f63e759e640 1 -- 172.21.15.28:0/3671906946 >> 172.21.15.28:0/3671906946 conn(0x7f63e80a7910 msgr2=0x7f63e814ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.543+0000 7f63e759e640 1 -- 172.21.15.28:0/3671906946 shutdown_connections 2023-12-16T03:25:22.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.543+0000 7f63e759e640 1 -- 172.21.15.28:0/3671906946 wait complete. 2023-12-16T03:25:22.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.547+0000 7f8202dd8640 1 -- 172.21.15.28:0/2665858537 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81dc0057e0 con 0x7f81fc0c4e60 2023-12-16T03:25:22.556 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.551+0000 7f81f17fa640 1 -- 172.21.15.28:0/2665858537 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81ec0c3070 con 0x7f81fc0c4e60 2023-12-16T03:25:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 -- 172.21.15.28:0/2665858537 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f81e80664d0 msgr2=0x7f81e8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f81e80664d0 0x7f81e8068990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81fc1584a0 tx=0x7f81f8007850 comp rx=0 tx=0).stop 2023-12-16T03:25:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 -- 172.21.15.28:0/2665858537 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81fc0c4e60 msgr2=0x7f81fc1ec940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81fc0c4e60 0x7f81fc1ec940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0ab000 tx=0x7f81ec0191c0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 -- 172.21.15.28:0/2665858537 shutdown_connections 2023-12-16T03:25:22.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81fc151e90 0x7f81fc0c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81fc0c7ea0 0x7f81fc14acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f81e80664d0 0x7f81e8068990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 --2- 172.21.15.28:0/2665858537 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81fc0c4e60 0x7f81fc1ec940 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 -- 172.21.15.28:0/2665858537 >> 172.21.15.28:0/2665858537 conn(0x7f81fc0ca170 msgr2=0x7f81fc0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 -- 172.21.15.28:0/2665858537 shutdown_connections 2023-12-16T03:25:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.555+0000 7f8202dd8640 1 -- 172.21.15.28:0/2665858537 wait complete. 2023-12-16T03:25:22.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-12-16T03:25:22.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-12-16T03:25:22.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-12-16T03:25:22.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-12-16T03:25:22.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.583+0000 7f05bbfff640 1 -- 172.21.15.28:0/356929882 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f05d00a7630 con 0x7f05d00728f0 2023-12-16T03:25:22.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.583+0000 7f05c67fc640 1 -- 172.21.15.28:0/356929882 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05cc0cf070 con 0x7f05d00728f0 2023-12-16T03:25:22.587 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 -- 172.21.15.28:0/356929882 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f05b40664d0 msgr2=0x7f05b4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f05b40664d0 0x7f05b4068990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f05d00c5720 tx=0x7f05c0001470 comp rx=0 tx=0).stop 2023-12-16T03:25:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 -- 172.21.15.28:0/356929882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05d00728f0 msgr2=0x7f05d01651a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05d00728f0 0x7f05d01651a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0b3040 tx=0x7f05cc01b740 comp rx=0 tx=0).stop 2023-12-16T03:25:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 -- 172.21.15.28:0/356929882 shutdown_connections 2023-12-16T03:25:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05d00c1ce0 0x7f05d01fb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05d00728f0 0x7f05d01651a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f05b40664d0 0x7f05b4068990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 --2- 172.21.15.28:0/356929882 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05d006c2b0 0x7f05d0164c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 -- 172.21.15.28:0/356929882 >> 172.21.15.28:0/356929882 conn(0x7f05d00a7910 msgr2=0x7f05d00c3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 -- 172.21.15.28:0/356929882 shutdown_connections 2023-12-16T03:25:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.587+0000 7f05bbfff640 1 -- 172.21.15.28:0/356929882 wait complete. 2023-12-16T03:25:22.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-16T03:25:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4a4c0057e0 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a537fe640 1 -- 172.21.15.28:0/3618174960 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a5c053e10 con 0x7f4a6c0c22c0 2023-12-16T03:25:22.610 INFO:teuthology.orchestra.run.smithi028.stdout:55834574852 2023-12-16T03:25:22.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-16T03:25:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a58066560 msgr2=0x7f4a58068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a58066560 0x7f4a58068a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c06e5b0 tx=0x7f4a60007b50 comp rx=0 tx=0).stop 2023-12-16T03:25:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a6c0c22c0 msgr2=0x7f4a6c1484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a6c0c22c0 0x7f4a6c1484c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00c500 tx=0x7f4a5c00c9c0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 shutdown_connections 2023-12-16T03:25:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a6c154ae0 0x7f4a6c14d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a58066560 0x7f4a58068a20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a6c0c67f0 0x7f4a6c14f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 --2- 172.21.15.28:0/3618174960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a6c0c22c0 0x7f4a6c1484c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 >> 172.21.15.28:0/3618174960 conn(0x7f4a6c0c5cd0 msgr2=0x7f4a6c0c4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 shutdown_connections 2023-12-16T03:25:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.607+0000 7f4a7179d640 1 -- 172.21.15.28:0/3618174960 wait complete. 2023-12-16T03:25:22.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.623+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f830004e850 con 0x7f83000c08c0 2023-12-16T03:25:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.623+0000 7f82e7fff640 1 -- 172.21.15.28:0/3010800524 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82f8055160 con 0x7f83000c08c0 2023-12-16T03:25:22.626 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:22.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.623+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f82ec066470 msgr2=0x7f82ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.623+0000 7f83058bb640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f82ec066470 0x7f82ec068930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f83000a62c0 tx=0x7f82f4008040 comp rx=0 tx=0).stop 2023-12-16T03:25:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.623+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c08c0 msgr2=0x7f830014e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.623+0000 7f83058bb640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c08c0 0x7f830014e3d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f82f800efc0 tx=0x7f82f800c490 comp rx=0 tx=0).stop 2023-12-16T03:25:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.623+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 shutdown_connections 2023-12-16T03:25:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.623+0000 7f83058bb640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8300152940 0x7f830014ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.623+0000 7f83058bb640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f82ec066470 0x7f82ec068930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.623+0000 7f83058bb640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83000c1350 0x7f83000ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.623+0000 7f83058bb640 1 --2- 172.21.15.28:0/3010800524 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83000c08c0 0x7f830014e3d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.627+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 >> 172.21.15.28:0/3010800524 conn(0x7f83000a7910 msgr2=0x7f83001628e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.627+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 shutdown_connections 2023-12-16T03:25:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:22.627+0000 7f83058bb640 1 -- 172.21.15.28:0/3010800524 wait complete. 2023-12-16T03:25:22.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-12-16T03:25:22.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-12-16T03:25:23.567 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-16T03:25:23.573 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-16T03:25:23.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-16T03:25:23.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-16T03:25:23.594 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-16T03:25:23.611 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-16T03:25:23.633 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-16T03:25:23.649 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-16T03:25:23.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.791+0000 7f70cba5a640 1 Processor -- start 2023-12-16T03:25:23.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.791+0000 7f70cba5a640 1 -- start start 2023-12-16T03:25:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70cba5a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f70c4151d50 0x7f70c41545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70cba5a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f70c40c4e30 0x7f70c4154af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70c97f6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f70c4151d50 0x7f70c41545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70c97f6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f70c4151d50 0x7f70c41545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38700/0 (socket says 172.21.15.28:38700) 2023-12-16T03:25:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70c97f6640 1 -- 172.21.15.28:0/3303747752 learned_addr learned my addr 172.21.15.28:0/3303747752 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70cba5a640 1 -- 172.21.15.28:0/3303747752 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c40c6090 con 0x7f70c4155030 2023-12-16T03:25:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70cba5a640 1 -- 172.21.15.28:0/3303747752 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c40bfff0 con 0x7f70c4151d50 2023-12-16T03:25:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70cba5a640 1 -- 172.21.15.28:0/3303747752 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c40c6370 con 0x7f70c40c4e30 2023-12-16T03:25:23.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70c8ff5640 1 --2- 172.21.15.28:0/3303747752 >> v2:172.21.15.134:3300/0 conn(0x7f70c40c4e30 0x7f70c4154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70bbfff640 1 -- 172.21.15.28:0/3303747752 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781840233 0 0) 0x7f70c40c6090 con 0x7f70c4155030 2023-12-16T03:25:23.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70bbfff640 1 -- 172.21.15.28:0/3303747752 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b0003530 con 0x7f70c4155030 2023-12-16T03:25:23.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70c97f6640 1 -- 172.21.15.28:0/3303747752 >> v2:172.21.15.134:3300/0 conn(0x7f70c40c4e30 msgr2=0x7f70c4154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70c97f6640 1 --2- 172.21.15.28:0/3303747752 >> v2:172.21.15.134:3300/0 conn(0x7f70c40c4e30 0x7f70c4154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70c97f6640 1 -- 172.21.15.28:0/3303747752 >> v1:172.21.15.134:6789/0 conn(0x7f70c4155030 legacy=0x7f70c40c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.795+0000 7f70c97f6640 1 -- 172.21.15.28:0/3303747752 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c41554c0 con 0x7f70c4151d50 2023-12-16T03:25:23.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.803+0000 7f70c97f6640 1 --2- 172.21.15.28:0/3303747752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c4151d50 0x7f70c41545b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f70c40cae90 tx=0x7f70c001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d681e5527b0c81 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.803+0000 7f70bbfff640 1 -- 172.21.15.28:0/3303747752 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0004230 con 0x7f70c4151d50 2023-12-16T03:25:23.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.803+0000 7f70bbfff640 1 -- 172.21.15.28:0/3303747752 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c00a7050 con 0x7f70c4151d50 2023-12-16T03:25:23.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.803+0000 7f70bbfff640 1 -- 172.21.15.28:0/3303747752 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0004230 con 0x7f70c4151d50 2023-12-16T03:25:23.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.803+0000 7f70cba5a640 1 -- 172.21.15.28:0/3303747752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c4151d50 msgr2=0x7f70c41545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.803+0000 7f70cba5a640 1 --2- 172.21.15.28:0/3303747752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c4151d50 0x7f70c41545b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f70c40cae90 tx=0x7f70c001c440 comp rx=0 tx=0).stop 2023-12-16T03:25:23.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.807+0000 7f70cba5a640 1 -- 172.21.15.28:0/3303747752 shutdown_connections 2023-12-16T03:25:23.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.807+0000 7f70cba5a640 1 --2- 172.21.15.28:0/3303747752 >> v2:172.21.15.134:3300/0 conn(0x7f70c40c4e30 0x7f70c4154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.807+0000 7f70cba5a640 1 --2- 172.21.15.28:0/3303747752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c4151d50 0x7f70c41545b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.807+0000 7f70cba5a640 1 -- 172.21.15.28:0/3303747752 >> 172.21.15.28:0/3303747752 conn(0x7f70c40c9d90 msgr2=0x7f70c40ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:23.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.807+0000 7f70cba5a640 1 -- 172.21.15.28:0/3303747752 shutdown_connections 2023-12-16T03:25:23.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.807+0000 7f70cba5a640 1 -- 172.21.15.28:0/3303747752 wait complete. 2023-12-16T03:25:23.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.811+0000 7f70cba5a640 1 Processor -- start 2023-12-16T03:25:23.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.811+0000 7f70cba5a640 1 -- start start 2023-12-16T03:25:23.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.811+0000 7f70cba5a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c4e30 0x7f70c406ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.811+0000 7f70cba5a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c4151d50 0x7f70c41f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.815+0000 7f70cba5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c4153e60 0x7f70c41ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.815+0000 7f70c97f6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c4e30 0x7f70c406ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.815+0000 7f70c97f6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c4e30 0x7f70c406ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60600/0 (socket says 172.21.15.28:60600) 2023-12-16T03:25:23.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.815+0000 7f70c97f6640 1 -- 172.21.15.28:0/2196021545 learned_addr learned my addr 172.21.15.28:0/2196021545 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.815+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c406b090 con 0x7f70c4153e60 2023-12-16T03:25:23.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.815+0000 7f70c9ff7640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c4153e60 0x7f70c41ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.815+0000 7f70c8ff5640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c4151d50 0x7f70c41f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.819+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c41f0b50 con 0x7f70c4151d50 2023-12-16T03:25:23.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.819+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c406b2c0 con 0x7f70c40c4e30 2023-12-16T03:25:23.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.819+0000 7f70c9ff7640 1 -- 172.21.15.28:0/2196021545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c4e30 msgr2=0x7f70c406ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.819+0000 7f70c9ff7640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c4e30 0x7f70c406ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.819+0000 7f70c9ff7640 1 -- 172.21.15.28:0/2196021545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c4151d50 msgr2=0x7f70c41f0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.819+0000 7f70c9ff7640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c4151d50 0x7f70c41f0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.819+0000 7f70c9ff7640 1 -- 172.21.15.28:0/2196021545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c00094d0 con 0x7f70c4153e60 2023-12-16T03:25:23.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.823+0000 7f70c9ff7640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c4153e60 0x7f70c41ec6a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70c406a850 tx=0x7f70bc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.823+0000 7f70b9ffb640 1 -- 172.21.15.28:0/2196021545 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc006d60 con 0x7f70c4153e60 2023-12-16T03:25:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.823+0000 7f70b9ffb640 1 -- 172.21.15.28:0/2196021545 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc003980 con 0x7f70c4153e60 2023-12-16T03:25:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.823+0000 7f70b9ffb640 1 -- 172.21.15.28:0/2196021545 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc003d70 con 0x7f70c4153e60 2023-12-16T03:25:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.823+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c406b5a0 con 0x7f70c4153e60 2023-12-16T03:25:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.823+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c41f00f0 con 0x7f70c4153e60 2023-12-16T03:25:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.827+0000 7f70b9ffb640 1 -- 172.21.15.28:0/2196021545 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f70bc0050d0 con 0x7f70c4153e60 2023-12-16T03:25:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.831+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c41efc70 con 0x7f70c4153e60 2023-12-16T03:25:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.831+0000 7f70b9ffb640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70a80664c0 0x7f70a8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.831+0000 7f70b9ffb640 1 -- 172.21.15.28:0/2196021545 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70bc083670 con 0x7f70c4153e60 2023-12-16T03:25:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.831+0000 7f70c97f6640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70a80664c0 0x7f70a8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.835+0000 7f70c97f6640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70a80664c0 0x7f70a8068980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70c0000c10 tx=0x7f70c00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.839+0000 7f70b9ffb640 1 -- 172.21.15.28:0/2196021545 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f70c41efc70 con 0x7f70c4153e60 2023-12-16T03:25:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.843+0000 7f3f66793640 1 Processor -- start 2023-12-16T03:25:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.847+0000 7f3f66793640 1 -- start start 2023-12-16T03:25:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.847+0000 7f3f66793640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c09c0 0x7f3f600c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.847+0000 7f3f66793640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3f600c1b40 0x7f3f6015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.847+0000 7f3f66793640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f600c05f0 con 0x7f3f600c12e0 2023-12-16T03:25:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.847+0000 7f3f66793640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f600c2430 con 0x7f3f600c1b40 2023-12-16T03:25:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.847+0000 7f3f66793640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f60150f90 con 0x7f3f600c09c0 2023-12-16T03:25:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.847+0000 7f3f65791640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c09c0 0x7f3f600c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.847+0000 7f3f65f92640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3f600c1b40 0x7f3f6015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.847+0000 7f3f65f92640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3f600c1b40 0x7f3f6015adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38718/0 (socket says 172.21.15.28:38718) 2023-12-16T03:25:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.847+0000 7f3f65f92640 1 -- 172.21.15.28:0/1053752154 learned_addr learned my addr 172.21.15.28:0/1053752154 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.847+0000 7f3f64f90640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3f600c12e0 0x7f3f600c3a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53880/0 (socket says 172.21.15.28:53880) 2023-12-16T03:25:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.851+0000 7f3f65791640 1 -- 172.21.15.28:0/1053752154 >> v2:172.21.15.28:3300/0 conn(0x7f3f600c1b40 msgr2=0x7f3f6015adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.851+0000 7f3f65791640 1 --2- 172.21.15.28:0/1053752154 >> v2:172.21.15.28:3300/0 conn(0x7f3f600c1b40 0x7f3f6015adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.851+0000 7f3f65791640 1 -- 172.21.15.28:0/1053752154 >> v1:172.21.15.134:6789/0 conn(0x7f3f600c12e0 legacy=0x7f3f600c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.851+0000 7f3f65791640 1 -- 172.21.15.28:0/1053752154 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f600a97a0 con 0x7f3f600c09c0 2023-12-16T03:25:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f3f65791640 1 --2- 172.21.15.28:0/1053752154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c09c0 0x7f3f600c0da0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00dbe0 tx=0x7f3f5c020720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21dc2a30f33ba98c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f3f57fff640 1 -- 172.21.15.28:0/1053752154 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00d2d0 con 0x7f3f600c09c0 2023-12-16T03:25:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f3f57fff640 1 -- 172.21.15.28:0/1053752154 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c0a95f0 con 0x7f3f600c09c0 2023-12-16T03:25:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f3f57fff640 1 -- 172.21.15.28:0/1053752154 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c0a9980 con 0x7f3f600c09c0 2023-12-16T03:25:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f674949c640 1 Processor -- start 2023-12-16T03:25:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f3f66793640 1 -- 172.21.15.28:0/1053752154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c09c0 msgr2=0x7f3f600c0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f3f66793640 1 --2- 172.21.15.28:0/1053752154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c09c0 0x7f3f600c0da0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00dbe0 tx=0x7f3f5c020720 comp rx=0 tx=0).stop 2023-12-16T03:25:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f674949c640 1 -- start start 2023-12-16T03:25:23.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f3f66793640 1 -- 172.21.15.28:0/1053752154 shutdown_connections 2023-12-16T03:25:23.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f3f66793640 1 --2- 172.21.15.28:0/1053752154 >> v2:172.21.15.28:3300/0 conn(0x7f3f600c1b40 0x7f3f6015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f3f66793640 1 --2- 172.21.15.28:0/1053752154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c09c0 0x7f3f600c0da0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f3f66793640 1 -- 172.21.15.28:0/1053752154 >> 172.21.15.28:0/1053752154 conn(0x7f3f600a7910 msgr2=0x7f3f600a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:23.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f674949c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6744151ca0 0x7f67440c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f674949c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f67440bf0d0 0x7f67440c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f674949c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67440c65b0 con 0x7f67440c4ab0 2023-12-16T03:25:23.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f674949c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67440c5300 con 0x7f67440bf0d0 2023-12-16T03:25:23.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f674949c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67441586d0 con 0x7f6744151ca0 2023-12-16T03:25:23.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.855+0000 7f3f66793640 1 -- 172.21.15.28:0/1053752154 shutdown_connections 2023-12-16T03:25:23.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f3f66793640 1 -- 172.21.15.28:0/1053752154 wait complete. 2023-12-16T03:25:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f6748c9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f67440c4ab0 0x7f6744157b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57876/0 (socket says 172.21.15.28:57876) 2023-12-16T03:25:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f6748c9b640 1 -- 172.21.15.28:0/516596807 learned_addr learned my addr 172.21.15.28:0/516596807 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f67437fe640 1 --2- 172.21.15.28:0/516596807 >> v2:172.21.15.28:3300/0 conn(0x7f67440bf0d0 0x7f67440c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f6743fff640 1 --2- 172.21.15.28:0/516596807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6744151ca0 0x7f67440c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f6742ffd640 1 -- 172.21.15.28:0/516596807 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770474231 0 0) 0x7f67440c65b0 con 0x7f67440c4ab0 2023-12-16T03:25:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f6742ffd640 1 -- 172.21.15.28:0/516596807 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f672c003530 con 0x7f67440c4ab0 2023-12-16T03:25:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f6743fff640 1 -- 172.21.15.28:0/516596807 >> v2:172.21.15.28:3300/0 conn(0x7f67440bf0d0 msgr2=0x7f67440c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f6743fff640 1 --2- 172.21.15.28:0/516596807 >> v2:172.21.15.28:3300/0 conn(0x7f67440bf0d0 0x7f67440c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f6743fff640 1 -- 172.21.15.28:0/516596807 >> v1:172.21.15.28:6789/0 conn(0x7f67440c4ab0 legacy=0x7f6744157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f6743fff640 1 -- 172.21.15.28:0/516596807 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67440c5020 con 0x7f6744151ca0 2023-12-16T03:25:23.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.859+0000 7f3f66793640 1 Processor -- start 2023-12-16T03:25:23.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7f3f66793640 1 -- start start 2023-12-16T03:25:23.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7f6743fff640 1 --2- 172.21.15.28:0/516596807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6744151ca0 0x7f67440c8680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f67340097c0 tx=0x7f673401ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b94fa6e2536ef03f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7f3f66793640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f600c09c0 0x7f3f6006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7fe769c59640 1 Processor -- start 2023-12-16T03:25:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7f3f66793640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f600c12e0 0x7f3f601ec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7f3f66793640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c1b40 0x7f3f60149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7f3f66793640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6013ef50 con 0x7f3f600c09c0 2023-12-16T03:25:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7f3f66793640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f60149460 con 0x7f3f600c12e0 2023-12-16T03:25:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7f3f66793640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f60142380 con 0x7f3f600c1b40 2023-12-16T03:25:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f6742ffd640 1 -- 172.21.15.28:0/516596807 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67340ab670 con 0x7f6744151ca0 2023-12-16T03:25:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7f3f65f92640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c1b40 0x7f3f60149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7f3f65f92640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c1b40 0x7f3f60149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60620/0 (socket says 172.21.15.28:60620) 2023-12-16T03:25:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7f3f65f92640 1 -- 172.21.15.28:0/1127905084 learned_addr learned my addr 172.21.15.28:0/1127905084 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f65791640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f600c09c0 0x7f3f6006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f65f92640 1 -- 172.21.15.28:0/1127905084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f600c12e0 msgr2=0x7f3f601ec2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-16T03:25:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f65f92640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f600c12e0 0x7f3f601ec2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f65f92640 1 -- 172.21.15.28:0/1127905084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f600c09c0 msgr2=0x7f3f6006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f65f92640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f600c09c0 0x7f3f6006bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f65f92640 1 -- 172.21.15.28:0/1127905084 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c00d8c0 con 0x7f3f600c1b40 2023-12-16T03:25:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f65791640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f600c09c0 0x7f3f6006bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f6742ffd640 1 -- 172.21.15.28:0/516596807 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67340ab7d0 con 0x7f6744151ca0 2023-12-16T03:25:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f6742ffd640 1 -- 172.21.15.28:0/516596807 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67340abb60 con 0x7f6744151ca0 2023-12-16T03:25:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f65f92640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c1b40 0x7f3f60149bd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000a670 tx=0x7f3f5000ab30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.863+0000 7fe769c59640 1 -- start start 2023-12-16T03:25:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7fe769c59640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe7640bd540 0x7fe764154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7fe769c59640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76406b820 0x7fe76406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f55ffb640 1 -- 172.21.15.28:0/1127905084 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50010040 con 0x7f3f600c1b40 2023-12-16T03:25:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f55ffb640 1 -- 172.21.15.28:0/1127905084 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5000b820 con 0x7f3f600c1b40 2023-12-16T03:25:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7fe769c59640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe764155450 con 0x7fe7640af430 2023-12-16T03:25:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7fe769c59640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7640c5d70 con 0x7fe7640bd540 2023-12-16T03:25:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7fe769c59640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76406c1f0 con 0x7fe76406b820 2023-12-16T03:25:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7fe768c57640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe7640af430 0x7fe7640c47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53890/0 (socket says 172.21.15.28:53890) 2023-12-16T03:25:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7fe768c57640 1 -- 172.21.15.28:0/1691830377 learned_addr learned my addr 172.21.15.28:0/1691830377 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:23.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f674949c640 1 -- 172.21.15.28:0/516596807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6744151ca0 msgr2=0x7f67440c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f674949c640 1 --2- 172.21.15.28:0/516596807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6744151ca0 0x7f67440c8680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f67340097c0 tx=0x7f673401ced0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f55ffb640 1 -- 172.21.15.28:0/1127905084 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500163f0 con 0x7f3f600c1b40 2023-12-16T03:25:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f66793640 1 -- 172.21.15.28:0/1127905084 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f600c42f0 con 0x7f3f600c1b40 2023-12-16T03:25:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f3f66793640 1 -- 172.21.15.28:0/1127905084 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f601ecdd0 con 0x7f3f600c1b40 2023-12-16T03:25:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7fe763fff640 1 --2- 172.21.15.28:0/1691830377 >> v2:172.21.15.134:3300/0 conn(0x7fe7640bd540 0x7fe764154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f674949c640 1 -- 172.21.15.28:0/516596807 shutdown_connections 2023-12-16T03:25:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f674949c640 1 --2- 172.21.15.28:0/516596807 >> v2:172.21.15.28:3300/0 conn(0x7f67440bf0d0 0x7f67440c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f674949c640 1 --2- 172.21.15.28:0/516596807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6744151ca0 0x7f67440c8680 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7f674949c640 1 -- 172.21.15.28:0/516596807 >> 172.21.15.28:0/516596807 conn(0x7f67440c67f0 msgr2=0x7f67440c6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746326172 0 0) 0x7fe758001120 con 0x7fe7640af430 2023-12-16T03:25:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7fe769458640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76406b820 0x7fe76406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.867+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe754003530 con 0x7fe7640af430 2023-12-16T03:25:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f332512a640 1 Processor -- start 2023-12-16T03:25:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2865096581 0 0) 0x7fe754003530 con 0x7fe7640af430 2023-12-16T03:25:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76406b820 msgr2=0x7fe76406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76406b820 0x7fe76406bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f332512a640 1 -- start start 2023-12-16T03:25:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 >> v2:172.21.15.134:3300/0 conn(0x7fe7640bd540 msgr2=0x7fe764154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 --2- 172.21.15.28:0/1691830377 >> v2:172.21.15.134:3300/0 conn(0x7fe7640bd540 0x7fe764154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7640c7270 con 0x7fe7640af430 2023-12-16T03:25:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fe758001810 con 0x7fe7640af430 2023-12-16T03:25:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 >> v1:172.21.15.134:6789/0 conn(0x7fe7640af430 legacy=0x7fe7640c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7540039b0 0x7fe754003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76406b820 0x7fe7540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe754004d10 0x7fe754005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76406c1f0 con 0x7fe7540039b0 2023-12-16T03:25:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7540142a0 con 0x7fe754004d10 2023-12-16T03:25:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe754014460 con 0x7fe76406b820 2023-12-16T03:25:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f674949c640 1 -- 172.21.15.28:0/516596807 shutdown_connections 2023-12-16T03:25:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f674949c640 1 -- 172.21.15.28:0/516596807 wait complete. 2023-12-16T03:25:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f3f66793640 1 -- 172.21.15.28:0/1127905084 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6004e850 con 0x7f3f600c1b40 2023-12-16T03:25:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe769458640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe754004d10 0x7fe754005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe763fff640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76406b820 0x7fe7540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe768c57640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7540039b0 0x7fe754003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f332512a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 0x7f33200c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f332512a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f33200c4e60 0x7f332006bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f332512a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332006c860 con 0x7f33200c7ea0 2023-12-16T03:25:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f332512a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33200c8750 con 0x7f33200c4e60 2023-12-16T03:25:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f332512a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33201552d0 con 0x7f3320151e90 2023-12-16T03:25:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f331ed9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 0x7f33200c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f331ed9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 0x7f33200c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60642/0 (socket says 172.21.15.28:60642) 2023-12-16T03:25:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f331ed9d640 1 -- 172.21.15.28:0/1213589280 learned_addr learned my addr 172.21.15.28:0/1213589280 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f674949c640 1 Processor -- start 2023-12-16T03:25:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f3f55ffb640 1 -- 172.21.15.28:0/1127905084 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3f50016550 con 0x7f3f600c1b40 2023-12-16T03:25:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe763fff640 1 -- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe754004d10 msgr2=0x7fe754005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe763fff640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe754004d10 0x7fe754005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe763fff640 1 -- 172.21.15.28:0/1691830377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7540039b0 msgr2=0x7fe754003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7fe763fff640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7540039b0 0x7fe754003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f674949c640 1 -- start start 2023-12-16T03:25:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f674949c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67440bf0d0 0x7f67440ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f674949c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67440c4ab0 0x7f67441faa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f674949c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6744151ca0 0x7f67440aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f67437fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67440c4ab0 0x7f67441faa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f67437fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67440c4ab0 0x7f67441faa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60650/0 (socket says 172.21.15.28:60650) 2023-12-16T03:25:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f6748c9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6744151ca0 0x7f67440aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f6748c9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6744151ca0 0x7f67440aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60344/0 (socket says 172.21.15.28:60344) 2023-12-16T03:25:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7fe763fff640 1 -- 172.21.15.28:0/1691830377 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7640c7270 con 0x7fe76406b820 2023-12-16T03:25:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f331ed9d640 1 -- 172.21.15.28:0/1213589280 >> v2:172.21.15.28:3300/0 conn(0x7f33200c4e60 msgr2=0x7f332006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f331ed9d640 1 --2- 172.21.15.28:0/1213589280 >> v2:172.21.15.28:3300/0 conn(0x7f33200c4e60 0x7f332006bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f331ed9d640 1 -- 172.21.15.28:0/1213589280 >> v1:172.21.15.28:6789/0 conn(0x7f33200c7ea0 legacy=0x7f332006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.871+0000 7f331ed9d640 1 -- 172.21.15.28:0/1213589280 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320154930 con 0x7f3320151e90 2023-12-16T03:25:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f3f55ffb640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f44066470 0x7f3f44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f3f55ffb640 1 -- 172.21.15.28:0/1127905084 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f50084310 con 0x7f3f600c1b40 2023-12-16T03:25:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f3f65791640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f44066470 0x7f3f44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7fe769458640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe754004d10 0x7fe754005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f6743fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67440bf0d0 0x7f67440ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f6743fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67440bf0d0 0x7f67440ac200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38754/0 (socket says 172.21.15.28:38754) 2023-12-16T03:25:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f674949c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6744154fd0 con 0x7f67440bf0d0 2023-12-16T03:25:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f674949c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67440ac740 con 0x7f6744151ca0 2023-12-16T03:25:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f674949c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67440abd70 con 0x7f67440c4ab0 2023-12-16T03:25:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f67437fe640 1 -- 172.21.15.28:0/4104622840 learned_addr learned my addr 172.21.15.28:0/4104622840 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.875+0000 7f660ffff640 1 Processor -- start 2023-12-16T03:25:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660ffff640 1 -- start start 2023-12-16T03:25:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f6748c9b640 1 -- 172.21.15.28:0/4104622840 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67440c4ab0 msgr2=0x7f67441faa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f6748c9b640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67440c4ab0 0x7f67441faa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f6748c9b640 1 -- 172.21.15.28:0/4104622840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67440bf0d0 msgr2=0x7f67440ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f6748c9b640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67440bf0d0 0x7f67440ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f6748c9b640 1 -- 172.21.15.28:0/4104622840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734009420 con 0x7f6744151ca0 2023-12-16T03:25:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f6748c9b640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6744151ca0 0x7f67440aae70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f673c00ca70 tx=0x7f673c00cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f331ed9d640 1 --2- 172.21.15.28:0/1213589280 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 0x7f33200c4920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3310009870 tx=0x7f331001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a749d339228913d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f331dd9b640 1 -- 172.21.15.28:0/1213589280 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33100ab600 con 0x7f3320151e90 2023-12-16T03:25:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f331dd9b640 1 -- 172.21.15.28:0/1213589280 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33100a7050 con 0x7f3320151e90 2023-12-16T03:25:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f331dd9b640 1 -- 172.21.15.28:0/1213589280 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33100ab980 con 0x7f3320151e90 2023-12-16T03:25:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f6740ff9640 1 -- 172.21.15.28:0/4104622840 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c00ab70 con 0x7f6744151ca0 2023-12-16T03:25:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f6740ff9640 1 -- 172.21.15.28:0/4104622840 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c00acd0 con 0x7f6744151ca0 2023-12-16T03:25:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f6740ff9640 1 -- 172.21.15.28:0/4104622840 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c012620 con 0x7f6744151ca0 2023-12-16T03:25:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f674949c640 1 -- 172.21.15.28:0/4104622840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6744154bd0 con 0x7f6744151ca0 2023-12-16T03:25:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f674949c640 1 -- 172.21.15.28:0/4104622840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67440aba00 con 0x7f6744151ca0 2023-12-16T03:25:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f3f55ffb640 1 -- 172.21.15.28:0/1127905084 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3f500516f0 con 0x7f3f600c1b40 2023-12-16T03:25:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7fe763fff640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76406b820 0x7fe7540047d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe75000ba30 tx=0x7fe75001c6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68c76eec579c897 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500ae680 con 0x7fe76406b820 2023-12-16T03:25:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7500ae7e0 con 0x7fe76406b820 2023-12-16T03:25:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7fe7637fe640 1 -- 172.21.15.28:0/1691830377 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500aeb90 con 0x7fe76406b820 2023-12-16T03:25:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660ffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f66080462c0 0x7f6608006990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660ffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 0x7f66080496b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660ffff640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66080467f0 con 0x7f660800b0b0 2023-12-16T03:25:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660ffff640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6608046b60 con 0x7f66080462c0 2023-12-16T03:25:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660ffff640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6608047390 con 0x7f6608006ed0 2023-12-16T03:25:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660effd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f660800b0b0 0x7f66080d3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57898/0 (socket says 172.21.15.28:57898) 2023-12-16T03:25:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660effd640 1 -- 172.21.15.28:0/3271704765 learned_addr learned my addr 172.21.15.28:0/3271704765 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660f7fe640 1 --2- 172.21.15.28:0/3271704765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 0x7f66080496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660e7fc640 1 --2- 172.21.15.28:0/3271704765 >> v2:172.21.15.134:3300/0 conn(0x7f66080462c0 0x7f6608006990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660f7fe640 1 -- 172.21.15.28:0/3271704765 >> v2:172.21.15.134:3300/0 conn(0x7f66080462c0 msgr2=0x7f6608006990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660f7fe640 1 --2- 172.21.15.28:0/3271704765 >> v2:172.21.15.134:3300/0 conn(0x7f66080462c0 0x7f6608006990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660f7fe640 1 -- 172.21.15.28:0/3271704765 >> v1:172.21.15.28:6789/0 conn(0x7f660800b0b0 legacy=0x7f66080d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f660f7fe640 1 -- 172.21.15.28:0/3271704765 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66080d3f30 con 0x7f6608006ed0 2023-12-16T03:25:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f332512a640 1 -- 172.21.15.28:0/1213589280 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 msgr2=0x7f33200c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7f332512a640 1 --2- 172.21.15.28:0/1213589280 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 0x7f33200c4920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3310009870 tx=0x7f331001c3e0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7f674949c640 1 -- 172.21.15.28:0/4104622840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674404e850 con 0x7f6744151ca0 2023-12-16T03:25:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7fe769c59640 1 -- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76406b820 msgr2=0x7fe7540047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7fe769c59640 1 --2- 172.21.15.28:0/1691830377 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76406b820 0x7fe7540047d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe75000ba30 tx=0x7fe75001c6c0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.879+0000 7fe769458640 1 -- 172.21.15.28:0/1691830377 reap_dead start 2023-12-16T03:25:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7fe769c59640 1 -- 172.21.15.28:0/1691830377 shutdown_connections 2023-12-16T03:25:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7fe769c59640 1 -- 172.21.15.28:0/1691830377 >> 172.21.15.28:0/1691830377 conn(0x7fe7640ab9f0 msgr2=0x7fe7640abe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7fe769c59640 1 -- 172.21.15.28:0/1691830377 shutdown_connections 2023-12-16T03:25:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7fe769c59640 1 -- 172.21.15.28:0/1691830377 wait complete. 2023-12-16T03:25:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7f3f65791640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f44066470 0x7f3f44068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0b2000 tx=0x7f3f5c0ab070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7f332512a640 1 -- 172.21.15.28:0/1213589280 shutdown_connections 2023-12-16T03:25:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7f332512a640 1 --2- 172.21.15.28:0/1213589280 >> v2:172.21.15.28:3300/0 conn(0x7f33200c4e60 0x7f332006bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7f332512a640 1 --2- 172.21.15.28:0/1213589280 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 0x7f33200c4920 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7f332512a640 1 -- 172.21.15.28:0/1213589280 >> 172.21.15.28:0/1213589280 conn(0x7f33200ca170 msgr2=0x7f33200ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7f332512a640 1 -- 172.21.15.28:0/1213589280 shutdown_connections 2023-12-16T03:25:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7f332512a640 1 -- 172.21.15.28:0/1213589280 wait complete. 2023-12-16T03:25:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.883+0000 7f6740ff9640 1 -- 172.21.15.28:0/4104622840 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f673c007070 con 0x7f6744151ca0 2023-12-16T03:25:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f660f7fe640 1 --2- 172.21.15.28:0/3271704765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 0x7f66080496b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6610064280 tx=0x7f6610096b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5caf9de2288ff0a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe769c59640 1 Processor -- start 2023-12-16T03:25:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f6740ff9640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f67300664f0 0x7f67300689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f6743fff640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f67300664f0 0x7f67300689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f660dffb640 1 -- 172.21.15.28:0/3271704765 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661011f980 con 0x7f6608006ed0 2023-12-16T03:25:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f332512a640 1 Processor -- start 2023-12-16T03:25:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f332512a640 1 -- start start 2023-12-16T03:25:23.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe769c59640 1 -- start start 2023-12-16T03:25:23.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe769c59640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76406b820 0x7fe7640c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe769c59640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76414c200 0x7fe7641ec350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe769c59640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe76414c730 0x7fe7641ec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f660dffb640 1 -- 172.21.15.28:0/3271704765 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661011fae0 con 0x7f6608006ed0 2023-12-16T03:25:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f660dffb640 1 -- 172.21.15.28:0/3271704765 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610127440 con 0x7f6608006ed0 2023-12-16T03:25:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f660ffff640 1 -- 172.21.15.28:0/3271704765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 msgr2=0x7f66080496b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f660ffff640 1 --2- 172.21.15.28:0/3271704765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 0x7f66080496b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6610064280 tx=0x7f6610096b70 comp rx=0 tx=0).stop 2023-12-16T03:25:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f660ffff640 1 -- 172.21.15.28:0/3271704765 shutdown_connections 2023-12-16T03:25:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f660ffff640 1 --2- 172.21.15.28:0/3271704765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 0x7f66080496b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f660ffff640 1 --2- 172.21.15.28:0/3271704765 >> v2:172.21.15.134:3300/0 conn(0x7f66080462c0 0x7f6608006990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f660ffff640 1 -- 172.21.15.28:0/3271704765 >> 172.21.15.28:0/3271704765 conn(0x7f6608005e70 msgr2=0x7f6608006280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe768c57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76406b820 0x7fe7640c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe768c57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76406b820 0x7fe7640c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60356/0 (socket says 172.21.15.28:60356) 2023-12-16T03:25:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe763fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76414c200 0x7fe7641ec350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe763fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76414c200 0x7fe7641ec350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60682/0 (socket says 172.21.15.28:60682) 2023-12-16T03:25:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe769458640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe76414c730 0x7fe7641ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe769458640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe76414c730 0x7fe7641ec890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38756/0 (socket says 172.21.15.28:38756) 2023-12-16T03:25:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe768c57640 1 -- 172.21.15.28:0/3963424954 learned_addr learned my addr 172.21.15.28:0/3963424954 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641ecdd0 con 0x7fe76414c730 2023-12-16T03:25:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f332512a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33200c4e60 0x7f33201568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f332512a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33200c7ea0 0x7f33201583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f332512a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 0x7f33200af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641ed290 con 0x7fe76406b820 2023-12-16T03:25:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33200c7ea0 0x7f33201583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33200c7ea0 0x7f33201583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60358/0 (socket says 172.21.15.28:60358) 2023-12-16T03:25:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33200c4e60 0x7f33201568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641ecfb0 con 0x7fe76414c200 2023-12-16T03:25:23.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33200c4e60 0x7f33201568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38764/0 (socket says 172.21.15.28:38764) 2023-12-16T03:25:23.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331ed9d640 1 -- 172.21.15.28:0/892553802 learned_addr learned my addr 172.21.15.28:0/892553802 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331f59e640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 0x7f33200af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.887+0000 7f6740ff9640 1 -- 172.21.15.28:0/4104622840 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f673c083b30 con 0x7f6744151ca0 2023-12-16T03:25:23.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f660ffff640 1 -- 172.21.15.28:0/3271704765 shutdown_connections 2023-12-16T03:25:23.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f660ffff640 1 -- 172.21.15.28:0/3271704765 wait complete. 2023-12-16T03:25:23.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f332512a640 1 -- 172.21.15.28:0/892553802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3320157680 con 0x7f33200c4e60 2023-12-16T03:25:23.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f332512a640 1 -- 172.21.15.28:0/892553802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3320156e00 con 0x7f33200c7ea0 2023-12-16T03:25:23.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f332512a640 1 -- 172.21.15.28:0/892553802 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33201570c0 con 0x7f3320151e90 2023-12-16T03:25:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331f59e640 1 -- 172.21.15.28:0/892553802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33200c7ea0 msgr2=0x7f33201583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331f59e640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33200c7ea0 0x7f33201583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331f59e640 1 -- 172.21.15.28:0/892553802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33200c4e60 msgr2=0x7f33201568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331f59e640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33200c4e60 0x7f33201568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331f59e640 1 -- 172.21.15.28:0/892553802 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33100094d0 con 0x7f3320151e90 2023-12-16T03:25:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331ed9d640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33200c4e60 0x7f33201568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f6743fff640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f67300664f0 0x7f67300689b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f67340af000 tx=0x7f6734004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f6740ff9640 1 -- 172.21.15.28:0/4104622840 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f673c0511d0 con 0x7f6744151ca0 2023-12-16T03:25:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7fe768c57640 1 -- 172.21.15.28:0/3963424954 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76414c200 msgr2=0x7fe7641ec350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7fe768c57640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76414c200 0x7fe7641ec350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7fe768c57640 1 -- 172.21.15.28:0/3963424954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe76414c730 msgr2=0x7fe7641ec890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f331f59e640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 0x7f33200af440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f331800be20 tx=0x7f331800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7fe768c57640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe76414c730 0x7fe7641ec890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7fe768c57640 1 -- 172.21.15.28:0/3963424954 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7641501d0 con 0x7fe76406b820 2023-12-16T03:25:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7fe768c57640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76406b820 0x7fe7640c36c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe75800e8a0 tx=0x7fe75800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f33177fe640 1 -- 172.21.15.28:0/892553802 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331800ce70 con 0x7f3320151e90 2023-12-16T03:25:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f33177fe640 1 -- 172.21.15.28:0/892553802 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3318014440 con 0x7f3320151e90 2023-12-16T03:25:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f33177fe640 1 -- 172.21.15.28:0/892553802 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318014810 con 0x7f3320151e90 2023-12-16T03:25:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f332512a640 1 -- 172.21.15.28:0/892553802 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33201573a0 con 0x7f3320151e90 2023-12-16T03:25:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.891+0000 7f332512a640 1 -- 172.21.15.28:0/892553802 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33201f2aa0 con 0x7f3320151e90 2023-12-16T03:25:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.895+0000 7fe7617fa640 1 -- 172.21.15.28:0/3963424954 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75800c8d0 con 0x7fe76406b820 2023-12-16T03:25:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.895+0000 7fe7617fa640 1 -- 172.21.15.28:0/3963424954 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75800ca30 con 0x7fe76406b820 2023-12-16T03:25:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.895+0000 7fe7617fa640 1 -- 172.21.15.28:0/3963424954 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75800cde0 con 0x7fe76406b820 2023-12-16T03:25:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.895+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7641504b0 con 0x7fe76406b820 2023-12-16T03:25:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.895+0000 7f660ffff640 1 Processor -- start 2023-12-16T03:25:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.895+0000 7f33177fe640 1 -- 172.21.15.28:0/892553802 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f331801d3b0 con 0x7f3320151e90 2023-12-16T03:25:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.895+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7640c3c00 con 0x7fe76406b820 2023-12-16T03:25:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.895+0000 7f660ffff640 1 -- start start 2023-12-16T03:25:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.895+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76404e850 con 0x7fe76406b820 2023-12-16T03:25:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f33177fe640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3300066540 0x7f3300068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f332512a640 1 -- 172.21.15.28:0/892553802 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3304005260 con 0x7f3320151e90 2023-12-16T03:25:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660ffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 0x7f6608030440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f660800b0b0 0x7f66080bf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66080462c0 0x7f66080bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660ffff640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66080d9bd0 con 0x7f660800b0b0 2023-12-16T03:25:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f33177fe640 1 -- 172.21.15.28:0/892553802 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3318083f30 con 0x7f3320151e90 2023-12-16T03:25:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66080462c0 0x7f66080bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66080462c0 0x7f66080bfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60364/0 (socket says 172.21.15.28:60364) 2023-12-16T03:25:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660f7fe640 1 -- 172.21.15.28:0/3759751321 learned_addr learned my addr 172.21.15.28:0/3759751321 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7fe7617fa640 1 -- 172.21.15.28:0/3963424954 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe75801d460 con 0x7fe76406b820 2023-12-16T03:25:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f331ed9d640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3300066540 0x7f3300068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66080da8c0 con 0x7f66080462c0 2023-12-16T03:25:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66080c01f0 con 0x7f6608006ed0 2023-12-16T03:25:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660f7fe640 1 -- 172.21.15.28:0/3759751321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 msgr2=0x7f6608030440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-16T03:25:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660effd640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 0x7f6608030440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660f7fe640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 0x7f6608030440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660f7fe640 1 -- 172.21.15.28:0/3759751321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f660800b0b0 msgr2=0x7f66080bf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f331ed9d640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3300066540 0x7f3300068a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f331001a010 tx=0x7f33100a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7fe7617fa640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe748066570 0x7fe748068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660f7fe640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f660800b0b0 0x7f66080bf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660f7fe640 1 -- 172.21.15.28:0/3759751321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661004f7e0 con 0x7f66080462c0 2023-12-16T03:25:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7f660effd640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 0x7f6608030440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.899+0000 7fe7617fa640 1 -- 172.21.15.28:0/3963424954 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe758083c60 con 0x7fe76406b820 2023-12-16T03:25:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.903+0000 7fe763fff640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe748066570 0x7fe748068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.903+0000 7f660f7fe640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66080462c0 0x7f66080bfcb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6610062150 tx=0x7f6610093a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.903+0000 7fe763fff640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe748066570 0x7fe748068a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7500b0000 tx=0x7fe7500046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.903+0000 7f33177fe640 1 -- 172.21.15.28:0/892553802 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f33180514d0 con 0x7f3320151e90 2023-12-16T03:25:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.903+0000 7fe7617fa640 1 -- 172.21.15.28:0/3963424954 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe758051200 con 0x7fe76406b820 2023-12-16T03:25:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.903+0000 7f65f77fe640 1 -- 172.21.15.28:0/3759751321 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610128c60 con 0x7f66080462c0 2023-12-16T03:25:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.907+0000 7f65f77fe640 1 -- 172.21.15.28:0/3759751321 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6610128dc0 con 0x7f66080462c0 2023-12-16T03:25:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.907+0000 7f65f77fe640 1 -- 172.21.15.28:0/3759751321 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661012f620 con 0x7f66080462c0 2023-12-16T03:25:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.907+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66080c8a10 con 0x7f66080462c0 2023-12-16T03:25:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.907+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66080c8fd0 con 0x7f66080462c0 2023-12-16T03:25:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.911+0000 7f65f77fe640 1 -- 172.21.15.28:0/3759751321 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f661012f780 con 0x7f66080462c0 2023-12-16T03:25:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.911+0000 7f65f77fe640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f65fc066570 0x7f65fc068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.911+0000 7f65f77fe640 1 -- 172.21.15.28:0/3759751321 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6610198c80 con 0x7f66080462c0 2023-12-16T03:25:23.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.911+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66080d98b0 con 0x7f66080462c0 2023-12-16T03:25:23.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.911+0000 7f660effd640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f65fc066570 0x7f65fc068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.919+0000 7f65f77fe640 1 -- 172.21.15.28:0/3759751321 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6610166170 con 0x7f66080462c0 2023-12-16T03:25:23.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.919+0000 7f660effd640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f65fc066570 0x7f65fc068a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6600005890 tx=0x7f6600009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.935+0000 7f96d71e6640 1 Processor -- start 2023-12-16T03:25:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.935+0000 7f96d71e6640 1 -- start start 2023-12-16T03:25:23.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.935+0000 7f96d71e6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96d01513c0 0x7f96d006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.935+0000 7f96d71e6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f96d00c22c0 0x7f96d015b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.935+0000 7f96cffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f96d00c06d0 0x7f96d00a4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57904/0 (socket says 172.21.15.28:57904) 2023-12-16T03:25:23.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.935+0000 7f96cffff640 1 -- 172.21.15.28:0/2805773452 learned_addr learned my addr 172.21.15.28:0/2805773452 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:23.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.935+0000 7f96d4f82640 1 --2- 172.21.15.28:0/2805773452 >> v2:172.21.15.134:3300/0 conn(0x7f96d01513c0 0x7f96d006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.935+0000 7f96d71e6640 1 -- 172.21.15.28:0/2805773452 --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d006e490 con 0x7f96d00c06d0 2023-12-16T03:25:23.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.935+0000 7f96d71e6640 1 -- 172.21.15.28:0/2805773452 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d00c1290 con 0x7f96d00c22c0 2023-12-16T03:25:23.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.935+0000 7f96d71e6640 1 -- 172.21.15.28:0/2805773452 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d006e770 con 0x7f96d01513c0 2023-12-16T03:25:23.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.939+0000 7f96d4f82640 1 -- 172.21.15.28:0/2805773452 >> v2:172.21.15.28:3300/0 conn(0x7f96d00c22c0 msgr2=0x7f96d015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.939+0000 7f96d4f82640 1 --2- 172.21.15.28:0/2805773452 >> v2:172.21.15.28:3300/0 conn(0x7f96d00c22c0 0x7f96d015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.939+0000 7f96d4f82640 1 -- 172.21.15.28:0/2805773452 >> v1:172.21.15.28:6789/0 conn(0x7f96d00c06d0 legacy=0x7f96d00a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.939+0000 7f96d4f82640 1 -- 172.21.15.28:0/2805773452 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d006cf70 con 0x7f96d01513c0 2023-12-16T03:25:23.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.943+0000 7f96d4f82640 1 --2- 172.21.15.28:0/2805773452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d01513c0 0x7f96d006d770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96d00673c0 tx=0x7f96c401e550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c182f1bf7191f531 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.943+0000 7f96cf7fe640 1 -- 172.21.15.28:0/2805773452 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40ac680 con 0x7f96d01513c0 2023-12-16T03:25:23.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.943+0000 7f96cf7fe640 1 -- 172.21.15.28:0/2805773452 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c40ac7e0 con 0x7f96d01513c0 2023-12-16T03:25:23.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.943+0000 7f96cf7fe640 1 -- 172.21.15.28:0/2805773452 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40acb70 con 0x7f96d01513c0 2023-12-16T03:25:23.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.947+0000 7f96d71e6640 1 -- 172.21.15.28:0/2805773452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d01513c0 msgr2=0x7f96d006d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.947+0000 7f96d71e6640 1 --2- 172.21.15.28:0/2805773452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d01513c0 0x7f96d006d770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96d00673c0 tx=0x7f96c401e550 comp rx=0 tx=0).stop 2023-12-16T03:25:23.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.947+0000 7f96d71e6640 1 -- 172.21.15.28:0/2805773452 shutdown_connections 2023-12-16T03:25:23.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.947+0000 7f96d71e6640 1 --2- 172.21.15.28:0/2805773452 >> v2:172.21.15.28:3300/0 conn(0x7f96d00c22c0 0x7f96d015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.947+0000 7f96d71e6640 1 --2- 172.21.15.28:0/2805773452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d01513c0 0x7f96d006d770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.947+0000 7f96d71e6640 1 -- 172.21.15.28:0/2805773452 >> 172.21.15.28:0/2805773452 conn(0x7f96d00c5cd0 msgr2=0x7f96d00c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:23.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.947+0000 7f96d71e6640 1 -- 172.21.15.28:0/2805773452 shutdown_connections 2023-12-16T03:25:23.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.947+0000 7f96d71e6640 1 -- 172.21.15.28:0/2805773452 wait complete. 2023-12-16T03:25:23.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.947+0000 7fbbd859d640 1 Processor -- start 2023-12-16T03:25:23.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7f96d71e6640 1 Processor -- start 2023-12-16T03:25:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.947+0000 7fbbd859d640 1 -- start start 2023-12-16T03:25:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd859d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbbd01513c0 0x7fbbd006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd859d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd00c06d0 0x7fbbd00a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd859d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbbd00c22c0 0x7fbbd0153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd859d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd00c1290 con 0x7fbbd01513c0 2023-12-16T03:25:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd859d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd006e490 con 0x7fbbd00c22c0 2023-12-16T03:25:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd859d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd006e770 con 0x7fbbd00c06d0 2023-12-16T03:25:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7f96d71e6640 1 -- start start 2023-12-16T03:25:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd6339640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbbd01513c0 0x7fbbd006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd6339640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbbd01513c0 0x7fbbd006d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38786/0 (socket says 172.21.15.28:38786) 2023-12-16T03:25:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd6b3a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbbd00c22c0 0x7fbbd0153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd6339640 1 -- 172.21.15.28:0/3786369242 learned_addr learned my addr 172.21.15.28:0/3786369242 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd5b38640 1 --2- 172.21.15.28:0/3786369242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd00c06d0 0x7fbbd00a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd6b3a640 1 -- 172.21.15.28:0/3786369242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd00c06d0 msgr2=0x7fbbd00a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd6b3a640 1 --2- 172.21.15.28:0/3786369242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd00c06d0 0x7fbbd00a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd6b3a640 1 -- 172.21.15.28:0/3786369242 >> v2:172.21.15.28:3300/0 conn(0x7fbbd01513c0 msgr2=0x7fbbd006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd6b3a640 1 --2- 172.21.15.28:0/3786369242 >> v2:172.21.15.28:3300/0 conn(0x7fbbd01513c0 0x7fbbd006d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7fbbd6b3a640 1 -- 172.21.15.28:0/3786369242 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd006cf70 con 0x7fbbd00c22c0 2023-12-16T03:25:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7f96d71e6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00c22c0 0x7f96d00bd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7f96d71e6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96d01513c0 0x7f96d00bacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7f96d71e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d0154af0 0x7f96d0153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7f96d71e6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00bd5b0 con 0x7f96d01513c0 2023-12-16T03:25:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7f96d71e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d01f9e60 con 0x7f96d0154af0 2023-12-16T03:25:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.951+0000 7f96d71e6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d0152d50 con 0x7f96d00c22c0 2023-12-16T03:25:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d5783640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d0154af0 0x7f96d0153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d5783640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d0154af0 0x7f96d0153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60408/0 (socket says 172.21.15.28:60408) 2023-12-16T03:25:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d5783640 1 -- 172.21.15.28:0/4113490635 learned_addr learned my addr 172.21.15.28:0/4113490635 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96cffff640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96d01513c0 0x7f96d00bacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d4f82640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00c22c0 0x7f96d00bd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d5783640 1 -- 172.21.15.28:0/4113490635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00c22c0 msgr2=0x7f96d00bd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d5783640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00c22c0 0x7f96d00bd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d5783640 1 -- 172.21.15.28:0/4113490635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96d01513c0 msgr2=0x7f96d00bacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d5783640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96d01513c0 0x7f96d00bacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d5783640 1 -- 172.21.15.28:0/4113490635 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4009420 con 0x7f96d0154af0 2023-12-16T03:25:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7fbbd6339640 1 --2- 172.21.15.28:0/3786369242 >> v2:172.21.15.28:3300/0 conn(0x7fbbd01513c0 0x7fbbd006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d5783640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d0154af0 0x7f96d0153a80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96c800b9a0 tx=0x7f96c800be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96cd7fa640 1 -- 172.21.15.28:0/4113490635 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c800cba0 con 0x7f96d0154af0 2023-12-16T03:25:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d71e6640 1 -- 172.21.15.28:0/4113490635 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d00bb230 con 0x7f96d0154af0 2023-12-16T03:25:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96d71e6640 1 -- 172.21.15.28:0/4113490635 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d0153280 con 0x7f96d0154af0 2023-12-16T03:25:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96cd7fa640 1 -- 172.21.15.28:0/4113490635 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c800cd00 con 0x7f96d0154af0 2023-12-16T03:25:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.955+0000 7f96cd7fa640 1 -- 172.21.15.28:0/4113490635 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c800cba0 con 0x7f96d0154af0 2023-12-16T03:25:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7f96d71e6640 1 -- 172.21.15.28:0/4113490635 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b0005260 con 0x7f96d0154af0 2023-12-16T03:25:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7fbbd6b3a640 1 --2- 172.21.15.28:0/3786369242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd00c22c0 0x7fbbd0153f00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbbd006fde0 tx=0x7fbbc001c200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afb07f789a4243bc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7f96cd7fa640 1 -- 172.21.15.28:0/4113490635 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f96c801d3b0 con 0x7f96d0154af0 2023-12-16T03:25:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7fbbd5337640 1 -- 172.21.15.28:0/3786369242 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0008be0 con 0x7fbbd00c22c0 2023-12-16T03:25:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7fbbd5337640 1 -- 172.21.15.28:0/3786369242 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc00a7050 con 0x7fbbd00c22c0 2023-12-16T03:25:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7fbbd5337640 1 -- 172.21.15.28:0/3786369242 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000a0d0 con 0x7fbbd00c22c0 2023-12-16T03:25:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7fbbd859d640 1 -- 172.21.15.28:0/3786369242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd00c22c0 msgr2=0x7fbbd0153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7fbbd859d640 1 --2- 172.21.15.28:0/3786369242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd00c22c0 0x7fbbd0153f00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbbd006fde0 tx=0x7fbbc001c200 comp rx=0 tx=0).stop 2023-12-16T03:25:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7f96cd7fa640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f96bc066530 0x7f96bc0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7f96cd7fa640 1 -- 172.21.15.28:0/4113490635 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96c80838a0 con 0x7f96d0154af0 2023-12-16T03:25:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7fbbd859d640 1 -- 172.21.15.28:0/3786369242 shutdown_connections 2023-12-16T03:25:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7fbbd859d640 1 --2- 172.21.15.28:0/3786369242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd00c22c0 0x7fbbd0153f00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.959+0000 7fbbd859d640 1 --2- 172.21.15.28:0/3786369242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd00c06d0 0x7fbbd00a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.963+0000 7f96d4f82640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f96bc066530 0x7f96bc0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.963+0000 7fbbd859d640 1 --2- 172.21.15.28:0/3786369242 >> v2:172.21.15.28:3300/0 conn(0x7fbbd01513c0 0x7fbbd006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.963+0000 7fbbd859d640 1 -- 172.21.15.28:0/3786369242 >> 172.21.15.28:0/3786369242 conn(0x7fbbd00c5cd0 msgr2=0x7fbbd00c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.963+0000 7fbbd859d640 1 -- 172.21.15.28:0/3786369242 shutdown_connections 2023-12-16T03:25:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.963+0000 7fbbd859d640 1 -- 172.21.15.28:0/3786369242 wait complete. 2023-12-16T03:25:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.963+0000 7f96d4f82640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f96bc066530 0x7f96bc0689f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f96c40b0000 tx=0x7f96c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.963+0000 7fbbd859d640 1 Processor -- start 2023-12-16T03:25:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7fbbd859d640 1 -- start start 2023-12-16T03:25:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7f96cd7fa640 1 -- 172.21.15.28:0/4113490635 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f96c8050de0 con 0x7f96d0154af0 2023-12-16T03:25:23.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7fbbd859d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd00c22c0 0x7fbbd00a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7fbbd859d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd01513c0 0x7fbbd00a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7fbbd859d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd01e58c0 0x7fbbd00a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7fbbd6339640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd00c22c0 0x7fbbd00a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7fbbd6339640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd00c22c0 0x7fbbd00a4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60738/0 (socket says 172.21.15.28:60738) 2023-12-16T03:25:23.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7fbbd6339640 1 -- 172.21.15.28:0/1683536493 learned_addr learned my addr 172.21.15.28:0/1683536493 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd01f4e50 con 0x7fbbd01513c0 2023-12-16T03:25:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00a2320 con 0x7fbbd01e58c0 2023-12-16T03:25:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00a2600 con 0x7fbbd00c22c0 2023-12-16T03:25:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.967+0000 7fbbd6b3a640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd01e58c0 0x7fbbd00a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbd5b38640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd01513c0 0x7fbbd00a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbd6b3a640 1 -- 172.21.15.28:0/1683536493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd00c22c0 msgr2=0x7fbbd00a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbd6b3a640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd00c22c0 0x7fbbd00a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbd6b3a640 1 -- 172.21.15.28:0/1683536493 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd01513c0 msgr2=0x7fbbd00a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbd6b3a640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd01513c0 0x7fbbd00a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbd6b3a640 1 -- 172.21.15.28:0/1683536493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc8009b30 con 0x7fbbd01e58c0 2023-12-16T03:25:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbd5b38640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd01513c0 0x7fbbd00a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbd6b3a640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd01e58c0 0x7fbbd00a30e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00aa000 tx=0x7fbbc0018fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbc6ffd640 1 -- 172.21.15.28:0/1683536493 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00ba070 con 0x7fbbd01e58c0 2023-12-16T03:25:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbc6ffd640 1 -- 172.21.15.28:0/1683536493 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc000a2e0 con 0x7fbbd01e58c0 2023-12-16T03:25:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc000ae50 con 0x7fbbd01e58c0 2023-12-16T03:25:23.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd00a2bc0 con 0x7fbbd01e58c0 2023-12-16T03:25:23.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.971+0000 7fbbc6ffd640 1 -- 172.21.15.28:0/1683536493 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000a670 con 0x7fbbd01e58c0 2023-12-16T03:25:23.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.975+0000 7fbbc6ffd640 1 -- 172.21.15.28:0/1683536493 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbbc00b2040 con 0x7fbbd01e58c0 2023-12-16T03:25:23.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.979+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb8005260 con 0x7fbbd01e58c0 2023-12-16T03:25:23.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.979+0000 7fbbc6ffd640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb40664a0 0x7fbbb4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:23.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.979+0000 7fbbc6ffd640 1 -- 172.21.15.28:0/1683536493 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbc011cee0 con 0x7fbbd01e58c0 2023-12-16T03:25:23.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.979+0000 7fbbd6339640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb40664a0 0x7fbbb4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:23.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.983+0000 7fbbd6339640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb40664a0 0x7fbbb4068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009fd0 tx=0x7fbbc800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:23.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:23.983+0000 7fbbc6ffd640 1 -- 172.21.15.28:0/1683536493 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fbbc0122060 con 0x7fbbd01e58c0 2023-12-16T03:25:24.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.183+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f70c41efc70 con 0x7f70c4153e60 2023-12-16T03:25:24.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.183+0000 7f70b9ffb640 1 -- 172.21.15.28:0/2196021545 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70c41efc70 con 0x7f70c4153e60 2023-12-16T03:25:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70a80664c0 msgr2=0x7f70a8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70a80664c0 0x7f70a8068980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70c0000c10 tx=0x7f70c00a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c4153e60 msgr2=0x7f70c41ec6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c4153e60 0x7f70c41ec6a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70c406a850 tx=0x7f70bc00cb90 comp rx=0 tx=0).stop 2023-12-16T03:25:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 shutdown_connections 2023-12-16T03:25:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70a80664c0 0x7f70a8068980 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c4153e60 0x7f70c41ec6a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c4151d50 0x7f70c41f0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 --2- 172.21.15.28:0/2196021545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c4e30 0x7f70c406ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 >> 172.21.15.28:0/2196021545 conn(0x7f70c40c9d90 msgr2=0x7f70c40bec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 shutdown_connections 2023-12-16T03:25:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.187+0000 7f70cba5a640 1 -- 172.21.15.28:0/2196021545 wait complete. 2023-12-16T03:25:24.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.211+0000 7f3f66793640 1 -- 172.21.15.28:0/1127905084 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f60074380 con 0x7f3f600c1b40 2023-12-16T03:25:24.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.211+0000 7f3f55ffb640 1 -- 172.21.15.28:0/1127905084 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f60074380 con 0x7f3f600c1b40 2023-12-16T03:25:24.218 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:24.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.215+0000 7f3f66793640 1 -- 172.21.15.28:0/1127905084 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f44066470 msgr2=0x7f3f44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.215+0000 7f3f66793640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f44066470 0x7f3f44068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0b2000 tx=0x7f3f5c0ab070 comp rx=0 tx=0).stop 2023-12-16T03:25:24.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.215+0000 7f3f66793640 1 -- 172.21.15.28:0/1127905084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c1b40 msgr2=0x7f3f60149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.215+0000 7f3f66793640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c1b40 0x7f3f60149bd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000a670 tx=0x7f3f5000ab30 comp rx=0 tx=0).stop 2023-12-16T03:25:24.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.215+0000 7f3f66793640 1 -- 172.21.15.28:0/1127905084 shutdown_connections 2023-12-16T03:25:24.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.219+0000 7f3f66793640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f600c1b40 0x7f3f60149bd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.219+0000 7f3f66793640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f600c12e0 0x7f3f601ec2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.219+0000 7f3f66793640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f44066470 0x7f3f44068930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.219+0000 7f3f66793640 1 --2- 172.21.15.28:0/1127905084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f600c09c0 0x7f3f6006bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.219+0000 7f3f66793640 1 -- 172.21.15.28:0/1127905084 >> 172.21.15.28:0/1127905084 conn(0x7f3f600a7910 msgr2=0x7f3f600a58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:24.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-12-16T03:25:24.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.219+0000 7f3f66793640 1 -- 172.21.15.28:0/1127905084 shutdown_connections 2023-12-16T03:25:24.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.219+0000 7f3f66793640 1 -- 172.21.15.28:0/1127905084 wait complete. 2023-12-16T03:25:24.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.231+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe764155450 con 0x7fe76406b820 2023-12-16T03:25:24.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.231+0000 7fe7617fa640 1 -- 172.21.15.28:0/3963424954 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe764155450 con 0x7fe76406b820 2023-12-16T03:25:24.236 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-12-16T03:25:24.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7f674949c640 1 -- 172.21.15.28:0/4104622840 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f674414abb0 con 0x7f6744151ca0 2023-12-16T03:25:24.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7f6740ff9640 1 -- 172.21.15.28:0/4104622840 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f673c001b10 con 0x7f6744151ca0 2023-12-16T03:25:24.238 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:24.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe748066570 msgr2=0x7fe748068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe748066570 0x7fe748068a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7500b0000 tx=0x7fe7500046d0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76406b820 msgr2=0x7fe7640c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76406b820 0x7fe7640c36c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe75800e8a0 tx=0x7fe75800ed60 comp rx=0 tx=0).stop 2023-12-16T03:25:24.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 shutdown_connections 2023-12-16T03:25:24.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe748066570 0x7fe748068a30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe76414c730 0x7fe7641ec890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe76414c200 0x7fe7641ec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 --2- 172.21.15.28:0/3963424954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe76406b820 0x7fe7640c36c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 >> 172.21.15.28:0/3963424954 conn(0x7fe7640ab9f0 msgr2=0x7fe7640c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:24.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 shutdown_connections 2023-12-16T03:25:24.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.235+0000 7fe769c59640 1 -- 172.21.15.28:0/3963424954 wait complete. 2023-12-16T03:25:24.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 -- 172.21.15.28:0/4104622840 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f67300664f0 msgr2=0x7f67300689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f67300664f0 0x7f67300689b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f67340af000 tx=0x7f6734004740 comp rx=0 tx=0).stop 2023-12-16T03:25:24.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 -- 172.21.15.28:0/4104622840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6744151ca0 msgr2=0x7f67440aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6744151ca0 0x7f67440aae70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f673c00ca70 tx=0x7f673c00cf30 comp rx=0 tx=0).stop 2023-12-16T03:25:24.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 -- 172.21.15.28:0/4104622840 shutdown_connections 2023-12-16T03:25:24.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6744151ca0 0x7f67440aae70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f67440c4ab0 0x7f67441faa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f67300664f0 0x7f67300689b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 --2- 172.21.15.28:0/4104622840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f67440bf0d0 0x7f67440ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 -- 172.21.15.28:0/4104622840 >> 172.21.15.28:0/4104622840 conn(0x7f67440c67f0 msgr2=0x7f6744147870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f332512a640 1 -- 172.21.15.28:0/892553802 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3304005510 con 0x7f3320151e90 2023-12-16T03:25:24.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f33177fe640 1 -- 172.21.15.28:0/892553802 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3318019030 con 0x7f3320151e90 2023-12-16T03:25:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:24.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 -- 172.21.15.28:0/4104622840 shutdown_connections 2023-12-16T03:25:24.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.239+0000 7f674949c640 1 -- 172.21.15.28:0/4104622840 wait complete. 2023-12-16T03:25:24.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 -- 172.21.15.28:0/892553802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3300066540 msgr2=0x7f3300068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3300066540 0x7f3300068a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f331001a010 tx=0x7f33100a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:24.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 -- 172.21.15.28:0/892553802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 msgr2=0x7f33200af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 0x7f33200af440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f331800be20 tx=0x7f331800bf10 comp rx=0 tx=0).stop 2023-12-16T03:25:24.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 -- 172.21.15.28:0/892553802 shutdown_connections 2023-12-16T03:25:24.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3320151e90 0x7f33200af440 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33200c7ea0 0x7f33201583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3300066540 0x7f3300068a00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 --2- 172.21.15.28:0/892553802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33200c4e60 0x7f33201568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 -- 172.21.15.28:0/892553802 >> 172.21.15.28:0/892553802 conn(0x7f33200ca170 msgr2=0x7f332015e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:24.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 -- 172.21.15.28:0/892553802 shutdown_connections 2023-12-16T03:25:24.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.243+0000 7f33157fa640 1 -- 172.21.15.28:0/892553802 wait complete. 2023-12-16T03:25:24.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-12-16T03:25:24.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.259+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f66080ca8d0 con 0x7f66080462c0 2023-12-16T03:25:24.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.259+0000 7f65f77fe640 1 -- 172.21.15.28:0/3759751321 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66080ca8d0 con 0x7f66080462c0 2023-12-16T03:25:24.262 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:24.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-12-16T03:25:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f65fc066570 msgr2=0x7f65fc068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f65fc066570 0x7f65fc068a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6600005890 tx=0x7f6600009040 comp rx=0 tx=0).stop 2023-12-16T03:25:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66080462c0 msgr2=0x7f66080bfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66080462c0 0x7f66080bfcb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6610062150 tx=0x7f6610093a10 comp rx=0 tx=0).stop 2023-12-16T03:25:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 shutdown_connections 2023-12-16T03:25:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66080462c0 0x7f66080bfcb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f65fc066570 0x7f65fc068a30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f660800b0b0 0x7f66080bf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 --2- 172.21.15.28:0/3759751321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6608006ed0 0x7f6608030440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 >> 172.21.15.28:0/3759751321 conn(0x7f6608005e70 msgr2=0x7f66080c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 shutdown_connections 2023-12-16T03:25:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.263+0000 7f660ffff640 1 -- 172.21.15.28:0/3759751321 wait complete. 2023-12-16T03:25:24.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-16T03:25:24.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-12-16T03:25:24.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-16T03:25:24.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.295+0000 7f96d71e6640 1 -- 172.21.15.28:0/4113490635 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f96b00057e0 con 0x7f96d0154af0 2023-12-16T03:25:24.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.295+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbbb80057e0 con 0x7fbbd01e58c0 2023-12-16T03:25:24.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.295+0000 7f96cd7fa640 1 -- 172.21.15.28:0/4113490635 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f96c8019020 con 0x7f96d0154af0 2023-12-16T03:25:24.299 INFO:teuthology.orchestra.run.smithi028.stdout:55834574852 2023-12-16T03:25:24.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.295+0000 7fbbc6ffd640 1 -- 172.21.15.28:0/1683536493 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbbc00ea360 con 0x7fbbd01e58c0 2023-12-16T03:25:24.300 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-12-16T03:25:24.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 -- 172.21.15.28:0/4113490635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f96bc066530 msgr2=0x7f96bc0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f96bc066530 0x7f96bc0689f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f96c40b0000 tx=0x7f96c4008040 comp rx=0 tx=0).stop 2023-12-16T03:25:24.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 -- 172.21.15.28:0/4113490635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d0154af0 msgr2=0x7f96d0153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d0154af0 0x7f96d0153a80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96c800b9a0 tx=0x7f96c800be60 comp rx=0 tx=0).stop 2023-12-16T03:25:24.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb40664a0 msgr2=0x7fbbb4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb40664a0 0x7fbbb4068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009fd0 tx=0x7fbbc800b040 comp rx=0 tx=0).stop 2023-12-16T03:25:24.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd01e58c0 msgr2=0x7fbbd00a30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:24.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd01e58c0 0x7fbbd00a30e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00aa000 tx=0x7fbbc0018fa0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 shutdown_connections 2023-12-16T03:25:24.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd01e58c0 0x7fbbd00a30e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb40664a0 0x7fbbb4068960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd01513c0 0x7fbbd00a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 --2- 172.21.15.28:0/1683536493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd00c22c0 0x7fbbd00a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 >> 172.21.15.28:0/1683536493 conn(0x7fbbd00c5cd0 msgr2=0x7fbbd01e82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:24.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 -- 172.21.15.28:0/4113490635 shutdown_connections 2023-12-16T03:25:24.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96d0154af0 0x7f96d0153a80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f96bc066530 0x7f96bc0689f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f96d01513c0 0x7f96d00bacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 --2- 172.21.15.28:0/4113490635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96d00c22c0 0x7f96d00bd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:24.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 -- 172.21.15.28:0/4113490635 >> 172.21.15.28:0/4113490635 conn(0x7f96d00c5cd0 msgr2=0x7f96d00a4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:24.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 shutdown_connections 2023-12-16T03:25:24.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 -- 172.21.15.28:0/4113490635 shutdown_connections 2023-12-16T03:25:24.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7fbbd859d640 1 -- 172.21.15.28:0/1683536493 wait complete. 2023-12-16T03:25:24.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:24.299+0000 7f96d71e6640 1 -- 172.21.15.28:0/4113490635 wait complete. 2023-12-16T03:25:24.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-12-16T03:25:24.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-12-16T03:25:25.224 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-16T03:25:25.250 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-16T03:25:25.267 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-16T03:25:25.275 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-16T03:25:25.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-16T03:25:25.297 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-16T03:25:25.324 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-16T03:25:25.324 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-16T03:25:25.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.415+0000 7fb9fcfe6640 1 Processor -- start 2023-12-16T03:25:25.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.415+0000 7fb9fcfe6640 1 -- start start 2023-12-16T03:25:25.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.415+0000 7fb9fcfe6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f8072080 0x7fb9f806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.415+0000 7fb9fcfe6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9f80c4300 0x7fb9f80c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9f659c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb9f8151350 0x7fb9f806bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57920/0 (socket says 172.21.15.28:57920) 2023-12-16T03:25:25.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9f659c640 1 -- 172.21.15.28:0/2251108984 learned_addr learned my addr 172.21.15.28:0/2251108984 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:25.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9fcfe6640 1 -- 172.21.15.28:0/2251108984 --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f80c3e70 con 0x7fb9f8151350 2023-12-16T03:25:25.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9fcfe6640 1 -- 172.21.15.28:0/2251108984 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f80c16e0 con 0x7fb9f80c4300 2023-12-16T03:25:25.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9f6d9d640 1 --2- 172.21.15.28:0/2251108984 >> v2:172.21.15.134:3300/0 conn(0x7fb9f80c4300 0x7fb9f80c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9f5d9b640 1 --2- 172.21.15.28:0/2251108984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f8072080 0x7fb9f806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9fcfe6640 1 -- 172.21.15.28:0/2251108984 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80c1120 con 0x7fb9f8072080 2023-12-16T03:25:25.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9f559a640 1 -- 172.21.15.28:0/2251108984 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744823446 0 0) 0x7fb9f80c3e70 con 0x7fb9f8151350 2023-12-16T03:25:25.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9f559a640 1 -- 172.21.15.28:0/2251108984 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e0003530 con 0x7fb9f8151350 2023-12-16T03:25:25.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9f5d9b640 1 -- 172.21.15.28:0/2251108984 >> v2:172.21.15.134:3300/0 conn(0x7fb9f80c4300 msgr2=0x7fb9f80c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:25.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9f5d9b640 1 --2- 172.21.15.28:0/2251108984 >> v2:172.21.15.134:3300/0 conn(0x7fb9f80c4300 0x7fb9f80c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9f5d9b640 1 -- 172.21.15.28:0/2251108984 >> v1:172.21.15.28:6789/0 conn(0x7fb9f8151350 legacy=0x7fb9f806bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.419+0000 7fb9f5d9b640 1 -- 172.21.15.28:0/2251108984 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80c1400 con 0x7fb9f8072080 2023-12-16T03:25:25.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.427+0000 7fb9f5d9b640 1 --2- 172.21.15.28:0/2251108984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f8072080 0x7fb9f806d1c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000f370 tx=0x7fb9f0020ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf78931cac25810a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.427+0000 7fb9f559a640 1 -- 172.21.15.28:0/2251108984 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f00a9c80 con 0x7fb9f8072080 2023-12-16T03:25:25.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.427+0000 7fb9f559a640 1 -- 172.21.15.28:0/2251108984 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f00a9de0 con 0x7fb9f8072080 2023-12-16T03:25:25.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.427+0000 7fb9f559a640 1 -- 172.21.15.28:0/2251108984 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f000d2f0 con 0x7fb9f8072080 2023-12-16T03:25:25.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.427+0000 7fb9fcfe6640 1 -- 172.21.15.28:0/2251108984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f8072080 msgr2=0x7fb9f806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.427+0000 7fb9fcfe6640 1 --2- 172.21.15.28:0/2251108984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f8072080 0x7fb9f806d1c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000f370 tx=0x7fb9f0020ce0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.431+0000 7fb9fcfe6640 1 -- 172.21.15.28:0/2251108984 shutdown_connections 2023-12-16T03:25:25.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.431+0000 7fb9fcfe6640 1 --2- 172.21.15.28:0/2251108984 >> v2:172.21.15.134:3300/0 conn(0x7fb9f80c4300 0x7fb9f80c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.431+0000 7fb9fcfe6640 1 --2- 172.21.15.28:0/2251108984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f8072080 0x7fb9f806d1c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.431+0000 7fb9fcfe6640 1 -- 172.21.15.28:0/2251108984 >> 172.21.15.28:0/2251108984 conn(0x7fb9f80a7910 msgr2=0x7fb9f80a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.431+0000 7fb9fcfe6640 1 -- 172.21.15.28:0/2251108984 shutdown_connections 2023-12-16T03:25:25.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.431+0000 7fb9fcfe6640 1 -- 172.21.15.28:0/2251108984 wait complete. 2023-12-16T03:25:25.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.431+0000 7fb9fcfe6640 1 Processor -- start 2023-12-16T03:25:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.431+0000 7fb9fcfe6640 1 -- start start 2023-12-16T03:25:25.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9fcfe6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9f8072080 0x7fb9f8153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9fcfe6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f80c4300 0x7fb9f81470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9fcfe6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9f8151350 0x7fb9f81475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9fcfe6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f8145ee0 con 0x7fb9f8072080 2023-12-16T03:25:25.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9fcfe6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f81ec9d0 con 0x7fb9f8151350 2023-12-16T03:25:25.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9fcfe6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f81460d0 con 0x7fb9f80c4300 2023-12-16T03:25:25.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9f8072080 0x7fb9f8153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9f8072080 0x7fb9f8153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38818/0 (socket says 172.21.15.28:38818) 2023-12-16T03:25:25.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f659c640 1 -- 172.21.15.28:0/3522395572 learned_addr learned my addr 172.21.15.28:0/3522395572 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:25.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f6d9d640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9f8151350 0x7fb9f81475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f5d9b640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f80c4300 0x7fb9f81470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f659c640 1 -- 172.21.15.28:0/3522395572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f80c4300 msgr2=0x7fb9f81470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f659c640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f80c4300 0x7fb9f81470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f659c640 1 -- 172.21.15.28:0/3522395572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9f8151350 msgr2=0x7fb9f81475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f659c640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9f8151350 0x7fb9f81475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f659c640 1 -- 172.21.15.28:0/3522395572 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f000f050 con 0x7fb9f8072080 2023-12-16T03:25:25.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f6d9d640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9f8151350 0x7fb9f81475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:25.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f5d9b640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f80c4300 0x7fb9f81470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:25.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.435+0000 7fb9f659c640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9f8072080 0x7fb9f8153cc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800c800 tx=0x7fb9e800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.439+0000 7fb9e6ffd640 1 -- 172.21.15.28:0/3522395572 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e800b040 con 0x7fb9f8072080 2023-12-16T03:25:25.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.439+0000 7fb9fcfe6640 1 -- 172.21.15.28:0/3522395572 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f814b3f0 con 0x7fb9f8072080 2023-12-16T03:25:25.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.439+0000 7fb9fcfe6640 1 -- 172.21.15.28:0/3522395572 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f8149c80 con 0x7fb9f8072080 2023-12-16T03:25:25.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.439+0000 7fb9e6ffd640 1 -- 172.21.15.28:0/3522395572 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e8007880 con 0x7fb9f8072080 2023-12-16T03:25:25.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.439+0000 7fb9e6ffd640 1 -- 172.21.15.28:0/3522395572 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e800b040 con 0x7fb9f8072080 2023-12-16T03:25:25.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.439+0000 7fb9e4ff9640 1 -- 172.21.15.28:0/3522395572 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f814b630 con 0x7fb9f8072080 2023-12-16T03:25:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.447+0000 7fb9e6ffd640 1 -- 172.21.15.28:0/3522395572 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb9e80079f0 con 0x7fb9f8072080 2023-12-16T03:25:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.447+0000 7fb9e6ffd640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d8066530 0x7fb9d80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.451+0000 7fb9f5d9b640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d8066530 0x7fb9d80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.451+0000 7fb9f5d9b640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d8066530 0x7fb9d80689f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00b2000 tx=0x7fb9f00ab070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.451+0000 7fb9e6ffd640 1 -- 172.21.15.28:0/3522395572 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9e8055020 con 0x7fb9f8072080 2023-12-16T03:25:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.459+0000 7fb9e6ffd640 1 -- 172.21.15.28:0/3522395572 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb9e8051360 con 0x7fb9f8072080 2023-12-16T03:25:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.491+0000 7f2fe7fff640 1 Processor -- start 2023-12-16T03:25:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f2fe7fff640 1 -- start start 2023-12-16T03:25:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f2fe7fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2fe8151ae0 0x7f2fe80c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f7716c9c640 1 Processor -- start 2023-12-16T03:25:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f7716c9c640 1 -- start start 2023-12-16T03:25:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f2fe7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2fe8158740 0x7f2fe80ca400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f2fe7fff640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe81582b0 con 0x7f2fe80ca940 2023-12-16T03:25:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f2fe7fff640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe80c5500 con 0x7f2fe8158740 2023-12-16T03:25:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f2fe7fff640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe80c4bb0 con 0x7f2fe8151ae0 2023-12-16T03:25:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f2fe6ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2fe8151ae0 0x7f2fe80c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f2fe6ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2fe8151ae0 0x7f2fe80c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60450/0 (socket says 172.21.15.28:60450) 2023-12-16T03:25:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f2fe6ffd640 1 -- 172.21.15.28:0/1021104469 learned_addr learned my addr 172.21.15.28:0/1021104469 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.495+0000 7f2fe6ffd640 1 -- 172.21.15.28:0/1021104469 >> v2:172.21.15.28:3300/0 conn(0x7f2fe8158740 msgr2=0x7f2fe80ca400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-16T03:25:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f2fe67fc640 1 --2- 172.21.15.28:0/1021104469 >> v2:172.21.15.28:3300/0 conn(0x7f2fe8158740 0x7f2fe80ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f2fe6ffd640 1 --2- 172.21.15.28:0/1021104469 >> v2:172.21.15.28:3300/0 conn(0x7f2fe8158740 0x7f2fe80ca400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f2fe6ffd640 1 -- 172.21.15.28:0/1021104469 >> v1:172.21.15.28:6789/0 conn(0x7f2fe80ca940 legacy=0x7f2fe81544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f2fe6ffd640 1 -- 172.21.15.28:0/1021104469 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe8151ec0 con 0x7f2fe8151ae0 2023-12-16T03:25:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f7716c9c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7710152ae0 0x7f77100c1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f2fe67fc640 1 --2- 172.21.15.28:0/1021104469 >> v2:172.21.15.28:3300/0 conn(0x7f2fe8158740 0x7f2fe80ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f7716c9c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7710159430 con 0x7f77100c1b70 2023-12-16T03:25:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f7716c9c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7710158840 con 0x7f77100c1550 2023-12-16T03:25:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f7716c9c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7710158b00 con 0x7f7710152ae0 2023-12-16T03:25:25.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f7715c9a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7710152ae0 0x7f77100c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f7715c9a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7710152ae0 0x7f77100c1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38830/0 (socket says 172.21.15.28:38830) 2023-12-16T03:25:25.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f7715c9a640 1 -- 172.21.15.28:0/1217315791 learned_addr learned my addr 172.21.15.28:0/1217315791 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:25.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f7714c98640 1 -- 172.21.15.28:0/1217315791 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282913764 0 0) 0x7f7710159430 con 0x7f77100c1b70 2023-12-16T03:25:25.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.499+0000 7f7714c98640 1 -- 172.21.15.28:0/1217315791 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76fc003530 con 0x7f77100c1b70 2023-12-16T03:25:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.503+0000 7f7715c9a640 1 -- 172.21.15.28:0/1217315791 >> v1:172.21.15.134:6789/0 conn(0x7f77100c1550 legacy=0x7f7710071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.503+0000 7f7715c9a640 1 -- 172.21.15.28:0/1217315791 >> v1:172.21.15.28:6789/0 conn(0x7f77100c1b70 legacy=0x7f77100c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.503+0000 7f7715c9a640 1 -- 172.21.15.28:0/1217315791 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7710158de0 con 0x7f7710152ae0 2023-12-16T03:25:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.503+0000 7f2fe6ffd640 1 --2- 172.21.15.28:0/1021104469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe8151ae0 0x7f2fe80c4670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2fe806d660 tx=0x7f2fd801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36975a0c3ad52869 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.503+0000 7f2fe5ffb640 1 -- 172.21.15.28:0/1021104469 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80aa430 con 0x7f2fe8151ae0 2023-12-16T03:25:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.503+0000 7f2fe5ffb640 1 -- 172.21.15.28:0/1021104469 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd80aa590 con 0x7f2fe8151ae0 2023-12-16T03:25:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.503+0000 7f2fe5ffb640 1 -- 172.21.15.28:0/1021104469 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80aa430 con 0x7f2fe8151ae0 2023-12-16T03:25:25.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1021104469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe8151ae0 msgr2=0x7f2fe80c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f2fe7fff640 1 --2- 172.21.15.28:0/1021104469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe8151ae0 0x7f2fe80c4670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2fe806d660 tx=0x7f2fd801c4d0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7715c9a640 1 --2- 172.21.15.28:0/1217315791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7710152ae0 0x7f77100c1010 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7700009870 tx=0x7f770001c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2069718d5752a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7190ac8640 1 Processor -- start 2023-12-16T03:25:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7714c98640 1 -- 172.21.15.28:0/1217315791 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c001a00 con 0x7f7710152ae0 2023-12-16T03:25:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7190ac8640 1 -- start start 2023-12-16T03:25:25.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7714c98640 1 -- 172.21.15.28:0/1217315791 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77000a7050 con 0x7f7710152ae0 2023-12-16T03:25:25.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7714c98640 1 -- 172.21.15.28:0/1217315791 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000ab600 con 0x7f7710152ae0 2023-12-16T03:25:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1021104469 shutdown_connections 2023-12-16T03:25:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f2fe7fff640 1 --2- 172.21.15.28:0/1021104469 >> v2:172.21.15.28:3300/0 conn(0x7f2fe8158740 0x7f2fe80ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f2fe7fff640 1 --2- 172.21.15.28:0/1021104469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe8151ae0 0x7f2fe80c4670 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1021104469 >> 172.21.15.28:0/1021104469 conn(0x7f2fe80abe80 msgr2=0x7f2fe80c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7716c9c640 1 -- 172.21.15.28:0/1217315791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7710152ae0 msgr2=0x7f77100c1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7716c9c640 1 --2- 172.21.15.28:0/1217315791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7710152ae0 0x7f77100c1010 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7700009870 tx=0x7f770001c280 comp rx=0 tx=0).stop 2023-12-16T03:25:25.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1021104469 shutdown_connections 2023-12-16T03:25:25.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7716c9c640 1 -- 172.21.15.28:0/1217315791 shutdown_connections 2023-12-16T03:25:25.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7716c9c640 1 --2- 172.21.15.28:0/1217315791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7710152ae0 0x7f77100c1010 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7716c9c640 1 -- 172.21.15.28:0/1217315791 >> 172.21.15.28:0/1217315791 conn(0x7f77100a7800 msgr2=0x7f77100a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7190ac8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f718c0a8430 0x7f718c14db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7190ac8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 0x7f718c0c0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7190ac8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718c0c05f0 con 0x7f718c0c1b40 2023-12-16T03:25:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7190ac8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c0c2430 con 0x7f718c0a8430 2023-12-16T03:25:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.507+0000 7f7190ac8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c150f90 con 0x7f718c0c09c0 2023-12-16T03:25:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f7716c9c640 1 -- 172.21.15.28:0/1217315791 shutdown_connections 2023-12-16T03:25:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f718b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f718c0c1b40 0x7f718c0c3a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57940/0 (socket says 172.21.15.28:57940) 2023-12-16T03:25:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f718b7fe640 1 -- 172.21.15.28:0/1834606588 learned_addr learned my addr 172.21.15.28:0/1834606588 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f718affd640 1 --2- 172.21.15.28:0/1834606588 >> v2:172.21.15.134:3300/0 conn(0x7f718c0a8430 0x7f718c14db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f718bfff640 1 --2- 172.21.15.28:0/1834606588 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 0x7f718c0c0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f7716c9c640 1 -- 172.21.15.28:0/1217315791 wait complete. 2023-12-16T03:25:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f7716c9c640 1 Processor -- start 2023-12-16T03:25:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f7716c9c640 1 -- start start 2023-12-16T03:25:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1021104469 wait complete. 2023-12-16T03:25:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f718a7fc640 1 -- 172.21.15.28:0/1834606588 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194311921 0 0) 0x7f718c0c05f0 con 0x7f718c0c1b40 2023-12-16T03:25:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f718a7fc640 1 -- 172.21.15.28:0/1834606588 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7174003530 con 0x7f718c0c1b40 2023-12-16T03:25:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f718bfff640 1 -- 172.21.15.28:0/1834606588 >> v2:172.21.15.134:3300/0 conn(0x7f718c0a8430 msgr2=0x7f718c14db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f718bfff640 1 --2- 172.21.15.28:0/1834606588 >> v2:172.21.15.134:3300/0 conn(0x7f718c0a8430 0x7f718c14db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f718bfff640 1 -- 172.21.15.28:0/1834606588 >> v1:172.21.15.28:6789/0 conn(0x7f718c0c1b40 legacy=0x7f718c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f718bfff640 1 -- 172.21.15.28:0/1834606588 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c1511e0 con 0x7f718c0c09c0 2023-12-16T03:25:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.511+0000 7f2fe7fff640 1 Processor -- start 2023-12-16T03:25:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f7716c9c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77100c1550 0x7f7710155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe7fff640 1 -- start start 2023-12-16T03:25:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f7716c9c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7710152ae0 0x7f7710153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80ca940 0x7f2fe8154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f7716c9c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f771015c4b0 0x7f771014d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f7715c9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77100c1550 0x7f7710155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f7715c9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77100c1550 0x7f7710155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60464/0 (socket says 172.21.15.28:60464) 2023-12-16T03:25:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe7fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe8151ae0 0x7f2fe8153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f7716c9c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771015b640 con 0x7f7710152ae0 2023-12-16T03:25:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f7716c9c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77101558b0 con 0x7f77100c1550 2023-12-16T03:25:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f7716c9c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771015cc20 con 0x7f771015c4b0 2023-12-16T03:25:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80ca940 0x7f2fe8154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f7715c9a640 1 -- 172.21.15.28:0/2014392921 learned_addr learned my addr 172.21.15.28:0/2014392921 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80ca940 0x7f2fe8154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38840/0 (socket says 172.21.15.28:38840) 2023-12-16T03:25:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe6ffd640 1 -- 172.21.15.28:0/1535577110 learned_addr learned my addr 172.21.15.28:0/1535577110 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe7fff640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe8158740 0x7f2fe80c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f7715499640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7710152ae0 0x7f7710153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe814cea0 con 0x7f2fe80ca940 2023-12-16T03:25:25.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8154270 con 0x7f2fe8158740 2023-12-16T03:25:25.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81f1fc0 con 0x7f2fe8151ae0 2023-12-16T03:25:25.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f771649b640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f771015c4b0 0x7f771014d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe67fc640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe8151ae0 0x7f2fe8153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.515+0000 7f2fe77fe640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe8158740 0x7f2fe80c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fe6ffd640 1 -- 172.21.15.28:0/1535577110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe8151ae0 msgr2=0x7f2fe8153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fe6ffd640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe8151ae0 0x7f2fe8153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f718bfff640 1 --2- 172.21.15.28:0/1834606588 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 0x7f718c0c0e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71800097c0 tx=0x7f718001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ab354899c1a81f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f771649b640 1 -- 172.21.15.28:0/2014392921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77100c1550 msgr2=0x7f7710155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f771649b640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77100c1550 0x7f7710155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f771649b640 1 -- 172.21.15.28:0/2014392921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7710152ae0 msgr2=0x7f7710153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fe6ffd640 1 -- 172.21.15.28:0/1535577110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe8158740 msgr2=0x7f2fe80c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fe6ffd640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe8158740 0x7f2fe80c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fe6ffd640 1 -- 172.21.15.28:0/1535577110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd80094d0 con 0x7f2fe80ca940 2023-12-16T03:25:25.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f771649b640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7710152ae0 0x7f7710153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f771649b640 1 -- 172.21.15.28:0/2014392921 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77000094d0 con 0x7f771015c4b0 2023-12-16T03:25:25.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fe77fe640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe8158740 0x7f2fe80c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:25.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f718a7fc640 1 -- 172.21.15.28:0/1834606588 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71800a6040 con 0x7f718c0c09c0 2023-12-16T03:25:25.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f718a7fc640 1 -- 172.21.15.28:0/1834606588 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71800aa600 con 0x7f718c0c09c0 2023-12-16T03:25:25.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f718a7fc640 1 -- 172.21.15.28:0/1834606588 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71800a6040 con 0x7f718c0c09c0 2023-12-16T03:25:25.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f771649b640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f771015c4b0 0x7f771014d220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f770800b410 tx=0x7f770800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fe6ffd640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80ca940 0x7f2fe8154630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2fd801c9b0 tx=0x7f2fd8019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f7190ac8640 1 -- 172.21.15.28:0/1834606588 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 msgr2=0x7f718c0c0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f7190ac8640 1 --2- 172.21.15.28:0/1834606588 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 0x7f718c0c0e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71800097c0 tx=0x7f718001c4a0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fcf7fe640 1 -- 172.21.15.28:0/1535577110 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80aadd0 con 0x7f2fe80ca940 2023-12-16T03:25:25.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f77067fc640 1 -- 172.21.15.28:0/2014392921 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708004020 con 0x7f771015c4b0 2023-12-16T03:25:25.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f77067fc640 1 -- 172.21.15.28:0/2014392921 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708004180 con 0x7f771015c4b0 2023-12-16T03:25:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f77067fc640 1 -- 172.21.15.28:0/2014392921 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708011630 con 0x7f771015c4b0 2023-12-16T03:25:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe80c1650 con 0x7f2fe80ca940 2023-12-16T03:25:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe80c1c10 con 0x7f2fe80ca940 2023-12-16T03:25:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fcf7fe640 1 -- 172.21.15.28:0/1535577110 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd8003620 con 0x7f2fe80ca940 2023-12-16T03:25:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f2fcf7fe640 1 -- 172.21.15.28:0/1535577110 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80039d0 con 0x7f2fe80ca940 2023-12-16T03:25:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f7716c9c640 1 -- 172.21.15.28:0/2014392921 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77101561e0 con 0x7f771015c4b0 2023-12-16T03:25:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f7716c9c640 1 -- 172.21.15.28:0/2014392921 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7710154890 con 0x7f771015c4b0 2023-12-16T03:25:25.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f7190ac8640 1 -- 172.21.15.28:0/1834606588 shutdown_connections 2023-12-16T03:25:25.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f7190ac8640 1 --2- 172.21.15.28:0/1834606588 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 0x7f718c0c0e30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f7190ac8640 1 --2- 172.21.15.28:0/1834606588 >> v2:172.21.15.134:3300/0 conn(0x7f718c0a8430 0x7f718c14db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f7190ac8640 1 -- 172.21.15.28:0/1834606588 >> 172.21.15.28:0/1834606588 conn(0x7f718c0a7910 msgr2=0x7f718c0a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.523+0000 7f77067fc640 1 -- 172.21.15.28:0/2014392921 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7708011790 con 0x7f771015c4b0 2023-12-16T03:25:25.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.519+0000 7f7190ac8640 1 -- 172.21.15.28:0/1834606588 shutdown_connections 2023-12-16T03:25:25.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.523+0000 7f7190ac8640 1 -- 172.21.15.28:0/1834606588 wait complete. 2023-12-16T03:25:25.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.523+0000 7f7190ac8640 1 Processor -- start 2023-12-16T03:25:25.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.523+0000 7f2fcf7fe640 1 -- 172.21.15.28:0/1535577110 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2fd8003b30 con 0x7f2fe80ca940 2023-12-16T03:25:25.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.523+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc8005260 con 0x7f2fe80ca940 2023-12-16T03:25:25.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f77067fc640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f40664c0 0x7f76f4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f7716c9c640 1 -- 172.21.15.28:0/2014392921 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771004e850 con 0x7f771015c4b0 2023-12-16T03:25:25.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f77067fc640 1 -- 172.21.15.28:0/2014392921 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7708054b30 con 0x7f771015c4b0 2023-12-16T03:25:25.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f2fcf7fe640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2fd40664c0 0x7f2fd4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f2fcf7fe640 1 -- 172.21.15.28:0/1535577110 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fd811e480 con 0x7f2fe80ca940 2023-12-16T03:25:25.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f7715c9a640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f40664c0 0x7f76f4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f7190ac8640 1 -- start start 2023-12-16T03:25:25.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f7190ac8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f718c0a8430 0x7f718c14dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f7190ac8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 0x7f718c1fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f7190ac8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f718c0c1b40 0x7f718c0bf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f718affd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 0x7f718c1fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f718affd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 0x7f718c1fc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60786/0 (socket says 172.21.15.28:60786) 2023-12-16T03:25:25.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f7715c9a640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f40664c0 0x7f76f4068980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f770001a930 tx=0x7f77000a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f718affd640 1 -- 172.21.15.28:0/924110101 learned_addr learned my addr 172.21.15.28:0/924110101 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:25.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c154340 con 0x7f718c0a8430 2023-12-16T03:25:25.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c153350 con 0x7f718c0c1b40 2023-12-16T03:25:25.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c153630 con 0x7f718c0c09c0 2023-12-16T03:25:25.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f718b7fe640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f718c0a8430 0x7f718c14dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.527+0000 7f718bfff640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f718c0c1b40 0x7f718c0bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f718affd640 1 -- 172.21.15.28:0/924110101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f718c0c1b40 msgr2=0x7f718c0bf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f718affd640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f718c0c1b40 0x7f718c0bf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f718affd640 1 -- 172.21.15.28:0/924110101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f718c0a8430 msgr2=0x7f718c14dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f718affd640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f718c0a8430 0x7f718c14dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f718affd640 1 -- 172.21.15.28:0/924110101 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180009420 con 0x7f718c0c09c0 2023-12-16T03:25:25.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f2fe67fc640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2fd40664c0 0x7f2fd4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f718b7fe640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f718c0a8430 0x7f718c14dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:25.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f718affd640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 0x7f718c1fc900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c7f0 tx=0x7f717c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f2fe67fc640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2fd40664c0 0x7f2fd4068980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80bd360 tx=0x7f2fdc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f7173fff640 1 -- 172.21.15.28:0/924110101 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c004220 con 0x7f718c0c09c0 2023-12-16T03:25:25.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f7173fff640 1 -- 172.21.15.28:0/924110101 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c0043a0 con 0x7f718c0c09c0 2023-12-16T03:25:25.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f7173fff640 1 -- 172.21.15.28:0/924110101 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c004510 con 0x7f718c0c09c0 2023-12-16T03:25:25.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718c0c42f0 con 0x7f718c0c09c0 2023-12-16T03:25:25.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f77067fc640 1 -- 172.21.15.28:0/2014392921 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7708051600 con 0x7f771015c4b0 2023-12-16T03:25:25.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c14e280 con 0x7f718c0c09c0 2023-12-16T03:25:25.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.531+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c152a90 con 0x7f718c0c09c0 2023-12-16T03:25:25.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.535+0000 7f7173fff640 1 -- 172.21.15.28:0/924110101 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f717c003a70 con 0x7f718c0c09c0 2023-12-16T03:25:25.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.535+0000 7f7173fff640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71780664c0 0x7f7178068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.535+0000 7f718b7fe640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71780664c0 0x7f7178068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.535+0000 7f2fcf7fe640 1 -- 172.21.15.28:0/1535577110 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2fd80ebb20 con 0x7f2fe80ca940 2023-12-16T03:25:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.539+0000 7f718b7fe640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71780664c0 0x7f7178068980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7184001570 tx=0x7f7184009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.539+0000 7f7173fff640 1 -- 172.21.15.28:0/924110101 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f717c054fa0 con 0x7f718c0c09c0 2023-12-16T03:25:25.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.543+0000 7f7173fff640 1 -- 172.21.15.28:0/924110101 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f717c051a70 con 0x7f718c0c09c0 2023-12-16T03:25:25.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.575+0000 7f367b65a640 1 Processor -- start 2023-12-16T03:25:25.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.575+0000 7f367b65a640 1 -- start start 2023-12-16T03:25:25.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.575+0000 7f367b65a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3674072050 0x7f36740c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.575+0000 7f367b65a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36740c4570 0x7f36740c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.575+0000 7f36793f6640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f36741513e0 0x7f36740c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53904/0 (socket says 172.21.15.28:53904) 2023-12-16T03:25:25.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.575+0000 7f36793f6640 1 -- 172.21.15.28:0/1111734345 learned_addr learned my addr 172.21.15.28:0/1111734345 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:25.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.575+0000 7f3678bf5640 1 --2- 172.21.15.28:0/1111734345 >> v2:172.21.15.28:3300/0 conn(0x7f3674072050 0x7f36740c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.575+0000 7f3679bf7640 1 --2- 172.21.15.28:0/1111734345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36740c4570 0x7f36740c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.579+0000 7f367b65a640 1 -- 172.21.15.28:0/1111734345 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36741517c0 con 0x7f36741513e0 2023-12-16T03:25:25.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.579+0000 7f367b65a640 1 -- 172.21.15.28:0/1111734345 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367406be20 con 0x7f3674072050 2023-12-16T03:25:25.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.579+0000 7f367b65a640 1 -- 172.21.15.28:0/1111734345 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367406c0c0 con 0x7f36740c4570 2023-12-16T03:25:25.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.579+0000 7f366bfff640 1 -- 172.21.15.28:0/1111734345 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724619881 0 0) 0x7f36741517c0 con 0x7f36741513e0 2023-12-16T03:25:25.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.579+0000 7f366bfff640 1 -- 172.21.15.28:0/1111734345 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3660005740 con 0x7f36741513e0 2023-12-16T03:25:25.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.579+0000 7f3678bf5640 1 -- 172.21.15.28:0/1111734345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36740c4570 msgr2=0x7f36740c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:25.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.579+0000 7f3678bf5640 1 --2- 172.21.15.28:0/1111734345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36740c4570 0x7f36740c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.579+0000 7f3678bf5640 1 -- 172.21.15.28:0/1111734345 >> v1:172.21.15.134:6789/0 conn(0x7f36741513e0 legacy=0x7f36740c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.579+0000 7f3678bf5640 1 -- 172.21.15.28:0/1111734345 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367406c7c0 con 0x7f3674072050 2023-12-16T03:25:25.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7faa91bf5640 1 Processor -- start 2023-12-16T03:25:25.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7f3678bf5640 1 --2- 172.21.15.28:0/1111734345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3674072050 0x7f36740c20e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f366c00c1e0 tx=0x7f366c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9b8e19bcb0d0c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7f366bfff640 1 -- 172.21.15.28:0/1111734345 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c008be0 con 0x7f3674072050 2023-12-16T03:25:25.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7f366bfff640 1 -- 172.21.15.28:0/1111734345 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c0a7050 con 0x7f3674072050 2023-12-16T03:25:25.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7faa91bf5640 1 -- start start 2023-12-16T03:25:25.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7faa91bf5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa8c1513c0 0x7faa8c06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7faa91bf5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faa8c0c06d0 0x7faa8c0a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7faa91bf5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 0x7faa8c153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7faa91bf5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c0c1290 con 0x7faa8c1513c0 2023-12-16T03:25:25.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7faa91bf5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c06e490 con 0x7faa8c0c06d0 2023-12-16T03:25:25.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7faa91bf5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c06e770 con 0x7faa8c0c22c0 2023-12-16T03:25:25.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.583+0000 7f366bfff640 1 -- 172.21.15.28:0/1111734345 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c008be0 con 0x7f3674072050 2023-12-16T03:25:25.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7f367b65a640 1 -- 172.21.15.28:0/1111734345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3674072050 msgr2=0x7f36740c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7f367b65a640 1 --2- 172.21.15.28:0/1111734345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3674072050 0x7f36740c20e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f366c00c1e0 tx=0x7f366c01c2e0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 0x7faa8c153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 0x7faa8c153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60808/0 (socket says 172.21.15.28:60808) 2023-12-16T03:25:25.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7faa8bfff640 1 -- 172.21.15.28:0/2631669671 learned_addr learned my addr 172.21.15.28:0/2631669671 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:25.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7faa8affd640 1 --2- 172.21.15.28:0/2631669671 >> v2:172.21.15.134:3300/0 conn(0x7faa8c0c06d0 0x7faa8c0a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7faa8b7fe640 1 --2- 172.21.15.28:0/2631669671 >> v2:172.21.15.28:3300/0 conn(0x7faa8c1513c0 0x7faa8c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7faa8bfff640 1 -- 172.21.15.28:0/2631669671 >> v2:172.21.15.134:3300/0 conn(0x7faa8c0c06d0 msgr2=0x7faa8c0a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:25.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7faa8bfff640 1 --2- 172.21.15.28:0/2631669671 >> v2:172.21.15.134:3300/0 conn(0x7faa8c0c06d0 0x7faa8c0a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7faa8bfff640 1 -- 172.21.15.28:0/2631669671 >> v2:172.21.15.28:3300/0 conn(0x7faa8c1513c0 msgr2=0x7faa8c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:25.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7f367b65a640 1 -- 172.21.15.28:0/1111734345 shutdown_connections 2023-12-16T03:25:25.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7f367b65a640 1 --2- 172.21.15.28:0/1111734345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36740c4570 0x7f36740c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7f367b65a640 1 --2- 172.21.15.28:0/1111734345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3674072050 0x7f36740c20e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7f367b65a640 1 -- 172.21.15.28:0/1111734345 >> 172.21.15.28:0/1111734345 conn(0x7f36740a7910 msgr2=0x7f36740a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7faa8bfff640 1 --2- 172.21.15.28:0/2631669671 >> v2:172.21.15.28:3300/0 conn(0x7faa8c1513c0 0x7faa8c06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7faa8bfff640 1 -- 172.21.15.28:0/2631669671 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c06cf70 con 0x7faa8c0c22c0 2023-12-16T03:25:25.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7f367b65a640 1 -- 172.21.15.28:0/1111734345 shutdown_connections 2023-12-16T03:25:25.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.587+0000 7f367b65a640 1 -- 172.21.15.28:0/1111734345 wait complete. 2023-12-16T03:25:25.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.591+0000 7faa8b7fe640 1 --2- 172.21.15.28:0/2631669671 >> v2:172.21.15.28:3300/0 conn(0x7faa8c1513c0 0x7faa8c06d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:25.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.591+0000 7f367b65a640 1 Processor -- start 2023-12-16T03:25:25.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.591+0000 7f367b65a640 1 -- start start 2023-12-16T03:25:25.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.591+0000 7f39bf1d1640 1 Processor -- start 2023-12-16T03:25:25.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.591+0000 7f39bf1d1640 1 -- start start 2023-12-16T03:25:25.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.591+0000 7faa8bfff640 1 --2- 172.21.15.28:0/2631669671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 0x7faa8c153f00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0c05a0 tx=0x7faa8401ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fdad011cdbb162f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f367b65a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3674072050 0x7f36741f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa8a7fc640 1 -- 172.21.15.28:0/2631669671 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840a7c30 con 0x7faa8c0c22c0 2023-12-16T03:25:25.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa8a7fc640 1 -- 172.21.15.28:0/2631669671 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa840ab070 con 0x7faa8c0c22c0 2023-12-16T03:25:25.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa8a7fc640 1 -- 172.21.15.28:0/2631669671 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840b1400 con 0x7faa8c0c22c0 2023-12-16T03:25:25.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f367b65a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36740c4570 0x7f3674153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3678bf5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36740c4570 0x7f3674153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39bf1d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 0x7f39b80a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39bf1d1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f39b80c33a0 0x7f39b80a5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f367b65a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36741513e0 0x7f3674154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3678bf5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36740c4570 0x7f3674153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38868/0 (socket says 172.21.15.28:38868) 2023-12-16T03:25:25.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f367b65a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3674153980 con 0x7f36740c4570 2023-12-16T03:25:25.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f367b65a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36740a8e60 con 0x7f3674072050 2023-12-16T03:25:25.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f367b65a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36740a8b80 con 0x7f36741513e0 2023-12-16T03:25:25.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3678bf5640 1 -- 172.21.15.28:0/3039499603 learned_addr learned my addr 172.21.15.28:0/3039499603 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:25.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39bf1d1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b806e670 con 0x7f39b80c45e0 2023-12-16T03:25:25.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39bf1d1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b80c58b0 con 0x7f39b80c33a0 2023-12-16T03:25:25.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39bf1d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80bfbb0 con 0x7f39b80bf360 2023-12-16T03:25:25.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f36793f6640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3674072050 0x7f36741f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39b7fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f39b80c45e0 0x7f39b8155e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57942/0 (socket says 172.21.15.28:57942) 2023-12-16T03:25:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39b7fff640 1 -- 172.21.15.28:0/643822044 learned_addr learned my addr 172.21.15.28:0/643822044 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39bd76e640 1 --2- 172.21.15.28:0/643822044 >> v2:172.21.15.134:3300/0 conn(0x7f39b80c33a0 0x7f39b80a5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3679bf7640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36741513e0 0x7f3674154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa91bf5640 1 -- 172.21.15.28:0/2631669671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 msgr2=0x7faa8c153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3679bf7640 1 -- 172.21.15.28:0/3039499603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3674072050 msgr2=0x7f36741f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3679bf7640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3674072050 0x7f36741f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3679bf7640 1 -- 172.21.15.28:0/3039499603 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36740c4570 msgr2=0x7f3674153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3679bf7640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36740c4570 0x7f3674153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3679bf7640 1 -- 172.21.15.28:0/3039499603 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c00ae50 con 0x7f36741513e0 2023-12-16T03:25:25.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa91bf5640 1 --2- 172.21.15.28:0/2631669671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 0x7faa8c153f00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0c05a0 tx=0x7faa8401ebe0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39bcf6d640 1 --2- 172.21.15.28:0/643822044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 0x7f39b80a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39bd76e640 1 -- 172.21.15.28:0/643822044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 msgr2=0x7f39b80a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa91bf5640 1 -- 172.21.15.28:0/2631669671 shutdown_connections 2023-12-16T03:25:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa91bf5640 1 --2- 172.21.15.28:0/2631669671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 0x7faa8c153f00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa91bf5640 1 --2- 172.21.15.28:0/2631669671 >> v2:172.21.15.134:3300/0 conn(0x7faa8c0c06d0 0x7faa8c0a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39b77fe640 1 -- 172.21.15.28:0/643822044 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888260379 0 0) 0x7f39b806e670 con 0x7f39b80c45e0 2023-12-16T03:25:25.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa91bf5640 1 --2- 172.21.15.28:0/2631669671 >> v2:172.21.15.28:3300/0 conn(0x7faa8c1513c0 0x7faa8c06d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa91bf5640 1 -- 172.21.15.28:0/2631669671 >> 172.21.15.28:0/2631669671 conn(0x7faa8c0c5cd0 msgr2=0x7faa8c0c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3679bf7640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36741513e0 0x7f3674154350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f367000efc0 tx=0x7f367000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa91bf5640 1 -- 172.21.15.28:0/2631669671 shutdown_connections 2023-12-16T03:25:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7faa91bf5640 1 -- 172.21.15.28:0/2631669671 wait complete. 2023-12-16T03:25:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3669ffb640 1 -- 172.21.15.28:0/3039499603 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670009c00 con 0x7f36741513e0 2023-12-16T03:25:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3669ffb640 1 -- 172.21.15.28:0/3039499603 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367000f040 con 0x7f36741513e0 2023-12-16T03:25:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f3669ffb640 1 -- 172.21.15.28:0/3039499603 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700146c0 con 0x7f36741513e0 2023-12-16T03:25:25.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f367b65a640 1 -- 172.21.15.28:0/3039499603 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36741f5ba0 con 0x7f36741513e0 2023-12-16T03:25:25.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39bd76e640 1 --2- 172.21.15.28:0/643822044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 0x7f39b80a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39bd76e640 1 -- 172.21.15.28:0/643822044 >> v1:172.21.15.28:6789/0 conn(0x7f39b80c45e0 legacy=0x7f39b8155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.595+0000 7f39bd76e640 1 -- 172.21.15.28:0/643822044 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b80bfe50 con 0x7f39b80c33a0 2023-12-16T03:25:25.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.599+0000 7f39bcf6d640 1 --2- 172.21.15.28:0/643822044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 0x7f39b80a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.599+0000 7f367b65a640 1 -- 172.21.15.28:0/3039499603 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36741f5890 con 0x7f36741513e0 2023-12-16T03:25:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.599+0000 7f367b65a640 1 -- 172.21.15.28:0/3039499603 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3674153af0 con 0x7f36741513e0 2023-12-16T03:25:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.599+0000 7faa91bf5640 1 Processor -- start 2023-12-16T03:25:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.599+0000 7fe8eed65640 1 Processor -- start 2023-12-16T03:25:25.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.599+0000 7faa91bf5640 1 -- start start 2023-12-16T03:25:25.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f3669ffb640 1 -- 172.21.15.28:0/3039499603 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3670014820 con 0x7f36741513e0 2023-12-16T03:25:25.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.599+0000 7fe8eed65640 1 -- start start 2023-12-16T03:25:25.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8eed65640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe8e8151e90 0x7fe8e80c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8eed65640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 0x7fe8e806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa91bf5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 0x7faa8c152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa91bf5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c1513c0 0x7faa8c0a7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8eed65640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e806c860 con 0x7fe8e80c4e60 2023-12-16T03:25:25.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8eed65640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80c8750 con 0x7fe8e8151e90 2023-12-16T03:25:25.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8eed65640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e81552d0 con 0x7fe8e80c7ea0 2023-12-16T03:25:25.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f39bd76e640 1 --2- 172.21.15.28:0/643822044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b80c33a0 0x7f39b80a5420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009d90 tx=0x7f39b001d2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eeddee009d16ae7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f3669ffb640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3658066570 0x7f3658068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa91bf5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa8c0a67f0 0x7faa8c0a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa91bf5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c14aa90 con 0x7faa8c1513c0 2023-12-16T03:25:25.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa91bf5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c14a7b0 con 0x7faa8c0a67f0 2023-12-16T03:25:25.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa91bf5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c1ece90 con 0x7faa8c0c22c0 2023-12-16T03:25:25.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa8affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c1513c0 0x7faa8c0a7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa8affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c1513c0 0x7faa8c0a7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38870/0 (socket says 172.21.15.28:38870) 2023-12-16T03:25:25.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa8affd640 1 -- 172.21.15.28:0/3024846053 learned_addr learned my addr 172.21.15.28:0/3024846053 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:25.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa8bfff640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa8c0a67f0 0x7faa8c0a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f39b77fe640 1 -- 172.21.15.28:0/643822044 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00a5970 con 0x7f39b80c33a0 2023-12-16T03:25:25.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f39b77fe640 1 -- 172.21.15.28:0/643822044 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b00a5ad0 con 0x7f39b80c33a0 2023-12-16T03:25:25.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8ecb01640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe8e8151e90 0x7fe8e80c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8ed302640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe8e80c4e60 0x7fe8e806b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53920/0 (socket says 172.21.15.28:53920) 2023-12-16T03:25:25.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8ed302640 1 -- 172.21.15.28:0/3320713399 learned_addr learned my addr 172.21.15.28:0/3320713399 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:25.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8e7fff640 1 --2- 172.21.15.28:0/3320713399 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 0x7fe8e806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa8b7fe640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 0x7faa8c152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f3669ffb640 1 -- 172.21.15.28:0/3039499603 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3670084be0 con 0x7f36741513e0 2023-12-16T03:25:25.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa8bfff640 1 -- 172.21.15.28:0/3024846053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 msgr2=0x7faa8c152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa8bfff640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 0x7faa8c152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa8bfff640 1 -- 172.21.15.28:0/3024846053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c1513c0 msgr2=0x7faa8c0a7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa8bfff640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c1513c0 0x7faa8c0a7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa8bfff640 1 -- 172.21.15.28:0/3024846053 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa840079d0 con 0x7faa8c0a67f0 2023-12-16T03:25:25.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8e77fe640 1 -- 172.21.15.28:0/3320713399 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999796296 0 0) 0x7fe8e806c860 con 0x7fe8e80c4e60 2023-12-16T03:25:25.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8e77fe640 1 -- 172.21.15.28:0/3320713399 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d8003530 con 0x7fe8e80c4e60 2023-12-16T03:25:25.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8e7fff640 1 -- 172.21.15.28:0/3320713399 >> v2:172.21.15.134:3300/0 conn(0x7fe8e8151e90 msgr2=0x7fe8e80c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:25.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8e7fff640 1 --2- 172.21.15.28:0/3320713399 >> v2:172.21.15.134:3300/0 conn(0x7fe8e8151e90 0x7fe8e80c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8e7fff640 1 -- 172.21.15.28:0/3320713399 >> v1:172.21.15.134:6789/0 conn(0x7fe8e80c4e60 legacy=0x7fe8e806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa8bfff640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa8c0a67f0 0x7faa8c0a76a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa840af000 tx=0x7faa8401b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f39bf1d1640 1 -- 172.21.15.28:0/643822044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b80c33a0 msgr2=0x7f39b80a5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f39bf1d1640 1 --2- 172.21.15.28:0/643822044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b80c33a0 0x7f39b80a5420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009d90 tx=0x7f39b001d2f0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f39bf1d1640 1 -- 172.21.15.28:0/643822044 shutdown_connections 2023-12-16T03:25:25.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f39bf1d1640 1 --2- 172.21.15.28:0/643822044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b80c33a0 0x7f39b80a5420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f39bf1d1640 1 --2- 172.21.15.28:0/643822044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 0x7f39b80a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f39bf1d1640 1 -- 172.21.15.28:0/643822044 >> 172.21.15.28:0/643822044 conn(0x7f39b80c5cd0 msgr2=0x7f39b80c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7fe8e7fff640 1 -- 172.21.15.28:0/3320713399 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e8154930 con 0x7fe8e80c7ea0 2023-12-16T03:25:25.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f36793f6640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3658066570 0x7f3658068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f39bf1d1640 1 -- 172.21.15.28:0/643822044 shutdown_connections 2023-12-16T03:25:25.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa73fff640 1 -- 172.21.15.28:0/3024846053 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840bf070 con 0x7faa8c0a67f0 2023-12-16T03:25:25.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7f39bf1d1640 1 -- 172.21.15.28:0/643822044 wait complete. 2023-12-16T03:25:25.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.603+0000 7faa91bf5640 1 -- 172.21.15.28:0/3024846053 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c0a5c50 con 0x7faa8c0a67f0 2023-12-16T03:25:25.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.607+0000 7faa91bf5640 1 -- 172.21.15.28:0/3024846053 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c1ed130 con 0x7faa8c0a67f0 2023-12-16T03:25:25.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.607+0000 7faa73fff640 1 -- 172.21.15.28:0/3024846053 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa84003c30 con 0x7faa8c0a67f0 2023-12-16T03:25:25.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.607+0000 7faa73fff640 1 -- 172.21.15.28:0/3024846053 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840bf070 con 0x7faa8c0a67f0 2023-12-16T03:25:25.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.607+0000 7f3669ffb640 1 -- 172.21.15.28:0/3039499603 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f36700520d0 con 0x7f36741513e0 2023-12-16T03:25:25.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.607+0000 7f39bf1d1640 1 Processor -- start 2023-12-16T03:25:25.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.607+0000 7f39bf1d1640 1 -- start start 2023-12-16T03:25:25.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7faa91bf5640 1 -- 172.21.15.28:0/3024846053 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c005260 con 0x7faa8c0a67f0 2023-12-16T03:25:25.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7fe8e7fff640 1 --2- 172.21.15.28:0/3320713399 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 0x7fe8e806b4a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0097c0 tx=0x7fe8dc01c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0d60a2da51802d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7faa73fff640 1 -- 172.21.15.28:0/3024846053 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7faa84004040 con 0x7faa8c0a67f0 2023-12-16T03:25:25.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7fe8e77fe640 1 -- 172.21.15.28:0/3320713399 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0ab600 con 0x7fe8e80c7ea0 2023-12-16T03:25:25.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bf1d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 0x7f39b8071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bf1d1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39b80c33a0 0x7f39b80be330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7fe8e77fe640 1 -- 172.21.15.28:0/3320713399 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc0a7050 con 0x7fe8e80c7ea0 2023-12-16T03:25:25.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7fe8e77fe640 1 -- 172.21.15.28:0/3320713399 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0ab980 con 0x7fe8e80c7ea0 2023-12-16T03:25:25.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bf1d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b80c45e0 0x7f39b8154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bcf6d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 0x7f39b8071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bf1d1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80bd510 con 0x7f39b80c33a0 2023-12-16T03:25:25.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bf1d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b81f2760 con 0x7f39b80c45e0 2023-12-16T03:25:25.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bf1d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80a7640 con 0x7f39b80bf360 2023-12-16T03:25:25.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bcf6d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 0x7f39b8071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:60844/0 (socket says 172.21.15.28:60844) 2023-12-16T03:25:25.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bcf6d640 1 -- 172.21.15.28:0/3085572452 learned_addr learned my addr 172.21.15.28:0/3085572452 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:25.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bd76e640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b80c45e0 0x7f39b8154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39b7fff640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39b80c33a0 0x7f39b80be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f36793f6640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3658066570 0x7f3658068a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36640011f0 tx=0x7f3664007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7faa73fff640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faa78066530 0x7faa780689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bd76e640 1 -- 172.21.15.28:0/3085572452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 msgr2=0x7f39b8071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bd76e640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 0x7f39b8071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bd76e640 1 -- 172.21.15.28:0/3085572452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39b80c33a0 msgr2=0x7f39b80be330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bd76e640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39b80c33a0 0x7f39b80be330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39bd76e640 1 -- 172.21.15.28:0/3085572452 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0009a70 con 0x7f39b80c45e0 2023-12-16T03:25:25.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7f39b7fff640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39b80c33a0 0x7f39b80be330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:25.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.611+0000 7faa73fff640 1 -- 172.21.15.28:0/3024846053 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa840efd20 con 0x7faa8c0a67f0 2023-12-16T03:25:25.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.615+0000 7faa8b7fe640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faa78066530 0x7faa780689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.615+0000 7f39bd76e640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b80c45e0 0x7f39b8154e50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f39b80ac040 tx=0x7f39b0019630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.615+0000 7fe8eed65640 1 -- 172.21.15.28:0/3320713399 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 msgr2=0x7fe8e806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.615+0000 7fe8eed65640 1 --2- 172.21.15.28:0/3320713399 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 0x7fe8e806b4a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0097c0 tx=0x7fe8dc01c360 comp rx=0 tx=0).stop 2023-12-16T03:25:25.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.615+0000 7faa8b7fe640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faa78066530 0x7faa780689f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00ba10 tx=0x7faa7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.615+0000 7fe8eed65640 1 -- 172.21.15.28:0/3320713399 shutdown_connections 2023-12-16T03:25:25.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.615+0000 7fe8eed65640 1 --2- 172.21.15.28:0/3320713399 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 0x7fe8e806b4a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.615+0000 7fe8eed65640 1 --2- 172.21.15.28:0/3320713399 >> v2:172.21.15.134:3300/0 conn(0x7fe8e8151e90 0x7fe8e80c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.615+0000 7fe8eed65640 1 -- 172.21.15.28:0/3320713399 >> 172.21.15.28:0/3320713399 conn(0x7fe8e80ca170 msgr2=0x7fe8e80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.615+0000 7fe8eed65640 1 -- 172.21.15.28:0/3320713399 shutdown_connections 2023-12-16T03:25:25.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.615+0000 7fe8eed65640 1 -- 172.21.15.28:0/3320713399 wait complete. 2023-12-16T03:25:25.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.619+0000 7fe8eed65640 1 Processor -- start 2023-12-16T03:25:25.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.619+0000 7f39b57fa640 1 -- 172.21.15.28:0/3085572452 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00adbc0 con 0x7f39b80c45e0 2023-12-16T03:25:25.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.619+0000 7faa73fff640 1 -- 172.21.15.28:0/3024846053 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7faa840ec0f0 con 0x7faa8c0a67f0 2023-12-16T03:25:25.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.619+0000 7f39b57fa640 1 -- 172.21.15.28:0/3085572452 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b00add20 con 0x7f39b80c45e0 2023-12-16T03:25:25.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.619+0000 7f39b57fa640 1 -- 172.21.15.28:0/3085572452 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00b9690 con 0x7f39b80c45e0 2023-12-16T03:25:25.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.619+0000 7f39bf1d1640 1 -- 172.21.15.28:0/3085572452 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b80a7920 con 0x7f39b80c45e0 2023-12-16T03:25:25.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.619+0000 7fe8eed65640 1 -- start start 2023-12-16T03:25:25.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.619+0000 7f39bf1d1640 1 -- 172.21.15.28:0/3085572452 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b80bde10 con 0x7f39b80c45e0 2023-12-16T03:25:25.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.619+0000 7f399f7fe640 1 -- 172.21.15.28:0/3085572452 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b80be000 con 0x7f39b80c45e0 2023-12-16T03:25:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.619+0000 7fe8eed65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e80c4e60 0x7fe8e814e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.619+0000 7fe8eed65640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 0x7fe8e80abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8eed65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8e8151e90 0x7fe8e80ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8eed65640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80ab8f0 con 0x7fe8e8151e90 2023-12-16T03:25:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8eed65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80bcf90 con 0x7fe8e80c4e60 2023-12-16T03:25:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8eed65640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80bd230 con 0x7fe8e80c7ea0 2023-12-16T03:25:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8ecb01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e80c4e60 0x7fe8e814e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8ecb01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e80c4e60 0x7fe8e814e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60562/0 (socket says 172.21.15.28:60562) 2023-12-16T03:25:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8ecb01640 1 -- 172.21.15.28:0/3177248606 learned_addr learned my addr 172.21.15.28:0/3177248606 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8e7fff640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 0x7fe8e80abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8ed302640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8e8151e90 0x7fe8e80ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8ecb01640 1 -- 172.21.15.28:0/3177248606 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 msgr2=0x7fe8e80abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8ecb01640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 0x7fe8e80abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8ecb01640 1 -- 172.21.15.28:0/3177248606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8e8151e90 msgr2=0x7fe8e80ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8ecb01640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8e8151e90 0x7fe8e80ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8ecb01640 1 -- 172.21.15.28:0/3177248606 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc009420 con 0x7fe8e80c4e60 2023-12-16T03:25:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8ed302640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8e8151e90 0x7fe8e80ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.623+0000 7fe8e7fff640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 0x7fe8e80abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:25.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.627+0000 7fe8ecb01640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e80c4e60 0x7fe8e814e670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400e960 tx=0x7fe8d400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.627+0000 7f39b57fa640 1 -- 172.21.15.28:0/3085572452 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f39b00b97f0 con 0x7f39b80c45e0 2023-12-16T03:25:25.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.627+0000 7fe8e57fa640 1 -- 172.21.15.28:0/3177248606 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4009690 con 0x7fe8e80c4e60 2023-12-16T03:25:25.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.627+0000 7fe8e57fa640 1 -- 172.21.15.28:0/3177248606 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d400ca00 con 0x7fe8e80c4e60 2023-12-16T03:25:25.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.627+0000 7fe8e57fa640 1 -- 172.21.15.28:0/3177248606 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400cd70 con 0x7fe8e80c4e60 2023-12-16T03:25:25.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.627+0000 7fe8eed65640 1 -- 172.21.15.28:0/3177248606 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e80a9a90 con 0x7fe8e80c4e60 2023-12-16T03:25:25.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.627+0000 7f39b57fa640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a40664a0 0x7f39a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.627+0000 7f39b57fa640 1 -- 172.21.15.28:0/3085572452 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39b011ef60 con 0x7f39b80c45e0 2023-12-16T03:25:25.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.627+0000 7f39b57fa640 1 -- 172.21.15.28:0/3085572452 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f39b011f340 con 0x7f39b80c45e0 2023-12-16T03:25:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.627+0000 7fe8eed65640 1 -- 172.21.15.28:0/3177248606 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e814ebb0 con 0x7fe8e80c4e60 2023-12-16T03:25:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.631+0000 7f39bcf6d640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a40664a0 0x7f39a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.631+0000 7fe8eed65640 1 -- 172.21.15.28:0/3177248606 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c8005260 con 0x7fe8e80c4e60 2023-12-16T03:25:25.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.631+0000 7f39bcf6d640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a40664a0 0x7f39a4068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f39a8006fd0 tx=0x7f39a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.635+0000 7fe8e57fa640 1 -- 172.21.15.28:0/3177248606 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe8d4013470 con 0x7fe8e80c4e60 2023-12-16T03:25:25.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.635+0000 7fe8e57fa640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe8cc066540 0x7fe8cc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:25.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.635+0000 7fe8e57fa640 1 -- 172.21.15.28:0/3177248606 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8d4084080 con 0x7fe8e80c4e60 2023-12-16T03:25:25.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.639+0000 7fe8e57fa640 1 -- 172.21.15.28:0/3177248606 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe8d4051590 con 0x7fe8e80c4e60 2023-12-16T03:25:25.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.643+0000 7fe8e7fff640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe8cc066540 0x7fe8cc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:25.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.643+0000 7fe8e7fff640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe8cc066540 0x7fe8cc068a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0ad000 tx=0x7fe8dc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:25.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.811+0000 7fb9e4ff9640 1 -- 172.21.15.28:0/3522395572 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb9f814b630 con 0x7fb9f8072080 2023-12-16T03:25:25.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.811+0000 7fb9e6ffd640 1 -- 172.21.15.28:0/3522395572 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9f814b630 con 0x7fb9f8072080 2023-12-16T03:25:25.814 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2023-12-16T03:25:25.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 -- 172.21.15.28:0/3522395572 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d8066530 msgr2=0x7fb9d80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d8066530 0x7fb9d80689f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00b2000 tx=0x7fb9f00ab070 comp rx=0 tx=0).stop 2023-12-16T03:25:25.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 -- 172.21.15.28:0/3522395572 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9f8072080 msgr2=0x7fb9f8153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9f8072080 0x7fb9f8153cc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800c800 tx=0x7fb9e800ccc0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 -- 172.21.15.28:0/3522395572 shutdown_connections 2023-12-16T03:25:25.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9f8151350 0x7fb9f81475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9f80c4300 0x7fb9f81470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d8066530 0x7fb9d80689f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 --2- 172.21.15.28:0/3522395572 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9f8072080 0x7fb9f8153cc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 -- 172.21.15.28:0/3522395572 >> 172.21.15.28:0/3522395572 conn(0x7fb9f80a7910 msgr2=0x7fb9f806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 -- 172.21.15.28:0/3522395572 shutdown_connections 2023-12-16T03:25:25.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.819+0000 7fb9e4ff9640 1 -- 172.21.15.28:0/3522395572 wait complete. 2023-12-16T03:25:25.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2023-12-16T03:25:25.854 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:25.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.863+0000 7f7716c9c640 1 -- 172.21.15.28:0/2014392921 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7710154100 con 0x7f771015c4b0 2023-12-16T03:25:25.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.863+0000 7f77067fc640 1 -- 172.21.15.28:0/2014392921 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77080517a0 con 0x7f771015c4b0 2023-12-16T03:25:25.868 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2023-12-16T03:25:25.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.863+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2fc80057e0 con 0x7f2fe80ca940 2023-12-16T03:25:25.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 -- 172.21.15.28:0/2014392921 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f40664c0 msgr2=0x7f76f4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f40664c0 0x7f76f4068980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f770001a930 tx=0x7f77000a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:25.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f2fcf7fe640 1 -- 172.21.15.28:0/1535577110 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2fd80ef140 con 0x7f2fe80ca940 2023-12-16T03:25:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 -- 172.21.15.28:0/2014392921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f771015c4b0 msgr2=0x7f771014d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f771015c4b0 0x7f771014d220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f770800b410 tx=0x7f770800b8d0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.872 INFO:teuthology.orchestra.run.smithi028.stdout:55834574856 2023-12-16T03:25:25.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 -- 172.21.15.28:0/2014392921 shutdown_connections 2023-12-16T03:25:25.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f771015c4b0 0x7f771014d220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f40664c0 0x7f76f4068980 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7710152ae0 0x7f7710153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 --2- 172.21.15.28:0/2014392921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77100c1550 0x7f7710155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 -- 172.21.15.28:0/2014392921 >> 172.21.15.28:0/2014392921 conn(0x7f77100a7800 msgr2=0x7f77100a7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 -- 172.21.15.28:0/2014392921 shutdown_connections 2023-12-16T03:25:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.867+0000 7f7716c9c640 1 -- 172.21.15.28:0/2014392921 wait complete. 2023-12-16T03:25:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2fd40664c0 msgr2=0x7f2fd4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2fd40664c0 0x7f2fd4068980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80bd360 tx=0x7f2fdc008040 comp rx=0 tx=0).stop 2023-12-16T03:25:25.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80ca940 msgr2=0x7f2fe8154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80ca940 0x7f2fe8154630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2fd801c9b0 tx=0x7f2fd8019270 comp rx=0 tx=0).stop 2023-12-16T03:25:25.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 shutdown_connections 2023-12-16T03:25:25.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe8158740 0x7f2fe80c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2fe8151ae0 0x7f2fe8153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2fd40664c0 0x7f2fd4068980 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 --2- 172.21.15.28:0/1535577110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80ca940 0x7f2fe8154630 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 >> 172.21.15.28:0/1535577110 conn(0x7f2fe80abe80 msgr2=0x7f2fe8154f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 shutdown_connections 2023-12-16T03:25:25.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.871+0000 7f2fe7fff640 1 -- 172.21.15.28:0/1535577110 wait complete. 2023-12-16T03:25:25.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.883+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f718c152a90 con 0x7f718c0c09c0 2023-12-16T03:25:25.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.883+0000 7f7173fff640 1 -- 172.21.15.28:0/924110101 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f718c152a90 con 0x7f718c0c09c0 2023-12-16T03:25:25.888 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2023-12-16T03:25:25.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.887+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71780664c0 msgr2=0x7f7178068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.887+0000 7f7190ac8640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71780664c0 0x7f7178068980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7184001570 tx=0x7f7184009040 comp rx=0 tx=0).stop 2023-12-16T03:25:25.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.887+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 msgr2=0x7f718c1fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.887+0000 7f7190ac8640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 0x7f718c1fc900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c7f0 tx=0x7f717c00ccb0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.887+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 shutdown_connections 2023-12-16T03:25:25.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.887+0000 7f7190ac8640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f718c0c1b40 0x7f718c0bf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.887+0000 7f7190ac8640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f718c0c09c0 0x7f718c1fc900 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.887+0000 7f7190ac8640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71780664c0 0x7f7178068980 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.887+0000 7f7190ac8640 1 --2- 172.21.15.28:0/924110101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f718c0a8430 0x7f718c14dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.887+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 >> 172.21.15.28:0/924110101 conn(0x7f718c0a7910 msgr2=0x7f718c0a62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.891+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 shutdown_connections 2023-12-16T03:25:25.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.891+0000 7f7190ac8640 1 -- 172.21.15.28:0/924110101 wait complete. 2023-12-16T03:25:25.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.2 2023-12-16T03:25:25.908 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:25.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.1 2023-12-16T03:25:25.912 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:25.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2023-12-16T03:25:25.916 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:25.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 -- 172.21.15.28:0/3039499603 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f367404e850 con 0x7f36741513e0 2023-12-16T03:25:25.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f3669ffb640 1 -- 172.21.15.28:0/3039499603 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3670018090 con 0x7f36741513e0 2023-12-16T03:25:25.918 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2023-12-16T03:25:25.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 -- 172.21.15.28:0/3039499603 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3658066570 msgr2=0x7f3658068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3658066570 0x7f3658068a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36640011f0 tx=0x7f3664007d40 comp rx=0 tx=0).stop 2023-12-16T03:25:25.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 -- 172.21.15.28:0/3039499603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36741513e0 msgr2=0x7f3674154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36741513e0 0x7f3674154350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f367000efc0 tx=0x7f367000c490 comp rx=0 tx=0).stop 2023-12-16T03:25:25.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 -- 172.21.15.28:0/3039499603 shutdown_connections 2023-12-16T03:25:25.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36741513e0 0x7f3674154350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3658066570 0x7f3658068a30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36740c4570 0x7f3674153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 --2- 172.21.15.28:0/3039499603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3674072050 0x7f36741f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 -- 172.21.15.28:0/3039499603 >> 172.21.15.28:0/3039499603 conn(0x7f36740a7910 msgr2=0x7f36740c0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 -- 172.21.15.28:0/3039499603 shutdown_connections 2023-12-16T03:25:25.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.915+0000 7f367b65a640 1 -- 172.21.15.28:0/3039499603 wait complete. 2023-12-16T03:25:25.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.931+0000 7f399f7fe640 1 -- 172.21.15.28:0/3085572452 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f39b8068400 con 0x7f39b80c45e0 2023-12-16T03:25:25.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.931+0000 7f39b57fa640 1 -- 172.21.15.28:0/3085572452 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f39b00ec4e0 con 0x7f39b80c45e0 2023-12-16T03:25:25.936 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2023-12-16T03:25:25.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 -- 172.21.15.28:0/3085572452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a40664a0 msgr2=0x7f39a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a40664a0 0x7f39a4068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f39a8006fd0 tx=0x7f39a8008040 comp rx=0 tx=0).stop 2023-12-16T03:25:25.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 -- 172.21.15.28:0/3085572452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b80c45e0 msgr2=0x7f39b8154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b80c45e0 0x7f39b8154e50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f39b80ac040 tx=0x7f39b0019630 comp rx=0 tx=0).stop 2023-12-16T03:25:25.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 -- 172.21.15.28:0/3085572452 shutdown_connections 2023-12-16T03:25:25.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39b80c45e0 0x7f39b8154e50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a40664a0 0x7f39a4068960 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39b80c33a0 0x7f39b80be330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 --2- 172.21.15.28:0/3085572452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39b80bf360 0x7f39b8071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 -- 172.21.15.28:0/3085572452 >> 172.21.15.28:0/3085572452 conn(0x7f39b80c5cd0 msgr2=0x7f39b80704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 -- 172.21.15.28:0/3085572452 shutdown_connections 2023-12-16T03:25:25.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.935+0000 7f399f7fe640 1 -- 172.21.15.28:0/3085572452 wait complete. 2023-12-16T03:25:25.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.3 2023-12-16T03:25:25.941 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:25.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.947+0000 7faa91bf5640 1 -- 172.21.15.28:0/3024846053 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa6c0057e0 con 0x7faa8c0a67f0 2023-12-16T03:25:25.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.947+0000 7faa73fff640 1 -- 172.21.15.28:0/3024846053 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa840ec0f0 con 0x7faa8c0a67f0 2023-12-16T03:25:25.952 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2023-12-16T03:25:25.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 -- 172.21.15.28:0/3024846053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faa78066530 msgr2=0x7faa780689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faa78066530 0x7faa780689f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00ba10 tx=0x7faa7c008040 comp rx=0 tx=0).stop 2023-12-16T03:25:25.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 -- 172.21.15.28:0/3024846053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa8c0a67f0 msgr2=0x7faa8c0a76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa8c0a67f0 0x7faa8c0a76a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa840af000 tx=0x7faa8401b980 comp rx=0 tx=0).stop 2023-12-16T03:25:25.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 -- 172.21.15.28:0/3024846053 shutdown_connections 2023-12-16T03:25:25.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa8c0a67f0 0x7faa8c0a76a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faa78066530 0x7faa780689f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa8c1513c0 0x7faa8c0a7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 --2- 172.21.15.28:0/3024846053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faa8c0c22c0 0x7faa8c152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 -- 172.21.15.28:0/3024846053 >> 172.21.15.28:0/3024846053 conn(0x7faa8c0c5cd0 msgr2=0x7faa8c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 -- 172.21.15.28:0/3024846053 shutdown_connections 2023-12-16T03:25:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.951+0000 7faa91bf5640 1 -- 172.21.15.28:0/3024846053 wait complete. 2023-12-16T03:25:25.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2023-12-16T03:25:25.959 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:25.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.975+0000 7fe8eed65640 1 -- 172.21.15.28:0/3177248606 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe8c8005510 con 0x7fe8e80c4e60 2023-12-16T03:25:25.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8e57fa640 1 -- 172.21.15.28:0/3177248606 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8d4017020 con 0x7fe8e80c4e60 2023-12-16T03:25:25.980 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-12-16T03:25:25.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2023-12-16T03:25:25.981 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 -- 172.21.15.28:0/3177248606 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe8cc066540 msgr2=0x7fe8cc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe8cc066540 0x7fe8cc068a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0ad000 tx=0x7fe8dc0a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 -- 172.21.15.28:0/3177248606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e80c4e60 msgr2=0x7fe8e814e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e80c4e60 0x7fe8e814e670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400e960 tx=0x7fe8d400ee20 comp rx=0 tx=0).stop 2023-12-16T03:25:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 -- 172.21.15.28:0/3177248606 shutdown_connections 2023-12-16T03:25:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe8cc066540 0x7fe8cc068a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe8e8151e90 0x7fe8e80ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8e80c7ea0 0x7fe8e80abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 --2- 172.21.15.28:0/3177248606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e80c4e60 0x7fe8e814e670 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 -- 172.21.15.28:0/3177248606 >> 172.21.15.28:0/3177248606 conn(0x7fe8e80ca170 msgr2=0x7fe8e80ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 -- 172.21.15.28:0/3177248606 shutdown_connections 2023-12-16T03:25:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:25.979+0000 7fe8eed65640 1 -- 172.21.15.28:0/3177248606 wait complete. 2023-12-16T03:25:26.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2023-12-16T03:25:26.002 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:26.002 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-16T03:25:26.002 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:25:26.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f4435254640 1 Processor -- start 2023-12-16T03:25:26.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f4435254640 1 -- start start 2023-12-16T03:25:26.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f4435254640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4430151e90 0x7f44300c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f4435254640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443006c860 con 0x7f44300c4e60 2023-12-16T03:25:26.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f4435254640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4430154930 con 0x7f44300c7ea0 2023-12-16T03:25:26.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f4435254640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44300c8750 con 0x7f4430151e90 2023-12-16T03:25:26.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f442f59e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f44300c4e60 0x7f443015f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57946/0 (socket says 172.21.15.28:57946) 2023-12-16T03:25:26.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f442f59e640 1 -- 172.21.15.28:0/3986306124 learned_addr learned my addr 172.21.15.28:0/3986306124 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:26.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f442ed9d640 1 --2- 172.21.15.28:0/3986306124 >> v2:172.21.15.134:3300/0 conn(0x7f4430151e90 0x7f44300c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f442e59c640 1 -- 172.21.15.28:0/3986306124 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578742594 0 0) 0x7f443006c860 con 0x7f44300c4e60 2023-12-16T03:25:26.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f442e59c640 1 -- 172.21.15.28:0/3986306124 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f441c003530 con 0x7f44300c4e60 2023-12-16T03:25:26.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f442ed9d640 1 -- 172.21.15.28:0/3986306124 >> v1:172.21.15.134:6789/0 conn(0x7f44300c7ea0 legacy=0x7f443006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f442ed9d640 1 -- 172.21.15.28:0/3986306124 >> v1:172.21.15.28:6789/0 conn(0x7f44300c4e60 legacy=0x7f443015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.187+0000 7f442ed9d640 1 -- 172.21.15.28:0/3986306124 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4430154c10 con 0x7f4430151e90 2023-12-16T03:25:26.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.191+0000 7f442ed9d640 1 --2- 172.21.15.28:0/3986306124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4430151e90 0x7f44300c4920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f44200097c0 tx=0x7f442001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=236d6521385fc62d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:26.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.191+0000 7f442e59c640 1 -- 172.21.15.28:0/3986306124 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200ab600 con 0x7f4430151e90 2023-12-16T03:25:26.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.191+0000 7f442e59c640 1 -- 172.21.15.28:0/3986306124 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44200a7050 con 0x7f4430151e90 2023-12-16T03:25:26.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.191+0000 7f442e59c640 1 -- 172.21.15.28:0/3986306124 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200ab980 con 0x7f4430151e90 2023-12-16T03:25:26.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.191+0000 7f4435254640 1 -- 172.21.15.28:0/3986306124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4430151e90 msgr2=0x7f44300c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.191+0000 7f4435254640 1 --2- 172.21.15.28:0/3986306124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4430151e90 0x7f44300c4920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f44200097c0 tx=0x7f442001c360 comp rx=0 tx=0).stop 2023-12-16T03:25:26.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.191+0000 7f4435254640 1 -- 172.21.15.28:0/3986306124 shutdown_connections 2023-12-16T03:25:26.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.191+0000 7f4435254640 1 --2- 172.21.15.28:0/3986306124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4430151e90 0x7f44300c4920 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.191+0000 7f4435254640 1 -- 172.21.15.28:0/3986306124 >> 172.21.15.28:0/3986306124 conn(0x7f44300ca170 msgr2=0x7f44300ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:26.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.191+0000 7f4435254640 1 -- 172.21.15.28:0/3986306124 shutdown_connections 2023-12-16T03:25:26.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.191+0000 7f4435254640 1 -- 172.21.15.28:0/3986306124 wait complete. 2023-12-16T03:25:26.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4435254640 1 Processor -- start 2023-12-16T03:25:26.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4435254640 1 -- start start 2023-12-16T03:25:26.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4435254640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44300c4e60 0x7f443014a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4435254640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44300c7ea0 0x7f44300c1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4435254640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4430151e90 0x7f44301f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4435254640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44301552d0 con 0x7f4430151e90 2023-12-16T03:25:26.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4435254640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44300c2410 con 0x7f44300c7ea0 2023-12-16T03:25:26.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4435254640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443014ce90 con 0x7f44300c4e60 2023-12-16T03:25:26.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f442f59e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4430151e90 0x7f44301f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f442f59e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4430151e90 0x7f44301f05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38880/0 (socket says 172.21.15.28:38880) 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f442f59e640 1 -- 172.21.15.28:0/1844633150 learned_addr learned my addr 172.21.15.28:0/1844633150 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f442ed9d640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44300c4e60 0x7f443014a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4427fff640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44300c7ea0 0x7f44300c1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f442f59e640 1 -- 172.21.15.28:0/1844633150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44300c4e60 msgr2=0x7f443014a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f442f59e640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44300c4e60 0x7f443014a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f442f59e640 1 -- 172.21.15.28:0/1844633150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44300c7ea0 msgr2=0x7f44300c1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f442f59e640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44300c7ea0 0x7f44300c1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f442f59e640 1 -- 172.21.15.28:0/1844633150 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420009420 con 0x7f4430151e90 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4427fff640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44300c7ea0 0x7f44300c1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f442f59e640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4430151e90 0x7f44301f05c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f442800caa0 tx=0x7f442800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f44277fe640 1 -- 172.21.15.28:0/1844633150 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800ac00 con 0x7f4430151e90 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f44277fe640 1 -- 172.21.15.28:0/1844633150 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442800ad60 con 0x7f4430151e90 2023-12-16T03:25:26.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f44277fe640 1 -- 172.21.15.28:0/1844633150 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4428012620 con 0x7f4430151e90 2023-12-16T03:25:26.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4435254640 1 -- 172.21.15.28:0/1844633150 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443014cbb0 con 0x7f4430151e90 2023-12-16T03:25:26.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.195+0000 7f4435254640 1 -- 172.21.15.28:0/1844633150 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4430149ae0 con 0x7f4430151e90 2023-12-16T03:25:26.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.199+0000 7f4435254640 1 -- 172.21.15.28:0/1844633150 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4430068400 con 0x7f4430151e90 2023-12-16T03:25:26.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.199+0000 7f44277fe640 1 -- 172.21.15.28:0/1844633150 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4428007070 con 0x7f4430151e90 2023-12-16T03:25:26.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.199+0000 7f44277fe640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f44100664a0 0x7f4410068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.199+0000 7f44277fe640 1 -- 172.21.15.28:0/1844633150 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4428083d60 con 0x7f4430151e90 2023-12-16T03:25:26.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.199+0000 7f442ed9d640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f44100664a0 0x7f4410068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.199+0000 7f442ed9d640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f44100664a0 0x7f4410068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f44200ad000 tx=0x7f44200a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:26.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.203+0000 7f44277fe640 1 -- 172.21.15.28:0/1844633150 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4428051280 con 0x7f4430151e90 2023-12-16T03:25:26.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.355+0000 7f4435254640 1 -- 172.21.15.28:0/1844633150 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44301556f0 con 0x7f44100664a0 2023-12-16T03:25:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.363+0000 7f44277fe640 1 -- 172.21.15.28:0/1844633150 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264545 (secure 0 0 0) 0x7f44200ab760 con 0x7f44100664a0 2023-12-16T03:25:26.371 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:25:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 -- 172.21.15.28:0/1844633150 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f44100664a0 msgr2=0x7f4410068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f44100664a0 0x7f4410068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f44200ad000 tx=0x7f44200a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 -- 172.21.15.28:0/1844633150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4430151e90 msgr2=0x7f44301f05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4430151e90 0x7f44301f05c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f442800caa0 tx=0x7f442800cf60 comp rx=0 tx=0).stop 2023-12-16T03:25:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 -- 172.21.15.28:0/1844633150 shutdown_connections 2023-12-16T03:25:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f44100664a0 0x7f4410068960 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4430151e90 0x7f44301f05c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44300c7ea0 0x7f44300c1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 --2- 172.21.15.28:0/1844633150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f44300c4e60 0x7f443014a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 -- 172.21.15.28:0/1844633150 >> 172.21.15.28:0/1844633150 conn(0x7f44300ca170 msgr2=0x7f443014f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 -- 172.21.15.28:0/1844633150 shutdown_connections 2023-12-16T03:25:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.367+0000 7f4435254640 1 -- 172.21.15.28:0/1844633150 wait complete. 2023-12-16T03:25:26.391 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-16T03:25:25.801198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235624,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739096,"statfs":{"total":773094113280,"available":772852834304,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.007990"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437358+0000","last_change":"2023-12-16T03:25:15.452175+0000","last_active":"2023-12-16T03:25:16.437358+0000","last_peered":"2023-12-16T03:25:16.437358+0000","last_clean":"2023-12-16T03:25:16.437358+0000","last_became_active":"2023-12-16T03:25:15.451916+0000","last_became_peered":"2023-12-16T03:25:15.451916+0000","last_unstale":"2023-12-16T03:25:16.437358+0000","last_undegraded":"2023-12-16T03:25:16.437358+0000","last_fullsized":"2023-12-16T03:25:16.437358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:43.581686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420315+0000","last_change":"2023-12-16T03:25:15.425458+0000","last_active":"2023-12-16T03:25:16.420315+0000","last_peered":"2023-12-16T03:25:16.420315+0000","last_clean":"2023-12-16T03:25:16.420315+0000","last_became_active":"2023-12-16T03:25:15.425194+0000","last_became_peered":"2023-12-16T03:25:15.425194+0000","last_unstale":"2023-12-16T03:25:16.420315+0000","last_undegraded":"2023-12-16T03:25:16.420315+0000","last_fullsized":"2023-12-16T03:25:16.420315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437452+0000","last_change":"2023-12-16T03:25:15.425638+0000","last_active":"2023-12-16T03:25:16.437452+0000","last_peered":"2023-12-16T03:25:16.437452+0000","last_clean":"2023-12-16T03:25:16.437452+0000","last_became_active":"2023-12-16T03:25:15.425353+0000","last_became_peered":"2023-12-16T03:25:15.425353+0000","last_unstale":"2023-12-16T03:25:16.437452+0000","last_undegraded":"2023-12-16T03:25:16.437452+0000","last_fullsized":"2023-12-16T03:25:16.437452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422853+0000","last_change":"2023-12-16T03:25:15.434050+0000","last_active":"2023-12-16T03:25:16.422853+0000","last_peered":"2023-12-16T03:25:16.422853+0000","last_clean":"2023-12-16T03:25:16.422853+0000","last_became_active":"2023-12-16T03:25:15.433643+0000","last_became_peered":"2023-12-16T03:25:15.433643+0000","last_unstale":"2023-12-16T03:25:16.422853+0000","last_undegraded":"2023-12-16T03:25:16.422853+0000","last_fullsized":"2023-12-16T03:25:16.422853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436512+0000","last_change":"2023-12-16T03:25:15.445800+0000","last_active":"2023-12-16T03:25:16.436512+0000","last_peered":"2023-12-16T03:25:16.436512+0000","last_clean":"2023-12-16T03:25:16.436512+0000","last_became_active":"2023-12-16T03:25:15.445496+0000","last_became_peered":"2023-12-16T03:25:15.445496+0000","last_unstale":"2023-12-16T03:25:16.436512+0000","last_undegraded":"2023-12-16T03:25:16.436512+0000","last_fullsized":"2023-12-16T03:25:16.436512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422916+0000","last_change":"2023-12-16T03:25:15.433130+0000","last_active":"2023-12-16T03:25:16.422916+0000","last_peered":"2023-12-16T03:25:16.422916+0000","last_clean":"2023-12-16T03:25:16.422916+0000","last_became_active":"2023-12-16T03:25:15.432783+0000","last_became_peered":"2023-12-16T03:25:15.432783+0000","last_unstale":"2023-12-16T03:25:16.422916+0000","last_undegraded":"2023-12-16T03:25:16.422916+0000","last_fullsized":"2023-12-16T03:25:16.422916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:55.217497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436380+0000","last_change":"2023-12-16T03:25:15.443935+0000","last_active":"2023-12-16T03:25:16.436380+0000","last_peered":"2023-12-16T03:25:16.436380+0000","last_clean":"2023-12-16T03:25:16.436380+0000","last_became_active":"2023-12-16T03:25:15.443601+0000","last_became_peered":"2023-12-16T03:25:15.443601+0000","last_unstale":"2023-12-16T03:25:16.436380+0000","last_undegraded":"2023-12-16T03:25:16.436380+0000","last_fullsized":"2023-12-16T03:25:16.436380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436427+0000","last_change":"2023-12-16T03:25:15.431879+0000","last_active":"2023-12-16T03:25:16.436427+0000","last_peered":"2023-12-16T03:25:16.436427+0000","last_clean":"2023-12-16T03:25:16.436427+0000","last_became_active":"2023-12-16T03:25:15.431564+0000","last_became_peered":"2023-12-16T03:25:15.431564+0000","last_unstale":"2023-12-16T03:25:16.436427+0000","last_undegraded":"2023-12-16T03:25:16.436427+0000","last_fullsized":"2023-12-16T03:25:16.436427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437342+0000","last_change":"2023-12-16T03:25:15.446906+0000","last_active":"2023-12-16T03:25:16.437342+0000","last_peered":"2023-12-16T03:25:16.437342+0000","last_clean":"2023-12-16T03:25:16.437342+0000","last_became_active":"2023-12-16T03:25:15.446136+0000","last_became_peered":"2023-12-16T03:25:15.446136+0000","last_unstale":"2023-12-16T03:25:16.437342+0000","last_undegraded":"2023-12-16T03:25:16.437342+0000","last_fullsized":"2023-12-16T03:25:16.437342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:54:38.927177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436922+0000","last_change":"2023-12-16T03:25:15.437274+0000","last_active":"2023-12-16T03:25:16.436922+0000","last_peered":"2023-12-16T03:25:16.436922+0000","last_clean":"2023-12-16T03:25:16.436922+0000","last_became_active":"2023-12-16T03:25:15.436993+0000","last_became_peered":"2023-12-16T03:25:15.436993+0000","last_unstale":"2023-12-16T03:25:16.436922+0000","last_undegraded":"2023-12-16T03:25:16.436922+0000","last_fullsized":"2023-12-16T03:25:16.436922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436247+0000","last_change":"2023-12-16T03:25:15.439228+0000","last_active":"2023-12-16T03:25:16.436247+0000","last_peered":"2023-12-16T03:25:16.436247+0000","last_clean":"2023-12-16T03:25:16.436247+0000","last_became_active":"2023-12-16T03:25:15.437550+0000","last_became_peered":"2023-12-16T03:25:15.437550+0000","last_unstale":"2023-12-16T03:25:16.436247+0000","last_undegraded":"2023-12-16T03:25:16.436247+0000","last_fullsized":"2023-12-16T03:25:16.436247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422787+0000","last_change":"2023-12-16T03:25:15.442026+0000","last_active":"2023-12-16T03:25:16.422787+0000","last_peered":"2023-12-16T03:25:16.422787+0000","last_clean":"2023-12-16T03:25:16.422787+0000","last_became_active":"2023-12-16T03:25:15.441374+0000","last_became_peered":"2023-12-16T03:25:15.441374+0000","last_unstale":"2023-12-16T03:25:16.422787+0000","last_undegraded":"2023-12-16T03:25:16.422787+0000","last_fullsized":"2023-12-16T03:25:16.422787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:21.931497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437544+0000","last_change":"2023-12-16T03:25:15.431327+0000","last_active":"2023-12-16T03:25:16.437544+0000","last_peered":"2023-12-16T03:25:16.437544+0000","last_clean":"2023-12-16T03:25:16.437544+0000","last_became_active":"2023-12-16T03:25:15.430973+0000","last_became_peered":"2023-12-16T03:25:15.430973+0000","last_unstale":"2023-12-16T03:25:16.437544+0000","last_undegraded":"2023-12-16T03:25:16.437544+0000","last_fullsized":"2023-12-16T03:25:16.437544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436524+0000","last_change":"2023-12-16T03:25:15.426240+0000","last_active":"2023-12-16T03:25:16.436524+0000","last_peered":"2023-12-16T03:25:16.436524+0000","last_clean":"2023-12-16T03:25:16.436524+0000","last_became_active":"2023-12-16T03:25:15.425045+0000","last_became_peered":"2023-12-16T03:25:15.425045+0000","last_unstale":"2023-12-16T03:25:16.436524+0000","last_undegraded":"2023-12-16T03:25:16.436524+0000","last_fullsized":"2023-12-16T03:25:16.436524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:11.236920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420099+0000","last_change":"2023-12-16T03:25:15.449282+0000","last_active":"2023-12-16T03:25:16.420099+0000","last_peered":"2023-12-16T03:25:16.420099+0000","last_clean":"2023-12-16T03:25:16.420099+0000","last_became_active":"2023-12-16T03:25:15.449009+0000","last_became_peered":"2023-12-16T03:25:15.449009+0000","last_unstale":"2023-12-16T03:25:16.420099+0000","last_undegraded":"2023-12-16T03:25:16.420099+0000","last_fullsized":"2023-12-16T03:25:16.420099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422703+0000","last_change":"2023-12-16T03:25:15.433001+0000","last_active":"2023-12-16T03:25:16.422703+0000","last_peered":"2023-12-16T03:25:16.422703+0000","last_clean":"2023-12-16T03:25:16.422703+0000","last_became_active":"2023-12-16T03:25:15.432331+0000","last_became_peered":"2023-12-16T03:25:15.432331+0000","last_unstale":"2023-12-16T03:25:16.422703+0000","last_undegraded":"2023-12-16T03:25:16.422703+0000","last_fullsized":"2023-12-16T03:25:16.422703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423697+0000","last_change":"2023-12-16T03:25:15.446721+0000","last_active":"2023-12-16T03:25:16.423697+0000","last_peered":"2023-12-16T03:25:16.423697+0000","last_clean":"2023-12-16T03:25:16.423697+0000","last_became_active":"2023-12-16T03:25:15.446449+0000","last_became_peered":"2023-12-16T03:25:15.446449+0000","last_unstale":"2023-12-16T03:25:16.423697+0000","last_undegraded":"2023-12-16T03:25:16.423697+0000","last_fullsized":"2023-12-16T03:25:16.423697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:00.341013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437037+0000","last_change":"2023-12-16T03:25:15.440602+0000","last_active":"2023-12-16T03:25:16.437037+0000","last_peered":"2023-12-16T03:25:16.437037+0000","last_clean":"2023-12-16T03:25:16.437037+0000","last_became_active":"2023-12-16T03:25:15.440121+0000","last_became_peered":"2023-12-16T03:25:15.440121+0000","last_unstale":"2023-12-16T03:25:16.437037+0000","last_undegraded":"2023-12-16T03:25:16.437037+0000","last_fullsized":"2023-12-16T03:25:16.437037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:07.619534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437099+0000","last_change":"2023-12-16T03:25:15.445828+0000","last_active":"2023-12-16T03:25:16.437099+0000","last_peered":"2023-12-16T03:25:16.437099+0000","last_clean":"2023-12-16T03:25:16.437099+0000","last_became_active":"2023-12-16T03:25:15.445531+0000","last_became_peered":"2023-12-16T03:25:15.445531+0000","last_unstale":"2023-12-16T03:25:16.437099+0000","last_undegraded":"2023-12-16T03:25:16.437099+0000","last_fullsized":"2023-12-16T03:25:16.437099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:59.239833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436366+0000","last_change":"2023-12-16T03:25:15.449537+0000","last_active":"2023-12-16T03:25:16.436366+0000","last_peered":"2023-12-16T03:25:16.436366+0000","last_clean":"2023-12-16T03:25:16.436366+0000","last_became_active":"2023-12-16T03:25:15.449070+0000","last_became_peered":"2023-12-16T03:25:15.449070+0000","last_unstale":"2023-12-16T03:25:16.436366+0000","last_undegraded":"2023-12-16T03:25:16.436366+0000","last_fullsized":"2023-12-16T03:25:16.436366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436601+0000","last_change":"2023-12-16T03:25:15.432034+0000","last_active":"2023-12-16T03:25:16.436601+0000","last_peered":"2023-12-16T03:25:16.436601+0000","last_clean":"2023-12-16T03:25:16.436601+0000","last_became_active":"2023-12-16T03:25:15.431749+0000","last_became_peered":"2023-12-16T03:25:15.431749+0000","last_unstale":"2023-12-16T03:25:16.436601+0000","last_undegraded":"2023-12-16T03:25:16.436601+0000","last_fullsized":"2023-12-16T03:25:16.436601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:37:00.957991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423015+0000","last_change":"2023-12-16T03:25:15.444757+0000","last_active":"2023-12-16T03:25:16.423015+0000","last_peered":"2023-12-16T03:25:16.423015+0000","last_clean":"2023-12-16T03:25:16.423015+0000","last_became_active":"2023-12-16T03:25:15.443767+0000","last_became_peered":"2023-12-16T03:25:15.443767+0000","last_unstale":"2023-12-16T03:25:16.423015+0000","last_undegraded":"2023-12-16T03:25:16.423015+0000","last_fullsized":"2023-12-16T03:25:16.423015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436894+0000","last_change":"2023-12-16T03:25:15.442263+0000","last_active":"2023-12-16T03:25:16.436894+0000","last_peered":"2023-12-16T03:25:16.436894+0000","last_clean":"2023-12-16T03:25:16.436894+0000","last_became_active":"2023-12-16T03:25:15.441740+0000","last_became_peered":"2023-12-16T03:25:15.441740+0000","last_unstale":"2023-12-16T03:25:16.436894+0000","last_undegraded":"2023-12-16T03:25:16.436894+0000","last_fullsized":"2023-12-16T03:25:16.436894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422740+0000","last_change":"2023-12-16T03:25:15.433490+0000","last_active":"2023-12-16T03:25:16.422740+0000","last_peered":"2023-12-16T03:25:16.422740+0000","last_clean":"2023-12-16T03:25:16.422740+0000","last_became_active":"2023-12-16T03:25:15.431932+0000","last_became_peered":"2023-12-16T03:25:15.431932+0000","last_unstale":"2023-12-16T03:25:16.422740+0000","last_undegraded":"2023-12-16T03:25:16.422740+0000","last_fullsized":"2023-12-16T03:25:16.422740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437338+0000","last_change":"2023-12-16T03:25:15.450545+0000","last_active":"2023-12-16T03:25:16.437338+0000","last_peered":"2023-12-16T03:25:16.437338+0000","last_clean":"2023-12-16T03:25:16.437338+0000","last_became_active":"2023-12-16T03:25:15.450331+0000","last_became_peered":"2023-12-16T03:25:15.450331+0000","last_unstale":"2023-12-16T03:25:16.437338+0000","last_undegraded":"2023-12-16T03:25:16.437338+0000","last_fullsized":"2023-12-16T03:25:16.437338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436987+0000","last_change":"2023-12-16T03:25:15.439606+0000","last_active":"2023-12-16T03:25:16.436987+0000","last_peered":"2023-12-16T03:25:16.436987+0000","last_clean":"2023-12-16T03:25:16.436987+0000","last_became_active":"2023-12-16T03:25:15.439192+0000","last_became_peered":"2023-12-16T03:25:15.439192+0000","last_unstale":"2023-12-16T03:25:16.436987+0000","last_undegraded":"2023-12-16T03:25:16.436987+0000","last_fullsized":"2023-12-16T03:25:16.436987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420282+0000","last_change":"2023-12-16T03:25:15.432802+0000","last_active":"2023-12-16T03:25:16.420282+0000","last_peered":"2023-12-16T03:25:16.420282+0000","last_clean":"2023-12-16T03:25:16.420282+0000","last_became_active":"2023-12-16T03:25:15.432545+0000","last_became_peered":"2023-12-16T03:25:15.432545+0000","last_unstale":"2023-12-16T03:25:16.420282+0000","last_undegraded":"2023-12-16T03:25:16.420282+0000","last_fullsized":"2023-12-16T03:25:16.420282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437287+0000","last_change":"2023-12-16T03:25:15.441487+0000","last_active":"2023-12-16T03:25:16.437287+0000","last_peered":"2023-12-16T03:25:16.437287+0000","last_clean":"2023-12-16T03:25:16.437287+0000","last_became_active":"2023-12-16T03:25:15.441150+0000","last_became_peered":"2023-12-16T03:25:15.441150+0000","last_unstale":"2023-12-16T03:25:16.437287+0000","last_undegraded":"2023-12-16T03:25:16.437287+0000","last_fullsized":"2023-12-16T03:25:16.437287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436778+0000","last_change":"2023-12-16T03:25:15.427812+0000","last_active":"2023-12-16T03:25:16.436778+0000","last_peered":"2023-12-16T03:25:16.436778+0000","last_clean":"2023-12-16T03:25:16.436778+0000","last_became_active":"2023-12-16T03:25:15.427532+0000","last_became_peered":"2023-12-16T03:25:15.427532+0000","last_unstale":"2023-12-16T03:25:16.436778+0000","last_undegraded":"2023-12-16T03:25:16.436778+0000","last_fullsized":"2023-12-16T03:25:16.436778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423136+0000","last_change":"2023-12-16T03:25:15.431187+0000","last_active":"2023-12-16T03:25:16.423136+0000","last_peered":"2023-12-16T03:25:16.423136+0000","last_clean":"2023-12-16T03:25:16.423136+0000","last_became_active":"2023-12-16T03:25:15.430884+0000","last_became_peered":"2023-12-16T03:25:15.430884+0000","last_unstale":"2023-12-16T03:25:16.423136+0000","last_undegraded":"2023-12-16T03:25:16.423136+0000","last_fullsized":"2023-12-16T03:25:16.423136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436280+0000","last_change":"2023-12-16T03:25:15.432854+0000","last_active":"2023-12-16T03:25:16.436280+0000","last_peered":"2023-12-16T03:25:16.436280+0000","last_clean":"2023-12-16T03:25:16.436280+0000","last_became_active":"2023-12-16T03:25:15.432566+0000","last_became_peered":"2023-12-16T03:25:15.432566+0000","last_unstale":"2023-12-16T03:25:16.436280+0000","last_undegraded":"2023-12-16T03:25:16.436280+0000","last_fullsized":"2023-12-16T03:25:16.436280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:39.322218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436057+0000","last_change":"2023-12-16T03:25:15.430509+0000","last_active":"2023-12-16T03:25:16.436057+0000","last_peered":"2023-12-16T03:25:16.436057+0000","last_clean":"2023-12-16T03:25:16.436057+0000","last_became_active":"2023-12-16T03:25:15.430160+0000","last_became_peered":"2023-12-16T03:25:15.430160+0000","last_unstale":"2023-12-16T03:25:16.436057+0000","last_undegraded":"2023-12-16T03:25:16.436057+0000","last_fullsized":"2023-12-16T03:25:16.436057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422522+0000","last_change":"2023-12-16T03:25:15.441852+0000","last_active":"2023-12-16T03:25:16.422522+0000","last_peered":"2023-12-16T03:25:16.422522+0000","last_clean":"2023-12-16T03:25:16.422522+0000","last_became_active":"2023-12-16T03:25:15.441128+0000","last_became_peered":"2023-12-16T03:25:15.441128+0000","last_unstale":"2023-12-16T03:25:16.422522+0000","last_undegraded":"2023-12-16T03:25:16.422522+0000","last_fullsized":"2023-12-16T03:25:16.422522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:37.465934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437593+0000","last_change":"2023-12-16T03:25:14.944628+0000","last_active":"2023-12-16T03:25:16.437593+0000","last_peered":"2023-12-16T03:25:16.437593+0000","last_clean":"2023-12-16T03:25:16.437593+0000","last_became_active":"2023-12-16T03:25:14.944278+0000","last_became_peered":"2023-12-16T03:25:14.944278+0000","last_unstale":"2023-12-16T03:25:16.437593+0000","last_undegraded":"2023-12-16T03:25:16.437593+0000","last_fullsized":"2023-12-16T03:25:16.437593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436947+0000","last_change":"2023-12-16T03:25:15.438299+0000","last_active":"2023-12-16T03:25:16.436947+0000","last_peered":"2023-12-16T03:25:16.436947+0000","last_clean":"2023-12-16T03:25:16.436947+0000","last_became_active":"2023-12-16T03:25:15.437923+0000","last_became_peered":"2023-12-16T03:25:15.437923+0000","last_unstale":"2023-12-16T03:25:16.436947+0000","last_undegraded":"2023-12-16T03:25:16.436947+0000","last_fullsized":"2023-12-16T03:25:16.436947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436200+0000","last_change":"2023-12-16T03:25:14.952619+0000","last_active":"2023-12-16T03:25:16.436200+0000","last_peered":"2023-12-16T03:25:16.436200+0000","last_clean":"2023-12-16T03:25:16.436200+0000","last_became_active":"2023-12-16T03:25:14.951351+0000","last_became_peered":"2023-12-16T03:25:14.951351+0000","last_unstale":"2023-12-16T03:25:16.436200+0000","last_undegraded":"2023-12-16T03:25:16.436200+0000","last_fullsized":"2023-12-16T03:25:16.436200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437048+0000","last_change":"2023-12-16T03:25:14.939694+0000","last_active":"2023-12-16T03:25:16.437048+0000","last_peered":"2023-12-16T03:25:16.437048+0000","last_clean":"2023-12-16T03:25:16.437048+0000","last_became_active":"2023-12-16T03:25:14.939359+0000","last_became_peered":"2023-12-16T03:25:14.939359+0000","last_unstale":"2023-12-16T03:25:16.437048+0000","last_undegraded":"2023-12-16T03:25:16.437048+0000","last_fullsized":"2023-12-16T03:25:16.437048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436550+0000","last_change":"2023-12-16T03:25:15.426946+0000","last_active":"2023-12-16T03:25:16.436550+0000","last_peered":"2023-12-16T03:25:16.436550+0000","last_clean":"2023-12-16T03:25:16.436550+0000","last_became_active":"2023-12-16T03:25:15.426548+0000","last_became_peered":"2023-12-16T03:25:15.426548+0000","last_unstale":"2023-12-16T03:25:16.436550+0000","last_undegraded":"2023-12-16T03:25:16.436550+0000","last_fullsized":"2023-12-16T03:25:16.436550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422798+0000","last_change":"2023-12-16T03:25:14.942071+0000","last_active":"2023-12-16T03:25:16.422798+0000","last_peered":"2023-12-16T03:25:16.422798+0000","last_clean":"2023-12-16T03:25:16.422798+0000","last_became_active":"2023-12-16T03:25:14.941786+0000","last_became_peered":"2023-12-16T03:25:14.941786+0000","last_unstale":"2023-12-16T03:25:16.422798+0000","last_undegraded":"2023-12-16T03:25:16.422798+0000","last_fullsized":"2023-12-16T03:25:16.422798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:34.131498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420100+0000","last_change":"2023-12-16T03:25:15.429804+0000","last_active":"2023-12-16T03:25:16.420100+0000","last_peered":"2023-12-16T03:25:16.420100+0000","last_clean":"2023-12-16T03:25:16.420100+0000","last_became_active":"2023-12-16T03:25:15.429063+0000","last_became_peered":"2023-12-16T03:25:15.429063+0000","last_unstale":"2023-12-16T03:25:16.420100+0000","last_undegraded":"2023-12-16T03:25:16.420100+0000","last_fullsized":"2023-12-16T03:25:16.420100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437091+0000","last_change":"2023-12-16T03:25:14.946494+0000","last_active":"2023-12-16T03:25:16.437091+0000","last_peered":"2023-12-16T03:25:16.437091+0000","last_clean":"2023-12-16T03:25:16.437091+0000","last_became_active":"2023-12-16T03:25:14.946193+0000","last_became_peered":"2023-12-16T03:25:14.946193+0000","last_unstale":"2023-12-16T03:25:16.437091+0000","last_undegraded":"2023-12-16T03:25:16.437091+0000","last_fullsized":"2023-12-16T03:25:16.437091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423512+0000","last_change":"2023-12-16T03:25:15.444625+0000","last_active":"2023-12-16T03:25:16.423512+0000","last_peered":"2023-12-16T03:25:16.423512+0000","last_clean":"2023-12-16T03:25:16.423512+0000","last_became_active":"2023-12-16T03:25:15.444322+0000","last_became_peered":"2023-12-16T03:25:15.444322+0000","last_unstale":"2023-12-16T03:25:16.423512+0000","last_undegraded":"2023-12-16T03:25:16.423512+0000","last_fullsized":"2023-12-16T03:25:16.423512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:07.831312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423548+0000","last_change":"2023-12-16T03:25:14.943434+0000","last_active":"2023-12-16T03:25:16.423548+0000","last_peered":"2023-12-16T03:25:16.423548+0000","last_clean":"2023-12-16T03:25:16.423548+0000","last_became_active":"2023-12-16T03:25:14.942914+0000","last_became_peered":"2023-12-16T03:25:14.942914+0000","last_unstale":"2023-12-16T03:25:16.423548+0000","last_undegraded":"2023-12-16T03:25:16.423548+0000","last_fullsized":"2023-12-16T03:25:16.423548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437746+0000","last_change":"2023-12-16T03:25:15.433507+0000","last_active":"2023-12-16T03:25:16.437746+0000","last_peered":"2023-12-16T03:25:16.437746+0000","last_clean":"2023-12-16T03:25:16.437746+0000","last_became_active":"2023-12-16T03:25:15.433228+0000","last_became_peered":"2023-12-16T03:25:15.433228+0000","last_unstale":"2023-12-16T03:25:16.437746+0000","last_undegraded":"2023-12-16T03:25:16.437746+0000","last_fullsized":"2023-12-16T03:25:16.437746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420270+0000","last_change":"2023-12-16T03:25:14.948029+0000","last_active":"2023-12-16T03:25:16.420270+0000","last_peered":"2023-12-16T03:25:16.420270+0000","last_clean":"2023-12-16T03:25:16.420270+0000","last_became_active":"2023-12-16T03:25:14.947608+0000","last_became_peered":"2023-12-16T03:25:14.947608+0000","last_unstale":"2023-12-16T03:25:16.420270+0000","last_undegraded":"2023-12-16T03:25:16.420270+0000","last_fullsized":"2023-12-16T03:25:16.420270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422868+0000","last_change":"2023-12-16T03:25:15.448886+0000","last_active":"2023-12-16T03:25:16.422868+0000","last_peered":"2023-12-16T03:25:16.422868+0000","last_clean":"2023-12-16T03:25:16.422868+0000","last_became_active":"2023-12-16T03:25:15.448576+0000","last_became_peered":"2023-12-16T03:25:15.448576+0000","last_unstale":"2023-12-16T03:25:16.422868+0000","last_undegraded":"2023-12-16T03:25:16.422868+0000","last_fullsized":"2023-12-16T03:25:16.422868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:39.322218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436460+0000","last_change":"2023-12-16T03:25:14.938057+0000","last_active":"2023-12-16T03:25:16.436460+0000","last_peered":"2023-12-16T03:25:16.436460+0000","last_clean":"2023-12-16T03:25:16.436460+0000","last_became_active":"2023-12-16T03:25:14.937091+0000","last_became_peered":"2023-12-16T03:25:14.937091+0000","last_unstale":"2023-12-16T03:25:16.436460+0000","last_undegraded":"2023-12-16T03:25:16.436460+0000","last_fullsized":"2023-12-16T03:25:16.436460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436738+0000","last_change":"2023-12-16T03:25:15.444073+0000","last_active":"2023-12-16T03:25:16.436738+0000","last_peered":"2023-12-16T03:25:16.436738+0000","last_clean":"2023-12-16T03:25:16.436738+0000","last_became_active":"2023-12-16T03:25:15.443746+0000","last_became_peered":"2023-12-16T03:25:15.443746+0000","last_unstale":"2023-12-16T03:25:16.436738+0000","last_undegraded":"2023-12-16T03:25:16.436738+0000","last_fullsized":"2023-12-16T03:25:16.436738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:20:54.316492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437145+0000","last_change":"2023-12-16T03:25:14.945151+0000","last_active":"2023-12-16T03:25:16.437145+0000","last_peered":"2023-12-16T03:25:16.437145+0000","last_clean":"2023-12-16T03:25:16.437145+0000","last_became_active":"2023-12-16T03:25:14.937913+0000","last_became_peered":"2023-12-16T03:25:14.937913+0000","last_unstale":"2023-12-16T03:25:16.437145+0000","last_undegraded":"2023-12-16T03:25:16.437145+0000","last_fullsized":"2023-12-16T03:25:16.437145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:36.459150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436602+0000","last_change":"2023-12-16T03:25:15.443554+0000","last_active":"2023-12-16T03:25:16.436602+0000","last_peered":"2023-12-16T03:25:16.436602+0000","last_clean":"2023-12-16T03:25:16.436602+0000","last_became_active":"2023-12-16T03:25:15.443275+0000","last_became_peered":"2023-12-16T03:25:15.443275+0000","last_unstale":"2023-12-16T03:25:16.436602+0000","last_undegraded":"2023-12-16T03:25:16.436602+0000","last_fullsized":"2023-12-16T03:25:16.436602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423115+0000","last_change":"2023-12-16T03:25:14.948755+0000","last_active":"2023-12-16T03:25:16.423115+0000","last_peered":"2023-12-16T03:25:16.423115+0000","last_clean":"2023-12-16T03:25:16.423115+0000","last_became_active":"2023-12-16T03:25:14.948399+0000","last_became_peered":"2023-12-16T03:25:14.948399+0000","last_unstale":"2023-12-16T03:25:16.423115+0000","last_undegraded":"2023-12-16T03:25:16.423115+0000","last_fullsized":"2023-12-16T03:25:16.423115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436672+0000","last_change":"2023-12-16T03:25:15.454032+0000","last_active":"2023-12-16T03:25:16.436672+0000","last_peered":"2023-12-16T03:25:16.436672+0000","last_clean":"2023-12-16T03:25:16.436672+0000","last_became_active":"2023-12-16T03:25:15.453722+0000","last_became_peered":"2023-12-16T03:25:15.453722+0000","last_unstale":"2023-12-16T03:25:16.436672+0000","last_undegraded":"2023-12-16T03:25:16.436672+0000","last_fullsized":"2023-12-16T03:25:16.436672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:07.831312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436040+0000","last_change":"2023-12-16T03:25:14.938917+0000","last_active":"2023-12-16T03:25:16.436040+0000","last_peered":"2023-12-16T03:25:16.436040+0000","last_clean":"2023-12-16T03:25:16.436040+0000","last_became_active":"2023-12-16T03:25:14.938389+0000","last_became_peered":"2023-12-16T03:25:14.938389+0000","last_unstale":"2023-12-16T03:25:16.436040+0000","last_undegraded":"2023-12-16T03:25:16.436040+0000","last_fullsized":"2023-12-16T03:25:16.436040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436799+0000","last_change":"2023-12-16T03:25:15.431222+0000","last_active":"2023-12-16T03:25:16.436799+0000","last_peered":"2023-12-16T03:25:16.436799+0000","last_clean":"2023-12-16T03:25:16.436799+0000","last_became_active":"2023-12-16T03:25:15.430884+0000","last_became_peered":"2023-12-16T03:25:15.430884+0000","last_unstale":"2023-12-16T03:25:16.436799+0000","last_undegraded":"2023-12-16T03:25:16.436799+0000","last_fullsized":"2023-12-16T03:25:16.436799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436272+0000","last_change":"2023-12-16T03:25:14.937196+0000","last_active":"2023-12-16T03:25:16.436272+0000","last_peered":"2023-12-16T03:25:16.436272+0000","last_clean":"2023-12-16T03:25:16.436272+0000","last_became_active":"2023-12-16T03:25:14.935102+0000","last_became_peered":"2023-12-16T03:25:14.935102+0000","last_unstale":"2023-12-16T03:25:16.436272+0000","last_undegraded":"2023-12-16T03:25:16.436272+0000","last_fullsized":"2023-12-16T03:25:16.436272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:39:22.295470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436578+0000","last_change":"2023-12-16T03:25:15.455089+0000","last_active":"2023-12-16T03:25:16.436578+0000","last_peered":"2023-12-16T03:25:16.436578+0000","last_clean":"2023-12-16T03:25:16.436578+0000","last_became_active":"2023-12-16T03:25:15.454725+0000","last_became_peered":"2023-12-16T03:25:15.454725+0000","last_unstale":"2023-12-16T03:25:16.436578+0000","last_undegraded":"2023-12-16T03:25:16.436578+0000","last_fullsized":"2023-12-16T03:25:16.436578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:29.020229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422895+0000","last_change":"2023-12-16T03:25:14.941188+0000","last_active":"2023-12-16T03:25:16.422895+0000","last_peered":"2023-12-16T03:25:16.422895+0000","last_clean":"2023-12-16T03:25:16.422895+0000","last_became_active":"2023-12-16T03:25:14.940811+0000","last_became_peered":"2023-12-16T03:25:14.940811+0000","last_unstale":"2023-12-16T03:25:16.422895+0000","last_undegraded":"2023-12-16T03:25:16.422895+0000","last_fullsized":"2023-12-16T03:25:16.422895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:08.626152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436563+0000","last_change":"2023-12-16T03:25:15.452042+0000","last_active":"2023-12-16T03:25:16.436563+0000","last_peered":"2023-12-16T03:25:16.436563+0000","last_clean":"2023-12-16T03:25:16.436563+0000","last_became_active":"2023-12-16T03:25:15.451737+0000","last_became_peered":"2023-12-16T03:25:15.451737+0000","last_unstale":"2023-12-16T03:25:16.436563+0000","last_undegraded":"2023-12-16T03:25:16.436563+0000","last_fullsized":"2023-12-16T03:25:16.436563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437165+0000","last_change":"2023-12-16T03:25:14.938664+0000","last_active":"2023-12-16T03:25:16.437165+0000","last_peered":"2023-12-16T03:25:16.437165+0000","last_clean":"2023-12-16T03:25:16.437165+0000","last_became_active":"2023-12-16T03:25:14.938324+0000","last_became_peered":"2023-12-16T03:25:14.938324+0000","last_unstale":"2023-12-16T03:25:16.437165+0000","last_undegraded":"2023-12-16T03:25:16.437165+0000","last_fullsized":"2023-12-16T03:25:16.437165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:36.459150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437416+0000","last_change":"2023-12-16T03:25:15.455016+0000","last_active":"2023-12-16T03:25:16.437416+0000","last_peered":"2023-12-16T03:25:16.437416+0000","last_clean":"2023-12-16T03:25:16.437416+0000","last_became_active":"2023-12-16T03:25:15.454715+0000","last_became_peered":"2023-12-16T03:25:15.454715+0000","last_unstale":"2023-12-16T03:25:16.437416+0000","last_undegraded":"2023-12-16T03:25:16.437416+0000","last_fullsized":"2023-12-16T03:25:16.437416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:02:53.965844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420363+0000","last_change":"2023-12-16T03:25:14.942353+0000","last_active":"2023-12-16T03:25:16.420363+0000","last_peered":"2023-12-16T03:25:16.420363+0000","last_clean":"2023-12-16T03:25:16.420363+0000","last_became_active":"2023-12-16T03:25:14.942088+0000","last_became_peered":"2023-12-16T03:25:14.942088+0000","last_unstale":"2023-12-16T03:25:16.420363+0000","last_undegraded":"2023-12-16T03:25:16.420363+0000","last_fullsized":"2023-12-16T03:25:16.420363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:36:59.951207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423137+0000","last_change":"2023-12-16T03:25:15.433902+0000","last_active":"2023-12-16T03:25:16.423137+0000","last_peered":"2023-12-16T03:25:16.423137+0000","last_clean":"2023-12-16T03:25:16.423137+0000","last_became_active":"2023-12-16T03:25:15.432579+0000","last_became_peered":"2023-12-16T03:25:15.432579+0000","last_unstale":"2023-12-16T03:25:16.423137+0000","last_undegraded":"2023-12-16T03:25:16.423137+0000","last_fullsized":"2023-12-16T03:25:16.423137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:29.020229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436825+0000","last_change":"2023-12-16T03:25:14.949089+0000","last_active":"2023-12-16T03:25:16.436825+0000","last_peered":"2023-12-16T03:25:16.436825+0000","last_clean":"2023-12-16T03:25:16.436825+0000","last_became_active":"2023-12-16T03:25:14.948668+0000","last_became_peered":"2023-12-16T03:25:14.948668+0000","last_unstale":"2023-12-16T03:25:16.436825+0000","last_undegraded":"2023-12-16T03:25:16.436825+0000","last_fullsized":"2023-12-16T03:25:16.436825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:06.962968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436870+0000","last_change":"2023-12-16T03:25:15.445232+0000","last_active":"2023-12-16T03:25:16.436870+0000","last_peered":"2023-12-16T03:25:16.436870+0000","last_clean":"2023-12-16T03:25:16.436870+0000","last_became_active":"2023-12-16T03:25:15.444929+0000","last_became_peered":"2023-12-16T03:25:15.444929+0000","last_unstale":"2023-12-16T03:25:16.436870+0000","last_undegraded":"2023-12-16T03:25:16.436870+0000","last_fullsized":"2023-12-16T03:25:16.436870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:00.341013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-16T03:25:15.435898+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:25:15.435898+0000","last_peered":"2023-12-16T03:25:15.435898+0000","last_clean":"2023-12-16T03:25:15.435898+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:25:15.435898+0000","last_undegraded":"2023-12-16T03:25:15.435898+0000","last_fullsized":"2023-12-16T03:25:15.435898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423217+0000","last_change":"2023-12-16T03:25:14.941508+0000","last_active":"2023-12-16T03:25:16.423217+0000","last_peered":"2023-12-16T03:25:16.423217+0000","last_clean":"2023-12-16T03:25:16.423217+0000","last_became_active":"2023-12-16T03:25:14.941128+0000","last_became_peered":"2023-12-16T03:25:14.941128+0000","last_unstale":"2023-12-16T03:25:16.423217+0000","last_undegraded":"2023-12-16T03:25:16.423217+0000","last_fullsized":"2023-12-16T03:25:16.423217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:34.241901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437288+0000","last_change":"2023-12-16T03:25:15.433356+0000","last_active":"2023-12-16T03:25:16.437288+0000","last_peered":"2023-12-16T03:25:16.437288+0000","last_clean":"2023-12-16T03:25:16.437288+0000","last_became_active":"2023-12-16T03:25:15.433010+0000","last_became_peered":"2023-12-16T03:25:15.433010+0000","last_unstale":"2023-12-16T03:25:16.437288+0000","last_undegraded":"2023-12-16T03:25:16.437288+0000","last_fullsized":"2023-12-16T03:25:16.437288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436448+0000","last_change":"2023-12-16T03:25:14.951710+0000","last_active":"2023-12-16T03:25:16.436448+0000","last_peered":"2023-12-16T03:25:16.436448+0000","last_clean":"2023-12-16T03:25:16.436448+0000","last_became_active":"2023-12-16T03:25:14.951249+0000","last_became_peered":"2023-12-16T03:25:14.951249+0000","last_unstale":"2023-12-16T03:25:16.436448+0000","last_undegraded":"2023-12-16T03:25:16.436448+0000","last_fullsized":"2023-12-16T03:25:16.436448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:20.924714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436461+0000","last_change":"2023-12-16T03:25:15.449196+0000","last_active":"2023-12-16T03:25:16.436461+0000","last_peered":"2023-12-16T03:25:16.436461+0000","last_clean":"2023-12-16T03:25:16.436461+0000","last_became_active":"2023-12-16T03:25:15.448896+0000","last_became_peered":"2023-12-16T03:25:15.448896+0000","last_unstale":"2023-12-16T03:25:16.436461+0000","last_undegraded":"2023-12-16T03:25:16.436461+0000","last_fullsized":"2023-12-16T03:25:16.436461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:06.946403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436387+0000","last_change":"2023-12-16T03:25:14.931491+0000","last_active":"2023-12-16T03:25:16.436387+0000","last_peered":"2023-12-16T03:25:16.436387+0000","last_clean":"2023-12-16T03:25:16.436387+0000","last_became_active":"2023-12-16T03:25:14.931114+0000","last_became_peered":"2023-12-16T03:25:14.931114+0000","last_unstale":"2023-12-16T03:25:16.436387+0000","last_undegraded":"2023-12-16T03:25:16.436387+0000","last_fullsized":"2023-12-16T03:25:16.436387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:34.241901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420119+0000","last_change":"2023-12-16T03:25:15.428698+0000","last_active":"2023-12-16T03:25:16.420119+0000","last_peered":"2023-12-16T03:25:16.420119+0000","last_clean":"2023-12-16T03:25:16.420119+0000","last_became_active":"2023-12-16T03:25:15.424710+0000","last_became_peered":"2023-12-16T03:25:15.424710+0000","last_unstale":"2023-12-16T03:25:16.420119+0000","last_undegraded":"2023-12-16T03:25:16.420119+0000","last_fullsized":"2023-12-16T03:25:16.420119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423180+0000","last_change":"2023-12-16T03:25:14.942839+0000","last_active":"2023-12-16T03:25:16.423180+0000","last_peered":"2023-12-16T03:25:16.423180+0000","last_clean":"2023-12-16T03:25:16.423180+0000","last_became_active":"2023-12-16T03:25:14.942596+0000","last_became_peered":"2023-12-16T03:25:14.942596+0000","last_unstale":"2023-12-16T03:25:16.423180+0000","last_undegraded":"2023-12-16T03:25:16.423180+0000","last_fullsized":"2023-12-16T03:25:16.423180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:36:59.951207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423043+0000","last_change":"2023-12-16T03:25:15.437137+0000","last_active":"2023-12-16T03:25:16.423043+0000","last_peered":"2023-12-16T03:25:16.423043+0000","last_clean":"2023-12-16T03:25:16.423043+0000","last_became_active":"2023-12-16T03:25:15.436800+0000","last_became_peered":"2023-12-16T03:25:15.436800+0000","last_unstale":"2023-12-16T03:25:16.423043+0000","last_undegraded":"2023-12-16T03:25:16.423043+0000","last_fullsized":"2023-12-16T03:25:16.423043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:07.619534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420344+0000","last_change":"2023-12-16T03:25:14.937971+0000","last_active":"2023-12-16T03:25:16.420344+0000","last_peered":"2023-12-16T03:25:16.420344+0000","last_clean":"2023-12-16T03:25:16.420344+0000","last_became_active":"2023-12-16T03:25:14.937684+0000","last_became_peered":"2023-12-16T03:25:14.937684+0000","last_unstale":"2023-12-16T03:25:16.420344+0000","last_undegraded":"2023-12-16T03:25:16.420344+0000","last_fullsized":"2023-12-16T03:25:16.420344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423696+0000","last_change":"2023-12-16T03:25:15.433590+0000","last_active":"2023-12-16T03:25:16.423696+0000","last_peered":"2023-12-16T03:25:16.423696+0000","last_clean":"2023-12-16T03:25:16.423696+0000","last_became_active":"2023-12-16T03:25:15.433276+0000","last_became_peered":"2023-12-16T03:25:15.433276+0000","last_unstale":"2023-12-16T03:25:16.423696+0000","last_undegraded":"2023-12-16T03:25:16.423696+0000","last_fullsized":"2023-12-16T03:25:16.423696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:59.239833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437138+0000","last_change":"2023-12-16T03:25:14.953294+0000","last_active":"2023-12-16T03:25:16.437138+0000","last_peered":"2023-12-16T03:25:16.437138+0000","last_clean":"2023-12-16T03:25:16.437138+0000","last_became_active":"2023-12-16T03:25:14.952984+0000","last_became_peered":"2023-12-16T03:25:14.952984+0000","last_unstale":"2023-12-16T03:25:16.437138+0000","last_undegraded":"2023-12-16T03:25:16.437138+0000","last_fullsized":"2023-12-16T03:25:16.437138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:24.531152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420255+0000","last_change":"2023-12-16T03:25:15.429623+0000","last_active":"2023-12-16T03:25:16.420255+0000","last_peered":"2023-12-16T03:25:16.420255+0000","last_clean":"2023-12-16T03:25:16.420255+0000","last_became_active":"2023-12-16T03:25:15.428854+0000","last_became_peered":"2023-12-16T03:25:15.428854+0000","last_unstale":"2023-12-16T03:25:16.420255+0000","last_undegraded":"2023-12-16T03:25:16.420255+0000","last_fullsized":"2023-12-16T03:25:16.420255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:17.818096+0000","last_change":"2023-12-16T03:25:14.939501+0000","last_active":"2023-12-16T03:25:17.818096+0000","last_peered":"2023-12-16T03:25:17.818096+0000","last_clean":"2023-12-16T03:25:17.818096+0000","last_became_active":"2023-12-16T03:25:14.939114+0000","last_became_peered":"2023-12-16T03:25:14.939114+0000","last_unstale":"2023-12-16T03:25:17.818096+0000","last_undegraded":"2023-12-16T03:25:17.818096+0000","last_fullsized":"2023-12-16T03:25:17.818096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437431+0000","last_change":"2023-12-16T03:25:15.448503+0000","last_active":"2023-12-16T03:25:16.437431+0000","last_peered":"2023-12-16T03:25:16.437431+0000","last_clean":"2023-12-16T03:25:16.437431+0000","last_became_active":"2023-12-16T03:25:15.448186+0000","last_became_peered":"2023-12-16T03:25:15.448186+0000","last_unstale":"2023-12-16T03:25:16.437431+0000","last_undegraded":"2023-12-16T03:25:16.437431+0000","last_fullsized":"2023-12-16T03:25:16.437431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:55.217497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437182+0000","last_change":"2023-12-16T03:25:14.939279+0000","last_active":"2023-12-16T03:25:16.437182+0000","last_peered":"2023-12-16T03:25:16.437182+0000","last_clean":"2023-12-16T03:25:16.437182+0000","last_became_active":"2023-12-16T03:25:14.938540+0000","last_became_peered":"2023-12-16T03:25:14.938540+0000","last_unstale":"2023-12-16T03:25:16.437182+0000","last_undegraded":"2023-12-16T03:25:16.437182+0000","last_fullsized":"2023-12-16T03:25:16.437182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437699+0000","last_change":"2023-12-16T03:25:15.427756+0000","last_active":"2023-12-16T03:25:16.437699+0000","last_peered":"2023-12-16T03:25:16.437699+0000","last_clean":"2023-12-16T03:25:16.437699+0000","last_became_active":"2023-12-16T03:25:15.427401+0000","last_became_peered":"2023-12-16T03:25:15.427401+0000","last_unstale":"2023-12-16T03:25:16.437699+0000","last_undegraded":"2023-12-16T03:25:16.437699+0000","last_fullsized":"2023-12-16T03:25:16.437699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436329+0000","last_change":"2023-12-16T03:25:14.947007+0000","last_active":"2023-12-16T03:25:16.436329+0000","last_peered":"2023-12-16T03:25:16.436329+0000","last_clean":"2023-12-16T03:25:16.436329+0000","last_became_active":"2023-12-16T03:25:14.946763+0000","last_became_peered":"2023-12-16T03:25:14.946763+0000","last_unstale":"2023-12-16T03:25:16.436329+0000","last_undegraded":"2023-12-16T03:25:16.436329+0000","last_fullsized":"2023-12-16T03:25:16.436329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:06.962968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422510+0000","last_change":"2023-12-16T03:25:15.439566+0000","last_active":"2023-12-16T03:25:16.422510+0000","last_peered":"2023-12-16T03:25:16.422510+0000","last_clean":"2023-12-16T03:25:16.422510+0000","last_became_active":"2023-12-16T03:25:15.437769+0000","last_became_peered":"2023-12-16T03:25:15.437769+0000","last_unstale":"2023-12-16T03:25:16.422510+0000","last_undegraded":"2023-12-16T03:25:16.422510+0000","last_fullsized":"2023-12-16T03:25:16.422510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:07.969752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420174+0000","last_change":"2023-12-16T03:25:14.946813+0000","last_active":"2023-12-16T03:25:16.420174+0000","last_peered":"2023-12-16T03:25:16.420174+0000","last_clean":"2023-12-16T03:25:16.420174+0000","last_became_active":"2023-12-16T03:25:14.945910+0000","last_became_peered":"2023-12-16T03:25:14.945910+0000","last_unstale":"2023-12-16T03:25:16.420174+0000","last_undegraded":"2023-12-16T03:25:16.420174+0000","last_fullsized":"2023-12-16T03:25:16.420174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436674+0000","last_change":"2023-12-16T03:25:15.429536+0000","last_active":"2023-12-16T03:25:16.436674+0000","last_peered":"2023-12-16T03:25:16.436674+0000","last_clean":"2023-12-16T03:25:16.436674+0000","last_became_active":"2023-12-16T03:25:15.429171+0000","last_became_peered":"2023-12-16T03:25:15.429171+0000","last_unstale":"2023-12-16T03:25:16.436674+0000","last_undegraded":"2023-12-16T03:25:16.436674+0000","last_fullsized":"2023-12-16T03:25:16.436674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420262+0000","last_change":"2023-12-16T03:25:14.947177+0000","last_active":"2023-12-16T03:25:16.420262+0000","last_peered":"2023-12-16T03:25:16.420262+0000","last_clean":"2023-12-16T03:25:16.420262+0000","last_became_active":"2023-12-16T03:25:14.946894+0000","last_became_peered":"2023-12-16T03:25:14.946894+0000","last_unstale":"2023-12-16T03:25:16.420262+0000","last_undegraded":"2023-12-16T03:25:16.420262+0000","last_fullsized":"2023-12-16T03:25:16.420262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437502+0000","last_change":"2023-12-16T03:25:15.428105+0000","last_active":"2023-12-16T03:25:16.437502+0000","last_peered":"2023-12-16T03:25:16.437502+0000","last_clean":"2023-12-16T03:25:16.437502+0000","last_became_active":"2023-12-16T03:25:15.426561+0000","last_became_peered":"2023-12-16T03:25:15.426561+0000","last_unstale":"2023-12-16T03:25:16.437502+0000","last_undegraded":"2023-12-16T03:25:16.437502+0000","last_fullsized":"2023-12-16T03:25:16.437502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436841+0000","last_change":"2023-12-16T03:25:14.952976+0000","last_active":"2023-12-16T03:25:16.436841+0000","last_peered":"2023-12-16T03:25:16.436841+0000","last_clean":"2023-12-16T03:25:16.436841+0000","last_became_active":"2023-12-16T03:25:14.952639+0000","last_became_peered":"2023-12-16T03:25:14.952639+0000","last_unstale":"2023-12-16T03:25:16.436841+0000","last_undegraded":"2023-12-16T03:25:16.436841+0000","last_fullsized":"2023-12-16T03:25:16.436841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:34.131498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436490+0000","last_change":"2023-12-16T03:25:15.450361+0000","last_active":"2023-12-16T03:25:16.436490+0000","last_peered":"2023-12-16T03:25:16.436490+0000","last_clean":"2023-12-16T03:25:16.436490+0000","last_became_active":"2023-12-16T03:25:15.450027+0000","last_became_peered":"2023-12-16T03:25:15.450027+0000","last_unstale":"2023-12-16T03:25:16.436490+0000","last_undegraded":"2023-12-16T03:25:16.436490+0000","last_fullsized":"2023-12-16T03:25:16.436490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423578+0000","last_change":"2023-12-16T03:25:15.442370+0000","last_active":"2023-12-16T03:25:16.423578+0000","last_peered":"2023-12-16T03:25:16.423578+0000","last_clean":"2023-12-16T03:25:16.423578+0000","last_became_active":"2023-12-16T03:25:15.442003+0000","last_became_peered":"2023-12-16T03:25:15.442003+0000","last_unstale":"2023-12-16T03:25:16.423578+0000","last_undegraded":"2023-12-16T03:25:16.423578+0000","last_fullsized":"2023-12-16T03:25:16.423578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:20:54.316492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437042+0000","last_change":"2023-12-16T03:25:14.955054+0000","last_active":"2023-12-16T03:25:16.437042+0000","last_peered":"2023-12-16T03:25:16.437042+0000","last_clean":"2023-12-16T03:25:16.437042+0000","last_became_active":"2023-12-16T03:25:14.954769+0000","last_became_peered":"2023-12-16T03:25:14.954769+0000","last_unstale":"2023-12-16T03:25:16.437042+0000","last_undegraded":"2023-12-16T03:25:16.437042+0000","last_fullsized":"2023-12-16T03:25:16.437042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423008+0000","last_change":"2023-12-16T03:25:15.447590+0000","last_active":"2023-12-16T03:25:16.423008+0000","last_peered":"2023-12-16T03:25:16.423008+0000","last_clean":"2023-12-16T03:25:16.423008+0000","last_became_active":"2023-12-16T03:25:15.447289+0000","last_became_peered":"2023-12-16T03:25:15.447289+0000","last_unstale":"2023-12-16T03:25:16.423008+0000","last_undegraded":"2023-12-16T03:25:16.423008+0000","last_fullsized":"2023-12-16T03:25:16.423008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436960+0000","last_change":"2023-12-16T03:25:14.953280+0000","last_active":"2023-12-16T03:25:16.436960+0000","last_peered":"2023-12-16T03:25:16.436960+0000","last_clean":"2023-12-16T03:25:16.436960+0000","last_became_active":"2023-12-16T03:25:14.952971+0000","last_became_peered":"2023-12-16T03:25:14.952971+0000","last_unstale":"2023-12-16T03:25:16.436960+0000","last_undegraded":"2023-12-16T03:25:16.436960+0000","last_fullsized":"2023-12-16T03:25:16.436960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437747+0000","last_change":"2023-12-16T03:25:15.433498+0000","last_active":"2023-12-16T03:25:16.437747+0000","last_peered":"2023-12-16T03:25:16.437747+0000","last_clean":"2023-12-16T03:25:16.437747+0000","last_became_active":"2023-12-16T03:25:15.433191+0000","last_became_peered":"2023-12-16T03:25:15.433191+0000","last_unstale":"2023-12-16T03:25:16.437747+0000","last_undegraded":"2023-12-16T03:25:16.437747+0000","last_fullsized":"2023-12-16T03:25:16.437747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437453+0000","last_change":"2023-12-16T03:25:14.938585+0000","last_active":"2023-12-16T03:25:16.437453+0000","last_peered":"2023-12-16T03:25:16.437453+0000","last_clean":"2023-12-16T03:25:16.437453+0000","last_became_active":"2023-12-16T03:25:14.938292+0000","last_became_peered":"2023-12-16T03:25:14.938292+0000","last_unstale":"2023-12-16T03:25:16.437453+0000","last_undegraded":"2023-12-16T03:25:16.437453+0000","last_fullsized":"2023-12-16T03:25:16.437453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437584+0000","last_change":"2023-12-16T03:25:15.440625+0000","last_active":"2023-12-16T03:25:16.437584+0000","last_peered":"2023-12-16T03:25:16.437584+0000","last_clean":"2023-12-16T03:25:16.437584+0000","last_became_active":"2023-12-16T03:25:15.440302+0000","last_became_peered":"2023-12-16T03:25:15.440302+0000","last_unstale":"2023-12-16T03:25:16.437584+0000","last_undegraded":"2023-12-16T03:25:16.437584+0000","last_fullsized":"2023-12-16T03:25:16.437584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437844+0000","last_change":"2023-12-16T03:25:14.942593+0000","last_active":"2023-12-16T03:25:16.437844+0000","last_peered":"2023-12-16T03:25:16.437844+0000","last_clean":"2023-12-16T03:25:16.437844+0000","last_became_active":"2023-12-16T03:25:14.942331+0000","last_became_peered":"2023-12-16T03:25:14.942331+0000","last_unstale":"2023-12-16T03:25:16.437844+0000","last_undegraded":"2023-12-16T03:25:16.437844+0000","last_fullsized":"2023-12-16T03:25:16.437844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4990000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6870000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.194}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1689999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2759999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3479999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.4269999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6319999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5650000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7720000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0439999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8940000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3010000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1920000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3570000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:25:26.395 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:25:26.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.575+0000 7fe70fd57640 1 Processor -- start 2023-12-16T03:25:26.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.575+0000 7fe70fd57640 1 -- start start 2023-12-16T03:25:26.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.575+0000 7fe70fd57640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe7081560e0 0x7fe70815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.575+0000 7fe70fd57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7080bffc0 0x7fe7080c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.575+0000 7fe70fd57640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70815c600 con 0x7fe70806d520 2023-12-16T03:25:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.575+0000 7fe70fd57640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70815a5c0 con 0x7fe7081560e0 2023-12-16T03:25:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.575+0000 7fe70fd57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7081594e0 con 0x7fe7080bffc0 2023-12-16T03:25:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70d2f2640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe70806d520 0x7fe708159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57952/0 (socket says 172.21.15.28:57952) 2023-12-16T03:25:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70d2f2640 1 -- 172.21.15.28:0/2220454048 learned_addr learned my addr 172.21.15.28:0/2220454048 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70daf3640 1 --2- 172.21.15.28:0/2220454048 >> v2:172.21.15.134:3300/0 conn(0x7fe7081560e0 0x7fe70815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70e2f4640 1 --2- 172.21.15.28:0/2220454048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7080bffc0 0x7fe7080c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70caf1640 1 -- 172.21.15.28:0/2220454048 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138315508 0 0) 0x7fe70815c600 con 0x7fe70806d520 2023-12-16T03:25:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70caf1640 1 -- 172.21.15.28:0/2220454048 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f4003530 con 0x7fe70806d520 2023-12-16T03:25:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70e2f4640 1 -- 172.21.15.28:0/2220454048 >> v2:172.21.15.134:3300/0 conn(0x7fe7081560e0 msgr2=0x7fe70815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70e2f4640 1 --2- 172.21.15.28:0/2220454048 >> v2:172.21.15.134:3300/0 conn(0x7fe7081560e0 0x7fe70815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70e2f4640 1 -- 172.21.15.28:0/2220454048 >> v1:172.21.15.28:6789/0 conn(0x7fe70806d520 legacy=0x7fe708159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70e2f4640 1 -- 172.21.15.28:0/2220454048 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7081597c0 con 0x7fe7080bffc0 2023-12-16T03:25:26.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70e2f4640 1 --2- 172.21.15.28:0/2220454048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7080bffc0 0x7fe7080c1bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe700009d90 tx=0x7fe70001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33d92f6f200e3b91 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:26.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70caf1640 1 -- 172.21.15.28:0/2220454048 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000a58f0 con 0x7fe7080bffc0 2023-12-16T03:25:26.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.579+0000 7fe70caf1640 1 -- 172.21.15.28:0/2220454048 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7000a5a50 con 0x7fe7080bffc0 2023-12-16T03:25:26.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70caf1640 1 -- 172.21.15.28:0/2220454048 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000a5de0 con 0x7fe7080bffc0 2023-12-16T03:25:26.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 -- 172.21.15.28:0/2220454048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7080bffc0 msgr2=0x7fe7080c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 --2- 172.21.15.28:0/2220454048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7080bffc0 0x7fe7080c1bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe700009d90 tx=0x7fe70001c920 comp rx=0 tx=0).stop 2023-12-16T03:25:26.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 -- 172.21.15.28:0/2220454048 shutdown_connections 2023-12-16T03:25:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 --2- 172.21.15.28:0/2220454048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7080bffc0 0x7fe7080c1bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 --2- 172.21.15.28:0/2220454048 >> v2:172.21.15.134:3300/0 conn(0x7fe7081560e0 0x7fe70815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 -- 172.21.15.28:0/2220454048 >> 172.21.15.28:0/2220454048 conn(0x7fe70806a5b0 msgr2=0x7fe70806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 -- 172.21.15.28:0/2220454048 shutdown_connections 2023-12-16T03:25:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 -- 172.21.15.28:0/2220454048 wait complete. 2023-12-16T03:25:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 Processor -- start 2023-12-16T03:25:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 -- start start 2023-12-16T03:25:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe70806d520 0x7fe708155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7080bffc0 0x7fe7080a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7081560e0 0x7fe7081496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70814ef50 con 0x7fe70806d520 2023-12-16T03:25:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7081589b0 con 0x7fe7081560e0 2023-12-16T03:25:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70fd57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7081586d0 con 0x7fe7080bffc0 2023-12-16T03:25:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70daf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe70806d520 0x7fe708155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70daf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe70806d520 0x7fe708155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38890/0 (socket says 172.21.15.28:38890) 2023-12-16T03:25:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70daf3640 1 -- 172.21.15.28:0/3822158545 learned_addr learned my addr 172.21.15.28:0/3822158545 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:26.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70daf3640 1 -- 172.21.15.28:0/3822158545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7080bffc0 msgr2=0x7fe7080a5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70e2f4640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7081560e0 0x7fe7081496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70daf3640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7080bffc0 0x7fe7080a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70daf3640 1 -- 172.21.15.28:0/3822158545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7081560e0 msgr2=0x7fe7081496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70daf3640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7081560e0 0x7fe7081496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.583+0000 7fe70daf3640 1 -- 172.21.15.28:0/3822158545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe700009a70 con 0x7fe70806d520 2023-12-16T03:25:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.587+0000 7fe70daf3640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe70806d520 0x7fe708155040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe70400e8a0 tx=0x7fe70400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.587+0000 7fe6fe7fc640 1 -- 172.21.15.28:0/3822158545 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704009510 con 0x7fe70806d520 2023-12-16T03:25:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.587+0000 7fe6fe7fc640 1 -- 172.21.15.28:0/3822158545 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70400c940 con 0x7fe70806d520 2023-12-16T03:25:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.587+0000 7fe70fd57640 1 -- 172.21.15.28:0/3822158545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7081f50a0 con 0x7fe70806d520 2023-12-16T03:25:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.587+0000 7fe6fe7fc640 1 -- 172.21.15.28:0/3822158545 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400ccb0 con 0x7fe70806d520 2023-12-16T03:25:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.587+0000 7fe70fd57640 1 -- 172.21.15.28:0/3822158545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe708155580 con 0x7fe70806d520 2023-12-16T03:25:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.587+0000 7fe70fd57640 1 -- 172.21.15.28:0/3822158545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe708068400 con 0x7fe70806d520 2023-12-16T03:25:26.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.587+0000 7fe6fe7fc640 1 -- 172.21.15.28:0/3822158545 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe704013470 con 0x7fe70806d520 2023-12-16T03:25:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.587+0000 7fe6fe7fc640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6ec066470 0x7fe6ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.587+0000 7fe6fe7fc640 1 -- 172.21.15.28:0/3822158545 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe704083ff0 con 0x7fe70806d520 2023-12-16T03:25:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.587+0000 7fe70d2f2640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6ec066470 0x7fe6ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.591+0000 7fe70d2f2640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6ec066470 0x7fe6ec068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8007fd0 tx=0x7fe6f8007940 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:26.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.591+0000 7fe6fe7fc640 1 -- 172.21.15.28:0/3822158545 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe7040b5290 con 0x7fe70806d520 2023-12-16T03:25:26.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.747+0000 7fe70fd57640 1 -- 172.21.15.28:0/3822158545 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7081f4f20 con 0x7fe6ec066470 2023-12-16T03:25:26.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.751+0000 7fe6fe7fc640 1 -- 172.21.15.28:0/3822158545 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264545 (secure 0 0 0) 0x7fe6f80058c0 con 0x7fe6ec066470 2023-12-16T03:25:26.759 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:26.760 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:25:26.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 -- 172.21.15.28:0/3822158545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6ec066470 msgr2=0x7fe6ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6ec066470 0x7fe6ec068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8007fd0 tx=0x7fe6f8007940 comp rx=0 tx=0).stop 2023-12-16T03:25:26.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 -- 172.21.15.28:0/3822158545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe70806d520 msgr2=0x7fe708155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe70806d520 0x7fe708155040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe70400e8a0 tx=0x7fe70400eca0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 -- 172.21.15.28:0/3822158545 shutdown_connections 2023-12-16T03:25:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7081560e0 0x7fe7081496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7080bffc0 0x7fe7080a5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6ec066470 0x7fe6ec068930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 --2- 172.21.15.28:0/3822158545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe70806d520 0x7fe708155040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 -- 172.21.15.28:0/3822158545 >> 172.21.15.28:0/3822158545 conn(0x7fe70806a5b0 msgr2=0x7fe70806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 -- 172.21.15.28:0/3822158545 shutdown_connections 2023-12-16T03:25:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.755+0000 7fe70fd57640 1 -- 172.21.15.28:0/3822158545 wait complete. 2023-12-16T03:25:26.780 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-16T03:25:25.801198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235624,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739096,"statfs":{"total":773094113280,"available":772852834304,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.007990"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437358+0000","last_change":"2023-12-16T03:25:15.452175+0000","last_active":"2023-12-16T03:25:16.437358+0000","last_peered":"2023-12-16T03:25:16.437358+0000","last_clean":"2023-12-16T03:25:16.437358+0000","last_became_active":"2023-12-16T03:25:15.451916+0000","last_became_peered":"2023-12-16T03:25:15.451916+0000","last_unstale":"2023-12-16T03:25:16.437358+0000","last_undegraded":"2023-12-16T03:25:16.437358+0000","last_fullsized":"2023-12-16T03:25:16.437358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:50:43.581686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420315+0000","last_change":"2023-12-16T03:25:15.425458+0000","last_active":"2023-12-16T03:25:16.420315+0000","last_peered":"2023-12-16T03:25:16.420315+0000","last_clean":"2023-12-16T03:25:16.420315+0000","last_became_active":"2023-12-16T03:25:15.425194+0000","last_became_peered":"2023-12-16T03:25:15.425194+0000","last_unstale":"2023-12-16T03:25:16.420315+0000","last_undegraded":"2023-12-16T03:25:16.420315+0000","last_fullsized":"2023-12-16T03:25:16.420315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437452+0000","last_change":"2023-12-16T03:25:15.425638+0000","last_active":"2023-12-16T03:25:16.437452+0000","last_peered":"2023-12-16T03:25:16.437452+0000","last_clean":"2023-12-16T03:25:16.437452+0000","last_became_active":"2023-12-16T03:25:15.425353+0000","last_became_peered":"2023-12-16T03:25:15.425353+0000","last_unstale":"2023-12-16T03:25:16.437452+0000","last_undegraded":"2023-12-16T03:25:16.437452+0000","last_fullsized":"2023-12-16T03:25:16.437452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422853+0000","last_change":"2023-12-16T03:25:15.434050+0000","last_active":"2023-12-16T03:25:16.422853+0000","last_peered":"2023-12-16T03:25:16.422853+0000","last_clean":"2023-12-16T03:25:16.422853+0000","last_became_active":"2023-12-16T03:25:15.433643+0000","last_became_peered":"2023-12-16T03:25:15.433643+0000","last_unstale":"2023-12-16T03:25:16.422853+0000","last_undegraded":"2023-12-16T03:25:16.422853+0000","last_fullsized":"2023-12-16T03:25:16.422853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436512+0000","last_change":"2023-12-16T03:25:15.445800+0000","last_active":"2023-12-16T03:25:16.436512+0000","last_peered":"2023-12-16T03:25:16.436512+0000","last_clean":"2023-12-16T03:25:16.436512+0000","last_became_active":"2023-12-16T03:25:15.445496+0000","last_became_peered":"2023-12-16T03:25:15.445496+0000","last_unstale":"2023-12-16T03:25:16.436512+0000","last_undegraded":"2023-12-16T03:25:16.436512+0000","last_fullsized":"2023-12-16T03:25:16.436512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422916+0000","last_change":"2023-12-16T03:25:15.433130+0000","last_active":"2023-12-16T03:25:16.422916+0000","last_peered":"2023-12-16T03:25:16.422916+0000","last_clean":"2023-12-16T03:25:16.422916+0000","last_became_active":"2023-12-16T03:25:15.432783+0000","last_became_peered":"2023-12-16T03:25:15.432783+0000","last_unstale":"2023-12-16T03:25:16.422916+0000","last_undegraded":"2023-12-16T03:25:16.422916+0000","last_fullsized":"2023-12-16T03:25:16.422916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:55.217497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436380+0000","last_change":"2023-12-16T03:25:15.443935+0000","last_active":"2023-12-16T03:25:16.436380+0000","last_peered":"2023-12-16T03:25:16.436380+0000","last_clean":"2023-12-16T03:25:16.436380+0000","last_became_active":"2023-12-16T03:25:15.443601+0000","last_became_peered":"2023-12-16T03:25:15.443601+0000","last_unstale":"2023-12-16T03:25:16.436380+0000","last_undegraded":"2023-12-16T03:25:16.436380+0000","last_fullsized":"2023-12-16T03:25:16.436380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436427+0000","last_change":"2023-12-16T03:25:15.431879+0000","last_active":"2023-12-16T03:25:16.436427+0000","last_peered":"2023-12-16T03:25:16.436427+0000","last_clean":"2023-12-16T03:25:16.436427+0000","last_became_active":"2023-12-16T03:25:15.431564+0000","last_became_peered":"2023-12-16T03:25:15.431564+0000","last_unstale":"2023-12-16T03:25:16.436427+0000","last_undegraded":"2023-12-16T03:25:16.436427+0000","last_fullsized":"2023-12-16T03:25:16.436427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437342+0000","last_change":"2023-12-16T03:25:15.446906+0000","last_active":"2023-12-16T03:25:16.437342+0000","last_peered":"2023-12-16T03:25:16.437342+0000","last_clean":"2023-12-16T03:25:16.437342+0000","last_became_active":"2023-12-16T03:25:15.446136+0000","last_became_peered":"2023-12-16T03:25:15.446136+0000","last_unstale":"2023-12-16T03:25:16.437342+0000","last_undegraded":"2023-12-16T03:25:16.437342+0000","last_fullsized":"2023-12-16T03:25:16.437342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:54:38.927177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436922+0000","last_change":"2023-12-16T03:25:15.437274+0000","last_active":"2023-12-16T03:25:16.436922+0000","last_peered":"2023-12-16T03:25:16.436922+0000","last_clean":"2023-12-16T03:25:16.436922+0000","last_became_active":"2023-12-16T03:25:15.436993+0000","last_became_peered":"2023-12-16T03:25:15.436993+0000","last_unstale":"2023-12-16T03:25:16.436922+0000","last_undegraded":"2023-12-16T03:25:16.436922+0000","last_fullsized":"2023-12-16T03:25:16.436922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436247+0000","last_change":"2023-12-16T03:25:15.439228+0000","last_active":"2023-12-16T03:25:16.436247+0000","last_peered":"2023-12-16T03:25:16.436247+0000","last_clean":"2023-12-16T03:25:16.436247+0000","last_became_active":"2023-12-16T03:25:15.437550+0000","last_became_peered":"2023-12-16T03:25:15.437550+0000","last_unstale":"2023-12-16T03:25:16.436247+0000","last_undegraded":"2023-12-16T03:25:16.436247+0000","last_fullsized":"2023-12-16T03:25:16.436247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422787+0000","last_change":"2023-12-16T03:25:15.442026+0000","last_active":"2023-12-16T03:25:16.422787+0000","last_peered":"2023-12-16T03:25:16.422787+0000","last_clean":"2023-12-16T03:25:16.422787+0000","last_became_active":"2023-12-16T03:25:15.441374+0000","last_became_peered":"2023-12-16T03:25:15.441374+0000","last_unstale":"2023-12-16T03:25:16.422787+0000","last_undegraded":"2023-12-16T03:25:16.422787+0000","last_fullsized":"2023-12-16T03:25:16.422787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:21.931497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437544+0000","last_change":"2023-12-16T03:25:15.431327+0000","last_active":"2023-12-16T03:25:16.437544+0000","last_peered":"2023-12-16T03:25:16.437544+0000","last_clean":"2023-12-16T03:25:16.437544+0000","last_became_active":"2023-12-16T03:25:15.430973+0000","last_became_peered":"2023-12-16T03:25:15.430973+0000","last_unstale":"2023-12-16T03:25:16.437544+0000","last_undegraded":"2023-12-16T03:25:16.437544+0000","last_fullsized":"2023-12-16T03:25:16.437544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436524+0000","last_change":"2023-12-16T03:25:15.426240+0000","last_active":"2023-12-16T03:25:16.436524+0000","last_peered":"2023-12-16T03:25:16.436524+0000","last_clean":"2023-12-16T03:25:16.436524+0000","last_became_active":"2023-12-16T03:25:15.425045+0000","last_became_peered":"2023-12-16T03:25:15.425045+0000","last_unstale":"2023-12-16T03:25:16.436524+0000","last_undegraded":"2023-12-16T03:25:16.436524+0000","last_fullsized":"2023-12-16T03:25:16.436524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:11.236920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420099+0000","last_change":"2023-12-16T03:25:15.449282+0000","last_active":"2023-12-16T03:25:16.420099+0000","last_peered":"2023-12-16T03:25:16.420099+0000","last_clean":"2023-12-16T03:25:16.420099+0000","last_became_active":"2023-12-16T03:25:15.449009+0000","last_became_peered":"2023-12-16T03:25:15.449009+0000","last_unstale":"2023-12-16T03:25:16.420099+0000","last_undegraded":"2023-12-16T03:25:16.420099+0000","last_fullsized":"2023-12-16T03:25:16.420099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422703+0000","last_change":"2023-12-16T03:25:15.433001+0000","last_active":"2023-12-16T03:25:16.422703+0000","last_peered":"2023-12-16T03:25:16.422703+0000","last_clean":"2023-12-16T03:25:16.422703+0000","last_became_active":"2023-12-16T03:25:15.432331+0000","last_became_peered":"2023-12-16T03:25:15.432331+0000","last_unstale":"2023-12-16T03:25:16.422703+0000","last_undegraded":"2023-12-16T03:25:16.422703+0000","last_fullsized":"2023-12-16T03:25:16.422703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423697+0000","last_change":"2023-12-16T03:25:15.446721+0000","last_active":"2023-12-16T03:25:16.423697+0000","last_peered":"2023-12-16T03:25:16.423697+0000","last_clean":"2023-12-16T03:25:16.423697+0000","last_became_active":"2023-12-16T03:25:15.446449+0000","last_became_peered":"2023-12-16T03:25:15.446449+0000","last_unstale":"2023-12-16T03:25:16.423697+0000","last_undegraded":"2023-12-16T03:25:16.423697+0000","last_fullsized":"2023-12-16T03:25:16.423697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:00.341013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437037+0000","last_change":"2023-12-16T03:25:15.440602+0000","last_active":"2023-12-16T03:25:16.437037+0000","last_peered":"2023-12-16T03:25:16.437037+0000","last_clean":"2023-12-16T03:25:16.437037+0000","last_became_active":"2023-12-16T03:25:15.440121+0000","last_became_peered":"2023-12-16T03:25:15.440121+0000","last_unstale":"2023-12-16T03:25:16.437037+0000","last_undegraded":"2023-12-16T03:25:16.437037+0000","last_fullsized":"2023-12-16T03:25:16.437037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:07.619534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437099+0000","last_change":"2023-12-16T03:25:15.445828+0000","last_active":"2023-12-16T03:25:16.437099+0000","last_peered":"2023-12-16T03:25:16.437099+0000","last_clean":"2023-12-16T03:25:16.437099+0000","last_became_active":"2023-12-16T03:25:15.445531+0000","last_became_peered":"2023-12-16T03:25:15.445531+0000","last_unstale":"2023-12-16T03:25:16.437099+0000","last_undegraded":"2023-12-16T03:25:16.437099+0000","last_fullsized":"2023-12-16T03:25:16.437099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:59.239833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436366+0000","last_change":"2023-12-16T03:25:15.449537+0000","last_active":"2023-12-16T03:25:16.436366+0000","last_peered":"2023-12-16T03:25:16.436366+0000","last_clean":"2023-12-16T03:25:16.436366+0000","last_became_active":"2023-12-16T03:25:15.449070+0000","last_became_peered":"2023-12-16T03:25:15.449070+0000","last_unstale":"2023-12-16T03:25:16.436366+0000","last_undegraded":"2023-12-16T03:25:16.436366+0000","last_fullsized":"2023-12-16T03:25:16.436366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436601+0000","last_change":"2023-12-16T03:25:15.432034+0000","last_active":"2023-12-16T03:25:16.436601+0000","last_peered":"2023-12-16T03:25:16.436601+0000","last_clean":"2023-12-16T03:25:16.436601+0000","last_became_active":"2023-12-16T03:25:15.431749+0000","last_became_peered":"2023-12-16T03:25:15.431749+0000","last_unstale":"2023-12-16T03:25:16.436601+0000","last_undegraded":"2023-12-16T03:25:16.436601+0000","last_fullsized":"2023-12-16T03:25:16.436601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:37:00.957991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423015+0000","last_change":"2023-12-16T03:25:15.444757+0000","last_active":"2023-12-16T03:25:16.423015+0000","last_peered":"2023-12-16T03:25:16.423015+0000","last_clean":"2023-12-16T03:25:16.423015+0000","last_became_active":"2023-12-16T03:25:15.443767+0000","last_became_peered":"2023-12-16T03:25:15.443767+0000","last_unstale":"2023-12-16T03:25:16.423015+0000","last_undegraded":"2023-12-16T03:25:16.423015+0000","last_fullsized":"2023-12-16T03:25:16.423015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:50.358074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436894+0000","last_change":"2023-12-16T03:25:15.442263+0000","last_active":"2023-12-16T03:25:16.436894+0000","last_peered":"2023-12-16T03:25:16.436894+0000","last_clean":"2023-12-16T03:25:16.436894+0000","last_became_active":"2023-12-16T03:25:15.441740+0000","last_became_peered":"2023-12-16T03:25:15.441740+0000","last_unstale":"2023-12-16T03:25:16.436894+0000","last_undegraded":"2023-12-16T03:25:16.436894+0000","last_fullsized":"2023-12-16T03:25:16.436894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422740+0000","last_change":"2023-12-16T03:25:15.433490+0000","last_active":"2023-12-16T03:25:16.422740+0000","last_peered":"2023-12-16T03:25:16.422740+0000","last_clean":"2023-12-16T03:25:16.422740+0000","last_became_active":"2023-12-16T03:25:15.431932+0000","last_became_peered":"2023-12-16T03:25:15.431932+0000","last_unstale":"2023-12-16T03:25:16.422740+0000","last_undegraded":"2023-12-16T03:25:16.422740+0000","last_fullsized":"2023-12-16T03:25:16.422740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437338+0000","last_change":"2023-12-16T03:25:15.450545+0000","last_active":"2023-12-16T03:25:16.437338+0000","last_peered":"2023-12-16T03:25:16.437338+0000","last_clean":"2023-12-16T03:25:16.437338+0000","last_became_active":"2023-12-16T03:25:15.450331+0000","last_became_peered":"2023-12-16T03:25:15.450331+0000","last_unstale":"2023-12-16T03:25:16.437338+0000","last_undegraded":"2023-12-16T03:25:16.437338+0000","last_fullsized":"2023-12-16T03:25:16.437338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436987+0000","last_change":"2023-12-16T03:25:15.439606+0000","last_active":"2023-12-16T03:25:16.436987+0000","last_peered":"2023-12-16T03:25:16.436987+0000","last_clean":"2023-12-16T03:25:16.436987+0000","last_became_active":"2023-12-16T03:25:15.439192+0000","last_became_peered":"2023-12-16T03:25:15.439192+0000","last_unstale":"2023-12-16T03:25:16.436987+0000","last_undegraded":"2023-12-16T03:25:16.436987+0000","last_fullsized":"2023-12-16T03:25:16.436987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420282+0000","last_change":"2023-12-16T03:25:15.432802+0000","last_active":"2023-12-16T03:25:16.420282+0000","last_peered":"2023-12-16T03:25:16.420282+0000","last_clean":"2023-12-16T03:25:16.420282+0000","last_became_active":"2023-12-16T03:25:15.432545+0000","last_became_peered":"2023-12-16T03:25:15.432545+0000","last_unstale":"2023-12-16T03:25:16.420282+0000","last_undegraded":"2023-12-16T03:25:16.420282+0000","last_fullsized":"2023-12-16T03:25:16.420282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437287+0000","last_change":"2023-12-16T03:25:15.441487+0000","last_active":"2023-12-16T03:25:16.437287+0000","last_peered":"2023-12-16T03:25:16.437287+0000","last_clean":"2023-12-16T03:25:16.437287+0000","last_became_active":"2023-12-16T03:25:15.441150+0000","last_became_peered":"2023-12-16T03:25:15.441150+0000","last_unstale":"2023-12-16T03:25:16.437287+0000","last_undegraded":"2023-12-16T03:25:16.437287+0000","last_fullsized":"2023-12-16T03:25:16.437287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436778+0000","last_change":"2023-12-16T03:25:15.427812+0000","last_active":"2023-12-16T03:25:16.436778+0000","last_peered":"2023-12-16T03:25:16.436778+0000","last_clean":"2023-12-16T03:25:16.436778+0000","last_became_active":"2023-12-16T03:25:15.427532+0000","last_became_peered":"2023-12-16T03:25:15.427532+0000","last_unstale":"2023-12-16T03:25:16.436778+0000","last_undegraded":"2023-12-16T03:25:16.436778+0000","last_fullsized":"2023-12-16T03:25:16.436778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423136+0000","last_change":"2023-12-16T03:25:15.431187+0000","last_active":"2023-12-16T03:25:16.423136+0000","last_peered":"2023-12-16T03:25:16.423136+0000","last_clean":"2023-12-16T03:25:16.423136+0000","last_became_active":"2023-12-16T03:25:15.430884+0000","last_became_peered":"2023-12-16T03:25:15.430884+0000","last_unstale":"2023-12-16T03:25:16.423136+0000","last_undegraded":"2023-12-16T03:25:16.423136+0000","last_fullsized":"2023-12-16T03:25:16.423136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436280+0000","last_change":"2023-12-16T03:25:15.432854+0000","last_active":"2023-12-16T03:25:16.436280+0000","last_peered":"2023-12-16T03:25:16.436280+0000","last_clean":"2023-12-16T03:25:16.436280+0000","last_became_active":"2023-12-16T03:25:15.432566+0000","last_became_peered":"2023-12-16T03:25:15.432566+0000","last_unstale":"2023-12-16T03:25:16.436280+0000","last_undegraded":"2023-12-16T03:25:16.436280+0000","last_fullsized":"2023-12-16T03:25:16.436280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:39.322218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436057+0000","last_change":"2023-12-16T03:25:15.430509+0000","last_active":"2023-12-16T03:25:16.436057+0000","last_peered":"2023-12-16T03:25:16.436057+0000","last_clean":"2023-12-16T03:25:16.436057+0000","last_became_active":"2023-12-16T03:25:15.430160+0000","last_became_peered":"2023-12-16T03:25:15.430160+0000","last_unstale":"2023-12-16T03:25:16.436057+0000","last_undegraded":"2023-12-16T03:25:16.436057+0000","last_fullsized":"2023-12-16T03:25:16.436057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422522+0000","last_change":"2023-12-16T03:25:15.441852+0000","last_active":"2023-12-16T03:25:16.422522+0000","last_peered":"2023-12-16T03:25:16.422522+0000","last_clean":"2023-12-16T03:25:16.422522+0000","last_became_active":"2023-12-16T03:25:15.441128+0000","last_became_peered":"2023-12-16T03:25:15.441128+0000","last_unstale":"2023-12-16T03:25:16.422522+0000","last_undegraded":"2023-12-16T03:25:16.422522+0000","last_fullsized":"2023-12-16T03:25:16.422522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:37.465934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437593+0000","last_change":"2023-12-16T03:25:14.944628+0000","last_active":"2023-12-16T03:25:16.437593+0000","last_peered":"2023-12-16T03:25:16.437593+0000","last_clean":"2023-12-16T03:25:16.437593+0000","last_became_active":"2023-12-16T03:25:14.944278+0000","last_became_peered":"2023-12-16T03:25:14.944278+0000","last_unstale":"2023-12-16T03:25:16.437593+0000","last_undegraded":"2023-12-16T03:25:16.437593+0000","last_fullsized":"2023-12-16T03:25:16.437593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436947+0000","last_change":"2023-12-16T03:25:15.438299+0000","last_active":"2023-12-16T03:25:16.436947+0000","last_peered":"2023-12-16T03:25:16.436947+0000","last_clean":"2023-12-16T03:25:16.436947+0000","last_became_active":"2023-12-16T03:25:15.437923+0000","last_became_peered":"2023-12-16T03:25:15.437923+0000","last_unstale":"2023-12-16T03:25:16.436947+0000","last_undegraded":"2023-12-16T03:25:16.436947+0000","last_fullsized":"2023-12-16T03:25:16.436947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436200+0000","last_change":"2023-12-16T03:25:14.952619+0000","last_active":"2023-12-16T03:25:16.436200+0000","last_peered":"2023-12-16T03:25:16.436200+0000","last_clean":"2023-12-16T03:25:16.436200+0000","last_became_active":"2023-12-16T03:25:14.951351+0000","last_became_peered":"2023-12-16T03:25:14.951351+0000","last_unstale":"2023-12-16T03:25:16.436200+0000","last_undegraded":"2023-12-16T03:25:16.436200+0000","last_fullsized":"2023-12-16T03:25:16.436200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437048+0000","last_change":"2023-12-16T03:25:14.939694+0000","last_active":"2023-12-16T03:25:16.437048+0000","last_peered":"2023-12-16T03:25:16.437048+0000","last_clean":"2023-12-16T03:25:16.437048+0000","last_became_active":"2023-12-16T03:25:14.939359+0000","last_became_peered":"2023-12-16T03:25:14.939359+0000","last_unstale":"2023-12-16T03:25:16.437048+0000","last_undegraded":"2023-12-16T03:25:16.437048+0000","last_fullsized":"2023-12-16T03:25:16.437048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436550+0000","last_change":"2023-12-16T03:25:15.426946+0000","last_active":"2023-12-16T03:25:16.436550+0000","last_peered":"2023-12-16T03:25:16.436550+0000","last_clean":"2023-12-16T03:25:16.436550+0000","last_became_active":"2023-12-16T03:25:15.426548+0000","last_became_peered":"2023-12-16T03:25:15.426548+0000","last_unstale":"2023-12-16T03:25:16.436550+0000","last_undegraded":"2023-12-16T03:25:16.436550+0000","last_fullsized":"2023-12-16T03:25:16.436550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:25.537936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422798+0000","last_change":"2023-12-16T03:25:14.942071+0000","last_active":"2023-12-16T03:25:16.422798+0000","last_peered":"2023-12-16T03:25:16.422798+0000","last_clean":"2023-12-16T03:25:16.422798+0000","last_became_active":"2023-12-16T03:25:14.941786+0000","last_became_peered":"2023-12-16T03:25:14.941786+0000","last_unstale":"2023-12-16T03:25:16.422798+0000","last_undegraded":"2023-12-16T03:25:16.422798+0000","last_fullsized":"2023-12-16T03:25:16.422798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:34.131498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420100+0000","last_change":"2023-12-16T03:25:15.429804+0000","last_active":"2023-12-16T03:25:16.420100+0000","last_peered":"2023-12-16T03:25:16.420100+0000","last_clean":"2023-12-16T03:25:16.420100+0000","last_became_active":"2023-12-16T03:25:15.429063+0000","last_became_peered":"2023-12-16T03:25:15.429063+0000","last_unstale":"2023-12-16T03:25:16.420100+0000","last_undegraded":"2023-12-16T03:25:16.420100+0000","last_fullsized":"2023-12-16T03:25:16.420100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437091+0000","last_change":"2023-12-16T03:25:14.946494+0000","last_active":"2023-12-16T03:25:16.437091+0000","last_peered":"2023-12-16T03:25:16.437091+0000","last_clean":"2023-12-16T03:25:16.437091+0000","last_became_active":"2023-12-16T03:25:14.946193+0000","last_became_peered":"2023-12-16T03:25:14.946193+0000","last_unstale":"2023-12-16T03:25:16.437091+0000","last_undegraded":"2023-12-16T03:25:16.437091+0000","last_fullsized":"2023-12-16T03:25:16.437091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423512+0000","last_change":"2023-12-16T03:25:15.444625+0000","last_active":"2023-12-16T03:25:16.423512+0000","last_peered":"2023-12-16T03:25:16.423512+0000","last_clean":"2023-12-16T03:25:16.423512+0000","last_became_active":"2023-12-16T03:25:15.444322+0000","last_became_peered":"2023-12-16T03:25:15.444322+0000","last_unstale":"2023-12-16T03:25:16.423512+0000","last_undegraded":"2023-12-16T03:25:16.423512+0000","last_fullsized":"2023-12-16T03:25:16.423512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:07.831312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423548+0000","last_change":"2023-12-16T03:25:14.943434+0000","last_active":"2023-12-16T03:25:16.423548+0000","last_peered":"2023-12-16T03:25:16.423548+0000","last_clean":"2023-12-16T03:25:16.423548+0000","last_became_active":"2023-12-16T03:25:14.942914+0000","last_became_peered":"2023-12-16T03:25:14.942914+0000","last_unstale":"2023-12-16T03:25:16.423548+0000","last_undegraded":"2023-12-16T03:25:16.423548+0000","last_fullsized":"2023-12-16T03:25:16.423548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437746+0000","last_change":"2023-12-16T03:25:15.433507+0000","last_active":"2023-12-16T03:25:16.437746+0000","last_peered":"2023-12-16T03:25:16.437746+0000","last_clean":"2023-12-16T03:25:16.437746+0000","last_became_active":"2023-12-16T03:25:15.433228+0000","last_became_peered":"2023-12-16T03:25:15.433228+0000","last_unstale":"2023-12-16T03:25:16.437746+0000","last_undegraded":"2023-12-16T03:25:16.437746+0000","last_fullsized":"2023-12-16T03:25:16.437746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420270+0000","last_change":"2023-12-16T03:25:14.948029+0000","last_active":"2023-12-16T03:25:16.420270+0000","last_peered":"2023-12-16T03:25:16.420270+0000","last_clean":"2023-12-16T03:25:16.420270+0000","last_became_active":"2023-12-16T03:25:14.947608+0000","last_became_peered":"2023-12-16T03:25:14.947608+0000","last_unstale":"2023-12-16T03:25:16.420270+0000","last_undegraded":"2023-12-16T03:25:16.420270+0000","last_fullsized":"2023-12-16T03:25:16.420270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422868+0000","last_change":"2023-12-16T03:25:15.448886+0000","last_active":"2023-12-16T03:25:16.422868+0000","last_peered":"2023-12-16T03:25:16.422868+0000","last_clean":"2023-12-16T03:25:16.422868+0000","last_became_active":"2023-12-16T03:25:15.448576+0000","last_became_peered":"2023-12-16T03:25:15.448576+0000","last_unstale":"2023-12-16T03:25:16.422868+0000","last_undegraded":"2023-12-16T03:25:16.422868+0000","last_fullsized":"2023-12-16T03:25:16.422868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:39.322218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436460+0000","last_change":"2023-12-16T03:25:14.938057+0000","last_active":"2023-12-16T03:25:16.436460+0000","last_peered":"2023-12-16T03:25:16.436460+0000","last_clean":"2023-12-16T03:25:16.436460+0000","last_became_active":"2023-12-16T03:25:14.937091+0000","last_became_peered":"2023-12-16T03:25:14.937091+0000","last_unstale":"2023-12-16T03:25:16.436460+0000","last_undegraded":"2023-12-16T03:25:16.436460+0000","last_fullsized":"2023-12-16T03:25:16.436460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436738+0000","last_change":"2023-12-16T03:25:15.444073+0000","last_active":"2023-12-16T03:25:16.436738+0000","last_peered":"2023-12-16T03:25:16.436738+0000","last_clean":"2023-12-16T03:25:16.436738+0000","last_became_active":"2023-12-16T03:25:15.443746+0000","last_became_peered":"2023-12-16T03:25:15.443746+0000","last_unstale":"2023-12-16T03:25:16.436738+0000","last_undegraded":"2023-12-16T03:25:16.436738+0000","last_fullsized":"2023-12-16T03:25:16.436738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:20:54.316492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437145+0000","last_change":"2023-12-16T03:25:14.945151+0000","last_active":"2023-12-16T03:25:16.437145+0000","last_peered":"2023-12-16T03:25:16.437145+0000","last_clean":"2023-12-16T03:25:16.437145+0000","last_became_active":"2023-12-16T03:25:14.937913+0000","last_became_peered":"2023-12-16T03:25:14.937913+0000","last_unstale":"2023-12-16T03:25:16.437145+0000","last_undegraded":"2023-12-16T03:25:16.437145+0000","last_fullsized":"2023-12-16T03:25:16.437145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:36.459150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436602+0000","last_change":"2023-12-16T03:25:15.443554+0000","last_active":"2023-12-16T03:25:16.436602+0000","last_peered":"2023-12-16T03:25:16.436602+0000","last_clean":"2023-12-16T03:25:16.436602+0000","last_became_active":"2023-12-16T03:25:15.443275+0000","last_became_peered":"2023-12-16T03:25:15.443275+0000","last_unstale":"2023-12-16T03:25:16.436602+0000","last_undegraded":"2023-12-16T03:25:16.436602+0000","last_fullsized":"2023-12-16T03:25:16.436602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:17:04.448804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423115+0000","last_change":"2023-12-16T03:25:14.948755+0000","last_active":"2023-12-16T03:25:16.423115+0000","last_peered":"2023-12-16T03:25:16.423115+0000","last_clean":"2023-12-16T03:25:16.423115+0000","last_became_active":"2023-12-16T03:25:14.948399+0000","last_became_peered":"2023-12-16T03:25:14.948399+0000","last_unstale":"2023-12-16T03:25:16.423115+0000","last_undegraded":"2023-12-16T03:25:16.423115+0000","last_fullsized":"2023-12-16T03:25:16.423115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:05.939619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436672+0000","last_change":"2023-12-16T03:25:15.454032+0000","last_active":"2023-12-16T03:25:16.436672+0000","last_peered":"2023-12-16T03:25:16.436672+0000","last_clean":"2023-12-16T03:25:16.436672+0000","last_became_active":"2023-12-16T03:25:15.453722+0000","last_became_peered":"2023-12-16T03:25:15.453722+0000","last_unstale":"2023-12-16T03:25:16.436672+0000","last_undegraded":"2023-12-16T03:25:16.436672+0000","last_fullsized":"2023-12-16T03:25:16.436672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:07.831312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436040+0000","last_change":"2023-12-16T03:25:14.938917+0000","last_active":"2023-12-16T03:25:16.436040+0000","last_peered":"2023-12-16T03:25:16.436040+0000","last_clean":"2023-12-16T03:25:16.436040+0000","last_became_active":"2023-12-16T03:25:14.938389+0000","last_became_peered":"2023-12-16T03:25:14.938389+0000","last_unstale":"2023-12-16T03:25:16.436040+0000","last_undegraded":"2023-12-16T03:25:16.436040+0000","last_fullsized":"2023-12-16T03:25:16.436040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436799+0000","last_change":"2023-12-16T03:25:15.431222+0000","last_active":"2023-12-16T03:25:16.436799+0000","last_peered":"2023-12-16T03:25:16.436799+0000","last_clean":"2023-12-16T03:25:16.436799+0000","last_became_active":"2023-12-16T03:25:15.430884+0000","last_became_peered":"2023-12-16T03:25:15.430884+0000","last_unstale":"2023-12-16T03:25:16.436799+0000","last_undegraded":"2023-12-16T03:25:16.436799+0000","last_fullsized":"2023-12-16T03:25:16.436799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436272+0000","last_change":"2023-12-16T03:25:14.937196+0000","last_active":"2023-12-16T03:25:16.436272+0000","last_peered":"2023-12-16T03:25:16.436272+0000","last_clean":"2023-12-16T03:25:16.436272+0000","last_became_active":"2023-12-16T03:25:14.935102+0000","last_became_peered":"2023-12-16T03:25:14.935102+0000","last_unstale":"2023-12-16T03:25:16.436272+0000","last_undegraded":"2023-12-16T03:25:16.436272+0000","last_fullsized":"2023-12-16T03:25:16.436272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:39:22.295470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436578+0000","last_change":"2023-12-16T03:25:15.455089+0000","last_active":"2023-12-16T03:25:16.436578+0000","last_peered":"2023-12-16T03:25:16.436578+0000","last_clean":"2023-12-16T03:25:16.436578+0000","last_became_active":"2023-12-16T03:25:15.454725+0000","last_became_peered":"2023-12-16T03:25:15.454725+0000","last_unstale":"2023-12-16T03:25:16.436578+0000","last_undegraded":"2023-12-16T03:25:16.436578+0000","last_fullsized":"2023-12-16T03:25:16.436578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:29.020229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422895+0000","last_change":"2023-12-16T03:25:14.941188+0000","last_active":"2023-12-16T03:25:16.422895+0000","last_peered":"2023-12-16T03:25:16.422895+0000","last_clean":"2023-12-16T03:25:16.422895+0000","last_became_active":"2023-12-16T03:25:14.940811+0000","last_became_peered":"2023-12-16T03:25:14.940811+0000","last_unstale":"2023-12-16T03:25:16.422895+0000","last_undegraded":"2023-12-16T03:25:16.422895+0000","last_fullsized":"2023-12-16T03:25:16.422895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:08.626152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436563+0000","last_change":"2023-12-16T03:25:15.452042+0000","last_active":"2023-12-16T03:25:16.436563+0000","last_peered":"2023-12-16T03:25:16.436563+0000","last_clean":"2023-12-16T03:25:16.436563+0000","last_became_active":"2023-12-16T03:25:15.451737+0000","last_became_peered":"2023-12-16T03:25:15.451737+0000","last_unstale":"2023-12-16T03:25:16.436563+0000","last_undegraded":"2023-12-16T03:25:16.436563+0000","last_fullsized":"2023-12-16T03:25:16.436563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437165+0000","last_change":"2023-12-16T03:25:14.938664+0000","last_active":"2023-12-16T03:25:16.437165+0000","last_peered":"2023-12-16T03:25:16.437165+0000","last_clean":"2023-12-16T03:25:16.437165+0000","last_became_active":"2023-12-16T03:25:14.938324+0000","last_became_peered":"2023-12-16T03:25:14.938324+0000","last_unstale":"2023-12-16T03:25:16.437165+0000","last_undegraded":"2023-12-16T03:25:16.437165+0000","last_fullsized":"2023-12-16T03:25:16.437165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:18:36.459150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437416+0000","last_change":"2023-12-16T03:25:15.455016+0000","last_active":"2023-12-16T03:25:16.437416+0000","last_peered":"2023-12-16T03:25:16.437416+0000","last_clean":"2023-12-16T03:25:16.437416+0000","last_became_active":"2023-12-16T03:25:15.454715+0000","last_became_peered":"2023-12-16T03:25:15.454715+0000","last_unstale":"2023-12-16T03:25:16.437416+0000","last_undegraded":"2023-12-16T03:25:16.437416+0000","last_fullsized":"2023-12-16T03:25:16.437416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:02:53.965844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420363+0000","last_change":"2023-12-16T03:25:14.942353+0000","last_active":"2023-12-16T03:25:16.420363+0000","last_peered":"2023-12-16T03:25:16.420363+0000","last_clean":"2023-12-16T03:25:16.420363+0000","last_became_active":"2023-12-16T03:25:14.942088+0000","last_became_peered":"2023-12-16T03:25:14.942088+0000","last_unstale":"2023-12-16T03:25:16.420363+0000","last_undegraded":"2023-12-16T03:25:16.420363+0000","last_fullsized":"2023-12-16T03:25:16.420363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:36:59.951207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423137+0000","last_change":"2023-12-16T03:25:15.433902+0000","last_active":"2023-12-16T03:25:16.423137+0000","last_peered":"2023-12-16T03:25:16.423137+0000","last_clean":"2023-12-16T03:25:16.423137+0000","last_became_active":"2023-12-16T03:25:15.432579+0000","last_became_peered":"2023-12-16T03:25:15.432579+0000","last_unstale":"2023-12-16T03:25:16.423137+0000","last_undegraded":"2023-12-16T03:25:16.423137+0000","last_fullsized":"2023-12-16T03:25:16.423137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:29.020229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436825+0000","last_change":"2023-12-16T03:25:14.949089+0000","last_active":"2023-12-16T03:25:16.436825+0000","last_peered":"2023-12-16T03:25:16.436825+0000","last_clean":"2023-12-16T03:25:16.436825+0000","last_became_active":"2023-12-16T03:25:14.948668+0000","last_became_peered":"2023-12-16T03:25:14.948668+0000","last_unstale":"2023-12-16T03:25:16.436825+0000","last_undegraded":"2023-12-16T03:25:16.436825+0000","last_fullsized":"2023-12-16T03:25:16.436825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:06.962968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436870+0000","last_change":"2023-12-16T03:25:15.445232+0000","last_active":"2023-12-16T03:25:16.436870+0000","last_peered":"2023-12-16T03:25:16.436870+0000","last_clean":"2023-12-16T03:25:16.436870+0000","last_became_active":"2023-12-16T03:25:15.444929+0000","last_became_peered":"2023-12-16T03:25:15.444929+0000","last_unstale":"2023-12-16T03:25:16.436870+0000","last_undegraded":"2023-12-16T03:25:16.436870+0000","last_fullsized":"2023-12-16T03:25:16.436870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:00.341013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-16T03:25:15.435898+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:25:15.435898+0000","last_peered":"2023-12-16T03:25:15.435898+0000","last_clean":"2023-12-16T03:25:15.435898+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:25:15.435898+0000","last_undegraded":"2023-12-16T03:25:15.435898+0000","last_fullsized":"2023-12-16T03:25:15.435898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423217+0000","last_change":"2023-12-16T03:25:14.941508+0000","last_active":"2023-12-16T03:25:16.423217+0000","last_peered":"2023-12-16T03:25:16.423217+0000","last_clean":"2023-12-16T03:25:16.423217+0000","last_became_active":"2023-12-16T03:25:14.941128+0000","last_became_peered":"2023-12-16T03:25:14.941128+0000","last_unstale":"2023-12-16T03:25:16.423217+0000","last_undegraded":"2023-12-16T03:25:16.423217+0000","last_fullsized":"2023-12-16T03:25:16.423217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:34.241901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437288+0000","last_change":"2023-12-16T03:25:15.433356+0000","last_active":"2023-12-16T03:25:16.437288+0000","last_peered":"2023-12-16T03:25:16.437288+0000","last_clean":"2023-12-16T03:25:16.437288+0000","last_became_active":"2023-12-16T03:25:15.433010+0000","last_became_peered":"2023-12-16T03:25:15.433010+0000","last_unstale":"2023-12-16T03:25:16.437288+0000","last_undegraded":"2023-12-16T03:25:16.437288+0000","last_fullsized":"2023-12-16T03:25:16.437288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:57:44.495013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436448+0000","last_change":"2023-12-16T03:25:14.951710+0000","last_active":"2023-12-16T03:25:16.436448+0000","last_peered":"2023-12-16T03:25:16.436448+0000","last_clean":"2023-12-16T03:25:16.436448+0000","last_became_active":"2023-12-16T03:25:14.951249+0000","last_became_peered":"2023-12-16T03:25:14.951249+0000","last_unstale":"2023-12-16T03:25:16.436448+0000","last_undegraded":"2023-12-16T03:25:16.436448+0000","last_fullsized":"2023-12-16T03:25:16.436448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:20.924714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436461+0000","last_change":"2023-12-16T03:25:15.449196+0000","last_active":"2023-12-16T03:25:16.436461+0000","last_peered":"2023-12-16T03:25:16.436461+0000","last_clean":"2023-12-16T03:25:16.436461+0000","last_became_active":"2023-12-16T03:25:15.448896+0000","last_became_peered":"2023-12-16T03:25:15.448896+0000","last_unstale":"2023-12-16T03:25:16.436461+0000","last_undegraded":"2023-12-16T03:25:16.436461+0000","last_fullsized":"2023-12-16T03:25:16.436461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:04:06.946403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436387+0000","last_change":"2023-12-16T03:25:14.931491+0000","last_active":"2023-12-16T03:25:16.436387+0000","last_peered":"2023-12-16T03:25:16.436387+0000","last_clean":"2023-12-16T03:25:16.436387+0000","last_became_active":"2023-12-16T03:25:14.931114+0000","last_became_peered":"2023-12-16T03:25:14.931114+0000","last_unstale":"2023-12-16T03:25:16.436387+0000","last_undegraded":"2023-12-16T03:25:16.436387+0000","last_fullsized":"2023-12-16T03:25:16.436387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:07:34.241901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420119+0000","last_change":"2023-12-16T03:25:15.428698+0000","last_active":"2023-12-16T03:25:16.420119+0000","last_peered":"2023-12-16T03:25:16.420119+0000","last_clean":"2023-12-16T03:25:16.420119+0000","last_became_active":"2023-12-16T03:25:15.424710+0000","last_became_peered":"2023-12-16T03:25:15.424710+0000","last_unstale":"2023-12-16T03:25:16.420119+0000","last_undegraded":"2023-12-16T03:25:16.420119+0000","last_fullsized":"2023-12-16T03:25:16.420119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423180+0000","last_change":"2023-12-16T03:25:14.942839+0000","last_active":"2023-12-16T03:25:16.423180+0000","last_peered":"2023-12-16T03:25:16.423180+0000","last_clean":"2023-12-16T03:25:16.423180+0000","last_became_active":"2023-12-16T03:25:14.942596+0000","last_became_peered":"2023-12-16T03:25:14.942596+0000","last_unstale":"2023-12-16T03:25:16.423180+0000","last_undegraded":"2023-12-16T03:25:16.423180+0000","last_fullsized":"2023-12-16T03:25:16.423180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:36:59.951207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423043+0000","last_change":"2023-12-16T03:25:15.437137+0000","last_active":"2023-12-16T03:25:16.423043+0000","last_peered":"2023-12-16T03:25:16.423043+0000","last_clean":"2023-12-16T03:25:16.423043+0000","last_became_active":"2023-12-16T03:25:15.436800+0000","last_became_peered":"2023-12-16T03:25:15.436800+0000","last_unstale":"2023-12-16T03:25:16.423043+0000","last_undegraded":"2023-12-16T03:25:16.423043+0000","last_fullsized":"2023-12-16T03:25:16.423043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:07.619534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420344+0000","last_change":"2023-12-16T03:25:14.937971+0000","last_active":"2023-12-16T03:25:16.420344+0000","last_peered":"2023-12-16T03:25:16.420344+0000","last_clean":"2023-12-16T03:25:16.420344+0000","last_became_active":"2023-12-16T03:25:14.937684+0000","last_became_peered":"2023-12-16T03:25:14.937684+0000","last_unstale":"2023-12-16T03:25:16.420344+0000","last_undegraded":"2023-12-16T03:25:16.420344+0000","last_fullsized":"2023-12-16T03:25:16.420344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:30:07.891210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423696+0000","last_change":"2023-12-16T03:25:15.433590+0000","last_active":"2023-12-16T03:25:16.423696+0000","last_peered":"2023-12-16T03:25:16.423696+0000","last_clean":"2023-12-16T03:25:16.423696+0000","last_became_active":"2023-12-16T03:25:15.433276+0000","last_became_peered":"2023-12-16T03:25:15.433276+0000","last_unstale":"2023-12-16T03:25:16.423696+0000","last_undegraded":"2023-12-16T03:25:16.423696+0000","last_fullsized":"2023-12-16T03:25:16.423696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:43:59.239833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437138+0000","last_change":"2023-12-16T03:25:14.953294+0000","last_active":"2023-12-16T03:25:16.437138+0000","last_peered":"2023-12-16T03:25:16.437138+0000","last_clean":"2023-12-16T03:25:16.437138+0000","last_became_active":"2023-12-16T03:25:14.952984+0000","last_became_peered":"2023-12-16T03:25:14.952984+0000","last_unstale":"2023-12-16T03:25:16.437138+0000","last_undegraded":"2023-12-16T03:25:16.437138+0000","last_fullsized":"2023-12-16T03:25:16.437138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:24.531152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420255+0000","last_change":"2023-12-16T03:25:15.429623+0000","last_active":"2023-12-16T03:25:16.420255+0000","last_peered":"2023-12-16T03:25:16.420255+0000","last_clean":"2023-12-16T03:25:16.420255+0000","last_became_active":"2023-12-16T03:25:15.428854+0000","last_became_peered":"2023-12-16T03:25:15.428854+0000","last_unstale":"2023-12-16T03:25:16.420255+0000","last_undegraded":"2023-12-16T03:25:16.420255+0000","last_fullsized":"2023-12-16T03:25:16.420255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:17.818096+0000","last_change":"2023-12-16T03:25:14.939501+0000","last_active":"2023-12-16T03:25:17.818096+0000","last_peered":"2023-12-16T03:25:17.818096+0000","last_clean":"2023-12-16T03:25:17.818096+0000","last_became_active":"2023-12-16T03:25:14.939114+0000","last_became_peered":"2023-12-16T03:25:14.939114+0000","last_unstale":"2023-12-16T03:25:17.818096+0000","last_undegraded":"2023-12-16T03:25:17.818096+0000","last_fullsized":"2023-12-16T03:25:17.818096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437431+0000","last_change":"2023-12-16T03:25:15.448503+0000","last_active":"2023-12-16T03:25:16.437431+0000","last_peered":"2023-12-16T03:25:16.437431+0000","last_clean":"2023-12-16T03:25:16.437431+0000","last_became_active":"2023-12-16T03:25:15.448186+0000","last_became_peered":"2023-12-16T03:25:15.448186+0000","last_unstale":"2023-12-16T03:25:16.437431+0000","last_undegraded":"2023-12-16T03:25:16.437431+0000","last_fullsized":"2023-12-16T03:25:16.437431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:55.217497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437182+0000","last_change":"2023-12-16T03:25:14.939279+0000","last_active":"2023-12-16T03:25:16.437182+0000","last_peered":"2023-12-16T03:25:16.437182+0000","last_clean":"2023-12-16T03:25:16.437182+0000","last_became_active":"2023-12-16T03:25:14.938540+0000","last_became_peered":"2023-12-16T03:25:14.938540+0000","last_unstale":"2023-12-16T03:25:16.437182+0000","last_undegraded":"2023-12-16T03:25:16.437182+0000","last_fullsized":"2023-12-16T03:25:16.437182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437699+0000","last_change":"2023-12-16T03:25:15.427756+0000","last_active":"2023-12-16T03:25:16.437699+0000","last_peered":"2023-12-16T03:25:16.437699+0000","last_clean":"2023-12-16T03:25:16.437699+0000","last_became_active":"2023-12-16T03:25:15.427401+0000","last_became_peered":"2023-12-16T03:25:15.427401+0000","last_unstale":"2023-12-16T03:25:16.437699+0000","last_undegraded":"2023-12-16T03:25:16.437699+0000","last_fullsized":"2023-12-16T03:25:16.437699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:30.136715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436329+0000","last_change":"2023-12-16T03:25:14.947007+0000","last_active":"2023-12-16T03:25:16.436329+0000","last_peered":"2023-12-16T03:25:16.436329+0000","last_clean":"2023-12-16T03:25:16.436329+0000","last_became_active":"2023-12-16T03:25:14.946763+0000","last_became_peered":"2023-12-16T03:25:14.946763+0000","last_unstale":"2023-12-16T03:25:16.436329+0000","last_undegraded":"2023-12-16T03:25:16.436329+0000","last_fullsized":"2023-12-16T03:25:16.436329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:06.962968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.422510+0000","last_change":"2023-12-16T03:25:15.439566+0000","last_active":"2023-12-16T03:25:16.422510+0000","last_peered":"2023-12-16T03:25:16.422510+0000","last_clean":"2023-12-16T03:25:16.422510+0000","last_became_active":"2023-12-16T03:25:15.437769+0000","last_became_peered":"2023-12-16T03:25:15.437769+0000","last_unstale":"2023-12-16T03:25:16.422510+0000","last_undegraded":"2023-12-16T03:25:16.422510+0000","last_fullsized":"2023-12-16T03:25:16.422510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:07.969752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420174+0000","last_change":"2023-12-16T03:25:14.946813+0000","last_active":"2023-12-16T03:25:16.420174+0000","last_peered":"2023-12-16T03:25:16.420174+0000","last_clean":"2023-12-16T03:25:16.420174+0000","last_became_active":"2023-12-16T03:25:14.945910+0000","last_became_peered":"2023-12-16T03:25:14.945910+0000","last_unstale":"2023-12-16T03:25:16.420174+0000","last_undegraded":"2023-12-16T03:25:16.420174+0000","last_fullsized":"2023-12-16T03:25:16.420174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436674+0000","last_change":"2023-12-16T03:25:15.429536+0000","last_active":"2023-12-16T03:25:16.436674+0000","last_peered":"2023-12-16T03:25:16.436674+0000","last_clean":"2023-12-16T03:25:16.436674+0000","last_became_active":"2023-12-16T03:25:15.429171+0000","last_became_peered":"2023-12-16T03:25:15.429171+0000","last_unstale":"2023-12-16T03:25:16.436674+0000","last_undegraded":"2023-12-16T03:25:16.436674+0000","last_fullsized":"2023-12-16T03:25:16.436674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:31:27.331592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.420262+0000","last_change":"2023-12-16T03:25:14.947177+0000","last_active":"2023-12-16T03:25:16.420262+0000","last_peered":"2023-12-16T03:25:16.420262+0000","last_clean":"2023-12-16T03:25:16.420262+0000","last_became_active":"2023-12-16T03:25:14.946894+0000","last_became_peered":"2023-12-16T03:25:14.946894+0000","last_unstale":"2023-12-16T03:25:16.420262+0000","last_undegraded":"2023-12-16T03:25:16.420262+0000","last_fullsized":"2023-12-16T03:25:16.420262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:49.035320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437502+0000","last_change":"2023-12-16T03:25:15.428105+0000","last_active":"2023-12-16T03:25:16.437502+0000","last_peered":"2023-12-16T03:25:16.437502+0000","last_clean":"2023-12-16T03:25:16.437502+0000","last_became_active":"2023-12-16T03:25:15.426561+0000","last_became_peered":"2023-12-16T03:25:15.426561+0000","last_unstale":"2023-12-16T03:25:16.437502+0000","last_undegraded":"2023-12-16T03:25:16.437502+0000","last_fullsized":"2023-12-16T03:25:16.437502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436841+0000","last_change":"2023-12-16T03:25:14.952976+0000","last_active":"2023-12-16T03:25:16.436841+0000","last_peered":"2023-12-16T03:25:16.436841+0000","last_clean":"2023-12-16T03:25:16.436841+0000","last_became_active":"2023-12-16T03:25:14.952639+0000","last_became_peered":"2023-12-16T03:25:14.952639+0000","last_unstale":"2023-12-16T03:25:16.436841+0000","last_undegraded":"2023-12-16T03:25:16.436841+0000","last_fullsized":"2023-12-16T03:25:16.436841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:34.131498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436490+0000","last_change":"2023-12-16T03:25:15.450361+0000","last_active":"2023-12-16T03:25:16.436490+0000","last_peered":"2023-12-16T03:25:16.436490+0000","last_clean":"2023-12-16T03:25:16.436490+0000","last_became_active":"2023-12-16T03:25:15.450027+0000","last_became_peered":"2023-12-16T03:25:15.450027+0000","last_unstale":"2023-12-16T03:25:16.436490+0000","last_undegraded":"2023-12-16T03:25:16.436490+0000","last_fullsized":"2023-12-16T03:25:16.436490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:08:35.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423578+0000","last_change":"2023-12-16T03:25:15.442370+0000","last_active":"2023-12-16T03:25:16.423578+0000","last_peered":"2023-12-16T03:25:16.423578+0000","last_clean":"2023-12-16T03:25:16.423578+0000","last_became_active":"2023-12-16T03:25:15.442003+0000","last_became_peered":"2023-12-16T03:25:15.442003+0000","last_unstale":"2023-12-16T03:25:16.423578+0000","last_undegraded":"2023-12-16T03:25:16.423578+0000","last_fullsized":"2023-12-16T03:25:16.423578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:20:54.316492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437042+0000","last_change":"2023-12-16T03:25:14.955054+0000","last_active":"2023-12-16T03:25:16.437042+0000","last_peered":"2023-12-16T03:25:16.437042+0000","last_clean":"2023-12-16T03:25:16.437042+0000","last_became_active":"2023-12-16T03:25:14.954769+0000","last_became_peered":"2023-12-16T03:25:14.954769+0000","last_unstale":"2023-12-16T03:25:16.437042+0000","last_undegraded":"2023-12-16T03:25:16.437042+0000","last_fullsized":"2023-12-16T03:25:16.437042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.423008+0000","last_change":"2023-12-16T03:25:15.447590+0000","last_active":"2023-12-16T03:25:16.423008+0000","last_peered":"2023-12-16T03:25:16.423008+0000","last_clean":"2023-12-16T03:25:16.423008+0000","last_became_active":"2023-12-16T03:25:15.447289+0000","last_became_peered":"2023-12-16T03:25:15.447289+0000","last_unstale":"2023-12-16T03:25:16.423008+0000","last_undegraded":"2023-12-16T03:25:16.423008+0000","last_fullsized":"2023-12-16T03:25:16.423008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:01.943875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.436960+0000","last_change":"2023-12-16T03:25:14.953280+0000","last_active":"2023-12-16T03:25:16.436960+0000","last_peered":"2023-12-16T03:25:16.436960+0000","last_clean":"2023-12-16T03:25:16.436960+0000","last_became_active":"2023-12-16T03:25:14.952971+0000","last_became_peered":"2023-12-16T03:25:14.952971+0000","last_unstale":"2023-12-16T03:25:16.436960+0000","last_undegraded":"2023-12-16T03:25:16.436960+0000","last_fullsized":"2023-12-16T03:25:16.436960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437747+0000","last_change":"2023-12-16T03:25:15.433498+0000","last_active":"2023-12-16T03:25:16.437747+0000","last_peered":"2023-12-16T03:25:16.437747+0000","last_clean":"2023-12-16T03:25:16.437747+0000","last_became_active":"2023-12-16T03:25:15.433191+0000","last_became_peered":"2023-12-16T03:25:15.433191+0000","last_unstale":"2023-12-16T03:25:16.437747+0000","last_undegraded":"2023-12-16T03:25:16.437747+0000","last_fullsized":"2023-12-16T03:25:16.437747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:57.318834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437453+0000","last_change":"2023-12-16T03:25:14.938585+0000","last_active":"2023-12-16T03:25:16.437453+0000","last_peered":"2023-12-16T03:25:16.437453+0000","last_clean":"2023-12-16T03:25:16.437453+0000","last_became_active":"2023-12-16T03:25:14.938292+0000","last_became_peered":"2023-12-16T03:25:14.938292+0000","last_unstale":"2023-12-16T03:25:16.437453+0000","last_undegraded":"2023-12-16T03:25:16.437453+0000","last_fullsized":"2023-12-16T03:25:16.437453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:10.230137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437584+0000","last_change":"2023-12-16T03:25:15.440625+0000","last_active":"2023-12-16T03:25:16.437584+0000","last_peered":"2023-12-16T03:25:16.437584+0000","last_clean":"2023-12-16T03:25:16.437584+0000","last_became_active":"2023-12-16T03:25:15.440302+0000","last_became_peered":"2023-12-16T03:25:15.440302+0000","last_unstale":"2023-12-16T03:25:16.437584+0000","last_undegraded":"2023-12-16T03:25:16.437584+0000","last_fullsized":"2023-12-16T03:25:16.437584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:14.906925+0000","last_clean_scrub_stamp":"2023-12-16T03:25:14.906925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:10.549768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-16T03:25:16.437844+0000","last_change":"2023-12-16T03:25:14.942593+0000","last_active":"2023-12-16T03:25:16.437844+0000","last_peered":"2023-12-16T03:25:16.437844+0000","last_clean":"2023-12-16T03:25:16.437844+0000","last_became_active":"2023-12-16T03:25:14.942331+0000","last_became_peered":"2023-12-16T03:25:14.942331+0000","last_unstale":"2023-12-16T03:25:16.437844+0000","last_undegraded":"2023-12-16T03:25:16.437844+0000","last_fullsized":"2023-12-16T03:25:16.437844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:13.900142+0000","last_clean_scrub_stamp":"2023-12-16T03:25:13.900142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:35:06.612750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4990000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6870000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.194}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1689999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2759999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3479999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.4269999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6319999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5650000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7720000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0439999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8940000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3010000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1920000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3570000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:25:26.784 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-16T03:25:26.784 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-16T03:25:26.784 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-16T03:25:26.785 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-16T03:25:26.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9f05b2a640 1 Processor -- start 2023-12-16T03:25:26.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9f05b2a640 1 -- start start 2023-12-16T03:25:26.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9f05b2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9f00151dc0 0x7f9f000c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9f05b2a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f000c7ed0 0x7f9f00154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9f05b2a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f000ac4f0 con 0x7f9f000bd660 2023-12-16T03:25:26.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9f05b2a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f00158780 con 0x7f9f000c7ed0 2023-12-16T03:25:26.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9f05b2a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f00158a60 con 0x7f9f00151dc0 2023-12-16T03:25:26.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9efeffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f000c7ed0 0x7f9f00154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9efeffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f000c7ed0 0x7f9f00154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38896/0 (socket says 172.21.15.28:38896) 2023-12-16T03:25:26.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9efeffd640 1 -- 172.21.15.28:0/4051369205 learned_addr learned my addr 172.21.15.28:0/4051369205 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:26.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9eff7fe640 1 --2- 172.21.15.28:0/4051369205 >> v2:172.21.15.134:3300/0 conn(0x7f9f00151dc0 0x7f9f000c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9efeffd640 1 -- 172.21.15.28:0/4051369205 >> v2:172.21.15.134:3300/0 conn(0x7f9f00151dc0 msgr2=0x7f9f000c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:26.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9efeffd640 1 --2- 172.21.15.28:0/4051369205 >> v2:172.21.15.134:3300/0 conn(0x7f9f00151dc0 0x7f9f000c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9efeffd640 1 -- 172.21.15.28:0/4051369205 >> v1:172.21.15.134:6789/0 conn(0x7f9f000bd660 legacy=0x7f9f00154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.959+0000 7f9efeffd640 1 -- 172.21.15.28:0/4051369205 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f000ac180 con 0x7f9f000c7ed0 2023-12-16T03:25:26.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9efeffd640 1 --2- 172.21.15.28:0/4051369205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f000c7ed0 0x7f9f00154650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009870 tx=0x7f9ef401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304ed825cf66a1d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:26.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9efe7fc640 1 -- 172.21.15.28:0/4051369205 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40ab600 con 0x7f9f000c7ed0 2023-12-16T03:25:26.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9efe7fc640 1 -- 172.21.15.28:0/4051369205 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef40a7050 con 0x7f9f000c7ed0 2023-12-16T03:25:26.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9efe7fc640 1 -- 172.21.15.28:0/4051369205 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40ab980 con 0x7f9f000c7ed0 2023-12-16T03:25:26.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9f05b2a640 1 -- 172.21.15.28:0/4051369205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f000c7ed0 msgr2=0x7f9f00154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9f05b2a640 1 --2- 172.21.15.28:0/4051369205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f000c7ed0 0x7f9f00154650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009870 tx=0x7f9ef401c3e0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9f05b2a640 1 -- 172.21.15.28:0/4051369205 shutdown_connections 2023-12-16T03:25:26.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9f05b2a640 1 --2- 172.21.15.28:0/4051369205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f000c7ed0 0x7f9f00154650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9f05b2a640 1 --2- 172.21.15.28:0/4051369205 >> v2:172.21.15.134:3300/0 conn(0x7f9f00151dc0 0x7f9f000c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9f05b2a640 1 -- 172.21.15.28:0/4051369205 >> 172.21.15.28:0/4051369205 conn(0x7f9f00071eb0 msgr2=0x7f9f000722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:26.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9f05b2a640 1 -- 172.21.15.28:0/4051369205 shutdown_connections 2023-12-16T03:25:26.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.963+0000 7f9f05b2a640 1 -- 172.21.15.28:0/4051369205 wait complete. 2023-12-16T03:25:26.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9f05b2a640 1 Processor -- start 2023-12-16T03:25:26.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9f05b2a640 1 -- start start 2023-12-16T03:25:26.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9f05b2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f000bd660 0x7f9f000aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9f05b2a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f000c7ed0 0x7f9f00149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9f05b2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f00151dc0 0x7f9f00149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9f05b2a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00149fa0 con 0x7f9f000c7ed0 2023-12-16T03:25:26.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9f05b2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00157180 con 0x7f9f00151dc0 2023-12-16T03:25:26.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9f05b2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00156590 con 0x7f9f000bd660 2023-12-16T03:25:26.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9efeffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f000c7ed0 0x7f9f00149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9efeffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f000c7ed0 0x7f9f00149520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38898/0 (socket says 172.21.15.28:38898) 2023-12-16T03:25:26.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9efeffd640 1 -- 172.21.15.28:0/3350741234 learned_addr learned my addr 172.21.15.28:0/3350741234 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:26.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9efffff640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f00151dc0 0x7f9f00149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9eff7fe640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f000bd660 0x7f9f000aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9efeffd640 1 -- 172.21.15.28:0/3350741234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f000bd660 msgr2=0x7f9f000aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9efeffd640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f000bd660 0x7f9f000aac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9efeffd640 1 -- 172.21.15.28:0/3350741234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f00151dc0 msgr2=0x7f9f00149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9efeffd640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f00151dc0 0x7f9f00149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9efeffd640 1 -- 172.21.15.28:0/3350741234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef40094d0 con 0x7f9f000c7ed0 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9eff7fe640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f000bd660 0x7f9f000aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9efffff640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f00151dc0 0x7f9f00149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9efeffd640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f000c7ed0 0x7f9f00149520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4018ff0 tx=0x7f9ef4019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9ee7fff640 1 -- 172.21.15.28:0/3350741234 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40b37d0 con 0x7f9f000c7ed0 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9ee7fff640 1 -- 172.21.15.28:0/3350741234 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef40b3930 con 0x7f9f000c7ed0 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9ee7fff640 1 -- 172.21.15.28:0/3350741234 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40b3cc0 con 0x7f9f000c7ed0 2023-12-16T03:25:26.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9f05b2a640 1 -- 172.21.15.28:0/3350741234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f00156b30 con 0x7f9f000c7ed0 2023-12-16T03:25:26.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9f05b2a640 1 -- 172.21.15.28:0/3350741234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f000c8f00 con 0x7f9f000c7ed0 2023-12-16T03:25:26.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.967+0000 7f9f05b2a640 1 -- 172.21.15.28:0/3350741234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0014a100 con 0x7f9f000c7ed0 2023-12-16T03:25:26.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.971+0000 7f9ee7fff640 1 -- 172.21.15.28:0/3350741234 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9ef40b2070 con 0x7f9f000c7ed0 2023-12-16T03:25:26.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.971+0000 7f9ee7fff640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9eec066470 0x7f9eec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:26.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.971+0000 7f9ee7fff640 1 -- 172.21.15.28:0/3350741234 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ef411e1b0 con 0x7f9f000c7ed0 2023-12-16T03:25:26.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.971+0000 7f9eff7fe640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9eec066470 0x7f9eec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.971+0000 7f9eff7fe640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9eec066470 0x7f9eec068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009840 tx=0x7f9ef0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:26.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:26.975+0000 7f9ee7fff640 1 -- 172.21.15.28:0/3350741234 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9f0014a100 con 0x7f9f000c7ed0 2023-12-16T03:25:27.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.163+0000 7f9f05b2a640 1 -- 172.21.15.28:0/3350741234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9f0014a100 con 0x7f9f000c7ed0 2023-12-16T03:25:27.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9ee7fff640 1 -- 172.21.15.28:0/3350741234 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9f0014a100 con 0x7f9f000c7ed0 2023-12-16T03:25:27.169 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:27.169 INFO:teuthology.orchestra.run.smithi028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-16T03:25:27.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 -- 172.21.15.28:0/3350741234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9eec066470 msgr2=0x7f9eec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9eec066470 0x7f9eec068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009840 tx=0x7f9ef0008040 comp rx=0 tx=0).stop 2023-12-16T03:25:27.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 -- 172.21.15.28:0/3350741234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f000c7ed0 msgr2=0x7f9f00149520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f000c7ed0 0x7f9f00149520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4018ff0 tx=0x7f9ef4019180 comp rx=0 tx=0).stop 2023-12-16T03:25:27.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 -- 172.21.15.28:0/3350741234 shutdown_connections 2023-12-16T03:25:27.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f00151dc0 0x7f9f00149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9eec066470 0x7f9eec068930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f000c7ed0 0x7f9f00149520 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 --2- 172.21.15.28:0/3350741234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f000bd660 0x7f9f000aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 -- 172.21.15.28:0/3350741234 >> 172.21.15.28:0/3350741234 conn(0x7f9f00071eb0 msgr2=0x7f9f00072290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:27.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 -- 172.21.15.28:0/3350741234 shutdown_connections 2023-12-16T03:25:27.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.167+0000 7f9f05b2a640 1 -- 172.21.15.28:0/3350741234 wait complete. 2023-12-16T03:25:27.190 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-16T03:25:27.190 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:27.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effba8ad640 1 Processor -- start 2023-12-16T03:25:27.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effba8ad640 1 -- start start 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effba8ad640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7effb4151dc0 0x7effb40c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effba8ad640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7effb40bd660 0x7effb4154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effba8ad640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40ac4f0 con 0x7effb40c7ed0 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effba8ad640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb4158780 con 0x7effb40bd660 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effba8ad640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb4158a60 con 0x7effb4151dc0 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effb8e4a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7effb40bd660 0x7effb4154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effb37fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7effb40c7ed0 0x7effb4154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57958/0 (socket says 172.21.15.28:57958) 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effb37fe640 1 -- 172.21.15.28:0/4154170376 learned_addr learned my addr 172.21.15.28:0/4154170376 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effb3fff640 1 --2- 172.21.15.28:0/4154170376 >> v2:172.21.15.134:3300/0 conn(0x7effb4151dc0 0x7effb40c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effb8e4a640 1 -- 172.21.15.28:0/4154170376 >> v2:172.21.15.134:3300/0 conn(0x7effb4151dc0 msgr2=0x7effb40c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effb8e4a640 1 --2- 172.21.15.28:0/4154170376 >> v2:172.21.15.134:3300/0 conn(0x7effb4151dc0 0x7effb40c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effb8e4a640 1 -- 172.21.15.28:0/4154170376 >> v1:172.21.15.28:6789/0 conn(0x7effb40c7ed0 legacy=0x7effb4154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effb2ffd640 1 -- 172.21.15.28:0/4154170376 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202871250 0 0) 0x7effb40ac4f0 con 0x7effb40c7ed0 2023-12-16T03:25:27.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.331+0000 7effb8e4a640 1 -- 172.21.15.28:0/4154170376 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40ac180 con 0x7effb40bd660 2023-12-16T03:25:27.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effb8e4a640 1 --2- 172.21.15.28:0/4154170376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effb40bd660 0x7effb4154d60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7effac009d90 tx=0x7effac01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea99dd9e8cef297 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:27.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effb2ffd640 1 -- 172.21.15.28:0/4154170376 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0a5740 con 0x7effb40bd660 2023-12-16T03:25:27.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effb2ffd640 1 -- 172.21.15.28:0/4154170376 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0a58a0 con 0x7effb40bd660 2023-12-16T03:25:27.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effb2ffd640 1 -- 172.21.15.28:0/4154170376 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0a5c30 con 0x7effb40bd660 2023-12-16T03:25:27.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effba8ad640 1 -- 172.21.15.28:0/4154170376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effb40bd660 msgr2=0x7effb4154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effba8ad640 1 --2- 172.21.15.28:0/4154170376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effb40bd660 0x7effb4154d60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7effac009d90 tx=0x7effac01c7f0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effba8ad640 1 -- 172.21.15.28:0/4154170376 shutdown_connections 2023-12-16T03:25:27.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effba8ad640 1 --2- 172.21.15.28:0/4154170376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effb40bd660 0x7effb4154d60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effba8ad640 1 --2- 172.21.15.28:0/4154170376 >> v2:172.21.15.134:3300/0 conn(0x7effb4151dc0 0x7effb40c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effba8ad640 1 -- 172.21.15.28:0/4154170376 >> 172.21.15.28:0/4154170376 conn(0x7effb4071eb0 msgr2=0x7effb40722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:27.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effba8ad640 1 -- 172.21.15.28:0/4154170376 shutdown_connections 2023-12-16T03:25:27.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effba8ad640 1 -- 172.21.15.28:0/4154170376 wait complete. 2023-12-16T03:25:27.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effba8ad640 1 Processor -- start 2023-12-16T03:25:27.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.335+0000 7effba8ad640 1 -- start start 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effba8ad640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effb40bd660 0x7effb40bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effba8ad640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effb40c7ed0 0x7effb4156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effba8ad640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effb4151dc0 0x7effb40beb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effba8ad640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb4154ee0 con 0x7effb40bd660 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effba8ad640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40a9da0 con 0x7effb4151dc0 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effba8ad640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb40aa080 con 0x7effb40c7ed0 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effb40bd660 0x7effb40bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effb40bd660 0x7effb40bfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38920/0 (socket says 172.21.15.28:38920) 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb3fff640 1 -- 172.21.15.28:0/164201968 learned_addr learned my addr 172.21.15.28:0/164201968 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb8e4a640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effb4151dc0 0x7effb40beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb37fe640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effb40c7ed0 0x7effb4156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb3fff640 1 -- 172.21.15.28:0/164201968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effb40c7ed0 msgr2=0x7effb4156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb3fff640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effb40c7ed0 0x7effb4156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb3fff640 1 -- 172.21.15.28:0/164201968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effb4151dc0 msgr2=0x7effb40beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb3fff640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effb4151dc0 0x7effb40beb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb3fff640 1 -- 172.21.15.28:0/164201968 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac009a70 con 0x7effb40bd660 2023-12-16T03:25:27.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb37fe640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effb40c7ed0 0x7effb4156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:27.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb3fff640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effb40bd660 0x7effb40bfe00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7effa400d800 tx=0x7effa400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:27.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb0ff9640 1 -- 172.21.15.28:0/164201968 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400b6c0 con 0x7effb40bd660 2023-12-16T03:25:27.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb0ff9640 1 -- 172.21.15.28:0/164201968 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa400b820 con 0x7effb40bd660 2023-12-16T03:25:27.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effba8ad640 1 -- 172.21.15.28:0/164201968 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb40aa360 con 0x7effb40bd660 2023-12-16T03:25:27.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effb0ff9640 1 -- 172.21.15.28:0/164201968 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400bb90 con 0x7effb40bd660 2023-12-16T03:25:27.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effba8ad640 1 -- 172.21.15.28:0/164201968 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb40aa920 con 0x7effb40bd660 2023-12-16T03:25:27.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.339+0000 7effba8ad640 1 -- 172.21.15.28:0/164201968 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb4068400 con 0x7effb40bd660 2023-12-16T03:25:27.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.343+0000 7effb0ff9640 1 -- 172.21.15.28:0/164201968 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7effa400bcf0 con 0x7effb40bd660 2023-12-16T03:25:27.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.343+0000 7effb0ff9640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7effa00664a0 0x7effa0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.343+0000 7effb0ff9640 1 -- 172.21.15.28:0/164201968 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effa4084300 con 0x7effb40bd660 2023-12-16T03:25:27.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.343+0000 7effb37fe640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7effa00664a0 0x7effa0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.343+0000 7effb37fe640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7effa00664a0 0x7effa0068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7effa8007fd0 tx=0x7effa8007c20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.347+0000 7effb0ff9640 1 -- 172.21.15.28:0/164201968 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7effa4051780 con 0x7effb40bd660 2023-12-16T03:25:27.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 -- 172.21.15.28:0/164201968 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effb415edb0 con 0x7effb40bd660 2023-12-16T03:25:27.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effb0ff9640 1 -- 172.21.15.28:0/164201968 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7effa4054da0 con 0x7effb40bd660 2023-12-16T03:25:27.510 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:27.510 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 -- 172.21.15.28:0/164201968 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7effa00664a0 msgr2=0x7effa0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7effa00664a0 0x7effa0068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7effa8007fd0 tx=0x7effa8007c20 comp rx=0 tx=0).stop 2023-12-16T03:25:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 -- 172.21.15.28:0/164201968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effb40bd660 msgr2=0x7effb40bfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effb40bd660 0x7effb40bfe00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7effa400d800 tx=0x7effa400dcc0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 -- 172.21.15.28:0/164201968 shutdown_connections 2023-12-16T03:25:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effb4151dc0 0x7effb40beb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effb40c7ed0 0x7effb4156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7effa00664a0 0x7effa0068960 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 --2- 172.21.15.28:0/164201968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7effb40bd660 0x7effb40bfe00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 -- 172.21.15.28:0/164201968 >> 172.21.15.28:0/164201968 conn(0x7effb4071eb0 msgr2=0x7effb40c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 -- 172.21.15.28:0/164201968 shutdown_connections 2023-12-16T03:25:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.507+0000 7effba8ad640 1 -- 172.21.15.28:0/164201968 wait complete. 2023-12-16T03:25:27.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:25:13.885447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:25:14.309086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:27.532 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:27.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.675+0000 7f00f8565640 1 Processor -- start 2023-12-16T03:25:27.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.675+0000 7f00f8565640 1 -- start start 2023-12-16T03:25:27.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.675+0000 7f00f8565640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f00f00c63c0 0x7f00f00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.675+0000 7f00f8565640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00f00c4100 0x7f00f00c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.675+0000 7f00f8565640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f00f00c29e0 0x7f00f00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.675+0000 7f00f8565640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f00c31c0 con 0x7f00f00c63c0 2023-12-16T03:25:27.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.675+0000 7f00f8565640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f00c34a0 con 0x7f00f00c29e0 2023-12-16T03:25:27.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.675+0000 7f00f8565640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f00c1030 con 0x7f00f00c4100 2023-12-16T03:25:27.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f6301640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f00f00c63c0 0x7f00f00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f6301640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f00f00c63c0 0x7f00f00c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38922/0 (socket says 172.21.15.28:38922) 2023-12-16T03:25:27.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f6301640 1 -- 172.21.15.28:0/2247281901 learned_addr learned my addr 172.21.15.28:0/2247281901 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:27.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f6b02640 1 --2- 172.21.15.28:0/2247281901 >> v2:172.21.15.134:3300/0 conn(0x7f00f00c29e0 0x7f00f00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f5b00640 1 --2- 172.21.15.28:0/2247281901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00f00c4100 0x7f00f00c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f6301640 1 -- 172.21.15.28:0/2247281901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00f00c4100 msgr2=0x7f00f00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:27.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f6301640 1 --2- 172.21.15.28:0/2247281901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00f00c4100 0x7f00f00c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f6301640 1 -- 172.21.15.28:0/2247281901 >> v2:172.21.15.134:3300/0 conn(0x7f00f00c29e0 msgr2=0x7f00f00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:27.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f6301640 1 --2- 172.21.15.28:0/2247281901 >> v2:172.21.15.134:3300/0 conn(0x7f00f00c29e0 0x7f00f00a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f6301640 1 -- 172.21.15.28:0/2247281901 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f00c1310 con 0x7f00f00c63c0 2023-12-16T03:25:27.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f6301640 1 --2- 172.21.15.28:0/2247281901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f00c63c0 0x7f00f00c06d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f00f00a5760 tx=0x7f00ec01ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f85caa69366d48 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:27.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f52ff640 1 -- 172.21.15.28:0/2247281901 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f00aa3d0 con 0x7f00f00c63c0 2023-12-16T03:25:27.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f52ff640 1 -- 172.21.15.28:0/2247281901 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec0a7b30 con 0x7f00f00c63c0 2023-12-16T03:25:27.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.679+0000 7f00f52ff640 1 -- 172.21.15.28:0/2247281901 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0af440 con 0x7f00f00c63c0 2023-12-16T03:25:27.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 -- 172.21.15.28:0/2247281901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f00c63c0 msgr2=0x7f00f00c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 --2- 172.21.15.28:0/2247281901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f00c63c0 0x7f00f00c06d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f00f00a5760 tx=0x7f00ec01ea80 comp rx=0 tx=0).stop 2023-12-16T03:25:27.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 -- 172.21.15.28:0/2247281901 shutdown_connections 2023-12-16T03:25:27.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 --2- 172.21.15.28:0/2247281901 >> v2:172.21.15.134:3300/0 conn(0x7f00f00c29e0 0x7f00f00a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 --2- 172.21.15.28:0/2247281901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00f00c4100 0x7f00f00c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 --2- 172.21.15.28:0/2247281901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f00c63c0 0x7f00f00c06d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 -- 172.21.15.28:0/2247281901 >> 172.21.15.28:0/2247281901 conn(0x7f00f006a5b0 msgr2=0x7f00f006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:27.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 -- 172.21.15.28:0/2247281901 shutdown_connections 2023-12-16T03:25:27.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 -- 172.21.15.28:0/2247281901 wait complete. 2023-12-16T03:25:27.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 Processor -- start 2023-12-16T03:25:27.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 -- start start 2023-12-16T03:25:27.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00f00c29e0 0x7f00f0152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f00c4100 0x7f00f014b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00f00c63c0 0x7f00f014b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f014d140 con 0x7f00f00c4100 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f014bea0 con 0x7f00f00c63c0 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f8565640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f014e090 con 0x7f00f00c29e0 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f5b00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f00c4100 0x7f00f014b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f5b00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f00c4100 0x7f00f014b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38932/0 (socket says 172.21.15.28:38932) 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f5b00640 1 -- 172.21.15.28:0/670269470 learned_addr learned my addr 172.21.15.28:0/670269470 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f6301640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00f00c29e0 0x7f00f0152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.683+0000 7f00f6b02640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00f00c63c0 0x7f00f014b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00f5b00640 1 -- 172.21.15.28:0/670269470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00f00c29e0 msgr2=0x7f00f0152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00f5b00640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00f00c29e0 0x7f00f0152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00f5b00640 1 -- 172.21.15.28:0/670269470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00f00c63c0 msgr2=0x7f00f014b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00f5b00640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00f00c63c0 0x7f00f014b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00f5b00640 1 -- 172.21.15.28:0/670269470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec00b770 con 0x7f00f00c4100 2023-12-16T03:25:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00f5b00640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f00c4100 0x7f00f014b070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f00e000d800 tx=0x7f00e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00e6ffd640 1 -- 172.21.15.28:0/670269470 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000b6c0 con 0x7f00f00c4100 2023-12-16T03:25:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00e6ffd640 1 -- 172.21.15.28:0/670269470 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e000b820 con 0x7f00f00c4100 2023-12-16T03:25:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00f8565640 1 -- 172.21.15.28:0/670269470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f00c69b0 con 0x7f00f00c4100 2023-12-16T03:25:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00e6ffd640 1 -- 172.21.15.28:0/670269470 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000bb90 con 0x7f00f00c4100 2023-12-16T03:25:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00f8565640 1 -- 172.21.15.28:0/670269470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f0153070 con 0x7f00f00c4100 2023-12-16T03:25:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00f8565640 1 -- 172.21.15.28:0/670269470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f014dee0 con 0x7f00f00c4100 2023-12-16T03:25:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00e6ffd640 1 -- 172.21.15.28:0/670269470 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f00e000bcf0 con 0x7f00f00c4100 2023-12-16T03:25:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00e6ffd640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f00d4066470 0x7f00d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00e6ffd640 1 -- 172.21.15.28:0/670269470 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00e0084290 con 0x7f00f00c4100 2023-12-16T03:25:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.687+0000 7f00f6301640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f00d4066470 0x7f00d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.691+0000 7f00f6301640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f00d4066470 0x7f00d4068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0b1000 tx=0x7f00ec0a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.691+0000 7f00e6ffd640 1 -- 172.21.15.28:0/670269470 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f00e00517b0 con 0x7f00f00c4100 2023-12-16T03:25:27.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.851+0000 7f00f8565640 1 -- 172.21.15.28:0/670269470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00f014c0c0 con 0x7f00f00c4100 2023-12-16T03:25:27.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00e6ffd640 1 -- 172.21.15.28:0/670269470 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00e0054dd0 con 0x7f00f00c4100 2023-12-16T03:25:27.857 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 -- 172.21.15.28:0/670269470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f00d4066470 msgr2=0x7f00d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f00d4066470 0x7f00d4068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0b1000 tx=0x7f00ec0a9070 comp rx=0 tx=0).stop 2023-12-16T03:25:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 -- 172.21.15.28:0/670269470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f00c4100 msgr2=0x7f00f014b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f00c4100 0x7f00f014b070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f00e000d800 tx=0x7f00e000dcc0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 -- 172.21.15.28:0/670269470 shutdown_connections 2023-12-16T03:25:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00f00c63c0 0x7f00f014b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f00d4066470 0x7f00d4068930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f00c4100 0x7f00f014b070 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 --2- 172.21.15.28:0/670269470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f00f00c29e0 0x7f00f0152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 -- 172.21.15.28:0/670269470 >> 172.21.15.28:0/670269470 conn(0x7f00f006a5b0 msgr2=0x7f00f00a57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:27.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 -- 172.21.15.28:0/670269470 shutdown_connections 2023-12-16T03:25:27.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:27.855+0000 7f00f8565640 1 -- 172.21.15.28:0/670269470 wait complete. 2023-12-16T03:25:27.878 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:25:28.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.019+0000 7fe005617640 1 Processor -- start 2023-12-16T03:25:28.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.019+0000 7fe005617640 1 -- start start 2023-12-16T03:25:28.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fe005617640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe0000c7cd0 0x7fe00015fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fe005617640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0000c5190 con 0x7fe00006ac20 2023-12-16T03:25:28.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fe005617640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00006bc20 con 0x7fe0000c4970 2023-12-16T03:25:28.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fe005617640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000c65d0 con 0x7fe0000c7cd0 2023-12-16T03:25:28.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fdffeffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe00006ac20 0x7fe0000c5ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57972/0 (socket says 172.21.15.28:57972) 2023-12-16T03:25:28.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fdffeffd640 1 -- 172.21.15.28:0/2669190812 learned_addr learned my addr 172.21.15.28:0/2669190812 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:28.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fdfff7fe640 1 --2- 172.21.15.28:0/2669190812 >> v2:172.21.15.134:3300/0 conn(0x7fe0000c7cd0 0x7fe00015fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fdffe7fc640 1 -- 172.21.15.28:0/2669190812 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023308732 0 0) 0x7fe0000c5190 con 0x7fe00006ac20 2023-12-16T03:25:28.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fdffe7fc640 1 -- 172.21.15.28:0/2669190812 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfec003530 con 0x7fe00006ac20 2023-12-16T03:25:28.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fdffe7fc640 1 -- 172.21.15.28:0/2669190812 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621942632 0 0) 0x7fe00006bc20 con 0x7fe0000c4970 2023-12-16T03:25:28.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fdffe7fc640 1 -- 172.21.15.28:0/2669190812 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0000c5190 con 0x7fe0000c4970 2023-12-16T03:25:28.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fdffe7fc640 1 -- 172.21.15.28:0/2669190812 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1666012922 0 0) 0x7fdfec003530 con 0x7fe00006ac20 2023-12-16T03:25:28.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fdfff7fe640 1 -- 172.21.15.28:0/2669190812 >> v1:172.21.15.134:6789/0 conn(0x7fe0000c4970 legacy=0x7fe00006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fdfff7fe640 1 -- 172.21.15.28:0/2669190812 >> v1:172.21.15.28:6789/0 conn(0x7fe00006ac20 legacy=0x7fe0000c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.023+0000 7fdfff7fe640 1 -- 172.21.15.28:0/2669190812 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe000152080 con 0x7fe0000c7cd0 2023-12-16T03:25:28.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fdfff7fe640 1 --2- 172.21.15.28:0/2669190812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0000c7cd0 0x7fe00015fde0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009dc0 tx=0x7fdff801c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e33f759529aba31 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:28.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fdffe7fc640 1 -- 172.21.15.28:0/2669190812 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0001680 con 0x7fe0000c7cd0 2023-12-16T03:25:28.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fdffe7fc640 1 -- 172.21.15.28:0/2669190812 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff80a64b0 con 0x7fe0000c7cd0 2023-12-16T03:25:28.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fdffe7fc640 1 -- 172.21.15.28:0/2669190812 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff80a6820 con 0x7fe0000c7cd0 2023-12-16T03:25:28.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fe005617640 1 -- 172.21.15.28:0/2669190812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0000c7cd0 msgr2=0x7fe00015fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fe005617640 1 --2- 172.21.15.28:0/2669190812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0000c7cd0 0x7fe00015fde0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009dc0 tx=0x7fdff801c730 comp rx=0 tx=0).stop 2023-12-16T03:25:28.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fe005617640 1 -- 172.21.15.28:0/2669190812 shutdown_connections 2023-12-16T03:25:28.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fe005617640 1 --2- 172.21.15.28:0/2669190812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0000c7cd0 0x7fe00015fde0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fe005617640 1 -- 172.21.15.28:0/2669190812 >> 172.21.15.28:0/2669190812 conn(0x7fe0000ab8c0 msgr2=0x7fe0000abca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:28.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fe005617640 1 -- 172.21.15.28:0/2669190812 shutdown_connections 2023-12-16T03:25:28.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fe005617640 1 -- 172.21.15.28:0/2669190812 wait complete. 2023-12-16T03:25:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fe005617640 1 Processor -- start 2023-12-16T03:25:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.027+0000 7fe005617640 1 -- start start 2023-12-16T03:25:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fe005617640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe00006ac20 0x7fe00013ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fe005617640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0000c4970 0x7fe0001efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fe005617640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000c7cd0 0x7fe0001f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fe005617640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000c3070 con 0x7fe0000c4970 2023-12-16T03:25:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fe005617640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000146b90 con 0x7fe00006ac20 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fe005617640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0001f09b0 con 0x7fe0000c7cd0 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0000c4970 0x7fe0001efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0000c4970 0x7fe0001efbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38948/0 (socket says 172.21.15.28:38948) 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff7fff640 1 -- 172.21.15.28:0/455363412 learned_addr learned my addr 172.21.15.28:0/455363412 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdfff7fe640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000c7cd0 0x7fe0001f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdffeffd640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe00006ac20 0x7fe00013ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff7fff640 1 -- 172.21.15.28:0/455363412 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000c7cd0 msgr2=0x7fe0001f0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff7fff640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000c7cd0 0x7fe0001f0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff7fff640 1 -- 172.21.15.28:0/455363412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe00006ac20 msgr2=0x7fe00013ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff7fff640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe00006ac20 0x7fe00013ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff7fff640 1 -- 172.21.15.28:0/455363412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8009a70 con 0x7fe0000c4970 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdfff7fe640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000c7cd0 0x7fe0001f0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdffeffd640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe00006ac20 0x7fe00013ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff7fff640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0000c4970 0x7fe0001efbc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c490 tx=0x7fdfe800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff77fe640 1 -- 172.21.15.28:0/455363412 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe80052d0 con 0x7fe0000c4970 2023-12-16T03:25:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff77fe640 1 -- 172.21.15.28:0/455363412 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe8005430 con 0x7fe0000c4970 2023-12-16T03:25:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fe005617640 1 -- 172.21.15.28:0/455363412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe000146e50 con 0x7fe0000c4970 2023-12-16T03:25:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff77fe640 1 -- 172.21.15.28:0/455363412 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8012870 con 0x7fe0000c4970 2023-12-16T03:25:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fe005617640 1 -- 172.21.15.28:0/455363412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0000c3d40 con 0x7fe0000c4970 2023-12-16T03:25:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fe005617640 1 -- 172.21.15.28:0/455363412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe000147300 con 0x7fe0000c4970 2023-12-16T03:25:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.031+0000 7fdff77fe640 1 -- 172.21.15.28:0/455363412 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdfe80129d0 con 0x7fe0000c4970 2023-12-16T03:25:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.035+0000 7fdff77fe640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfe0066470 0x7fdfe0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.035+0000 7fdff77fe640 1 -- 172.21.15.28:0/455363412 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfe8083a60 con 0x7fe0000c4970 2023-12-16T03:25:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.035+0000 7fdffeffd640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfe0066470 0x7fdfe0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.035+0000 7fdffeffd640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfe0066470 0x7fdfe0068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdff00011f0 tx=0x7fdff0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:28.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.039+0000 7fdff77fe640 1 -- 172.21.15.28:0/455363412 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdfe8050ed0 con 0x7fe0000c4970 2023-12-16T03:25:28.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 -- 172.21.15.28:0/455363412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe00004e850 con 0x7fe0000c4970 2023-12-16T03:25:28.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fdff77fe640 1 -- 172.21.15.28:0/455363412 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfe80544f0 con 0x7fe0000c4970 2023-12-16T03:25:28.198 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:25:28.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 -- 172.21.15.28:0/455363412 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfe0066470 msgr2=0x7fdfe0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfe0066470 0x7fdfe0068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdff00011f0 tx=0x7fdff0009040 comp rx=0 tx=0).stop 2023-12-16T03:25:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 -- 172.21.15.28:0/455363412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0000c4970 msgr2=0x7fe0001efbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0000c4970 0x7fe0001efbc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c490 tx=0x7fdfe800c950 comp rx=0 tx=0).stop 2023-12-16T03:25:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 -- 172.21.15.28:0/455363412 shutdown_connections 2023-12-16T03:25:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000c7cd0 0x7fe0001f0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfe0066470 0x7fdfe0068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0000c4970 0x7fe0001efbc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 --2- 172.21.15.28:0/455363412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe00006ac20 0x7fe00013ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 -- 172.21.15.28:0/455363412 >> 172.21.15.28:0/455363412 conn(0x7fe0000ab8c0 msgr2=0x7fe0000c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 -- 172.21.15.28:0/455363412 shutdown_connections 2023-12-16T03:25:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.195+0000 7fe005617640 1 -- 172.21.15.28:0/455363412 wait complete. 2023-12-16T03:25:28.220 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:25:28.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a1a71d640 1 Processor -- start 2023-12-16T03:25:28.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a1a71d640 1 -- start start 2023-12-16T03:25:28.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a1a71d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1a140c2840 0x7f1a140c1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a1a71d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a14157cd0 con 0x7f1a140a6c60 2023-12-16T03:25:28.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a1a71d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a14158850 con 0x7f1a141578f0 2023-12-16T03:25:28.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a1a71d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a140c2e00 con 0x7f1a140c2840 2023-12-16T03:25:28.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a137fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1a140a6c60 0x7f1a140c1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57980/0 (socket says 172.21.15.28:57980) 2023-12-16T03:25:28.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a137fe640 1 -- 172.21.15.28:0/2092200431 learned_addr learned my addr 172.21.15.28:0/2092200431 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a18cba640 1 --2- 172.21.15.28:0/2092200431 >> v2:172.21.15.134:3300/0 conn(0x7f1a140c2840 0x7f1a140c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a12ffd640 1 -- 172.21.15.28:0/2092200431 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642722766 0 0) 0x7f1a14157cd0 con 0x7f1a140a6c60 2023-12-16T03:25:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a12ffd640 1 -- 172.21.15.28:0/2092200431 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19fc003530 con 0x7f1a140a6c60 2023-12-16T03:25:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a12ffd640 1 -- 172.21.15.28:0/2092200431 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571622152 0 0) 0x7f1a14158850 con 0x7f1a141578f0 2023-12-16T03:25:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a12ffd640 1 -- 172.21.15.28:0/2092200431 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a14157cd0 con 0x7f1a141578f0 2023-12-16T03:25:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a18cba640 1 -- 172.21.15.28:0/2092200431 >> v1:172.21.15.134:6789/0 conn(0x7f1a141578f0 legacy=0x7f1a140c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a18cba640 1 -- 172.21.15.28:0/2092200431 >> v1:172.21.15.28:6789/0 conn(0x7f1a140a6c60 legacy=0x7f1a140c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.363+0000 7f1a18cba640 1 -- 172.21.15.28:0/2092200431 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14157f20 con 0x7f1a140c2840 2023-12-16T03:25:28.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.367+0000 7f1a18cba640 1 --2- 172.21.15.28:0/2092200431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a140c2840 0x7f1a140c1980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009d90 tx=0x7f1a0c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fc349821d116975 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:28.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.367+0000 7f1a12ffd640 1 -- 172.21.15.28:0/2092200431 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0a5870 con 0x7f1a140c2840 2023-12-16T03:25:28.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.367+0000 7f1a12ffd640 1 -- 172.21.15.28:0/2092200431 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c0a59d0 con 0x7f1a140c2840 2023-12-16T03:25:28.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.367+0000 7f1a12ffd640 1 -- 172.21.15.28:0/2092200431 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0a5d60 con 0x7f1a140c2840 2023-12-16T03:25:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.367+0000 7f1a1a71d640 1 -- 172.21.15.28:0/2092200431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a140c2840 msgr2=0x7f1a140c1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.367+0000 7f1a1a71d640 1 --2- 172.21.15.28:0/2092200431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a140c2840 0x7f1a140c1980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009d90 tx=0x7f1a0c01c8c0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.367+0000 7f1a1a71d640 1 -- 172.21.15.28:0/2092200431 shutdown_connections 2023-12-16T03:25:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.367+0000 7f1a1a71d640 1 --2- 172.21.15.28:0/2092200431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a140c2840 0x7f1a140c1980 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.367+0000 7f1a1a71d640 1 -- 172.21.15.28:0/2092200431 >> 172.21.15.28:0/2092200431 conn(0x7f1a140c7e40 msgr2=0x7f1a140c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.367+0000 7f1a1a71d640 1 -- 172.21.15.28:0/2092200431 shutdown_connections 2023-12-16T03:25:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.367+0000 7f1a1a71d640 1 -- 172.21.15.28:0/2092200431 wait complete. 2023-12-16T03:25:28.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a1a71d640 1 Processor -- start 2023-12-16T03:25:28.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a1a71d640 1 -- start start 2023-12-16T03:25:28.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a1a71d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a140a6c60 0x7f1a1406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a1a71d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a140c2840 0x7f1a1414b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a1a71d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a141578f0 0x7f1a14150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a1a71d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1406e920 con 0x7f1a140c2840 2023-12-16T03:25:28.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a1a71d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a141534b0 con 0x7f1a141578f0 2023-12-16T03:25:28.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a1a71d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14153790 con 0x7f1a140a6c60 2023-12-16T03:25:28.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a137fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a140c2840 0x7f1a1414b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a137fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a140c2840 0x7f1a1414b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38952/0 (socket says 172.21.15.28:38952) 2023-12-16T03:25:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a137fe640 1 -- 172.21.15.28:0/4028636719 learned_addr learned my addr 172.21.15.28:0/4028636719 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a13fff640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a140a6c60 0x7f1a1406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a18cba640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a141578f0 0x7f1a14150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a137fe640 1 -- 172.21.15.28:0/4028636719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a140a6c60 msgr2=0x7f1a1406ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a137fe640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a140a6c60 0x7f1a1406ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a137fe640 1 -- 172.21.15.28:0/4028636719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a141578f0 msgr2=0x7f1a14150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a137fe640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a141578f0 0x7f1a14150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a137fe640 1 -- 172.21.15.28:0/4028636719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c009a70 con 0x7f1a140c2840 2023-12-16T03:25:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a13fff640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a140a6c60 0x7f1a1406ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a137fe640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a140c2840 0x7f1a1414b6e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1a08005890 tx=0x7f1a0800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a10ff9640 1 -- 172.21.15.28:0/4028636719 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08005cf0 con 0x7f1a140c2840 2023-12-16T03:25:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a10ff9640 1 -- 172.21.15.28:0/4028636719 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a08005e50 con 0x7f1a140c2840 2023-12-16T03:25:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a10ff9640 1 -- 172.21.15.28:0/4028636719 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080072b0 con 0x7f1a140c2840 2023-12-16T03:25:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a1a71d640 1 -- 172.21.15.28:0/4028636719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a14153a70 con 0x7f1a140c2840 2023-12-16T03:25:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.371+0000 7f1a1a71d640 1 -- 172.21.15.28:0/4028636719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1406e540 con 0x7f1a140c2840 2023-12-16T03:25:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.375+0000 7f1a1a71d640 1 -- 172.21.15.28:0/4028636719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1406ea60 con 0x7f1a140c2840 2023-12-16T03:25:28.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.375+0000 7f1a10ff9640 1 -- 172.21.15.28:0/4028636719 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1a08007410 con 0x7f1a140c2840 2023-12-16T03:25:28.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.375+0000 7f1a10ff9640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1a00066470 0x7f1a00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.375+0000 7f1a10ff9640 1 -- 172.21.15.28:0/4028636719 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a08083430 con 0x7f1a140c2840 2023-12-16T03:25:28.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.375+0000 7f1a13fff640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1a00066470 0x7f1a00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.375+0000 7f1a13fff640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1a00066470 0x7f1a00068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a040011f0 tx=0x7f1a04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:28.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.379+0000 7f1a10ff9640 1 -- 172.21.15.28:0/4028636719 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1a1406ea60 con 0x7f1a140c2840 2023-12-16T03:25:28.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 -- 172.21.15.28:0/4028636719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a1406ea60 con 0x7f1a140c2840 2023-12-16T03:25:28.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a10ff9640 1 -- 172.21.15.28:0/4028636719 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a1406ea60 con 0x7f1a140c2840 2023-12-16T03:25:28.545 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:25:28.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 -- 172.21.15.28:0/4028636719 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1a00066470 msgr2=0x7f1a00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1a00066470 0x7f1a00068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a040011f0 tx=0x7f1a04009040 comp rx=0 tx=0).stop 2023-12-16T03:25:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 -- 172.21.15.28:0/4028636719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a140c2840 msgr2=0x7f1a1414b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a140c2840 0x7f1a1414b6e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1a08005890 tx=0x7f1a0800c960 comp rx=0 tx=0).stop 2023-12-16T03:25:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 -- 172.21.15.28:0/4028636719 shutdown_connections 2023-12-16T03:25:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a141578f0 0x7f1a14150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1a00066470 0x7f1a00068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a140c2840 0x7f1a1414b6e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 --2- 172.21.15.28:0/4028636719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a140a6c60 0x7f1a1406ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 -- 172.21.15.28:0/4028636719 >> 172.21.15.28:0/4028636719 conn(0x7f1a140c7e40 msgr2=0x7f1a14155620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 -- 172.21.15.28:0/4028636719 shutdown_connections 2023-12-16T03:25:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.543+0000 7f1a1a71d640 1 -- 172.21.15.28:0/4028636719 wait complete. 2023-12-16T03:25:28.566 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:25:28.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e5bb1d640 1 Processor -- start 2023-12-16T03:25:28.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e5bb1d640 1 -- start start 2023-12-16T03:25:28.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e5bb1d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e54151e90 0x7f0e540c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e5bb1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e540c7ea0 0x7f0e5406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e5bb1d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5406c860 con 0x7f0e540c4e60 2023-12-16T03:25:28.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e5bb1d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e540c8750 con 0x7f0e54151e90 2023-12-16T03:25:28.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e5bb1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541552d0 con 0x7f0e540c7ea0 2023-12-16T03:25:28.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e598b9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e54151e90 0x7f0e540c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e598b9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e54151e90 0x7f0e540c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:60706/0 (socket says 172.21.15.28:60706) 2023-12-16T03:25:28.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e590b8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e540c7ea0 0x7f0e5406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e598b9640 1 -- 172.21.15.28:0/3360465648 learned_addr learned my addr 172.21.15.28:0/3360465648 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:28.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e5a0ba640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0e540c4e60 0x7f0e5406b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53968/0 (socket says 172.21.15.28:53968) 2023-12-16T03:25:28.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e598b9640 1 -- 172.21.15.28:0/3360465648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e540c7ea0 msgr2=0x7f0e5406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:28.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e598b9640 1 --2- 172.21.15.28:0/3360465648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e540c7ea0 0x7f0e5406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e598b9640 1 -- 172.21.15.28:0/3360465648 >> v1:172.21.15.134:6789/0 conn(0x7f0e540c4e60 legacy=0x7f0e5406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.707+0000 7f0e598b9640 1 -- 172.21.15.28:0/3360465648 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e54154930 con 0x7f0e54151e90 2023-12-16T03:25:28.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e598b9640 1 --2- 172.21.15.28:0/3360465648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e54151e90 0x7f0e540c4920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009870 tx=0x7f0e5001c020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=882469307c5c90b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:28.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e588b7640 1 -- 172.21.15.28:0/3360465648 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500a9620 con 0x7f0e54151e90 2023-12-16T03:25:28.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e588b7640 1 -- 172.21.15.28:0/3360465648 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e500a9780 con 0x7f0e54151e90 2023-12-16T03:25:28.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e588b7640 1 -- 172.21.15.28:0/3360465648 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500a9b10 con 0x7f0e54151e90 2023-12-16T03:25:28.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/3360465648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e54151e90 msgr2=0x7f0e540c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e5bb1d640 1 --2- 172.21.15.28:0/3360465648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e54151e90 0x7f0e540c4920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009870 tx=0x7f0e5001c020 comp rx=0 tx=0).stop 2023-12-16T03:25:28.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/3360465648 shutdown_connections 2023-12-16T03:25:28.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e5bb1d640 1 --2- 172.21.15.28:0/3360465648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e540c7ea0 0x7f0e5406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e5bb1d640 1 --2- 172.21.15.28:0/3360465648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e54151e90 0x7f0e540c4920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/3360465648 >> 172.21.15.28:0/3360465648 conn(0x7f0e540ca170 msgr2=0x7f0e540ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/3360465648 shutdown_connections 2023-12-16T03:25:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.711+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/3360465648 wait complete. 2023-12-16T03:25:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5bb1d640 1 Processor -- start 2023-12-16T03:25:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5bb1d640 1 -- start start 2023-12-16T03:25:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5bb1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e540c4e60 0x7f0e5414af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5bb1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e540c7ea0 0x7f0e54155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5bb1d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e54151e90 0x7f0e54156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5bb1d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540af880 con 0x7f0e54151e90 2023-12-16T03:25:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5bb1d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540af3f0 con 0x7f0e540c4e60 2023-12-16T03:25:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5bb1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e54156590 con 0x7f0e540c7ea0 2023-12-16T03:25:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5a0ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e54151e90 0x7f0e54156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5a0ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e54151e90 0x7f0e54156050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38954/0 (socket says 172.21.15.28:38954) 2023-12-16T03:25:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5a0ba640 1 -- 172.21.15.28:0/2943604323 learned_addr learned my addr 172.21.15.28:0/2943604323 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e598b9640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e540c4e60 0x7f0e5414af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e590b8640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e540c7ea0 0x7f0e54155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5a0ba640 1 -- 172.21.15.28:0/2943604323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e540c7ea0 msgr2=0x7f0e54155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5a0ba640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e540c7ea0 0x7f0e54155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5a0ba640 1 -- 172.21.15.28:0/2943604323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e540c4e60 msgr2=0x7f0e5414af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5a0ba640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e540c4e60 0x7f0e5414af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5a0ba640 1 -- 172.21.15.28:0/2943604323 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e500094d0 con 0x7f0e54151e90 2023-12-16T03:25:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5a0ba640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e54151e90 0x7f0e54156050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00caf0 tx=0x7f0e4c002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e4a7fc640 1 -- 172.21.15.28:0/2943604323 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00a700 con 0x7f0e54151e90 2023-12-16T03:25:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e4a7fc640 1 -- 172.21.15.28:0/2943604323 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c00a860 con 0x7f0e54151e90 2023-12-16T03:25:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e4a7fc640 1 -- 172.21.15.28:0/2943604323 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00ac10 con 0x7f0e54151e90 2023-12-16T03:25:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.715+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/2943604323 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e540ae7e0 con 0x7f0e54151e90 2023-12-16T03:25:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.719+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/2943604323 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e540aeda0 con 0x7f0e54151e90 2023-12-16T03:25:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.719+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/2943604323 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e540af5a0 con 0x7f0e54151e90 2023-12-16T03:25:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.719+0000 7f0e4a7fc640 1 -- 172.21.15.28:0/2943604323 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0e4c0070d0 con 0x7f0e54151e90 2023-12-16T03:25:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.719+0000 7f0e4a7fc640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e380664a0 0x7f0e38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.719+0000 7f0e4a7fc640 1 -- 172.21.15.28:0/2943604323 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e4c0833f0 con 0x7f0e54151e90 2023-12-16T03:25:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.719+0000 7f0e598b9640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e380664a0 0x7f0e38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.719+0000 7f0e598b9640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e380664a0 0x7f0e38068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e500ad000 tx=0x7f0e500b4040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.723+0000 7f0e4a7fc640 1 -- 172.21.15.28:0/2943604323 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0e540af5a0 con 0x7f0e54151e90 2023-12-16T03:25:28.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/2943604323 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e540af560 con 0x7f0e54151e90 2023-12-16T03:25:28.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e4a7fc640 1 -- 172.21.15.28:0/2943604323 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f0e4c050880 con 0x7f0e54151e90 2023-12-16T03:25:28.934 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:28.934 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/2517100030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2517100030},{"type":"v1","addr":"172.21.15.134:6835","nonce":2517100030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/146686059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":146686059},{"type":"v1","addr":"172.21.15.28:6836","nonce":146686059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1280024314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1280024314},{"type":"v1","addr":"172.21.15.28:6837","nonce":1280024314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:25:15.321507+0000","modified":"2023-12-16T03:25:18.328454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/199412786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":199412786},{"type":"v1","addr":"172.21.15.134:6834","nonce":199412786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T03:25:28.934 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/2943604323 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e380664a0 msgr2=0x7f0e38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e380664a0 0x7f0e38068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e500ad000 tx=0x7f0e500b4040 comp rx=0 tx=0).stop 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/2943604323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e54151e90 msgr2=0x7f0e54156050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e54151e90 0x7f0e54156050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00caf0 tx=0x7f0e4c002080 comp rx=0 tx=0).stop 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/2943604323 shutdown_connections 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e380664a0 0x7f0e38068960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e54151e90 0x7f0e54156050 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e540c7ea0 0x7f0e54155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 --2- 172.21.15.28:0/2943604323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e540c4e60 0x7f0e5414af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/2943604323 >> 172.21.15.28:0/2943604323 conn(0x7f0e540ca170 msgr2=0x7f0e5406c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/2943604323 shutdown_connections 2023-12-16T03:25:28.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:28.931+0000 7f0e5bb1d640 1 -- 172.21.15.28:0/2943604323 wait complete. 2023-12-16T03:25:28.955 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:29.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.095+0000 7fd3a7232640 1 Processor -- start 2023-12-16T03:25:29.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.095+0000 7fd3a7232640 1 -- start start 2023-12-16T03:25:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.095+0000 7fd3a7232640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd3a00c63c0 0x7fd3a00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.095+0000 7fd3a7232640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd3a00c2bb0 0x7fd3a00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.095+0000 7fd3a7232640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a00c31c0 con 0x7fd3a00c4100 2023-12-16T03:25:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a7232640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a00c34a0 con 0x7fd3a00c63c0 2023-12-16T03:25:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a7232640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a00c1030 con 0x7fd3a00c2bb0 2023-12-16T03:25:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a4fce640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd3a00c63c0 0x7fd3a00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a4fce640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd3a00c63c0 0x7fd3a00c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38960/0 (socket says 172.21.15.28:38960) 2023-12-16T03:25:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a4fce640 1 -- 172.21.15.28:0/891722316 learned_addr learned my addr 172.21.15.28:0/891722316 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a57cf640 1 --2- 172.21.15.28:0/891722316 >> v2:172.21.15.134:3300/0 conn(0x7fd3a00c2bb0 0x7fd3a00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a4fce640 1 -- 172.21.15.28:0/891722316 >> v2:172.21.15.134:3300/0 conn(0x7fd3a00c2bb0 msgr2=0x7fd3a00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a4fce640 1 --2- 172.21.15.28:0/891722316 >> v2:172.21.15.134:3300/0 conn(0x7fd3a00c2bb0 0x7fd3a00a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a4fce640 1 -- 172.21.15.28:0/891722316 >> v1:172.21.15.28:6789/0 conn(0x7fd3a00c4100 legacy=0x7fd3a00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a4fce640 1 -- 172.21.15.28:0/891722316 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a00c1310 con 0x7fd3a00c63c0 2023-12-16T03:25:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a57cf640 1 --2- 172.21.15.28:0/891722316 >> v2:172.21.15.134:3300/0 conn(0x7fd3a00c2bb0 0x7fd3a00a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:29.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.099+0000 7fd3a4fce640 1 --2- 172.21.15.28:0/891722316 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a00c63c0 0x7fd3a00c06d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00c4550 tx=0x7fd39401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797963dfbb344399 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:29.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd39f7fe640 1 -- 172.21.15.28:0/891722316 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00aa3d0 con 0x7fd3a00c63c0 2023-12-16T03:25:29.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd39f7fe640 1 -- 172.21.15.28:0/891722316 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3940ab600 con 0x7fd3a00c63c0 2023-12-16T03:25:29.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd39f7fe640 1 -- 172.21.15.28:0/891722316 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940ab990 con 0x7fd3a00c63c0 2023-12-16T03:25:29.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 -- 172.21.15.28:0/891722316 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a00c63c0 msgr2=0x7fd3a00c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 --2- 172.21.15.28:0/891722316 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a00c63c0 0x7fd3a00c06d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00c4550 tx=0x7fd39401c3e0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 -- 172.21.15.28:0/891722316 shutdown_connections 2023-12-16T03:25:29.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 --2- 172.21.15.28:0/891722316 >> v2:172.21.15.134:3300/0 conn(0x7fd3a00c2bb0 0x7fd3a00a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 --2- 172.21.15.28:0/891722316 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a00c63c0 0x7fd3a00c06d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 -- 172.21.15.28:0/891722316 >> 172.21.15.28:0/891722316 conn(0x7fd3a006a5b0 msgr2=0x7fd3a006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:29.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 -- 172.21.15.28:0/891722316 shutdown_connections 2023-12-16T03:25:29.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 -- 172.21.15.28:0/891722316 wait complete. 2023-12-16T03:25:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 Processor -- start 2023-12-16T03:25:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 -- start start 2023-12-16T03:25:29.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a00c2bb0 0x7fd3a00a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a00c4100 0x7fd3a01ee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3a00c63c0 0x7fd3a01eeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a01ee120 con 0x7fd3a00c4100 2023-12-16T03:25:29.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a0156c50 con 0x7fd3a00c2bb0 2023-12-16T03:25:29.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd3a7232640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a0157570 con 0x7fd3a00c63c0 2023-12-16T03:25:29.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.103+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a00c4100 0x7fd3a01ee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a00c4100 0x7fd3a01ee5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38962/0 (socket says 172.21.15.28:38962) 2023-12-16T03:25:29.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39ffff640 1 -- 172.21.15.28:0/2815795001 learned_addr learned my addr 172.21.15.28:0/2815795001 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:29.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd3a4fce640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a00c2bb0 0x7fd3a00a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd3a57cf640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3a00c63c0 0x7fd3a01eeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39ffff640 1 -- 172.21.15.28:0/2815795001 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3a00c63c0 msgr2=0x7fd3a01eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39ffff640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3a00c63c0 0x7fd3a01eeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39ffff640 1 -- 172.21.15.28:0/2815795001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a00c2bb0 msgr2=0x7fd3a00a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39ffff640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a00c2bb0 0x7fd3a00a6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39ffff640 1 -- 172.21.15.28:0/2815795001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940094d0 con 0x7fd3a00c4100 2023-12-16T03:25:29.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39ffff640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a00c4100 0x7fd3a01ee5b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00c500 tx=0x7fd38c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:29.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39d7fa640 1 -- 172.21.15.28:0/2815795001 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c005220 con 0x7fd3a00c4100 2023-12-16T03:25:29.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39d7fa640 1 -- 172.21.15.28:0/2815795001 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c005380 con 0x7fd3a00c4100 2023-12-16T03:25:29.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd3a7232640 1 -- 172.21.15.28:0/2815795001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a0157850 con 0x7fd3a00c4100 2023-12-16T03:25:29.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39d7fa640 1 -- 172.21.15.28:0/2815795001 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c007270 con 0x7fd3a00c4100 2023-12-16T03:25:29.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd3a7232640 1 -- 172.21.15.28:0/2815795001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a00a7230 con 0x7fd3a00c4100 2023-12-16T03:25:29.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd3a7232640 1 -- 172.21.15.28:0/2815795001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a01ee2d0 con 0x7fd3a00c4100 2023-12-16T03:25:29.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39d7fa640 1 -- 172.21.15.28:0/2815795001 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd38c0073d0 con 0x7fd3a00c4100 2023-12-16T03:25:29.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39d7fa640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3840664a0 0x7fd384068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.107+0000 7fd39d7fa640 1 -- 172.21.15.28:0/2815795001 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd38c083830 con 0x7fd3a00c4100 2023-12-16T03:25:29.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.111+0000 7fd3a4fce640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3840664a0 0x7fd384068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.111+0000 7fd3a4fce640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3840664a0 0x7fd384068960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd3940af000 tx=0x7fd3940a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:29.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.111+0000 7fd39d7fa640 1 -- 172.21.15.28:0/2815795001 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd3a01ee2d0 con 0x7fd3a00c4100 2023-12-16T03:25:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd3a7232640 1 -- 172.21.15.28:0/2815795001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3a0068400 con 0x7fd3a00c4100 2023-12-16T03:25:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd39d7fa640 1 -- 172.21.15.28:0/2815795001 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fd38c050c20 con 0x7fd3a00c4100 2023-12-16T03:25:29.275 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:29.275 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd3a7232640 1 -- 172.21.15.28:0/2815795001 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3840664a0 msgr2=0x7fd384068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd3a7232640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3840664a0 0x7fd384068960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd3940af000 tx=0x7fd3940a7000 comp rx=0 tx=0).stop 2023-12-16T03:25:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd3a7232640 1 -- 172.21.15.28:0/2815795001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a00c4100 msgr2=0x7fd3a01ee5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd3a7232640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a00c4100 0x7fd3a01ee5b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00c500 tx=0x7fd38c00c9c0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd3a7232640 1 -- 172.21.15.28:0/2815795001 shutdown_connections 2023-12-16T03:25:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd3a7232640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3a00c63c0 0x7fd3a01eeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd3a7232640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3840664a0 0x7fd384068960 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd3a7232640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a00c4100 0x7fd3a01ee5b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd3a7232640 1 --2- 172.21.15.28:0/2815795001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a00c2bb0 0x7fd3a00a6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.271+0000 7fd3a7232640 1 -- 172.21.15.28:0/2815795001 >> 172.21.15.28:0/2815795001 conn(0x7fd3a006a5b0 msgr2=0x7fd3a006d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.275+0000 7fd3a7232640 1 -- 172.21.15.28:0/2815795001 shutdown_connections 2023-12-16T03:25:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.275+0000 7fd3a7232640 1 -- 172.21.15.28:0/2815795001 wait complete. 2023-12-16T03:25:29.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:25:13.885447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:25:14.309086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:29.297 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:29.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.439+0000 7f0c3cf57640 1 Processor -- start 2023-12-16T03:25:29.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.439+0000 7f0c3cf57640 1 -- start start 2023-12-16T03:25:29.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.439+0000 7f0c3cf57640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0c3814b010 0x7f0c380bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.439+0000 7f0c3cf57640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3806a5b0 con 0x7f0c38157c20 2023-12-16T03:25:29.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.439+0000 7f0c3cf57640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3806b710 con 0x7f0c38073a70 2023-12-16T03:25:29.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.439+0000 7f0c3cf57640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c380c1d60 con 0x7f0c3814b010 2023-12-16T03:25:29.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.439+0000 7f0c36d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0c38157c20 0x7f0c38158070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58000/0 (socket says 172.21.15.28:58000) 2023-12-16T03:25:29.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.439+0000 7f0c36d9d640 1 -- 172.21.15.28:0/2817292809 learned_addr learned my addr 172.21.15.28:0/2817292809 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:29.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c3659c640 1 --2- 172.21.15.28:0/2817292809 >> v2:172.21.15.134:3300/0 conn(0x7f0c3814b010 0x7f0c380bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c35d9b640 1 -- 172.21.15.28:0/2817292809 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284152870 0 0) 0x7f0c3806a5b0 con 0x7f0c38157c20 2023-12-16T03:25:29.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c35d9b640 1 -- 172.21.15.28:0/2817292809 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c24003530 con 0x7f0c38157c20 2023-12-16T03:25:29.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c35d9b640 1 -- 172.21.15.28:0/2817292809 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637085606 0 0) 0x7f0c3806b710 con 0x7f0c38073a70 2023-12-16T03:25:29.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c35d9b640 1 -- 172.21.15.28:0/2817292809 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c3806a5b0 con 0x7f0c38073a70 2023-12-16T03:25:29.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c3659c640 1 -- 172.21.15.28:0/2817292809 >> v1:172.21.15.134:6789/0 conn(0x7f0c38073a70 legacy=0x7f0c3806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c3659c640 1 -- 172.21.15.28:0/2817292809 >> v1:172.21.15.28:6789/0 conn(0x7f0c38157c20 legacy=0x7f0c38158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c3659c640 1 -- 172.21.15.28:0/2817292809 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380c2040 con 0x7f0c3814b010 2023-12-16T03:25:29.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c3659c640 1 --2- 172.21.15.28:0/2817292809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c3814b010 0x7f0c380bf9f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0c280097c0 tx=0x7f0c2801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=255f2051fb09f756 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:29.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c35d9b640 1 -- 172.21.15.28:0/2817292809 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c280a8970 con 0x7f0c3814b010 2023-12-16T03:25:29.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c35d9b640 1 -- 172.21.15.28:0/2817292809 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c280a8ad0 con 0x7f0c3814b010 2023-12-16T03:25:29.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.443+0000 7f0c35d9b640 1 -- 172.21.15.28:0/2817292809 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c280a8e60 con 0x7f0c3814b010 2023-12-16T03:25:29.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 -- 172.21.15.28:0/2817292809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c3814b010 msgr2=0x7f0c380bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 --2- 172.21.15.28:0/2817292809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c3814b010 0x7f0c380bf9f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0c280097c0 tx=0x7f0c2801ec70 comp rx=0 tx=0).stop 2023-12-16T03:25:29.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 -- 172.21.15.28:0/2817292809 shutdown_connections 2023-12-16T03:25:29.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 --2- 172.21.15.28:0/2817292809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c3814b010 0x7f0c380bf9f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 -- 172.21.15.28:0/2817292809 >> 172.21.15.28:0/2817292809 conn(0x7f0c380c30c0 msgr2=0x7f0c380c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:29.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 -- 172.21.15.28:0/2817292809 shutdown_connections 2023-12-16T03:25:29.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 -- 172.21.15.28:0/2817292809 wait complete. 2023-12-16T03:25:29.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 Processor -- start 2023-12-16T03:25:29.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 -- start start 2023-12-16T03:25:29.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c38073a70 0x7f0c381549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c3814b010 0x7f0c380a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c38157c20 0x7f0c381ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c380ab840 con 0x7f0c38073a70 2023-12-16T03:25:29.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c38152e90 con 0x7f0c38157c20 2023-12-16T03:25:29.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3cf57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c381553d0 con 0x7f0c3814b010 2023-12-16T03:25:29.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c38073a70 0x7f0c381549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c38073a70 0x7f0c381549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38976/0 (socket says 172.21.15.28:38976) 2023-12-16T03:25:29.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3659c640 1 -- 172.21.15.28:0/3952640273 learned_addr learned my addr 172.21.15.28:0/3952640273 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:29.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c36d9d640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c38157c20 0x7f0c381ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c2ffff640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c3814b010 0x7f0c380a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.447+0000 7f0c3659c640 1 -- 172.21.15.28:0/3952640273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c3814b010 msgr2=0x7f0c380a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c3659c640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c3814b010 0x7f0c380a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c3659c640 1 -- 172.21.15.28:0/3952640273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c38157c20 msgr2=0x7f0c381ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c3659c640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c38157c20 0x7f0c381ed420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c3659c640 1 -- 172.21.15.28:0/3952640273 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28009420 con 0x7f0c38073a70 2023-12-16T03:25:29.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c3659c640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c38073a70 0x7f0c381549d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0c280b3040 tx=0x7f0c2801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:29.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c2effd640 1 -- 172.21.15.28:0/3952640273 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c280b0d60 con 0x7f0c38073a70 2023-12-16T03:25:29.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c2effd640 1 -- 172.21.15.28:0/3952640273 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c280b9430 con 0x7f0c38073a70 2023-12-16T03:25:29.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c3cf57640 1 -- 172.21.15.28:0/3952640273 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c381530e0 con 0x7f0c38073a70 2023-12-16T03:25:29.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c2effd640 1 -- 172.21.15.28:0/3952640273 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c280b97e0 con 0x7f0c38073a70 2023-12-16T03:25:29.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c3cf57640 1 -- 172.21.15.28:0/3952640273 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c381536a0 con 0x7f0c38073a70 2023-12-16T03:25:29.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c3cf57640 1 -- 172.21.15.28:0/3952640273 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c38068400 con 0x7f0c38073a70 2023-12-16T03:25:29.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c2effd640 1 -- 172.21.15.28:0/3952640273 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0c280b7040 con 0x7f0c38073a70 2023-12-16T03:25:29.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c2effd640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c18066470 0x7f0c18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c2effd640 1 -- 172.21.15.28:0/3952640273 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c281218e0 con 0x7f0c38073a70 2023-12-16T03:25:29.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.451+0000 7f0c2ffff640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c18066470 0x7f0c18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.455+0000 7f0c2ffff640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c18066470 0x7f0c18068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c38154630 tx=0x7f0c20009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:29.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.455+0000 7f0c2effd640 1 -- 172.21.15.28:0/3952640273 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0c280eed50 con 0x7f0c38073a70 2023-12-16T03:25:29.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.615+0000 7f0c3cf57640 1 -- 172.21.15.28:0/3952640273 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c3806b680 con 0x7f0c38073a70 2023-12-16T03:25:29.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.615+0000 7f0c2effd640 1 -- 172.21.15.28:0/3952640273 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c280f2370 con 0x7f0c38073a70 2023-12-16T03:25:29.620 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 -- 172.21.15.28:0/3952640273 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c18066470 msgr2=0x7f0c18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c18066470 0x7f0c18068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c38154630 tx=0x7f0c20009040 comp rx=0 tx=0).stop 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 -- 172.21.15.28:0/3952640273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c38073a70 msgr2=0x7f0c381549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c38073a70 0x7f0c381549d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0c280b3040 tx=0x7f0c2801ba10 comp rx=0 tx=0).stop 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 -- 172.21.15.28:0/3952640273 shutdown_connections 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c38157c20 0x7f0c381ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c3814b010 0x7f0c380a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c18066470 0x7f0c18068930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 --2- 172.21.15.28:0/3952640273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c38073a70 0x7f0c381549d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 -- 172.21.15.28:0/3952640273 >> 172.21.15.28:0/3952640273 conn(0x7f0c380c30c0 msgr2=0x7f0c38158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 -- 172.21.15.28:0/3952640273 shutdown_connections 2023-12-16T03:25:29.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.619+0000 7f0c3cf57640 1 -- 172.21.15.28:0/3952640273 wait complete. 2023-12-16T03:25:29.641 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:25:29.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f6bd1640 1 Processor -- start 2023-12-16T03:25:29.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f6bd1640 1 -- start start 2023-12-16T03:25:29.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f6bd1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7f00c7ea0 0x7ff7f006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f6bd1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff7f006b9e0 0x7ff7f015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f6bd1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f006c860 con 0x7ff7f0151e90 2023-12-16T03:25:29.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f6bd1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f00c8750 con 0x7ff7f006b9e0 2023-12-16T03:25:29.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f6bd1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f01552d0 con 0x7ff7f00c7ea0 2023-12-16T03:25:29.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f516e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff7f006b9e0 0x7ff7f015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f516e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff7f006b9e0 0x7ff7f015f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55852/0 (socket says 172.21.15.28:55852) 2023-12-16T03:25:29.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f516e640 1 -- 172.21.15.28:0/2706552389 learned_addr learned my addr 172.21.15.28:0/2706552389 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:29.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7effff640 1 --2- 172.21.15.28:0/2706552389 >> v2:172.21.15.134:3300/0 conn(0x7ff7f00c7ea0 0x7ff7f006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f516e640 1 -- 172.21.15.28:0/2706552389 >> v2:172.21.15.134:3300/0 conn(0x7ff7f00c7ea0 msgr2=0x7ff7f006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:29.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f516e640 1 --2- 172.21.15.28:0/2706552389 >> v2:172.21.15.134:3300/0 conn(0x7ff7f00c7ea0 0x7ff7f006b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f516e640 1 -- 172.21.15.28:0/2706552389 >> v1:172.21.15.134:6789/0 conn(0x7ff7f0151e90 legacy=0x7ff7f00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:29.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7f516e640 1 -- 172.21.15.28:0/2706552389 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0154930 con 0x7ff7f006b9e0 2023-12-16T03:25:29.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.783+0000 7ff7effff640 1 --2- 172.21.15.28:0/2706552389 >> v2:172.21.15.134:3300/0 conn(0x7ff7f00c7ea0 0x7ff7f006b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:29.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7f516e640 1 --2- 172.21.15.28:0/2706552389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7f006b9e0 0x7ff7f015f0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00a9a70 tx=0x7ff7e801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f3be6e7aeb69f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:29.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7ef7fe640 1 -- 172.21.15.28:0/2706552389 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80a5530 con 0x7ff7f006b9e0 2023-12-16T03:25:29.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7ef7fe640 1 -- 172.21.15.28:0/2706552389 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e80a5690 con 0x7ff7f006b9e0 2023-12-16T03:25:29.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7ef7fe640 1 -- 172.21.15.28:0/2706552389 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80a5a20 con 0x7ff7f006b9e0 2023-12-16T03:25:29.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2706552389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7f006b9e0 msgr2=0x7ff7f015f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7f6bd1640 1 --2- 172.21.15.28:0/2706552389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7f006b9e0 0x7ff7f015f0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00a9a70 tx=0x7ff7e801c870 comp rx=0 tx=0).stop 2023-12-16T03:25:29.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2706552389 shutdown_connections 2023-12-16T03:25:29.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7f6bd1640 1 --2- 172.21.15.28:0/2706552389 >> v2:172.21.15.134:3300/0 conn(0x7ff7f00c7ea0 0x7ff7f006b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7f6bd1640 1 --2- 172.21.15.28:0/2706552389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7f006b9e0 0x7ff7f015f0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2706552389 >> 172.21.15.28:0/2706552389 conn(0x7ff7f00ca170 msgr2=0x7ff7f00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:29.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2706552389 shutdown_connections 2023-12-16T03:25:29.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.787+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2706552389 wait complete. 2023-12-16T03:25:29.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f6bd1640 1 Processor -- start 2023-12-16T03:25:29.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f6bd1640 1 -- start start 2023-12-16T03:25:29.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f6bd1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7f006b9e0 0x7ff7f014e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f6bd1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7f00c7ea0 0x7ff7f00af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f6bd1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7f0151e90 0x7ff7f00af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f6bd1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f014b740 con 0x7ff7f006b9e0 2023-12-16T03:25:29.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f6bd1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00ae430 con 0x7ff7f00c7ea0 2023-12-16T03:25:29.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f6bd1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0149390 con 0x7ff7f0151e90 2023-12-16T03:25:29.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f496d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7f006b9e0 0x7ff7f014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f496d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7f006b9e0 0x7ff7f014e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55866/0 (socket says 172.21.15.28:55866) 2023-12-16T03:25:29.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f496d640 1 -- 172.21.15.28:0/2433748177 learned_addr learned my addr 172.21.15.28:0/2433748177 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:29.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7effff640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7f00c7ea0 0x7ff7f00af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f516e640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7f0151e90 0x7ff7f00af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f496d640 1 -- 172.21.15.28:0/2433748177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7f0151e90 msgr2=0x7ff7f00af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f496d640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7f0151e90 0x7ff7f00af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f496d640 1 -- 172.21.15.28:0/2433748177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7f00c7ea0 msgr2=0x7ff7f00af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f496d640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7f00c7ea0 0x7ff7f00af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f496d640 1 -- 172.21.15.28:0/2433748177 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009b30 con 0x7ff7f006b9e0 2023-12-16T03:25:29.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f496d640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7f006b9e0 0x7ff7f014e670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c480 tx=0x7ff7e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:29.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7ed7fa640 1 -- 172.21.15.28:0/2433748177 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4012830 con 0x7ff7f006b9e0 2023-12-16T03:25:29.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7ed7fa640 1 -- 172.21.15.28:0/2433748177 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e40129b0 con 0x7ff7f006b9e0 2023-12-16T03:25:29.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7ed7fa640 1 -- 172.21.15.28:0/2433748177 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4012d60 con 0x7ff7f006b9e0 2023-12-16T03:25:29.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.791+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2433748177 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f014b950 con 0x7ff7f006b9e0 2023-12-16T03:25:29.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.795+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2433748177 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f014ebb0 con 0x7ff7f006b9e0 2023-12-16T03:25:29.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.795+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2433748177 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f00acec0 con 0x7ff7f006b9e0 2023-12-16T03:25:29.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.795+0000 7ff7ed7fa640 1 -- 172.21.15.28:0/2433748177 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff7e401c460 con 0x7ff7f006b9e0 2023-12-16T03:25:29.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.795+0000 7ff7ed7fa640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7d4066470 0x7ff7d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:29.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.795+0000 7ff7ed7fa640 1 -- 172.21.15.28:0/2433748177 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7e4083ba0 con 0x7ff7f006b9e0 2023-12-16T03:25:29.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.795+0000 7ff7effff640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7d4066470 0x7ff7d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:29.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.795+0000 7ff7effff640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7d4066470 0x7ff7d4068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0149960 tx=0x7ff7dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:29.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.799+0000 7ff7ed7fa640 1 -- 172.21.15.28:0/2433748177 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff7f00acec0 con 0x7ff7f006b9e0 2023-12-16T03:25:29.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2433748177 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7f00acec0 con 0x7ff7f006b9e0 2023-12-16T03:25:29.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7ed7fa640 1 -- 172.21.15.28:0/2433748177 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7f00acec0 con 0x7ff7f006b9e0 2023-12-16T03:25:29.961 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:25:29.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2433748177 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7d4066470 msgr2=0x7ff7d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7d4066470 0x7ff7d4068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0149960 tx=0x7ff7dc008040 comp rx=0 tx=0).stop 2023-12-16T03:25:29.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2433748177 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7f006b9e0 msgr2=0x7ff7f014e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:29.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7f006b9e0 0x7ff7f014e670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c480 tx=0x7ff7e400c940 comp rx=0 tx=0).stop 2023-12-16T03:25:29.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2433748177 shutdown_connections 2023-12-16T03:25:29.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7f0151e90 0x7ff7f00af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7f00c7ea0 0x7ff7f00af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff7d4066470 0x7ff7d4068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 --2- 172.21.15.28:0/2433748177 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7f006b9e0 0x7ff7f014e670 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:29.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2433748177 >> 172.21.15.28:0/2433748177 conn(0x7ff7f00ca170 msgr2=0x7ff7f0152f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:29.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2433748177 shutdown_connections 2023-12-16T03:25:29.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:29.959+0000 7ff7f6bd1640 1 -- 172.21.15.28:0/2433748177 wait complete. 2023-12-16T03:25:29.982 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:25:30.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.123+0000 7f4a031f8640 1 Processor -- start 2023-12-16T03:25:30.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.123+0000 7f4a031f8640 1 -- start start 2023-12-16T03:25:30.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f4a031f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5260 0x7f49fc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f4a031f8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc156960 con 0x7f49fc155de0 2023-12-16T03:25:30.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f4a031f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc0c2580 con 0x7f49fc0c5640 2023-12-16T03:25:30.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f4a031f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc153510 con 0x7f49fc0c5260 2023-12-16T03:25:30.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f4a01795640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f49fc155de0 0x7f49fc156250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43532/0 (socket says 172.21.15.28:43532) 2023-12-16T03:25:30.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f4a01795640 1 -- 172.21.15.28:0/892020085 learned_addr learned my addr 172.21.15.28:0/892020085 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:30.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f4a00f94640 1 --2- 172.21.15.28:0/892020085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5260 0x7f49fc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f49fb7fe640 1 -- 172.21.15.28:0/892020085 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546509678 0 0) 0x7f49f40014a0 con 0x7f49fc155de0 2023-12-16T03:25:30.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f49fb7fe640 1 -- 172.21.15.28:0/892020085 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49ec003530 con 0x7f49fc155de0 2023-12-16T03:25:30.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f49fb7fe640 1 -- 172.21.15.28:0/892020085 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621055228 0 0) 0x7f49fc0c2580 con 0x7f49fc0c5640 2023-12-16T03:25:30.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f49fb7fe640 1 -- 172.21.15.28:0/892020085 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f40014a0 con 0x7f49fc0c5640 2023-12-16T03:25:30.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f4a00f94640 1 -- 172.21.15.28:0/892020085 >> v1:172.21.15.134:6789/0 conn(0x7f49fc0c5640 legacy=0x7f49fc0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f4a00f94640 1 -- 172.21.15.28:0/892020085 >> v1:172.21.15.28:6789/0 conn(0x7f49fc155de0 legacy=0x7f49fc156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f49fb7fe640 1 -- 172.21.15.28:0/892020085 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1002254349 0 0) 0x7f49ec003530 con 0x7f49fc155de0 2023-12-16T03:25:30.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.127+0000 7f4a00f94640 1 -- 172.21.15.28:0/892020085 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc0c1a00 con 0x7f49fc0c5260 2023-12-16T03:25:30.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f4a00f94640 1 --2- 172.21.15.28:0/892020085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5260 0x7f49fc06d5b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f49f00097f0 tx=0x7f49f001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6bf1eb87ffb09a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:30.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f49fb7fe640 1 -- 172.21.15.28:0/892020085 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f4001bb0 con 0x7f49fc0c5260 2023-12-16T03:25:30.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f49fb7fe640 1 -- 172.21.15.28:0/892020085 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f00a7050 con 0x7f49fc0c5260 2023-12-16T03:25:30.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f49fb7fe640 1 -- 172.21.15.28:0/892020085 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f00ab620 con 0x7f49fc0c5260 2023-12-16T03:25:30.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f4a031f8640 1 -- 172.21.15.28:0/892020085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5260 msgr2=0x7f49fc06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f4a031f8640 1 --2- 172.21.15.28:0/892020085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5260 0x7f49fc06d5b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f49f00097f0 tx=0x7f49f001c350 comp rx=0 tx=0).stop 2023-12-16T03:25:30.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f4a031f8640 1 -- 172.21.15.28:0/892020085 shutdown_connections 2023-12-16T03:25:30.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f4a031f8640 1 --2- 172.21.15.28:0/892020085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5260 0x7f49fc06d5b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f4a031f8640 1 -- 172.21.15.28:0/892020085 >> 172.21.15.28:0/892020085 conn(0x7f49fc06a5b0 msgr2=0x7f49fc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:30.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f4a031f8640 1 -- 172.21.15.28:0/892020085 shutdown_connections 2023-12-16T03:25:30.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f4a031f8640 1 -- 172.21.15.28:0/892020085 wait complete. 2023-12-16T03:25:30.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f4a031f8640 1 Processor -- start 2023-12-16T03:25:30.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.131+0000 7f4a031f8640 1 -- start start 2023-12-16T03:25:30.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a031f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49fc0c5260 0x7f49fc0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a031f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5640 0x7f49fc1ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a031f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49fc155de0 0x7f49fc1ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a031f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc071650 con 0x7f49fc155de0 2023-12-16T03:25:30.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a031f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1ec990 con 0x7f49fc0c5260 2023-12-16T03:25:30.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a031f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc154e50 con 0x7f49fc0c5640 2023-12-16T03:25:30.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a01795640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49fc155de0 0x7f49fc1ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a01795640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49fc155de0 0x7f49fc1ed360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55868/0 (socket says 172.21.15.28:55868) 2023-12-16T03:25:30.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a01795640 1 -- 172.21.15.28:0/3095873997 learned_addr learned my addr 172.21.15.28:0/3095873997 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:30.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a00f94640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49fc0c5260 0x7f49fc0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a01795640 1 -- 172.21.15.28:0/3095873997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5640 msgr2=0x7f49fc1ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f49fbfff640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5640 0x7f49fc1ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a01795640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5640 0x7f49fc1ece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a01795640 1 -- 172.21.15.28:0/3095873997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49fc0c5260 msgr2=0x7f49fc0bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a01795640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49fc0c5260 0x7f49fc0bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a01795640 1 -- 172.21.15.28:0/3095873997 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f0009420 con 0x7f49fc155de0 2023-12-16T03:25:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a00f94640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49fc0c5260 0x7f49fc0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f49fbfff640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5640 0x7f49fc1ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a01795640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49fc155de0 0x7f49fc1ed360 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f49f400cb10 tx=0x7f49f400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f49f97fa640 1 -- 172.21.15.28:0/3095873997 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f400a860 con 0x7f49fc155de0 2023-12-16T03:25:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f49f97fa640 1 -- 172.21.15.28:0/3095873997 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f400a9c0 con 0x7f49fc155de0 2023-12-16T03:25:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a031f8640 1 -- 172.21.15.28:0/3095873997 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc155130 con 0x7f49fc155de0 2023-12-16T03:25:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f49f97fa640 1 -- 172.21.15.28:0/3095873997 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f400adf0 con 0x7f49fc155de0 2023-12-16T03:25:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a031f8640 1 -- 172.21.15.28:0/3095873997 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc1556f0 con 0x7f49fc155de0 2023-12-16T03:25:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.135+0000 7f4a031f8640 1 -- 172.21.15.28:0/3095873997 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49fc1ecb20 con 0x7f49fc155de0 2023-12-16T03:25:30.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.139+0000 7f49f97fa640 1 -- 172.21.15.28:0/3095873997 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f49f40070d0 con 0x7f49fc155de0 2023-12-16T03:25:30.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.139+0000 7f49f97fa640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49e0066470 0x7f49e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.139+0000 7f49f97fa640 1 -- 172.21.15.28:0/3095873997 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49f4083520 con 0x7f49fc155de0 2023-12-16T03:25:30.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.139+0000 7f4a00f94640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49e0066470 0x7f49e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.139+0000 7f4a00f94640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49e0066470 0x7f49e0068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f49f00ad000 tx=0x7f49f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:30.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.143+0000 7f49f97fa640 1 -- 172.21.15.28:0/3095873997 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f49f4050a30 con 0x7f49fc155de0 2023-12-16T03:25:30.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.299+0000 7f4a031f8640 1 -- 172.21.15.28:0/3095873997 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49fc156960 con 0x7f49fc155de0 2023-12-16T03:25:30.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.299+0000 7f49f97fa640 1 -- 172.21.15.28:0/3095873997 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49fc156960 con 0x7f49fc155de0 2023-12-16T03:25:30.303 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:25:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 -- 172.21.15.28:0/3095873997 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49e0066470 msgr2=0x7f49e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49e0066470 0x7f49e0068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f49f00ad000 tx=0x7f49f0008040 comp rx=0 tx=0).stop 2023-12-16T03:25:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 -- 172.21.15.28:0/3095873997 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49fc155de0 msgr2=0x7f49fc1ed360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49fc155de0 0x7f49fc1ed360 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f49f400cb10 tx=0x7f49f400a060 comp rx=0 tx=0).stop 2023-12-16T03:25:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 -- 172.21.15.28:0/3095873997 shutdown_connections 2023-12-16T03:25:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49e0066470 0x7f49e0068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49fc155de0 0x7f49fc1ed360 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f49fc0c5640 0x7f49fc1ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 --2- 172.21.15.28:0/3095873997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49fc0c5260 0x7f49fc0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 -- 172.21.15.28:0/3095873997 >> 172.21.15.28:0/3095873997 conn(0x7f49fc06a5b0 msgr2=0x7f49fc06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 -- 172.21.15.28:0/3095873997 shutdown_connections 2023-12-16T03:25:30.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.303+0000 7f4a031f8640 1 -- 172.21.15.28:0/3095873997 wait complete. 2023-12-16T03:25:30.325 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:25:30.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f335cf96640 1 Processor -- start 2023-12-16T03:25:30.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f335cf96640 1 -- start start 2023-12-16T03:25:30.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f335cf96640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3358151cd0 0x7f33580ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f335cf96640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f33580c7c50 0x7f33581544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f335cf96640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33580c8160 con 0x7f33580ca9a0 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f335cf96640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3358157b40 con 0x7f33580c7c50 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f335cf96640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3358157e20 con 0x7f3358151cd0 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f3356ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f33580c7c50 0x7f33581544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f3356ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f33580c7c50 0x7f33581544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55872/0 (socket says 172.21.15.28:55872) 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f3356ffd640 1 -- 172.21.15.28:0/3906290668 learned_addr learned my addr 172.21.15.28:0/3906290668 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f33577fe640 1 --2- 172.21.15.28:0/3906290668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3358151cd0 0x7f33580ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f3356ffd640 1 -- 172.21.15.28:0/3906290668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3358151cd0 msgr2=0x7f33580ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f3356ffd640 1 --2- 172.21.15.28:0/3906290668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3358151cd0 0x7f33580ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f3356ffd640 1 -- 172.21.15.28:0/3906290668 >> v1:172.21.15.134:6789/0 conn(0x7f33580ca9a0 legacy=0x7f335806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f3356ffd640 1 -- 172.21.15.28:0/3906290668 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3358158100 con 0x7f33580c7c50 2023-12-16T03:25:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.467+0000 7f33577fe640 1 --2- 172.21.15.28:0/3906290668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3358151cd0 0x7f33580ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:30.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f3356ffd640 1 --2- 172.21.15.28:0/3906290668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33580c7c50 0x7f33581544d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f334c009870 tx=0x7f334c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67d09b91c223909 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:30.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f33567fc640 1 -- 172.21.15.28:0/3906290668 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0aa610 con 0x7f33580c7c50 2023-12-16T03:25:30.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f33567fc640 1 -- 172.21.15.28:0/3906290668 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c0a6040 con 0x7f33580c7c50 2023-12-16T03:25:30.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f33567fc640 1 -- 172.21.15.28:0/3906290668 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0aa990 con 0x7f33580c7c50 2023-12-16T03:25:30.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f335cf96640 1 -- 172.21.15.28:0/3906290668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33580c7c50 msgr2=0x7f33581544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f335cf96640 1 --2- 172.21.15.28:0/3906290668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33580c7c50 0x7f33581544d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f334c009870 tx=0x7f334c01c4d0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f335cf96640 1 -- 172.21.15.28:0/3906290668 shutdown_connections 2023-12-16T03:25:30.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f335cf96640 1 --2- 172.21.15.28:0/3906290668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33580c7c50 0x7f33581544d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f335cf96640 1 --2- 172.21.15.28:0/3906290668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3358151cd0 0x7f33580ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f335cf96640 1 -- 172.21.15.28:0/3906290668 >> 172.21.15.28:0/3906290668 conn(0x7f33580abee0 msgr2=0x7f33580c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:30.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f335cf96640 1 -- 172.21.15.28:0/3906290668 shutdown_connections 2023-12-16T03:25:30.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f335cf96640 1 -- 172.21.15.28:0/3906290668 wait complete. 2023-12-16T03:25:30.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f335cf96640 1 Processor -- start 2023-12-16T03:25:30.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.471+0000 7f335cf96640 1 -- start start 2023-12-16T03:25:30.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f335cf96640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33580c7c50 0x7f33581567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f335cf96640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33580ca9a0 0x7f335814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f335cf96640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3358151cd0 0x7f33581f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f335cf96640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33580c2b10 con 0x7f33580c7c50 2023-12-16T03:25:30.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f335cf96640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33581502e0 con 0x7f33580ca9a0 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f335cf96640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3358157660 con 0x7f3358151cd0 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f33577fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33580c7c50 0x7f33581567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f33577fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33580c7c50 0x7f33581567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55884/0 (socket says 172.21.15.28:55884) 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f33577fe640 1 -- 172.21.15.28:0/1009173500 learned_addr learned my addr 172.21.15.28:0/1009173500 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f3357fff640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3358151cd0 0x7f33581f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f3356ffd640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33580ca9a0 0x7f335814fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f33577fe640 1 -- 172.21.15.28:0/1009173500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3358151cd0 msgr2=0x7f33581f0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f33577fe640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3358151cd0 0x7f33581f0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f33577fe640 1 -- 172.21.15.28:0/1009173500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33580ca9a0 msgr2=0x7f335814fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f33577fe640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33580ca9a0 0x7f335814fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f33577fe640 1 -- 172.21.15.28:0/1009173500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c0094d0 con 0x7f33580c7c50 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f33577fe640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33580c7c50 0x7f33581567f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f334800c7c0 tx=0x7f334800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f333ffff640 1 -- 172.21.15.28:0/1009173500 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348007a30 con 0x7f33580c7c50 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f333ffff640 1 -- 172.21.15.28:0/1009173500 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3348007b90 con 0x7f33580c7c50 2023-12-16T03:25:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f335cf96640 1 -- 172.21.15.28:0/1009173500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3358157330 con 0x7f33580c7c50 2023-12-16T03:25:30.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f333ffff640 1 -- 172.21.15.28:0/1009173500 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334800ce70 con 0x7f33580c7c50 2023-12-16T03:25:30.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f335cf96640 1 -- 172.21.15.28:0/1009173500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33581f1340 con 0x7f33580c7c50 2023-12-16T03:25:30.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f335cf96640 1 -- 172.21.15.28:0/1009173500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33580c6120 con 0x7f33580c7c50 2023-12-16T03:25:30.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.475+0000 7f333ffff640 1 -- 172.21.15.28:0/1009173500 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f33480113f0 con 0x7f33580c7c50 2023-12-16T03:25:30.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.479+0000 7f333ffff640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3344066470 0x7f3344068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.479+0000 7f333ffff640 1 -- 172.21.15.28:0/1009173500 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33480843b0 con 0x7f33580c7c50 2023-12-16T03:25:30.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.479+0000 7f3356ffd640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3344066470 0x7f3344068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.479+0000 7f3356ffd640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3344066470 0x7f3344068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f334c0ae000 tx=0x7f334c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:30.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.483+0000 7f333ffff640 1 -- 172.21.15.28:0/1009173500 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f33480517b0 con 0x7f33580c7c50 2023-12-16T03:25:30.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 -- 172.21.15.28:0/1009173500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f335804e850 con 0x7f33580c7c50 2023-12-16T03:25:30.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f333ffff640 1 -- 172.21.15.28:0/1009173500 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f3348054dd0 con 0x7f33580c7c50 2023-12-16T03:25:30.674 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:30.675 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/2517100030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2517100030},{"type":"v1","addr":"172.21.15.134:6835","nonce":2517100030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/146686059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":146686059},{"type":"v1","addr":"172.21.15.28:6836","nonce":146686059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1280024314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1280024314},{"type":"v1","addr":"172.21.15.28:6837","nonce":1280024314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:25:15.321507+0000","modified":"2023-12-16T03:25:18.328454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/199412786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":199412786},{"type":"v1","addr":"172.21.15.134:6834","nonce":199412786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T03:25:30.675 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-12-16T03:25:30.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 -- 172.21.15.28:0/1009173500 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3344066470 msgr2=0x7f3344068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3344066470 0x7f3344068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f334c0ae000 tx=0x7f334c0a7000 comp rx=0 tx=0).stop 2023-12-16T03:25:30.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 -- 172.21.15.28:0/1009173500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33580c7c50 msgr2=0x7f33581567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33580c7c50 0x7f33581567f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f334800c7c0 tx=0x7f334800cc80 comp rx=0 tx=0).stop 2023-12-16T03:25:30.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 -- 172.21.15.28:0/1009173500 shutdown_connections 2023-12-16T03:25:30.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3358151cd0 0x7f33581f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33580ca9a0 0x7f335814fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3344066470 0x7f3344068930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 --2- 172.21.15.28:0/1009173500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33580c7c50 0x7f33581567f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 -- 172.21.15.28:0/1009173500 >> 172.21.15.28:0/1009173500 conn(0x7f33580abee0 msgr2=0x7f3358150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:30.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 -- 172.21.15.28:0/1009173500 shutdown_connections 2023-12-16T03:25:30.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.671+0000 7f335cf96640 1 -- 172.21.15.28:0/1009173500 wait complete. 2023-12-16T03:25:30.696 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:30.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.835+0000 7f654906b640 1 Processor -- start 2023-12-16T03:25:30.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.835+0000 7f654906b640 1 -- start start 2023-12-16T03:25:30.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.835+0000 7f654906b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f65440c5260 0x7f654406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.835+0000 7f654906b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 0x7f6544156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.835+0000 7f654906b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65440c2580 con 0x7f65440c5640 2023-12-16T03:25:30.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.835+0000 7f654906b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6544153510 con 0x7f65440c5260 2023-12-16T03:25:30.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.835+0000 7f654906b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65440c17f0 con 0x7f6544155de0 2023-12-16T03:25:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.835+0000 7f654359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 0x7f6544156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f654359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 0x7f6544156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:35992/0 (socket says 172.21.15.28:35992) 2023-12-16T03:25:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f654359e640 1 -- 172.21.15.28:0/4130036338 learned_addr learned my addr 172.21.15.28:0/4130036338 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f6542d9d640 1 --2- 172.21.15.28:0/4130036338 >> v2:172.21.15.134:3300/0 conn(0x7f65440c5260 0x7f654406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f654359e640 1 -- 172.21.15.28:0/4130036338 >> v2:172.21.15.134:3300/0 conn(0x7f65440c5260 msgr2=0x7f654406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f654359e640 1 --2- 172.21.15.28:0/4130036338 >> v2:172.21.15.134:3300/0 conn(0x7f65440c5260 0x7f654406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f654359e640 1 -- 172.21.15.28:0/4130036338 >> v1:172.21.15.134:6789/0 conn(0x7f65440c5640 legacy=0x7f65440c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f654359e640 1 -- 172.21.15.28:0/4130036338 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440c1a00 con 0x7f6544155de0 2023-12-16T03:25:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f6542d9d640 1 --2- 172.21.15.28:0/4130036338 >> v2:172.21.15.134:3300/0 conn(0x7f65440c5260 0x7f654406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f654259c640 1 -- 172.21.15.28:0/4130036338 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745937340 0 0) 0x7f65440c2580 con 0x7f65440c5640 2023-12-16T03:25:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f654359e640 1 --2- 172.21.15.28:0/4130036338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 0x7f6544156230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f65440c1930 tx=0x7f653c01c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0b7042e3c0d81c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f654259c640 1 -- 172.21.15.28:0/4130036338 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c0a5700 con 0x7f6544155de0 2023-12-16T03:25:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f654259c640 1 -- 172.21.15.28:0/4130036338 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c0a5860 con 0x7f6544155de0 2023-12-16T03:25:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.839+0000 7f654259c640 1 -- 172.21.15.28:0/4130036338 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c0a5bf0 con 0x7f6544155de0 2023-12-16T03:25:30.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 -- 172.21.15.28:0/4130036338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 msgr2=0x7f6544156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 --2- 172.21.15.28:0/4130036338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 0x7f6544156230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f65440c1930 tx=0x7f653c01c930 comp rx=0 tx=0).stop 2023-12-16T03:25:30.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 -- 172.21.15.28:0/4130036338 shutdown_connections 2023-12-16T03:25:30.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 --2- 172.21.15.28:0/4130036338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 0x7f6544156230 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 --2- 172.21.15.28:0/4130036338 >> v2:172.21.15.134:3300/0 conn(0x7f65440c5260 0x7f654406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 -- 172.21.15.28:0/4130036338 >> 172.21.15.28:0/4130036338 conn(0x7f654406a5b0 msgr2=0x7f654406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:30.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 -- 172.21.15.28:0/4130036338 shutdown_connections 2023-12-16T03:25:30.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 -- 172.21.15.28:0/4130036338 wait complete. 2023-12-16T03:25:30.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 Processor -- start 2023-12-16T03:25:30.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 -- start start 2023-12-16T03:25:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65440c5260 0x7f65440bf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65440c5640 0x7f65440bfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 0x7f654414c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6544153870 con 0x7f65440c5260 2023-12-16T03:25:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65440c4880 con 0x7f65440c5640 2023-12-16T03:25:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654906b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65440c4b60 con 0x7f6544155de0 2023-12-16T03:25:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f6542d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65440c5260 0x7f65440bf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f6542d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65440c5260 0x7f65440bf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55894/0 (socket says 172.21.15.28:55894) 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f6542d9d640 1 -- 172.21.15.28:0/3175615717 learned_addr learned my addr 172.21.15.28:0/3175615717 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f654359e640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 0x7f654414c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f653bfff640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65440c5640 0x7f65440bfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f6542d9d640 1 -- 172.21.15.28:0/3175615717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 msgr2=0x7f654414c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f6542d9d640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 0x7f654414c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f6542d9d640 1 -- 172.21.15.28:0/3175615717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65440c5640 msgr2=0x7f65440bfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f6542d9d640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65440c5640 0x7f65440bfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f6542d9d640 1 -- 172.21.15.28:0/3175615717 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653400d8c0 con 0x7f65440c5260 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.843+0000 7f653bfff640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65440c5640 0x7f65440bfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.847+0000 7f6542d9d640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65440c5260 0x7f65440bf780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6534012fc0 tx=0x7f6534010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.847+0000 7f653b7fe640 1 -- 172.21.15.28:0/3175615717 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400db80 con 0x7f65440c5260 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.847+0000 7f653b7fe640 1 -- 172.21.15.28:0/3175615717 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534013040 con 0x7f65440c5260 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.847+0000 7f654906b640 1 -- 172.21.15.28:0/3175615717 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c009b30 con 0x7f65440c5260 2023-12-16T03:25:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.847+0000 7f653b7fe640 1 -- 172.21.15.28:0/3175615717 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400d2e0 con 0x7f65440c5260 2023-12-16T03:25:30.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.847+0000 7f654906b640 1 -- 172.21.15.28:0/3175615717 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6544151420 con 0x7f65440c5260 2023-12-16T03:25:30.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.847+0000 7f654906b640 1 -- 172.21.15.28:0/3175615717 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6544068400 con 0x7f65440c5260 2023-12-16T03:25:30.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.847+0000 7f653b7fe640 1 -- 172.21.15.28:0/3175615717 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6534018480 con 0x7f65440c5260 2023-12-16T03:25:30.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.847+0000 7f653b7fe640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6524066470 0x7f6524068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:30.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.847+0000 7f653b7fe640 1 -- 172.21.15.28:0/3175615717 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65340883d0 con 0x7f65440c5260 2023-12-16T03:25:30.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.847+0000 7f653bfff640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6524066470 0x7f6524068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:30.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.851+0000 7f653bfff640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6524066470 0x7f6524068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f652c000f70 tx=0x7f652c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:30.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:30.851+0000 7f653b7fe640 1 -- 172.21.15.28:0/3175615717 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6534055830 con 0x7f65440c5260 2023-12-16T03:25:31.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.011+0000 7f654906b640 1 -- 172.21.15.28:0/3175615717 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65441e8290 con 0x7f65440c5260 2023-12-16T03:25:31.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f653b7fe640 1 -- 172.21.15.28:0/3175615717 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f6534058e50 con 0x7f65440c5260 2023-12-16T03:25:31.017 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:31.017 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:31.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 -- 172.21.15.28:0/3175615717 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6524066470 msgr2=0x7f6524068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6524066470 0x7f6524068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f652c000f70 tx=0x7f652c009040 comp rx=0 tx=0).stop 2023-12-16T03:25:31.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 -- 172.21.15.28:0/3175615717 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65440c5260 msgr2=0x7f65440bf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65440c5260 0x7f65440bf780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6534012fc0 tx=0x7f6534010490 comp rx=0 tx=0).stop 2023-12-16T03:25:31.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 -- 172.21.15.28:0/3175615717 shutdown_connections 2023-12-16T03:25:31.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6544155de0 0x7f654414c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65440c5640 0x7f65440bfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6524066470 0x7f6524068930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 --2- 172.21.15.28:0/3175615717 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65440c5260 0x7f65440bf780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 -- 172.21.15.28:0/3175615717 >> 172.21.15.28:0/3175615717 conn(0x7f654406a5b0 msgr2=0x7f6544152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:31.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 -- 172.21.15.28:0/3175615717 shutdown_connections 2023-12-16T03:25:31.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.015+0000 7f654906b640 1 -- 172.21.15.28:0/3175615717 wait complete. 2023-12-16T03:25:31.039 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:25:31.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f286ac79640 1 Processor -- start 2023-12-16T03:25:31.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f286ac79640 1 -- start start 2023-12-16T03:25:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f286ac79640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f28640c5260 0x7f286406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f286ac79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2864155de0 0x7f2864156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f286ac79640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28640c2580 con 0x7f28640c5640 2023-12-16T03:25:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f286ac79640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2864153510 con 0x7f28640c5260 2023-12-16T03:25:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f286ac79640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28640c17f0 con 0x7f2864155de0 2023-12-16T03:25:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f2868a15640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f28640c5260 0x7f286406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f2868a15640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f28640c5260 0x7f286406d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55908/0 (socket says 172.21.15.28:55908) 2023-12-16T03:25:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f2868a15640 1 -- 172.21.15.28:0/2477080394 learned_addr learned my addr 172.21.15.28:0/2477080394 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f2869216640 1 --2- 172.21.15.28:0/2477080394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2864155de0 0x7f2864156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f2868a15640 1 -- 172.21.15.28:0/2477080394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2864155de0 msgr2=0x7f2864156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:31.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f2868a15640 1 --2- 172.21.15.28:0/2477080394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2864155de0 0x7f2864156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f2868a15640 1 -- 172.21.15.28:0/2477080394 >> v1:172.21.15.134:6789/0 conn(0x7f28640c5640 legacy=0x7f28640c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:31.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.179+0000 7f2868a15640 1 -- 172.21.15.28:0/2477080394 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640c1a00 con 0x7f28640c5260 2023-12-16T03:25:31.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f2868a15640 1 --2- 172.21.15.28:0/2477080394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28640c5260 0x7f286406d5b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f28640c1930 tx=0x7f285801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb610d0ad3fc4a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:31.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f28637fe640 1 -- 172.21.15.28:0/2477080394 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28580ab660 con 0x7f28640c5260 2023-12-16T03:25:31.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f28637fe640 1 -- 172.21.15.28:0/2477080394 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28580ab7c0 con 0x7f28640c5260 2023-12-16T03:25:31.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f28637fe640 1 -- 172.21.15.28:0/2477080394 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28580abb50 con 0x7f28640c5260 2023-12-16T03:25:31.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f286ac79640 1 -- 172.21.15.28:0/2477080394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28640c5260 msgr2=0x7f286406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f286ac79640 1 --2- 172.21.15.28:0/2477080394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28640c5260 0x7f286406d5b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f28640c1930 tx=0x7f285801c460 comp rx=0 tx=0).stop 2023-12-16T03:25:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f286ac79640 1 -- 172.21.15.28:0/2477080394 shutdown_connections 2023-12-16T03:25:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f286ac79640 1 --2- 172.21.15.28:0/2477080394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2864155de0 0x7f2864156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f286ac79640 1 --2- 172.21.15.28:0/2477080394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28640c5260 0x7f286406d5b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f286ac79640 1 -- 172.21.15.28:0/2477080394 >> 172.21.15.28:0/2477080394 conn(0x7f286406a5b0 msgr2=0x7f286406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f286ac79640 1 -- 172.21.15.28:0/2477080394 shutdown_connections 2023-12-16T03:25:31.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.183+0000 7f286ac79640 1 -- 172.21.15.28:0/2477080394 wait complete. 2023-12-16T03:25:31.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f286ac79640 1 Processor -- start 2023-12-16T03:25:31.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f286ac79640 1 -- start start 2023-12-16T03:25:31.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f286ac79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28640c5260 0x7f286414ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f286ac79640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28640c5640 0x7f2864156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f286ac79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2864155de0 0x7f28641574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f286ac79640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28641edcb0 con 0x7f28640c5260 2023-12-16T03:25:31.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f286ac79640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286414f240 con 0x7f28640c5640 2023-12-16T03:25:31.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f286ac79640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28640aa7b0 con 0x7f2864155de0 2023-12-16T03:25:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f2868a15640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28640c5260 0x7f286414ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f2868a15640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28640c5260 0x7f286414ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55922/0 (socket says 172.21.15.28:55922) 2023-12-16T03:25:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f2868a15640 1 -- 172.21.15.28:0/3651064096 learned_addr learned my addr 172.21.15.28:0/3651064096 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f2863fff640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28640c5640 0x7f2864156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f2869216640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2864155de0 0x7f28641574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f2868a15640 1 -- 172.21.15.28:0/3651064096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2864155de0 msgr2=0x7f28641574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f2868a15640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2864155de0 0x7f28641574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f2868a15640 1 -- 172.21.15.28:0/3651064096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28640c5640 msgr2=0x7f2864156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f2868a15640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28640c5640 0x7f2864156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f2868a15640 1 -- 172.21.15.28:0/3651064096 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580094d0 con 0x7f28640c5260 2023-12-16T03:25:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f2868a15640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28640c5260 0x7f286414ed00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f28580ad040 tx=0x7f285801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f28617fa640 1 -- 172.21.15.28:0/3651064096 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28580b4800 con 0x7f28640c5260 2023-12-16T03:25:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f28617fa640 1 -- 172.21.15.28:0/3651064096 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28580b4980 con 0x7f28640c5260 2023-12-16T03:25:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f28617fa640 1 -- 172.21.15.28:0/3651064096 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28580b4d30 con 0x7f28640c5260 2023-12-16T03:25:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f286ac79640 1 -- 172.21.15.28:0/3651064096 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28640aaa90 con 0x7f28640c5260 2023-12-16T03:25:31.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f286ac79640 1 -- 172.21.15.28:0/3651064096 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28640a91b0 con 0x7f28640c5260 2023-12-16T03:25:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.187+0000 7f286ac79640 1 -- 172.21.15.28:0/3651064096 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2864068400 con 0x7f28640c5260 2023-12-16T03:25:31.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.191+0000 7f28617fa640 1 -- 172.21.15.28:0/3651064096 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f28580a9070 con 0x7f28640c5260 2023-12-16T03:25:31.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.191+0000 7f28617fa640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 0x7f2848068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.191+0000 7f28617fa640 1 -- 172.21.15.28:0/3651064096 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f285811e860 con 0x7f28640c5260 2023-12-16T03:25:31.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.191+0000 7f2863fff640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 0x7f2848068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.191+0000 7f2863fff640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 0x7f2848068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2850007fd0 tx=0x7f2850009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:31.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.195+0000 7f28617fa640 1 -- 172.21.15.28:0/3651064096 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f28580ebea0 con 0x7f28640c5260 2023-12-16T03:25:31.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.383+0000 7f286ac79640 1 -- 172.21.15.28:0/3651064096 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f286414f920 con 0x7f28640c5260 2023-12-16T03:25:31.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f28617fa640 1 -- 172.21.15.28:0/3651064096 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f28580ef4c0 con 0x7f28640c5260 2023-12-16T03:25:31.389 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:31.389 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/2517100030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2517100030},{"type":"v1","addr":"172.21.15.134:6835","nonce":2517100030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/146686059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":146686059},{"type":"v1","addr":"172.21.15.28:6836","nonce":146686059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1280024314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1280024314},{"type":"v1","addr":"172.21.15.28:6837","nonce":1280024314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:25:15.321507+0000","modified":"2023-12-16T03:25:18.328454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/199412786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":199412786},{"type":"v1","addr":"172.21.15.134:6834","nonce":199412786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T03:25:31.390 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-12-16T03:25:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 -- 172.21.15.28:0/3651064096 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 msgr2=0x7f2848068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 0x7f2848068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2850007fd0 tx=0x7f2850009040 comp rx=0 tx=0).stop 2023-12-16T03:25:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 -- 172.21.15.28:0/3651064096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28640c5260 msgr2=0x7f286414ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28640c5260 0x7f286414ed00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f28580ad040 tx=0x7f285801aca0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 -- 172.21.15.28:0/3651064096 shutdown_connections 2023-12-16T03:25:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2864155de0 0x7f28641574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28640c5640 0x7f2864156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 0x7f2848068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 --2- 172.21.15.28:0/3651064096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28640c5260 0x7f286414ed00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 -- 172.21.15.28:0/3651064096 >> 172.21.15.28:0/3651064096 conn(0x7f286406a5b0 msgr2=0x7f28640a61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 -- 172.21.15.28:0/3651064096 shutdown_connections 2023-12-16T03:25:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.387+0000 7f286ac79640 1 -- 172.21.15.28:0/3651064096 wait complete. 2023-12-16T03:25:31.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-16T03:25:15.321507+0000', 'modified': '2023-12-16T03:25:18.328454+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6834/199412786', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6833', 'nonce': 199412786}, {'type': 'v1', 'addr': '172.21.15.134:6834', 'nonce': 199412786}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-16T03:25:31.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-16T03:25:31.813 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-16T03:25:31.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.955+0000 7f055a2c9640 1 Processor -- start 2023-12-16T03:25:31.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.955+0000 7f055a2c9640 1 -- start start 2023-12-16T03:25:31.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f055a2c9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f055414ec10 0x7f0554070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f055a2c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f05540c1400 0x7f055406e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f055a2c9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055406f350 con 0x7f05540714a0 2023-12-16T03:25:31.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f055a2c9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0554071a00 con 0x7f055414ec10 2023-12-16T03:25:31.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f055a2c9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05541521e0 con 0x7f05540c1400 2023-12-16T03:25:31.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f0553fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f055414ec10 0x7f0554070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f0558866640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f05540714a0 0x7f0554154960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43534/0 (socket says 172.21.15.28:43534) 2023-12-16T03:25:31.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f0558866640 1 -- 172.21.15.28:0/1883171251 learned_addr learned my addr 172.21.15.28:0/1883171251 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:31.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f05537fe640 1 --2- 172.21.15.28:0/1883171251 >> v2:172.21.15.134:3300/0 conn(0x7f05540c1400 0x7f055406e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f0553fff640 1 -- 172.21.15.28:0/1883171251 >> v2:172.21.15.134:3300/0 conn(0x7f05540c1400 msgr2=0x7f055406e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:31.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f0553fff640 1 --2- 172.21.15.28:0/1883171251 >> v2:172.21.15.134:3300/0 conn(0x7f05540c1400 0x7f055406e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f0553fff640 1 -- 172.21.15.28:0/1883171251 >> v1:172.21.15.28:6789/0 conn(0x7f05540714a0 legacy=0x7f0554154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f0553fff640 1 -- 172.21.15.28:0/1883171251 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055406f5a0 con 0x7f055414ec10 2023-12-16T03:25:31.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.959+0000 7f0552ffd640 1 -- 172.21.15.28:0/1883171251 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162436349 0 0) 0x7f055406f350 con 0x7f05540714a0 2023-12-16T03:25:31.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f0553fff640 1 --2- 172.21.15.28:0/1883171251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f055414ec10 0x7f0554070f60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f05540a8f00 tx=0x7f054401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cacaa3f25091a84 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:31.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f0552ffd640 1 -- 172.21.15.28:0/1883171251 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05440ac600 con 0x7f055414ec10 2023-12-16T03:25:31.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f0552ffd640 1 -- 172.21.15.28:0/1883171251 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05440a8050 con 0x7f055414ec10 2023-12-16T03:25:31.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f0552ffd640 1 -- 172.21.15.28:0/1883171251 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05440ac980 con 0x7f055414ec10 2023-12-16T03:25:31.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f055a2c9640 1 -- 172.21.15.28:0/1883171251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f055414ec10 msgr2=0x7f0554070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f055a2c9640 1 --2- 172.21.15.28:0/1883171251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f055414ec10 0x7f0554070f60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f05540a8f00 tx=0x7f054401c3a0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f055a2c9640 1 -- 172.21.15.28:0/1883171251 shutdown_connections 2023-12-16T03:25:31.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f055a2c9640 1 --2- 172.21.15.28:0/1883171251 >> v2:172.21.15.134:3300/0 conn(0x7f05540c1400 0x7f055406e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f055a2c9640 1 --2- 172.21.15.28:0/1883171251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f055414ec10 0x7f0554070f60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f055a2c9640 1 -- 172.21.15.28:0/1883171251 >> 172.21.15.28:0/1883171251 conn(0x7f05540c6ef0 msgr2=0x7f05540c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:31.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f055a2c9640 1 -- 172.21.15.28:0/1883171251 shutdown_connections 2023-12-16T03:25:31.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f055a2c9640 1 -- 172.21.15.28:0/1883171251 wait complete. 2023-12-16T03:25:31.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f055a2c9640 1 Processor -- start 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.963+0000 7f055a2c9640 1 -- start start 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f055a2c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05540714a0 0x7f05541458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f055a2c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f055414ec10 0x7f0554153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f055a2c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0554152dd0 0x7f055415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f055a2c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05541ee030 con 0x7f05540714a0 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f055a2c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05541460d0 con 0x7f0554152dd0 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f055a2c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0554154d10 con 0x7f055414ec10 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0553fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05540714a0 0x7f05541458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0553fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05540714a0 0x7f05541458c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55948/0 (socket says 172.21.15.28:55948) 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0553fff640 1 -- 172.21.15.28:0/3421935356 learned_addr learned my addr 172.21.15.28:0/3421935356 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0553fff640 1 -- 172.21.15.28:0/3421935356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f055414ec10 msgr2=0x7f0554153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0553fff640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f055414ec10 0x7f0554153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0553fff640 1 -- 172.21.15.28:0/3421935356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0554152dd0 msgr2=0x7f055415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0553fff640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0554152dd0 0x7f055415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0553fff640 1 -- 172.21.15.28:0/3421935356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0544009420 con 0x7f05540714a0 2023-12-16T03:25:31.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0553fff640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05540714a0 0x7f05541458c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0544019fd0 tx=0x7f054401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:31.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0550ff9640 1 -- 172.21.15.28:0/3421935356 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05440b5830 con 0x7f05540714a0 2023-12-16T03:25:31.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0550ff9640 1 -- 172.21.15.28:0/3421935356 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05440b5990 con 0x7f05540714a0 2023-12-16T03:25:31.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f055a2c9640 1 -- 172.21.15.28:0/3421935356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05541edc50 con 0x7f05540714a0 2023-12-16T03:25:31.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f0550ff9640 1 -- 172.21.15.28:0/3421935356 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05440b5d00 con 0x7f05540714a0 2023-12-16T03:25:31.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.967+0000 7f055a2c9640 1 -- 172.21.15.28:0/3421935356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0554151230 con 0x7f05540714a0 2023-12-16T03:25:31.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0550ff9640 1 -- 172.21.15.28:0/3421935356 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f05440b3070 con 0x7f05540714a0 2023-12-16T03:25:31.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0550ff9640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0540066470 0x7f0540068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0550ff9640 1 -- 172.21.15.28:0/3421935356 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f054411e950 con 0x7f05540714a0 2023-12-16T03:25:31.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f05537fe640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0540066470 0x7f0540068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f055d633000 1 Processor -- start 2023-12-16T03:25:31.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f055d633000 1 -- start start 2023-12-16T03:25:31.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f05537fe640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0540066470 0x7f0540068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f05540c2190 tx=0x7f0548008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:31.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f055d633000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe65650 0x55d6cfe65a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f055d633000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65f70 0x55d6cfe66350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f055d633000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe66890 0x55d6cfeafde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f055d633000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cfd2ff00 con 0x55d6cfe66890 2023-12-16T03:25:31.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f055d633000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cfcbfdd0 con 0x55d6cfe65650 2023-12-16T03:25:31.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f055d633000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6cfcbd300 con 0x55d6cfe65f70 2023-12-16T03:25:31.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0558866640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe66890 0x55d6cfeafde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0558866640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe66890 0x55d6cfeafde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55954/0 (socket says 172.21.15.28:55954) 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0558866640 1 -- 172.21.15.28:0/1136778381 learned_addr learned my addr 172.21.15.28:0/1136778381 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0553fff640 1 --2- 172.21.15.28:0/1136778381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe65650 0x55d6cfe65a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f05537fe640 1 --2- 172.21.15.28:0/1136778381 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65f70 0x55d6cfe66350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0558866640 1 -- 172.21.15.28:0/1136778381 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65f70 msgr2=0x55d6cfe66350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0558866640 1 --2- 172.21.15.28:0/1136778381 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65f70 0x55d6cfe66350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0558866640 1 -- 172.21.15.28:0/1136778381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe65650 msgr2=0x55d6cfe65a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0558866640 1 --2- 172.21.15.28:0/1136778381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe65650 0x55d6cfe65a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0558866640 1 -- 172.21.15.28:0/1136778381 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6cf9b0890 con 0x55d6cfe66890 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0558866640 1 --2- 172.21.15.28:0/1136778381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe66890 0x55d6cfeafde0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f054c001d20 tx=0x7f054c0021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2820edb7f32a8ba6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0539ffb640 1 -- 172.21.15.28:0/1136778381 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c00c8a0 con 0x55d6cfe66890 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0539ffb640 1 -- 172.21.15.28:0/1136778381 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c00ca00 con 0x55d6cfe66890 2023-12-16T03:25:31.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.971+0000 7f0539ffb640 1 -- 172.21.15.28:0/1136778381 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c00cd90 con 0x55d6cfe66890 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 -- 172.21.15.28:0/1136778381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe66890 msgr2=0x55d6cfeafde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 --2- 172.21.15.28:0/1136778381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe66890 0x55d6cfeafde0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f054c001d20 tx=0x7f054c0021e0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 -- 172.21.15.28:0/1136778381 shutdown_connections 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 --2- 172.21.15.28:0/1136778381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe66890 0x55d6cfeafde0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 --2- 172.21.15.28:0/1136778381 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65f70 0x55d6cfe66350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 --2- 172.21.15.28:0/1136778381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe65650 0x55d6cfe65a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 -- 172.21.15.28:0/1136778381 >> 172.21.15.28:0/1136778381 conn(0x55d6cfe6e2f0 msgr2=0x55d6cfea5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 -- 172.21.15.28:0/1136778381 shutdown_connections 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 -- 172.21.15.28:0/1136778381 wait complete. 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 -- start start 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 Processor -- start 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe65650 0x55d6cfe6a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cfe6a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe66890 0x55d6cfe6ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cfcb8bf0 con 0x55d6cfe65f70 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cfc70c60 con 0x55d6cfe65650 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6cfc76b00 con 0x55d6cfe66890 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 10 client.0 _ll_register_callbacks cb 0x55d6cfe53710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f05537fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cfe6a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f05537fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cfe6a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55956/0 (socket says 172.21.15.28:55956) 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f05537fe640 1 -- 172.21.15.28:0/3233623779 learned_addr learned my addr 172.21.15.28:0/3233623779 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f0553fff640 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe65650 0x55d6cfe6a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f0558866640 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe66890 0x55d6cfe6ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f05537fe640 1 -- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe66890 msgr2=0x55d6cfe6ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f05537fe640 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe66890 0x55d6cfe6ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f05537fe640 1 -- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe65650 msgr2=0x55d6cfe6a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:31.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f05537fe640 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe65650 0x55d6cfe6a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f05537fe640 1 -- 172.21.15.28:0/3233623779 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054c001950 con 0x55d6cfe65f70 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f0553fff640 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe65650 0x55d6cfe6a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f05537fe640 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cfe6a940 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f054800deb0 tx=0x7f05480046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cb07e3f1baae62 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f0532ffd640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f0532ffd640 1 -- 172.21.15.28:0/3233623779 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548020600 con 0x55d6cfe65f70 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f0532ffd640 1 -- 172.21.15.28:0/3233623779 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0548020760 con 0x55d6cfe65f70 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 -- 172.21.15.28:0/3233623779 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6cfc76490 con 0x55d6cfe65f70 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f0532ffd640 1 -- 172.21.15.28:0/3233623779 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0548020920 con 0x55d6cfe65f70 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 10 client.4668 fetch_fsmap learned FSMap version 8 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 1 -- 172.21.15.28:0/3233623779 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d6cfc79200 con 0x55d6cfe65f70 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f0532ffd640 1 -- 172.21.15.28:0/3233623779 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6cfc76490 con 0x55d6cfe65f70 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f0532ffd640 1 -- 172.21.15.28:0/3233623779 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f054801f070 con 0x55d6cfe65f70 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.975+0000 7f055d633000 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 10 client.4668 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-16T03:25:31.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 20 client.4668 populate_metadata read hostname 'smithi028' 2023-12-16T03:25:31.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:6833/199412786,v1:172.21.15.134:6834/199412786] conn(0x55d6cfeb8140 0x55d6cfeba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:31.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 4 client.4668 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-16T03:25:31.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 -- 172.21.15.28:0/3233623779 --> [v2:172.21.15.134:6833/199412786,v1:172.21.15.134:6834/199412786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6cfcb7540 con 0x55d6cfeb8140 2023-12-16T03:25:31.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f0553fff640 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:6833/199412786,v1:172.21.15.134:6834/199412786] conn(0x55d6cfeb8140 0x55d6cfeba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:31.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f0553fff640 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:6833/199412786,v1:172.21.15.134:6834/199412786] conn(0x55d6cfeb8140 0x55d6cfeba530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50932a09990e5c7e server_cookie=e09bfc42bf30ab40 in_seq=0 out_seq=0 2023-12-16T03:25:31.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f0532ffd640 10 client.4668 ms_handle_connect on v2:172.21.15.134:6833/199412786 2023-12-16T03:25:31.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f0532ffd640 1 -- 172.21.15.28:0/3233623779 <== mds.0 v2:172.21.15.134:6833/199412786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d6cfcb7540 con 0x55d6cfeb8140 2023-12-16T03:25:31.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f0532ffd640 10 client.4668 handle_command_reply: tid=0 2023-12-16T03:25:31.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 client.4668 shutdown 2023-12-16T03:25:31.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 -- 172.21.15.28:0/3233623779 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 msgr2=0x55d6cfe6a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:31.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cfe6a940 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f054800deb0 tx=0x7f05480046d0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 -- 172.21.15.28:0/3233623779 shutdown_connections 2023-12-16T03:25:31.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe66890 0x55d6cfe6ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cfe6a940 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:6833/199412786,v1:172.21.15.134:6834/199412786] conn(0x55d6cfeb8140 0x55d6cfeba530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 --2- 172.21.15.28:0/3233623779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe65650 0x55d6cfe6a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:31.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 -- 172.21.15.28:0/3233623779 >> 172.21.15.28:0/3233623779 conn(0x55d6cfe6e2f0 msgr2=0x55d6cfe64d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:31.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f0532ffd640 0 client.4668 ms_handle_reset on v2:172.21.15.134:6833/199412786 2023-12-16T03:25:31.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 -- 172.21.15.28:0/3233623779 shutdown_connections 2023-12-16T03:25:31.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 1 -- 172.21.15.28:0/3233623779 wait complete. 2023-12-16T03:25:31.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.979+0000 7f055d633000 20 client.4668 trim_cache size 0 max 16384 2023-12-16T03:25:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f055d633000 1 Processor -- start 2023-12-16T03:25:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f055d633000 1 -- start start 2023-12-16T03:25:32.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f055d633000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65650 0x55d6cff02350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f055d633000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff02890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f055d633000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe66890 0x55d6cff02dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f055d633000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cf971940 con 0x55d6cfe65f70 2023-12-16T03:25:32.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f055d633000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cfcb7a80 con 0x55d6cfe66890 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f055d633000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6cfea2da0 con 0x55d6cfe65650 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f05537fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff02890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f05537fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff02890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55960/0 (socket says 172.21.15.28:55960) 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f05537fe640 1 -- 172.21.15.28:0/117544863 learned_addr learned my addr 172.21.15.28:0/117544863 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f0558866640 1 --2- 172.21.15.28:0/117544863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe66890 0x55d6cff02dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f0553fff640 1 --2- 172.21.15.28:0/117544863 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65650 0x55d6cff02350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f05537fe640 1 -- 172.21.15.28:0/117544863 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65650 msgr2=0x55d6cff02350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f05537fe640 1 --2- 172.21.15.28:0/117544863 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65650 0x55d6cff02350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f05537fe640 1 -- 172.21.15.28:0/117544863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe66890 msgr2=0x55d6cff02dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f05537fe640 1 --2- 172.21.15.28:0/117544863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe66890 0x55d6cff02dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f05537fe640 1 -- 172.21.15.28:0/117544863 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6cfc5f500 con 0x55d6cfe65f70 2023-12-16T03:25:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.995+0000 7f05537fe640 1 --2- 172.21.15.28:0/117544863 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff02890 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0548000c10 tx=0x7f0548020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27c7810c96f32c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:32.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f053a7fc640 1 -- 172.21.15.28:0/117544863 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05480090c0 con 0x55d6cfe65f70 2023-12-16T03:25:32.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f053a7fc640 1 -- 172.21.15.28:0/117544863 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0548018070 con 0x55d6cfe65f70 2023-12-16T03:25:32.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f053a7fc640 1 -- 172.21.15.28:0/117544863 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548020820 con 0x55d6cfe65f70 2023-12-16T03:25:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 -- 172.21.15.28:0/117544863 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 msgr2=0x55d6cff02890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 --2- 172.21.15.28:0/117544863 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff02890 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0548000c10 tx=0x7f0548020000 comp rx=0 tx=0).stop 2023-12-16T03:25:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 -- 172.21.15.28:0/117544863 shutdown_connections 2023-12-16T03:25:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 --2- 172.21.15.28:0/117544863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe66890 0x55d6cff02dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 --2- 172.21.15.28:0/117544863 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff02890 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 --2- 172.21.15.28:0/117544863 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65650 0x55d6cff02350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 -- 172.21.15.28:0/117544863 >> 172.21.15.28:0/117544863 conn(0x55d6cfe6e2f0 msgr2=0x55d6cfea15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 -- 172.21.15.28:0/117544863 shutdown_connections 2023-12-16T03:25:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 -- 172.21.15.28:0/117544863 wait complete. 2023-12-16T03:25:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 -- start start 2023-12-16T03:25:32.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 Processor -- start 2023-12-16T03:25:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65650 0x55d6cff067f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff06d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe66890 0x55d6cff07830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cfcb4ce0 con 0x55d6cfe65f70 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cfcbb750 con 0x55d6cfe66890 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6cfcc3020 con 0x55d6cfe65650 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f055d633000 10 client.0 _ll_register_callbacks cb 0x55d6cfe33f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f05537fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff06d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f05537fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff06d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55972/0 (socket says 172.21.15.28:55972) 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f05537fe640 1 -- 172.21.15.28:0/551080502 learned_addr learned my addr 172.21.15.28:0/551080502 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f0553fff640 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65650 0x55d6cff067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f0558866640 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe66890 0x55d6cff07830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f05537fe640 1 -- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65650 msgr2=0x55d6cff067f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f05537fe640 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65650 0x55d6cff067f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f05537fe640 1 -- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe66890 msgr2=0x55d6cff07830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f05537fe640 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe66890 0x55d6cff07830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f05537fe640 1 -- 172.21.15.28:0/551080502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6cfc79200 con 0x55d6cfe65f70 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f05537fe640 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff06d30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f054800d8d0 tx=0x7f0548014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2031227074919a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f0532ffd640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:31.999+0000 7f0532ffd640 1 -- 172.21.15.28:0/551080502 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548029600 con 0x55d6cfe65f70 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 -- 172.21.15.28:0/551080502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6cfc3fa50 con 0x55d6cfe65f70 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f0532ffd640 1 -- 172.21.15.28:0/551080502 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0548029760 con 0x55d6cfe65f70 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f0532ffd640 1 -- 172.21.15.28:0/551080502 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0548029920 con 0x55d6cfe65f70 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 10 client.4674 fetch_fsmap learned FSMap version 8 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 -- 172.21.15.28:0/551080502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d6cf9b0cc0 con 0x55d6cfe65f70 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f0532ffd640 1 -- 172.21.15.28:0/551080502 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6cfc3fa50 con 0x55d6cfe65f70 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f0532ffd640 1 -- 172.21.15.28:0/551080502 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0548029a80 con 0x55d6cfe65f70 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 10 client.4674 fetch_fsmap finished waiting for FSMap version 8 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 10 client.4674 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 20 client.4674 populate_metadata read hostname 'smithi028' 2023-12-16T03:25:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:6833/199412786,v1:172.21.15.134:6834/199412786] conn(0x55d6cff07d70 0x55d6cff08150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 4 client.4674 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-16T03:25:32.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 -- 172.21.15.28:0/551080502 --> [v2:172.21.15.134:6833/199412786,v1:172.21.15.134:6834/199412786] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d6cfce6f30 con 0x55d6cff07d70 2023-12-16T03:25:32.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f0553fff640 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:6833/199412786,v1:172.21.15.134:6834/199412786] conn(0x55d6cff07d70 0x55d6cff08150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:32.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f0553fff640 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:6833/199412786,v1:172.21.15.134:6834/199412786] conn(0x55d6cff07d70 0x55d6cff08150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94b025c89e42e984 server_cookie=32e8848f330c35da in_seq=0 out_seq=0 2023-12-16T03:25:32.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f0532ffd640 10 client.4674 ms_handle_connect on v2:172.21.15.134:6833/199412786 2023-12-16T03:25:32.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f0532ffd640 1 -- 172.21.15.28:0/551080502 <== mds.0 v2:172.21.15.134:6833/199412786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d6cfce6f30 con 0x55d6cff07d70 2023-12-16T03:25:32.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f0532ffd640 10 client.4674 handle_command_reply: tid=0 2023-12-16T03:25:32.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 client.4674 shutdown 2023-12-16T03:25:32.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 -- 172.21.15.28:0/551080502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 msgr2=0x55d6cff06d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:32.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff06d30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f054800d8d0 tx=0x7f0548014000 comp rx=0 tx=0).stop 2023-12-16T03:25:32.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 -- 172.21.15.28:0/551080502 shutdown_connections 2023-12-16T03:25:32.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:6833/199412786,v1:172.21.15.134:6834/199412786] conn(0x55d6cff07d70 0x55d6cff08150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6cfe66890 0x55d6cff07830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d6cfe65f70 0x55d6cff06d30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f0532ffd640 0 client.4674 ms_handle_reset on v2:172.21.15.134:6833/199412786 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 --2- 172.21.15.28:0/551080502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55d6cfe65650 0x55d6cff067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 -- 172.21.15.28:0/551080502 >> 172.21.15.28:0/551080502 conn(0x55d6cfe6e2f0 msgr2=0x55d6cfea0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 -- 172.21.15.28:0/551080502 shutdown_connections 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 1 -- 172.21.15.28:0/551080502 wait complete. 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055d633000 20 client.4674 trim_cache size 0 max 16384 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "96b65b79-be1d-4832-b923-85c874d6fb27", 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4279, 2023-12-16T03:25:32.010 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2023-12-16T03:25:32.011 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2023-12-16T03:25:32.011 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2023-12-16T03:25:32.011 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 16.088611899, 2023-12-16T03:25:32.011 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 8, 2023-12-16T03:25:32.011 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 20, 2023-12-16T03:25:32.011 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 20, 2023-12-16T03:25:32.011 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 22.853370780999999 2023-12-16T03:25:32.011 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 -- 172.21.15.28:0/3421935356 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0540066470 msgr2=0x7f0540068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0540066470 0x7f0540068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f05540c2190 tx=0x7f0548008040 comp rx=0 tx=0).stop 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 -- 172.21.15.28:0/3421935356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05540714a0 msgr2=0x7f05541458c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05540714a0 0x7f05541458c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0544019fd0 tx=0x7f054401abe0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 -- 172.21.15.28:0/3421935356 shutdown_connections 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0554152dd0 0x7f055415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f055414ec10 0x7f0554153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0540066470 0x7f0540068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 --2- 172.21.15.28:0/3421935356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05540714a0 0x7f05541458c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 -- 172.21.15.28:0/3421935356 >> 172.21.15.28:0/3421935356 conn(0x7f05540c6ef0 msgr2=0x7f055414dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 -- 172.21.15.28:0/3421935356 shutdown_connections 2023-12-16T03:25:32.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.003+0000 7f055a2c9640 1 -- 172.21.15.28:0/3421935356 wait complete. 2023-12-16T03:25:32.027 INFO:teuthology.run_tasks:Running task kclient... 2023-12-16T03:25:32.050 INFO:tasks.kclient:Mounting kernel clients... 2023-12-16T03:25:32.050 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-16T03:25:32.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.050 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2023-12-16T03:25:32.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.061 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link delete ceph-brx 2023-12-16T03:25:32.128 INFO:teuthology.orchestra.run.smithi028.stderr:Cannot find device "ceph-brx" 2023-12-16T03:25:32.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:25:32.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.130 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-16T03:25:32.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2023-12-16T03:25:32.209 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2023-12-16T03:25:32.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:25:32.212 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-16T03:25:32.212 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T03:25:32.212 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T03:25:32.212 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:25:32.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.351+0000 7ff7223e6640 1 Processor -- start 2023-12-16T03:25:32.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.351+0000 7ff7223e6640 1 -- start start 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.351+0000 7ff7223e6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff71c0a7450 0x7ff71c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.351+0000 7ff7223e6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff71c0c76a0 0x7ff71c06f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.351+0000 7ff7223e6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71c156820 con 0x7ff71c06fcb0 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.351+0000 7ff7223e6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71c06ec40 con 0x7ff71c0a7450 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.351+0000 7ff7223e6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0a7830 con 0x7ff71c0c76a0 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.351+0000 7ff71bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff71c0a7450 0x7ff71c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.351+0000 7ff720983640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff71c06fcb0 0x7ff71c1526e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43538/0 (socket says 172.21.15.28:43538) 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.351+0000 7ff720983640 1 -- 172.21.15.28:0/909111691 learned_addr learned my addr 172.21.15.28:0/909111691 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.355+0000 7ff71bfff640 1 -- 172.21.15.28:0/909111691 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff71c0c76a0 msgr2=0x7ff71c06f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.355+0000 7ff71bfff640 1 --2- 172.21.15.28:0/909111691 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff71c0c76a0 0x7ff71c06f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.355+0000 7ff71bfff640 1 -- 172.21.15.28:0/909111691 >> v1:172.21.15.28:6789/0 conn(0x7ff71c06fcb0 legacy=0x7ff71c1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:32.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.355+0000 7ff71bfff640 1 -- 172.21.15.28:0/909111691 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c06e1b0 con 0x7ff71c0a7450 2023-12-16T03:25:32.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.355+0000 7ff71affd640 1 -- 172.21.15.28:0/909111691 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120764576 0 0) 0x7ff71c156820 con 0x7ff71c06fcb0 2023-12-16T03:25:32.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.355+0000 7ff71bfff640 1 --2- 172.21.15.28:0/909111691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff71c0a7450 0x7ff71c06dc70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0097c0 tx=0x7ff70c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81ab78883a744b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:32.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.355+0000 7ff71affd640 1 -- 172.21.15.28:0/909111691 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0ab600 con 0x7ff71c0a7450 2023-12-16T03:25:32.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.355+0000 7ff71affd640 1 -- 172.21.15.28:0/909111691 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c0a7050 con 0x7ff71c0a7450 2023-12-16T03:25:32.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.355+0000 7ff71affd640 1 -- 172.21.15.28:0/909111691 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0ab980 con 0x7ff71c0a7450 2023-12-16T03:25:32.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.355+0000 7ff7223e6640 1 -- 172.21.15.28:0/909111691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff71c0a7450 msgr2=0x7ff71c06dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:32.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.355+0000 7ff7223e6640 1 --2- 172.21.15.28:0/909111691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff71c0a7450 0x7ff71c06dc70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0097c0 tx=0x7ff70c01c3c0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 -- 172.21.15.28:0/909111691 shutdown_connections 2023-12-16T03:25:32.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 --2- 172.21.15.28:0/909111691 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff71c0c76a0 0x7ff71c06f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 --2- 172.21.15.28:0/909111691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff71c0a7450 0x7ff71c06dc70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 -- 172.21.15.28:0/909111691 >> 172.21.15.28:0/909111691 conn(0x7ff71c0c7e40 msgr2=0x7ff71c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:32.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 -- 172.21.15.28:0/909111691 shutdown_connections 2023-12-16T03:25:32.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 -- 172.21.15.28:0/909111691 wait complete. 2023-12-16T03:25:32.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 Processor -- start 2023-12-16T03:25:32.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 -- start start 2023-12-16T03:25:32.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff71c06fcb0 0x7ff71c0a6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff71c0a7450 0x7ff71c0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff71c0c76a0 0x7ff71c0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0c4090 con 0x7ff71c06fcb0 2023-12-16T03:25:32.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0acdc0 con 0x7ff71c0a7450 2023-12-16T03:25:32.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff7223e6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c14b540 con 0x7ff71c0c76a0 2023-12-16T03:25:32.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff71bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff71c06fcb0 0x7ff71c0a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:32.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff71bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff71c06fcb0 0x7ff71c0a6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55996/0 (socket says 172.21.15.28:55996) 2023-12-16T03:25:32.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff71bfff640 1 -- 172.21.15.28:0/3603726346 learned_addr learned my addr 172.21.15.28:0/3603726346 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:32.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff71bfff640 1 -- 172.21.15.28:0/3603726346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff71c0c76a0 msgr2=0x7ff71c0c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:32.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff71bfff640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff71c0c76a0 0x7ff71c0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff71bfff640 1 -- 172.21.15.28:0/3603726346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff71c0a7450 msgr2=0x7ff71c0c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:32.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff71bfff640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff71c0a7450 0x7ff71c0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff71bfff640 1 -- 172.21.15.28:0/3603726346 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c009420 con 0x7ff71c06fcb0 2023-12-16T03:25:32.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.359+0000 7ff71bfff640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff71c06fcb0 0x7ff71c0a6770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0ae040 tx=0x7ff70c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:32.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.363+0000 7ff718ff9640 1 -- 172.21.15.28:0/3603726346 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0b7650 con 0x7ff71c06fcb0 2023-12-16T03:25:32.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.363+0000 7ff718ff9640 1 -- 172.21.15.28:0/3603726346 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c0b77b0 con 0x7ff71c06fcb0 2023-12-16T03:25:32.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.363+0000 7ff7223e6640 1 -- 172.21.15.28:0/3603726346 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c0ac2e0 con 0x7ff71c06fcb0 2023-12-16T03:25:32.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.363+0000 7ff718ff9640 1 -- 172.21.15.28:0/3603726346 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0b7b60 con 0x7ff71c06fcb0 2023-12-16T03:25:32.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.363+0000 7ff7223e6640 1 -- 172.21.15.28:0/3603726346 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71c0ac8a0 con 0x7ff71c06fcb0 2023-12-16T03:25:32.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.363+0000 7ff7223e6640 1 -- 172.21.15.28:0/3603726346 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71c0ac110 con 0x7ff71c06fcb0 2023-12-16T03:25:32.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.363+0000 7ff718ff9640 1 -- 172.21.15.28:0/3603726346 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff70c0b7cc0 con 0x7ff71c06fcb0 2023-12-16T03:25:32.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.363+0000 7ff718ff9640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff708066470 0x7ff708068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:32.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.363+0000 7ff718ff9640 1 -- 172.21.15.28:0/3603726346 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff70c11e8e0 con 0x7ff71c06fcb0 2023-12-16T03:25:32.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.363+0000 7ff71b7fe640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff708066470 0x7ff708068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:32.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.367+0000 7ff71b7fe640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff708066470 0x7ff708068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0ade30 tx=0x7ff710006ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:32.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.367+0000 7ff718ff9640 1 -- 172.21.15.28:0/3603726346 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff70c0ebe70 con 0x7ff71c06fcb0 2023-12-16T03:25:32.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.563+0000 7ff7223e6640 1 -- 172.21.15.28:0/3603726346 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff71c068400 con 0x7ff71c06fcb0 2023-12-16T03:25:32.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.563+0000 7ff718ff9640 1 -- 172.21.15.28:0/3603726346 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff70c0b0070 con 0x7ff71c06fcb0 2023-12-16T03:25:32.567 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:25:32.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 -- 172.21.15.28:0/3603726346 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff708066470 msgr2=0x7ff708068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:32.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff708066470 0x7ff708068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0ade30 tx=0x7ff710006ca0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 -- 172.21.15.28:0/3603726346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff71c06fcb0 msgr2=0x7ff71c0a6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:32.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff71c06fcb0 0x7ff71c0a6770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0ae040 tx=0x7ff70c01ac00 comp rx=0 tx=0).stop 2023-12-16T03:25:32.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 -- 172.21.15.28:0/3603726346 shutdown_connections 2023-12-16T03:25:32.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff71c0c76a0 0x7ff71c0c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff71c0a7450 0x7ff71c0c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff708066470 0x7ff708068930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 --2- 172.21.15.28:0/3603726346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff71c06fcb0 0x7ff71c0a6770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:32.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 -- 172.21.15.28:0/3603726346 >> 172.21.15.28:0/3603726346 conn(0x7ff71c0c7e40 msgr2=0x7ff71c1526e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:32.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 -- 172.21.15.28:0/3603726346 shutdown_connections 2023-12-16T03:25:32.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:32.567+0000 7ff7223e6640 1 -- 172.21.15.28:0/3603726346 wait complete. 2023-12-16T03:25:32.589 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T03:25:32.589 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:25:32.589 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2023-12-16T03:25:32.589 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-16T03:25:32.589 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T03:25:32.589 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T03:25:32.589 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T03:25:32.589 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:25:32.590 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:25:32.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.590 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:25:32.600 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42373sec preferred_lft 42373sec 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:9f:0c:41:28 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:25:32.601 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:25:32.602 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T03:25:32.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.602 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec bash -c ' 2023-12-16T03:25:32.602 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2023-12-16T03:25:32.602 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add name ceph-brx type bridge 2023-12-16T03:25:32.602 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr flush dev ceph-brx 2023-12-16T03:25:32.602 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set ceph-brx up 2023-12-16T03:25:32.602 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T03:25:32.602 DEBUG:teuthology.orchestra.run.smithi028:> ') 2023-12-16T03:25:32.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.717 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:25:32.736 INFO:teuthology.orchestra.run.smithi028.stdout:1 2023-12-16T03:25:32.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.739 DEBUG:teuthology.orchestra.run.smithi028:> route 2023-12-16T03:25:32.807 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2023-12-16T03:25:32.807 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:25:32.807 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-16T03:25:32.807 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:25:32.807 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-16T03:25:32.807 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:25:32.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.808 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec bash -c ' 2023-12-16T03:25:32.808 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2023-12-16T03:25:32.808 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-16T03:25:32.808 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-16T03:25:32.808 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-16T03:25:32.808 DEBUG:teuthology.orchestra.run.smithi028:> ') 2023-12-16T03:25:32.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.901 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2023-12-16T03:25:32.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.911 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list-id 2023-12-16T03:25:32.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:32.966 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec bash -c ' 2023-12-16T03:25:32.966 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2023-12-16T03:25:32.966 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T03:25:32.966 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-16T03:25:32.966 DEBUG:teuthology.orchestra.run.smithi028:> ') 2023-12-16T03:25:33.048 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-16T03:25:33.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:33.049 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec bash -c ' 2023-12-16T03:25:33.049 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2023-12-16T03:25:33.049 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-16T03:25:33.049 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T03:25:33.049 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-16T03:25:33.049 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-16T03:25:33.049 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-16T03:25:33.049 DEBUG:teuthology.orchestra.run.smithi028:> ') 2023-12-16T03:25:33.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:33.216 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec bash -c ' 2023-12-16T03:25:33.216 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2023-12-16T03:25:33.216 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2023-12-16T03:25:33.216 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T03:25:33.216 DEBUG:teuthology.orchestra.run.smithi028:> ') 2023-12-16T03:25:33.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:25:33.258 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T03:25:33.313 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:25:33.313 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:25:33.313 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:25:33.364 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-16T03:25:33.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:33.365 DEBUG:teuthology.orchestra.run.smithi028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:25:33.471 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:25:33.472 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:25:33.603 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:25:33.603 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:25:33.603 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:25:33.603 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: trying mount with new device syntax: 0@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs=/ 2023-12-16T03:25:33.603 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:25:33.607 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:25:33.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:33.608 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:25:33.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:33.630 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:25:33.709 INFO:teuthology.orchestra.run.smithi028.stdout:client4532 2023-12-16T03:25:33.709 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:25:33.709 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:25:33.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:33.761 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:25:33.826 INFO:teuthology.orchestra.run.smithi028.stdout:client4532 2023-12-16T03:25:33.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:33.827 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:25:33.894 INFO:teuthology.orchestra.run.smithi028.stdout:client4532 2023-12-16T03:25:33.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:33.894 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/96b65b79-be1d-4832-b923-85c874d6fb27.client4532/status') 2023-12-16T03:25:33.965 INFO:teuthology.orchestra.run.smithi028.stdout:instance: client.4532 (3)172.21.15.28:0/3651094588 2023-12-16T03:25:33.965 INFO:teuthology.orchestra.run.smithi028.stdout:blocklisted: false 2023-12-16T03:25:33.966 INFO:teuthology.orchestra.run.smithi028.stderr:0+1 records in 2023-12-16T03:25:33.966 INFO:teuthology.orchestra.run.smithi028.stderr:0+1 records out 2023-12-16T03:25:33.966 INFO:teuthology.orchestra.run.smithi028.stderr:70 bytes copied, 5.3091e-05 s, 1.3 MB/s 2023-12-16T03:25:33.967 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-16T03:25:33.967 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-16T03:25:33.967 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:25:33.968 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:25:34.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.147+0000 7f32f9279640 1 Processor -- start 2023-12-16T03:25:34.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.147+0000 7f32f9279640 1 -- start start 2023-12-16T03:25:34.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.147+0000 7f32f9279640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32f40a5370 0x7f32f40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:34.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.147+0000 7f32f9279640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f40c4110 0x7f32f4150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:34.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.147+0000 7f32f9279640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f40c2760 con 0x7f32f4072090 2023-12-16T03:25:34.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.147+0000 7f32f9279640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f40c3070 con 0x7f32f40a5370 2023-12-16T03:25:34.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.147+0000 7f32f9279640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4151bf0 con 0x7f32f40c4110 2023-12-16T03:25:34.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32f2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32f40a5370 0x7f32f40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:34.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32ea7fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f40c4110 0x7f32f4150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:34.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32f2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f32f40a5370 0x7f32f40c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:55902/0 (socket says 172.21.15.28:55902) 2023-12-16T03:25:34.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32ea7fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f40c4110 0x7f32f4150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:36114/0 (socket says 172.21.15.28:36114) 2023-12-16T03:25:34.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32f2ffd640 1 -- 172.21.15.28:0/1153202116 learned_addr learned my addr 172.21.15.28:0/1153202116 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:34.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32f37fe640 1 --1- 172.21.15.28:0/1153202116 >> v1:172.21.15.134:6789/0 conn(0x7f32f4072090 0x7f32f41514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:54586/0 (socket says 172.21.15.28:54586) 2023-12-16T03:25:34.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32f2ffd640 1 -- 172.21.15.28:0/1153202116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f40c4110 msgr2=0x7f32f4150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:34.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32f2ffd640 1 --2- 172.21.15.28:0/1153202116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f40c4110 0x7f32f4150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:34.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32f2ffd640 1 -- 172.21.15.28:0/1153202116 >> v1:172.21.15.134:6789/0 conn(0x7f32f4072090 legacy=0x7f32f41514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:34.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32f2ffd640 1 -- 172.21.15.28:0/1153202116 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f40a5750 con 0x7f32f40a5370 2023-12-16T03:25:34.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32ea7fc640 1 --2- 172.21.15.28:0/1153202116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f40c4110 0x7f32f4150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:34.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.151+0000 7f32f2ffd640 1 --2- 172.21.15.28:0/1153202116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32f40a5370 0x7f32f40c3bd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f32e400bb20 tx=0x7f32e401e880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5892e26fc45625d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:34.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f27fc640 1 -- 172.21.15.28:0/1153202116 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e4004230 con 0x7f32f40a5370 2023-12-16T03:25:34.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f27fc640 1 -- 172.21.15.28:0/1153202116 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e40ab070 con 0x7f32f40a5370 2023-12-16T03:25:34.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f27fc640 1 -- 172.21.15.28:0/1153202116 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e40a76d0 con 0x7f32f40a5370 2023-12-16T03:25:34.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 -- 172.21.15.28:0/1153202116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32f40a5370 msgr2=0x7f32f40c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:34.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 --2- 172.21.15.28:0/1153202116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32f40a5370 0x7f32f40c3bd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f32e400bb20 tx=0x7f32e401e880 comp rx=0 tx=0).stop 2023-12-16T03:25:34.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 -- 172.21.15.28:0/1153202116 shutdown_connections 2023-12-16T03:25:34.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 --2- 172.21.15.28:0/1153202116 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f40c4110 0x7f32f4150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:34.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 --2- 172.21.15.28:0/1153202116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32f40a5370 0x7f32f40c3bd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:34.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 -- 172.21.15.28:0/1153202116 >> 172.21.15.28:0/1153202116 conn(0x7f32f406a5b0 msgr2=0x7f32f406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:34.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 -- 172.21.15.28:0/1153202116 shutdown_connections 2023-12-16T03:25:34.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 -- 172.21.15.28:0/1153202116 wait complete. 2023-12-16T03:25:34.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 Processor -- start 2023-12-16T03:25:34.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 -- start start 2023-12-16T03:25:34.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f4072090 0x7f32f4151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:34.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32f40a5370 0x7f32f41f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:34.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32f40c4110 0x7f32f414acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:34.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f41f1540 con 0x7f32f40a5370 2023-12-16T03:25:34.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4154d10 con 0x7f32f40c4110 2023-12-16T03:25:34.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.155+0000 7f32f9279640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4071690 con 0x7f32f4072090 2023-12-16T03:25:34.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ea7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32f40a5370 0x7f32f41f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:34.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ea7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32f40a5370 0x7f32f41f0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56010/0 (socket says 172.21.15.28:56010) 2023-12-16T03:25:34.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ea7fc640 1 -- 172.21.15.28:0/3421400642 learned_addr learned my addr 172.21.15.28:0/3421400642 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:34.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32f2ffd640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f4072090 0x7f32f4151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:34.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32f37fe640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32f40c4110 0x7f32f414acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:34.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ea7fc640 1 -- 172.21.15.28:0/3421400642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f4072090 msgr2=0x7f32f4151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:34.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ea7fc640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f4072090 0x7f32f4151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:34.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ea7fc640 1 -- 172.21.15.28:0/3421400642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32f40c4110 msgr2=0x7f32f414acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:34.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ea7fc640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32f40c4110 0x7f32f414acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:34.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ea7fc640 1 -- 172.21.15.28:0/3421400642 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc009420 con 0x7f32f40a5370 2023-12-16T03:25:34.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32f37fe640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32f40c4110 0x7f32f414acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:34.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ea7fc640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32f40a5370 0x7f32f41f0e40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00e980 tx=0x7f32dc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:34.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ebfff640 1 -- 172.21.15.28:0/3421400642 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00ca00 con 0x7f32f40a5370 2023-12-16T03:25:34.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ebfff640 1 -- 172.21.15.28:0/3421400642 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc00cb60 con 0x7f32f40a5370 2023-12-16T03:25:34.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32f9279640 1 -- 172.21.15.28:0/3421400642 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e400b780 con 0x7f32f40a5370 2023-12-16T03:25:34.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ebfff640 1 -- 172.21.15.28:0/3421400642 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc013470 con 0x7f32f40a5370 2023-12-16T03:25:34.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32f9279640 1 -- 172.21.15.28:0/3421400642 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f414b200 con 0x7f32f40a5370 2023-12-16T03:25:34.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32f9279640 1 -- 172.21.15.28:0/3421400642 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f4068400 con 0x7f32f40a5370 2023-12-16T03:25:34.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.159+0000 7f32ebfff640 1 -- 172.21.15.28:0/3421400642 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f32dc0135d0 con 0x7f32f40a5370 2023-12-16T03:25:34.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.163+0000 7f32ebfff640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f32d4066470 0x7f32d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:34.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.163+0000 7f32ebfff640 1 -- 172.21.15.28:0/3421400642 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32dc083fd0 con 0x7f32f40a5370 2023-12-16T03:25:34.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.163+0000 7f32f2ffd640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f32d4066470 0x7f32d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:34.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.163+0000 7f32f2ffd640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f32d4066470 0x7f32d4068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f32e40b1000 tx=0x7f32e40a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:34.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.167+0000 7f32ebfff640 1 -- 172.21.15.28:0/3421400642 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f32dc051500 con 0x7f32f40a5370 2023-12-16T03:25:34.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 -- 172.21.15.28:0/3421400642 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f32f40c6780 con 0x7f32f40a5370 2023-12-16T03:25:34.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32ebfff640 1 -- 172.21.15.28:0/3421400642 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f32dc054b20 con 0x7f32f40a5370 2023-12-16T03:25:34.362 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:25:34.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 -- 172.21.15.28:0/3421400642 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f32d4066470 msgr2=0x7f32d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:34.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f32d4066470 0x7f32d4068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f32e40b1000 tx=0x7f32e40a9070 comp rx=0 tx=0).stop 2023-12-16T03:25:34.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 -- 172.21.15.28:0/3421400642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32f40a5370 msgr2=0x7f32f41f0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:34.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32f40a5370 0x7f32f41f0e40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00e980 tx=0x7f32dc00ee40 comp rx=0 tx=0).stop 2023-12-16T03:25:34.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 -- 172.21.15.28:0/3421400642 shutdown_connections 2023-12-16T03:25:34.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32f40c4110 0x7f32f414acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:34.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f32d4066470 0x7f32d4068930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:34.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f32f40a5370 0x7f32f41f0e40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:34.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 --2- 172.21.15.28:0/3421400642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32f4072090 0x7f32f4151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:34.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 -- 172.21.15.28:0/3421400642 >> 172.21.15.28:0/3421400642 conn(0x7f32f406a5b0 msgr2=0x7f32f40bf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:34.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 -- 172.21.15.28:0/3421400642 shutdown_connections 2023-12-16T03:25:34.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:34.359+0000 7f32f9279640 1 -- 172.21.15.28:0/3421400642 wait complete. 2023-12-16T03:25:34.383 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-16T03:25:34.383 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:25:34.383 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-12-16T03:25:34.383 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-16T03:25:34.383 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:25:34.383 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-16T03:25:34.383 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-16T03:25:34.384 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:25:34.384 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:25:34.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:34.384 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-12-16T03:25:34.394 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:25:34.395 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:25:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:25:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-16T03:25:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42405sec preferred_lft 42405sec 2023-12-16T03:25:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-12-16T03:25:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:25:34.396 INFO:teuthology.orchestra.run.smithi134.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:25:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 02:42:8f:0f:48:af brd ff:ff:ff:ff:ff:ff 2023-12-16T03:25:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:25:34.396 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:25:34.397 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-16T03:25:34.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:34.397 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:25:34.397 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:25:34.397 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2023-12-16T03:25:34.397 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2023-12-16T03:25:34.397 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2023-12-16T03:25:34.397 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-16T03:25:34.398 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:25:34.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:34.523 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:25:34.542 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-12-16T03:25:34.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:34.545 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-12-16T03:25:34.619 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-12-16T03:25:34.619 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:25:34.619 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-16T03:25:34.619 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T03:25:34.619 INFO:teuthology.orchestra.run.smithi134.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:25:34.619 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T03:25:34.620 INFO:teuthology.orchestra.run.smithi134.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:25:34.620 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:25:34.620 INFO:teuthology.orchestra.run.smithi134.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:25:34.620 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:25:34.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:34.620 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:25:34.620 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:25:34.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T03:25:34.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T03:25:34.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T03:25:34.620 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:25:34.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:34.712 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-16T03:25:34.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:34.723 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2023-12-16T03:25:34.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:34.776 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:25:34.776 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:25:34.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T03:25:34.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-16T03:25:34.777 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:25:34.864 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-16T03:25:34.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:34.865 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:25:34.865 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:25:34.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-16T03:25:34.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-16T03:25:34.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-16T03:25:34.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-16T03:25:34.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-16T03:25:34.865 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:25:35.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:35.033 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:25:35.033 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:25:35.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-12-16T03:25:35.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2023-12-16T03:25:35.033 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:25:35.074 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:25:35.074 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T03:25:35.128 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:25:35.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:25:35.129 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:25:35.179 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-16T03:25:35.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:35.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:25:35.282 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:25:35.283 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:25:35.383 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:25:35.383 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:25:35.383 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:25:35.383 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: 1@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs=/ 2023-12-16T03:25:35.383 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:25:35.386 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:25:35.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:35.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:25:35.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:35.407 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:25:35.468 INFO:teuthology.orchestra.run.smithi134.stdout:client4689 2023-12-16T03:25:35.468 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:25:35.468 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:25:35.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:35.520 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:25:35.575 INFO:teuthology.orchestra.run.smithi134.stdout:client4689 2023-12-16T03:25:35.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:35.575 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:25:35.626 INFO:teuthology.orchestra.run.smithi134.stdout:client4689 2023-12-16T03:25:35.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:35.627 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/96b65b79-be1d-4832-b923-85c874d6fb27.client4689/status') 2023-12-16T03:25:35.687 INFO:teuthology.orchestra.run.smithi134.stdout:instance: client.4689 (3)172.21.15.134:0/2415429962 2023-12-16T03:25:35.687 INFO:teuthology.orchestra.run.smithi134.stdout:blocklisted: false 2023-12-16T03:25:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2023-12-16T03:25:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2023-12-16T03:25:35.688 INFO:teuthology.orchestra.run.smithi134.stderr:71 bytes copied, 5.4247e-05 s, 1.3 MB/s 2023-12-16T03:25:35.689 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-16T03:25:35.706 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:35.785 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:25:35.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:25:35.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6aff57640 1 Processor -- start 2023-12-16T03:25:35.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6aff57640 1 -- start start 2023-12-16T03:25:35.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6aff57640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff6a8151e90 0x7ff6a80c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:35.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6aff57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 0x7ff6a806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:35.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6aff57640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a806c860 con 0x7ff6a80c4e60 2023-12-16T03:25:35.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6aff57640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a80c8750 con 0x7ff6a8151e90 2023-12-16T03:25:35.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6aff57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a81552d0 con 0x7ff6a80c7ea0 2023-12-16T03:25:35.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6ae4f4640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff6a80c4e60 0x7ff6a806b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43546/0 (socket says 172.21.15.28:43546) 2023-12-16T03:25:35.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6ae4f4640 1 -- 172.21.15.28:0/3309326477 learned_addr learned my addr 172.21.15.28:0/3309326477 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:35.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6ad4f2640 1 --2- 172.21.15.28:0/3309326477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 0x7ff6a806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:35.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6adcf3640 1 --2- 172.21.15.28:0/3309326477 >> v2:172.21.15.134:3300/0 conn(0x7ff6a8151e90 0x7ff6a80c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:35.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6accf1640 1 -- 172.21.15.28:0/3309326477 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87453294 0 0) 0x7ff6a806c860 con 0x7ff6a80c4e60 2023-12-16T03:25:35.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6accf1640 1 -- 172.21.15.28:0/3309326477 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff694003530 con 0x7ff6a80c4e60 2023-12-16T03:25:35.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6ad4f2640 1 -- 172.21.15.28:0/3309326477 >> v2:172.21.15.134:3300/0 conn(0x7ff6a8151e90 msgr2=0x7ff6a80c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:35.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6ad4f2640 1 --2- 172.21.15.28:0/3309326477 >> v2:172.21.15.134:3300/0 conn(0x7ff6a8151e90 0x7ff6a80c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:35.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6ad4f2640 1 -- 172.21.15.28:0/3309326477 >> v1:172.21.15.28:6789/0 conn(0x7ff6a80c4e60 legacy=0x7ff6a806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:35.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6ad4f2640 1 -- 172.21.15.28:0/3309326477 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8154930 con 0x7ff6a80c7ea0 2023-12-16T03:25:35.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.859+0000 7ff6adcf3640 1 --2- 172.21.15.28:0/3309326477 >> v2:172.21.15.134:3300/0 conn(0x7ff6a8151e90 0x7ff6a80c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:35.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.863+0000 7ff6ad4f2640 1 --2- 172.21.15.28:0/3309326477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 0x7ff6a806b4a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097c0 tx=0x7ff69801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f5a8f12a765df5f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:35.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.863+0000 7ff6accf1640 1 -- 172.21.15.28:0/3309326477 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6980ab600 con 0x7ff6a80c7ea0 2023-12-16T03:25:35.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.863+0000 7ff6accf1640 1 -- 172.21.15.28:0/3309326477 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6980a7050 con 0x7ff6a80c7ea0 2023-12-16T03:25:35.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.863+0000 7ff6accf1640 1 -- 172.21.15.28:0/3309326477 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6980ab960 con 0x7ff6a80c7ea0 2023-12-16T03:25:35.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.863+0000 7ff6aff57640 1 -- 172.21.15.28:0/3309326477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 msgr2=0x7ff6a806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:35.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.863+0000 7ff6aff57640 1 --2- 172.21.15.28:0/3309326477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 0x7ff6a806b4a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097c0 tx=0x7ff69801c360 comp rx=0 tx=0).stop 2023-12-16T03:25:35.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 -- 172.21.15.28:0/3309326477 shutdown_connections 2023-12-16T03:25:35.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 --2- 172.21.15.28:0/3309326477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 0x7ff6a806b4a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:35.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 --2- 172.21.15.28:0/3309326477 >> v2:172.21.15.134:3300/0 conn(0x7ff6a8151e90 0x7ff6a80c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:35.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 -- 172.21.15.28:0/3309326477 >> 172.21.15.28:0/3309326477 conn(0x7ff6a80ca170 msgr2=0x7ff6a80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:35.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 -- 172.21.15.28:0/3309326477 shutdown_connections 2023-12-16T03:25:35.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 -- 172.21.15.28:0/3309326477 wait complete. 2023-12-16T03:25:35.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 Processor -- start 2023-12-16T03:25:35.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 -- start start 2023-12-16T03:25:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a80c4e60 0x7ff6a81ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 0x7ff6a81edf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6a8151e90 0x7ff6a80abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a81edaf0 con 0x7ff6a8151e90 2023-12-16T03:25:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80bdb00 con 0x7ff6a80c4e60 2023-12-16T03:25:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6aff57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80c3d40 con 0x7ff6a80c7ea0 2023-12-16T03:25:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6ae4f4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6a8151e90 0x7ff6a80abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6ad4f2640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 0x7ff6a81edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6ae4f4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6a8151e90 0x7ff6a80abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56014/0 (socket says 172.21.15.28:56014) 2023-12-16T03:25:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6ae4f4640 1 -- 172.21.15.28:0/614585327 learned_addr learned my addr 172.21.15.28:0/614585327 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:35.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6adcf3640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a80c4e60 0x7ff6a81ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6ae4f4640 1 -- 172.21.15.28:0/614585327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 msgr2=0x7ff6a81edf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6ae4f4640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 0x7ff6a81edf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6ae4f4640 1 -- 172.21.15.28:0/614585327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a80c4e60 msgr2=0x7ff6a81ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6ae4f4640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a80c4e60 0x7ff6a81ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6ae4f4640 1 -- 172.21.15.28:0/614585327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009420 con 0x7ff6a8151e90 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6ad4f2640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 0x7ff6a81edf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6adcf3640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a80c4e60 0x7ff6a81ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.867+0000 7ff6ae4f4640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6a8151e90 0x7ff6a80abbb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000caa0 tx=0x7ff6a000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.871+0000 7ff69e7fc640 1 -- 172.21.15.28:0/614585327 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000ab40 con 0x7ff6a8151e90 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.871+0000 7ff69e7fc640 1 -- 172.21.15.28:0/614585327 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a000aca0 con 0x7ff6a8151e90 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.871+0000 7ff6aff57640 1 -- 172.21.15.28:0/614585327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff698009420 con 0x7ff6a8151e90 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.871+0000 7ff69e7fc640 1 -- 172.21.15.28:0/614585327 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0012620 con 0x7ff6a8151e90 2023-12-16T03:25:35.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.871+0000 7ff6aff57640 1 -- 172.21.15.28:0/614585327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a80bed60 con 0x7ff6a8151e90 2023-12-16T03:25:35.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.871+0000 7ff6aff57640 1 -- 172.21.15.28:0/614585327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a8068400 con 0x7ff6a8151e90 2023-12-16T03:25:35.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.871+0000 7ff69e7fc640 1 -- 172.21.15.28:0/614585327 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff6a0007070 con 0x7ff6a8151e90 2023-12-16T03:25:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.871+0000 7ff69e7fc640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff68c066470 0x7ff68c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.871+0000 7ff69e7fc640 1 -- 172.21.15.28:0/614585327 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6a0083d80 con 0x7ff6a8151e90 2023-12-16T03:25:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.871+0000 7ff6adcf3640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff68c066470 0x7ff68c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:35.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.875+0000 7ff6adcf3640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff68c066470 0x7ff68c068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff6a81effd0 tx=0x7ff6a4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:35.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:35.875+0000 7ff69e7fc640 1 -- 172.21.15.28:0/614585327 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff6a00512a0 con 0x7ff6a8151e90 2023-12-16T03:25:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.035+0000 7ff6aff57640 1 -- 172.21.15.28:0/614585327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6a80c3e80 con 0x7ff6a8151e90 2023-12-16T03:25:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff69e7fc640 1 -- 172.21.15.28:0/614585327 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7ff6a0017090 con 0x7ff6a8151e90 2023-12-16T03:25:36.041 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:36.041 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 -- 172.21.15.28:0/614585327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff68c066470 msgr2=0x7ff68c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff68c066470 0x7ff68c068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff6a81effd0 tx=0x7ff6a4009190 comp rx=0 tx=0).stop 2023-12-16T03:25:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 -- 172.21.15.28:0/614585327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6a8151e90 msgr2=0x7ff6a80abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6a8151e90 0x7ff6a80abbb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000caa0 tx=0x7ff6a000cf60 comp rx=0 tx=0).stop 2023-12-16T03:25:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 -- 172.21.15.28:0/614585327 shutdown_connections 2023-12-16T03:25:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff68c066470 0x7ff68c068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6a8151e90 0x7ff6a80abbb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6a80c7ea0 0x7ff6a81edf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 --2- 172.21.15.28:0/614585327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a80c4e60 0x7ff6a81ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 -- 172.21.15.28:0/614585327 >> 172.21.15.28:0/614585327 conn(0x7ff6a80ca170 msgr2=0x7ff6a814af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 -- 172.21.15.28:0/614585327 shutdown_connections 2023-12-16T03:25:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.039+0000 7ff6aff57640 1 -- 172.21.15.28:0/614585327 wait complete. 2023-12-16T03:25:36.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:25:13.885447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:25:14.309086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:36.064 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:36.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a97f2a640 1 Processor -- start 2023-12-16T03:25:36.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a97f2a640 1 -- start start 2023-12-16T03:25:36.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a97f2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a900a5370 0x7f2a900c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a97f2a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2a900c4110 0x7f2a90150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a97f2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2a90072090 0x7f2a901514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a97f2a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a900c3070 con 0x7f2a900c4110 2023-12-16T03:25:36.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a97f2a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a900c2760 con 0x7f2a90072090 2023-12-16T03:25:36.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a97f2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900a5750 con 0x7f2a900a5370 2023-12-16T03:25:36.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a954c5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2a900c4110 0x7f2a90150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a954c5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2a900c4110 0x7f2a90150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56028/0 (socket says 172.21.15.28:56028) 2023-12-16T03:25:36.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a954c5640 1 -- 172.21.15.28:0/2112811856 learned_addr learned my addr 172.21.15.28:0/2112811856 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:36.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a964c7640 1 --2- 172.21.15.28:0/2112811856 >> v2:172.21.15.134:3300/0 conn(0x7f2a90072090 0x7f2a901514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a95cc6640 1 --2- 172.21.15.28:0/2112811856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a900a5370 0x7f2a900c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a954c5640 1 -- 172.21.15.28:0/2112811856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a900a5370 msgr2=0x7f2a900c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:36.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a954c5640 1 --2- 172.21.15.28:0/2112811856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a900a5370 0x7f2a900c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a954c5640 1 -- 172.21.15.28:0/2112811856 >> v2:172.21.15.134:3300/0 conn(0x7f2a90072090 msgr2=0x7f2a901514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:36.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a954c5640 1 --2- 172.21.15.28:0/2112811856 >> v2:172.21.15.134:3300/0 conn(0x7f2a90072090 0x7f2a901514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.247+0000 7f2a954c5640 1 -- 172.21.15.28:0/2112811856 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a900aad20 con 0x7f2a900c4110 2023-12-16T03:25:36.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a954c5640 1 --2- 172.21.15.28:0/2112811856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a900c4110 0x7f2a90150fa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2a900c4590 tx=0x7f2a8001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993d6f8b3bd9098e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:36.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a94cc4640 1 -- 172.21.15.28:0/2112811856 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a800a7a90 con 0x7f2a900c4110 2023-12-16T03:25:36.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a94cc4640 1 -- 172.21.15.28:0/2112811856 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a800a7bf0 con 0x7f2a900c4110 2023-12-16T03:25:36.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a94cc4640 1 -- 172.21.15.28:0/2112811856 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a800af440 con 0x7f2a900c4110 2023-12-16T03:25:36.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a97f2a640 1 -- 172.21.15.28:0/2112811856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a900c4110 msgr2=0x7f2a90150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a97f2a640 1 --2- 172.21.15.28:0/2112811856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a900c4110 0x7f2a90150fa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2a900c4590 tx=0x7f2a8001ea80 comp rx=0 tx=0).stop 2023-12-16T03:25:36.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a97f2a640 1 -- 172.21.15.28:0/2112811856 shutdown_connections 2023-12-16T03:25:36.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a97f2a640 1 --2- 172.21.15.28:0/2112811856 >> v2:172.21.15.134:3300/0 conn(0x7f2a90072090 0x7f2a901514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a97f2a640 1 --2- 172.21.15.28:0/2112811856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a900c4110 0x7f2a90150fa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a97f2a640 1 --2- 172.21.15.28:0/2112811856 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a900a5370 0x7f2a900c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a97f2a640 1 -- 172.21.15.28:0/2112811856 >> 172.21.15.28:0/2112811856 conn(0x7f2a9006a5b0 msgr2=0x7f2a9006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a97f2a640 1 -- 172.21.15.28:0/2112811856 shutdown_connections 2023-12-16T03:25:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.251+0000 7f2a97f2a640 1 -- 172.21.15.28:0/2112811856 wait complete. 2023-12-16T03:25:36.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a97f2a640 1 Processor -- start 2023-12-16T03:25:36.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a97f2a640 1 -- start start 2023-12-16T03:25:36.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a97f2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a90072090 0x7f2a900a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a97f2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a900a5370 0x7f2a9014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a97f2a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a900c4110 0x7f2a900bf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a97f2a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a901ed4a0 con 0x7f2a900c4110 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a97f2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900a6cb0 con 0x7f2a90072090 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a97f2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900a6080 con 0x7f2a900a5370 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a964c7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a900c4110 0x7f2a900bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a964c7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a900c4110 0x7f2a900bf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56044/0 (socket says 172.21.15.28:56044) 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a964c7640 1 -- 172.21.15.28:0/3557809634 learned_addr learned my addr 172.21.15.28:0/3557809634 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a95cc6640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a90072090 0x7f2a900a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a954c5640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a900a5370 0x7f2a9014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a964c7640 1 -- 172.21.15.28:0/3557809634 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a900a5370 msgr2=0x7f2a9014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a964c7640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a900a5370 0x7f2a9014b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a964c7640 1 -- 172.21.15.28:0/3557809634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a90072090 msgr2=0x7f2a900a6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a964c7640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a90072090 0x7f2a900a6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a964c7640 1 -- 172.21.15.28:0/3557809634 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8000b770 con 0x7f2a900c4110 2023-12-16T03:25:36.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a964c7640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a900c4110 0x7f2a900bf200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800ef00 tx=0x7f2a8800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:36.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a867fc640 1 -- 172.21.15.28:0/3557809634 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88010040 con 0x7f2a900c4110 2023-12-16T03:25:36.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a867fc640 1 -- 172.21.15.28:0/3557809634 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a88014400 con 0x7f2a900c4110 2023-12-16T03:25:36.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a867fc640 1 -- 172.21.15.28:0/3557809634 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88009ea0 con 0x7f2a900c4110 2023-12-16T03:25:36.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a97f2a640 1 -- 172.21.15.28:0/3557809634 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a90148100 con 0x7f2a900c4110 2023-12-16T03:25:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a97f2a640 1 -- 172.21.15.28:0/3557809634 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a900a5a30 con 0x7f2a900c4110 2023-12-16T03:25:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.255+0000 7f2a97f2a640 1 -- 172.21.15.28:0/3557809634 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a900a5890 con 0x7f2a900c4110 2023-12-16T03:25:36.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.259+0000 7f2a867fc640 1 -- 172.21.15.28:0/3557809634 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2a880147b0 con 0x7f2a900c4110 2023-12-16T03:25:36.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.259+0000 7f2a867fc640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a740664a0 0x7f2a74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.259+0000 7f2a867fc640 1 -- 172.21.15.28:0/3557809634 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a880843d0 con 0x7f2a900c4110 2023-12-16T03:25:36.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.259+0000 7f2a95cc6640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a740664a0 0x7f2a74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.259+0000 7f2a95cc6640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a740664a0 0x7f2a74068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009b60 tx=0x7f2a8c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:36.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.263+0000 7f2a867fc640 1 -- 172.21.15.28:0/3557809634 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2a900a5890 con 0x7f2a900c4110 2023-12-16T03:25:36.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.419+0000 7f2a97f2a640 1 -- 172.21.15.28:0/3557809634 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a900a5890 con 0x7f2a900c4110 2023-12-16T03:25:36.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.419+0000 7f2a867fc640 1 -- 172.21.15.28:0/3557809634 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a900a5890 con 0x7f2a900c4110 2023-12-16T03:25:36.424 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 -- 172.21.15.28:0/3557809634 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a740664a0 msgr2=0x7f2a74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a740664a0 0x7f2a74068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009b60 tx=0x7f2a8c009190 comp rx=0 tx=0).stop 2023-12-16T03:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 -- 172.21.15.28:0/3557809634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a900c4110 msgr2=0x7f2a900bf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a900c4110 0x7f2a900bf200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800ef00 tx=0x7f2a8800b480 comp rx=0 tx=0).stop 2023-12-16T03:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 -- 172.21.15.28:0/3557809634 shutdown_connections 2023-12-16T03:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a740664a0 0x7f2a74068960 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a900c4110 0x7f2a900bf200 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a900a5370 0x7f2a9014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 --2- 172.21.15.28:0/3557809634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a90072090 0x7f2a900a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 -- 172.21.15.28:0/3557809634 >> 172.21.15.28:0/3557809634 conn(0x7f2a9006a5b0 msgr2=0x7f2a900a8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:36.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 -- 172.21.15.28:0/3557809634 shutdown_connections 2023-12-16T03:25:36.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.423+0000 7f2a97f2a640 1 -- 172.21.15.28:0/3557809634 wait complete. 2023-12-16T03:25:36.445 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:25:36.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.587+0000 7f4006e32640 1 Processor -- start 2023-12-16T03:25:36.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.587+0000 7f4006e32640 1 -- start start 2023-12-16T03:25:36.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f4006e32640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4000155de0 0x7f4000156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f4006e32640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40000c2580 con 0x7f40000c5260 2023-12-16T03:25:36.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f4006e32640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40000c1a00 con 0x7f40000c5640 2023-12-16T03:25:36.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f4006e32640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4000153510 con 0x7f4000155de0 2023-12-16T03:25:36.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f4004bce640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f40000c5260 0x7f400006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43556/0 (socket says 172.21.15.28:43556) 2023-12-16T03:25:36.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f4004bce640 1 -- 172.21.15.28:0/3836126433 learned_addr learned my addr 172.21.15.28:0/3836126433 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:36.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f40053cf640 1 --2- 172.21.15.28:0/3836126433 >> v2:172.21.15.28:3300/0 conn(0x7f4000155de0 0x7f4000156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f40053cf640 1 -- 172.21.15.28:0/3836126433 >> v1:172.21.15.134:6789/0 conn(0x7f40000c5640 legacy=0x7f40000c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f40053cf640 1 -- 172.21.15.28:0/3836126433 >> v1:172.21.15.28:6789/0 conn(0x7f40000c5260 legacy=0x7f400006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f40053cf640 1 -- 172.21.15.28:0/3836126433 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000c1ce0 con 0x7f4000155de0 2023-12-16T03:25:36.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f3ff77fe640 1 -- 172.21.15.28:0/3836126433 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650658456 0 0) 0x7f40000c1a00 con 0x7f40000c5640 2023-12-16T03:25:36.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f40053cf640 1 --2- 172.21.15.28:0/3836126433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4000155de0 0x7f4000156230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009d90 tx=0x7f3ff801c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b29968f6211b3f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:36.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f3ff77fe640 1 -- 172.21.15.28:0/3836126433 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80a6690 con 0x7f4000155de0 2023-12-16T03:25:36.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f3ff77fe640 1 -- 172.21.15.28:0/3836126433 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff80a67f0 con 0x7f4000155de0 2023-12-16T03:25:36.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.591+0000 7f3ff77fe640 1 -- 172.21.15.28:0/3836126433 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80a6b80 con 0x7f4000155de0 2023-12-16T03:25:36.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 -- 172.21.15.28:0/3836126433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4000155de0 msgr2=0x7f4000156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 --2- 172.21.15.28:0/3836126433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4000155de0 0x7f4000156230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009d90 tx=0x7f3ff801c750 comp rx=0 tx=0).stop 2023-12-16T03:25:36.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 -- 172.21.15.28:0/3836126433 shutdown_connections 2023-12-16T03:25:36.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 --2- 172.21.15.28:0/3836126433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4000155de0 0x7f4000156230 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 -- 172.21.15.28:0/3836126433 >> 172.21.15.28:0/3836126433 conn(0x7f400006a5b0 msgr2=0x7f400006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:36.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 -- 172.21.15.28:0/3836126433 shutdown_connections 2023-12-16T03:25:36.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 -- 172.21.15.28:0/3836126433 wait complete. 2023-12-16T03:25:36.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 Processor -- start 2023-12-16T03:25:36.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 -- start start 2023-12-16T03:25:36.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40000c5260 0x7f400006fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40000c5640 0x7f4000071970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4000155de0 0x7f40000c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000a59e0 con 0x7f4000155de0 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000a5cc0 con 0x7f40000c5260 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4006e32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40000a5fa0 con 0x7f40000c5640 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f40053cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4000155de0 0x7f40000c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4004bce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40000c5260 0x7f400006fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f40053cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4000155de0 0x7f40000c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56066/0 (socket says 172.21.15.28:56066) 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f40053cf640 1 -- 172.21.15.28:0/2262951077 learned_addr learned my addr 172.21.15.28:0/2262951077 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f4004bce640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40000c5260 0x7f400006fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:55942/0 (socket says 172.21.15.28:55942) 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f3ff7fff640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40000c5640 0x7f4000071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f40053cf640 1 -- 172.21.15.28:0/2262951077 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40000c5640 msgr2=0x7f4000071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f40053cf640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40000c5640 0x7f4000071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.595+0000 7f40053cf640 1 -- 172.21.15.28:0/2262951077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40000c5260 msgr2=0x7f400006fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f40053cf640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40000c5260 0x7f400006fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f40053cf640 1 -- 172.21.15.28:0/2262951077 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8009a70 con 0x7f4000155de0 2023-12-16T03:25:36.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f40053cf640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4000155de0 0x7f40000c41f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8019360 tx=0x7f3ff80194f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:36.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f3ff57fa640 1 -- 172.21.15.28:0/2262951077 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80b6070 con 0x7f4000155de0 2023-12-16T03:25:36.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f3ff57fa640 1 -- 172.21.15.28:0/2262951077 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff80a7470 con 0x7f4000155de0 2023-12-16T03:25:36.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f3ff57fa640 1 -- 172.21.15.28:0/2262951077 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80a7800 con 0x7f4000155de0 2023-12-16T03:25:36.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f4006e32640 1 -- 172.21.15.28:0/2262951077 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40000a85c0 con 0x7f4000155de0 2023-12-16T03:25:36.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f4006e32640 1 -- 172.21.15.28:0/2262951077 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40000a8300 con 0x7f4000155de0 2023-12-16T03:25:36.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f4006e32640 1 -- 172.21.15.28:0/2262951077 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4000068400 con 0x7f4000155de0 2023-12-16T03:25:36.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f3ff57fa640 1 -- 172.21.15.28:0/2262951077 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3ff80c3430 con 0x7f4000155de0 2023-12-16T03:25:36.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f3ff57fa640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3fec066470 0x7f3fec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f3ff57fa640 1 -- 172.21.15.28:0/2262951077 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ff811e350 con 0x7f4000155de0 2023-12-16T03:25:36.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.599+0000 7f4004bce640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3fec066470 0x7f3fec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.603+0000 7f4004bce640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3fec066470 0x7f3fec068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc000f70 tx=0x7f3ffc007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:36.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.603+0000 7f3ff57fa640 1 -- 172.21.15.28:0/2262951077 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3ff80eb7e0 con 0x7f4000155de0 2023-12-16T03:25:36.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 -- 172.21.15.28:0/2262951077 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40000a5b20 con 0x7f4000155de0 2023-12-16T03:25:36.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f3ff57fa640 1 -- 172.21.15.28:0/2262951077 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40000a5b20 con 0x7f4000155de0 2023-12-16T03:25:36.766 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:25:36.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 -- 172.21.15.28:0/2262951077 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3fec066470 msgr2=0x7f3fec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3fec066470 0x7f3fec068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc000f70 tx=0x7f3ffc007e30 comp rx=0 tx=0).stop 2023-12-16T03:25:36.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 -- 172.21.15.28:0/2262951077 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4000155de0 msgr2=0x7f40000c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4000155de0 0x7f40000c41f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8019360 tx=0x7f3ff80194f0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 -- 172.21.15.28:0/2262951077 shutdown_connections 2023-12-16T03:25:36.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3fec066470 0x7f3fec068930 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4000155de0 0x7f40000c41f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f40000c5640 0x7f4000071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 --2- 172.21.15.28:0/2262951077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40000c5260 0x7f400006fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 -- 172.21.15.28:0/2262951077 >> 172.21.15.28:0/2262951077 conn(0x7f400006a5b0 msgr2=0x7f40000bf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:36.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 -- 172.21.15.28:0/2262951077 shutdown_connections 2023-12-16T03:25:36.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.763+0000 7f4006e32640 1 -- 172.21.15.28:0/2262951077 wait complete. 2023-12-16T03:25:36.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:25:36.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2478079640 1 Processor -- start 2023-12-16T03:25:36.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2478079640 1 -- start start 2023-12-16T03:25:36.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2478079640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f24701560e0 0x7f247015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2478079640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f247006d520 0x7f2470159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2478079640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f24700bffc0 0x7f24700c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2478079640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247015c600 con 0x7f24701560e0 2023-12-16T03:25:36.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2478079640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24701594e0 con 0x7f24700bffc0 2023-12-16T03:25:36.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2478079640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24701597c0 con 0x7f247006d520 2023-12-16T03:25:36.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2475e15640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f24701560e0 0x7f247015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2475e15640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f24701560e0 0x7f247015ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56070/0 (socket says 172.21.15.28:56070) 2023-12-16T03:25:36.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2475e15640 1 -- 172.21.15.28:0/2208763497 learned_addr learned my addr 172.21.15.28:0/2208763497 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:36.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2476616640 1 --2- 172.21.15.28:0/2208763497 >> v2:172.21.15.134:3300/0 conn(0x7f24700bffc0 0x7f24700c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2475614640 1 --2- 172.21.15.28:0/2208763497 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f247006d520 0x7f2470159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2475e15640 1 -- 172.21.15.28:0/2208763497 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f247006d520 msgr2=0x7f2470159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:36.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2475e15640 1 --2- 172.21.15.28:0/2208763497 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f247006d520 0x7f2470159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2475e15640 1 -- 172.21.15.28:0/2208763497 >> v2:172.21.15.134:3300/0 conn(0x7f24700bffc0 msgr2=0x7f24700c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:36.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2475e15640 1 --2- 172.21.15.28:0/2208763497 >> v2:172.21.15.134:3300/0 conn(0x7f24700bffc0 0x7f24700c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2475e15640 1 -- 172.21.15.28:0/2208763497 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247015bfb0 con 0x7f24701560e0 2023-12-16T03:25:36.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.931+0000 7f2475614640 1 --2- 172.21.15.28:0/2208763497 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f247006d520 0x7f2470159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:36.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2475e15640 1 --2- 172.21.15.28:0/2208763497 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24701560e0 0x7f247015ca90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f24700c66a0 tx=0x7f246c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701a3042ce45f79a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:36.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2474e13640 1 -- 172.21.15.28:0/2208763497 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c0ac600 con 0x7f24701560e0 2023-12-16T03:25:36.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2474e13640 1 -- 172.21.15.28:0/2208763497 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c0a8050 con 0x7f24701560e0 2023-12-16T03:25:36.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2474e13640 1 -- 172.21.15.28:0/2208763497 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c0ac980 con 0x7f24701560e0 2023-12-16T03:25:36.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2478079640 1 -- 172.21.15.28:0/2208763497 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24701560e0 msgr2=0x7f247015ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2478079640 1 --2- 172.21.15.28:0/2208763497 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24701560e0 0x7f247015ca90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f24700c66a0 tx=0x7f246c01c4d0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2478079640 1 -- 172.21.15.28:0/2208763497 shutdown_connections 2023-12-16T03:25:36.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2478079640 1 --2- 172.21.15.28:0/2208763497 >> v2:172.21.15.134:3300/0 conn(0x7f24700bffc0 0x7f24700c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2478079640 1 --2- 172.21.15.28:0/2208763497 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f247006d520 0x7f2470159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2478079640 1 --2- 172.21.15.28:0/2208763497 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24701560e0 0x7f247015ca90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2478079640 1 -- 172.21.15.28:0/2208763497 >> 172.21.15.28:0/2208763497 conn(0x7f247006a5b0 msgr2=0x7f247006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:36.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2478079640 1 -- 172.21.15.28:0/2208763497 shutdown_connections 2023-12-16T03:25:36.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.935+0000 7f2478079640 1 -- 172.21.15.28:0/2208763497 wait complete. 2023-12-16T03:25:36.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2478079640 1 Processor -- start 2023-12-16T03:25:36.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2478079640 1 -- start start 2023-12-16T03:25:36.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2478079640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f247006d520 0x7f2470157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2478079640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24700bffc0 0x7f24700a6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2478079640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24701560e0 0x7f24700a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2478079640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700a9350 con 0x7f24701560e0 2023-12-16T03:25:36.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2478079640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700a2d00 con 0x7f24700bffc0 2023-12-16T03:25:36.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2478079640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24700a63e0 con 0x7f247006d520 2023-12-16T03:25:36.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2476616640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24701560e0 0x7f24700a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2476616640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24701560e0 0x7f24700a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56078/0 (socket says 172.21.15.28:56078) 2023-12-16T03:25:36.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2476616640 1 -- 172.21.15.28:0/579136341 learned_addr learned my addr 172.21.15.28:0/579136341 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:36.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2475e15640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f247006d520 0x7f2470157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2475614640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24700bffc0 0x7f24700a6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2476616640 1 -- 172.21.15.28:0/579136341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f247006d520 msgr2=0x7f2470157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2476616640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f247006d520 0x7f2470157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2476616640 1 -- 172.21.15.28:0/579136341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24700bffc0 msgr2=0x7f24700a6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:36.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2476616640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24700bffc0 0x7f24700a6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:36.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2476616640 1 -- 172.21.15.28:0/579136341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0094d0 con 0x7f24701560e0 2023-12-16T03:25:36.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2476616640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24701560e0 0x7f24700a71e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f246800efc0 tx=0x7f246800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:36.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f24667fc640 1 -- 172.21.15.28:0/579136341 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468009ba0 con 0x7f24701560e0 2023-12-16T03:25:36.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f24667fc640 1 -- 172.21.15.28:0/579136341 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246800f040 con 0x7f24701560e0 2023-12-16T03:25:36.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f24667fc640 1 -- 172.21.15.28:0/579136341 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24680146c0 con 0x7f24701560e0 2023-12-16T03:25:36.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2478079640 1 -- 172.21.15.28:0/579136341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24700a66c0 con 0x7f24701560e0 2023-12-16T03:25:36.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2478079640 1 -- 172.21.15.28:0/579136341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24700a9840 con 0x7f24701560e0 2023-12-16T03:25:36.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.939+0000 7f2478079640 1 -- 172.21.15.28:0/579136341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24700a9a60 con 0x7f24701560e0 2023-12-16T03:25:36.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.943+0000 7f24667fc640 1 -- 172.21.15.28:0/579136341 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2468014820 con 0x7f24701560e0 2023-12-16T03:25:36.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.943+0000 7f24667fc640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f24540664c0 0x7f2454068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:36.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.943+0000 7f24667fc640 1 -- 172.21.15.28:0/579136341 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2468084b40 con 0x7f24701560e0 2023-12-16T03:25:36.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.943+0000 7f2475e15640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f24540664c0 0x7f2454068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:36.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.943+0000 7f2475e15640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f24540664c0 0x7f2454068980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f246c0ae000 tx=0x7f246c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:36.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:36.947+0000 7f24667fc640 1 -- 172.21.15.28:0/579136341 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2468052050 con 0x7f24701560e0 2023-12-16T03:25:37.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.103+0000 7f2478079640 1 -- 172.21.15.28:0/579136341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f24700a68b0 con 0x7f24701560e0 2023-12-16T03:25:37.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.103+0000 7f24667fc640 1 -- 172.21.15.28:0/579136341 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f24680180a0 con 0x7f24701560e0 2023-12-16T03:25:37.107 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:25:37.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 -- 172.21.15.28:0/579136341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f24540664c0 msgr2=0x7f2454068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f24540664c0 0x7f2454068980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f246c0ae000 tx=0x7f246c0a7000 comp rx=0 tx=0).stop 2023-12-16T03:25:37.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 -- 172.21.15.28:0/579136341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24701560e0 msgr2=0x7f24700a71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24701560e0 0x7f24700a71e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f246800efc0 tx=0x7f246800c490 comp rx=0 tx=0).stop 2023-12-16T03:25:37.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 -- 172.21.15.28:0/579136341 shutdown_connections 2023-12-16T03:25:37.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f24540664c0 0x7f2454068980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24701560e0 0x7f24700a71e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24700bffc0 0x7f24700a6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 --2- 172.21.15.28:0/579136341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f247006d520 0x7f2470157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 -- 172.21.15.28:0/579136341 >> 172.21.15.28:0/579136341 conn(0x7f247006a5b0 msgr2=0x7f247006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:37.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 -- 172.21.15.28:0/579136341 shutdown_connections 2023-12-16T03:25:37.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.107+0000 7f2478079640 1 -- 172.21.15.28:0/579136341 wait complete. 2023-12-16T03:25:37.128 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:37.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.267+0000 7fe6dd8c9640 1 Processor -- start 2023-12-16T03:25:37.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.267+0000 7fe6dd8c9640 1 -- start start 2023-12-16T03:25:37.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6dd8c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 0x7fe6d8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6dd8c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe6d80725c0 0x7fe6d81514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6dd8c9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d80c2760 con 0x7fe6d80a5370 2023-12-16T03:25:37.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6dd8c9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d80c3070 con 0x7fe6d80725c0 2023-12-16T03:25:37.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6dd8c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80a5750 con 0x7fe6d8072090 2023-12-16T03:25:37.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6d77fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe6d80725c0 0x7fe6d81514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6cffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 0x7fe6d8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6cffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 0x7fe6d8150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:36196/0 (socket says 172.21.15.28:36196) 2023-12-16T03:25:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6cffff640 1 -- 172.21.15.28:0/3367459864 learned_addr learned my addr 172.21.15.28:0/3367459864 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6d77fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe6d80725c0 0x7fe6d81514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:55976/0 (socket says 172.21.15.28:55976) 2023-12-16T03:25:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6cffff640 1 -- 172.21.15.28:0/3367459864 >> v2:172.21.15.134:3300/0 conn(0x7fe6d80725c0 msgr2=0x7fe6d81514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6cffff640 1 --2- 172.21.15.28:0/3367459864 >> v2:172.21.15.134:3300/0 conn(0x7fe6d80725c0 0x7fe6d81514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6cffff640 1 -- 172.21.15.28:0/3367459864 >> v1:172.21.15.134:6789/0 conn(0x7fe6d80a5370 legacy=0x7fe6d80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.271+0000 7fe6cffff640 1 -- 172.21.15.28:0/3367459864 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d80aad20 con 0x7fe6d8072090 2023-12-16T03:25:37.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6cffff640 1 --2- 172.21.15.28:0/3367459864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 0x7fe6d8150fa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009870 tx=0x7fe6c001e600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5101788bab1d9483 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:37.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6d67fc640 1 -- 172.21.15.28:0/3367459864 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00ab650 con 0x7fe6d8072090 2023-12-16T03:25:37.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6d67fc640 1 -- 172.21.15.28:0/3367459864 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c00ab7b0 con 0x7fe6d8072090 2023-12-16T03:25:37.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6d67fc640 1 -- 172.21.15.28:0/3367459864 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00abb40 con 0x7fe6d8072090 2023-12-16T03:25:37.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/3367459864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 msgr2=0x7fe6d8150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6dd8c9640 1 --2- 172.21.15.28:0/3367459864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 0x7fe6d8150fa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009870 tx=0x7fe6c001e600 comp rx=0 tx=0).stop 2023-12-16T03:25:37.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/3367459864 shutdown_connections 2023-12-16T03:25:37.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6dd8c9640 1 --2- 172.21.15.28:0/3367459864 >> v2:172.21.15.134:3300/0 conn(0x7fe6d80725c0 0x7fe6d81514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6dd8c9640 1 --2- 172.21.15.28:0/3367459864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 0x7fe6d8150fa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/3367459864 >> 172.21.15.28:0/3367459864 conn(0x7fe6d806a5b0 msgr2=0x7fe6d806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:37.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/3367459864 shutdown_connections 2023-12-16T03:25:37.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/3367459864 wait complete. 2023-12-16T03:25:37.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6dd8c9640 1 Processor -- start 2023-12-16T03:25:37.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.275+0000 7fe6dd8c9640 1 -- start start 2023-12-16T03:25:37.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6dd8c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 0x7fe6d814c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6dd8c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6d80725c0 0x7fe6d81ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6dd8c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6d80a5370 0x7fe6d80bf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6dd8c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d81eca00 con 0x7fe6d80725c0 2023-12-16T03:25:37.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6dd8c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d81ecf60 con 0x7fe6d80a5370 2023-12-16T03:25:37.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6dd8c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d806ad20 con 0x7fe6d8072090 2023-12-16T03:25:37.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6cffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6d80725c0 0x7fe6d81ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6cffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6d80725c0 0x7fe6d81ed3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56094/0 (socket says 172.21.15.28:56094) 2023-12-16T03:25:37.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6cffff640 1 -- 172.21.15.28:0/2158977257 learned_addr learned my addr 172.21.15.28:0/2158977257 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:37.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6d6ffd640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 0x7fe6d814c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6d77fe640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6d80a5370 0x7fe6d80bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6cffff640 1 -- 172.21.15.28:0/2158977257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 msgr2=0x7fe6d814c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6cffff640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 0x7fe6d814c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6cffff640 1 -- 172.21.15.28:0/2158977257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6d80a5370 msgr2=0x7fe6d80bf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6cffff640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6d80a5370 0x7fe6d80bf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6cffff640 1 -- 172.21.15.28:0/2158977257 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c00094d0 con 0x7fe6d80725c0 2023-12-16T03:25:37.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6d77fe640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6d80a5370 0x7fe6d80bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:37.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6cffff640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6d80725c0 0x7fe6d81ed3f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ad040 tx=0x7fe6c001ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:37.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6d4ff9640 1 -- 172.21.15.28:0/2158977257 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00ab650 con 0x7fe6d80725c0 2023-12-16T03:25:37.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6d4ff9640 1 -- 172.21.15.28:0/2158977257 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c00b3820 con 0x7fe6d80725c0 2023-12-16T03:25:37.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/2158977257 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d814fc60 con 0x7fe6d80725c0 2023-12-16T03:25:37.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6d4ff9640 1 -- 172.21.15.28:0/2158977257 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00b3bd0 con 0x7fe6d80725c0 2023-12-16T03:25:37.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/2158977257 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d8150220 con 0x7fe6d80725c0 2023-12-16T03:25:37.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.279+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/2158977257 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d81ed0d0 con 0x7fe6d80725c0 2023-12-16T03:25:37.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.283+0000 7fe6d4ff9640 1 -- 172.21.15.28:0/2158977257 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe6c00b3d30 con 0x7fe6d80725c0 2023-12-16T03:25:37.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.283+0000 7fe6d4ff9640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6b8066470 0x7fe6b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.283+0000 7fe6d4ff9640 1 -- 172.21.15.28:0/2158977257 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6c011e9f0 con 0x7fe6d80725c0 2023-12-16T03:25:37.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.283+0000 7fe6d6ffd640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6b8066470 0x7fe6b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.283+0000 7fe6d6ffd640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6b8066470 0x7fe6b8068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe6d815a7a0 tx=0x7fe6c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:37.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.287+0000 7fe6d4ff9640 1 -- 172.21.15.28:0/2158977257 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe6c00ebf20 con 0x7fe6d80725c0 2023-12-16T03:25:37.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/2158977257 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6d8150410 con 0x7fe6d80725c0 2023-12-16T03:25:37.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6d4ff9640 1 -- 172.21.15.28:0/2158977257 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fe6c00ef540 con 0x7fe6d80725c0 2023-12-16T03:25:37.450 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:37.450 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:37.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/2158977257 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6b8066470 msgr2=0x7fe6b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6b8066470 0x7fe6b8068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe6d815a7a0 tx=0x7fe6c8009040 comp rx=0 tx=0).stop 2023-12-16T03:25:37.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/2158977257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6d80725c0 msgr2=0x7fe6d81ed3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6d80725c0 0x7fe6d81ed3f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ad040 tx=0x7fe6c001ce40 comp rx=0 tx=0).stop 2023-12-16T03:25:37.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/2158977257 shutdown_connections 2023-12-16T03:25:37.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6d80a5370 0x7fe6d80bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6b8066470 0x7fe6b8068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6d80725c0 0x7fe6d81ed3f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 --2- 172.21.15.28:0/2158977257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6d8072090 0x7fe6d814c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/2158977257 >> 172.21.15.28:0/2158977257 conn(0x7fe6d806a5b0 msgr2=0x7fe6d80c05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:37.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/2158977257 shutdown_connections 2023-12-16T03:25:37.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.447+0000 7fe6dd8c9640 1 -- 172.21.15.28:0/2158977257 wait complete. 2023-12-16T03:25:37.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:25:13.885447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:25:14.309086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:37.472 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:37.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.615+0000 7f7f9466b640 1 Processor -- start 2023-12-16T03:25:37.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.615+0000 7f7f9466b640 1 -- start start 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f9466b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f8c0c4100 0x7f7f8c0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f9466b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7f8c0c06d0 0x7f7f8c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f9466b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8c0c31c0 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f9466b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8c0c34a0 con 0x7f7f8c0c06d0 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f9466b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0c1030 con 0x7f7f8c0c4100 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f92407640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7f8c0c63c0 0x7f7f8c0c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43558/0 (socket says 172.21.15.28:43558) 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f92c08640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7f8c0c06d0 0x7f7f8c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f92407640 1 -- 172.21.15.28:0/2653970752 learned_addr learned my addr 172.21.15.28:0/2653970752 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f91c06640 1 --2- 172.21.15.28:0/2653970752 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f8c0c4100 0x7f7f8c0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f92c08640 1 -- 172.21.15.28:0/2653970752 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f8c0c4100 msgr2=0x7f7f8c0c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f92c08640 1 --2- 172.21.15.28:0/2653970752 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f8c0c4100 0x7f7f8c0c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f92c08640 1 -- 172.21.15.28:0/2653970752 >> v1:172.21.15.28:6789/0 conn(0x7f7f8c0c63c0 legacy=0x7f7f8c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f92c08640 1 -- 172.21.15.28:0/2653970752 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c0c1310 con 0x7f7f8c0c06d0 2023-12-16T03:25:37.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.619+0000 7f7f91405640 1 -- 172.21.15.28:0/2653970752 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535211747 0 0) 0x7f7f8c0c31c0 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f92c08640 1 --2- 172.21.15.28:0/2653970752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f8c0c06d0 0x7f7f8c0a9680 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009d90 tx=0x7f7f8401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf619432e13f918 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:37.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f91405640 1 -- 172.21.15.28:0/2653970752 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0aa3d0 con 0x7f7f8c0c06d0 2023-12-16T03:25:37.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f91405640 1 -- 172.21.15.28:0/2653970752 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f840a5800 con 0x7f7f8c0c06d0 2023-12-16T03:25:37.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f91405640 1 -- 172.21.15.28:0/2653970752 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840a5b90 con 0x7f7f8c0c06d0 2023-12-16T03:25:37.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f9466b640 1 -- 172.21.15.28:0/2653970752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f8c0c06d0 msgr2=0x7f7f8c0a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f9466b640 1 --2- 172.21.15.28:0/2653970752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f8c0c06d0 0x7f7f8c0a9680 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009d90 tx=0x7f7f8401c830 comp rx=0 tx=0).stop 2023-12-16T03:25:37.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f9466b640 1 -- 172.21.15.28:0/2653970752 shutdown_connections 2023-12-16T03:25:37.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f9466b640 1 --2- 172.21.15.28:0/2653970752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f8c0c06d0 0x7f7f8c0a9680 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f9466b640 1 --2- 172.21.15.28:0/2653970752 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f8c0c4100 0x7f7f8c0c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f9466b640 1 -- 172.21.15.28:0/2653970752 >> 172.21.15.28:0/2653970752 conn(0x7f7f8c06a5b0 msgr2=0x7f7f8c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:37.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f9466b640 1 -- 172.21.15.28:0/2653970752 shutdown_connections 2023-12-16T03:25:37.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f9466b640 1 -- 172.21.15.28:0/2653970752 wait complete. 2023-12-16T03:25:37.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f9466b640 1 Processor -- start 2023-12-16T03:25:37.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.623+0000 7f7f9466b640 1 -- start start 2023-12-16T03:25:37.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f9466b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8c0c06d0 0x7f7f8c1ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f9466b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f8c0c4100 0x7f7f8c14caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f9466b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f8c0c63c0 0x7f7f8c1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f9466b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0bd520 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f9466b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0a7850 con 0x7f7f8c0c06d0 2023-12-16T03:25:37.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f9466b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c15afb0 con 0x7f7f8c0c4100 2023-12-16T03:25:37.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f92c08640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f8c0c63c0 0x7f7f8c1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f92c08640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f8c0c63c0 0x7f7f8c1541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56112/0 (socket says 172.21.15.28:56112) 2023-12-16T03:25:37.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f92c08640 1 -- 172.21.15.28:0/3446929017 learned_addr learned my addr 172.21.15.28:0/3446929017 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:37.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f91c06640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f8c0c4100 0x7f7f8c14caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f92c08640 1 -- 172.21.15.28:0/3446929017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f8c0c4100 msgr2=0x7f7f8c14caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f92407640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8c0c06d0 0x7f7f8c1ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f92c08640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f8c0c4100 0x7f7f8c14caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f92c08640 1 -- 172.21.15.28:0/3446929017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8c0c06d0 msgr2=0x7f7f8c1ed7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f92c08640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8c0c06d0 0x7f7f8c1ed7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f92c08640 1 -- 172.21.15.28:0/3446929017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f84009a70 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f91c06640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f8c0c4100 0x7f7f8c14caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f92407640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8c0c06d0 0x7f7f8c1ed7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f92c08640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f8c0c63c0 0x7f7f8c1541d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7f8401aee0 tx=0x7f7f840195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f82ffd640 1 -- 172.21.15.28:0/3446929017 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840b9660 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f82ffd640 1 -- 172.21.15.28:0/3446929017 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f840b97c0 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f9466b640 1 -- 172.21.15.28:0/3446929017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8c1edd30 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f82ffd640 1 -- 172.21.15.28:0/3446929017 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840b9b30 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f9466b640 1 -- 172.21.15.28:0/3446929017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8c0bc8e0 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f9466b640 1 -- 172.21.15.28:0/3446929017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8c066ba0 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.627+0000 7f7f82ffd640 1 -- 172.21.15.28:0/3446929017 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7f840b9c90 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.631+0000 7f7f82ffd640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f700664a0 0x7f7f70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.631+0000 7f7f82ffd640 1 -- 172.21.15.28:0/3446929017 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f8411f390 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.631+0000 7f7f92407640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f700664a0 0x7f7f70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.631+0000 7f7f92407640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f700664a0 0x7f7f70068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f88007fd0 tx=0x7f7f88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:37.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.635+0000 7f7f82ffd640 1 -- 172.21.15.28:0/3446929017 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7f8c066ba0 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.791+0000 7f7f9466b640 1 -- 172.21.15.28:0/3446929017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f8c066ba0 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f82ffd640 1 -- 172.21.15.28:0/3446929017 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f8c066ba0 con 0x7f7f8c0c63c0 2023-12-16T03:25:37.797 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:37.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 -- 172.21.15.28:0/3446929017 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f700664a0 msgr2=0x7f7f70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f700664a0 0x7f7f70068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f88007fd0 tx=0x7f7f88009040 comp rx=0 tx=0).stop 2023-12-16T03:25:37.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 -- 172.21.15.28:0/3446929017 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f8c0c63c0 msgr2=0x7f7f8c1541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f8c0c63c0 0x7f7f8c1541d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7f8401aee0 tx=0x7f7f840195d0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 -- 172.21.15.28:0/3446929017 shutdown_connections 2023-12-16T03:25:37.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f700664a0 0x7f7f70068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f8c0c63c0 0x7f7f8c1541d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f8c0c4100 0x7f7f8c14caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 --2- 172.21.15.28:0/3446929017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8c0c06d0 0x7f7f8c1ed7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 -- 172.21.15.28:0/3446929017 >> 172.21.15.28:0/3446929017 conn(0x7f7f8c06a5b0 msgr2=0x7f7f8c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:37.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 -- 172.21.15.28:0/3446929017 shutdown_connections 2023-12-16T03:25:37.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.795+0000 7f7f9466b640 1 -- 172.21.15.28:0/3446929017 wait complete. 2023-12-16T03:25:37.818 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:25:37.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.959+0000 7f8dd711d640 1 Processor -- start 2023-12-16T03:25:37.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dd711d640 1 -- start start 2023-12-16T03:25:37.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dd711d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8dd00c61e0 0x7f8dd00a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dd711d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd00c28e0 con 0x7f8dd01555c0 2023-12-16T03:25:37.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dd711d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd00c2b80 con 0x7f8dd00c1270 2023-12-16T03:25:37.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dd711d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd00c3680 con 0x7f8dd00c61e0 2023-12-16T03:25:37.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dcffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8dd00c61e0 0x7f8dd00a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dd4eb9640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8dd01555c0 0x7f8dd00c6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43572/0 (socket says 172.21.15.28:43572) 2023-12-16T03:25:37.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dd4eb9640 1 -- 172.21.15.28:0/883081480 learned_addr learned my addr 172.21.15.28:0/883081480 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:37.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dcffff640 1 -- 172.21.15.28:0/883081480 >> v1:172.21.15.134:6789/0 conn(0x7f8dd00c1270 legacy=0x7f8dd00c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dcffff640 1 -- 172.21.15.28:0/883081480 >> v1:172.21.15.28:6789/0 conn(0x7f8dd01555c0 legacy=0x7f8dd00c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dcf7fe640 1 -- 172.21.15.28:0/883081480 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464341551 0 0) 0x7f8dd00c28e0 con 0x7f8dd01555c0 2023-12-16T03:25:37.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.963+0000 7f8dcffff640 1 -- 172.21.15.28:0/883081480 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd00c32a0 con 0x7f8dd00c61e0 2023-12-16T03:25:37.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dcffff640 1 --2- 172.21.15.28:0/883081480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8dd00c61e0 0x7f8dd00a6df0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0097c0 tx=0x7f8dbc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4feb2eaa731432 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:37.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dcf7fe640 1 -- 172.21.15.28:0/883081480 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc0ab600 con 0x7f8dd00c61e0 2023-12-16T03:25:37.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dcf7fe640 1 -- 172.21.15.28:0/883081480 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc0a7050 con 0x7f8dd00c61e0 2023-12-16T03:25:37.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dcf7fe640 1 -- 172.21.15.28:0/883081480 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc0ab980 con 0x7f8dd00c61e0 2023-12-16T03:25:37.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dd711d640 1 -- 172.21.15.28:0/883081480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8dd00c61e0 msgr2=0x7f8dd00a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dd711d640 1 --2- 172.21.15.28:0/883081480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8dd00c61e0 0x7f8dd00a6df0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0097c0 tx=0x7f8dbc01c480 comp rx=0 tx=0).stop 2023-12-16T03:25:37.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dd711d640 1 -- 172.21.15.28:0/883081480 shutdown_connections 2023-12-16T03:25:37.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dd711d640 1 --2- 172.21.15.28:0/883081480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8dd00c61e0 0x7f8dd00a6df0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dd711d640 1 -- 172.21.15.28:0/883081480 >> 172.21.15.28:0/883081480 conn(0x7f8dd00c7e40 msgr2=0x7f8dd00c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:37.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dd711d640 1 -- 172.21.15.28:0/883081480 shutdown_connections 2023-12-16T03:25:37.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dd711d640 1 -- 172.21.15.28:0/883081480 wait complete. 2023-12-16T03:25:37.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dd711d640 1 Processor -- start 2023-12-16T03:25:37.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.967+0000 7f8dd711d640 1 -- start start 2023-12-16T03:25:37.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd711d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00c1270 0x7f8dd0158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd711d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8dd00c61e0 0x7f8dd0155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd711d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8dd01555c0 0x7f8dd01560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd711d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd01ed7c0 con 0x7f8dd01555c0 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd711d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd0153810 con 0x7f8dd00c1270 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd711d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd01ecbd0 con 0x7f8dd00c61e0 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd56ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8dd01555c0 0x7f8dd01560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd56ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8dd01555c0 0x7f8dd01560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56130/0 (socket says 172.21.15.28:56130) 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd56ba640 1 -- 172.21.15.28:0/1357020816 learned_addr learned my addr 172.21.15.28:0/1357020816 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd4eb9640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00c1270 0x7f8dd0158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dcffff640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8dd00c61e0 0x7f8dd0155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd56ba640 1 -- 172.21.15.28:0/1357020816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8dd00c61e0 msgr2=0x7f8dd0155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd56ba640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8dd00c61e0 0x7f8dd0155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd56ba640 1 -- 172.21.15.28:0/1357020816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00c1270 msgr2=0x7f8dd0158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd56ba640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00c1270 0x7f8dd0158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:37.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd56ba640 1 -- 172.21.15.28:0/1357020816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc009420 con 0x7f8dd01555c0 2023-12-16T03:25:37.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd56ba640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8dd01555c0 0x7f8dd01560f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800c770 tx=0x7f8dc800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:37.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dcd7fa640 1 -- 172.21.15.28:0/1357020816 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8003b80 con 0x7f8dd01555c0 2023-12-16T03:25:37.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dcd7fa640 1 -- 172.21.15.28:0/1357020816 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8003ce0 con 0x7f8dd01555c0 2023-12-16T03:25:37.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd711d640 1 -- 172.21.15.28:0/1357020816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd01ece90 con 0x7f8dd01555c0 2023-12-16T03:25:37.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dcd7fa640 1 -- 172.21.15.28:0/1357020816 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800aa90 con 0x7f8dd01555c0 2023-12-16T03:25:37.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd711d640 1 -- 172.21.15.28:0/1357020816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd01ed450 con 0x7f8dd01555c0 2023-12-16T03:25:37.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.971+0000 7f8dd711d640 1 -- 172.21.15.28:0/1357020816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd00c2580 con 0x7f8dd01555c0 2023-12-16T03:25:37.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.975+0000 7f8dcd7fa640 1 -- 172.21.15.28:0/1357020816 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8dc800abf0 con 0x7f8dd01555c0 2023-12-16T03:25:37.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.975+0000 7f8dcd7fa640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8db4066470 0x7f8db4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:37.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.975+0000 7f8dcd7fa640 1 -- 172.21.15.28:0/1357020816 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8dc8083ae0 con 0x7f8dd01555c0 2023-12-16T03:25:37.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.975+0000 7f8dd4eb9640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8db4066470 0x7f8db4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:37.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.975+0000 7f8dd4eb9640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8db4066470 0x7f8db4068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4007bc0 tx=0x7f8dc4007b10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:37.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:37.979+0000 7f8dcd7fa640 1 -- 172.21.15.28:0/1357020816 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8dc80510a0 con 0x7f8dd01555c0 2023-12-16T03:25:38.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.135+0000 7f8dd711d640 1 -- 172.21.15.28:0/1357020816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8dd00c51a0 con 0x7f8dd01555c0 2023-12-16T03:25:38.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.135+0000 7f8dcd7fa640 1 -- 172.21.15.28:0/1357020816 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8dc80546c0 con 0x7f8dd01555c0 2023-12-16T03:25:38.140 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 -- 172.21.15.28:0/1357020816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8db4066470 msgr2=0x7f8db4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8db4066470 0x7f8db4068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4007bc0 tx=0x7f8dc4007b10 comp rx=0 tx=0).stop 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 -- 172.21.15.28:0/1357020816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8dd01555c0 msgr2=0x7f8dd01560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8dd01555c0 0x7f8dd01560f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800c770 tx=0x7f8dc800cc30 comp rx=0 tx=0).stop 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 -- 172.21.15.28:0/1357020816 shutdown_connections 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8db4066470 0x7f8db4068930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8dd01555c0 0x7f8dd01560f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8dd00c61e0 0x7f8dd0155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 --2- 172.21.15.28:0/1357020816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00c1270 0x7f8dd0158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 -- 172.21.15.28:0/1357020816 >> 172.21.15.28:0/1357020816 conn(0x7f8dd00c7e40 msgr2=0x7f8dd006dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 -- 172.21.15.28:0/1357020816 shutdown_connections 2023-12-16T03:25:38.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.139+0000 7f8dd711d640 1 -- 172.21.15.28:0/1357020816 wait complete. 2023-12-16T03:25:38.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:25:38.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.303+0000 7f177c8c8640 1 Processor -- start 2023-12-16T03:25:38.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.303+0000 7f177c8c8640 1 -- start start 2023-12-16T03:25:38.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f177c8c8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1778151ae0 0x7f17780c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f177c8c8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1778158740 0x7f17780ca400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f177c8c8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17781582b0 con 0x7f17780ca940 2023-12-16T03:25:38.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f177c8c8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17780c5500 con 0x7f1778158740 2023-12-16T03:25:38.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f177c8c8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17780c4bb0 con 0x7f1778151ae0 2023-12-16T03:25:38.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f1776ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1778158740 0x7f17780ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f1777fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f17780ca940 0x7f17781544f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43574/0 (socket says 172.21.15.28:43574) 2023-12-16T03:25:38.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f1777fff640 1 -- 172.21.15.28:0/2980276776 learned_addr learned my addr 172.21.15.28:0/2980276776 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:38.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f17777fe640 1 --2- 172.21.15.28:0/2980276776 >> v2:172.21.15.134:3300/0 conn(0x7f1778151ae0 0x7f17780c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f1776ffd640 1 -- 172.21.15.28:0/2980276776 >> v2:172.21.15.134:3300/0 conn(0x7f1778151ae0 msgr2=0x7f17780c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:38.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f1776ffd640 1 --2- 172.21.15.28:0/2980276776 >> v2:172.21.15.134:3300/0 conn(0x7f1778151ae0 0x7f17780c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f1776ffd640 1 -- 172.21.15.28:0/2980276776 >> v1:172.21.15.28:6789/0 conn(0x7f17780ca940 legacy=0x7f17781544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f1776ffd640 1 -- 172.21.15.28:0/2980276776 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1778151ec0 con 0x7f1778158740 2023-12-16T03:25:38.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.307+0000 7f17767fc640 1 -- 172.21.15.28:0/2980276776 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762062490 0 0) 0x7f17781582b0 con 0x7f17780ca940 2023-12-16T03:25:38.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f1776ffd640 1 --2- 172.21.15.28:0/2980276776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1778158740 0x7f17780ca400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f177806d660 tx=0x7f176c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ac581d22e8f432 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:38.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f17767fc640 1 -- 172.21.15.28:0/2980276776 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0a7070 con 0x7f1778158740 2023-12-16T03:25:38.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f17767fc640 1 -- 172.21.15.28:0/2980276776 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c0ab430 con 0x7f1778158740 2023-12-16T03:25:38.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f17767fc640 1 -- 172.21.15.28:0/2980276776 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0ab7c0 con 0x7f1778158740 2023-12-16T03:25:38.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f177c8c8640 1 -- 172.21.15.28:0/2980276776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1778158740 msgr2=0x7f17780ca400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f177c8c8640 1 --2- 172.21.15.28:0/2980276776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1778158740 0x7f17780ca400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f177806d660 tx=0x7f176c01c430 comp rx=0 tx=0).stop 2023-12-16T03:25:38.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f177c8c8640 1 -- 172.21.15.28:0/2980276776 shutdown_connections 2023-12-16T03:25:38.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f177c8c8640 1 --2- 172.21.15.28:0/2980276776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1778158740 0x7f17780ca400 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f177c8c8640 1 --2- 172.21.15.28:0/2980276776 >> v2:172.21.15.134:3300/0 conn(0x7f1778151ae0 0x7f17780c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f177c8c8640 1 -- 172.21.15.28:0/2980276776 >> 172.21.15.28:0/2980276776 conn(0x7f17780abe80 msgr2=0x7f17780c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:38.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f177c8c8640 1 -- 172.21.15.28:0/2980276776 shutdown_connections 2023-12-16T03:25:38.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f177c8c8640 1 -- 172.21.15.28:0/2980276776 wait complete. 2023-12-16T03:25:38.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f177c8c8640 1 Processor -- start 2023-12-16T03:25:38.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.311+0000 7f177c8c8640 1 -- start start 2023-12-16T03:25:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f177c8c8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17780ca940 0x7f17781535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f177c8c8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1778151ae0 0x7f177814b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f177c8c8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1778158740 0x7f177814b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f177c8c8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17780c3c80 con 0x7f1778151ae0 2023-12-16T03:25:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f177c8c8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177814bce0 con 0x7f1778158740 2023-12-16T03:25:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f177c8c8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17780bf990 con 0x7f17780ca940 2023-12-16T03:25:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f1776ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1778151ae0 0x7f177814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f1776ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1778151ae0 0x7f177814b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56158/0 (socket says 172.21.15.28:56158) 2023-12-16T03:25:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f1776ffd640 1 -- 172.21.15.28:0/8163982 learned_addr learned my addr 172.21.15.28:0/8163982 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f17777fe640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17780ca940 0x7f17781535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f1777fff640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1778158740 0x7f177814b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f1776ffd640 1 -- 172.21.15.28:0/8163982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17780ca940 msgr2=0x7f17781535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f1776ffd640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17780ca940 0x7f17781535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f1776ffd640 1 -- 172.21.15.28:0/8163982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1778158740 msgr2=0x7f177814b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f1776ffd640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1778158740 0x7f177814b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f1776ffd640 1 -- 172.21.15.28:0/8163982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c009420 con 0x7f1778151ae0 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f1777fff640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1778158740 0x7f177814b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f1776ffd640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1778151ae0 0x7f177814b260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f176c01a060 tx=0x7f176c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f175ffff640 1 -- 172.21.15.28:0/8163982 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0bf610 con 0x7f1778151ae0 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f175ffff640 1 -- 172.21.15.28:0/8163982 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c0bf790 con 0x7f1778151ae0 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f175ffff640 1 -- 172.21.15.28:0/8163982 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0bfb40 con 0x7f1778151ae0 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f177c8c8640 1 -- 172.21.15.28:0/8163982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17780be520 con 0x7f1778151ae0 2023-12-16T03:25:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f177c8c8640 1 -- 172.21.15.28:0/8163982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17780c39a0 con 0x7f1778151ae0 2023-12-16T03:25:38.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f177c8c8640 1 -- 172.21.15.28:0/8163982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17780be6b0 con 0x7f1778151ae0 2023-12-16T03:25:38.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.315+0000 7f175ffff640 1 -- 172.21.15.28:0/8163982 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f176c0b5400 con 0x7f1778151ae0 2023-12-16T03:25:38.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.319+0000 7f175ffff640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1764066470 0x7f1764068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.319+0000 7f175ffff640 1 -- 172.21.15.28:0/8163982 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f176c11e5f0 con 0x7f1778151ae0 2023-12-16T03:25:38.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.319+0000 7f17777fe640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1764066470 0x7f1764068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.319+0000 7f17777fe640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1764066470 0x7f1764068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f17780685b0 tx=0x7f1768008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:38.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.319+0000 7f175ffff640 1 -- 172.21.15.28:0/8163982 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f176c0ebcd0 con 0x7f1778151ae0 2023-12-16T03:25:38.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 -- 172.21.15.28:0/8163982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f177806c7c0 con 0x7f1778151ae0 2023-12-16T03:25:38.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f175ffff640 1 -- 172.21.15.28:0/8163982 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f176c0ef2f0 con 0x7f1778151ae0 2023-12-16T03:25:38.483 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:25:38.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 -- 172.21.15.28:0/8163982 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1764066470 msgr2=0x7f1764068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1764066470 0x7f1764068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f17780685b0 tx=0x7f1768008040 comp rx=0 tx=0).stop 2023-12-16T03:25:38.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 -- 172.21.15.28:0/8163982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1778151ae0 msgr2=0x7f177814b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1778151ae0 0x7f177814b260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f176c01a060 tx=0x7f176c01ac70 comp rx=0 tx=0).stop 2023-12-16T03:25:38.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 -- 172.21.15.28:0/8163982 shutdown_connections 2023-12-16T03:25:38.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1778158740 0x7f177814b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1764066470 0x7f1764068930 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1778151ae0 0x7f177814b260 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 --2- 172.21.15.28:0/8163982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17780ca940 0x7f17781535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 -- 172.21.15.28:0/8163982 >> 172.21.15.28:0/8163982 conn(0x7f17780abe80 msgr2=0x7f177806c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:38.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.479+0000 7f177c8c8640 1 -- 172.21.15.28:0/8163982 shutdown_connections 2023-12-16T03:25:38.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.483+0000 7f177c8c8640 1 -- 172.21.15.28:0/8163982 wait complete. 2023-12-16T03:25:38.504 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:38.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff6459640 1 Processor -- start 2023-12-16T03:25:38.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff6459640 1 -- start start 2023-12-16T03:25:38.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff6459640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feff00c4750 0x7feff00c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff6459640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff006c660 con 0x7feff01544c0 2023-12-16T03:25:38.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff6459640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff006ba50 con 0x7feff00af5c0 2023-12-16T03:25:38.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff6459640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff006bd30 con 0x7feff00c4750 2023-12-16T03:25:38.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff5c58640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7feff01544c0 0x7feff0154910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43590/0 (socket says 172.21.15.28:43590) 2023-12-16T03:25:38.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff5c58640 1 -- 172.21.15.28:0/1489925728 learned_addr learned my addr 172.21.15.28:0/1489925728 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:38.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff4c56640 1 --2- 172.21.15.28:0/1489925728 >> v2:172.21.15.134:3300/0 conn(0x7feff00c4750 0x7feff00c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632615143 0 0) 0x7feff006c660 con 0x7feff01544c0 2023-12-16T03:25:38.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefdc003530 con 0x7feff01544c0 2023-12-16T03:25:38.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187958500 0 0) 0x7feff006ba50 con 0x7feff00af5c0 2023-12-16T03:25:38.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff006c660 con 0x7feff00af5c0 2023-12-16T03:25:38.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 852183933 0 0) 0x7fefdc003530 con 0x7feff01544c0 2023-12-16T03:25:38.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 >> v2:172.21.15.134:3300/0 conn(0x7feff00c4750 msgr2=0x7feff00c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:38.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 --2- 172.21.15.28:0/1489925728 >> v2:172.21.15.134:3300/0 conn(0x7feff00c4750 0x7feff00c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 >> v1:172.21.15.134:6789/0 conn(0x7feff00af5c0 legacy=0x7feff00c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff006c010 con 0x7feff01544c0 2023-12-16T03:25:38.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fefe8001a00 con 0x7feff01544c0 2023-12-16T03:25:38.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 >> v1:172.21.15.28:6789/0 conn(0x7feff01544c0 legacy=0x7feff0154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 --2- 172.21.15.28:0/1489925728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefdc003b10 0x7fefdc003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 --2- 172.21.15.28:0/1489925728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefdc0047d0 0x7fefdc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 --2- 172.21.15.28:0/1489925728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc005190 0x7fefdc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff006bd30 con 0x7fefdc003b10 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc00c010 con 0x7fefdc005190 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc00c1d0 con 0x7fefdc0047d0 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff5457640 1 --2- 172.21.15.28:0/1489925728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefdc003b10 0x7fefdc003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff5c58640 1 --2- 172.21.15.28:0/1489925728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc005190 0x7fefdc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff4c56640 1 --2- 172.21.15.28:0/1489925728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefdc0047d0 0x7fefdc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff5457640 1 -- 172.21.15.28:0/1489925728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefdc0047d0 msgr2=0x7fefdc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff5457640 1 --2- 172.21.15.28:0/1489925728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefdc0047d0 0x7fefdc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff5457640 1 -- 172.21.15.28:0/1489925728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc005190 msgr2=0x7fefdc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff5457640 1 --2- 172.21.15.28:0/1489925728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefdc005190 0x7fefdc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff5c58640 1 -- 172.21.15.28:0/1489925728 reap_dead start 2023-12-16T03:25:38.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.647+0000 7feff5457640 1 -- 172.21.15.28:0/1489925728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc003530 con 0x7fefdc003b10 2023-12-16T03:25:38.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.651+0000 7feff5457640 1 --2- 172.21.15.28:0/1489925728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefdc003b10 0x7fefdc003f10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fefec0018d0 tx=0x7fefec01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762083e348e54bad server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:38.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.651+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec0052d0 con 0x7fefdc003b10 2023-12-16T03:25:38.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.651+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec0a7050 con 0x7fefdc003b10 2023-12-16T03:25:38.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.651+0000 7fefe7fff640 1 -- 172.21.15.28:0/1489925728 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec003600 con 0x7fefdc003b10 2023-12-16T03:25:38.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.651+0000 7feff6459640 1 -- 172.21.15.28:0/1489925728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefdc003b10 msgr2=0x7fefdc003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.651+0000 7feff6459640 1 --2- 172.21.15.28:0/1489925728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefdc003b10 0x7fefdc003f10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fefec0018d0 tx=0x7fefec01c540 comp rx=0 tx=0).stop 2023-12-16T03:25:38.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.651+0000 7feff6459640 1 -- 172.21.15.28:0/1489925728 shutdown_connections 2023-12-16T03:25:38.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.651+0000 7feff6459640 1 --2- 172.21.15.28:0/1489925728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefdc003b10 0x7fefdc003f10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.651+0000 7feff6459640 1 -- 172.21.15.28:0/1489925728 >> 172.21.15.28:0/1489925728 conn(0x7feff00ab960 msgr2=0x7feff00abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:38.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.651+0000 7feff6459640 1 -- 172.21.15.28:0/1489925728 shutdown_connections 2023-12-16T03:25:38.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.651+0000 7feff6459640 1 -- 172.21.15.28:0/1489925728 wait complete. 2023-12-16T03:25:38.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff6459640 1 Processor -- start 2023-12-16T03:25:38.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff6459640 1 -- start start 2023-12-16T03:25:38.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff6459640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefdc003b10 0x7feff0153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff6459640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feff01f0820 0x7feff01e1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff6459640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff01e2350 0x7feff014aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff6459640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff01e0b20 con 0x7feff01f0820 2023-12-16T03:25:38.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff6459640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff01ee720 con 0x7feff01e2350 2023-12-16T03:25:38.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff6459640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff01e0d70 con 0x7fefdc003b10 2023-12-16T03:25:38.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff4c56640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feff01f0820 0x7feff01e1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff4c56640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feff01f0820 0x7feff01e1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56176/0 (socket says 172.21.15.28:56176) 2023-12-16T03:25:38.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff4c56640 1 -- 172.21.15.28:0/1995528244 learned_addr learned my addr 172.21.15.28:0/1995528244 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:38.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff5457640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefdc003b10 0x7feff0153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff5c58640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff01e2350 0x7feff014aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff4c56640 1 -- 172.21.15.28:0/1995528244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefdc003b10 msgr2=0x7feff0153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff4c56640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefdc003b10 0x7feff0153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff4c56640 1 -- 172.21.15.28:0/1995528244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff01e2350 msgr2=0x7feff014aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff4c56640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff01e2350 0x7feff014aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff4c56640 1 -- 172.21.15.28:0/1995528244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff01e1050 con 0x7feff01f0820 2023-12-16T03:25:38.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff4c56640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feff01f0820 0x7feff01e1e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fefe0011900 tx=0x7fefe0011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:38.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7fefe5ffb640 1 -- 172.21.15.28:0/1995528244 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe00095b0 con 0x7feff01f0820 2023-12-16T03:25:38.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7fefe5ffb640 1 -- 172.21.15.28:0/1995528244 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe0004240 con 0x7feff01f0820 2023-12-16T03:25:38.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff6459640 1 -- 172.21.15.28:0/1995528244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff01e1330 con 0x7feff01f0820 2023-12-16T03:25:38.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7fefe5ffb640 1 -- 172.21.15.28:0/1995528244 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000f8e0 con 0x7feff01f0820 2023-12-16T03:25:38.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.655+0000 7feff6459640 1 -- 172.21.15.28:0/1995528244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff01e18f0 con 0x7feff01f0820 2023-12-16T03:25:38.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.659+0000 7feff6459640 1 -- 172.21.15.28:0/1995528244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff004e850 con 0x7feff01f0820 2023-12-16T03:25:38.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.659+0000 7fefe5ffb640 1 -- 172.21.15.28:0/1995528244 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fefe000fa40 con 0x7feff01f0820 2023-12-16T03:25:38.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.659+0000 7fefe5ffb640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fefd40664a0 0x7fefd4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.659+0000 7fefe5ffb640 1 -- 172.21.15.28:0/1995528244 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefe0084450 con 0x7feff01f0820 2023-12-16T03:25:38.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.659+0000 7feff5457640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fefd40664a0 0x7fefd4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.659+0000 7feff5457640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fefd40664a0 0x7fefd4068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fefec0ac000 tx=0x7fefec0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:38.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.663+0000 7fefe5ffb640 1 -- 172.21.15.28:0/1995528244 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fefe0051970 con 0x7feff01f0820 2023-12-16T03:25:38.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 -- 172.21.15.28:0/1995528244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feff00bd610 con 0x7feff01f0820 2023-12-16T03:25:38.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7fefe5ffb640 1 -- 172.21.15.28:0/1995528244 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fefe000fcf0 con 0x7feff01f0820 2023-12-16T03:25:38.826 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:38.826 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:38.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 -- 172.21.15.28:0/1995528244 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fefd40664a0 msgr2=0x7fefd4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fefd40664a0 0x7fefd4068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fefec0ac000 tx=0x7fefec0a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:38.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 -- 172.21.15.28:0/1995528244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feff01f0820 msgr2=0x7feff01e1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feff01f0820 0x7feff01e1e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fefe0011900 tx=0x7fefe0011dc0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 -- 172.21.15.28:0/1995528244 shutdown_connections 2023-12-16T03:25:38.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feff01e2350 0x7feff014aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fefd40664a0 0x7fefd4068960 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feff01f0820 0x7feff01e1e10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 --2- 172.21.15.28:0/1995528244 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefdc003b10 0x7feff0153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:38.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 -- 172.21.15.28:0/1995528244 >> 172.21.15.28:0/1995528244 conn(0x7feff00ab960 msgr2=0x7feff0156a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:38.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 -- 172.21.15.28:0/1995528244 shutdown_connections 2023-12-16T03:25:38.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.823+0000 7feff6459640 1 -- 172.21.15.28:0/1995528244 wait complete. 2023-12-16T03:25:38.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:25:13.885447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:25:14.309086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:38.849 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:38.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.991+0000 7ff13bd01640 1 Processor -- start 2023-12-16T03:25:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff13bd01640 1 -- start start 2023-12-16T03:25:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff13bd01640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff1340c4100 0x7ff1340c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff13bd01640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1340c31c0 con 0x7ff1340c06d0 2023-12-16T03:25:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff13bd01640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1340c34a0 con 0x7ff1340c63c0 2023-12-16T03:25:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff13bd01640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1340c1030 con 0x7ff1340c4100 2023-12-16T03:25:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff13929c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff1340c4100 0x7ff1340c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff13a29e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff1340c06d0 0x7ff1340a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43596/0 (socket says 172.21.15.28:43596) 2023-12-16T03:25:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff13a29e640 1 -- 172.21.15.28:0/1831982658 learned_addr learned my addr 172.21.15.28:0/1831982658 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:38.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff13929c640 1 -- 172.21.15.28:0/1831982658 >> v1:172.21.15.134:6789/0 conn(0x7ff1340c63c0 legacy=0x7ff1340c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff13929c640 1 -- 172.21.15.28:0/1831982658 >> v1:172.21.15.28:6789/0 conn(0x7ff1340c06d0 legacy=0x7ff1340a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:38.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff13929c640 1 -- 172.21.15.28:0/1831982658 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1340c1310 con 0x7ff1340c4100 2023-12-16T03:25:38.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.995+0000 7ff138a9b640 1 -- 172.21.15.28:0/1831982658 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060436183 0 0) 0x7ff1340c31c0 con 0x7ff1340c06d0 2023-12-16T03:25:39.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff13929c640 1 --2- 172.21.15.28:0/1831982658 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1340c4100 0x7ff1340c2bb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff1240097c0 tx=0x7ff12401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fb74a429630c4f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:39.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff138a9b640 1 -- 172.21.15.28:0/1831982658 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1240ab600 con 0x7ff1340c4100 2023-12-16T03:25:39.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff138a9b640 1 -- 172.21.15.28:0/1831982658 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1240a7050 con 0x7ff1340c4100 2023-12-16T03:25:39.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff138a9b640 1 -- 172.21.15.28:0/1831982658 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1240ab980 con 0x7ff1340c4100 2023-12-16T03:25:39.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff13bd01640 1 -- 172.21.15.28:0/1831982658 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1340c4100 msgr2=0x7ff1340c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff13bd01640 1 --2- 172.21.15.28:0/1831982658 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1340c4100 0x7ff1340c2bb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff1240097c0 tx=0x7ff12401c360 comp rx=0 tx=0).stop 2023-12-16T03:25:39.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff13bd01640 1 -- 172.21.15.28:0/1831982658 shutdown_connections 2023-12-16T03:25:39.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff13bd01640 1 --2- 172.21.15.28:0/1831982658 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1340c4100 0x7ff1340c2bb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff13bd01640 1 -- 172.21.15.28:0/1831982658 >> 172.21.15.28:0/1831982658 conn(0x7ff13406a5b0 msgr2=0x7ff13406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:39.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff13bd01640 1 -- 172.21.15.28:0/1831982658 shutdown_connections 2023-12-16T03:25:39.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff13bd01640 1 -- 172.21.15.28:0/1831982658 wait complete. 2023-12-16T03:25:39.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff13bd01640 1 Processor -- start 2023-12-16T03:25:39.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:38.999+0000 7ff13bd01640 1 -- start start 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13bd01640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1340c06d0 0x7ff134150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13bd01640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1340c4100 0x7ff134156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13bd01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1340c63c0 0x7ff1341574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13bd01640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1341edf30 con 0x7ff1340c4100 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13bd01640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1341f1470 con 0x7ff1340c63c0 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13bd01640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff134071860 con 0x7ff1340c06d0 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13929c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1340c4100 0x7ff134156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13929c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1340c4100 0x7ff134156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56190/0 (socket says 172.21.15.28:56190) 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13929c640 1 -- 172.21.15.28:0/568151397 learned_addr learned my addr 172.21.15.28:0/568151397 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff139a9d640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1340c06d0 0x7ff134150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13a29e640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1340c63c0 0x7ff1341574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13929c640 1 -- 172.21.15.28:0/568151397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1340c06d0 msgr2=0x7ff134150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13929c640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1340c06d0 0x7ff134150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13929c640 1 -- 172.21.15.28:0/568151397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1340c63c0 msgr2=0x7ff1341574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13929c640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1340c63c0 0x7ff1341574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13929c640 1 -- 172.21.15.28:0/568151397 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124009420 con 0x7ff1340c4100 2023-12-16T03:25:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13929c640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1340c4100 0x7ff134156fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff1240097c0 tx=0x7ff124019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:39.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff12a7fc640 1 -- 172.21.15.28:0/568151397 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1240b4840 con 0x7ff1340c4100 2023-12-16T03:25:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff12a7fc640 1 -- 172.21.15.28:0/568151397 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1240b49c0 con 0x7ff1340c4100 2023-12-16T03:25:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff12a7fc640 1 -- 172.21.15.28:0/568151397 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1240b4d70 con 0x7ff1340c4100 2023-12-16T03:25:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13bd01640 1 -- 172.21.15.28:0/568151397 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1340c69b0 con 0x7ff1340c4100 2023-12-16T03:25:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13bd01640 1 -- 172.21.15.28:0/568151397 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1340712a0 con 0x7ff1340c4100 2023-12-16T03:25:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff13bd01640 1 -- 172.21.15.28:0/568151397 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff134071100 con 0x7ff1340c4100 2023-12-16T03:25:39.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.003+0000 7ff12a7fc640 1 -- 172.21.15.28:0/568151397 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff1240b2040 con 0x7ff1340c4100 2023-12-16T03:25:39.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.007+0000 7ff12a7fc640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff118066470 0x7ff118068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.007+0000 7ff12a7fc640 1 -- 172.21.15.28:0/568151397 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff12411e3b0 con 0x7ff1340c4100 2023-12-16T03:25:39.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.007+0000 7ff139a9d640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff118066470 0x7ff118068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.007+0000 7ff139a9d640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff118066470 0x7ff118068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff130000f70 tx=0x7ff130009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:39.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.011+0000 7ff12a7fc640 1 -- 172.21.15.28:0/568151397 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff134071100 con 0x7ff1340c4100 2023-12-16T03:25:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 -- 172.21.15.28:0/568151397 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff134071100 con 0x7ff1340c4100 2023-12-16T03:25:39.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff12a7fc640 1 -- 172.21.15.28:0/568151397 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff134071100 con 0x7ff1340c4100 2023-12-16T03:25:39.171 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 -- 172.21.15.28:0/568151397 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff118066470 msgr2=0x7ff118068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff118066470 0x7ff118068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff130000f70 tx=0x7ff130009040 comp rx=0 tx=0).stop 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 -- 172.21.15.28:0/568151397 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1340c4100 msgr2=0x7ff134156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1340c4100 0x7ff134156fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff1240097c0 tx=0x7ff124019100 comp rx=0 tx=0).stop 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 -- 172.21.15.28:0/568151397 shutdown_connections 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1340c63c0 0x7ff1341574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff118066470 0x7ff118068930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1340c4100 0x7ff134156fa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 --2- 172.21.15.28:0/568151397 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1340c06d0 0x7ff134150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 -- 172.21.15.28:0/568151397 >> 172.21.15.28:0/568151397 conn(0x7ff13406a5b0 msgr2=0x7ff1340c22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 -- 172.21.15.28:0/568151397 shutdown_connections 2023-12-16T03:25:39.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.167+0000 7ff13bd01640 1 -- 172.21.15.28:0/568151397 wait complete. 2023-12-16T03:25:39.192 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:25:39.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb68c8bb640 1 Processor -- start 2023-12-16T03:25:39.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb68c8bb640 1 -- start start 2023-12-16T03:25:39.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb68c8bb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb6880c63c0 0x7fb6880c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb68c8bb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb6880c4100 0x7fb6880c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb68c8bb640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6880c31c0 con 0x7fb6880c29e0 2023-12-16T03:25:39.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb68c8bb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6880c34a0 con 0x7fb6880c4100 2023-12-16T03:25:39.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb68c8bb640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6880c1030 con 0x7fb6880c63c0 2023-12-16T03:25:39.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb67ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb6880c4100 0x7fb6880c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb67ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb6880c4100 0x7fb6880c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56196/0 (socket says 172.21.15.28:56196) 2023-12-16T03:25:39.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb67ffff640 1 -- 172.21.15.28:0/3704506253 learned_addr learned my addr 172.21.15.28:0/3704506253 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:39.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb68659c640 1 --2- 172.21.15.28:0/3704506253 >> v2:172.21.15.134:3300/0 conn(0x7fb6880c63c0 0x7fb6880c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb67ffff640 1 -- 172.21.15.28:0/3704506253 >> v2:172.21.15.134:3300/0 conn(0x7fb6880c63c0 msgr2=0x7fb6880c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:39.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb67ffff640 1 --2- 172.21.15.28:0/3704506253 >> v2:172.21.15.134:3300/0 conn(0x7fb6880c63c0 0x7fb6880c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb67ffff640 1 -- 172.21.15.28:0/3704506253 >> v1:172.21.15.134:6789/0 conn(0x7fb6880c29e0 legacy=0x7fb6880a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.335+0000 7fb67ffff640 1 -- 172.21.15.28:0/3704506253 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6880c1310 con 0x7fb6880c4100 2023-12-16T03:25:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb67ffff640 1 --2- 172.21.15.28:0/3704506253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6880c4100 0x7fb6880c24a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb68806e000 tx=0x7fb67001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2a1a40ef9ca165 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb685d9b640 1 -- 172.21.15.28:0/3704506253 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700ac630 con 0x7fb6880c4100 2023-12-16T03:25:39.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb685d9b640 1 -- 172.21.15.28:0/3704506253 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6700ac790 con 0x7fb6880c4100 2023-12-16T03:25:39.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb685d9b640 1 -- 172.21.15.28:0/3704506253 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700acb20 con 0x7fb6880c4100 2023-12-16T03:25:39.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb68c8bb640 1 -- 172.21.15.28:0/3704506253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6880c4100 msgr2=0x7fb6880c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb68c8bb640 1 --2- 172.21.15.28:0/3704506253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6880c4100 0x7fb6880c24a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb68806e000 tx=0x7fb67001c3b0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb68c8bb640 1 -- 172.21.15.28:0/3704506253 shutdown_connections 2023-12-16T03:25:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb68c8bb640 1 --2- 172.21.15.28:0/3704506253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6880c4100 0x7fb6880c24a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb68c8bb640 1 --2- 172.21.15.28:0/3704506253 >> v2:172.21.15.134:3300/0 conn(0x7fb6880c63c0 0x7fb6880c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb68c8bb640 1 -- 172.21.15.28:0/3704506253 >> 172.21.15.28:0/3704506253 conn(0x7fb68806a5b0 msgr2=0x7fb68806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb68c8bb640 1 -- 172.21.15.28:0/3704506253 shutdown_connections 2023-12-16T03:25:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.339+0000 7fb68c8bb640 1 -- 172.21.15.28:0/3704506253 wait complete. 2023-12-16T03:25:39.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68c8bb640 1 Processor -- start 2023-12-16T03:25:39.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68c8bb640 1 -- start start 2023-12-16T03:25:39.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68c8bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6880c29e0 0x7fb6881520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68c8bb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6880c4100 0x7fb68814e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68c8bb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6880c63c0 0x7fb688154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68c8bb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880bb920 con 0x7fb6880c63c0 2023-12-16T03:25:39.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68c8bb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6881ec170 con 0x7fb6880c4100 2023-12-16T03:25:39.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68c8bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb688157810 con 0x7fb6880c29e0 2023-12-16T03:25:39.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb686d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6880c63c0 0x7fb688154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb686d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6880c63c0 0x7fb688154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56206/0 (socket says 172.21.15.28:56206) 2023-12-16T03:25:39.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb686d9d640 1 -- 172.21.15.28:0/1775405698 learned_addr learned my addr 172.21.15.28:0/1775405698 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:39.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb67ffff640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6880c4100 0x7fb68814e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68659c640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6880c29e0 0x7fb6881520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb686d9d640 1 -- 172.21.15.28:0/1775405698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6880c29e0 msgr2=0x7fb6881520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb686d9d640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6880c29e0 0x7fb6881520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb686d9d640 1 -- 172.21.15.28:0/1775405698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6880c4100 msgr2=0x7fb68814e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb686d9d640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6880c4100 0x7fb68814e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb686d9d640 1 -- 172.21.15.28:0/1775405698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6700094d0 con 0x7fb6880c63c0 2023-12-16T03:25:39.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb686d9d640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6880c63c0 0x7fb688154ea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c770 tx=0x7fb68000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:39.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb67effd640 1 -- 172.21.15.28:0/1775405698 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680003b80 con 0x7fb6880c63c0 2023-12-16T03:25:39.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb67effd640 1 -- 172.21.15.28:0/1775405698 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680003ce0 con 0x7fb6880c63c0 2023-12-16T03:25:39.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb67effd640 1 -- 172.21.15.28:0/1775405698 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68000aa90 con 0x7fb6880c63c0 2023-12-16T03:25:39.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68c8bb640 1 -- 172.21.15.28:0/1775405698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb688157af0 con 0x7fb6880c63c0 2023-12-16T03:25:39.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68c8bb640 1 -- 172.21.15.28:0/1775405698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6881580b0 con 0x7fb6880c63c0 2023-12-16T03:25:39.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.343+0000 7fb68c8bb640 1 -- 172.21.15.28:0/1775405698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb688068400 con 0x7fb6880c63c0 2023-12-16T03:25:39.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.347+0000 7fb67effd640 1 -- 172.21.15.28:0/1775405698 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb68000abf0 con 0x7fb6880c63c0 2023-12-16T03:25:39.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.347+0000 7fb67effd640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb668066470 0x7fb668068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.347+0000 7fb67effd640 1 -- 172.21.15.28:0/1775405698 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb680083d80 con 0x7fb6880c63c0 2023-12-16T03:25:39.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.347+0000 7fb68659c640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb668066470 0x7fb668068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.347+0000 7fb68659c640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb668066470 0x7fb668068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb67800b930 tx=0x7fb678008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:39.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.351+0000 7fb67effd640 1 -- 172.21.15.28:0/1775405698 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb680051160 con 0x7fb6880c63c0 2023-12-16T03:25:39.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb68c8bb640 1 -- 172.21.15.28:0/1775405698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6881ec2b0 con 0x7fb6880c63c0 2023-12-16T03:25:39.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb67effd640 1 -- 172.21.15.28:0/1775405698 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb680054780 con 0x7fb6880c63c0 2023-12-16T03:25:39.515 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:25:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb68c8bb640 1 -- 172.21.15.28:0/1775405698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb668066470 msgr2=0x7fb668068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb68c8bb640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb668066470 0x7fb668068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb67800b930 tx=0x7fb678008040 comp rx=0 tx=0).stop 2023-12-16T03:25:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb68c8bb640 1 -- 172.21.15.28:0/1775405698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6880c63c0 msgr2=0x7fb688154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb68c8bb640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6880c63c0 0x7fb688154ea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c770 tx=0x7fb68000cc30 comp rx=0 tx=0).stop 2023-12-16T03:25:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb68c8bb640 1 -- 172.21.15.28:0/1775405698 shutdown_connections 2023-12-16T03:25:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb68c8bb640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb668066470 0x7fb668068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb68c8bb640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6880c63c0 0x7fb688154ea0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb68c8bb640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6880c4100 0x7fb68814e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb68c8bb640 1 --2- 172.21.15.28:0/1775405698 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6880c29e0 0x7fb6881520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.511+0000 7fb68c8bb640 1 -- 172.21.15.28:0/1775405698 >> 172.21.15.28:0/1775405698 conn(0x7fb68806a5b0 msgr2=0x7fb6880a71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:39.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.515+0000 7fb68c8bb640 1 -- 172.21.15.28:0/1775405698 shutdown_connections 2023-12-16T03:25:39.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.515+0000 7fb68c8bb640 1 -- 172.21.15.28:0/1775405698 wait complete. 2023-12-16T03:25:39.536 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:25:39.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c20c68640 1 Processor -- start 2023-12-16T03:25:39.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c20c68640 1 -- start start 2023-12-16T03:25:39.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c20c68640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6c1c151e90 0x7f6c1c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c20c68640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c1c0c4e60 0x7f6c1c06bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c20c68640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1c06c860 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c20c68640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c0c8750 con 0x7f6c1c151e90 2023-12-16T03:25:39.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c20c68640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c1552d0 con 0x7f6c1c0c4e60 2023-12-16T03:25:39.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c1a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6c1c151e90 0x7f6c1c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c1a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6c1c151e90 0x7f6c1c0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34492/0 (socket says 172.21.15.28:34492) 2023-12-16T03:25:39.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c1a59c640 1 -- 172.21.15.28:0/2646869234 learned_addr learned my addr 172.21.15.28:0/2646869234 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:39.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c1ad9d640 1 --2- 172.21.15.28:0/2646869234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c1c0c4e60 0x7f6c1c06bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c1a59c640 1 -- 172.21.15.28:0/2646869234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c1c0c4e60 msgr2=0x7f6c1c06bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:39.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c1a59c640 1 --2- 172.21.15.28:0/2646869234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c1c0c4e60 0x7f6c1c06bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c1a59c640 1 -- 172.21.15.28:0/2646869234 >> v1:172.21.15.134:6789/0 conn(0x7f6c1c0c7ea0 legacy=0x7f6c1c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:39.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.679+0000 7f6c1a59c640 1 -- 172.21.15.28:0/2646869234 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c154930 con 0x7f6c1c151e90 2023-12-16T03:25:39.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c1a59c640 1 --2- 172.21.15.28:0/2646869234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c1c151e90 0x7f6c1c0c4920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009870 tx=0x7f6c0c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343662146be99048 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:39.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c19d9b640 1 -- 172.21.15.28:0/2646869234 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0ab600 con 0x7f6c1c151e90 2023-12-16T03:25:39.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c19d9b640 1 -- 172.21.15.28:0/2646869234 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c0a7050 con 0x7f6c1c151e90 2023-12-16T03:25:39.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c19d9b640 1 -- 172.21.15.28:0/2646869234 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0ab980 con 0x7f6c1c151e90 2023-12-16T03:25:39.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c20c68640 1 -- 172.21.15.28:0/2646869234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c1c151e90 msgr2=0x7f6c1c0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c20c68640 1 --2- 172.21.15.28:0/2646869234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c1c151e90 0x7f6c1c0c4920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009870 tx=0x7f6c0c01c3e0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c20c68640 1 -- 172.21.15.28:0/2646869234 shutdown_connections 2023-12-16T03:25:39.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c20c68640 1 --2- 172.21.15.28:0/2646869234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c1c0c4e60 0x7f6c1c06bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c20c68640 1 --2- 172.21.15.28:0/2646869234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c1c151e90 0x7f6c1c0c4920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c20c68640 1 -- 172.21.15.28:0/2646869234 >> 172.21.15.28:0/2646869234 conn(0x7f6c1c0ca170 msgr2=0x7f6c1c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:39.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c20c68640 1 -- 172.21.15.28:0/2646869234 shutdown_connections 2023-12-16T03:25:39.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.683+0000 7f6c20c68640 1 -- 172.21.15.28:0/2646869234 wait complete. 2023-12-16T03:25:39.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c20c68640 1 Processor -- start 2023-12-16T03:25:39.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c20c68640 1 -- start start 2023-12-16T03:25:39.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c20c68640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c1c0c4e60 0x7f6c1c146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c20c68640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c1c0c7ea0 0x7f6c1c1f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c20c68640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c1c151e90 0x7f6c1c1433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c20c68640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c1f0460 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c20c68640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c1f0740 con 0x7f6c1c0c4e60 2023-12-16T03:25:39.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c20c68640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c1eda10 con 0x7f6c1c151e90 2023-12-16T03:25:39.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c13fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c1c0c7ea0 0x7f6c1c1f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c13fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c1c0c7ea0 0x7f6c1c1f0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34494/0 (socket says 172.21.15.28:34494) 2023-12-16T03:25:39.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c13fff640 1 -- 172.21.15.28:0/65736554 learned_addr learned my addr 172.21.15.28:0/65736554 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:39.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c1a59c640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c1c0c4e60 0x7f6c1c146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c1ad9d640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c1c151e90 0x7f6c1c1433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c13fff640 1 -- 172.21.15.28:0/65736554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c1c151e90 msgr2=0x7f6c1c1433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c13fff640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c1c151e90 0x7f6c1c1433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c13fff640 1 -- 172.21.15.28:0/65736554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c1c0c4e60 msgr2=0x7f6c1c146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c13fff640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c1c0c4e60 0x7f6c1c146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c13fff640 1 -- 172.21.15.28:0/65736554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0094d0 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c1ad9d640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c1c151e90 0x7f6c1c1433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:39.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c13fff640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c1c0c7ea0 0x7f6c1c1f0bd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400b410 tx=0x7f6c0400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:39.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c12ffd640 1 -- 172.21.15.28:0/65736554 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04004020 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c12ffd640 1 -- 172.21.15.28:0/65736554 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c04004180 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c20c68640 1 -- 172.21.15.28:0/65736554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1c145bf0 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c12ffd640 1 -- 172.21.15.28:0/65736554 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04011630 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c20c68640 1 -- 172.21.15.28:0/65736554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1c146e90 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.687+0000 7f6c20c68640 1 -- 172.21.15.28:0/65736554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c068400 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.691+0000 7f6c12ffd640 1 -- 172.21.15.28:0/65736554 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6c04011790 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.691+0000 7f6c12ffd640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bfc0664a0 0x7f6bfc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:39.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.691+0000 7f6c12ffd640 1 -- 172.21.15.28:0/65736554 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c04083c30 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.691+0000 7f6c1a59c640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bfc0664a0 0x7f6bfc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:39.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.691+0000 7f6c1a59c640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bfc0664a0 0x7f6bfc068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0ad000 tx=0x7f6c0c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:39.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.695+0000 7f6c12ffd640 1 -- 172.21.15.28:0/65736554 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6c040510a0 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.851+0000 7f6c20c68640 1 -- 172.21.15.28:0/65736554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c1c0c40a0 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c12ffd640 1 -- 172.21.15.28:0/65736554 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c040150a0 con 0x7f6c1c0c7ea0 2023-12-16T03:25:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:25:39.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 -- 172.21.15.28:0/65736554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bfc0664a0 msgr2=0x7f6bfc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bfc0664a0 0x7f6bfc068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0ad000 tx=0x7f6c0c0a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:39.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 -- 172.21.15.28:0/65736554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c1c0c7ea0 msgr2=0x7f6c1c1f0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:39.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c1c0c7ea0 0x7f6c1c1f0bd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400b410 tx=0x7f6c0400b8d0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 -- 172.21.15.28:0/65736554 shutdown_connections 2023-12-16T03:25:39.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c1c151e90 0x7f6c1c1433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bfc0664a0 0x7f6bfc068960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c1c0c7ea0 0x7f6c1c1f0bd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 --2- 172.21.15.28:0/65736554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c1c0c4e60 0x7f6c1c146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:39.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 -- 172.21.15.28:0/65736554 >> 172.21.15.28:0/65736554 conn(0x7f6c1c0ca170 msgr2=0x7f6c1c0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:39.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 -- 172.21.15.28:0/65736554 shutdown_connections 2023-12-16T03:25:39.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:39.855+0000 7f6c20c68640 1 -- 172.21.15.28:0/65736554 wait complete. 2023-12-16T03:25:39.878 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:40.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e9e7f8640 1 Processor -- start 2023-12-16T03:25:40.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e9e7f8640 1 -- start start 2023-12-16T03:25:40.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e9e7f8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4e980bffc0 0x7f4e9815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e9e7f8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9815c600 con 0x7f4e981560e0 2023-12-16T03:25:40.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e9e7f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9815a5c0 con 0x7f4e9806d520 2023-12-16T03:25:40.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e9e7f8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e981594e0 con 0x7f4e980bffc0 2023-12-16T03:25:40.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e97fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4e981560e0 0x7f4e98159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57458/0 (socket says 172.21.15.28:57458) 2023-12-16T03:25:40.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e97fff640 1 -- 172.21.15.28:0/3513574611 learned_addr learned my addr 172.21.15.28:0/3513574611 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:40.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e9cd95640 1 --2- 172.21.15.28:0/3513574611 >> v2:172.21.15.134:3300/0 conn(0x7f4e980bffc0 0x7f4e9815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916064749 0 0) 0x7f4e9815c600 con 0x7f4e981560e0 2023-12-16T03:25:40.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e80003530 con 0x7f4e981560e0 2023-12-16T03:25:40.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3750991124 0 0) 0x7f4e80003530 con 0x7f4e981560e0 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 >> v2:172.21.15.134:3300/0 conn(0x7f4e980bffc0 msgr2=0x7f4e9815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 --2- 172.21.15.28:0/3513574611 >> v2:172.21.15.134:3300/0 conn(0x7f4e980bffc0 0x7f4e9815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 >> v1:172.21.15.134:6789/0 conn(0x7f4e9806d520 legacy=0x7f4e980c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e981597c0 con 0x7f4e981560e0 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f4e88001680 con 0x7f4e981560e0 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e9cd95640 1 --2- 172.21.15.28:0/3513574611 >> v2:172.21.15.134:3300/0 conn(0x7f4e980bffc0 0x7f4e9815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 >> v1:172.21.15.28:6789/0 conn(0x7f4e981560e0 legacy=0x7f4e98159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 0x7f4e80003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800047d0 0x7f4e80004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e80005190 0x7f4e8000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e981594e0 con 0x7f4e800039d0 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8000c090 con 0x7f4e80005190 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8000c250 con 0x7f4e800047d0 2023-12-16T03:25:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e97fff640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 0x7f4e80003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e9cd95640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e80005190 0x7f4e8000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e977fe640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800047d0 0x7f4e80004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e97fff640 1 -- 172.21.15.28:0/3513574611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800047d0 msgr2=0x7f4e80004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:40.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e97fff640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e800047d0 0x7f4e80004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e97fff640 1 -- 172.21.15.28:0/3513574611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e80005190 msgr2=0x7f4e8000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:40.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e97fff640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e80005190 0x7f4e8000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e97fff640 1 -- 172.21.15.28:0/3513574611 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80003530 con 0x7f4e800039d0 2023-12-16T03:25:40.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e9cd95640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e80005190 0x7f4e8000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:40.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.023+0000 7f4e9cd95640 1 -- 172.21.15.28:0/3513574611 reap_dead start 2023-12-16T03:25:40.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.027+0000 7f4e97fff640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 0x7f4e80003df0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800c0e0 tx=0x7f4e8801caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2295115ac6f8fa6e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.027+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88005ae0 con 0x7f4e800039d0 2023-12-16T03:25:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.027+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e88005c40 con 0x7f4e800039d0 2023-12-16T03:25:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.027+0000 7f4e96ffd640 1 -- 172.21.15.28:0/3513574611 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e880a5a10 con 0x7f4e800039d0 2023-12-16T03:25:40.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.027+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/3513574611 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 msgr2=0x7f4e80003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.027+0000 7f4e9e7f8640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 0x7f4e80003df0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800c0e0 tx=0x7f4e8801caf0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.027+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/3513574611 shutdown_connections 2023-12-16T03:25:40.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.027+0000 7f4e9e7f8640 1 --2- 172.21.15.28:0/3513574611 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 0x7f4e80003df0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.027+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/3513574611 >> 172.21.15.28:0/3513574611 conn(0x7f4e9806a5b0 msgr2=0x7f4e9806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:40.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.027+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/3513574611 shutdown_connections 2023-12-16T03:25:40.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.027+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/3513574611 wait complete. 2023-12-16T03:25:40.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9e7f8640 1 Processor -- start 2023-12-16T03:25:40.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9e7f8640 1 -- start start 2023-12-16T03:25:40.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9e7f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 0x7f4e9815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9e7f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9815d950 0x7f4e980a34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9e7f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e980a3a00 0x7f4e980a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9e7f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98071170 con 0x7f4e800039d0 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9e7f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e981f2360 con 0x7f4e9815d950 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9e7f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98071410 con 0x7f4e980a3a00 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e97fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 0x7f4e9815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e97fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 0x7f4e9815aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34512/0 (socket says 172.21.15.28:34512) 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e97fff640 1 -- 172.21.15.28:0/907245329 learned_addr learned my addr 172.21.15.28:0/907245329 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e977fe640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9815d950 0x7f4e980a34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9cd95640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e980a3a00 0x7f4e980a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e97fff640 1 -- 172.21.15.28:0/907245329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e980a3a00 msgr2=0x7f4e980a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e97fff640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e980a3a00 0x7f4e980a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e97fff640 1 -- 172.21.15.28:0/907245329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9815d950 msgr2=0x7f4e980a34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e97fff640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9815d950 0x7f4e980a34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e97fff640 1 -- 172.21.15.28:0/907245329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9806e340 con 0x7f4e800039d0 2023-12-16T03:25:40.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9cd95640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e980a3a00 0x7f4e980a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:40.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e97fff640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 0x7f4e9815aa10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e8801cb30 tx=0x7f4e80005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:40.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e94ff9640 1 -- 172.21.15.28:0/907245329 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e880b4070 con 0x7f4e800039d0 2023-12-16T03:25:40.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e94ff9640 1 -- 172.21.15.28:0/907245329 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e880047f0 con 0x7f4e800039d0 2023-12-16T03:25:40.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e94ff9640 1 -- 172.21.15.28:0/907245329 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88004b80 con 0x7f4e800039d0 2023-12-16T03:25:40.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/907245329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e981f2640 con 0x7f4e800039d0 2023-12-16T03:25:40.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.031+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/907245329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e981553b0 con 0x7f4e800039d0 2023-12-16T03:25:40.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.035+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/907245329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e980715d0 con 0x7f4e800039d0 2023-12-16T03:25:40.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.035+0000 7f4e94ff9640 1 -- 172.21.15.28:0/907245329 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4e88004ce0 con 0x7f4e800039d0 2023-12-16T03:25:40.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.035+0000 7f4e94ff9640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e840664a0 0x7f4e84068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.035+0000 7f4e94ff9640 1 -- 172.21.15.28:0/907245329 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e8811d7f0 con 0x7f4e800039d0 2023-12-16T03:25:40.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.035+0000 7f4e977fe640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e840664a0 0x7f4e84068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.035+0000 7f4e977fe640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e840664a0 0x7f4e84068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4e980a6770 tx=0x7f4e8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:40.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.039+0000 7f4e94ff9640 1 -- 172.21.15.28:0/907245329 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4e880ead20 con 0x7f4e800039d0 2023-12-16T03:25:40.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/907245329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e98068400 con 0x7f4e800039d0 2023-12-16T03:25:40.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e94ff9640 1 -- 172.21.15.28:0/907245329 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f4e880ee340 con 0x7f4e800039d0 2023-12-16T03:25:40.206 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:40.206 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:40.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/907245329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e840664a0 msgr2=0x7f4e84068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e840664a0 0x7f4e84068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4e980a6770 tx=0x7f4e8c009040 comp rx=0 tx=0).stop 2023-12-16T03:25:40.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/907245329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 msgr2=0x7f4e9815aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 0x7f4e9815aa10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e8801cb30 tx=0x7f4e80005800 comp rx=0 tx=0).stop 2023-12-16T03:25:40.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/907245329 shutdown_connections 2023-12-16T03:25:40.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e980a3a00 0x7f4e980a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9815d950 0x7f4e980a34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e840664a0 0x7f4e84068960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 --2- 172.21.15.28:0/907245329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e800039d0 0x7f4e9815aa10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/907245329 >> 172.21.15.28:0/907245329 conn(0x7f4e9806a5b0 msgr2=0x7f4e980a81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:40.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/907245329 shutdown_connections 2023-12-16T03:25:40.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.203+0000 7f4e9e7f8640 1 -- 172.21.15.28:0/907245329 wait complete. 2023-12-16T03:25:40.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:25:13.885447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:25:14.309086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:40.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:40.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.371+0000 7f54c0cd6640 1 Processor -- start 2023-12-16T03:25:40.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.371+0000 7f54c0cd6640 1 -- start start 2023-12-16T03:25:40.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.371+0000 7f54c0cd6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c4100 0x7f54bc0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.371+0000 7f54c0cd6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f54bc0c06d0 0x7f54bc0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.371+0000 7f54c0cd6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc0c31c0 con 0x7f54bc0c63c0 2023-12-16T03:25:40.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.371+0000 7f54c0cd6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc0c34a0 con 0x7f54bc0c06d0 2023-12-16T03:25:40.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.371+0000 7f54c0cd6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0c1030 con 0x7f54bc0c4100 2023-12-16T03:25:40.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54b3fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c4100 0x7f54bc0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54ba59c640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f54bc0c63c0 0x7f54bc0c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:55768/0 (socket says 172.21.15.28:55768) 2023-12-16T03:25:40.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54bad9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f54bc0c06d0 0x7f54bc0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54ba59c640 1 -- 172.21.15.28:0/1124627982 learned_addr learned my addr 172.21.15.28:0/1124627982 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:40.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54bad9d640 1 -- 172.21.15.28:0/1124627982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c4100 msgr2=0x7f54bc0c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:40.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54b9d9b640 1 -- 172.21.15.28:0/1124627982 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153999778 0 0) 0x7f54bc0c31c0 con 0x7f54bc0c63c0 2023-12-16T03:25:40.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54bad9d640 1 --2- 172.21.15.28:0/1124627982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c4100 0x7f54bc0c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54bad9d640 1 -- 172.21.15.28:0/1124627982 >> v1:172.21.15.134:6789/0 conn(0x7f54bc0c63c0 legacy=0x7f54bc0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54bad9d640 1 -- 172.21.15.28:0/1124627982 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc0c1310 con 0x7f54bc0c06d0 2023-12-16T03:25:40.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54bad9d640 1 --2- 172.21.15.28:0/1124627982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54bc0c06d0 0x7f54bc0a9680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009d90 tx=0x7f54b401ea40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a5f5c11abae9261 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:40.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54b9d9b640 1 -- 172.21.15.28:0/1124627982 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0aa3d0 con 0x7f54bc0c06d0 2023-12-16T03:25:40.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54b9d9b640 1 -- 172.21.15.28:0/1124627982 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b40a7a20 con 0x7f54bc0c06d0 2023-12-16T03:25:40.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.375+0000 7f54b9d9b640 1 -- 172.21.15.28:0/1124627982 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40a7db0 con 0x7f54bc0c06d0 2023-12-16T03:25:40.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 -- 172.21.15.28:0/1124627982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54bc0c06d0 msgr2=0x7f54bc0a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 --2- 172.21.15.28:0/1124627982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54bc0c06d0 0x7f54bc0a9680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009d90 tx=0x7f54b401ea40 comp rx=0 tx=0).stop 2023-12-16T03:25:40.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 -- 172.21.15.28:0/1124627982 shutdown_connections 2023-12-16T03:25:40.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 --2- 172.21.15.28:0/1124627982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54bc0c06d0 0x7f54bc0a9680 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 --2- 172.21.15.28:0/1124627982 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c4100 0x7f54bc0c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 -- 172.21.15.28:0/1124627982 >> 172.21.15.28:0/1124627982 conn(0x7f54bc06a5b0 msgr2=0x7f54bc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:40.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 -- 172.21.15.28:0/1124627982 shutdown_connections 2023-12-16T03:25:40.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 -- 172.21.15.28:0/1124627982 wait complete. 2023-12-16T03:25:40.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 Processor -- start 2023-12-16T03:25:40.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 -- start start 2023-12-16T03:25:40.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54bc0c06d0 0x7f54bc071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54bc0c4100 0x7f54bc157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c63c0 0x7f54bc150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc1586b0 con 0x7f54bc0c4100 2023-12-16T03:25:40.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0bf930 con 0x7f54bc0c06d0 2023-12-16T03:25:40.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54c0cd6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc159790 con 0x7f54bc0c63c0 2023-12-16T03:25:40.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54b3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54bc0c4100 0x7f54bc157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54ba59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54bc0c06d0 0x7f54bc071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54bad9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c63c0 0x7f54bc150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54bad9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c63c0 0x7f54bc150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:54378/0 (socket says 172.21.15.28:54378) 2023-12-16T03:25:40.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.379+0000 7f54bad9d640 1 -- 172.21.15.28:0/2432254598 learned_addr learned my addr 172.21.15.28:0/2432254598 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:40.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b3fff640 1 -- 172.21.15.28:0/2432254598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c63c0 msgr2=0x7f54bc150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b3fff640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c63c0 0x7f54bc150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b3fff640 1 -- 172.21.15.28:0/2432254598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54bc0c06d0 msgr2=0x7f54bc071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b3fff640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54bc0c06d0 0x7f54bc071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b3fff640 1 -- 172.21.15.28:0/2432254598 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b4009a70 con 0x7f54bc0c4100 2023-12-16T03:25:40.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54bad9d640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c63c0 0x7f54bc150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:40.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b3fff640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54bc0c4100 0x7f54bc157a40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54a400e840 tx=0x7f54a400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:40.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b2ffd640 1 -- 172.21.15.28:0/2432254598 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400c940 con 0x7f54bc0c4100 2023-12-16T03:25:40.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b2ffd640 1 -- 172.21.15.28:0/2432254598 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400caa0 con 0x7f54bc0c4100 2023-12-16T03:25:40.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b2ffd640 1 -- 172.21.15.28:0/2432254598 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400ce10 con 0x7f54bc0c4100 2023-12-16T03:25:40.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54c0cd6640 1 -- 172.21.15.28:0/2432254598 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc0a4e50 con 0x7f54bc0c4100 2023-12-16T03:25:40.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54c0cd6640 1 -- 172.21.15.28:0/2432254598 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc06aab0 con 0x7f54bc0c4100 2023-12-16T03:25:40.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54c0cd6640 1 -- 172.21.15.28:0/2432254598 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc068400 con 0x7f54bc0c4100 2023-12-16T03:25:40.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b2ffd640 1 -- 172.21.15.28:0/2432254598 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f54a4013470 con 0x7f54bc0c4100 2023-12-16T03:25:40.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b2ffd640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f549c066470 0x7f549c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54b2ffd640 1 -- 172.21.15.28:0/2432254598 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54a4083f30 con 0x7f54bc0c4100 2023-12-16T03:25:40.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.383+0000 7f54ba59c640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f549c066470 0x7f549c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.387+0000 7f54ba59c640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f549c066470 0x7f549c068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f54ac000f70 tx=0x7f54ac007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:40.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.387+0000 7f54b2ffd640 1 -- 172.21.15.28:0/2432254598 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f54a4051460 con 0x7f54bc0c4100 2023-12-16T03:25:40.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.547+0000 7f54c0cd6640 1 -- 172.21.15.28:0/2432254598 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54bc0c3e70 con 0x7f54bc0c4100 2023-12-16T03:25:40.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.547+0000 7f54b2ffd640 1 -- 172.21.15.28:0/2432254598 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54a4017020 con 0x7f54bc0c4100 2023-12-16T03:25:40.552 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:40.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 -- 172.21.15.28:0/2432254598 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f549c066470 msgr2=0x7f549c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f549c066470 0x7f549c068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f54ac000f70 tx=0x7f54ac007df0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 -- 172.21.15.28:0/2432254598 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54bc0c4100 msgr2=0x7f54bc157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54bc0c4100 0x7f54bc157a40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54a400e840 tx=0x7f54a400ed00 comp rx=0 tx=0).stop 2023-12-16T03:25:40.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 -- 172.21.15.28:0/2432254598 shutdown_connections 2023-12-16T03:25:40.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f54bc0c63c0 0x7f54bc150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f549c066470 0x7f549c068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54bc0c4100 0x7f54bc157a40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 --2- 172.21.15.28:0/2432254598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54bc0c06d0 0x7f54bc071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 -- 172.21.15.28:0/2432254598 >> 172.21.15.28:0/2432254598 conn(0x7f54bc06a5b0 msgr2=0x7f54bc0c22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:40.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 -- 172.21.15.28:0/2432254598 shutdown_connections 2023-12-16T03:25:40.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.551+0000 7f54c0cd6640 1 -- 172.21.15.28:0/2432254598 wait complete. 2023-12-16T03:25:40.573 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:25:40.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.715+0000 7f465f0c9640 1 Processor -- start 2023-12-16T03:25:40.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.715+0000 7f465f0c9640 1 -- start start 2023-12-16T03:25:40.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.715+0000 7f465f0c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f465806a5b0 0x7f465806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.715+0000 7f465f0c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f465806b1e0 0x7f46580c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.715+0000 7f465f0c9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4658072500 con 0x7f465806dfe0 2023-12-16T03:25:40.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.715+0000 7f465f0c9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465806ef50 con 0x7f465806b1e0 2023-12-16T03:25:40.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.715+0000 7f465f0c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46580720b0 con 0x7f465806a5b0 2023-12-16T03:25:40.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.715+0000 7f4657fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f465806dfe0 0x7f46580c2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57464/0 (socket says 172.21.15.28:57464) 2023-12-16T03:25:40.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.715+0000 7f4657fff640 1 -- 172.21.15.28:0/3332192436 learned_addr learned my addr 172.21.15.28:0/3332192436 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:40.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f465ce65640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f465806a5b0 0x7f465806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f465d666640 1 --2- 172.21.15.28:0/3332192436 >> v2:172.21.15.134:3300/0 conn(0x7f465806b1e0 0x7f46580c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553699991 0 0) 0x7f4658072500 con 0x7f465806dfe0 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4648003530 con 0x7f465806dfe0 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3147492980 0 0) 0x7f4648003530 con 0x7f465806dfe0 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f465806a5b0 msgr2=0x7f465806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f465806a5b0 0x7f465806a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 >> v2:172.21.15.134:3300/0 conn(0x7f465806b1e0 msgr2=0x7f46580c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 --2- 172.21.15.28:0/3332192436 >> v2:172.21.15.134:3300/0 conn(0x7f465806b1e0 0x7f46580c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4658070f60 con 0x7f465806dfe0 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f4644001680 con 0x7f465806dfe0 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f465d666640 1 --2- 172.21.15.28:0/3332192436 >> v2:172.21.15.134:3300/0 conn(0x7f465806b1e0 0x7f46580c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 >> v1:172.21.15.28:6789/0 conn(0x7f465806dfe0 legacy=0x7f46580c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f465806a5b0 0x7f4648003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4648003f00 0x7f46480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 0x7f4648005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465806ef50 con 0x7f4648004d10 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46580720b0 con 0x7f4648003f00 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464800b9e0 con 0x7f465806a5b0 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f465d666640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 0x7f4648005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f465ce65640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f465806a5b0 0x7f4648003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f4657fff640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4648003f00 0x7f46480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f465d666640 1 -- 172.21.15.28:0/3332192436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f465806a5b0 msgr2=0x7f4648003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f465d666640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f465806a5b0 0x7f4648003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f465d666640 1 -- 172.21.15.28:0/3332192436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4648003f00 msgr2=0x7f46480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f465d666640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4648003f00 0x7f46480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.719+0000 7f465d666640 1 -- 172.21.15.28:0/3332192436 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4648003530 con 0x7f4648004d10 2023-12-16T03:25:40.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465d666640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 0x7f4648005190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f465000e380 tx=0x7f465001ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d26f6867da6c9c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:40.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500a5e50 con 0x7f4648004d10 2023-12-16T03:25:40.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465000f040 con 0x7f4648004d10 2023-12-16T03:25:40.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f46577fe640 1 -- 172.21.15.28:0/3332192436 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500ad640 con 0x7f4648004d10 2023-12-16T03:25:40.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 -- 172.21.15.28:0/3332192436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 msgr2=0x7f4648005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 --2- 172.21.15.28:0/3332192436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 0x7f4648005190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f465000e380 tx=0x7f465001ce40 comp rx=0 tx=0).stop 2023-12-16T03:25:40.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465d666640 1 -- 172.21.15.28:0/3332192436 reap_dead start 2023-12-16T03:25:40.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 -- 172.21.15.28:0/3332192436 shutdown_connections 2023-12-16T03:25:40.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 -- 172.21.15.28:0/3332192436 >> 172.21.15.28:0/3332192436 conn(0x7f46580c6ef0 msgr2=0x7f46580c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:40.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 -- 172.21.15.28:0/3332192436 shutdown_connections 2023-12-16T03:25:40.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 -- 172.21.15.28:0/3332192436 wait complete. 2023-12-16T03:25:40.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 Processor -- start 2023-12-16T03:25:40.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 -- start start 2023-12-16T03:25:40.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 0x7f4658156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4658145310 0x7f46580c2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4658144800 0x7f4658144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4658156690 con 0x7f4648004d10 2023-12-16T03:25:40.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4658155830 con 0x7f4658144800 2023-12-16T03:25:40.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.723+0000 7f465f0c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46581e9cb0 con 0x7f4658145310 2023-12-16T03:25:40.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465ce65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 0x7f4658156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465ce65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 0x7f4658156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34542/0 (socket says 172.21.15.28:34542) 2023-12-16T03:25:40.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465ce65640 1 -- 172.21.15.28:0/4097343170 learned_addr learned my addr 172.21.15.28:0/4097343170 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:40.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f4657fff640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4658145310 0x7f46580c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465d666640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4658144800 0x7f4658144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465ce65640 1 -- 172.21.15.28:0/4097343170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4658145310 msgr2=0x7f46580c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465ce65640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4658145310 0x7f46580c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465ce65640 1 -- 172.21.15.28:0/4097343170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4658144800 msgr2=0x7f4658144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465ce65640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4658144800 0x7f4658144c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465ce65640 1 -- 172.21.15.28:0/4097343170 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46581e9f50 con 0x7f4648004d10 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465ce65640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 0x7f4658156150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f464c0119d0 tx=0x7f464c011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f46557fa640 1 -- 172.21.15.28:0/4097343170 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c00faf0 con 0x7f4648004d10 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f46557fa640 1 -- 172.21.15.28:0/4097343170 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c00fc50 con 0x7f4648004d10 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465f0c9640 1 -- 172.21.15.28:0/4097343170 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46581ea230 con 0x7f4648004d10 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f46557fa640 1 -- 172.21.15.28:0/4097343170 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c014440 con 0x7f4648004d10 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465f0c9640 1 -- 172.21.15.28:0/4097343170 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46581568c0 con 0x7f4648004d10 2023-12-16T03:25:40.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f465f0c9640 1 -- 172.21.15.28:0/4097343170 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4658068400 con 0x7f4648004d10 2023-12-16T03:25:40.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f46557fa640 1 -- 172.21.15.28:0/4097343170 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f464c01d400 con 0x7f4648004d10 2023-12-16T03:25:40.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.727+0000 7f46557fa640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f463c0664a0 0x7f463c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:40.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.731+0000 7f46557fa640 1 -- 172.21.15.28:0/4097343170 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f464c0845f0 con 0x7f4648004d10 2023-12-16T03:25:40.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.731+0000 7f4657fff640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f463c0664a0 0x7f463c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:40.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.731+0000 7f4657fff640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f463c0664a0 0x7f463c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4658148a30 tx=0x7f4644007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:40.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.735+0000 7f46557fa640 1 -- 172.21.15.28:0/4097343170 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f464c051b20 con 0x7f4648004d10 2023-12-16T03:25:40.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.891+0000 7f465f0c9640 1 -- 172.21.15.28:0/4097343170 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46580c7cb0 con 0x7f4648004d10 2023-12-16T03:25:40.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.891+0000 7f46557fa640 1 -- 172.21.15.28:0/4097343170 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f464c055140 con 0x7f4648004d10 2023-12-16T03:25:40.896 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:25:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 -- 172.21.15.28:0/4097343170 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f463c0664a0 msgr2=0x7f463c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f463c0664a0 0x7f463c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4658148a30 tx=0x7f4644007900 comp rx=0 tx=0).stop 2023-12-16T03:25:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 -- 172.21.15.28:0/4097343170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 msgr2=0x7f4658156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 0x7f4658156150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f464c0119d0 tx=0x7f464c011dd0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 -- 172.21.15.28:0/4097343170 shutdown_connections 2023-12-16T03:25:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4658144800 0x7f4658144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4658145310 0x7f46580c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f463c0664a0 0x7f463c068960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 --2- 172.21.15.28:0/4097343170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4648004d10 0x7f4658156150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 -- 172.21.15.28:0/4097343170 >> 172.21.15.28:0/4097343170 conn(0x7f46580c6ef0 msgr2=0x7f46580c1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 -- 172.21.15.28:0/4097343170 shutdown_connections 2023-12-16T03:25:40.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:40.895+0000 7f465f0c9640 1 -- 172.21.15.28:0/4097343170 wait complete. 2023-12-16T03:25:40.917 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:25:41.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.059+0000 7f6bd7bdf640 1 Processor -- start 2023-12-16T03:25:41.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.059+0000 7f6bd7bdf640 1 -- start start 2023-12-16T03:25:41.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.059+0000 7f6bd7bdf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 0x7f6bd006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.059+0000 7f6bd7bdf640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6bd01577f0 0x7f6bd0157c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.059+0000 7f6bd7bdf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd00c1db0 con 0x7f6bd00c64d0 2023-12-16T03:25:41.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.059+0000 7f6bd7bdf640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd00c2090 con 0x7f6bd01577f0 2023-12-16T03:25:41.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.059+0000 7f6bd7bdf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00c5cd0 con 0x7f6bd0157410 2023-12-16T03:25:41.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd617c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6bd01577f0 0x7f6bd0157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd617c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6bd01577f0 0x7f6bd0157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34548/0 (socket says 172.21.15.28:34548) 2023-12-16T03:25:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd617c640 1 -- 172.21.15.28:0/523384012 learned_addr learned my addr 172.21.15.28:0/523384012 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd597b640 1 --2- 172.21.15.28:0/523384012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 0x7f6bd006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd617c640 1 -- 172.21.15.28:0/523384012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 msgr2=0x7f6bd006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd617c640 1 --2- 172.21.15.28:0/523384012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 0x7f6bd006fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd617c640 1 -- 172.21.15.28:0/523384012 >> v1:172.21.15.134:6789/0 conn(0x7f6bd00c64d0 legacy=0x7f6bd00c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd617c640 1 -- 172.21.15.28:0/523384012 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd00c5fb0 con 0x7f6bd01577f0 2023-12-16T03:25:41.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd597b640 1 --2- 172.21.15.28:0/523384012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 0x7f6bd006fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:41.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd617c640 1 --2- 172.21.15.28:0/523384012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bd01577f0 0x7f6bd0157c20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009e50 tx=0x7f6bc801c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba56534a09ac4ed server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:41.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd4979640 1 -- 172.21.15.28:0/523384012 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80a5520 con 0x7f6bd01577f0 2023-12-16T03:25:41.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd4979640 1 -- 172.21.15.28:0/523384012 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc80a5680 con 0x7f6bd01577f0 2023-12-16T03:25:41.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.063+0000 7f6bd4979640 1 -- 172.21.15.28:0/523384012 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80a5a10 con 0x7f6bd01577f0 2023-12-16T03:25:41.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/523384012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bd01577f0 msgr2=0x7f6bd0157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 --2- 172.21.15.28:0/523384012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bd01577f0 0x7f6bd0157c20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009e50 tx=0x7f6bc801c750 comp rx=0 tx=0).stop 2023-12-16T03:25:41.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/523384012 shutdown_connections 2023-12-16T03:25:41.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 --2- 172.21.15.28:0/523384012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bd01577f0 0x7f6bd0157c20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 --2- 172.21.15.28:0/523384012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 0x7f6bd006fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/523384012 >> 172.21.15.28:0/523384012 conn(0x7f6bd00a9b80 msgr2=0x7f6bd00a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:41.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/523384012 shutdown_connections 2023-12-16T03:25:41.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/523384012 wait complete. 2023-12-16T03:25:41.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 Processor -- start 2023-12-16T03:25:41.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 -- start start 2023-12-16T03:25:41.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bd00c64d0 0x7f6bd0152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 0x7f6bd0152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bd01577f0 0x7f6bd014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd0153110 con 0x7f6bd01577f0 2023-12-16T03:25:41.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00ace00 con 0x7f6bd00c64d0 2023-12-16T03:25:41.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd7bdf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00ac860 con 0x7f6bd0157410 2023-12-16T03:25:41.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd617c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bd01577f0 0x7f6bd014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd617c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bd01577f0 0x7f6bd014a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34564/0 (socket says 172.21.15.28:34564) 2023-12-16T03:25:41.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd617c640 1 -- 172.21.15.28:0/2616797394 learned_addr learned my addr 172.21.15.28:0/2616797394 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:41.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd597b640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bd00c64d0 0x7f6bd0152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd517a640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 0x7f6bd0152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd617c640 1 -- 172.21.15.28:0/2616797394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 msgr2=0x7f6bd0152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd617c640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 0x7f6bd0152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd617c640 1 -- 172.21.15.28:0/2616797394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bd00c64d0 msgr2=0x7f6bd0152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd617c640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bd00c64d0 0x7f6bd0152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd617c640 1 -- 172.21.15.28:0/2616797394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc8009b30 con 0x7f6bd01577f0 2023-12-16T03:25:41.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.067+0000 7f6bd517a640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 0x7f6bd0152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:41.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.071+0000 7f6bd617c640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bd01577f0 0x7f6bd014a050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6bc801a380 tx=0x7f6bc80194f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:41.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.071+0000 7f6bc67fc640 1 -- 172.21.15.28:0/2616797394 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80a5520 con 0x7f6bd01577f0 2023-12-16T03:25:41.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.071+0000 7f6bc67fc640 1 -- 172.21.15.28:0/2616797394 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc80b8670 con 0x7f6bd01577f0 2023-12-16T03:25:41.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.071+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/2616797394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd01ed8c0 con 0x7f6bd01577f0 2023-12-16T03:25:41.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.071+0000 7f6bc67fc640 1 -- 172.21.15.28:0/2616797394 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80b89e0 con 0x7f6bd01577f0 2023-12-16T03:25:41.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.071+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/2616797394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd0152170 con 0x7f6bd01577f0 2023-12-16T03:25:41.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.071+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/2616797394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd0152360 con 0x7f6bd01577f0 2023-12-16T03:25:41.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.071+0000 7f6bc67fc640 1 -- 172.21.15.28:0/2616797394 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6bc80b8b40 con 0x7f6bd01577f0 2023-12-16T03:25:41.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.071+0000 7f6bc67fc640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bb40664a0 0x7f6bb4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.071+0000 7f6bc67fc640 1 -- 172.21.15.28:0/2616797394 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bc811f120 con 0x7f6bd01577f0 2023-12-16T03:25:41.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.071+0000 7f6bd597b640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bb40664a0 0x7f6bb4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.075+0000 7f6bd597b640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bb40664a0 0x7f6bb4068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0098b0 tx=0x7f6bcc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:41.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.075+0000 7f6bc67fc640 1 -- 172.21.15.28:0/2616797394 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6bc80ec590 con 0x7f6bd01577f0 2023-12-16T03:25:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/2616797394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6bd0068400 con 0x7f6bd01577f0 2023-12-16T03:25:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bc67fc640 1 -- 172.21.15.28:0/2616797394 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6bc8009510 con 0x7f6bd01577f0 2023-12-16T03:25:41.239 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/2616797394 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bb40664a0 msgr2=0x7f6bb4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bd7bdf640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bb40664a0 0x7f6bb4068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0098b0 tx=0x7f6bcc008040 comp rx=0 tx=0).stop 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/2616797394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bd01577f0 msgr2=0x7f6bd014a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bd7bdf640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bd01577f0 0x7f6bd014a050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6bc801a380 tx=0x7f6bc80194f0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/2616797394 shutdown_connections 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bd7bdf640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bb40664a0 0x7f6bb4068960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bd7bdf640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bd01577f0 0x7f6bd014a050 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bd7bdf640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bd0157410 0x7f6bd0152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bd7bdf640 1 --2- 172.21.15.28:0/2616797394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bd00c64d0 0x7f6bd0152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.235+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/2616797394 >> 172.21.15.28:0/2616797394 conn(0x7f6bd00a9b80 msgr2=0x7f6bd00c7380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.239+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/2616797394 shutdown_connections 2023-12-16T03:25:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.239+0000 7f6bd7bdf640 1 -- 172.21.15.28:0/2616797394 wait complete. 2023-12-16T03:25:41.272 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-16T03:25:41.272 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:41.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.411+0000 7f8d354fe640 1 Processor -- start 2023-12-16T03:25:41.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.411+0000 7f8d354fe640 1 -- start start 2023-12-16T03:25:41.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.411+0000 7f8d354fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8d301578f0 0x7f8d300c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.411+0000 7f8d354fe640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d30157cd0 con 0x7f8d300a6c60 2023-12-16T03:25:41.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.411+0000 7f8d354fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d30158850 con 0x7f8d300c2840 2023-12-16T03:25:41.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.411+0000 7f8d354fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d300c2e00 con 0x7f8d301578f0 2023-12-16T03:25:41.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.411+0000 7f8d267fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8d300a6c60 0x7f8d300c1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57480/0 (socket says 172.21.15.28:57480) 2023-12-16T03:25:41.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.411+0000 7f8d267fc640 1 -- 172.21.15.28:0/1986227772 learned_addr learned my addr 172.21.15.28:0/1986227772 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:41.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.411+0000 7f8d2effd640 1 --2- 172.21.15.28:0/1986227772 >> v2:172.21.15.134:3300/0 conn(0x7f8d301578f0 0x7f8d300c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.415+0000 7f8d2e7fc640 1 -- 172.21.15.28:0/1986227772 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468889005 0 0) 0x7f8d30157cd0 con 0x7f8d300a6c60 2023-12-16T03:25:41.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.415+0000 7f8d2e7fc640 1 -- 172.21.15.28:0/1986227772 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d1c003530 con 0x7f8d300a6c60 2023-12-16T03:25:41.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.415+0000 7f8d2e7fc640 1 -- 172.21.15.28:0/1986227772 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240105866 0 0) 0x7f8d30158850 con 0x7f8d300c2840 2023-12-16T03:25:41.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.415+0000 7f8d2e7fc640 1 -- 172.21.15.28:0/1986227772 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d30157cd0 con 0x7f8d300c2840 2023-12-16T03:25:41.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.415+0000 7f8d2effd640 1 -- 172.21.15.28:0/1986227772 >> v1:172.21.15.134:6789/0 conn(0x7f8d300c2840 legacy=0x7f8d3015f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.415+0000 7f8d2effd640 1 -- 172.21.15.28:0/1986227772 >> v1:172.21.15.28:6789/0 conn(0x7f8d300a6c60 legacy=0x7f8d300c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.415+0000 7f8d2effd640 1 -- 172.21.15.28:0/1986227772 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d30157f20 con 0x7f8d301578f0 2023-12-16T03:25:41.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.415+0000 7f8d2effd640 1 --2- 172.21.15.28:0/1986227772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d301578f0 0x7f8d300c30e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009d90 tx=0x7f8d2001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebe3c869bf6a327 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:41.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.415+0000 7f8d2e7fc640 1 -- 172.21.15.28:0/1986227772 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d200a5780 con 0x7f8d301578f0 2023-12-16T03:25:41.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.415+0000 7f8d2e7fc640 1 -- 172.21.15.28:0/1986227772 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d200a58e0 con 0x7f8d301578f0 2023-12-16T03:25:41.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.415+0000 7f8d2e7fc640 1 -- 172.21.15.28:0/1986227772 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d200a5c50 con 0x7f8d301578f0 2023-12-16T03:25:41.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 -- 172.21.15.28:0/1986227772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d301578f0 msgr2=0x7f8d300c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 --2- 172.21.15.28:0/1986227772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d301578f0 0x7f8d300c30e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009d90 tx=0x7f8d2001c8c0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 -- 172.21.15.28:0/1986227772 shutdown_connections 2023-12-16T03:25:41.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 --2- 172.21.15.28:0/1986227772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d301578f0 0x7f8d300c30e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 -- 172.21.15.28:0/1986227772 >> 172.21.15.28:0/1986227772 conn(0x7f8d300c7e40 msgr2=0x7f8d300c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:41.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 -- 172.21.15.28:0/1986227772 shutdown_connections 2023-12-16T03:25:41.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 -- 172.21.15.28:0/1986227772 wait complete. 2023-12-16T03:25:41.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 Processor -- start 2023-12-16T03:25:41.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 -- start start 2023-12-16T03:25:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d300a6c60 0x7f8d30144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d300c2840 0x7f8d301450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d301578f0 0x7f8d300ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d301455f0 con 0x7f8d301578f0 2023-12-16T03:25:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3014c620 con 0x7f8d300c2840 2023-12-16T03:25:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d354fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d301ee140 con 0x7f8d300a6c60 2023-12-16T03:25:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d301578f0 0x7f8d300ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d301578f0 0x7f8d300ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34568/0 (socket says 172.21.15.28:34568) 2023-12-16T03:25:41.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d2f7fe640 1 -- 172.21.15.28:0/222419942 learned_addr learned my addr 172.21.15.28:0/222419942 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:41.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d2effd640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d300a6c60 0x7f8d30144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d267fc640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d300c2840 0x7f8d301450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d2f7fe640 1 -- 172.21.15.28:0/222419942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d300a6c60 msgr2=0x7f8d30144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d2f7fe640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d300a6c60 0x7f8d30144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d2f7fe640 1 -- 172.21.15.28:0/222419942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d300c2840 msgr2=0x7f8d301450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d2f7fe640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d300c2840 0x7f8d301450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.419+0000 7f8d2f7fe640 1 -- 172.21.15.28:0/222419942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20009a70 con 0x7f8d301578f0 2023-12-16T03:25:41.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.423+0000 7f8d2f7fe640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d301578f0 0x7f8d300ac6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800c410 tx=0x7f8d2800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:41.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.423+0000 7f8d27fff640 1 -- 172.21.15.28:0/222419942 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d280052d0 con 0x7f8d301578f0 2023-12-16T03:25:41.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.423+0000 7f8d27fff640 1 -- 172.21.15.28:0/222419942 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d28005430 con 0x7f8d301578f0 2023-12-16T03:25:41.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.423+0000 7f8d354fe640 1 -- 172.21.15.28:0/222419942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3014c8c0 con 0x7f8d301578f0 2023-12-16T03:25:41.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.423+0000 7f8d27fff640 1 -- 172.21.15.28:0/222419942 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d28003800 con 0x7f8d301578f0 2023-12-16T03:25:41.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.423+0000 7f8d354fe640 1 -- 172.21.15.28:0/222419942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d300aae70 con 0x7f8d301578f0 2023-12-16T03:25:41.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.423+0000 7f8d354fe640 1 -- 172.21.15.28:0/222419942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d300c7c10 con 0x7f8d301578f0 2023-12-16T03:25:41.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.423+0000 7f8d27fff640 1 -- 172.21.15.28:0/222419942 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8d28003960 con 0x7f8d301578f0 2023-12-16T03:25:41.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.423+0000 7f8d27fff640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d100664a0 0x7f8d10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.423+0000 7f8d27fff640 1 -- 172.21.15.28:0/222419942 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d280832f0 con 0x7f8d301578f0 2023-12-16T03:25:41.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.423+0000 7f8d2effd640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d100664a0 0x7f8d10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.427+0000 7f8d2effd640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d100664a0 0x7f8d10068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d200af000 tx=0x7f8d200a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:41.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.427+0000 7f8d27fff640 1 -- 172.21.15.28:0/222419942 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8d28050820 con 0x7f8d301578f0 2023-12-16T03:25:41.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.587+0000 7f8d354fe640 1 -- 172.21.15.28:0/222419942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d3014cab0 con 0x7f8d301578f0 2023-12-16T03:25:41.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.587+0000 7f8d27fff640 1 -- 172.21.15.28:0/222419942 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f8d28053e40 con 0x7f8d301578f0 2023-12-16T03:25:41.592 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:41.592 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:41.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 -- 172.21.15.28:0/222419942 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d100664a0 msgr2=0x7f8d10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d100664a0 0x7f8d10068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d200af000 tx=0x7f8d200a7070 comp rx=0 tx=0).stop 2023-12-16T03:25:41.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 -- 172.21.15.28:0/222419942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d301578f0 msgr2=0x7f8d300ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d301578f0 0x7f8d300ac6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800c410 tx=0x7f8d2800c8d0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 -- 172.21.15.28:0/222419942 shutdown_connections 2023-12-16T03:25:41.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d100664a0 0x7f8d10068960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d301578f0 0x7f8d300ac6e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d300c2840 0x7f8d301450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 --2- 172.21.15.28:0/222419942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d300a6c60 0x7f8d30144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 -- 172.21.15.28:0/222419942 >> 172.21.15.28:0/222419942 conn(0x7f8d300c7e40 msgr2=0x7f8d30156aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:41.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 -- 172.21.15.28:0/222419942 shutdown_connections 2023-12-16T03:25:41.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.591+0000 7f8d354fe640 1 -- 172.21.15.28:0/222419942 wait complete. 2023-12-16T03:25:41.614 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:25:13.885447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:25:14.309086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:41.614 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:41.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fcebe98d640 1 Processor -- start 2023-12-16T03:25:41.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fcebe98d640 1 -- start start 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fcebe98d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fceb80c5640 0x7fceb80c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fcebe98d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceb80c60f0 0x7fceb8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fcebe98d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb80c2580 con 0x7fceb80c5260 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fcebe98d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb8153510 con 0x7fceb80c5640 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fcebe98d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80c17f0 con 0x7fceb80c60f0 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fceb77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fceb80c5640 0x7fceb80c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fceb77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fceb80c5640 0x7fceb80c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34584/0 (socket says 172.21.15.28:34584) 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fceb77fe640 1 -- 172.21.15.28:0/3103446102 learned_addr learned my addr 172.21.15.28:0/3103446102 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fcebcf2a640 1 --2- 172.21.15.28:0/3103446102 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceb80c60f0 0x7fceb8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fceb77fe640 1 -- 172.21.15.28:0/3103446102 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceb80c60f0 msgr2=0x7fceb8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fceb77fe640 1 --2- 172.21.15.28:0/3103446102 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceb80c60f0 0x7fceb8155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fceb77fe640 1 -- 172.21.15.28:0/3103446102 >> v1:172.21.15.134:6789/0 conn(0x7fceb80c5260 legacy=0x7fceb806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:41.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fceb77fe640 1 -- 172.21.15.28:0/3103446102 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb80c1a00 con 0x7fceb80c5640 2023-12-16T03:25:41.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.759+0000 7fcebcf2a640 1 --2- 172.21.15.28:0/3103446102 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceb80c60f0 0x7fceb8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:41.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fceb77fe640 1 --2- 172.21.15.28:0/3103446102 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fceb80c5640 0x7fceb80c5bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fceb80c1930 tx=0x7fceac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0c562229a5a382 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:41.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fceb6ffd640 1 -- 172.21.15.28:0/3103446102 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0ab600 con 0x7fceb80c5640 2023-12-16T03:25:41.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fceb6ffd640 1 -- 172.21.15.28:0/3103446102 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac0a7050 con 0x7fceb80c5640 2023-12-16T03:25:41.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fceb6ffd640 1 -- 172.21.15.28:0/3103446102 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0ab980 con 0x7fceb80c5640 2023-12-16T03:25:41.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fcebe98d640 1 -- 172.21.15.28:0/3103446102 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fceb80c5640 msgr2=0x7fceb80c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fcebe98d640 1 --2- 172.21.15.28:0/3103446102 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fceb80c5640 0x7fceb80c5bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fceb80c1930 tx=0x7fceac01c460 comp rx=0 tx=0).stop 2023-12-16T03:25:41.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fcebe98d640 1 -- 172.21.15.28:0/3103446102 shutdown_connections 2023-12-16T03:25:41.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fcebe98d640 1 --2- 172.21.15.28:0/3103446102 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceb80c60f0 0x7fceb8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fcebe98d640 1 --2- 172.21.15.28:0/3103446102 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fceb80c5640 0x7fceb80c5bb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fcebe98d640 1 -- 172.21.15.28:0/3103446102 >> 172.21.15.28:0/3103446102 conn(0x7fceb806a5b0 msgr2=0x7fceb806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:41.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fcebe98d640 1 -- 172.21.15.28:0/3103446102 shutdown_connections 2023-12-16T03:25:41.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fcebe98d640 1 -- 172.21.15.28:0/3103446102 wait complete. 2023-12-16T03:25:41.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.763+0000 7fcebe98d640 1 Processor -- start 2023-12-16T03:25:41.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fcebe98d640 1 -- start start 2023-12-16T03:25:41.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fcebe98d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceb80c5260 0x7fceb81f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fcebe98d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fceb80c5640 0x7fceb8070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fcebe98d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fceb80c60f0 0x7fceb814ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fcebe98d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8071740 con 0x7fceb80c5640 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fcebe98d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb81f0df0 con 0x7fceb80c60f0 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fcebe98d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb815c840 con 0x7fceb80c5260 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fceb80c5640 0x7fceb8070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fceb80c5640 0x7fceb8070d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34588/0 (socket says 172.21.15.28:34588) 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb77fe640 1 -- 172.21.15.28:0/1084417855 learned_addr learned my addr 172.21.15.28:0/1084417855 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fcebcf2a640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fceb80c60f0 0x7fceb814ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb7fff640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceb80c5260 0x7fceb81f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb77fe640 1 -- 172.21.15.28:0/1084417855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceb80c5260 msgr2=0x7fceb81f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb77fe640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceb80c5260 0x7fceb81f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb77fe640 1 -- 172.21.15.28:0/1084417855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fceb80c60f0 msgr2=0x7fceb814ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb77fe640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fceb80c60f0 0x7fceb814ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb77fe640 1 -- 172.21.15.28:0/1084417855 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0094d0 con 0x7fceb80c5640 2023-12-16T03:25:41.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb77fe640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fceb80c5640 0x7fceb8070d00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fceac01a090 tx=0x7fceac019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:41.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb4ff9640 1 -- 172.21.15.28:0/1084417855 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0b37d0 con 0x7fceb80c5640 2023-12-16T03:25:41.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb4ff9640 1 -- 172.21.15.28:0/1084417855 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac0b3930 con 0x7fceb80c5640 2023-12-16T03:25:41.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fceb4ff9640 1 -- 172.21.15.28:0/1084417855 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0b3ce0 con 0x7fceb80c5640 2023-12-16T03:25:41.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fcebe98d640 1 -- 172.21.15.28:0/1084417855 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb81f07a0 con 0x7fceb80c5640 2023-12-16T03:25:41.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fcebe98d640 1 -- 172.21.15.28:0/1084417855 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb814f4b0 con 0x7fceb80c5640 2023-12-16T03:25:41.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.767+0000 7fcebe98d640 1 -- 172.21.15.28:0/1084417855 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb8068400 con 0x7fceb80c5640 2023-12-16T03:25:41.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.771+0000 7fceb4ff9640 1 -- 172.21.15.28:0/1084417855 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fceac0b2070 con 0x7fceb80c5640 2023-12-16T03:25:41.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.771+0000 7fceb4ff9640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcea4066470 0x7fcea4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:41.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.771+0000 7fceb4ff9640 1 -- 172.21.15.28:0/1084417855 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fceac11e1e0 con 0x7fceb80c5640 2023-12-16T03:25:41.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.771+0000 7fceb7fff640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcea4066470 0x7fcea4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:41.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.771+0000 7fceb7fff640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcea4066470 0x7fcea4068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fceb81eafd0 tx=0x7fcea8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:41.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.775+0000 7fceb4ff9640 1 -- 172.21.15.28:0/1084417855 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fceac0eb650 con 0x7fceb80c5640 2023-12-16T03:25:41.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 -- 172.21.15.28:0/1084417855 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fceb806d390 con 0x7fceb80c5640 2023-12-16T03:25:41.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fceb4ff9640 1 -- 172.21.15.28:0/1084417855 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fceac0eec70 con 0x7fceb80c5640 2023-12-16T03:25:41.938 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:41.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 -- 172.21.15.28:0/1084417855 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcea4066470 msgr2=0x7fcea4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcea4066470 0x7fcea4068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fceb81eafd0 tx=0x7fcea8009040 comp rx=0 tx=0).stop 2023-12-16T03:25:41.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 -- 172.21.15.28:0/1084417855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fceb80c5640 msgr2=0x7fceb8070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:41.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fceb80c5640 0x7fceb8070d00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fceac01a090 tx=0x7fceac019200 comp rx=0 tx=0).stop 2023-12-16T03:25:41.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 -- 172.21.15.28:0/1084417855 shutdown_connections 2023-12-16T03:25:41.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fceb80c60f0 0x7fceb814ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcea4066470 0x7fcea4068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fceb80c5640 0x7fceb8070d00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 --2- 172.21.15.28:0/1084417855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceb80c5260 0x7fceb81f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:41.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 -- 172.21.15.28:0/1084417855 >> 172.21.15.28:0/1084417855 conn(0x7fceb806a5b0 msgr2=0x7fceb80c2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:41.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 -- 172.21.15.28:0/1084417855 shutdown_connections 2023-12-16T03:25:41.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:41.935+0000 7fcebe98d640 1 -- 172.21.15.28:0/1084417855 wait complete. 2023-12-16T03:25:41.959 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:25:42.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafab7c4640 1 Processor -- start 2023-12-16T03:25:42.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafab7c4640 1 -- start start 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafab7c4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafa40725c0 0x7fafa40a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafab7c4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fafa40c3bd0 0x7fafa40c4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafab7c4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa40c2760 con 0x7fafa4072090 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafab7c4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa40c3070 con 0x7fafa40c3bd0 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafab7c4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40c63e0 con 0x7fafa40725c0 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafa9d61640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fafa40c3bd0 0x7fafa40c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafa9d61640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fafa40c3bd0 0x7fafa40c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34590/0 (socket says 172.21.15.28:34590) 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafa9d61640 1 -- 172.21.15.28:0/2536276970 learned_addr learned my addr 172.21.15.28:0/2536276970 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafa8d5f640 1 --2- 172.21.15.28:0/2536276970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafa40725c0 0x7fafa40a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafa9d61640 1 -- 172.21.15.28:0/2536276970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafa40725c0 msgr2=0x7fafa40a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafa9d61640 1 --2- 172.21.15.28:0/2536276970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafa40725c0 0x7fafa40a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafa9d61640 1 -- 172.21.15.28:0/2536276970 >> v1:172.21.15.134:6789/0 conn(0x7fafa4072090 legacy=0x7fafa40c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.103+0000 7fafa9d61640 1 -- 172.21.15.28:0/2536276970 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40aad20 con 0x7fafa40c3bd0 2023-12-16T03:25:42.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7fafa9d61640 1 --2- 172.21.15.28:0/2536276970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafa40c3bd0 0x7fafa40c4060 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009e80 tx=0x7faf9c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d84d7ec02f1e3e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:42.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7faf9bfff640 1 -- 172.21.15.28:0/2536276970 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0a57b0 con 0x7fafa40c3bd0 2023-12-16T03:25:42.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7faf9bfff640 1 -- 172.21.15.28:0/2536276970 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c0a5910 con 0x7fafa40c3bd0 2023-12-16T03:25:42.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7faf9bfff640 1 -- 172.21.15.28:0/2536276970 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0a5ca0 con 0x7fafa40c3bd0 2023-12-16T03:25:42.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7fafab7c4640 1 -- 172.21.15.28:0/2536276970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafa40c3bd0 msgr2=0x7fafa40c4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7fafab7c4640 1 --2- 172.21.15.28:0/2536276970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafa40c3bd0 0x7fafa40c4060 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009e80 tx=0x7faf9c01c8d0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7fafab7c4640 1 -- 172.21.15.28:0/2536276970 shutdown_connections 2023-12-16T03:25:42.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7fafab7c4640 1 --2- 172.21.15.28:0/2536276970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafa40725c0 0x7fafa40a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7fafab7c4640 1 --2- 172.21.15.28:0/2536276970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafa40c3bd0 0x7fafa40c4060 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7fafab7c4640 1 -- 172.21.15.28:0/2536276970 >> 172.21.15.28:0/2536276970 conn(0x7fafa406a5b0 msgr2=0x7fafa406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:42.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7fafab7c4640 1 -- 172.21.15.28:0/2536276970 shutdown_connections 2023-12-16T03:25:42.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7fafab7c4640 1 -- 172.21.15.28:0/2536276970 wait complete. 2023-12-16T03:25:42.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.107+0000 7fafab7c4640 1 Processor -- start 2023-12-16T03:25:42.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafab7c4640 1 -- start start 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafab7c4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafa4072090 0x7fafa414e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafab7c4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafa40725c0 0x7fafa4146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafab7c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa40c3bd0 0x7fafa4147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafab7c4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa41483b0 con 0x7fafa4072090 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafab7c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4071770 con 0x7fafa40c3bd0 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafab7c4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4071a50 con 0x7fafa40725c0 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafa9560640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafa4072090 0x7fafa414e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafa9560640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafa4072090 0x7fafa414e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34602/0 (socket says 172.21.15.28:34602) 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafa9560640 1 -- 172.21.15.28:0/3195323050 learned_addr learned my addr 172.21.15.28:0/3195323050 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafa8d5f640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafa40725c0 0x7fafa4146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafa9d61640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa40c3bd0 0x7fafa4147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafa9560640 1 -- 172.21.15.28:0/3195323050 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafa40725c0 msgr2=0x7fafa4146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafa9560640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafa40725c0 0x7fafa4146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafa9560640 1 -- 172.21.15.28:0/3195323050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa40c3bd0 msgr2=0x7fafa4147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafa9560640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa40c3bd0 0x7fafa4147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafa9560640 1 -- 172.21.15.28:0/3195323050 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c009b30 con 0x7fafa4072090 2023-12-16T03:25:42.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafa9560640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafa4072090 0x7fafa414e040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c500 tx=0x7fafa000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:42.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7faf99ffb640 1 -- 172.21.15.28:0/3195323050 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0005220 con 0x7fafa4072090 2023-12-16T03:25:42.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7faf99ffb640 1 -- 172.21.15.28:0/3195323050 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0005380 con 0x7fafa4072090 2023-12-16T03:25:42.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7faf99ffb640 1 -- 172.21.15.28:0/3195323050 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0007270 con 0x7fafa4072090 2023-12-16T03:25:42.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafab7c4640 1 -- 172.21.15.28:0/3195323050 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa41478d0 con 0x7fafa4072090 2023-12-16T03:25:42.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafab7c4640 1 -- 172.21.15.28:0/3195323050 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa4147e90 con 0x7fafa4072090 2023-12-16T03:25:42.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.111+0000 7fafab7c4640 1 -- 172.21.15.28:0/3195323050 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa41480b0 con 0x7fafa4072090 2023-12-16T03:25:42.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.115+0000 7faf99ffb640 1 -- 172.21.15.28:0/3195323050 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fafa00073d0 con 0x7fafa4072090 2023-12-16T03:25:42.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.115+0000 7faf99ffb640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf88066470 0x7faf88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.115+0000 7faf99ffb640 1 -- 172.21.15.28:0/3195323050 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafa0083720 con 0x7fafa4072090 2023-12-16T03:25:42.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.115+0000 7fafa8d5f640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf88066470 0x7faf88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.115+0000 7fafa8d5f640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf88066470 0x7faf88068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fafa40c5a00 tx=0x7faf94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:42.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.119+0000 7faf99ffb640 1 -- 172.21.15.28:0/3195323050 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fafa0050bc0 con 0x7fafa4072090 2023-12-16T03:25:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 -- 172.21.15.28:0/3195323050 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafa4068400 con 0x7fafa4072090 2023-12-16T03:25:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7faf99ffb640 1 -- 172.21.15.28:0/3195323050 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafa00541e0 con 0x7fafa4072090 2023-12-16T03:25:42.278 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:25:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 -- 172.21.15.28:0/3195323050 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf88066470 msgr2=0x7faf88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf88066470 0x7faf88068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fafa40c5a00 tx=0x7faf94008040 comp rx=0 tx=0).stop 2023-12-16T03:25:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 -- 172.21.15.28:0/3195323050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafa4072090 msgr2=0x7fafa414e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafa4072090 0x7fafa414e040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c500 tx=0x7fafa000c9c0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 -- 172.21.15.28:0/3195323050 shutdown_connections 2023-12-16T03:25:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa40c3bd0 0x7fafa4147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafa40725c0 0x7fafa4146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf88066470 0x7faf88068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 --2- 172.21.15.28:0/3195323050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafa4072090 0x7fafa414e040 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 -- 172.21.15.28:0/3195323050 >> 172.21.15.28:0/3195323050 conn(0x7fafa406a5b0 msgr2=0x7fafa40bf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 -- 172.21.15.28:0/3195323050 shutdown_connections 2023-12-16T03:25:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.275+0000 7fafab7c4640 1 -- 172.21.15.28:0/3195323050 wait complete. 2023-12-16T03:25:42.299 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:25:42.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84fab57640 1 Processor -- start 2023-12-16T03:25:42.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84fab57640 1 -- start start 2023-12-16T03:25:42.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84fab57640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f84f40725c0 0x7f84f41516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84fab57640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f40c2760 con 0x7f84f40a5370 2023-12-16T03:25:42.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84fab57640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f40a5750 con 0x7f84f4072090 2023-12-16T03:25:42.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84fab57640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f40c3070 con 0x7f84f40725c0 2023-12-16T03:25:42.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84f90f4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f84f40725c0 0x7f84f41516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84f88f3640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f84f40a5370 0x7f84f40c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57492/0 (socket says 172.21.15.28:57492) 2023-12-16T03:25:42.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84f88f3640 1 -- 172.21.15.28:0/531496653 learned_addr learned my addr 172.21.15.28:0/531496653 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:42.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84f90f4640 1 -- 172.21.15.28:0/531496653 >> v1:172.21.15.134:6789/0 conn(0x7f84f4072090 legacy=0x7f84f4150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:42.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84f90f4640 1 -- 172.21.15.28:0/531496653 >> v1:172.21.15.28:6789/0 conn(0x7f84f40a5370 legacy=0x7f84f40c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84f90f4640 1 -- 172.21.15.28:0/531496653 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f40aad20 con 0x7f84f40725c0 2023-12-16T03:25:42.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.443+0000 7f84f37fe640 1 -- 172.21.15.28:0/531496653 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926219842 0 0) 0x7f84f40c2760 con 0x7f84f40a5370 2023-12-16T03:25:42.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84f90f4640 1 --2- 172.21.15.28:0/531496653 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84f40725c0 0x7f84f41516b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009d90 tx=0x7f84ec01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda751f39150ae53 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:42.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84f37fe640 1 -- 172.21.15.28:0/531496653 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec0a57a0 con 0x7f84f40725c0 2023-12-16T03:25:42.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84f37fe640 1 -- 172.21.15.28:0/531496653 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec0a5900 con 0x7f84f40725c0 2023-12-16T03:25:42.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84f37fe640 1 -- 172.21.15.28:0/531496653 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec0a5c90 con 0x7f84f40725c0 2023-12-16T03:25:42.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84fab57640 1 -- 172.21.15.28:0/531496653 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84f40725c0 msgr2=0x7f84f41516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84fab57640 1 --2- 172.21.15.28:0/531496653 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84f40725c0 0x7f84f41516b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009d90 tx=0x7f84ec01c7f0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84fab57640 1 -- 172.21.15.28:0/531496653 shutdown_connections 2023-12-16T03:25:42.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84fab57640 1 --2- 172.21.15.28:0/531496653 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84f40725c0 0x7f84f41516b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84fab57640 1 -- 172.21.15.28:0/531496653 >> 172.21.15.28:0/531496653 conn(0x7f84f406a5b0 msgr2=0x7f84f406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:42.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84fab57640 1 -- 172.21.15.28:0/531496653 shutdown_connections 2023-12-16T03:25:42.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84fab57640 1 -- 172.21.15.28:0/531496653 wait complete. 2023-12-16T03:25:42.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84fab57640 1 Processor -- start 2023-12-16T03:25:42.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.447+0000 7f84fab57640 1 -- start start 2023-12-16T03:25:42.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84fab57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84f4072090 0x7f84f4145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84fab57640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84f40725c0 0x7f84f4144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84fab57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f40a5370 0x7f84f4145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84fab57640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4145540 con 0x7f84f40725c0 2023-12-16T03:25:42.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84fab57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f41ed880 con 0x7f84f4072090 2023-12-16T03:25:42.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84fab57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4141000 con 0x7f84f40a5370 2023-12-16T03:25:42.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84f40725c0 0x7f84f4144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84f40725c0 0x7f84f4144ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34626/0 (socket says 172.21.15.28:34626) 2023-12-16T03:25:42.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f3fff640 1 -- 172.21.15.28:0/958657154 learned_addr learned my addr 172.21.15.28:0/958657154 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:42.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f90f4640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f40a5370 0x7f84f4145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f88f3640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84f4072090 0x7f84f4145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f3fff640 1 -- 172.21.15.28:0/958657154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f40a5370 msgr2=0x7f84f4145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f3fff640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f40a5370 0x7f84f4145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f3fff640 1 -- 172.21.15.28:0/958657154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84f4072090 msgr2=0x7f84f4145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f3fff640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84f4072090 0x7f84f4145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f3fff640 1 -- 172.21.15.28:0/958657154 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec009a70 con 0x7f84f40725c0 2023-12-16T03:25:42.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f3fff640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84f40725c0 0x7f84f4144ac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84e000c450 tx=0x7f84e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:42.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f17fa640 1 -- 172.21.15.28:0/958657154 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0012830 con 0x7f84f40725c0 2023-12-16T03:25:42.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f17fa640 1 -- 172.21.15.28:0/958657154 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e00129b0 con 0x7f84f40725c0 2023-12-16T03:25:42.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84fab57640 1 -- 172.21.15.28:0/958657154 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f4142df0 con 0x7f84f40725c0 2023-12-16T03:25:42.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84f17fa640 1 -- 172.21.15.28:0/958657154 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0012d60 con 0x7f84f40725c0 2023-12-16T03:25:42.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84fab57640 1 -- 172.21.15.28:0/958657154 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f41ecf50 con 0x7f84f40725c0 2023-12-16T03:25:42.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.451+0000 7f84fab57640 1 -- 172.21.15.28:0/958657154 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f41ed9f0 con 0x7f84f40725c0 2023-12-16T03:25:42.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.455+0000 7f84f17fa640 1 -- 172.21.15.28:0/958657154 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f84e001c460 con 0x7f84f40725c0 2023-12-16T03:25:42.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.455+0000 7f84f17fa640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84d8066470 0x7f84d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.455+0000 7f84f17fa640 1 -- 172.21.15.28:0/958657154 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84e0083c40 con 0x7f84f40725c0 2023-12-16T03:25:42.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.455+0000 7f84f88f3640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84d8066470 0x7f84d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.455+0000 7f84f88f3640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84d8066470 0x7f84d8068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f84e8000f70 tx=0x7f84e8007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:42.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.459+0000 7f84f17fa640 1 -- 172.21.15.28:0/958657154 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f84e00510d0 con 0x7f84f40725c0 2023-12-16T03:25:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 -- 172.21.15.28:0/958657154 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84f40c5ca0 con 0x7f84f40725c0 2023-12-16T03:25:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84f17fa640 1 -- 172.21.15.28:0/958657154 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84e00546f0 con 0x7f84f40725c0 2023-12-16T03:25:42.618 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:25:42.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 -- 172.21.15.28:0/958657154 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84d8066470 msgr2=0x7f84d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84d8066470 0x7f84d8068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f84e8000f70 tx=0x7f84e8007df0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 -- 172.21.15.28:0/958657154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84f40725c0 msgr2=0x7f84f4144ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84f40725c0 0x7f84f4144ac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84e000c450 tx=0x7f84e000c910 comp rx=0 tx=0).stop 2023-12-16T03:25:42.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 -- 172.21.15.28:0/958657154 shutdown_connections 2023-12-16T03:25:42.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84f40a5370 0x7f84f4145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84d8066470 0x7f84d8068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84f40725c0 0x7f84f4144ac0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 --2- 172.21.15.28:0/958657154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84f4072090 0x7f84f4145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 -- 172.21.15.28:0/958657154 >> 172.21.15.28:0/958657154 conn(0x7f84f406a5b0 msgr2=0x7f84f406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:42.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 -- 172.21.15.28:0/958657154 shutdown_connections 2023-12-16T03:25:42.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.615+0000 7f84fab57640 1 -- 172.21.15.28:0/958657154 wait complete. 2023-12-16T03:25:42.640 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-16T03:25:42.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.779+0000 7f0e97b80640 1 Processor -- start 2023-12-16T03:25:42.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.779+0000 7f0e97b80640 1 -- start start 2023-12-16T03:25:42.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.779+0000 7f0e97b80640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e900c4100 0x7f0e900c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.779+0000 7f0e97b80640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0e900c06d0 0x7f0e900a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.779+0000 7f0e97b80640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e900c31c0 con 0x7f0e900c63c0 2023-12-16T03:25:42.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.779+0000 7f0e97b80640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e900c34a0 con 0x7f0e900c06d0 2023-12-16T03:25:42.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.779+0000 7f0e97b80640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900c1030 con 0x7f0e900c4100 2023-12-16T03:25:42.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9591c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0e900c63c0 0x7f0e900c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57496/0 (socket says 172.21.15.28:57496) 2023-12-16T03:25:42.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9591c640 1 -- 172.21.15.28:0/449074641 learned_addr learned my addr 172.21.15.28:0/449074641 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:42.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9611d640 1 --2- 172.21.15.28:0/449074641 >> v2:172.21.15.28:3300/0 conn(0x7f0e900c06d0 0x7f0e900a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9511b640 1 --2- 172.21.15.28:0/449074641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e900c4100 0x7f0e900c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9491a640 1 -- 172.21.15.28:0/449074641 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615688945 0 0) 0x7f0e900c31c0 con 0x7f0e900c63c0 2023-12-16T03:25:42.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9491a640 1 -- 172.21.15.28:0/449074641 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e7c005740 con 0x7f0e900c63c0 2023-12-16T03:25:42.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9611d640 1 -- 172.21.15.28:0/449074641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e900c4100 msgr2=0x7f0e900c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:42.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9611d640 1 --2- 172.21.15.28:0/449074641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e900c4100 0x7f0e900c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9611d640 1 -- 172.21.15.28:0/449074641 >> v1:172.21.15.28:6789/0 conn(0x7f0e900c63c0 legacy=0x7f0e900c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9611d640 1 -- 172.21.15.28:0/449074641 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e900c1310 con 0x7f0e900c06d0 2023-12-16T03:25:42.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9611d640 1 --2- 172.21.15.28:0/449074641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e900c06d0 0x7f0e900a9680 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009d90 tx=0x7f0e8801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146148412c187c58 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:42.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.783+0000 7f0e9491a640 1 -- 172.21.15.28:0/449074641 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e900aa3d0 con 0x7f0e900c06d0 2023-12-16T03:25:42.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9491a640 1 -- 172.21.15.28:0/449074641 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e880a5800 con 0x7f0e900c06d0 2023-12-16T03:25:42.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9491a640 1 -- 172.21.15.28:0/449074641 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880a5b70 con 0x7f0e900c06d0 2023-12-16T03:25:42.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 -- 172.21.15.28:0/449074641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e900c06d0 msgr2=0x7f0e900a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 --2- 172.21.15.28:0/449074641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e900c06d0 0x7f0e900a9680 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009d90 tx=0x7f0e8801c830 comp rx=0 tx=0).stop 2023-12-16T03:25:42.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 -- 172.21.15.28:0/449074641 shutdown_connections 2023-12-16T03:25:42.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 --2- 172.21.15.28:0/449074641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e900c06d0 0x7f0e900a9680 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 --2- 172.21.15.28:0/449074641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e900c4100 0x7f0e900c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 -- 172.21.15.28:0/449074641 >> 172.21.15.28:0/449074641 conn(0x7f0e9006a5b0 msgr2=0x7f0e9006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:42.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 -- 172.21.15.28:0/449074641 shutdown_connections 2023-12-16T03:25:42.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 -- 172.21.15.28:0/449074641 wait complete. 2023-12-16T03:25:42.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 Processor -- start 2023-12-16T03:25:42.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 -- start start 2023-12-16T03:25:42.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e900c06d0 0x7f0e90158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e900c4100 0x7f0e9014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e900c63c0 0x7f0e90156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90158580 con 0x7f0e900c4100 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9014de50 con 0x7f0e900c63c0 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e97b80640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e901561c0 con 0x7f0e900c06d0 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9511b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e900c4100 0x7f0e9014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9511b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e900c4100 0x7f0e9014ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34650/0 (socket says 172.21.15.28:34650) 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9511b640 1 -- 172.21.15.28:0/4049989022 learned_addr learned my addr 172.21.15.28:0/4049989022 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9591c640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e900c06d0 0x7f0e90158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9611d640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e900c63c0 0x7f0e90156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9511b640 1 -- 172.21.15.28:0/4049989022 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e900c06d0 msgr2=0x7f0e90158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9511b640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e900c06d0 0x7f0e90158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9511b640 1 -- 172.21.15.28:0/4049989022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e900c63c0 msgr2=0x7f0e90156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:42.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9511b640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e900c63c0 0x7f0e90156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:42.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9511b640 1 -- 172.21.15.28:0/4049989022 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e88009a70 con 0x7f0e900c4100 2023-12-16T03:25:42.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.787+0000 7f0e9591c640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e900c06d0 0x7f0e90158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:42.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.791+0000 7f0e9511b640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e900c4100 0x7f0e9014ef80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000e930 tx=0x7f0e8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:42.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.791+0000 7f0e867fc640 1 -- 172.21.15.28:0/4049989022 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80009690 con 0x7f0e900c4100 2023-12-16T03:25:42.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.791+0000 7f0e867fc640 1 -- 172.21.15.28:0/4049989022 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8000ca00 con 0x7f0e900c4100 2023-12-16T03:25:42.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.791+0000 7f0e867fc640 1 -- 172.21.15.28:0/4049989022 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000cd90 con 0x7f0e900c4100 2023-12-16T03:25:42.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.791+0000 7f0e97b80640 1 -- 172.21.15.28:0/4049989022 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9014e380 con 0x7f0e900c4100 2023-12-16T03:25:42.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.791+0000 7f0e97b80640 1 -- 172.21.15.28:0/4049989022 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9014e0a0 con 0x7f0e900c4100 2023-12-16T03:25:42.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.791+0000 7f0e97b80640 1 -- 172.21.15.28:0/4049989022 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e90068400 con 0x7f0e900c4100 2023-12-16T03:25:42.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.791+0000 7f0e867fc640 1 -- 172.21.15.28:0/4049989022 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0e80013470 con 0x7f0e900c4100 2023-12-16T03:25:42.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.791+0000 7f0e867fc640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e74066470 0x7f0e74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:42.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.791+0000 7f0e867fc640 1 -- 172.21.15.28:0/4049989022 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e80084070 con 0x7f0e900c4100 2023-12-16T03:25:42.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.791+0000 7f0e9591c640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e74066470 0x7f0e74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:42.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.795+0000 7f0e9591c640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e74066470 0x7f0e74068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c005890 tx=0x7f0e8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:42.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:42.795+0000 7f0e867fc640 1 -- 172.21.15.28:0/4049989022 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0e80051640 con 0x7f0e900c4100 2023-12-16T03:25:43.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.011+0000 7f0e97b80640 1 -- 172.21.15.28:0/4049989022 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f0e90156300 con 0x7f0e900c4100 2023-12-16T03:25:43.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.547+0000 7f0e867fc640 1 -- 172.21.15.28:0/4049989022 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v50) v1 ==== 162+0+0 (secure 0 0 0) 0x7f0e80054c60 con 0x7f0e900c4100 2023-12-16T03:25:43.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 -- 172.21.15.28:0/4049989022 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e74066470 msgr2=0x7f0e74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:43.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e74066470 0x7f0e74068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c005890 tx=0x7f0e8c009040 comp rx=0 tx=0).stop 2023-12-16T03:25:43.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 -- 172.21.15.28:0/4049989022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e900c4100 msgr2=0x7f0e9014ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:43.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e900c4100 0x7f0e9014ef80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000e930 tx=0x7f0e8000edf0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 -- 172.21.15.28:0/4049989022 shutdown_connections 2023-12-16T03:25:43.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e900c63c0 0x7f0e90156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e74066470 0x7f0e74068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e900c4100 0x7f0e9014ef80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 --2- 172.21.15.28:0/4049989022 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e900c06d0 0x7f0e90158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 -- 172.21.15.28:0/4049989022 >> 172.21.15.28:0/4049989022 conn(0x7f0e9006a5b0 msgr2=0x7f0e9006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:43.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 -- 172.21.15.28:0/4049989022 shutdown_connections 2023-12-16T03:25:43.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.551+0000 7f0e97b80640 1 -- 172.21.15.28:0/4049989022 wait complete. 2023-12-16T03:25:43.576 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-16T03:25:43.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc9d2a640 1 Processor -- start 2023-12-16T03:25:43.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc9d2a640 1 -- start start 2023-12-16T03:25:43.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc9d2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fecc40c6050 0x7fecc40c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:43.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc9d2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc40c31c0 0x7fecc4155020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:43.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc9d2a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fecc4155560 0x7fecc40c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:43.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc9d2a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc40c8d90 con 0x7fecc4155560 2023-12-16T03:25:43.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc9d2a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc40c3c80 con 0x7fecc40c6050 2023-12-16T03:25:43.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc9d2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40c6bc0 con 0x7fecc40c31c0 2023-12-16T03:25:43.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fecc4155560 0x7fecc40c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:43.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fecc4155560 0x7fecc40c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34652/0 (socket says 172.21.15.28:34652) 2023-12-16T03:25:43.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc3fff640 1 -- 172.21.15.28:0/941046234 learned_addr learned my addr 172.21.15.28:0/941046234 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:43.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc37fe640 1 --2- 172.21.15.28:0/941046234 >> v2:172.21.15.134:3300/0 conn(0x7fecc40c6050 0x7fecc40c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:43.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc2ffd640 1 --2- 172.21.15.28:0/941046234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc40c31c0 0x7fecc4155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:43.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc3fff640 1 -- 172.21.15.28:0/941046234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc40c31c0 msgr2=0x7fecc4155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:43.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc3fff640 1 --2- 172.21.15.28:0/941046234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc40c31c0 0x7fecc4155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc3fff640 1 -- 172.21.15.28:0/941046234 >> v2:172.21.15.134:3300/0 conn(0x7fecc40c6050 msgr2=0x7fecc40c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:43.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc3fff640 1 --2- 172.21.15.28:0/941046234 >> v2:172.21.15.134:3300/0 conn(0x7fecc40c6050 0x7fecc40c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.723+0000 7fecc3fff640 1 -- 172.21.15.28:0/941046234 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc40c6970 con 0x7fecc4155560 2023-12-16T03:25:43.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc3fff640 1 --2- 172.21.15.28:0/941046234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc4155560 0x7fecc40c7640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fecc4067370 tx=0x7fecbc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406e32d003dc68d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:43.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc27fc640 1 -- 172.21.15.28:0/941046234 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40c8390 con 0x7fecc4155560 2023-12-16T03:25:43.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc27fc640 1 -- 172.21.15.28:0/941046234 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc0a5790 con 0x7fecc4155560 2023-12-16T03:25:43.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc27fc640 1 -- 172.21.15.28:0/941046234 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0a5b20 con 0x7fecc4155560 2023-12-16T03:25:43.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc9d2a640 1 -- 172.21.15.28:0/941046234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc4155560 msgr2=0x7fecc40c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:43.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc9d2a640 1 --2- 172.21.15.28:0/941046234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc4155560 0x7fecc40c7640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fecc4067370 tx=0x7fecbc01c910 comp rx=0 tx=0).stop 2023-12-16T03:25:43.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc9d2a640 1 -- 172.21.15.28:0/941046234 shutdown_connections 2023-12-16T03:25:43.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc9d2a640 1 --2- 172.21.15.28:0/941046234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc4155560 0x7fecc40c7640 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc9d2a640 1 --2- 172.21.15.28:0/941046234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc40c31c0 0x7fecc4155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc9d2a640 1 --2- 172.21.15.28:0/941046234 >> v2:172.21.15.134:3300/0 conn(0x7fecc40c6050 0x7fecc40c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc9d2a640 1 -- 172.21.15.28:0/941046234 >> 172.21.15.28:0/941046234 conn(0x7fecc40a9b80 msgr2=0x7fecc40a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:43.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc9d2a640 1 -- 172.21.15.28:0/941046234 shutdown_connections 2023-12-16T03:25:43.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.727+0000 7fecc9d2a640 1 -- 172.21.15.28:0/941046234 wait complete. 2023-12-16T03:25:43.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc9d2a640 1 Processor -- start 2023-12-16T03:25:43.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc9d2a640 1 -- start start 2023-12-16T03:25:43.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc9d2a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc40c31c0 0x7fecc415e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:43.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc9d2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc40c6050 0x7fecc414ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:43.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc9d2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc4155560 0x7fecc414f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:43.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc9d2a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc415aeb0 con 0x7fecc40c31c0 2023-12-16T03:25:43.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc9d2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc41ec8d0 con 0x7fecc40c6050 2023-12-16T03:25:43.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc9d2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc4155b40 con 0x7fecc4155560 2023-12-16T03:25:43.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc40c31c0 0x7fecc415e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:43.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc40c31c0 0x7fecc415e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34654/0 (socket says 172.21.15.28:34654) 2023-12-16T03:25:43.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc37fe640 1 -- 172.21.15.28:0/41067296 learned_addr learned my addr 172.21.15.28:0/41067296 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:43.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc2ffd640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc40c6050 0x7fecc414ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:43.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc3fff640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc4155560 0x7fecc414f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:43.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc37fe640 1 -- 172.21.15.28:0/41067296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc4155560 msgr2=0x7fecc414f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:43.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc37fe640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc4155560 0x7fecc414f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc37fe640 1 -- 172.21.15.28:0/41067296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc40c6050 msgr2=0x7fecc414ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:43.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc37fe640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc40c6050 0x7fecc414ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc37fe640 1 -- 172.21.15.28:0/41067296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc009b30 con 0x7fecc40c31c0 2023-12-16T03:25:43.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc2ffd640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc40c6050 0x7fecc414ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:43.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc37fe640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc40c31c0 0x7fecc415e6b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fecb400e8a0 tx=0x7fecb400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecabfff640 1 -- 172.21.15.28:0/41067296 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4009510 con 0x7fecc40c31c0 2023-12-16T03:25:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecabfff640 1 -- 172.21.15.28:0/41067296 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb400c940 con 0x7fecc40c31c0 2023-12-16T03:25:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecabfff640 1 -- 172.21.15.28:0/41067296 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb400ccb0 con 0x7fecc40c31c0 2023-12-16T03:25:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc9d2a640 1 -- 172.21.15.28:0/41067296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc415b0b0 con 0x7fecc40c31c0 2023-12-16T03:25:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.731+0000 7fecc9d2a640 1 -- 172.21.15.28:0/41067296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc4155d90 con 0x7fecc40c31c0 2023-12-16T03:25:43.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.735+0000 7fecc9d2a640 1 -- 172.21.15.28:0/41067296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc4068400 con 0x7fecc40c31c0 2023-12-16T03:25:43.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.735+0000 7fecabfff640 1 -- 172.21.15.28:0/41067296 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fecb4013470 con 0x7fecc40c31c0 2023-12-16T03:25:43.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.735+0000 7fecabfff640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fecb0066470 0x7fecb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:43.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.735+0000 7fecabfff640 1 -- 172.21.15.28:0/41067296 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecb4083e90 con 0x7fecc40c31c0 2023-12-16T03:25:43.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.735+0000 7fecc2ffd640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fecb0066470 0x7fecb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:43.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.735+0000 7fecc2ffd640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fecb0066470 0x7fecb0068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fecc406cba0 tx=0x7fecb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:43.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.739+0000 7fecabfff640 1 -- 172.21.15.28:0/41067296 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fecb4051300 con 0x7fecc40c31c0 2023-12-16T03:25:43.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.899+0000 7fecc9d2a640 1 -- 172.21.15.28:0/41067296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fecc40aa480 con 0x7fecc40c31c0 2023-12-16T03:25:43.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.903+0000 7fecabfff640 1 -- 172.21.15.28:0/41067296 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fecb4054920 con 0x7fecc40c31c0 2023-12-16T03:25:43.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 -- 172.21.15.28:0/41067296 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fecb0066470 msgr2=0x7fecb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fecb0066470 0x7fecb0068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fecc406cba0 tx=0x7fecb8008040 comp rx=0 tx=0).stop 2023-12-16T03:25:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 -- 172.21.15.28:0/41067296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc40c31c0 msgr2=0x7fecc415e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc40c31c0 0x7fecc415e6b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fecb400e8a0 tx=0x7fecb400eca0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 -- 172.21.15.28:0/41067296 shutdown_connections 2023-12-16T03:25:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecc4155560 0x7fecc414f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecc40c6050 0x7fecc414ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fecb0066470 0x7fecb0068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 --2- 172.21.15.28:0/41067296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc40c31c0 0x7fecc415e6b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 -- 172.21.15.28:0/41067296 >> 172.21.15.28:0/41067296 conn(0x7fecc40a9b80 msgr2=0x7fecc4154270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 -- 172.21.15.28:0/41067296 shutdown_connections 2023-12-16T03:25:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:43.907+0000 7fecc9d2a640 1 -- 172.21.15.28:0/41067296 wait complete. 2023-12-16T03:25:43.929 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-16T03:25:43.929 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:25:44.019 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:25:44.147 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-16T03:25:44.147 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:25:44.147 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:25:44.156 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:25:44.156 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:25:44.209 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:25:44.209 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:25:44.261 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:44.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.443+0000 7f9f2f30f640 1 Processor -- start 2023-12-16T03:25:44.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.443+0000 7f9f2f30f640 1 -- start start 2023-12-16T03:25:44.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2f30f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f280c5260 0x7f9f2806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2f30f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f28156960 con 0x7f9f28155de0 2023-12-16T03:25:44.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2f30f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f280c2580 con 0x7f9f280c5640 2023-12-16T03:25:44.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2f30f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f28153510 con 0x7f9f280c5260 2023-12-16T03:25:44.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2d8ac640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9f28155de0 0x7f9f28156250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57508/0 (socket says 172.21.15.28:57508) 2023-12-16T03:25:44.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2d8ac640 1 -- 172.21.15.28:0/3429833554 learned_addr learned my addr 172.21.15.28:0/3429833554 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:44.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966632141 0 0) 0x7f9f200014a0 con 0x7f9f28155de0 2023-12-16T03:25:44.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2d0ab640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f280c5260 0x7f9f2806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f14003530 con 0x7f9f28155de0 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3455783694 0 0) 0x7f9f14003530 con 0x7f9f28155de0 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f280c5260 msgr2=0x7f9f2806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f280c5260 0x7f9f2806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 >> v1:172.21.15.134:6789/0 conn(0x7f9f280c5640 legacy=0x7f9f280c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f280c1a00 con 0x7f9f28155de0 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f9f20001bb0 con 0x7f9f28155de0 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 >> v1:172.21.15.28:6789/0 conn(0x7f9f28155de0 legacy=0x7f9f28156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f140039b0 0x7f9f14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f140047d0 0x7f9f14004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f280c5260 0x7f9f140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1400ba90 con 0x7f9f140047d0 2023-12-16T03:25:44.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1400bc00 con 0x7f9f140039b0 2023-12-16T03:25:44.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1400bdc0 con 0x7f9f280c5260 2023-12-16T03:25:44.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2c8aa640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f140047d0 0x7f9f14004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2d0ab640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f140039b0 0x7f9f14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2d8ac640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f280c5260 0x7f9f140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2c8aa640 1 -- 172.21.15.28:0/3429833554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f280c5260 msgr2=0x7f9f140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:44.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2c8aa640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f280c5260 0x7f9f140051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2c8aa640 1 -- 172.21.15.28:0/3429833554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f140039b0 msgr2=0x7f9f14003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:44.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2c8aa640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f140039b0 0x7f9f14003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.447+0000 7f9f2c8aa640 1 -- 172.21.15.28:0/3429833554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f14003530 con 0x7f9f140047d0 2023-12-16T03:25:44.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f2c8aa640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f140047d0 0x7f9f14004c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9f18001750 tx=0x7f9f1801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576aadf25bdabfdd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:44.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f180052d0 con 0x7f9f140047d0 2023-12-16T03:25:44.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f180a7050 con 0x7f9f140047d0 2023-12-16T03:25:44.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f1ffff640 1 -- 172.21.15.28:0/3429833554 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18003600 con 0x7f9f140047d0 2023-12-16T03:25:44.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f2f30f640 1 -- 172.21.15.28:0/3429833554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f140047d0 msgr2=0x7f9f14004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f2f30f640 1 --2- 172.21.15.28:0/3429833554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f140047d0 0x7f9f14004c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9f18001750 tx=0x7f9f1801c3c0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f2d8ac640 1 -- 172.21.15.28:0/3429833554 reap_dead start 2023-12-16T03:25:44.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f2f30f640 1 -- 172.21.15.28:0/3429833554 shutdown_connections 2023-12-16T03:25:44.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f2f30f640 1 -- 172.21.15.28:0/3429833554 >> 172.21.15.28:0/3429833554 conn(0x7f9f2806a5b0 msgr2=0x7f9f2806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:44.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f2f30f640 1 -- 172.21.15.28:0/3429833554 shutdown_connections 2023-12-16T03:25:44.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f2f30f640 1 -- 172.21.15.28:0/3429833554 wait complete. 2023-12-16T03:25:44.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.451+0000 7f9f2f30f640 1 Processor -- start 2023-12-16T03:25:44.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2f30f640 1 -- start start 2023-12-16T03:25:44.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2f30f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f140047d0 0x7f9f28151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2f30f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f281ed740 0x7f9f280bf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2f30f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f281f0970 0x7f9f281f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2f30f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f281edc40 con 0x7f9f281ed740 2023-12-16T03:25:44.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2f30f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f280a6480 con 0x7f9f140047d0 2023-12-16T03:25:44.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2f30f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f281f04e0 con 0x7f9f281f0970 2023-12-16T03:25:44.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2c8aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f281ed740 0x7f9f280bf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2c8aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f281ed740 0x7f9f280bf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34676/0 (socket says 172.21.15.28:34676) 2023-12-16T03:25:44.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2c8aa640 1 -- 172.21.15.28:0/2339581814 learned_addr learned my addr 172.21.15.28:0/2339581814 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:44.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2c8aa640 1 -- 172.21.15.28:0/2339581814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f281f0970 msgr2=0x7f9f281f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2c8aa640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f281f0970 0x7f9f281f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2d0ab640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f140047d0 0x7f9f28151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2c8aa640 1 -- 172.21.15.28:0/2339581814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f140047d0 msgr2=0x7f9f28151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2c8aa640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f140047d0 0x7f9f28151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2c8aa640 1 -- 172.21.15.28:0/2339581814 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f280a5ec0 con 0x7f9f281ed740 2023-12-16T03:25:44.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2c8aa640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f281ed740 0x7f9f280bf390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f18005040 tx=0x7f9f14005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:44.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f1dffb640 1 -- 172.21.15.28:0/2339581814 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f180072f0 con 0x7f9f281ed740 2023-12-16T03:25:44.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f1dffb640 1 -- 172.21.15.28:0/2339581814 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f18007470 con 0x7f9f281ed740 2023-12-16T03:25:44.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f1dffb640 1 -- 172.21.15.28:0/2339581814 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f180067e0 con 0x7f9f281ed740 2023-12-16T03:25:44.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2f30f640 1 -- 172.21.15.28:0/2339581814 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f280a61a0 con 0x7f9f281ed740 2023-12-16T03:25:44.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2f30f640 1 -- 172.21.15.28:0/2339581814 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f280bf8d0 con 0x7f9f281ed740 2023-12-16T03:25:44.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.455+0000 7f9f2f30f640 1 -- 172.21.15.28:0/2339581814 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f281f02b0 con 0x7f9f281ed740 2023-12-16T03:25:44.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.459+0000 7f9f1dffb640 1 -- 172.21.15.28:0/2339581814 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9f18006940 con 0x7f9f281ed740 2023-12-16T03:25:44.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.459+0000 7f9f1dffb640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f0c066470 0x7f9f0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.459+0000 7f9f1dffb640 1 -- 172.21.15.28:0/2339581814 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f1811ddb0 con 0x7f9f281ed740 2023-12-16T03:25:44.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.459+0000 7f9f2d0ab640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f0c066470 0x7f9f0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.459+0000 7f9f2d0ab640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f0c066470 0x7f9f0c068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009a20 tx=0x7f9f24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:44.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.463+0000 7f9f1dffb640 1 -- 172.21.15.28:0/2339581814 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9f180eb220 con 0x7f9f281ed740 2023-12-16T03:25:44.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.623+0000 7f9f2f30f640 1 -- 172.21.15.28:0/2339581814 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f28068400 con 0x7f9f281ed740 2023-12-16T03:25:44.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f1dffb640 1 -- 172.21.15.28:0/2339581814 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f9f180ee840 con 0x7f9f281ed740 2023-12-16T03:25:44.629 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:44.630 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:44.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 -- 172.21.15.28:0/2339581814 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f0c066470 msgr2=0x7f9f0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f0c066470 0x7f9f0c068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009a20 tx=0x7f9f24008040 comp rx=0 tx=0).stop 2023-12-16T03:25:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 -- 172.21.15.28:0/2339581814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f281ed740 msgr2=0x7f9f280bf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f281ed740 0x7f9f280bf390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f18005040 tx=0x7f9f14005800 comp rx=0 tx=0).stop 2023-12-16T03:25:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 -- 172.21.15.28:0/2339581814 shutdown_connections 2023-12-16T03:25:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f281f0970 0x7f9f281f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f0c066470 0x7f9f0c068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f281ed740 0x7f9f280bf390 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 --2- 172.21.15.28:0/2339581814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f140047d0 0x7f9f28151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 -- 172.21.15.28:0/2339581814 >> 172.21.15.28:0/2339581814 conn(0x7f9f2806a5b0 msgr2=0x7f9f280c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 -- 172.21.15.28:0/2339581814 shutdown_connections 2023-12-16T03:25:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.627+0000 7f9f2f30f640 1 -- 172.21.15.28:0/2339581814 wait complete. 2023-12-16T03:25:44.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:25:13.885447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:25:14.309086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:44.651 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:44.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.791+0000 7fda52972640 1 Processor -- start 2023-12-16T03:25:44.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda52972640 1 -- start start 2023-12-16T03:25:44.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda52972640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fda4c1578f0 0x7fda4c0c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda52972640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda4c0c2840 0x7fda4c0c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda52972640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4c157cd0 con 0x7fda4c0a6c60 2023-12-16T03:25:44.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda52972640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4c0c2e00 con 0x7fda4c1578f0 2023-12-16T03:25:44.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda52972640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c158850 con 0x7fda4c0c2840 2023-12-16T03:25:44.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda4bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fda4c1578f0 0x7fda4c0c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda4b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fda4c0a6c60 0x7fda4c0c1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57516/0 (socket says 172.21.15.28:57516) 2023-12-16T03:25:44.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda4b7fe640 1 -- 172.21.15.28:0/4045972316 learned_addr learned my addr 172.21.15.28:0/4045972316 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:44.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda50f0f640 1 --2- 172.21.15.28:0/4045972316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda4c0c2840 0x7fda4c0c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda4bfff640 1 -- 172.21.15.28:0/4045972316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda4c0c2840 msgr2=0x7fda4c0c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:44.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda4bfff640 1 --2- 172.21.15.28:0/4045972316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda4c0c2840 0x7fda4c0c3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda4bfff640 1 -- 172.21.15.28:0/4045972316 >> v1:172.21.15.28:6789/0 conn(0x7fda4c0a6c60 legacy=0x7fda4c0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.795+0000 7fda4bfff640 1 -- 172.21.15.28:0/4045972316 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c157f20 con 0x7fda4c1578f0 2023-12-16T03:25:44.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda4bfff640 1 --2- 172.21.15.28:0/4045972316 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda4c1578f0 0x7fda4c0c30e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0097c0 tx=0x7fda3c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e953436f0d970c8e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:44.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda4affd640 1 -- 172.21.15.28:0/4045972316 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0ab600 con 0x7fda4c1578f0 2023-12-16T03:25:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda4affd640 1 -- 172.21.15.28:0/4045972316 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c0a7050 con 0x7fda4c1578f0 2023-12-16T03:25:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda4affd640 1 -- 172.21.15.28:0/4045972316 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0ab980 con 0x7fda4c1578f0 2023-12-16T03:25:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda52972640 1 -- 172.21.15.28:0/4045972316 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda4c1578f0 msgr2=0x7fda4c0c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda52972640 1 --2- 172.21.15.28:0/4045972316 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda4c1578f0 0x7fda4c0c30e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0097c0 tx=0x7fda3c01c3f0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda52972640 1 -- 172.21.15.28:0/4045972316 shutdown_connections 2023-12-16T03:25:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda52972640 1 --2- 172.21.15.28:0/4045972316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda4c0c2840 0x7fda4c0c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda52972640 1 --2- 172.21.15.28:0/4045972316 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda4c1578f0 0x7fda4c0c30e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda52972640 1 -- 172.21.15.28:0/4045972316 >> 172.21.15.28:0/4045972316 conn(0x7fda4c0c7e40 msgr2=0x7fda4c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda52972640 1 -- 172.21.15.28:0/4045972316 shutdown_connections 2023-12-16T03:25:44.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda52972640 1 -- 172.21.15.28:0/4045972316 wait complete. 2023-12-16T03:25:44.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda52972640 1 Processor -- start 2023-12-16T03:25:44.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.799+0000 7fda52972640 1 -- start start 2023-12-16T03:25:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda52972640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda4c0a6c60 0x7fda4c0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda52972640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda4c0c2840 0x7fda4c0c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda52972640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda4c1578f0 0x7fda4c14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda52972640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0adcc0 con 0x7fda4c0c2840 2023-12-16T03:25:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda52972640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0aaa70 con 0x7fda4c0a6c60 2023-12-16T03:25:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda52972640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0aa460 con 0x7fda4c1578f0 2023-12-16T03:25:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda4b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda4c0c2840 0x7fda4c0c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda4b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda4c0c2840 0x7fda4c0c4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34690/0 (socket says 172.21.15.28:34690) 2023-12-16T03:25:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda4b7fe640 1 -- 172.21.15.28:0/2435520337 learned_addr learned my addr 172.21.15.28:0/2435520337 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda50f0f640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda4c1578f0 0x7fda4c14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda4bfff640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda4c0a6c60 0x7fda4c0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda4b7fe640 1 -- 172.21.15.28:0/2435520337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda4c1578f0 msgr2=0x7fda4c14ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda4b7fe640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda4c1578f0 0x7fda4c14ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda4b7fe640 1 -- 172.21.15.28:0/2435520337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda4c0a6c60 msgr2=0x7fda4c0ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda4b7fe640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda4c0a6c60 0x7fda4c0ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda4b7fe640 1 -- 172.21.15.28:0/2435520337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c009420 con 0x7fda4c0c2840 2023-12-16T03:25:44.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda4b7fe640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda4c0c2840 0x7fda4c0c4b30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fda4000c4d0 tx=0x7fda4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:44.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda48ff9640 1 -- 172.21.15.28:0/2435520337 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40005cf0 con 0x7fda4c0c2840 2023-12-16T03:25:44.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda48ff9640 1 -- 172.21.15.28:0/2435520337 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda40005e50 con 0x7fda4c0c2840 2023-12-16T03:25:44.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda52972640 1 -- 172.21.15.28:0/2435520337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4c1f17b0 con 0x7fda4c0c2840 2023-12-16T03:25:44.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda48ff9640 1 -- 172.21.15.28:0/2435520337 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40007270 con 0x7fda4c0c2840 2023-12-16T03:25:44.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda52972640 1 -- 172.21.15.28:0/2435520337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4c1f1a90 con 0x7fda4c0c2840 2023-12-16T03:25:44.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.803+0000 7fda52972640 1 -- 172.21.15.28:0/2435520337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4c0ad4a0 con 0x7fda4c0c2840 2023-12-16T03:25:44.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.807+0000 7fda48ff9640 1 -- 172.21.15.28:0/2435520337 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fda400073d0 con 0x7fda4c0c2840 2023-12-16T03:25:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.807+0000 7fda48ff9640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda380664a0 0x7fda38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.807+0000 7fda48ff9640 1 -- 172.21.15.28:0/2435520337 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda40083270 con 0x7fda4c0c2840 2023-12-16T03:25:44.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.807+0000 7fda4bfff640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda380664a0 0x7fda38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:44.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.807+0000 7fda4bfff640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda380664a0 0x7fda38068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0ad000 tx=0x7fda3c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:44.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.811+0000 7fda48ff9640 1 -- 172.21.15.28:0/2435520337 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fda4c0ad4a0 con 0x7fda4c0c2840 2023-12-16T03:25:44.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.967+0000 7fda52972640 1 -- 172.21.15.28:0/2435520337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda4c0ad4a0 con 0x7fda4c0c2840 2023-12-16T03:25:44.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.967+0000 7fda48ff9640 1 -- 172.21.15.28:0/2435520337 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda4c0ad4a0 con 0x7fda4c0c2840 2023-12-16T03:25:44.971 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:44.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 -- 172.21.15.28:0/2435520337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda380664a0 msgr2=0x7fda38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda380664a0 0x7fda38068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0ad000 tx=0x7fda3c0a6000 comp rx=0 tx=0).stop 2023-12-16T03:25:44.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 -- 172.21.15.28:0/2435520337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda4c0c2840 msgr2=0x7fda4c0c4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:44.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda4c0c2840 0x7fda4c0c4b30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fda4000c4d0 tx=0x7fda4000c990 comp rx=0 tx=0).stop 2023-12-16T03:25:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 -- 172.21.15.28:0/2435520337 shutdown_connections 2023-12-16T03:25:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fda4c1578f0 0x7fda4c14ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda380664a0 0x7fda38068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda4c0c2840 0x7fda4c0c4b30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 --2- 172.21.15.28:0/2435520337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda4c0a6c60 0x7fda4c0ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 -- 172.21.15.28:0/2435520337 >> 172.21.15.28:0/2435520337 conn(0x7fda4c0c7e40 msgr2=0x7fda4c156720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 -- 172.21.15.28:0/2435520337 shutdown_connections 2023-12-16T03:25:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:44.971+0000 7fda52972640 1 -- 172.21.15.28:0/2435520337 wait complete. 2023-12-16T03:25:44.992 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:25:45.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.135+0000 7f39c3caa640 1 Processor -- start 2023-12-16T03:25:45.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.135+0000 7f39c3caa640 1 -- start start 2023-12-16T03:25:45.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.135+0000 7f39c3caa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc06dfe0 0x7f39bc06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.135+0000 7f39c3caa640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39bc072500 con 0x7f39bc06a5b0 2023-12-16T03:25:45.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.135+0000 7f39c3caa640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39bc070f60 con 0x7f39bc06b1e0 2023-12-16T03:25:45.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.135+0000 7f39c3caa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc06ef50 con 0x7f39bc06dfe0 2023-12-16T03:25:45.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.135+0000 7f39c1a46640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f39bc06a5b0 0x7f39bc0c2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57518/0 (socket says 172.21.15.28:57518) 2023-12-16T03:25:45.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.135+0000 7f39c1a46640 1 -- 172.21.15.28:0/3879873201 learned_addr learned my addr 172.21.15.28:0/3879873201 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:45.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.135+0000 7f39c1245640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc06dfe0 0x7f39bc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.135+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175837176 0 0) 0x7f39bc072500 con 0x7f39bc06a5b0 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a8003530 con 0x7f39bc06a5b0 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3262411860 0 0) 0x7f39a8003530 con 0x7f39bc06a5b0 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc06dfe0 msgr2=0x7f39bc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc06dfe0 0x7f39bc06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 >> v1:172.21.15.134:6789/0 conn(0x7f39bc06b1e0 legacy=0x7f39bc15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc14eda0 con 0x7f39bc06a5b0 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f39b8001680 con 0x7f39bc06a5b0 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c1245640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc06dfe0 0x7f39bc06a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 >> v1:172.21.15.28:6789/0 conn(0x7f39bc06a5b0 legacy=0x7f39bc0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 0x7f39a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39a8004360 0x7f39a8004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc06dfe0 0x7f39a80050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc06ef50 con 0x7f39a80039b0 2023-12-16T03:25:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a800b9e0 con 0x7f39a8004360 2023-12-16T03:25:45.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a800bba0 con 0x7f39bc06dfe0 2023-12-16T03:25:45.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c1a46640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 0x7f39a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c2247640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc06dfe0 0x7f39a80050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c1245640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39a8004360 0x7f39a8004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c1a46640 1 -- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc06dfe0 msgr2=0x7f39a80050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:45.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c1a46640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc06dfe0 0x7f39a80050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c1a46640 1 -- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39a8004360 msgr2=0x7f39a8004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:45.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c1a46640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39a8004360 0x7f39a8004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c1a46640 1 -- 172.21.15.28:0/3879873201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac009420 con 0x7f39a80039b0 2023-12-16T03:25:45.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c1245640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39a8004360 0x7f39a8004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:45.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.139+0000 7f39c1a46640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 0x7f39a8003d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c160 tx=0x7f39b801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7107e79037c95bcf server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:45.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8005ae0 con 0x7f39a80039b0 2023-12-16T03:25:45.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b8005c60 con 0x7f39a80039b0 2023-12-16T03:25:45.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c0a44640 1 -- 172.21.15.28:0/3879873201 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8007070 con 0x7f39a80039b0 2023-12-16T03:25:45.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 -- 172.21.15.28:0/3879873201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 msgr2=0x7f39a8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 --2- 172.21.15.28:0/3879873201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 0x7f39a8003d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c160 tx=0x7f39b801cbc0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c2247640 1 -- 172.21.15.28:0/3879873201 reap_dead start 2023-12-16T03:25:45.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 -- 172.21.15.28:0/3879873201 shutdown_connections 2023-12-16T03:25:45.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 -- 172.21.15.28:0/3879873201 >> 172.21.15.28:0/3879873201 conn(0x7f39bc0c6ef0 msgr2=0x7f39bc0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:45.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 -- 172.21.15.28:0/3879873201 shutdown_connections 2023-12-16T03:25:45.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 -- 172.21.15.28:0/3879873201 wait complete. 2023-12-16T03:25:45.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 Processor -- start 2023-12-16T03:25:45.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 -- start start 2023-12-16T03:25:45.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 0x7f39bc0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc160240 0x7f39bc1f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39bc1f0880 0x7f39bc1f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc1ed4b0 con 0x7f39a80039b0 2023-12-16T03:25:45.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc1ed790 con 0x7f39bc1f0880 2023-12-16T03:25:45.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c3caa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc1eda70 con 0x7f39bc160240 2023-12-16T03:25:45.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.143+0000 7f39c1a46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 0x7f39bc0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39c1a46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 0x7f39bc0c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34702/0 (socket says 172.21.15.28:34702) 2023-12-16T03:25:45.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39c1a46640 1 -- 172.21.15.28:0/887067739 learned_addr learned my addr 172.21.15.28:0/887067739 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:45.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39c1a46640 1 -- 172.21.15.28:0/887067739 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc160240 msgr2=0x7f39bc1f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39c1a46640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc160240 0x7f39bc1f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39c1a46640 1 -- 172.21.15.28:0/887067739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39bc1f0880 msgr2=0x7f39bc1f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39c1a46640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39bc1f0880 0x7f39bc1f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39c1a46640 1 -- 172.21.15.28:0/887067739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc1edd50 con 0x7f39a80039b0 2023-12-16T03:25:45.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39c1a46640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 0x7f39bc0c5b20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c160 tx=0x7f39a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:45.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39b27fc640 1 -- 172.21.15.28:0/887067739 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b80b4070 con 0x7f39a80039b0 2023-12-16T03:25:45.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39b27fc640 1 -- 172.21.15.28:0/887067739 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b8004a00 con 0x7f39a80039b0 2023-12-16T03:25:45.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39c3caa640 1 -- 172.21.15.28:0/887067739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc1ee030 con 0x7f39a80039b0 2023-12-16T03:25:45.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39b27fc640 1 -- 172.21.15.28:0/887067739 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8004d70 con 0x7f39a80039b0 2023-12-16T03:25:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39c3caa640 1 -- 172.21.15.28:0/887067739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc0c6060 con 0x7f39a80039b0 2023-12-16T03:25:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39c3caa640 1 -- 172.21.15.28:0/887067739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc0c6340 con 0x7f39a80039b0 2023-12-16T03:25:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39b27fc640 1 -- 172.21.15.28:0/887067739 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f39b8007040 con 0x7f39a80039b0 2023-12-16T03:25:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39b27fc640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a00664f0 0x7f39a00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.147+0000 7f39b27fc640 1 -- 172.21.15.28:0/887067739 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39b811d740 con 0x7f39a80039b0 2023-12-16T03:25:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.151+0000 7f39c1245640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a00664f0 0x7f39a00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.151+0000 7f39c1245640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a00664f0 0x7f39a00689b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f39bc160640 tx=0x7f39ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:45.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.151+0000 7f39b27fc640 1 -- 172.21.15.28:0/887067739 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f39b80eaba0 con 0x7f39a80039b0 2023-12-16T03:25:45.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.307+0000 7f39c3caa640 1 -- 172.21.15.28:0/887067739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39bc068400 con 0x7f39a80039b0 2023-12-16T03:25:45.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.307+0000 7f39b27fc640 1 -- 172.21.15.28:0/887067739 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39b80ee1c0 con 0x7f39a80039b0 2023-12-16T03:25:45.312 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:25:45.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 -- 172.21.15.28:0/887067739 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a00664f0 msgr2=0x7f39a00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a00664f0 0x7f39a00689b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f39bc160640 tx=0x7f39ac008040 comp rx=0 tx=0).stop 2023-12-16T03:25:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 -- 172.21.15.28:0/887067739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 msgr2=0x7f39bc0c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 0x7f39bc0c5b20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c160 tx=0x7f39a8005800 comp rx=0 tx=0).stop 2023-12-16T03:25:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 -- 172.21.15.28:0/887067739 shutdown_connections 2023-12-16T03:25:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39bc1f0880 0x7f39bc1f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39bc160240 0x7f39bc1f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f39a00664f0 0x7f39a00689b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 --2- 172.21.15.28:0/887067739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39a80039b0 0x7f39bc0c5b20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 -- 172.21.15.28:0/887067739 >> 172.21.15.28:0/887067739 conn(0x7f39bc0c6ef0 msgr2=0x7f39bc1596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 -- 172.21.15.28:0/887067739 shutdown_connections 2023-12-16T03:25:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.311+0000 7f39c3caa640 1 -- 172.21.15.28:0/887067739 wait complete. 2023-12-16T03:25:45.333 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:25:45.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.475+0000 7f9016f57640 1 Processor -- start 2023-12-16T03:25:45.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.475+0000 7f9016f57640 1 -- start start 2023-12-16T03:25:45.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.475+0000 7f9016f57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90101555c0 0x7f90100a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.475+0000 7f9016f57640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f90100c61e0 0x7f90100c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.475+0000 7f9016f57640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90100c28e0 con 0x7f90100c6c70 2023-12-16T03:25:45.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.475+0000 7f9016f57640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90100c3680 con 0x7f90100c61e0 2023-12-16T03:25:45.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.475+0000 7f9016f57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90100c2b80 con 0x7f90101555c0 2023-12-16T03:25:45.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f900ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f90100c61e0 0x7f90100c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f900ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f90100c61e0 0x7f90100c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34718/0 (socket says 172.21.15.28:34718) 2023-12-16T03:25:45.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f900ffff640 1 -- 172.21.15.28:0/4221391604 learned_addr learned my addr 172.21.15.28:0/4221391604 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f9014cf3640 1 --2- 172.21.15.28:0/4221391604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90101555c0 0x7f90100a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f900ffff640 1 -- 172.21.15.28:0/4221391604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90101555c0 msgr2=0x7f90100a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f900ffff640 1 --2- 172.21.15.28:0/4221391604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90101555c0 0x7f90100a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f900ffff640 1 -- 172.21.15.28:0/4221391604 >> v1:172.21.15.134:6789/0 conn(0x7f90100c6c70 legacy=0x7f90100c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f900ffff640 1 -- 172.21.15.28:0/4221391604 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90100c32a0 con 0x7f90100c61e0 2023-12-16T03:25:45.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f9014cf3640 1 --2- 172.21.15.28:0/4221391604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90101555c0 0x7f90100a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:45.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f900ffff640 1 --2- 172.21.15.28:0/4221391604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90100c61e0 0x7f90100c6730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009870 tx=0x7f8ffc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f4a97f4d77b00d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:45.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f900f7fe640 1 -- 172.21.15.28:0/4221391604 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0ac630 con 0x7f90100c61e0 2023-12-16T03:25:45.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f900f7fe640 1 -- 172.21.15.28:0/4221391604 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc0ac790 con 0x7f90100c61e0 2023-12-16T03:25:45.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.479+0000 7f900f7fe640 1 -- 172.21.15.28:0/4221391604 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0acb20 con 0x7f90100c61e0 2023-12-16T03:25:45.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 -- 172.21.15.28:0/4221391604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90100c61e0 msgr2=0x7f90100c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 --2- 172.21.15.28:0/4221391604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90100c61e0 0x7f90100c6730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009870 tx=0x7f8ffc01c500 comp rx=0 tx=0).stop 2023-12-16T03:25:45.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 -- 172.21.15.28:0/4221391604 shutdown_connections 2023-12-16T03:25:45.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 --2- 172.21.15.28:0/4221391604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90100c61e0 0x7f90100c6730 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 --2- 172.21.15.28:0/4221391604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90101555c0 0x7f90100a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 -- 172.21.15.28:0/4221391604 >> 172.21.15.28:0/4221391604 conn(0x7f90100c7e40 msgr2=0x7f90100c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:45.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 -- 172.21.15.28:0/4221391604 shutdown_connections 2023-12-16T03:25:45.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 -- 172.21.15.28:0/4221391604 wait complete. 2023-12-16T03:25:45.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 Processor -- start 2023-12-16T03:25:45.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 -- start start 2023-12-16T03:25:45.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90100c61e0 0x7f901014c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90100c6c70 0x7f90101f0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90101555c0 0x7f90101f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90101edd80 con 0x7f90100c6c70 2023-12-16T03:25:45.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90101ed170 con 0x7f90101555c0 2023-12-16T03:25:45.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9016f57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90101ed450 con 0x7f90100c61e0 2023-12-16T03:25:45.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f900ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90100c6c70 0x7f90101f0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f900ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90100c6c70 0x7f90101f0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34728/0 (socket says 172.21.15.28:34728) 2023-12-16T03:25:45.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f900ffff640 1 -- 172.21.15.28:0/3833284407 learned_addr learned my addr 172.21.15.28:0/3833284407 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:45.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f9014cf3640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90100c61e0 0x7f901014c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f90154f4640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90101555c0 0x7f90101f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f900ffff640 1 -- 172.21.15.28:0/3833284407 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90100c61e0 msgr2=0x7f901014c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f900ffff640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90100c61e0 0x7f901014c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f900ffff640 1 -- 172.21.15.28:0/3833284407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90101555c0 msgr2=0x7f90101f0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f900ffff640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90101555c0 0x7f90101f0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.483+0000 7f900ffff640 1 -- 172.21.15.28:0/3833284407 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc0094d0 con 0x7f90100c6c70 2023-12-16T03:25:45.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.487+0000 7f900ffff640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90100c6c70 0x7f90101f0750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0af040 tx=0x7f8ffc0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:45.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.487+0000 7f900d7fa640 1 -- 172.21.15.28:0/3833284407 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0ba070 con 0x7f90100c6c70 2023-12-16T03:25:45.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.487+0000 7f900d7fa640 1 -- 172.21.15.28:0/3833284407 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc0ac5b0 con 0x7f90100c6c70 2023-12-16T03:25:45.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.487+0000 7f900d7fa640 1 -- 172.21.15.28:0/3833284407 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0b58b0 con 0x7f90100c6c70 2023-12-16T03:25:45.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.487+0000 7f9016f57640 1 -- 172.21.15.28:0/3833284407 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90101ed730 con 0x7f90100c6c70 2023-12-16T03:25:45.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.487+0000 7f9016f57640 1 -- 172.21.15.28:0/3833284407 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901014c8c0 con 0x7f90100c6c70 2023-12-16T03:25:45.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.487+0000 7f9016f57640 1 -- 172.21.15.28:0/3833284407 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90101edef0 con 0x7f90100c6c70 2023-12-16T03:25:45.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.487+0000 7f900d7fa640 1 -- 172.21.15.28:0/3833284407 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8ffc0b3070 con 0x7f90100c6c70 2023-12-16T03:25:45.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.487+0000 7f900d7fa640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ff40664a0 0x7f8ff4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.487+0000 7f900d7fa640 1 -- 172.21.15.28:0/3833284407 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ffc11d6b0 con 0x7f90100c6c70 2023-12-16T03:25:45.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.487+0000 7f9014cf3640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ff40664a0 0x7f8ff4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.491+0000 7f9014cf3640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ff40664a0 0x7f8ff4068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9004006fd0 tx=0x7f9004008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:45.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.491+0000 7f900d7fa640 1 -- 172.21.15.28:0/3833284407 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8ffc0eab40 con 0x7f90100c6c70 2023-12-16T03:25:45.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 -- 172.21.15.28:0/3833284407 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9010068400 con 0x7f90100c6c70 2023-12-16T03:25:45.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f900d7fa640 1 -- 172.21.15.28:0/3833284407 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ffc0ee160 con 0x7f90100c6c70 2023-12-16T03:25:45.655 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:25:45.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 -- 172.21.15.28:0/3833284407 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ff40664a0 msgr2=0x7f8ff4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ff40664a0 0x7f8ff4068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9004006fd0 tx=0x7f9004008040 comp rx=0 tx=0).stop 2023-12-16T03:25:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 -- 172.21.15.28:0/3833284407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90100c6c70 msgr2=0x7f90101f0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90100c6c70 0x7f90101f0750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0af040 tx=0x7f8ffc0192a0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 -- 172.21.15.28:0/3833284407 shutdown_connections 2023-12-16T03:25:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90101555c0 0x7f90101f0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ff40664a0 0x7f8ff4068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90100c6c70 0x7f90101f0750 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 --2- 172.21.15.28:0/3833284407 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90100c61e0 0x7f901014c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 -- 172.21.15.28:0/3833284407 >> 172.21.15.28:0/3833284407 conn(0x7f90100c7e40 msgr2=0x7f901006e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 -- 172.21.15.28:0/3833284407 shutdown_connections 2023-12-16T03:25:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.651+0000 7f9016f57640 1 -- 172.21.15.28:0/3833284407 wait complete. 2023-12-16T03:25:45.676 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:25:45.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.815+0000 7f050ca17640 1 Processor -- start 2023-12-16T03:25:45.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.815+0000 7f050ca17640 1 -- start start 2023-12-16T03:25:45.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.815+0000 7f050ca17640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f05080725c0 0x7f05081516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.815+0000 7f050ca17640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05080c2760 con 0x7f0508072090 2023-12-16T03:25:45.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.815+0000 7f050ca17640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05080a5750 con 0x7f05080a5370 2023-12-16T03:25:45.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.815+0000 7f050ca17640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05080c3070 con 0x7f05080725c0 2023-12-16T03:25:45.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f0505d9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0508072090 0x7f0508150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57530/0 (socket says 172.21.15.28:57530) 2023-12-16T03:25:45.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f0505d9b640 1 -- 172.21.15.28:0/4026889947 learned_addr learned my addr 172.21.15.28:0/4026889947 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:45.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f0506d9d640 1 --2- 172.21.15.28:0/4026889947 >> v2:172.21.15.134:3300/0 conn(0x7f05080725c0 0x7f05081516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459204498 0 0) 0x7f05080c2760 con 0x7f0508072090 2023-12-16T03:25:45.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f0003530 con 0x7f0508072090 2023-12-16T03:25:45.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918428476 0 0) 0x7f05080a5750 con 0x7f05080a5370 2023-12-16T03:25:45.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05080c2760 con 0x7f05080a5370 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1036248390 0 0) 0x7f04f0003530 con 0x7f0508072090 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 >> v2:172.21.15.134:3300/0 conn(0x7f05080725c0 msgr2=0x7f05081516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 --2- 172.21.15.28:0/4026889947 >> v2:172.21.15.134:3300/0 conn(0x7f05080725c0 0x7f05081516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 >> v1:172.21.15.134:6789/0 conn(0x7f05080a5370 legacy=0x7f05080c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080aad20 con 0x7f0508072090 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f04fc001680 con 0x7f0508072090 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 >> v1:172.21.15.28:6789/0 conn(0x7f0508072090 legacy=0x7f0508150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 --2- 172.21.15.28:0/4026889947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f0003b60 0x7f04f0003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 --2- 172.21.15.28:0/4026889947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00047d0 0x7f04f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 --2- 172.21.15.28:0/4026889947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0005250 0x7f04f000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05080c3070 con 0x7f04f00047d0 2023-12-16T03:25:45.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f000e3a0 con 0x7f04f0005250 2023-12-16T03:25:45.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f000e560 con 0x7f04f0003b60 2023-12-16T03:25:45.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f0505d9b640 1 --2- 172.21.15.28:0/4026889947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00047d0 0x7f04f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f050659c640 1 --2- 172.21.15.28:0/4026889947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f0003b60 0x7f04f0003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f0506d9d640 1 --2- 172.21.15.28:0/4026889947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0005250 0x7f04f000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f0505d9b640 1 -- 172.21.15.28:0/4026889947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f0003b60 msgr2=0x7f04f0003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:45.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f0505d9b640 1 --2- 172.21.15.28:0/4026889947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f0003b60 0x7f04f0003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f0505d9b640 1 -- 172.21.15.28:0/4026889947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0005250 msgr2=0x7f04f000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:45.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f0505d9b640 1 --2- 172.21.15.28:0/4026889947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0005250 0x7f04f000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f0505d9b640 1 -- 172.21.15.28:0/4026889947 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0003530 con 0x7f04f00047d0 2023-12-16T03:25:45.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.819+0000 7f0506d9d640 1 -- 172.21.15.28:0/4026889947 reap_dead start 2023-12-16T03:25:45.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f0505d9b640 1 --2- 172.21.15.28:0/4026889947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00047d0 0x7f04f0004c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04fc007fb0 tx=0x7f04fc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711439fe098739 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:45.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc005ae0 con 0x7f04f00047d0 2023-12-16T03:25:45.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc005c40 con 0x7f04f00047d0 2023-12-16T03:25:45.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050559a640 1 -- 172.21.15.28:0/4026889947 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc0072b0 con 0x7f04f00047d0 2023-12-16T03:25:45.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050ca17640 1 -- 172.21.15.28:0/4026889947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00047d0 msgr2=0x7f04f0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050ca17640 1 --2- 172.21.15.28:0/4026889947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00047d0 0x7f04f0004c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04fc007fb0 tx=0x7f04fc01ca90 comp rx=0 tx=0).stop 2023-12-16T03:25:45.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050ca17640 1 -- 172.21.15.28:0/4026889947 shutdown_connections 2023-12-16T03:25:45.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050ca17640 1 --2- 172.21.15.28:0/4026889947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00047d0 0x7f04f0004c50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050ca17640 1 -- 172.21.15.28:0/4026889947 >> 172.21.15.28:0/4026889947 conn(0x7f050806a5b0 msgr2=0x7f050806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:45.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050ca17640 1 -- 172.21.15.28:0/4026889947 shutdown_connections 2023-12-16T03:25:45.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050ca17640 1 -- 172.21.15.28:0/4026889947 wait complete. 2023-12-16T03:25:45.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050ca17640 1 Processor -- start 2023-12-16T03:25:45.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.823+0000 7f050ca17640 1 -- start start 2023-12-16T03:25:45.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f050ca17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f00047d0 0x7f05081476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f050ca17640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05081e9240 0x7f050814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f050ca17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f050814d630 0x7f0508152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f050ca17640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508154770 con 0x7f05081e9240 2023-12-16T03:25:45.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f050ca17640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05080a8930 con 0x7f04f00047d0 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f050ca17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05081e9790 con 0x7f050814d630 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f0505d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05081e9240 0x7f050814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f0505d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05081e9240 0x7f050814d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34748/0 (socket says 172.21.15.28:34748) 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f0505d9b640 1 -- 172.21.15.28:0/3296852842 learned_addr learned my addr 172.21.15.28:0/3296852842 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f0506d9d640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f050814d630 0x7f0508152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f050659c640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f00047d0 0x7f05081476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f0505d9b640 1 -- 172.21.15.28:0/3296852842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f050814d630 msgr2=0x7f0508152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f0505d9b640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f050814d630 0x7f0508152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f0505d9b640 1 -- 172.21.15.28:0/3296852842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f00047d0 msgr2=0x7f05081476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f0505d9b640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f00047d0 0x7f05081476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f0505d9b640 1 -- 172.21.15.28:0/3296852842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508147bf0 con 0x7f05081e9240 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f0505d9b640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05081e9240 0x7f050814d0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f04fc01c8c0 tx=0x7f04f0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f04f6ffd640 1 -- 172.21.15.28:0/3296852842 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc0b4070 con 0x7f05081e9240 2023-12-16T03:25:45.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f04f6ffd640 1 -- 172.21.15.28:0/3296852842 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc005900 con 0x7f05081e9240 2023-12-16T03:25:45.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f04f6ffd640 1 -- 172.21.15.28:0/3296852842 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc0072b0 con 0x7f05081e9240 2023-12-16T03:25:45.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f050ca17640 1 -- 172.21.15.28:0/3296852842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05080a8370 con 0x7f05081e9240 2023-12-16T03:25:45.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f050ca17640 1 -- 172.21.15.28:0/3296852842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05081528c0 con 0x7f05081e9240 2023-12-16T03:25:45.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f050ca17640 1 -- 172.21.15.28:0/3296852842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0508152720 con 0x7f05081e9240 2023-12-16T03:25:45.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.827+0000 7f04f6ffd640 1 -- 172.21.15.28:0/3296852842 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f04fc007410 con 0x7f05081e9240 2023-12-16T03:25:45.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.831+0000 7f04f6ffd640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04e80664a0 0x7f04e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:45.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.831+0000 7f04f6ffd640 1 -- 172.21.15.28:0/3296852842 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04fc11d890 con 0x7f05081e9240 2023-12-16T03:25:45.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.831+0000 7f050659c640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04e80664a0 0x7f04e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:45.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.831+0000 7f050659c640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04e80664a0 0x7f04e8068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f04f8007fd0 tx=0x7f04f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:45.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:45.835+0000 7f04f6ffd640 1 -- 172.21.15.28:0/3296852842 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0508152720 con 0x7f05081e9240 2023-12-16T03:25:46.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f050ca17640 1 -- 172.21.15.28:0/3296852842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0508152720 con 0x7f05081e9240 2023-12-16T03:25:46.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f04f6ffd640 1 -- 172.21.15.28:0/3296852842 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0508152720 con 0x7f05081e9240 2023-12-16T03:25:46.007 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:25:46.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f050ca17640 1 -- 172.21.15.28:0/3296852842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04e80664a0 msgr2=0x7f04e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f050ca17640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04e80664a0 0x7f04e8068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f04f8007fd0 tx=0x7f04f8009040 comp rx=0 tx=0).stop 2023-12-16T03:25:46.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f050ca17640 1 -- 172.21.15.28:0/3296852842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05081e9240 msgr2=0x7f050814d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f050ca17640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05081e9240 0x7f050814d0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f04fc01c8c0 tx=0x7f04f0005800 comp rx=0 tx=0).stop 2023-12-16T03:25:46.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f050ca17640 1 -- 172.21.15.28:0/3296852842 shutdown_connections 2023-12-16T03:25:46.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f050ca17640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f050814d630 0x7f0508152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f050ca17640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04e80664a0 0x7f04e8068960 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f050ca17640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05081e9240 0x7f050814d0f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f050ca17640 1 --2- 172.21.15.28:0/3296852842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f00047d0 0x7f05081476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.003+0000 7f050ca17640 1 -- 172.21.15.28:0/3296852842 >> 172.21.15.28:0/3296852842 conn(0x7f050806a5b0 msgr2=0x7f050806ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:46.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.007+0000 7f050ca17640 1 -- 172.21.15.28:0/3296852842 shutdown_connections 2023-12-16T03:25:46.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.007+0000 7f050ca17640 1 -- 172.21.15.28:0/3296852842 wait complete. 2023-12-16T03:25:46.028 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-16T03:25:46.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:46.028 DEBUG:teuthology.orchestra.run.smithi028:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-16T03:25:46.062 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:25:46.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:46.062 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-16T03:25:46.126 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:25:46.126 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:25:46.136 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:25:46.136 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:25:46.192 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:25:46.193 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:25:46.245 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:46.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.383+0000 7feb9065a640 1 Processor -- start 2023-12-16T03:25:46.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.383+0000 7feb9065a640 1 -- start start 2023-12-16T03:25:46.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb9065a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feb880c4100 0x7feb880c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb9065a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb880c31c0 con 0x7feb880c06d0 2023-12-16T03:25:46.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb9065a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb880c34a0 con 0x7feb880c63c0 2023-12-16T03:25:46.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb9065a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb880c1030 con 0x7feb880c4100 2023-12-16T03:25:46.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8ebf7640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7feb880c06d0 0x7feb880a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57534/0 (socket says 172.21.15.28:57534) 2023-12-16T03:25:46.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8ebf7640 1 -- 172.21.15.28:0/684418029 learned_addr learned my addr 172.21.15.28:0/684418029 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:46.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8dbf5640 1 --2- 172.21.15.28:0/684418029 >> v2:172.21.15.134:3300/0 conn(0x7feb880c4100 0x7feb880c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217054632 0 0) 0x7feb880c31c0 con 0x7feb880c06d0 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb74003530 con 0x7feb880c06d0 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 297204342 0 0) 0x7feb74003530 con 0x7feb880c06d0 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 >> v2:172.21.15.134:3300/0 conn(0x7feb880c4100 msgr2=0x7feb880c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 --2- 172.21.15.28:0/684418029 >> v2:172.21.15.134:3300/0 conn(0x7feb880c4100 0x7feb880c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 >> v1:172.21.15.134:6789/0 conn(0x7feb880c63c0 legacy=0x7feb880c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880c1310 con 0x7feb880c06d0 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7feb80001a20 con 0x7feb880c06d0 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8dbf5640 1 --2- 172.21.15.28:0/684418029 >> v2:172.21.15.134:3300/0 conn(0x7feb880c4100 0x7feb880c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 >> v1:172.21.15.28:6789/0 conn(0x7feb880c06d0 legacy=0x7feb880a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 --2- 172.21.15.28:0/684418029 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb74003980 0x7feb74003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 --2- 172.21.15.28:0/684418029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb740047d0 0x7feb74004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 --2- 172.21.15.28:0/684418029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb740052b0 0x7feb7400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880c1030 con 0x7feb740052b0 2023-12-16T03:25:46.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7400c180 con 0x7feb740047d0 2023-12-16T03:25:46.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7400e550 con 0x7feb74003980 2023-12-16T03:25:46.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8ebf7640 1 --2- 172.21.15.28:0/684418029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb740052b0 0x7feb7400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8dbf5640 1 --2- 172.21.15.28:0/684418029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb740047d0 0x7feb74004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8e3f6640 1 --2- 172.21.15.28:0/684418029 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb74003980 0x7feb74003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8ebf7640 1 -- 172.21.15.28:0/684418029 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb74003980 msgr2=0x7feb74003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:46.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8ebf7640 1 --2- 172.21.15.28:0/684418029 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb74003980 0x7feb74003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8ebf7640 1 -- 172.21.15.28:0/684418029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb740047d0 msgr2=0x7feb74004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:46.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8ebf7640 1 --2- 172.21.15.28:0/684418029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb740047d0 0x7feb74004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.387+0000 7feb8ebf7640 1 -- 172.21.15.28:0/684418029 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74003530 con 0x7feb740052b0 2023-12-16T03:25:46.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb8ebf7640 1 -- 172.21.15.28:0/684418029 reap_dead start 2023-12-16T03:25:46.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb8ebf7640 1 --2- 172.21.15.28:0/684418029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb740052b0 0x7feb7400b990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feb80002240 tx=0x7feb8001d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c12200943bd5a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:46.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800ad630 con 0x7feb740052b0 2023-12-16T03:25:46.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb800a8070 con 0x7feb740052b0 2023-12-16T03:25:46.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb8d3f4640 1 -- 172.21.15.28:0/684418029 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800ad990 con 0x7feb740052b0 2023-12-16T03:25:46.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb9065a640 1 -- 172.21.15.28:0/684418029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb740052b0 msgr2=0x7feb7400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb9065a640 1 --2- 172.21.15.28:0/684418029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb740052b0 0x7feb7400b990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feb80002240 tx=0x7feb8001d300 comp rx=0 tx=0).stop 2023-12-16T03:25:46.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb9065a640 1 -- 172.21.15.28:0/684418029 shutdown_connections 2023-12-16T03:25:46.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb9065a640 1 --2- 172.21.15.28:0/684418029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb740052b0 0x7feb7400b990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb9065a640 1 -- 172.21.15.28:0/684418029 >> 172.21.15.28:0/684418029 conn(0x7feb8806a5b0 msgr2=0x7feb8806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:46.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb9065a640 1 -- 172.21.15.28:0/684418029 shutdown_connections 2023-12-16T03:25:46.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.391+0000 7feb9065a640 1 -- 172.21.15.28:0/684418029 wait complete. 2023-12-16T03:25:46.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb9065a640 1 Processor -- start 2023-12-16T03:25:46.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb9065a640 1 -- start start 2023-12-16T03:25:46.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb9065a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb740052b0 0x7feb881ee220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb9065a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb88153450 0x7feb8815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb9065a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb88152970 0x7feb88152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb9065a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb881f12a0 con 0x7feb88153450 2023-12-16T03:25:46.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb9065a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8815a4c0 con 0x7feb740052b0 2023-12-16T03:25:46.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb9065a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8815a7a0 con 0x7feb88152970 2023-12-16T03:25:46.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb8dbf5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb88153450 0x7feb8815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb8dbf5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb88153450 0x7feb8815b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34780/0 (socket says 172.21.15.28:34780) 2023-12-16T03:25:46.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb8dbf5640 1 -- 172.21.15.28:0/1064648112 learned_addr learned my addr 172.21.15.28:0/1064648112 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:46.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb8e3f6640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb740052b0 0x7feb881ee220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb8ebf7640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb88152970 0x7feb88152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb8dbf5640 1 -- 172.21.15.28:0/1064648112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb88152970 msgr2=0x7feb88152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb8dbf5640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb88152970 0x7feb88152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb8dbf5640 1 -- 172.21.15.28:0/1064648112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb740052b0 msgr2=0x7feb881ee220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb8dbf5640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb740052b0 0x7feb881ee220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb8dbf5640 1 -- 172.21.15.28:0/1064648112 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880c69b0 con 0x7feb88153450 2023-12-16T03:25:46.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb8dbf5640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb88153450 0x7feb8815b280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7feb78011a50 tx=0x7feb78011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:46.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb7effd640 1 -- 172.21.15.28:0/1064648112 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7800fc50 con 0x7feb88153450 2023-12-16T03:25:46.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb7effd640 1 -- 172.21.15.28:0/1064648112 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7800fdb0 con 0x7feb88153450 2023-12-16T03:25:46.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb9065a640 1 -- 172.21.15.28:0/1064648112 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8815aa80 con 0x7feb88153450 2023-12-16T03:25:46.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb7effd640 1 -- 172.21.15.28:0/1064648112 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78014680 con 0x7feb88153450 2023-12-16T03:25:46.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb9065a640 1 -- 172.21.15.28:0/1064648112 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb881ee760 con 0x7feb88153450 2023-12-16T03:25:46.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.395+0000 7feb9065a640 1 -- 172.21.15.28:0/1064648112 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb88068400 con 0x7feb88153450 2023-12-16T03:25:46.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.399+0000 7feb7effd640 1 -- 172.21.15.28:0/1064648112 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7feb780147e0 con 0x7feb88153450 2023-12-16T03:25:46.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.399+0000 7feb7effd640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb6c0664a0 0x7feb6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.399+0000 7feb7effd640 1 -- 172.21.15.28:0/1064648112 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb78084680 con 0x7feb88153450 2023-12-16T03:25:46.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.399+0000 7feb8e3f6640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb6c0664a0 0x7feb6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.399+0000 7feb8e3f6640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb6c0664a0 0x7feb6c068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feb84000c10 tx=0x7feb84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:46.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.403+0000 7feb7effd640 1 -- 172.21.15.28:0/1064648112 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7feb78051ba0 con 0x7feb88153450 2023-12-16T03:25:46.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.563+0000 7feb9065a640 1 -- 172.21.15.28:0/1064648112 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb8815cbd0 con 0x7feb88153450 2023-12-16T03:25:46.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.563+0000 7feb7effd640 1 -- 172.21.15.28:0/1064648112 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7feb780551c0 con 0x7feb88153450 2023-12-16T03:25:46.567 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:46.567 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 -- 172.21.15.28:0/1064648112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb6c0664a0 msgr2=0x7feb6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb6c0664a0 0x7feb6c068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feb84000c10 tx=0x7feb84009040 comp rx=0 tx=0).stop 2023-12-16T03:25:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 -- 172.21.15.28:0/1064648112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb88153450 msgr2=0x7feb8815b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb88153450 0x7feb8815b280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7feb78011a50 tx=0x7feb78011f10 comp rx=0 tx=0).stop 2023-12-16T03:25:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 -- 172.21.15.28:0/1064648112 shutdown_connections 2023-12-16T03:25:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb88152970 0x7feb88152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb6c0664a0 0x7feb6c068960 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb88153450 0x7feb8815b280 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 --2- 172.21.15.28:0/1064648112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb740052b0 0x7feb881ee220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 -- 172.21.15.28:0/1064648112 >> 172.21.15.28:0/1064648112 conn(0x7feb8806a5b0 msgr2=0x7feb88155050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 -- 172.21.15.28:0/1064648112 shutdown_connections 2023-12-16T03:25:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.567+0000 7feb9065a640 1 -- 172.21.15.28:0/1064648112 wait complete. 2023-12-16T03:25:46.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:25:13.885447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:25:14.309086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:46.589 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:46.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.731+0000 7fdaba059640 1 Processor -- start 2023-12-16T03:25:46.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.731+0000 7fdaba059640 1 -- start start 2023-12-16T03:25:46.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaba059640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdab40c5ac0 0x7fdab4155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaba059640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c2960 0x7fdab415eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaba059640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab40a76e0 con 0x7fdab40c2580 2023-12-16T03:25:46.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaba059640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab40c3540 con 0x7fdab40c5ac0 2023-12-16T03:25:46.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaba059640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab4155500 con 0x7fdab40c2960 2023-12-16T03:25:46.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab9057640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdab40c2580 0x7fdab4154df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57548/0 (socket says 172.21.15.28:57548) 2023-12-16T03:25:46.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab9057640 1 -- 172.21.15.28:0/3476532254 learned_addr learned my addr 172.21.15.28:0/3476532254 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:46.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab9858640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c2960 0x7fdab415eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab8856640 1 --2- 172.21.15.28:0/3476532254 >> v2:172.21.15.134:3300/0 conn(0x7fdab40c5ac0 0x7fdab4155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371952859 0 0) 0x7fdab40a76e0 con 0x7fdab40c2580 2023-12-16T03:25:46.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaa0003530 con 0x7fdab40c2580 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2931163180 0 0) 0x7fdaa0003530 con 0x7fdab40c2580 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c2960 msgr2=0x7fdab415eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c2960 0x7fdab415eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 >> v2:172.21.15.134:3300/0 conn(0x7fdab40c5ac0 msgr2=0x7fdab4155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 --2- 172.21.15.28:0/3476532254 >> v2:172.21.15.134:3300/0 conn(0x7fdab40c5ac0 0x7fdab4155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab40c2df0 con 0x7fdab40c2580 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fdab0001680 con 0x7fdab40c2580 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 >> v1:172.21.15.28:6789/0 conn(0x7fdab40c2580 legacy=0x7fdab4154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 0x7fdaa0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c2960 0x7fdaa00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa0004d10 0x7fdaa0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40c3540 con 0x7fdaa0003980 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab4155500 con 0x7fdaa0004d10 2023-12-16T03:25:46.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa000ba40 con 0x7fdab40c2960 2023-12-16T03:25:46.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab9057640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 0x7fdaa0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab8856640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c2960 0x7fdaa00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab9858640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa0004d10 0x7fdaa0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab9057640 1 -- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c2960 msgr2=0x7fdaa00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:46.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab9057640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c2960 0x7fdaa00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab9057640 1 -- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa0004d10 msgr2=0x7fdaa0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:46.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab9057640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa0004d10 0x7fdaa0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab9057640 1 -- 172.21.15.28:0/3476532254 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa0003530 con 0x7fdaa0003980 2023-12-16T03:25:46.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.735+0000 7fdab9858640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaa0004d10 0x7fdaa0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:46.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdab9057640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 0x7fdaa0003da0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdab0007f30 tx=0x7fdab001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe86b9dc841aa1d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:46.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab00058e0 con 0x7fdaa0003980 2023-12-16T03:25:46.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab0005a40 con 0x7fdaa0003980 2023-12-16T03:25:46.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdaabfff640 1 -- 172.21.15.28:0/3476532254 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0005e10 con 0x7fdaa0003980 2023-12-16T03:25:46.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdaba059640 1 -- 172.21.15.28:0/3476532254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 msgr2=0x7fdaa0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdaba059640 1 --2- 172.21.15.28:0/3476532254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 0x7fdaa0003da0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdab0007f30 tx=0x7fdab001ca90 comp rx=0 tx=0).stop 2023-12-16T03:25:46.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdab9858640 1 -- 172.21.15.28:0/3476532254 reap_dead start 2023-12-16T03:25:46.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdaba059640 1 -- 172.21.15.28:0/3476532254 shutdown_connections 2023-12-16T03:25:46.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdaba059640 1 -- 172.21.15.28:0/3476532254 >> 172.21.15.28:0/3476532254 conn(0x7fdab40a9930 msgr2=0x7fdab40a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:46.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdaba059640 1 -- 172.21.15.28:0/3476532254 shutdown_connections 2023-12-16T03:25:46.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdaba059640 1 -- 172.21.15.28:0/3476532254 wait complete. 2023-12-16T03:25:46.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdaba059640 1 Processor -- start 2023-12-16T03:25:46.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.739+0000 7fdaba059640 1 -- start start 2023-12-16T03:25:46.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaba059640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 0x7fdab40a7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaba059640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c7da0 0x7fdab41f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaba059640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab406e660 0x7fdab40ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaba059640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40a7300 con 0x7fdaa0003980 2023-12-16T03:25:46.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaba059640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40aae90 con 0x7fdab406e660 2023-12-16T03:25:46.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaba059640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab41f1090 con 0x7fdab40c7da0 2023-12-16T03:25:46.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab9057640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 0x7fdab40a7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab9057640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 0x7fdab40a7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34794/0 (socket says 172.21.15.28:34794) 2023-12-16T03:25:46.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab9057640 1 -- 172.21.15.28:0/1895527575 learned_addr learned my addr 172.21.15.28:0/1895527575 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:46.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab9858640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab406e660 0x7fdab40ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab8856640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c7da0 0x7fdab41f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab9057640 1 -- 172.21.15.28:0/1895527575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c7da0 msgr2=0x7fdab41f0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab9057640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c7da0 0x7fdab41f0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab9057640 1 -- 172.21.15.28:0/1895527575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab406e660 msgr2=0x7fdab40ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab9057640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab406e660 0x7fdab40ab320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab9057640 1 -- 172.21.15.28:0/1895527575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab406f660 con 0x7fdaa0003980 2023-12-16T03:25:46.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab8856640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c7da0 0x7fdab41f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:46.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab9858640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab406e660 0x7fdab40ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:46.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdab9057640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 0x7fdab40a7df0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdab00ab040 tx=0x7fdaa0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:46.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaa9ffb640 1 -- 172.21.15.28:0/1895527575 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0005e70 con 0x7fdaa0003980 2023-12-16T03:25:46.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaa9ffb640 1 -- 172.21.15.28:0/1895527575 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab00047f0 con 0x7fdaa0003980 2023-12-16T03:25:46.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaba059640 1 -- 172.21.15.28:0/1895527575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab406f940 con 0x7fdaa0003980 2023-12-16T03:25:46.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaa9ffb640 1 -- 172.21.15.28:0/1895527575 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0004b80 con 0x7fdaa0003980 2023-12-16T03:25:46.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaba059640 1 -- 172.21.15.28:0/1895527575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab406eae0 con 0x7fdaa0003980 2023-12-16T03:25:46.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.743+0000 7fdaba059640 1 -- 172.21.15.28:0/1895527575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab4067a00 con 0x7fdaa0003980 2023-12-16T03:25:46.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.747+0000 7fdaa9ffb640 1 -- 172.21.15.28:0/1895527575 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdab0004ce0 con 0x7fdaa0003980 2023-12-16T03:25:46.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.747+0000 7fdaa9ffb640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda98066470 0x7fda98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:46.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.747+0000 7fdaa9ffb640 1 -- 172.21.15.28:0/1895527575 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdab011d860 con 0x7fdaa0003980 2023-12-16T03:25:46.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.747+0000 7fdab8856640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda98066470 0x7fda98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:46.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.747+0000 7fdab8856640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda98066470 0x7fda98068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdab406df90 tx=0x7fdaa4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:46.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.751+0000 7fdaa9ffb640 1 -- 172.21.15.28:0/1895527575 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdab00eacd0 con 0x7fdaa0003980 2023-12-16T03:25:46.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 -- 172.21.15.28:0/1895527575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdab406fb80 con 0x7fdaa0003980 2023-12-16T03:25:46.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaa9ffb640 1 -- 172.21.15.28:0/1895527575 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdab406fb80 con 0x7fdaa0003980 2023-12-16T03:25:46.914 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:46.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 -- 172.21.15.28:0/1895527575 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda98066470 msgr2=0x7fda98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda98066470 0x7fda98068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdab406df90 tx=0x7fdaa4008040 comp rx=0 tx=0).stop 2023-12-16T03:25:46.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 -- 172.21.15.28:0/1895527575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 msgr2=0x7fdab40a7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:46.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 0x7fdab40a7df0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdab00ab040 tx=0x7fdaa0005800 comp rx=0 tx=0).stop 2023-12-16T03:25:46.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 -- 172.21.15.28:0/1895527575 shutdown_connections 2023-12-16T03:25:46.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab406e660 0x7fdab40ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdab40c7da0 0x7fdab41f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fda98066470 0x7fda98068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 --2- 172.21.15.28:0/1895527575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaa0003980 0x7fdab40a7df0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:46.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 -- 172.21.15.28:0/1895527575 >> 172.21.15.28:0/1895527575 conn(0x7fdab40a9930 msgr2=0x7fdab40a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:46.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 -- 172.21.15.28:0/1895527575 shutdown_connections 2023-12-16T03:25:46.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:46.911+0000 7fdaba059640 1 -- 172.21.15.28:0/1895527575 wait complete. 2023-12-16T03:25:46.935 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:25:47.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3aece6b640 1 Processor -- start 2023-12-16T03:25:47.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3aece6b640 1 -- start start 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3aece6b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ae80c5260 0x7f3ae806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3aece6b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae8155de0 0x7f3ae8156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3aece6b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae80c2580 con 0x7f3ae80c5640 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3aece6b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae8153510 con 0x7f3ae80c5260 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3aece6b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae80c17f0 con 0x7f3ae8155de0 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3ae659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ae80c5260 0x7f3ae806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3ae659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ae80c5260 0x7f3ae806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34806/0 (socket says 172.21.15.28:34806) 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3ae659c640 1 -- 172.21.15.28:0/3303775953 learned_addr learned my addr 172.21.15.28:0/3303775953 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3ae6d9d640 1 --2- 172.21.15.28:0/3303775953 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae8155de0 0x7f3ae8156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3ae659c640 1 -- 172.21.15.28:0/3303775953 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae8155de0 msgr2=0x7f3ae8156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3ae659c640 1 --2- 172.21.15.28:0/3303775953 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae8155de0 0x7f3ae8156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3ae659c640 1 -- 172.21.15.28:0/3303775953 >> v1:172.21.15.134:6789/0 conn(0x7f3ae80c5640 legacy=0x7f3ae80c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:47.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.079+0000 7f3ae659c640 1 -- 172.21.15.28:0/3303775953 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae80c1a00 con 0x7f3ae80c5260 2023-12-16T03:25:47.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3ae659c640 1 --2- 172.21.15.28:0/3303775953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae80c5260 0x7f3ae806d5b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80c1930 tx=0x7f3ad801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e647eee1600bee62 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:47.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3ae5d9b640 1 -- 172.21.15.28:0/3303775953 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80ab660 con 0x7f3ae80c5260 2023-12-16T03:25:47.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3ae5d9b640 1 -- 172.21.15.28:0/3303775953 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad80ab7c0 con 0x7f3ae80c5260 2023-12-16T03:25:47.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3ae5d9b640 1 -- 172.21.15.28:0/3303775953 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80abb50 con 0x7f3ae80c5260 2023-12-16T03:25:47.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3aece6b640 1 -- 172.21.15.28:0/3303775953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae80c5260 msgr2=0x7f3ae806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3aece6b640 1 --2- 172.21.15.28:0/3303775953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae80c5260 0x7f3ae806d5b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80c1930 tx=0x7f3ad801c460 comp rx=0 tx=0).stop 2023-12-16T03:25:47.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3aece6b640 1 -- 172.21.15.28:0/3303775953 shutdown_connections 2023-12-16T03:25:47.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3aece6b640 1 --2- 172.21.15.28:0/3303775953 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae8155de0 0x7f3ae8156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3aece6b640 1 --2- 172.21.15.28:0/3303775953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae80c5260 0x7f3ae806d5b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3aece6b640 1 -- 172.21.15.28:0/3303775953 >> 172.21.15.28:0/3303775953 conn(0x7f3ae806a5b0 msgr2=0x7f3ae806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:47.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3aece6b640 1 -- 172.21.15.28:0/3303775953 shutdown_connections 2023-12-16T03:25:47.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.083+0000 7f3aece6b640 1 -- 172.21.15.28:0/3303775953 wait complete. 2023-12-16T03:25:47.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3aece6b640 1 Processor -- start 2023-12-16T03:25:47.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3aece6b640 1 -- start start 2023-12-16T03:25:47.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3aece6b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae80c5260 0x7f3ae80bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3aece6b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae80c5640 0x7f3ae814e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3aece6b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae8155de0 0x7f3ae814e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3aece6b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae8070780 con 0x7f3ae80c5640 2023-12-16T03:25:47.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3aece6b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae814ecb0 con 0x7f3ae80c5260 2023-12-16T03:25:47.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3aece6b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae814f380 con 0x7f3ae8155de0 2023-12-16T03:25:47.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae80c5640 0x7f3ae814e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae80c5640 0x7f3ae814e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34816/0 (socket says 172.21.15.28:34816) 2023-12-16T03:25:47.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adffff640 1 -- 172.21.15.28:0/247195574 learned_addr learned my addr 172.21.15.28:0/247195574 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:47.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3ae6d9d640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae8155de0 0x7f3ae814e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3ae659c640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae80c5260 0x7f3ae80bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adffff640 1 -- 172.21.15.28:0/247195574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae8155de0 msgr2=0x7f3ae814e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adffff640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae8155de0 0x7f3ae814e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adffff640 1 -- 172.21.15.28:0/247195574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae80c5260 msgr2=0x7f3ae80bf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adffff640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae80c5260 0x7f3ae80bf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adffff640 1 -- 172.21.15.28:0/247195574 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad80094d0 con 0x7f3ae80c5640 2023-12-16T03:25:47.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adffff640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae80c5640 0x7f3ae814e230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c4d0 tx=0x7f3ad000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:47.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adeffd640 1 -- 172.21.15.28:0/247195574 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad00052d0 con 0x7f3ae80c5640 2023-12-16T03:25:47.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adeffd640 1 -- 172.21.15.28:0/247195574 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad0005430 con 0x7f3ae80c5640 2023-12-16T03:25:47.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3adeffd640 1 -- 172.21.15.28:0/247195574 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0012830 con 0x7f3ae80c5640 2023-12-16T03:25:47.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3aece6b640 1 -- 172.21.15.28:0/247195574 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae806fe50 con 0x7f3ae80c5640 2023-12-16T03:25:47.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.087+0000 7f3aece6b640 1 -- 172.21.15.28:0/247195574 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae8070410 con 0x7f3ae80c5640 2023-12-16T03:25:47.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.091+0000 7f3aece6b640 1 -- 172.21.15.28:0/247195574 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae80705a0 con 0x7f3ae80c5640 2023-12-16T03:25:47.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.091+0000 7f3adeffd640 1 -- 172.21.15.28:0/247195574 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3ad0012990 con 0x7f3ae80c5640 2023-12-16T03:25:47.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.091+0000 7f3adeffd640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ac8066470 0x7f3ac8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.091+0000 7f3adeffd640 1 -- 172.21.15.28:0/247195574 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ad0083870 con 0x7f3ae80c5640 2023-12-16T03:25:47.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.091+0000 7f3ae659c640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ac8066470 0x7f3ac8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.091+0000 7f3ae659c640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ac8066470 0x7f3ac8068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80af000 tx=0x7f3ad80b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:47.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.095+0000 7f3adeffd640 1 -- 172.21.15.28:0/247195574 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3ad0050d90 con 0x7f3ae80c5640 2023-12-16T03:25:47.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.251+0000 7f3aece6b640 1 -- 172.21.15.28:0/247195574 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ae8068400 con 0x7f3ae80c5640 2023-12-16T03:25:47.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.251+0000 7f3adeffd640 1 -- 172.21.15.28:0/247195574 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ad00543b0 con 0x7f3ae80c5640 2023-12-16T03:25:47.256 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:25:47.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 -- 172.21.15.28:0/247195574 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ac8066470 msgr2=0x7f3ac8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ac8066470 0x7f3ac8068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80af000 tx=0x7f3ad80b6040 comp rx=0 tx=0).stop 2023-12-16T03:25:47.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 -- 172.21.15.28:0/247195574 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae80c5640 msgr2=0x7f3ae814e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae80c5640 0x7f3ae814e230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c4d0 tx=0x7f3ad000c990 comp rx=0 tx=0).stop 2023-12-16T03:25:47.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 -- 172.21.15.28:0/247195574 shutdown_connections 2023-12-16T03:25:47.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae8155de0 0x7f3ae814e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3ac8066470 0x7f3ac8068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae80c5640 0x7f3ae814e230 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 --2- 172.21.15.28:0/247195574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae80c5260 0x7f3ae80bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 -- 172.21.15.28:0/247195574 >> 172.21.15.28:0/247195574 conn(0x7f3ae806a5b0 msgr2=0x7f3ae806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:47.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 -- 172.21.15.28:0/247195574 shutdown_connections 2023-12-16T03:25:47.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.255+0000 7f3aece6b640 1 -- 172.21.15.28:0/247195574 wait complete. 2023-12-16T03:25:47.277 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:25:47.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddba101640 1 Processor -- start 2023-12-16T03:25:47.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddba101640 1 -- start start 2023-12-16T03:25:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddba101640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fddb40c5640 0x7fddb40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddba101640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fddb40c60f0 0x7fddb4155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddba101640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb40c2580 con 0x7fddb40c5260 2023-12-16T03:25:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddba101640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb4153510 con 0x7fddb40c5640 2023-12-16T03:25:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddba101640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb40c17f0 con 0x7fddb40c60f0 2023-12-16T03:25:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddb2ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fddb40c5640 0x7fddb40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddb2ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fddb40c5640 0x7fddb40c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34832/0 (socket says 172.21.15.28:34832) 2023-12-16T03:25:47.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddb2ffd640 1 -- 172.21.15.28:0/3292588825 learned_addr learned my addr 172.21.15.28:0/3292588825 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:47.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddb3fff640 1 --2- 172.21.15.28:0/3292588825 >> v2:172.21.15.134:3300/0 conn(0x7fddb40c60f0 0x7fddb4155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddb2ffd640 1 -- 172.21.15.28:0/3292588825 >> v2:172.21.15.134:3300/0 conn(0x7fddb40c60f0 msgr2=0x7fddb4155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:47.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddb2ffd640 1 --2- 172.21.15.28:0/3292588825 >> v2:172.21.15.134:3300/0 conn(0x7fddb40c60f0 0x7fddb4155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddb2ffd640 1 -- 172.21.15.28:0/3292588825 >> v1:172.21.15.134:6789/0 conn(0x7fddb40c5260 legacy=0x7fddb406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:47.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.419+0000 7fddb2ffd640 1 -- 172.21.15.28:0/3292588825 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb40c1a00 con 0x7fddb40c5640 2023-12-16T03:25:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.423+0000 7fddb2ffd640 1 --2- 172.21.15.28:0/3292588825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fddb40c5640 0x7fddb40c5bb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fddb40c6b10 tx=0x7fdda801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0ef4f737b09840 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.423+0000 7fddb27fc640 1 -- 172.21.15.28:0/3292588825 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda80ac640 con 0x7fddb40c5640 2023-12-16T03:25:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.423+0000 7fddb27fc640 1 -- 172.21.15.28:0/3292588825 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda80ac7a0 con 0x7fddb40c5640 2023-12-16T03:25:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.423+0000 7fddb27fc640 1 -- 172.21.15.28:0/3292588825 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda80acb30 con 0x7fddb40c5640 2023-12-16T03:25:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.423+0000 7fddba101640 1 -- 172.21.15.28:0/3292588825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fddb40c5640 msgr2=0x7fddb40c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.423+0000 7fddba101640 1 --2- 172.21.15.28:0/3292588825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fddb40c5640 0x7fddb40c5bb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fddb40c6b10 tx=0x7fdda801c400 comp rx=0 tx=0).stop 2023-12-16T03:25:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 -- 172.21.15.28:0/3292588825 shutdown_connections 2023-12-16T03:25:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 --2- 172.21.15.28:0/3292588825 >> v2:172.21.15.134:3300/0 conn(0x7fddb40c60f0 0x7fddb4155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 --2- 172.21.15.28:0/3292588825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fddb40c5640 0x7fddb40c5bb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 -- 172.21.15.28:0/3292588825 >> 172.21.15.28:0/3292588825 conn(0x7fddb406a5b0 msgr2=0x7fddb406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 -- 172.21.15.28:0/3292588825 shutdown_connections 2023-12-16T03:25:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 -- 172.21.15.28:0/3292588825 wait complete. 2023-12-16T03:25:47.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 Processor -- start 2023-12-16T03:25:47.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 -- start start 2023-12-16T03:25:47.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddb40c5260 0x7fddb41ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb40c5640 0x7fddb40c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fddb40c60f0 0x7fddb41570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb40bfe10 con 0x7fddb40c60f0 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4153c10 con 0x7fddb40c5640 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddba101640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4158d60 con 0x7fddb40c5260 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddb3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fddb40c60f0 0x7fddb41570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddb3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fddb40c60f0 0x7fddb41570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34844/0 (socket says 172.21.15.28:34844) 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddb3fff640 1 -- 172.21.15.28:0/1413543171 learned_addr learned my addr 172.21.15.28:0/1413543171 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddb37fe640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddb40c5260 0x7fddb41ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddb2ffd640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb40c5640 0x7fddb40c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddb3fff640 1 -- 172.21.15.28:0/1413543171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddb40c5260 msgr2=0x7fddb41ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddb3fff640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddb40c5260 0x7fddb41ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddb3fff640 1 -- 172.21.15.28:0/1413543171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb40c5640 msgr2=0x7fddb40c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddb3fff640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb40c5640 0x7fddb40c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.427+0000 7fddb3fff640 1 -- 172.21.15.28:0/1413543171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda80094d0 con 0x7fddb40c60f0 2023-12-16T03:25:47.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.431+0000 7fddb3fff640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fddb40c60f0 0x7fddb41570e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fddac007e40 tx=0x7fddac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:47.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.431+0000 7fdd9bfff640 1 -- 172.21.15.28:0/1413543171 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac014620 con 0x7fddb40c60f0 2023-12-16T03:25:47.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.431+0000 7fdd9bfff640 1 -- 172.21.15.28:0/1413543171 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac00ee90 con 0x7fddb40c60f0 2023-12-16T03:25:47.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.431+0000 7fdd9bfff640 1 -- 172.21.15.28:0/1413543171 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac0149e0 con 0x7fddb40c60f0 2023-12-16T03:25:47.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.431+0000 7fddba101640 1 -- 172.21.15.28:0/1413543171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb40bf290 con 0x7fddb40c60f0 2023-12-16T03:25:47.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.431+0000 7fddba101640 1 -- 172.21.15.28:0/1413543171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb40bf850 con 0x7fddb40c60f0 2023-12-16T03:25:47.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.431+0000 7fddba101640 1 -- 172.21.15.28:0/1413543171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb4156e00 con 0x7fddb40c60f0 2023-12-16T03:25:47.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.431+0000 7fdd9bfff640 1 -- 172.21.15.28:0/1413543171 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fddac014b40 con 0x7fddb40c60f0 2023-12-16T03:25:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.431+0000 7fdd9bfff640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdda0066470 0x7fdda0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.435+0000 7fdd9bfff640 1 -- 172.21.15.28:0/1413543171 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddac083e30 con 0x7fddb40c60f0 2023-12-16T03:25:47.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.435+0000 7fddb37fe640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdda0066470 0x7fdda0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.435+0000 7fddb37fe640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdda0066470 0x7fdda0068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdda40098e0 tx=0x7fdda4009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:47.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.439+0000 7fdd9bfff640 1 -- 172.21.15.28:0/1413543171 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fddb4156e00 con 0x7fddb40c60f0 2023-12-16T03:25:47.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 -- 172.21.15.28:0/1413543171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fddb4156e00 con 0x7fddb40c60f0 2023-12-16T03:25:47.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fdd9bfff640 1 -- 172.21.15.28:0/1413543171 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fddb4156e00 con 0x7fddb40c60f0 2023-12-16T03:25:47.601 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:25:47.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 -- 172.21.15.28:0/1413543171 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdda0066470 msgr2=0x7fdda0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdda0066470 0x7fdda0068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdda40098e0 tx=0x7fdda4009060 comp rx=0 tx=0).stop 2023-12-16T03:25:47.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 -- 172.21.15.28:0/1413543171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fddb40c60f0 msgr2=0x7fddb41570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fddb40c60f0 0x7fddb41570e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fddac007e40 tx=0x7fddac00e4b0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 -- 172.21.15.28:0/1413543171 shutdown_connections 2023-12-16T03:25:47.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdda0066470 0x7fdda0068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fddb40c60f0 0x7fddb41570e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddb40c5640 0x7fddb40c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 --2- 172.21.15.28:0/1413543171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fddb40c5260 0x7fddb41ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 -- 172.21.15.28:0/1413543171 >> 172.21.15.28:0/1413543171 conn(0x7fddb406a5b0 msgr2=0x7fddb40c2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:47.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 -- 172.21.15.28:0/1413543171 shutdown_connections 2023-12-16T03:25:47.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.599+0000 7fddba101640 1 -- 172.21.15.28:0/1413543171 wait complete. 2023-12-16T03:25:47.623 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:25:47.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f771231d640 1 Processor -- start 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f771231d640 1 -- start start 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f771231d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f770c0c7ea0 0x7f770c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f771231d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f770c06b9e0 0x7f770c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f771231d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c06c860 con 0x7f770c151e90 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f771231d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c0c8750 con 0x7f770c06b9e0 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f771231d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c1552d0 con 0x7f770c0c7ea0 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f770bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f770c151e90 0x7f770c0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57564/0 (socket says 172.21.15.28:57564) 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f770bfff640 1 -- 172.21.15.28:0/1536150092 learned_addr learned my addr 172.21.15.28:0/1536150092 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f770b7fe640 1 --2- 172.21.15.28:0/1536150092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f770c0c7ea0 0x7f770c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f77108ba640 1 --2- 172.21.15.28:0/1536150092 >> v2:172.21.15.134:3300/0 conn(0x7f770c06b9e0 0x7f770c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f770affd640 1 -- 172.21.15.28:0/1536150092 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260697866 0 0) 0x7f770c06c860 con 0x7f770c151e90 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f770affd640 1 -- 172.21.15.28:0/1536150092 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76f4003530 con 0x7f770c151e90 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f770b7fe640 1 -- 172.21.15.28:0/1536150092 >> v2:172.21.15.134:3300/0 conn(0x7f770c06b9e0 msgr2=0x7f770c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f770b7fe640 1 --2- 172.21.15.28:0/1536150092 >> v2:172.21.15.134:3300/0 conn(0x7f770c06b9e0 0x7f770c15f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f770b7fe640 1 -- 172.21.15.28:0/1536150092 >> v1:172.21.15.28:6789/0 conn(0x7f770c151e90 legacy=0x7f770c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f770b7fe640 1 -- 172.21.15.28:0/1536150092 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c154930 con 0x7f770c0c7ea0 2023-12-16T03:25:47.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.763+0000 7f77108ba640 1 --2- 172.21.15.28:0/1536150092 >> v2:172.21.15.134:3300/0 conn(0x7f770c06b9e0 0x7f770c15f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:47.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f770b7fe640 1 --2- 172.21.15.28:0/1536150092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f770c0c7ea0 0x7f770c06b4a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f77000097c0 tx=0x7f770001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7c46d2922a69430 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:47.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f770affd640 1 -- 172.21.15.28:0/1536150092 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000ab600 con 0x7f770c0c7ea0 2023-12-16T03:25:47.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f770affd640 1 -- 172.21.15.28:0/1536150092 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77000a7050 con 0x7f770c0c7ea0 2023-12-16T03:25:47.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f770affd640 1 -- 172.21.15.28:0/1536150092 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000ab980 con 0x7f770c0c7ea0 2023-12-16T03:25:47.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f771231d640 1 -- 172.21.15.28:0/1536150092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f770c0c7ea0 msgr2=0x7f770c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f771231d640 1 --2- 172.21.15.28:0/1536150092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f770c0c7ea0 0x7f770c06b4a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f77000097c0 tx=0x7f770001c360 comp rx=0 tx=0).stop 2023-12-16T03:25:47.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f771231d640 1 -- 172.21.15.28:0/1536150092 shutdown_connections 2023-12-16T03:25:47.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f771231d640 1 --2- 172.21.15.28:0/1536150092 >> v2:172.21.15.134:3300/0 conn(0x7f770c06b9e0 0x7f770c15f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f771231d640 1 --2- 172.21.15.28:0/1536150092 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f770c0c7ea0 0x7f770c06b4a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f771231d640 1 -- 172.21.15.28:0/1536150092 >> 172.21.15.28:0/1536150092 conn(0x7f770c0ca170 msgr2=0x7f770c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:47.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f771231d640 1 -- 172.21.15.28:0/1536150092 shutdown_connections 2023-12-16T03:25:47.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.767+0000 7f771231d640 1 -- 172.21.15.28:0/1536150092 wait complete. 2023-12-16T03:25:47.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f771231d640 1 Processor -- start 2023-12-16T03:25:47.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f771231d640 1 -- start start 2023-12-16T03:25:47.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f771231d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f770c06b9e0 0x7f770c1f0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f771231d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c0c7ea0 0x7f770c14e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f771231d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f770c151e90 0x7f770c14ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f771231d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c14c630 con 0x7f770c151e90 2023-12-16T03:25:47.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f771231d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c15f3c0 con 0x7f770c0c7ea0 2023-12-16T03:25:47.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f771231d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c1f0dd0 con 0x7f770c06b9e0 2023-12-16T03:25:47.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f77108ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f770c151e90 0x7f770c14ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f77108ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f770c151e90 0x7f770c14ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34854/0 (socket says 172.21.15.28:34854) 2023-12-16T03:25:47.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f77108ba640 1 -- 172.21.15.28:0/3494203766 learned_addr learned my addr 172.21.15.28:0/3494203766 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:47.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f770b7fe640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c0c7ea0 0x7f770c14e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f770bfff640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f770c06b9e0 0x7f770c1f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f77108ba640 1 -- 172.21.15.28:0/3494203766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f770c06b9e0 msgr2=0x7f770c1f0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f77108ba640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f770c06b9e0 0x7f770c1f0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f77108ba640 1 -- 172.21.15.28:0/3494203766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c0c7ea0 msgr2=0x7f770c14e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f77108ba640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c0c7ea0 0x7f770c14e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f77108ba640 1 -- 172.21.15.28:0/3494203766 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7704009a70 con 0x7f770c151e90 2023-12-16T03:25:47.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f77108ba640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f770c151e90 0x7f770c14ee30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f770400efc0 tx=0x7f770400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:47.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f7708ff9640 1 -- 172.21.15.28:0/3494203766 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704009cd0 con 0x7f770c151e90 2023-12-16T03:25:47.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f7708ff9640 1 -- 172.21.15.28:0/3494203766 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770400f040 con 0x7f770c151e90 2023-12-16T03:25:47.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f7708ff9640 1 -- 172.21.15.28:0/3494203766 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77040039a0 con 0x7f770c151e90 2023-12-16T03:25:47.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.771+0000 7f771231d640 1 -- 172.21.15.28:0/3494203766 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7700009420 con 0x7f770c151e90 2023-12-16T03:25:47.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.775+0000 7f771231d640 1 -- 172.21.15.28:0/3494203766 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c0ac460 con 0x7f770c151e90 2023-12-16T03:25:47.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.775+0000 7f771231d640 1 -- 172.21.15.28:0/3494203766 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c068400 con 0x7f770c151e90 2023-12-16T03:25:47.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.775+0000 7f7708ff9640 1 -- 172.21.15.28:0/3494203766 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7704014480 con 0x7f770c151e90 2023-12-16T03:25:47.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.775+0000 7f7708ff9640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f8066470 0x7f76f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:47.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.775+0000 7f7708ff9640 1 -- 172.21.15.28:0/3494203766 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7704084a40 con 0x7f770c151e90 2023-12-16T03:25:47.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.775+0000 7f770bfff640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f8066470 0x7f76f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:47.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.775+0000 7f770bfff640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f8066470 0x7f76f8068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0011f0 tx=0x7f76fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:47.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.779+0000 7f7708ff9640 1 -- 172.21.15.28:0/3494203766 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7704051eb0 con 0x7f770c151e90 2023-12-16T03:25:47.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 -- 172.21.15.28:0/3494203766 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f770c06ca50 con 0x7f770c151e90 2023-12-16T03:25:47.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f7708ff9640 1 -- 172.21.15.28:0/3494203766 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7704018080 con 0x7f770c151e90 2023-12-16T03:25:47.953 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:25:47.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 -- 172.21.15.28:0/3494203766 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f8066470 msgr2=0x7f76f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f8066470 0x7f76f8068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0011f0 tx=0x7f76fc009040 comp rx=0 tx=0).stop 2023-12-16T03:25:47.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 -- 172.21.15.28:0/3494203766 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f770c151e90 msgr2=0x7f770c14ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:47.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f770c151e90 0x7f770c14ee30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f770400efc0 tx=0x7f770400c490 comp rx=0 tx=0).stop 2023-12-16T03:25:47.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 -- 172.21.15.28:0/3494203766 shutdown_connections 2023-12-16T03:25:47.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76f8066470 0x7f76f8068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f770c151e90 0x7f770c14ee30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c0c7ea0 0x7f770c14e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 --2- 172.21.15.28:0/3494203766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f770c06b9e0 0x7f770c1f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 -- 172.21.15.28:0/3494203766 >> 172.21.15.28:0/3494203766 conn(0x7f770c0ca170 msgr2=0x7f770c152550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 -- 172.21.15.28:0/3494203766 shutdown_connections 2023-12-16T03:25:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:47.951+0000 7f771231d640 1 -- 172.21.15.28:0/3494203766 wait complete. 2023-12-16T03:25:47.976 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-16T03:25:47.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:47.977 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-16T03:25:48.018 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:25:48.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:25:48.019 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T03:25:48.072 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-16T03:25:48.072 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:25:48.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c74d6640 1 Processor -- start 2023-12-16T03:25:48.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c74d6640 1 -- start start 2023-12-16T03:25:48.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c74d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c00c7ea0 0x7f71c006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c74d6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f71c006b9e0 0x7f71c015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c74d6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c006c860 con 0x7f71c0151e90 2023-12-16T03:25:48.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c74d6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c00c8750 con 0x7f71c006b9e0 2023-12-16T03:25:48.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c74d6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c01552d0 con 0x7f71c00c7ea0 2023-12-16T03:25:48.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c5272640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f71c0151e90 0x7f71c00c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57570/0 (socket says 172.21.15.28:57570) 2023-12-16T03:25:48.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c5272640 1 -- 172.21.15.28:0/2902578917 learned_addr learned my addr 172.21.15.28:0/2902578917 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:48.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c5a73640 1 --2- 172.21.15.28:0/2902578917 >> v2:172.21.15.134:3300/0 conn(0x7f71c006b9e0 0x7f71c015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c4a71640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c00c7ea0 0x7f71c006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445872130 0 0) 0x7f71c006c860 con 0x7f71c0151e90 2023-12-16T03:25:48.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71ac003530 con 0x7f71c0151e90 2023-12-16T03:25:48.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3119464928 0 0) 0x7f71ac003530 con 0x7f71c0151e90 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c00c7ea0 msgr2=0x7f71c006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c00c7ea0 0x7f71c006b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 >> v2:172.21.15.134:3300/0 conn(0x7f71c006b9e0 msgr2=0x7f71c015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 --2- 172.21.15.28:0/2902578917 >> v2:172.21.15.134:3300/0 conn(0x7f71c006b9e0 0x7f71c015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0154930 con 0x7f71c0151e90 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f71bc001680 con 0x7f71c0151e90 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 >> v1:172.21.15.28:6789/0 conn(0x7f71c0151e90 legacy=0x7f71c00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c00c7ea0 0x7f71ac003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71ac003f50 0x7f71ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ac004d10 0x7f71ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c00c8750 con 0x7f71ac003f50 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c01552d0 con 0x7f71ac004d10 2023-12-16T03:25:48.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac00bac0 con 0x7f71c00c7ea0 2023-12-16T03:25:48.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c4a71640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71ac003f50 0x7f71ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c5272640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c00c7ea0 0x7f71ac003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.211+0000 7f71c5a73640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ac004d10 0x7f71ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71c4a71640 1 -- 172.21.15.28:0/2902578917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c00c7ea0 msgr2=0x7f71ac003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:48.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71c4a71640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c00c7ea0 0x7f71ac003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71c4a71640 1 -- 172.21.15.28:0/2902578917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ac004d10 msgr2=0x7f71ac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:48.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71c4a71640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ac004d10 0x7f71ac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71c4a71640 1 -- 172.21.15.28:0/2902578917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac003530 con 0x7f71ac003f50 2023-12-16T03:25:48.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71c4a71640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71ac003f50 0x7f71ac0047d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009ab0 tx=0x7f71b001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cfcb0d40fb652a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:48.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00a6410 con 0x7f71ac003f50 2023-12-16T03:25:48.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b00a6570 con 0x7f71ac003f50 2023-12-16T03:25:48.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71b7fff640 1 -- 172.21.15.28:0/2902578917 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00a6920 con 0x7f71ac003f50 2023-12-16T03:25:48.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71c74d6640 1 -- 172.21.15.28:0/2902578917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71ac003f50 msgr2=0x7f71ac0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71c74d6640 1 --2- 172.21.15.28:0/2902578917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71ac003f50 0x7f71ac0047d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009ab0 tx=0x7f71b001ca30 comp rx=0 tx=0).stop 2023-12-16T03:25:48.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.215+0000 7f71c5a73640 1 -- 172.21.15.28:0/2902578917 reap_dead start 2023-12-16T03:25:48.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 -- 172.21.15.28:0/2902578917 shutdown_connections 2023-12-16T03:25:48.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 -- 172.21.15.28:0/2902578917 >> 172.21.15.28:0/2902578917 conn(0x7f71c00ca170 msgr2=0x7f71c00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:48.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 -- 172.21.15.28:0/2902578917 shutdown_connections 2023-12-16T03:25:48.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 -- 172.21.15.28:0/2902578917 wait complete. 2023-12-16T03:25:48.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 Processor -- start 2023-12-16T03:25:48.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 -- start start 2023-12-16T03:25:48.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ac003f50 0x7f71c00c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c00ac450 0x7f71c00c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c015e340 0x7f71c00a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c015ec40 con 0x7f71c00ac450 2023-12-16T03:25:48.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c00c2f50 con 0x7f71ac003f50 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c74d6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c00c2620 con 0x7f71c015e340 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c4a71640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c00ac450 0x7f71c00c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c4a71640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c00ac450 0x7f71c00c1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34870/0 (socket says 172.21.15.28:34870) 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c4a71640 1 -- 172.21.15.28:0/424817580 learned_addr learned my addr 172.21.15.28:0/424817580 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c5a73640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c015e340 0x7f71c00a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c5272640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ac003f50 0x7f71c00c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c4a71640 1 -- 172.21.15.28:0/424817580 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c015e340 msgr2=0x7f71c00a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c4a71640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c015e340 0x7f71c00a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c4a71640 1 -- 172.21.15.28:0/424817580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ac003f50 msgr2=0x7f71c00c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c4a71640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ac003f50 0x7f71c00c33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c4a71640 1 -- 172.21.15.28:0/424817580 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c00c2900 con 0x7f71c00ac450 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c5272640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ac003f50 0x7f71c00c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:48.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.219+0000 7f71c4a71640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c00ac450 0x7f71c00c1a80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f71b0000c10 tx=0x7f71ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:48.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.223+0000 7f71b5ffb640 1 -- 172.21.15.28:0/424817580 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00b5070 con 0x7f71c00ac450 2023-12-16T03:25:48.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.223+0000 7f71b5ffb640 1 -- 172.21.15.28:0/424817580 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b000f000 con 0x7f71c00ac450 2023-12-16T03:25:48.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.223+0000 7f71c74d6640 1 -- 172.21.15.28:0/424817580 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c015ec40 con 0x7f71c00ac450 2023-12-16T03:25:48.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.223+0000 7f71b5ffb640 1 -- 172.21.15.28:0/424817580 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00b03f0 con 0x7f71c00ac450 2023-12-16T03:25:48.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.223+0000 7f71c74d6640 1 -- 172.21.15.28:0/424817580 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c015e7c0 con 0x7f71c00ac450 2023-12-16T03:25:48.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.223+0000 7f71c74d6640 1 -- 172.21.15.28:0/424817580 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c00c30c0 con 0x7f71c00ac450 2023-12-16T03:25:48.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.223+0000 7f71b5ffb640 1 -- 172.21.15.28:0/424817580 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f71b00b0550 con 0x7f71c00ac450 2023-12-16T03:25:48.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.223+0000 7f71b5ffb640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71a40664a0 0x7f71a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.223+0000 7f71b5ffb640 1 -- 172.21.15.28:0/424817580 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71b011d340 con 0x7f71c00ac450 2023-12-16T03:25:48.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.223+0000 7f71c5272640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71a40664a0 0x7f71a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.227+0000 7f71c5272640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71a40664a0 0x7f71a4068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f71bc000c10 tx=0x7f71bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:48.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.227+0000 7f71b5ffb640 1 -- 172.21.15.28:0/424817580 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f71b00ea7d0 con 0x7f71c00ac450 2023-12-16T03:25:48.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71c74d6640 1 -- 172.21.15.28:0/424817580 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71c0068400 con 0x7f71c00ac450 2023-12-16T03:25:48.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71b5ffb640 1 -- 172.21.15.28:0/424817580 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f71b00eddf0 con 0x7f71c00ac450 2023-12-16T03:25:48.423 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:48.423 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/2517100030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2517100030},{"type":"v1","addr":"172.21.15.134:6835","nonce":2517100030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/146686059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":146686059},{"type":"v1","addr":"172.21.15.28:6836","nonce":146686059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1280024314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1280024314},{"type":"v1","addr":"172.21.15.28:6837","nonce":1280024314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:25:15.321507+0000","modified":"2023-12-16T03:25:18.328454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/199412786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":199412786},{"type":"v1","addr":"172.21.15.134:6834","nonce":199412786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T03:25:48.423 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71c74d6640 1 -- 172.21.15.28:0/424817580 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71a40664a0 msgr2=0x7f71a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71c74d6640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71a40664a0 0x7f71a4068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f71bc000c10 tx=0x7f71bc009040 comp rx=0 tx=0).stop 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71c74d6640 1 -- 172.21.15.28:0/424817580 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c00ac450 msgr2=0x7f71c00c1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71c74d6640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c00ac450 0x7f71c00c1a80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f71b0000c10 tx=0x7f71ac005800 comp rx=0 tx=0).stop 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71c74d6640 1 -- 172.21.15.28:0/424817580 shutdown_connections 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71c74d6640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71c015e340 0x7f71c00a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71c74d6640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71a40664a0 0x7f71a4068960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71c74d6640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f71c00ac450 0x7f71c00c1a80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71c74d6640 1 --2- 172.21.15.28:0/424817580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ac003f50 0x7f71c00c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.419+0000 7f71c74d6640 1 -- 172.21.15.28:0/424817580 >> 172.21.15.28:0/424817580 conn(0x7f71c00ca170 msgr2=0x7f71c014b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.423+0000 7f71c74d6640 1 -- 172.21.15.28:0/424817580 shutdown_connections 2023-12-16T03:25:48.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.423+0000 7f71c74d6640 1 -- 172.21.15.28:0/424817580 wait complete. 2023-12-16T03:25:48.444 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:48.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c1ef1d640 1 Processor -- start 2023-12-16T03:25:48.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c1ef1d640 1 -- start start 2023-12-16T03:25:48.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c1ef1d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8c1806bbb0 0x7f8c181600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c1ef1d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1806c860 con 0x7f8c180c7ea0 2023-12-16T03:25:48.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c1ef1d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1806c000 con 0x7f8c18151e90 2023-12-16T03:25:48.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c1ef1d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c180c8750 con 0x7f8c1806bbb0 2023-12-16T03:25:48.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c17fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8c180c7ea0 0x7f8c1806b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57584/0 (socket says 172.21.15.28:57584) 2023-12-16T03:25:48.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c17fff640 1 -- 172.21.15.28:0/2731259413 learned_addr learned my addr 172.21.15.28:0/2731259413 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:48.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c1d4ba640 1 --2- 172.21.15.28:0/2731259413 >> v2:172.21.15.134:3300/0 conn(0x7f8c1806bbb0 0x7f8c181600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c177fe640 1 -- 172.21.15.28:0/2731259413 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362698700 0 0) 0x7f8c1806c860 con 0x7f8c180c7ea0 2023-12-16T03:25:48.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c177fe640 1 -- 172.21.15.28:0/2731259413 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c08003530 con 0x7f8c180c7ea0 2023-12-16T03:25:48.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c177fe640 1 -- 172.21.15.28:0/2731259413 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194575107 0 0) 0x7f8c1806c000 con 0x7f8c18151e90 2023-12-16T03:25:48.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c177fe640 1 -- 172.21.15.28:0/2731259413 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c1806c860 con 0x7f8c18151e90 2023-12-16T03:25:48.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c1d4ba640 1 -- 172.21.15.28:0/2731259413 >> v1:172.21.15.134:6789/0 conn(0x7f8c18151e90 legacy=0x7f8c180c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c1d4ba640 1 -- 172.21.15.28:0/2731259413 >> v1:172.21.15.28:6789/0 conn(0x7f8c180c7ea0 legacy=0x7f8c1806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.586+0000 7f8c1d4ba640 1 -- 172.21.15.28:0/2731259413 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c18154930 con 0x7f8c1806bbb0 2023-12-16T03:25:48.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.590+0000 7f8c1d4ba640 1 --2- 172.21.15.28:0/2731259413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1806bbb0 0x7f8c181600b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009d90 tx=0x7f8c1001c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dafe14e5524155c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.590+0000 7f8c177fe640 1 -- 172.21.15.28:0/2731259413 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100a6700 con 0x7f8c1806bbb0 2023-12-16T03:25:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.590+0000 7f8c177fe640 1 -- 172.21.15.28:0/2731259413 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c100a6860 con 0x7f8c1806bbb0 2023-12-16T03:25:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.590+0000 7f8c177fe640 1 -- 172.21.15.28:0/2731259413 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100a6bf0 con 0x7f8c1806bbb0 2023-12-16T03:25:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.590+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/2731259413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1806bbb0 msgr2=0x7f8c181600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.590+0000 7f8c1ef1d640 1 --2- 172.21.15.28:0/2731259413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1806bbb0 0x7f8c181600b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009d90 tx=0x7f8c1001c830 comp rx=0 tx=0).stop 2023-12-16T03:25:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.590+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/2731259413 shutdown_connections 2023-12-16T03:25:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.590+0000 7f8c1ef1d640 1 --2- 172.21.15.28:0/2731259413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c1806bbb0 0x7f8c181600b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.590+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/2731259413 >> 172.21.15.28:0/2731259413 conn(0x7f8c180ca170 msgr2=0x7f8c180ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.590+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/2731259413 shutdown_connections 2023-12-16T03:25:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.590+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/2731259413 wait complete. 2023-12-16T03:25:48.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1ef1d640 1 Processor -- start 2023-12-16T03:25:48.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1ef1d640 1 -- start start 2023-12-16T03:25:48.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1ef1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c1806bbb0 0x7f8c181eae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1ef1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c180c7ea0 0x7f8c181f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1ef1d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c18151e90 0x7f8c181f0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1ef1d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c181552d0 con 0x7f8c18151e90 2023-12-16T03:25:48.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1ef1d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c181f0e70 con 0x7f8c180c7ea0 2023-12-16T03:25:48.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1ef1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c181562e0 con 0x7f8c1806bbb0 2023-12-16T03:25:48.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1d4ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c18151e90 0x7f8c181f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1d4ba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c18151e90 0x7f8c181f0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34872/0 (socket says 172.21.15.28:34872) 2023-12-16T03:25:48.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1d4ba640 1 -- 172.21.15.28:0/910538417 learned_addr learned my addr 172.21.15.28:0/910538417 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:48.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1ccb9640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c1806bbb0 0x7f8c181eae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c17fff640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c180c7ea0 0x7f8c181f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1d4ba640 1 -- 172.21.15.28:0/910538417 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c1806bbb0 msgr2=0x7f8c181eae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1d4ba640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c1806bbb0 0x7f8c181eae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1d4ba640 1 -- 172.21.15.28:0/910538417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c180c7ea0 msgr2=0x7f8c181f03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1d4ba640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c180c7ea0 0x7f8c181f03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1d4ba640 1 -- 172.21.15.28:0/910538417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10009a70 con 0x7f8c18151e90 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1d4ba640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c18151e90 0x7f8c181f0930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8c1001a460 tx=0x7f8c100195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c157fa640 1 -- 172.21.15.28:0/910538417 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100b8630 con 0x7f8c18151e90 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c157fa640 1 -- 172.21.15.28:0/910538417 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c100b8790 con 0x7f8c18151e90 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c157fa640 1 -- 172.21.15.28:0/910538417 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100b8b20 con 0x7f8c18151e90 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/910538417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c181f1330 con 0x7f8c18151e90 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.594+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/910538417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c181f1100 con 0x7f8c18151e90 2023-12-16T03:25:48.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.598+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/910538417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c18068400 con 0x7f8c18151e90 2023-12-16T03:25:48.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.598+0000 7f8c157fa640 1 -- 172.21.15.28:0/910538417 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8c100b8c80 con 0x7f8c18151e90 2023-12-16T03:25:48.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.598+0000 7f8c157fa640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8bfc066470 0x7f8bfc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.598+0000 7f8c157fa640 1 -- 172.21.15.28:0/910538417 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c100aa070 con 0x7f8c18151e90 2023-12-16T03:25:48.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.598+0000 7f8c1ccb9640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8bfc066470 0x7f8bfc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.598+0000 7f8c1ccb9640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8bfc066470 0x7f8bfc068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0011f0 tx=0x7f8c0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:48.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.602+0000 7f8c157fa640 1 -- 172.21.15.28:0/910538417 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8c100ec880 con 0x7f8c18151e90 2023-12-16T03:25:48.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.758+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/910538417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c1806ca50 con 0x7f8c18151e90 2023-12-16T03:25:48.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c157fa640 1 -- 172.21.15.28:0/910538417 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f8c100efea0 con 0x7f8c18151e90 2023-12-16T03:25:48.766 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:48.766 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:48.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/910538417 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8bfc066470 msgr2=0x7f8bfc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8bfc066470 0x7f8bfc068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0011f0 tx=0x7f8c0c009040 comp rx=0 tx=0).stop 2023-12-16T03:25:48.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/910538417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c18151e90 msgr2=0x7f8c181f0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c18151e90 0x7f8c181f0930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8c1001a460 tx=0x7f8c100195d0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/910538417 shutdown_connections 2023-12-16T03:25:48.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8bfc066470 0x7f8bfc068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c18151e90 0x7f8c181f0930 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c180c7ea0 0x7f8c181f03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 --2- 172.21.15.28:0/910538417 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c1806bbb0 0x7f8c181eae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/910538417 >> 172.21.15.28:0/910538417 conn(0x7f8c180ca170 msgr2=0x7f8c1814ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:48.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/910538417 shutdown_connections 2023-12-16T03:25:48.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.762+0000 7f8c1ef1d640 1 -- 172.21.15.28:0/910538417 wait complete. 2023-12-16T03:25:48.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:25:13.885447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:25:14.309086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:48.788 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:48.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf38b72640 1 Processor -- start 2023-12-16T03:25:48.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf38b72640 1 -- start start 2023-12-16T03:25:48.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf38b72640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcf3406c470 0x7fcf340c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf38b72640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf34157c90 0x7fcf340c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf38b72640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf34154b60 con 0x7fcf34152030 2023-12-16T03:25:48.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf38b72640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf34152410 con 0x7fcf3406c470 2023-12-16T03:25:48.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf38b72640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34155700 con 0x7fcf34157c90 2023-12-16T03:25:48.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf2bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcf3406c470 0x7fcf340c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf3259c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcf34152030 0x7fcf34154ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57594/0 (socket says 172.21.15.28:57594) 2023-12-16T03:25:48.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf3259c640 1 -- 172.21.15.28:0/1340903473 learned_addr learned my addr 172.21.15.28:0/1340903473 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:48.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf32d9d640 1 --2- 172.21.15.28:0/1340903473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf34157c90 0x7fcf340c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf2bfff640 1 -- 172.21.15.28:0/1340903473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf34157c90 msgr2=0x7fcf340c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:48.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/1340903473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf34157c90 0x7fcf340c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf2bfff640 1 -- 172.21.15.28:0/1340903473 >> v1:172.21.15.28:6789/0 conn(0x7fcf34152030 legacy=0x7fcf34154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf2bfff640 1 -- 172.21.15.28:0/1340903473 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34158100 con 0x7fcf3406c470 2023-12-16T03:25:48.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.930+0000 7fcf32d9d640 1 --2- 172.21.15.28:0/1340903473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf34157c90 0x7fcf340c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:48.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/1340903473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf3406c470 0x7fcf340c0c40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0097c0 tx=0x7fcf1c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad84bb6f144e516 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:48.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf31d9b640 1 -- 172.21.15.28:0/1340903473 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0ab5f0 con 0x7fcf3406c470 2023-12-16T03:25:48.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf31d9b640 1 -- 172.21.15.28:0/1340903473 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c0ab750 con 0x7fcf3406c470 2023-12-16T03:25:48.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf31d9b640 1 -- 172.21.15.28:0/1340903473 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0abae0 con 0x7fcf3406c470 2023-12-16T03:25:48.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf38b72640 1 -- 172.21.15.28:0/1340903473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf3406c470 msgr2=0x7fcf340c0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf38b72640 1 --2- 172.21.15.28:0/1340903473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf3406c470 0x7fcf340c0c40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0097c0 tx=0x7fcf1c01c3f0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf38b72640 1 -- 172.21.15.28:0/1340903473 shutdown_connections 2023-12-16T03:25:48.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf38b72640 1 --2- 172.21.15.28:0/1340903473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf34157c90 0x7fcf340c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf38b72640 1 --2- 172.21.15.28:0/1340903473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf3406c470 0x7fcf340c0c40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf38b72640 1 -- 172.21.15.28:0/1340903473 >> 172.21.15.28:0/1340903473 conn(0x7fcf3406a5b0 msgr2=0x7fcf3406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:48.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf38b72640 1 -- 172.21.15.28:0/1340903473 shutdown_connections 2023-12-16T03:25:48.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.934+0000 7fcf38b72640 1 -- 172.21.15.28:0/1340903473 wait complete. 2023-12-16T03:25:48.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf38b72640 1 Processor -- start 2023-12-16T03:25:48.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf38b72640 1 -- start start 2023-12-16T03:25:48.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf38b72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf3406c470 0x7fcf3414b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf38b72640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf34152030 0x7fcf34144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf38b72640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf34157c90 0x7fcf341f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf38b72640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34145d90 con 0x7fcf3406c470 2023-12-16T03:25:48.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf38b72640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf341f0ce0 con 0x7fcf34152030 2023-12-16T03:25:48.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf38b72640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34145700 con 0x7fcf34157c90 2023-12-16T03:25:48.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf3259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf3406c470 0x7fcf3414b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf3259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf3406c470 0x7fcf3414b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34894/0 (socket says 172.21.15.28:34894) 2023-12-16T03:25:48.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf3259c640 1 -- 172.21.15.28:0/4183633456 learned_addr learned my addr 172.21.15.28:0/4183633456 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:48.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf34152030 0x7fcf34144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf32d9d640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf34157c90 0x7fcf341f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf3259c640 1 -- 172.21.15.28:0/4183633456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf34157c90 msgr2=0x7fcf341f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf3259c640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf34157c90 0x7fcf341f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf3259c640 1 -- 172.21.15.28:0/4183633456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf34152030 msgr2=0x7fcf34144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:48.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf3259c640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf34152030 0x7fcf34144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:48.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf3259c640 1 -- 172.21.15.28:0/4183633456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c009420 con 0x7fcf3406c470 2023-12-16T03:25:48.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf3259c640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf3406c470 0x7fcf3414b080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c500 tx=0x7fcf2400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:48.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf2affd640 1 -- 172.21.15.28:0/4183633456 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24005cf0 con 0x7fcf3406c470 2023-12-16T03:25:48.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf2affd640 1 -- 172.21.15.28:0/4183633456 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf24005e50 con 0x7fcf3406c470 2023-12-16T03:25:48.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf2affd640 1 -- 172.21.15.28:0/4183633456 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf240072f0 con 0x7fcf3406c470 2023-12-16T03:25:48.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf38b72640 1 -- 172.21.15.28:0/4183633456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf341443f0 con 0x7fcf3406c470 2023-12-16T03:25:48.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.938+0000 7fcf38b72640 1 -- 172.21.15.28:0/4183633456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf34157710 con 0x7fcf3406c470 2023-12-16T03:25:48.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.942+0000 7fcf38b72640 1 -- 172.21.15.28:0/4183633456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3406d540 con 0x7fcf3406c470 2023-12-16T03:25:48.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.942+0000 7fcf2affd640 1 -- 172.21.15.28:0/4183633456 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcf24007450 con 0x7fcf3406c470 2023-12-16T03:25:48.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.942+0000 7fcf2affd640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf14066470 0x7fcf14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:48.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.942+0000 7fcf2affd640 1 -- 172.21.15.28:0/4183633456 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf24083330 con 0x7fcf3406c470 2023-12-16T03:25:48.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.942+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf14066470 0x7fcf14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:48.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.942+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf14066470 0x7fcf14068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0af000 tx=0x7fcf1c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:48.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:48.946+0000 7fcf2affd640 1 -- 172.21.15.28:0/4183633456 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcf24050850 con 0x7fcf3406c470 2023-12-16T03:25:49.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.110+0000 7fcf38b72640 1 -- 172.21.15.28:0/4183633456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf340c3bb0 con 0x7fcf3406c470 2023-12-16T03:25:49.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.110+0000 7fcf2affd640 1 -- 172.21.15.28:0/4183633456 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf24053e70 con 0x7fcf3406c470 2023-12-16T03:25:49.115 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:49.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 -- 172.21.15.28:0/4183633456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf14066470 msgr2=0x7fcf14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf14066470 0x7fcf14068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0af000 tx=0x7fcf1c0a7000 comp rx=0 tx=0).stop 2023-12-16T03:25:49.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 -- 172.21.15.28:0/4183633456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf3406c470 msgr2=0x7fcf3414b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf3406c470 0x7fcf3414b080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c500 tx=0x7fcf2400c9c0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 -- 172.21.15.28:0/4183633456 shutdown_connections 2023-12-16T03:25:49.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf34157c90 0x7fcf341f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf34152030 0x7fcf34144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf14066470 0x7fcf14068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 --2- 172.21.15.28:0/4183633456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf3406c470 0x7fcf3414b080 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 -- 172.21.15.28:0/4183633456 >> 172.21.15.28:0/4183633456 conn(0x7fcf3406a5b0 msgr2=0x7fcf3414f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 -- 172.21.15.28:0/4183633456 shutdown_connections 2023-12-16T03:25:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.114+0000 7fcf38b72640 1 -- 172.21.15.28:0/4183633456 wait complete. 2023-12-16T03:25:49.136 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:25:49.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e359e640 1 Processor -- start 2023-12-16T03:25:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e359e640 1 -- start start 2023-12-16T03:25:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e359e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f80e4151bb0 0x7f80e406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40c7c30 0x7f80e415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e359e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e40c8400 con 0x7f80e40bd3c0 2023-12-16T03:25:49.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e359e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e40c86e0 con 0x7f80e4151bb0 2023-12-16T03:25:49.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e359e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e41543e0 con 0x7f80e40c7c30 2023-12-16T03:25:49.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e259c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f80e4151bb0 0x7f80e406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e2d9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40c7c30 0x7f80e415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e2d9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40c7c30 0x7f80e415ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:54750/0 (socket says 172.21.15.28:54750) 2023-12-16T03:25:49.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e259c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f80e4151bb0 0x7f80e406ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:42892/0 (socket says 172.21.15.28:42892) 2023-12-16T03:25:49.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e2d9d640 1 -- 172.21.15.28:0/3242490833 learned_addr learned my addr 172.21.15.28:0/3242490833 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:49.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e2d9d640 1 -- 172.21.15.28:0/3242490833 >> v2:172.21.15.134:3300/0 conn(0x7f80e4151bb0 msgr2=0x7f80e406ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:49.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e2d9d640 1 --2- 172.21.15.28:0/3242490833 >> v2:172.21.15.134:3300/0 conn(0x7f80e4151bb0 0x7f80e406ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e2d9d640 1 -- 172.21.15.28:0/3242490833 >> v1:172.21.15.134:6789/0 conn(0x7f80e40bd3c0 legacy=0x7f80e40c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.278+0000 7f80e2d9d640 1 -- 172.21.15.28:0/3242490833 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e41545f0 con 0x7f80e40c7c30 2023-12-16T03:25:49.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e2d9d640 1 --2- 172.21.15.28:0/3242490833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40c7c30 0x7f80e415ed60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009e50 tx=0x7f80dc01c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f52551cd75a99b7f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:49.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e1d9b640 1 -- 172.21.15.28:0/3242490833 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0a5780 con 0x7f80e40c7c30 2023-12-16T03:25:49.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e1d9b640 1 -- 172.21.15.28:0/3242490833 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc0a58e0 con 0x7f80e40c7c30 2023-12-16T03:25:49.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e1d9b640 1 -- 172.21.15.28:0/3242490833 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0a5c70 con 0x7f80e40c7c30 2023-12-16T03:25:49.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e359e640 1 -- 172.21.15.28:0/3242490833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40c7c30 msgr2=0x7f80e415ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e359e640 1 --2- 172.21.15.28:0/3242490833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40c7c30 0x7f80e415ed60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009e50 tx=0x7f80dc01c8c0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e359e640 1 -- 172.21.15.28:0/3242490833 shutdown_connections 2023-12-16T03:25:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e359e640 1 --2- 172.21.15.28:0/3242490833 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40c7c30 0x7f80e415ed60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e359e640 1 --2- 172.21.15.28:0/3242490833 >> v2:172.21.15.134:3300/0 conn(0x7f80e4151bb0 0x7f80e406ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e359e640 1 -- 172.21.15.28:0/3242490833 >> 172.21.15.28:0/3242490833 conn(0x7f80e40abcc0 msgr2=0x7f80e40ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e359e640 1 -- 172.21.15.28:0/3242490833 shutdown_connections 2023-12-16T03:25:49.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.282+0000 7f80e359e640 1 -- 172.21.15.28:0/3242490833 wait complete. 2023-12-16T03:25:49.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e359e640 1 Processor -- start 2023-12-16T03:25:49.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e359e640 1 -- start start 2023-12-16T03:25:49.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40bd3c0 0x7f80e41f0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80e40c7c30 0x7f80e4157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80e4151bb0 0x7f80e41575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e359e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40c0320 con 0x7f80e40c7c30 2023-12-16T03:25:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e359e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e414ded0 con 0x7f80e4151bb0 2023-12-16T03:25:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e359e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e41f1050 con 0x7f80e40bd3c0 2023-12-16T03:25:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80dbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80e40c7c30 0x7f80e4157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80e4151bb0 0x7f80e41575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80dbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80e40c7c30 0x7f80e4157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34908/0 (socket says 172.21.15.28:34908) 2023-12-16T03:25:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80dbfff640 1 -- 172.21.15.28:0/2731058330 learned_addr learned my addr 172.21.15.28:0/2731058330 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e2d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80e4151bb0 0x7f80e41575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:42908/0 (socket says 172.21.15.28:42908) 2023-12-16T03:25:49.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e259c640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40bd3c0 0x7f80e41f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80dbfff640 1 -- 172.21.15.28:0/2731058330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40bd3c0 msgr2=0x7f80e41f0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80dbfff640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40bd3c0 0x7f80e41f0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80dbfff640 1 -- 172.21.15.28:0/2731058330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80e4151bb0 msgr2=0x7f80e41575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80dbfff640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80e4151bb0 0x7f80e41575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80dbfff640 1 -- 172.21.15.28:0/2731058330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc009b30 con 0x7f80e40c7c30 2023-12-16T03:25:49.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80dbfff640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80e40c7c30 0x7f80e4157080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c3c0 tx=0x7f80cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:49.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80daffd640 1 -- 172.21.15.28:0/2731058330 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0052d0 con 0x7f80e40c7c30 2023-12-16T03:25:49.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80daffd640 1 -- 172.21.15.28:0/2731058330 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc005430 con 0x7f80e40c7c30 2023-12-16T03:25:49.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e359e640 1 -- 172.21.15.28:0/2731058330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e41565a0 con 0x7f80e40c7c30 2023-12-16T03:25:49.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80daffd640 1 -- 172.21.15.28:0/2731058330 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc003840 con 0x7f80e40c7c30 2023-12-16T03:25:49.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.286+0000 7f80e359e640 1 -- 172.21.15.28:0/2731058330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e4156b60 con 0x7f80e40c7c30 2023-12-16T03:25:49.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.290+0000 7f80e359e640 1 -- 172.21.15.28:0/2731058330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e4067e90 con 0x7f80e40c7c30 2023-12-16T03:25:49.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.290+0000 7f80daffd640 1 -- 172.21.15.28:0/2731058330 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f80cc0039a0 con 0x7f80e40c7c30 2023-12-16T03:25:49.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.290+0000 7f80daffd640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80c4066470 0x7f80c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.290+0000 7f80daffd640 1 -- 172.21.15.28:0/2731058330 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80cc0833f0 con 0x7f80e40c7c30 2023-12-16T03:25:49.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.290+0000 7f80e259c640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80c4066470 0x7f80c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.290+0000 7f80e259c640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80c4066470 0x7f80c4068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009b60 tx=0x7f80d4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:49.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.294+0000 7f80daffd640 1 -- 172.21.15.28:0/2731058330 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f80cc0507f0 con 0x7f80e40c7c30 2023-12-16T03:25:49.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.454+0000 7f80e359e640 1 -- 172.21.15.28:0/2731058330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80e4156d50 con 0x7f80e40c7c30 2023-12-16T03:25:49.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.454+0000 7f80daffd640 1 -- 172.21.15.28:0/2731058330 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80cc053e10 con 0x7f80e40c7c30 2023-12-16T03:25:49.459 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:25:49.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 -- 172.21.15.28:0/2731058330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80c4066470 msgr2=0x7f80c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80c4066470 0x7f80c4068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009b60 tx=0x7f80d4009190 comp rx=0 tx=0).stop 2023-12-16T03:25:49.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 -- 172.21.15.28:0/2731058330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80e40c7c30 msgr2=0x7f80e4157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80e40c7c30 0x7f80e4157080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c3c0 tx=0x7f80cc00c880 comp rx=0 tx=0).stop 2023-12-16T03:25:49.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 -- 172.21.15.28:0/2731058330 shutdown_connections 2023-12-16T03:25:49.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80e4151bb0 0x7f80e41575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80c4066470 0x7f80c4068930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80e40c7c30 0x7f80e4157080 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 --2- 172.21.15.28:0/2731058330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80e40bd3c0 0x7f80e41f0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 -- 172.21.15.28:0/2731058330 >> 172.21.15.28:0/2731058330 conn(0x7f80e40abcc0 msgr2=0x7f80e40c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:49.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 -- 172.21.15.28:0/2731058330 shutdown_connections 2023-12-16T03:25:49.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.458+0000 7f80e359e640 1 -- 172.21.15.28:0/2731058330 wait complete. 2023-12-16T03:25:49.480 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:25:49.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.622+0000 7f249b217640 1 Processor -- start 2023-12-16T03:25:49.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.622+0000 7f249b217640 1 -- start start 2023-12-16T03:25:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.622+0000 7f249b217640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f24940c4100 0x7f24940c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.622+0000 7f249b217640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24940c06d0 0x7f24940a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.622+0000 7f249b217640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24940c31c0 con 0x7f24940c63c0 2023-12-16T03:25:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.622+0000 7f249b217640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24940c34a0 con 0x7f24940c4100 2023-12-16T03:25:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.622+0000 7f249b217640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24940c1030 con 0x7f24940c06d0 2023-12-16T03:25:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f2493fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f24940c4100 0x7f24940c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f2493fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f24940c4100 0x7f24940c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57448/0 (socket says 172.21.15.28:57448) 2023-12-16T03:25:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f2493fff640 1 -- 172.21.15.28:0/567758977 learned_addr learned my addr 172.21.15.28:0/567758977 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:49.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f2493fff640 1 -- 172.21.15.28:0/567758977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24940c06d0 msgr2=0x7f24940a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:49.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f24997b4640 1 --2- 172.21.15.28:0/567758977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24940c06d0 0x7f24940a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f2493fff640 1 --2- 172.21.15.28:0/567758977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24940c06d0 0x7f24940a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f2493fff640 1 -- 172.21.15.28:0/567758977 >> v1:172.21.15.28:6789/0 conn(0x7f24940c63c0 legacy=0x7f24940c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f2493fff640 1 -- 172.21.15.28:0/567758977 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940c1310 con 0x7f24940c4100 2023-12-16T03:25:49.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f24997b4640 1 --2- 172.21.15.28:0/567758977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24940c06d0 0x7f24940a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:49.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f24937fe640 1 -- 172.21.15.28:0/567758977 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732396815 0 0) 0x7f24940c31c0 con 0x7f24940c63c0 2023-12-16T03:25:49.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f2493fff640 1 --2- 172.21.15.28:0/567758977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24940c4100 0x7f24940c2bb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2480009870 tx=0x7f248001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e2c567ea92b51e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:49.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f24937fe640 1 -- 172.21.15.28:0/567758977 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940aa3d0 con 0x7f24940c4100 2023-12-16T03:25:49.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f24937fe640 1 -- 172.21.15.28:0/567758977 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24800a7050 con 0x7f24940c4100 2023-12-16T03:25:49.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.626+0000 7f24937fe640 1 -- 172.21.15.28:0/567758977 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24800ab820 con 0x7f24940c4100 2023-12-16T03:25:49.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 -- 172.21.15.28:0/567758977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24940c4100 msgr2=0x7f24940c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 --2- 172.21.15.28:0/567758977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24940c4100 0x7f24940c2bb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2480009870 tx=0x7f248001c420 comp rx=0 tx=0).stop 2023-12-16T03:25:49.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 -- 172.21.15.28:0/567758977 shutdown_connections 2023-12-16T03:25:49.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 --2- 172.21.15.28:0/567758977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24940c06d0 0x7f24940a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 --2- 172.21.15.28:0/567758977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24940c4100 0x7f24940c2bb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 -- 172.21.15.28:0/567758977 >> 172.21.15.28:0/567758977 conn(0x7f249406a5b0 msgr2=0x7f249406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:49.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 -- 172.21.15.28:0/567758977 shutdown_connections 2023-12-16T03:25:49.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 -- 172.21.15.28:0/567758977 wait complete. 2023-12-16T03:25:49.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 Processor -- start 2023-12-16T03:25:49.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 -- start start 2023-12-16T03:25:49.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24940c06d0 0x7f24940a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24940c4100 0x7f24941ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24940c63c0 0x7f24941ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24941f0810 con 0x7f24940c63c0 2023-12-16T03:25:49.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24941f0af0 con 0x7f24940c4100 2023-12-16T03:25:49.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f249b217640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24941f0dd0 con 0x7f24940c06d0 2023-12-16T03:25:49.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f24997b4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24940c63c0 0x7f24941ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f24997b4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24940c63c0 0x7f24941ed800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57452/0 (socket says 172.21.15.28:57452) 2023-12-16T03:25:49.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f24997b4640 1 -- 172.21.15.28:0/2077005059 learned_addr learned my addr 172.21.15.28:0/2077005059 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:49.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f2498fb3640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24940c06d0 0x7f24940a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.630+0000 7f2493fff640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24940c4100 0x7f24941ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24997b4640 1 -- 172.21.15.28:0/2077005059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24940c06d0 msgr2=0x7f24940a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24997b4640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24940c06d0 0x7f24940a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24997b4640 1 -- 172.21.15.28:0/2077005059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24940c4100 msgr2=0x7f24941ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24997b4640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24940c4100 0x7f24941ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24997b4640 1 -- 172.21.15.28:0/2077005059 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24800094d0 con 0x7f24940c63c0 2023-12-16T03:25:49.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24997b4640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24940c63c0 0x7f24941ed800 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f248c00cef0 tx=0x7f248c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:49.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24917fa640 1 -- 172.21.15.28:0/2077005059 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00d840 con 0x7f24940c63c0 2023-12-16T03:25:49.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24917fa640 1 -- 172.21.15.28:0/2077005059 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c00d9c0 con 0x7f24940c63c0 2023-12-16T03:25:49.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24917fa640 1 -- 172.21.15.28:0/2077005059 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00dd70 con 0x7f24940c63c0 2023-12-16T03:25:49.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f249b217640 1 -- 172.21.15.28:0/2077005059 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24941f10b0 con 0x7f24940c63c0 2023-12-16T03:25:49.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f249b217640 1 -- 172.21.15.28:0/2077005059 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24941ecd30 con 0x7f24940c63c0 2023-12-16T03:25:49.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f249b217640 1 -- 172.21.15.28:0/2077005059 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24941ecfe0 con 0x7f24940c63c0 2023-12-16T03:25:49.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24917fa640 1 -- 172.21.15.28:0/2077005059 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f248c01e3b0 con 0x7f24940c63c0 2023-12-16T03:25:49.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24917fa640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2478066470 0x7f2478068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f24917fa640 1 -- 172.21.15.28:0/2077005059 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f248c084920 con 0x7f24940c63c0 2023-12-16T03:25:49.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.634+0000 7f2498fb3640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2478066470 0x7f2478068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.638+0000 7f2498fb3640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2478066470 0x7f2478068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2488007fd0 tx=0x7f2488009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:49.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.638+0000 7f24917fa640 1 -- 172.21.15.28:0/2077005059 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f24941ecfe0 con 0x7f24940c63c0 2023-12-16T03:25:49.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 -- 172.21.15.28:0/2077005059 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f24941ecfe0 con 0x7f24940c63c0 2023-12-16T03:25:49.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f24917fa640 1 -- 172.21.15.28:0/2077005059 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f24941ecfe0 con 0x7f24940c63c0 2023-12-16T03:25:49.802 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:25:49.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 -- 172.21.15.28:0/2077005059 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2478066470 msgr2=0x7f2478068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2478066470 0x7f2478068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2488007fd0 tx=0x7f2488009040 comp rx=0 tx=0).stop 2023-12-16T03:25:49.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 -- 172.21.15.28:0/2077005059 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24940c63c0 msgr2=0x7f24941ed800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24940c63c0 0x7f24941ed800 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f248c00cef0 tx=0x7f248c00a710 comp rx=0 tx=0).stop 2023-12-16T03:25:49.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 -- 172.21.15.28:0/2077005059 shutdown_connections 2023-12-16T03:25:49.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2478066470 0x7f2478068930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24940c63c0 0x7f24941ed800 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24940c4100 0x7f24941ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 --2- 172.21.15.28:0/2077005059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24940c06d0 0x7f24940a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 -- 172.21.15.28:0/2077005059 >> 172.21.15.28:0/2077005059 conn(0x7f249406a5b0 msgr2=0x7f2494155460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:49.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 -- 172.21.15.28:0/2077005059 shutdown_connections 2023-12-16T03:25:49.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.798+0000 7f249b217640 1 -- 172.21.15.28:0/2077005059 wait complete. 2023-12-16T03:25:49.823 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:25:49.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc992caa640 1 Processor -- start 2023-12-16T03:25:49.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc992caa640 1 -- start start 2023-12-16T03:25:49.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc992caa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc98c0c4100 0x7fc98c0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc992caa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc98c0c06d0 0x7fc98c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc992caa640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98c0c31c0 con 0x7fc98c0c63c0 2023-12-16T03:25:49.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc992caa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c0c34a0 con 0x7fc98c0c06d0 2023-12-16T03:25:49.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc992caa640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c0c1030 con 0x7fc98c0c4100 2023-12-16T03:25:49.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc991247640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc98c0c06d0 0x7fc98c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc990a46640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc98c0c63c0 0x7fc98c0c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:46980/0 (socket says 172.21.15.28:46980) 2023-12-16T03:25:49.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc990a46640 1 -- 172.21.15.28:0/1281539239 learned_addr learned my addr 172.21.15.28:0/1281539239 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:49.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc991247640 1 -- 172.21.15.28:0/1281539239 >> v2:172.21.15.134:3300/0 conn(0x7fc98c0c4100 msgr2=0x7fc98c0c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:49.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc98bfff640 1 --2- 172.21.15.28:0/1281539239 >> v2:172.21.15.134:3300/0 conn(0x7fc98c0c4100 0x7fc98c0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc98b7fe640 1 -- 172.21.15.28:0/1281539239 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040273701 0 0) 0x7fc98c0c31c0 con 0x7fc98c0c63c0 2023-12-16T03:25:49.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc991247640 1 --2- 172.21.15.28:0/1281539239 >> v2:172.21.15.134:3300/0 conn(0x7fc98c0c4100 0x7fc98c0c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc991247640 1 -- 172.21.15.28:0/1281539239 >> v1:172.21.15.28:6789/0 conn(0x7fc98c0c63c0 legacy=0x7fc98c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc991247640 1 -- 172.21.15.28:0/1281539239 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0c1310 con 0x7fc98c0c06d0 2023-12-16T03:25:49.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.962+0000 7fc98bfff640 1 --2- 172.21.15.28:0/1281539239 >> v2:172.21.15.134:3300/0 conn(0x7fc98c0c4100 0x7fc98c0c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:49.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc991247640 1 --2- 172.21.15.28:0/1281539239 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc98c0c06d0 0x7fc98c0a9680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0a8b40 tx=0x7fc98401c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551817926d0825bb server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:49.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc98b7fe640 1 -- 172.21.15.28:0/1281539239 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c0aa3d0 con 0x7fc98c0c06d0 2023-12-16T03:25:49.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc98b7fe640 1 -- 172.21.15.28:0/1281539239 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9840a57c0 con 0x7fc98c0c06d0 2023-12-16T03:25:49.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc98b7fe640 1 -- 172.21.15.28:0/1281539239 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9840a5b50 con 0x7fc98c0c06d0 2023-12-16T03:25:49.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc992caa640 1 -- 172.21.15.28:0/1281539239 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc98c0c06d0 msgr2=0x7fc98c0a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc992caa640 1 --2- 172.21.15.28:0/1281539239 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc98c0c06d0 0x7fc98c0a9680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0a8b40 tx=0x7fc98401c7f0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc992caa640 1 -- 172.21.15.28:0/1281539239 shutdown_connections 2023-12-16T03:25:49.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc992caa640 1 --2- 172.21.15.28:0/1281539239 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc98c0c06d0 0x7fc98c0a9680 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc992caa640 1 --2- 172.21.15.28:0/1281539239 >> v2:172.21.15.134:3300/0 conn(0x7fc98c0c4100 0x7fc98c0c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc992caa640 1 -- 172.21.15.28:0/1281539239 >> 172.21.15.28:0/1281539239 conn(0x7fc98c06a5b0 msgr2=0x7fc98c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:49.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc992caa640 1 -- 172.21.15.28:0/1281539239 shutdown_connections 2023-12-16T03:25:49.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.966+0000 7fc992caa640 1 -- 172.21.15.28:0/1281539239 wait complete. 2023-12-16T03:25:49.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc992caa640 1 Processor -- start 2023-12-16T03:25:49.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc992caa640 1 -- start start 2023-12-16T03:25:49.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc992caa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc98c0c06d0 0x7fc98c0719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc992caa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc98c0c4100 0x7fc98c1f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc992caa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc98c0c63c0 0x7fc98c1ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc992caa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c1eda30 con 0x7fc98c0c06d0 2023-12-16T03:25:49.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc992caa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c1f0710 con 0x7fc98c0c4100 2023-12-16T03:25:49.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc992caa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c071fc0 con 0x7fc98c0c63c0 2023-12-16T03:25:49.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc990a46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc98c0c06d0 0x7fc98c0719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc990a46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc98c0c06d0 0x7fc98c0719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57470/0 (socket says 172.21.15.28:57470) 2023-12-16T03:25:49.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc990a46640 1 -- 172.21.15.28:0/1695921082 learned_addr learned my addr 172.21.15.28:0/1695921082 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:49.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc990a46640 1 -- 172.21.15.28:0/1695921082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc98c0c63c0 msgr2=0x7fc98c1ed4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc990a46640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc98c0c63c0 0x7fc98c1ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc990a46640 1 -- 172.21.15.28:0/1695921082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc98c0c4100 msgr2=0x7fc98c1f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:49.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc990a46640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc98c0c4100 0x7fc98c1f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:49.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc990a46640 1 -- 172.21.15.28:0/1695921082 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc984009a70 con 0x7fc98c0c06d0 2023-12-16T03:25:49.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc990a46640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc98c0c06d0 0x7fc98c0719e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc980007fd0 tx=0x7fc98000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:49.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc9897fa640 1 -- 172.21.15.28:0/1695921082 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980005cf0 con 0x7fc98c0c06d0 2023-12-16T03:25:49.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc9897fa640 1 -- 172.21.15.28:0/1695921082 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc980005e50 con 0x7fc98c0c06d0 2023-12-16T03:25:49.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc9897fa640 1 -- 172.21.15.28:0/1695921082 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980007310 con 0x7fc98c0c06d0 2023-12-16T03:25:49.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc992caa640 1 -- 172.21.15.28:0/1695921082 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98c1f00c0 con 0x7fc98c0c06d0 2023-12-16T03:25:49.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.970+0000 7fc992caa640 1 -- 172.21.15.28:0/1695921082 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c0722a0 con 0x7fc98c0c06d0 2023-12-16T03:25:49.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.974+0000 7fc992caa640 1 -- 172.21.15.28:0/1695921082 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98c068400 con 0x7fc98c0c06d0 2023-12-16T03:25:49.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.974+0000 7fc9897fa640 1 -- 172.21.15.28:0/1695921082 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc980007470 con 0x7fc98c0c06d0 2023-12-16T03:25:49.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.974+0000 7fc9897fa640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9700664a0 0x7fc970068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:49.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.974+0000 7fc9897fa640 1 -- 172.21.15.28:0/1695921082 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc980083480 con 0x7fc98c0c06d0 2023-12-16T03:25:49.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.974+0000 7fc98bfff640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9700664a0 0x7fc970068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:49.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.974+0000 7fc98bfff640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9700664a0 0x7fc970068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc98c159410 tx=0x7fc978008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:49.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:49.978+0000 7fc9897fa640 1 -- 172.21.15.28:0/1695921082 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc9800508f0 con 0x7fc98c0c06d0 2023-12-16T03:25:50.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.170+0000 7fc992caa640 1 -- 172.21.15.28:0/1695921082 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc98c0c3e70 con 0x7fc98c0c06d0 2023-12-16T03:25:50.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.170+0000 7fc9897fa640 1 -- 172.21.15.28:0/1695921082 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7fc980053f10 con 0x7fc98c0c06d0 2023-12-16T03:25:50.175 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:50.175 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/2517100030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2517100030},{"type":"v1","addr":"172.21.15.134:6835","nonce":2517100030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/146686059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":146686059},{"type":"v1","addr":"172.21.15.28:6836","nonce":146686059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1280024314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1280024314},{"type":"v1","addr":"172.21.15.28:6837","nonce":1280024314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:25:15.321507+0000","modified":"2023-12-16T03:25:18.328454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/199412786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":199412786},{"type":"v1","addr":"172.21.15.134:6834","nonce":199412786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T03:25:50.176 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-12-16T03:25:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 -- 172.21.15.28:0/1695921082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9700664a0 msgr2=0x7fc970068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9700664a0 0x7fc970068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc98c159410 tx=0x7fc978008040 comp rx=0 tx=0).stop 2023-12-16T03:25:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 -- 172.21.15.28:0/1695921082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc98c0c06d0 msgr2=0x7fc98c0719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc98c0c06d0 0x7fc98c0719e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc980007fd0 tx=0x7fc98000c8e0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 -- 172.21.15.28:0/1695921082 shutdown_connections 2023-12-16T03:25:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc98c0c63c0 0x7fc98c1ed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc98c0c4100 0x7fc98c1f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9700664a0 0x7fc970068960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 --2- 172.21.15.28:0/1695921082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc98c0c06d0 0x7fc98c0719e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 -- 172.21.15.28:0/1695921082 >> 172.21.15.28:0/1695921082 conn(0x7fc98c06a5b0 msgr2=0x7fc98c0c4640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 -- 172.21.15.28:0/1695921082 shutdown_connections 2023-12-16T03:25:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.174+0000 7fc992caa640 1 -- 172.21.15.28:0/1695921082 wait complete. 2023-12-16T03:25:50.196 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:50.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.334+0000 7f4256209640 1 Processor -- start 2023-12-16T03:25:50.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.334+0000 7f4256209640 1 -- start start 2023-12-16T03:25:50.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f4256209640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42500a5240 0x7f42500bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f4256209640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f42500c01c0 0x7f42500c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f4256209640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42500c3bd0 con 0x7f42500c61a0 2023-12-16T03:25:50.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f4256209640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42500bf1e0 con 0x7f42500c01c0 2023-12-16T03:25:50.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f4256209640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42500c3e20 con 0x7f42500a5240 2023-12-16T03:25:50.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f424effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f42500c01c0 0x7f42500c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f424effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f42500c01c0 0x7f42500c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57480/0 (socket says 172.21.15.28:57480) 2023-12-16T03:25:50.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f424effd640 1 -- 172.21.15.28:0/1590878330 learned_addr learned my addr 172.21.15.28:0/1590878330 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:50.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f424f7fe640 1 --2- 172.21.15.28:0/1590878330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42500a5240 0x7f42500bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f424effd640 1 -- 172.21.15.28:0/1590878330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42500a5240 msgr2=0x7f42500bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:50.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f424effd640 1 --2- 172.21.15.28:0/1590878330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42500a5240 0x7f42500bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f424effd640 1 -- 172.21.15.28:0/1590878330 >> v1:172.21.15.134:6789/0 conn(0x7f42500c61a0 legacy=0x7f42501561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:50.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.338+0000 7f424effd640 1 -- 172.21.15.28:0/1590878330 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500c4100 con 0x7f42500c01c0 2023-12-16T03:25:50.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f424effd640 1 --2- 172.21.15.28:0/1590878330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42500c01c0 0x7f42500c5c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f42440098a0 tx=0x7f424401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258163950d5cb1d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f424e7fc640 1 -- 172.21.15.28:0/1590878330 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440ac640 con 0x7f42500c01c0 2023-12-16T03:25:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f424e7fc640 1 -- 172.21.15.28:0/1590878330 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42440ac7a0 con 0x7f42500c01c0 2023-12-16T03:25:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f424e7fc640 1 -- 172.21.15.28:0/1590878330 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440acb30 con 0x7f42500c01c0 2023-12-16T03:25:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 -- 172.21.15.28:0/1590878330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42500c01c0 msgr2=0x7f42500c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 --2- 172.21.15.28:0/1590878330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42500c01c0 0x7f42500c5c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f42440098a0 tx=0x7f424401c420 comp rx=0 tx=0).stop 2023-12-16T03:25:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 -- 172.21.15.28:0/1590878330 shutdown_connections 2023-12-16T03:25:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 --2- 172.21.15.28:0/1590878330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42500c01c0 0x7f42500c5c60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 --2- 172.21.15.28:0/1590878330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42500a5240 0x7f42500bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 -- 172.21.15.28:0/1590878330 >> 172.21.15.28:0/1590878330 conn(0x7f425006a5b0 msgr2=0x7f425006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 -- 172.21.15.28:0/1590878330 shutdown_connections 2023-12-16T03:25:50.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 -- 172.21.15.28:0/1590878330 wait complete. 2023-12-16T03:25:50.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 Processor -- start 2023-12-16T03:25:50.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 -- start start 2023-12-16T03:25:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42500a5240 0x7f4250155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.342+0000 7f4256209640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42500c01c0 0x7f425015c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f4256209640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42500c61a0 0x7f4250152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f4256209640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4250072150 con 0x7f42500a5240 2023-12-16T03:25:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f4256209640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42500718b0 con 0x7f42500c01c0 2023-12-16T03:25:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f4256209640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4250071b90 con 0x7f42500c61a0 2023-12-16T03:25:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42500a5240 0x7f4250155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42500a5240 0x7f4250155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57486/0 (socket says 172.21.15.28:57486) 2023-12-16T03:25:50.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424f7fe640 1 -- 172.21.15.28:0/3964105411 learned_addr learned my addr 172.21.15.28:0/3964105411 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424effd640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42500c01c0 0x7f425015c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424ffff640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42500c61a0 0x7f4250152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424f7fe640 1 -- 172.21.15.28:0/3964105411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42500c61a0 msgr2=0x7f4250152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424f7fe640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42500c61a0 0x7f4250152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424f7fe640 1 -- 172.21.15.28:0/3964105411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42500c01c0 msgr2=0x7f425015c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424f7fe640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42500c01c0 0x7f425015c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424f7fe640 1 -- 172.21.15.28:0/3964105411 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440094d0 con 0x7f42500a5240 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424effd640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42500c01c0 0x7f425015c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f424f7fe640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42500a5240 0x7f4250155100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f424000d5f0 tx=0x7f424000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f4237fff640 1 -- 172.21.15.28:0/3964105411 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42400125f0 con 0x7f42500a5240 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f4237fff640 1 -- 172.21.15.28:0/3964105411 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4240012750 con 0x7f42500a5240 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f4237fff640 1 -- 172.21.15.28:0/3964105411 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240012ae0 con 0x7f42500a5240 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f4256209640 1 -- 172.21.15.28:0/3964105411 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4250071e70 con 0x7f42500a5240 2023-12-16T03:25:50.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f4256209640 1 -- 172.21.15.28:0/3964105411 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425015d4c0 con 0x7f42500a5240 2023-12-16T03:25:50.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f4256209640 1 -- 172.21.15.28:0/3964105411 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42500c52e0 con 0x7f42500a5240 2023-12-16T03:25:50.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.346+0000 7f4237fff640 1 -- 172.21.15.28:0/3964105411 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4240012c40 con 0x7f42500a5240 2023-12-16T03:25:50.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.350+0000 7f4237fff640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f423c066470 0x7f423c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.350+0000 7f4237fff640 1 -- 172.21.15.28:0/3964105411 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4240084390 con 0x7f42500a5240 2023-12-16T03:25:50.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.350+0000 7f424effd640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f423c066470 0x7f423c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.350+0000 7f424effd640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f423c066470 0x7f423c068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f42440ae000 tx=0x7f4244008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:50.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.354+0000 7f4237fff640 1 -- 172.21.15.28:0/3964105411 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4240051800 con 0x7f42500a5240 2023-12-16T03:25:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.514+0000 7f4256209640 1 -- 172.21.15.28:0/3964105411 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4250068400 con 0x7f42500a5240 2023-12-16T03:25:50.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.514+0000 7f4237fff640 1 -- 172.21.15.28:0/3964105411 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f4240007380 con 0x7f42500a5240 2023-12-16T03:25:50.520 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:50.520 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 -- 172.21.15.28:0/3964105411 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f423c066470 msgr2=0x7f423c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f423c066470 0x7f423c068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f42440ae000 tx=0x7f4244008040 comp rx=0 tx=0).stop 2023-12-16T03:25:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 -- 172.21.15.28:0/3964105411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42500a5240 msgr2=0x7f4250155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42500a5240 0x7f4250155100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f424000d5f0 tx=0x7f424000dab0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 -- 172.21.15.28:0/3964105411 shutdown_connections 2023-12-16T03:25:50.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42500c61a0 0x7f4250152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42500c01c0 0x7f425015c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f423c066470 0x7f423c068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 --2- 172.21.15.28:0/3964105411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42500a5240 0x7f4250155100 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 -- 172.21.15.28:0/3964105411 >> 172.21.15.28:0/3964105411 conn(0x7f425006a5b0 msgr2=0x7f42500c19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:50.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 -- 172.21.15.28:0/3964105411 shutdown_connections 2023-12-16T03:25:50.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.518+0000 7f4256209640 1 -- 172.21.15.28:0/3964105411 wait complete. 2023-12-16T03:25:50.542 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-16T03:25:50.542 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:25:50.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.678+0000 7fb00359e640 1 Processor -- start 2023-12-16T03:25:50.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7fb00359e640 1 -- start start 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7fb00359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb00414f800 0x7fb004072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7fb00359e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb004072860 0x7fb00406fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7fb00359e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0040c1010 0x7fb004155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7fb00359e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb004071e90 con 0x7fb004072860 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7fb00359e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0040a5110 con 0x7fb0040c1010 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7fb00359e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb004152d70 con 0x7fb00414f800 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7faffbfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb004072860 0x7fb00406fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7faffbfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb004072860 0x7fb00406fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57492/0 (socket says 172.21.15.28:57492) 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7faffbfff640 1 -- 172.21.15.28:0/2145337452 learned_addr learned my addr 172.21.15.28:0/2145337452 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7fb00259c640 1 --2- 172.21.15.28:0/2145337452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb00414f800 0x7fb004072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7fb002d9d640 1 --2- 172.21.15.28:0/2145337452 >> v2:172.21.15.134:3300/0 conn(0x7fb0040c1010 0x7fb004155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7faffbfff640 1 -- 172.21.15.28:0/2145337452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb00414f800 msgr2=0x7fb004072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:50.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7faffbfff640 1 --2- 172.21.15.28:0/2145337452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb00414f800 0x7fb004072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7faffbfff640 1 -- 172.21.15.28:0/2145337452 >> v2:172.21.15.134:3300/0 conn(0x7fb0040c1010 msgr2=0x7fb004155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:50.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7faffbfff640 1 --2- 172.21.15.28:0/2145337452 >> v2:172.21.15.134:3300/0 conn(0x7fb0040c1010 0x7fb004155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7faffbfff640 1 -- 172.21.15.28:0/2145337452 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb004153050 con 0x7fb004072860 2023-12-16T03:25:50.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.682+0000 7fb002d9d640 1 --2- 172.21.15.28:0/2145337452 >> v2:172.21.15.134:3300/0 conn(0x7fb0040c1010 0x7fb004155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:50.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7faffbfff640 1 --2- 172.21.15.28:0/2145337452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb004072860 0x7fb00406fd40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb00406b7b0 tx=0x7fafec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d6a5c45ee080c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:50.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb001d9b640 1 -- 172.21.15.28:0/2145337452 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0ab620 con 0x7fb004072860 2023-12-16T03:25:50.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb001d9b640 1 -- 172.21.15.28:0/2145337452 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec0ab780 con 0x7fb004072860 2023-12-16T03:25:50.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb001d9b640 1 -- 172.21.15.28:0/2145337452 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0abb10 con 0x7fb004072860 2023-12-16T03:25:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb00359e640 1 -- 172.21.15.28:0/2145337452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb004072860 msgr2=0x7fb00406fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb00359e640 1 --2- 172.21.15.28:0/2145337452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb004072860 0x7fb00406fd40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb00406b7b0 tx=0x7fafec01c440 comp rx=0 tx=0).stop 2023-12-16T03:25:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb00359e640 1 -- 172.21.15.28:0/2145337452 shutdown_connections 2023-12-16T03:25:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb00359e640 1 --2- 172.21.15.28:0/2145337452 >> v2:172.21.15.134:3300/0 conn(0x7fb0040c1010 0x7fb004155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb00359e640 1 --2- 172.21.15.28:0/2145337452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb004072860 0x7fb00406fd40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb00359e640 1 --2- 172.21.15.28:0/2145337452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb00414f800 0x7fb004072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb00359e640 1 -- 172.21.15.28:0/2145337452 >> 172.21.15.28:0/2145337452 conn(0x7fb0040a7800 msgr2=0x7fb0040a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb00359e640 1 -- 172.21.15.28:0/2145337452 shutdown_connections 2023-12-16T03:25:50.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb00359e640 1 -- 172.21.15.28:0/2145337452 wait complete. 2023-12-16T03:25:50.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb00359e640 1 Processor -- start 2023-12-16T03:25:50.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.686+0000 7fb00359e640 1 -- start start 2023-12-16T03:25:50.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb00359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb004072860 0x7fb0040c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb00359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0040c1010 0x7fb00414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb00359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb00414f800 0x7fb0041ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb00359e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004153b00 con 0x7fb00414f800 2023-12-16T03:25:50.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb00359e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004152360 con 0x7fb0040c1010 2023-12-16T03:25:50.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb00359e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040bfe60 con 0x7fb004072860 2023-12-16T03:25:50.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb002d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb00414f800 0x7fb0041ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb002d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb00414f800 0x7fb0041ee2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57506/0 (socket says 172.21.15.28:57506) 2023-12-16T03:25:50.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb002d9d640 1 -- 172.21.15.28:0/2318162236 learned_addr learned my addr 172.21.15.28:0/2318162236 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:50.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb00259c640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb004072860 0x7fb0040c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7faffbfff640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0040c1010 0x7fb00414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb002d9d640 1 -- 172.21.15.28:0/2318162236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb004072860 msgr2=0x7fb0040c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb002d9d640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb004072860 0x7fb0040c26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb002d9d640 1 -- 172.21.15.28:0/2318162236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0040c1010 msgr2=0x7fb00414d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb002d9d640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0040c1010 0x7fb00414d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb002d9d640 1 -- 172.21.15.28:0/2318162236 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec0094d0 con 0x7fb00414f800 2023-12-16T03:25:50.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb002d9d640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb00414f800 0x7fb0041ee2e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faffc007e60 tx=0x7faffc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:50.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7faffaffd640 1 -- 172.21.15.28:0/2318162236 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc015600 con 0x7fb00414f800 2023-12-16T03:25:50.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7faffaffd640 1 -- 172.21.15.28:0/2318162236 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc00f040 con 0x7fb00414f800 2023-12-16T03:25:50.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7faffaffd640 1 -- 172.21.15.28:0/2318162236 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc0159a0 con 0x7fb00414f800 2023-12-16T03:25:50.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb00359e640 1 -- 172.21.15.28:0/2318162236 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0041eb790 con 0x7fb00414f800 2023-12-16T03:25:50.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb00359e640 1 -- 172.21.15.28:0/2318162236 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0041eb420 con 0x7fb00414f800 2023-12-16T03:25:50.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7fb00359e640 1 -- 172.21.15.28:0/2318162236 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0041eb920 con 0x7fb00414f800 2023-12-16T03:25:50.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.690+0000 7faffaffd640 1 -- 172.21.15.28:0/2318162236 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7faffc01e3b0 con 0x7fb00414f800 2023-12-16T03:25:50.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.694+0000 7faffaffd640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fafe4066470 0x7fafe4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:50.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.694+0000 7faffaffd640 1 -- 172.21.15.28:0/2318162236 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faffc084020 con 0x7fb00414f800 2023-12-16T03:25:50.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.694+0000 7fb00259c640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fafe4066470 0x7fafe4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:50.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.694+0000 7fb00259c640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fafe4066470 0x7fafe4068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb00414e960 tx=0x7faff4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:50.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.698+0000 7faffaffd640 1 -- 172.21.15.28:0/2318162236 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7faffc0515e0 con 0x7fb00414f800 2023-12-16T03:25:50.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 -- 172.21.15.28:0/2318162236 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0041eaf70 con 0x7fb00414f800 2023-12-16T03:25:50.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7faffaffd640 1 -- 172.21.15.28:0/2318162236 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7faffc054c00 con 0x7fb00414f800 2023-12-16T03:25:50.895 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:50.895 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/2517100030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2517100030},{"type":"v1","addr":"172.21.15.134:6835","nonce":2517100030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/146686059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":146686059},{"type":"v1","addr":"172.21.15.28:6836","nonce":146686059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1280024314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1280024314},{"type":"v1","addr":"172.21.15.28:6837","nonce":1280024314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:25:15.321507+0000","modified":"2023-12-16T03:25:18.328454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/199412786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":199412786},{"type":"v1","addr":"172.21.15.134:6834","nonce":199412786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T03:25:50.895 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-12-16T03:25:50.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 -- 172.21.15.28:0/2318162236 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fafe4066470 msgr2=0x7fafe4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fafe4066470 0x7fafe4068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb00414e960 tx=0x7faff4009190 comp rx=0 tx=0).stop 2023-12-16T03:25:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 -- 172.21.15.28:0/2318162236 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb00414f800 msgr2=0x7fb0041ee2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb00414f800 0x7fb0041ee2e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faffc007e60 tx=0x7faffc00d4a0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 -- 172.21.15.28:0/2318162236 shutdown_connections 2023-12-16T03:25:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fafe4066470 0x7fafe4068930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb00414f800 0x7fb0041ee2e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0040c1010 0x7fb00414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 --2- 172.21.15.28:0/2318162236 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb004072860 0x7fb0040c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 -- 172.21.15.28:0/2318162236 >> 172.21.15.28:0/2318162236 conn(0x7fb0040a7800 msgr2=0x7fb00414ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 -- 172.21.15.28:0/2318162236 shutdown_connections 2023-12-16T03:25:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:50.890+0000 7fb00359e640 1 -- 172.21.15.28:0/2318162236 wait complete. 2023-12-16T03:25:50.916 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:25:51.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.054+0000 7ff083217640 1 Processor -- start 2023-12-16T03:25:51.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.054+0000 7ff083217640 1 -- start start 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.054+0000 7ff083217640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff07c0c4100 0x7ff07c0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.054+0000 7ff083217640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff07c0c06d0 0x7ff07c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.054+0000 7ff083217640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c0c31c0 con 0x7ff07c0c63c0 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.054+0000 7ff083217640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c0c34a0 con 0x7ff07c0c4100 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.054+0000 7ff083217640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0c1030 con 0x7ff07c0c06d0 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.054+0000 7ff07bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff07c0c4100 0x7ff07c0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.054+0000 7ff07bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff07c0c4100 0x7ff07c0c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57520/0 (socket says 172.21.15.28:57520) 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.054+0000 7ff07bfff640 1 -- 172.21.15.28:0/3037943510 learned_addr learned my addr 172.21.15.28:0/3037943510 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.054+0000 7ff0817b4640 1 --2- 172.21.15.28:0/3037943510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff07c0c06d0 0x7ff07c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff07bfff640 1 -- 172.21.15.28:0/3037943510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff07c0c06d0 msgr2=0x7ff07c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff07bfff640 1 --2- 172.21.15.28:0/3037943510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff07c0c06d0 0x7ff07c0a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff07bfff640 1 -- 172.21.15.28:0/3037943510 >> v1:172.21.15.134:6789/0 conn(0x7ff07c0c63c0 legacy=0x7ff07c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff07bfff640 1 -- 172.21.15.28:0/3037943510 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c0c1310 con 0x7ff07c0c4100 2023-12-16T03:25:51.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff0817b4640 1 --2- 172.21.15.28:0/3037943510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff07c0c06d0 0x7ff07c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:51.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff07bfff640 1 --2- 172.21.15.28:0/3037943510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff07c0c4100 0x7ff07c0c2bb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff068009870 tx=0x7ff06801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2ff5b7ba9bf7d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:51.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff07b7fe640 1 -- 172.21.15.28:0/3037943510 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c0aa3d0 con 0x7ff07c0c4100 2023-12-16T03:25:51.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff07b7fe640 1 -- 172.21.15.28:0/3037943510 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0680a7050 con 0x7ff07c0c4100 2023-12-16T03:25:51.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff07b7fe640 1 -- 172.21.15.28:0/3037943510 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0680ab820 con 0x7ff07c0c4100 2023-12-16T03:25:51.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff083217640 1 -- 172.21.15.28:0/3037943510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff07c0c4100 msgr2=0x7ff07c0c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff083217640 1 --2- 172.21.15.28:0/3037943510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff07c0c4100 0x7ff07c0c2bb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff068009870 tx=0x7ff06801c420 comp rx=0 tx=0).stop 2023-12-16T03:25:51.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff083217640 1 -- 172.21.15.28:0/3037943510 shutdown_connections 2023-12-16T03:25:51.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff083217640 1 --2- 172.21.15.28:0/3037943510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff07c0c06d0 0x7ff07c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff083217640 1 --2- 172.21.15.28:0/3037943510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff07c0c4100 0x7ff07c0c2bb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff083217640 1 -- 172.21.15.28:0/3037943510 >> 172.21.15.28:0/3037943510 conn(0x7ff07c06a5b0 msgr2=0x7ff07c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:51.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff083217640 1 -- 172.21.15.28:0/3037943510 shutdown_connections 2023-12-16T03:25:51.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.058+0000 7ff083217640 1 -- 172.21.15.28:0/3037943510 wait complete. 2023-12-16T03:25:51.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff083217640 1 Processor -- start 2023-12-16T03:25:51.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff083217640 1 -- start start 2023-12-16T03:25:51.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff083217640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff07c0c06d0 0x7ff07c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff083217640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff07c0c4100 0x7ff07c152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff083217640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff07c0c63c0 0x7ff07c071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff083217640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0c4c10 con 0x7ff07c0c63c0 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff083217640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c070760 con 0x7ff07c0c4100 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff083217640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c071130 con 0x7ff07c0c06d0 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0817b4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff07c0c63c0 0x7ff07c071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0817b4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff07c0c63c0 0x7ff07c071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57524/0 (socket says 172.21.15.28:57524) 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0817b4640 1 -- 172.21.15.28:0/847446212 learned_addr learned my addr 172.21.15.28:0/847446212 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff080fb3640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff07c0c06d0 0x7ff07c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff07bfff640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff07c0c4100 0x7ff07c152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0817b4640 1 -- 172.21.15.28:0/847446212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff07c0c06d0 msgr2=0x7ff07c070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0817b4640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff07c0c06d0 0x7ff07c070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0817b4640 1 -- 172.21.15.28:0/847446212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff07c0c4100 msgr2=0x7ff07c152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0817b4640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff07c0c4100 0x7ff07c152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0817b4640 1 -- 172.21.15.28:0/847446212 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680094d0 con 0x7ff07c0c63c0 2023-12-16T03:25:51.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0817b4640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff07c0c63c0 0x7ff07c071610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff074007ef0 tx=0x7ff07400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:51.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0797fa640 1 -- 172.21.15.28:0/847446212 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074003ba0 con 0x7ff07c0c63c0 2023-12-16T03:25:51.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0797fa640 1 -- 172.21.15.28:0/847446212 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07400f040 con 0x7ff07c0c63c0 2023-12-16T03:25:51.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff083217640 1 -- 172.21.15.28:0/847446212 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c06fe50 con 0x7ff07c0c63c0 2023-12-16T03:25:51.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.062+0000 7ff0797fa640 1 -- 172.21.15.28:0/847446212 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07400de80 con 0x7ff07c0c63c0 2023-12-16T03:25:51.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.066+0000 7ff083217640 1 -- 172.21.15.28:0/847446212 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c1f0ec0 con 0x7ff07c0c63c0 2023-12-16T03:25:51.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.066+0000 7ff083217640 1 -- 172.21.15.28:0/847446212 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c070910 con 0x7ff07c0c63c0 2023-12-16T03:25:51.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.066+0000 7ff0797fa640 1 -- 172.21.15.28:0/847446212 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff074004030 con 0x7ff07c0c63c0 2023-12-16T03:25:51.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.066+0000 7ff0797fa640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff060066470 0x7ff060068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.066+0000 7ff0797fa640 1 -- 172.21.15.28:0/847446212 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff074084170 con 0x7ff07c0c63c0 2023-12-16T03:25:51.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.066+0000 7ff080fb3640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff060066470 0x7ff060068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.066+0000 7ff080fb3640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff060066470 0x7ff060068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff070007fd0 tx=0x7ff070009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:51.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.070+0000 7ff0797fa640 1 -- 172.21.15.28:0/847446212 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff07c070910 con 0x7ff07c0c63c0 2023-12-16T03:25:51.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.258+0000 7ff083217640 1 -- 172.21.15.28:0/847446212 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff07c070910 con 0x7ff07c0c63c0 2023-12-16T03:25:51.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.258+0000 7ff0797fa640 1 -- 172.21.15.28:0/847446212 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7ff07c070910 con 0x7ff07c0c63c0 2023-12-16T03:25:51.263 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:51.264 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/2517100030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2517100030},{"type":"v1","addr":"172.21.15.134:6835","nonce":2517100030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/146686059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":146686059},{"type":"v1","addr":"172.21.15.28:6836","nonce":146686059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1280024314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1280024314},{"type":"v1","addr":"172.21.15.28:6837","nonce":1280024314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:25:15.321507+0000","modified":"2023-12-16T03:25:18.328454+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/199412786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":199412786},{"type":"v1","addr":"172.21.15.134:6834","nonce":199412786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-16T03:25:51.264 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-12-16T03:25:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 -- 172.21.15.28:0/847446212 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff060066470 msgr2=0x7ff060068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff060066470 0x7ff060068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff070007fd0 tx=0x7ff070009040 comp rx=0 tx=0).stop 2023-12-16T03:25:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 -- 172.21.15.28:0/847446212 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff07c0c63c0 msgr2=0x7ff07c071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff07c0c63c0 0x7ff07c071610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff074007ef0 tx=0x7ff07400d4a0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 -- 172.21.15.28:0/847446212 shutdown_connections 2023-12-16T03:25:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff060066470 0x7ff060068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff07c0c63c0 0x7ff07c071610 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff07c0c4100 0x7ff07c152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 --2- 172.21.15.28:0/847446212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff07c0c06d0 0x7ff07c070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 -- 172.21.15.28:0/847446212 >> 172.21.15.28:0/847446212 conn(0x7ff07c06a5b0 msgr2=0x7ff07c0bfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:51.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 -- 172.21.15.28:0/847446212 shutdown_connections 2023-12-16T03:25:51.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.262+0000 7ff083217640 1 -- 172.21.15.28:0/847446212 wait complete. 2023-12-16T03:25:51.285 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:51.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa767f80640 1 Processor -- start 2023-12-16T03:25:51.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa767f80640 1 -- start start 2023-12-16T03:25:51.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa767f80640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa76006d520 0x7fa76015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa767f80640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa7600bffc0 0x7fa7600c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa767f80640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76015c600 con 0x7fa7601560e0 2023-12-16T03:25:51.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa767f80640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76015a5c0 con 0x7fa7600bffc0 2023-12-16T03:25:51.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa767f80640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7601594e0 con 0x7fa76006d520 2023-12-16T03:25:51.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa765d1c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa7601560e0 0x7fa760159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:46988/0 (socket says 172.21.15.28:46988) 2023-12-16T03:25:51.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa765d1c640 1 -- 172.21.15.28:0/1248647691 learned_addr learned my addr 172.21.15.28:0/1248647691 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:51.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa76651d640 1 --2- 172.21.15.28:0/1248647691 >> v2:172.21.15.28:3300/0 conn(0x7fa7600bffc0 0x7fa7600c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa76551b640 1 --2- 172.21.15.28:0/1248647691 >> v2:172.21.15.134:3300/0 conn(0x7fa76006d520 0x7fa76015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.422+0000 7fa764d1a640 1 -- 172.21.15.28:0/1248647691 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034545075 0 0) 0x7fa76015c600 con 0x7fa7601560e0 2023-12-16T03:25:51.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa764d1a640 1 -- 172.21.15.28:0/1248647691 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa74c003530 con 0x7fa7601560e0 2023-12-16T03:25:51.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa76651d640 1 -- 172.21.15.28:0/1248647691 >> v2:172.21.15.134:3300/0 conn(0x7fa76006d520 msgr2=0x7fa76015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:51.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa76651d640 1 --2- 172.21.15.28:0/1248647691 >> v2:172.21.15.134:3300/0 conn(0x7fa76006d520 0x7fa76015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa76651d640 1 -- 172.21.15.28:0/1248647691 >> v1:172.21.15.28:6789/0 conn(0x7fa7601560e0 legacy=0x7fa760159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa76651d640 1 -- 172.21.15.28:0/1248647691 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7601597c0 con 0x7fa7600bffc0 2023-12-16T03:25:51.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa76651d640 1 --2- 172.21.15.28:0/1248647691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7600bffc0 0x7fa7600c1bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa7600c1330 tx=0x7fa75801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9d6717114194c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:51.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa764d1a640 1 -- 172.21.15.28:0/1248647691 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7580a58b0 con 0x7fa7600bffc0 2023-12-16T03:25:51.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa764d1a640 1 -- 172.21.15.28:0/1248647691 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7580a5a10 con 0x7fa7600bffc0 2023-12-16T03:25:51.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa764d1a640 1 -- 172.21.15.28:0/1248647691 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7580a5da0 con 0x7fa7600bffc0 2023-12-16T03:25:51.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa767f80640 1 -- 172.21.15.28:0/1248647691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7600bffc0 msgr2=0x7fa7600c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa767f80640 1 --2- 172.21.15.28:0/1248647691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7600bffc0 0x7fa7600c1bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa7600c1330 tx=0x7fa75801c8e0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa767f80640 1 -- 172.21.15.28:0/1248647691 shutdown_connections 2023-12-16T03:25:51.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa767f80640 1 --2- 172.21.15.28:0/1248647691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7600bffc0 0x7fa7600c1bf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa767f80640 1 --2- 172.21.15.28:0/1248647691 >> v2:172.21.15.134:3300/0 conn(0x7fa76006d520 0x7fa76015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.426+0000 7fa767f80640 1 -- 172.21.15.28:0/1248647691 >> 172.21.15.28:0/1248647691 conn(0x7fa76006a5b0 msgr2=0x7fa76006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:51.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 -- 172.21.15.28:0/1248647691 shutdown_connections 2023-12-16T03:25:51.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 -- 172.21.15.28:0/1248647691 wait complete. 2023-12-16T03:25:51.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 Processor -- start 2023-12-16T03:25:51.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 -- start start 2023-12-16T03:25:51.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa76006d520 0x7fa7600c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7600bffc0 0x7fa760152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7601560e0 0x7fa760153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7601f2260 con 0x7fa76006d520 2023-12-16T03:25:51.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7601536c0 con 0x7fa7600bffc0 2023-12-16T03:25:51.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa760070b60 con 0x7fa7601560e0 2023-12-16T03:25:51.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa765d1c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa76006d520 0x7fa7600c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa765d1c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa76006d520 0x7fa7600c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57540/0 (socket says 172.21.15.28:57540) 2023-12-16T03:25:51.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa765d1c640 1 -- 172.21.15.28:0/714054123 learned_addr learned my addr 172.21.15.28:0/714054123 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:51.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa76651d640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7601560e0 0x7fa760153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa76551b640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7600bffc0 0x7fa760152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa765d1c640 1 -- 172.21.15.28:0/714054123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7601560e0 msgr2=0x7fa760153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa765d1c640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7601560e0 0x7fa760153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa765d1c640 1 -- 172.21.15.28:0/714054123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7600bffc0 msgr2=0x7fa760152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa765d1c640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7600bffc0 0x7fa760152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa765d1c640 1 -- 172.21.15.28:0/714054123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa758009a70 con 0x7fa76006d520 2023-12-16T03:25:51.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa765d1c640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa76006d520 0x7fa7600c5810 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c420 tx=0x7fa75c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:51.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa7567fc640 1 -- 172.21.15.28:0/714054123 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c005cf0 con 0x7fa76006d520 2023-12-16T03:25:51.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa7567fc640 1 -- 172.21.15.28:0/714054123 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c005e50 con 0x7fa76006d520 2023-12-16T03:25:51.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa7567fc640 1 -- 172.21.15.28:0/714054123 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0072d0 con 0x7fa76006d520 2023-12-16T03:25:51.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 -- 172.21.15.28:0/714054123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7601f1cc0 con 0x7fa76006d520 2023-12-16T03:25:51.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.430+0000 7fa767f80640 1 -- 172.21.15.28:0/714054123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7600a2770 con 0x7fa76006d520 2023-12-16T03:25:51.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.434+0000 7fa767f80640 1 -- 172.21.15.28:0/714054123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa760068400 con 0x7fa76006d520 2023-12-16T03:25:51.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.434+0000 7fa7567fc640 1 -- 172.21.15.28:0/714054123 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa75c007430 con 0x7fa76006d520 2023-12-16T03:25:51.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.434+0000 7fa7567fc640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa744066470 0x7fa744068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.434+0000 7fa7567fc640 1 -- 172.21.15.28:0/714054123 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa75c0833a0 con 0x7fa76006d520 2023-12-16T03:25:51.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.434+0000 7fa76551b640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa744066470 0x7fa744068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.434+0000 7fa76551b640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa744066470 0x7fa744068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7600ab090 tx=0x7fa750008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:51.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.438+0000 7fa7567fc640 1 -- 172.21.15.28:0/714054123 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa75c0508c0 con 0x7fa76006d520 2023-12-16T03:25:51.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 -- 172.21.15.28:0/714054123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7600a2a70 con 0x7fa76006d520 2023-12-16T03:25:51.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa7567fc640 1 -- 172.21.15.28:0/714054123 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fa75c053ee0 con 0x7fa76006d520 2023-12-16T03:25:51.606 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:51.607 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:16.411964+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:25:13.885447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-16T03:25:14.309086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 -- 172.21.15.28:0/714054123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa744066470 msgr2=0x7fa744068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa744066470 0x7fa744068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7600ab090 tx=0x7fa750008040 comp rx=0 tx=0).stop 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 -- 172.21.15.28:0/714054123 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa76006d520 msgr2=0x7fa7600c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa76006d520 0x7fa7600c5810 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c420 tx=0x7fa75c00c8e0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 -- 172.21.15.28:0/714054123 shutdown_connections 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa7601560e0 0x7fa760153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7600bffc0 0x7fa760152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa744066470 0x7fa744068930 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7600ab090 tx=0x7fa750008040 comp rx=0 tx=0).stop 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 --2- 172.21.15.28:0/714054123 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa76006d520 0x7fa7600c5810 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 -- 172.21.15.28:0/714054123 >> 172.21.15.28:0/714054123 conn(0x7fa76006a5b0 msgr2=0x7fa7600a82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 -- 172.21.15.28:0/714054123 shutdown_connections 2023-12-16T03:25:51.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.602+0000 7fa767f80640 1 -- 172.21.15.28:0/714054123 wait complete. 2023-12-16T03:25:51.628 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-16T03:25:51.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.766+0000 7f4b9d6fe640 1 Processor -- start 2023-12-16T03:25:51.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.766+0000 7f4b9d6fe640 1 -- start start 2023-12-16T03:25:51.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.766+0000 7f4b9d6fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b980a5370 0x7f4b980c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b9d6fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4b980c4110 0x7f4b98150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b9d6fe640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b980c2760 con 0x7f4b98072090 2023-12-16T03:25:51.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b9d6fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b980c3070 con 0x7f4b980c4110 2023-12-16T03:25:51.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b9d6fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98151bf0 con 0x7f4b980a5370 2023-12-16T03:25:51.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b977fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4b98072090 0x7f4b981514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47004/0 (socket says 172.21.15.28:47004) 2023-12-16T03:25:51.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b977fe640 1 -- 172.21.15.28:0/3786772831 learned_addr learned my addr 172.21.15.28:0/3786772831 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:51.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b8ffff640 1 --2- 172.21.15.28:0/3786772831 >> v2:172.21.15.134:3300/0 conn(0x7f4b980c4110 0x7f4b98150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b96ffd640 1 --2- 172.21.15.28:0/3786772831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b980a5370 0x7f4b980c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b967fc640 1 -- 172.21.15.28:0/3786772831 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259531273 0 0) 0x7f4b980c2760 con 0x7f4b98072090 2023-12-16T03:25:51.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b967fc640 1 -- 172.21.15.28:0/3786772831 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b84005740 con 0x7f4b98072090 2023-12-16T03:25:51.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b96ffd640 1 -- 172.21.15.28:0/3786772831 >> v2:172.21.15.134:3300/0 conn(0x7f4b980c4110 msgr2=0x7f4b98150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:51.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b96ffd640 1 --2- 172.21.15.28:0/3786772831 >> v2:172.21.15.134:3300/0 conn(0x7f4b980c4110 0x7f4b98150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b96ffd640 1 -- 172.21.15.28:0/3786772831 >> v1:172.21.15.28:6789/0 conn(0x7f4b98072090 legacy=0x7f4b981514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b96ffd640 1 -- 172.21.15.28:0/3786772831 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980a5750 con 0x7f4b980a5370 2023-12-16T03:25:51.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.770+0000 7f4b8ffff640 1 --2- 172.21.15.28:0/3786772831 >> v2:172.21.15.134:3300/0 conn(0x7f4b980c4110 0x7f4b98150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:51.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b96ffd640 1 --2- 172.21.15.28:0/3786772831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b980a5370 0x7f4b980c3bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800a960 tx=0x7f4b8801c600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4091719a972e2efd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:51.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b967fc640 1 -- 172.21.15.28:0/3786772831 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880a6650 con 0x7f4b980a5370 2023-12-16T03:25:51.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b967fc640 1 -- 172.21.15.28:0/3786772831 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b880a67b0 con 0x7f4b980a5370 2023-12-16T03:25:51.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b967fc640 1 -- 172.21.15.28:0/3786772831 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880a6b20 con 0x7f4b980a5370 2023-12-16T03:25:51.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/3786772831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b980a5370 msgr2=0x7f4b980c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b9d6fe640 1 --2- 172.21.15.28:0/3786772831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b980a5370 0x7f4b980c3bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800a960 tx=0x7f4b8801c600 comp rx=0 tx=0).stop 2023-12-16T03:25:51.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/3786772831 shutdown_connections 2023-12-16T03:25:51.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b9d6fe640 1 --2- 172.21.15.28:0/3786772831 >> v2:172.21.15.134:3300/0 conn(0x7f4b980c4110 0x7f4b98150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b9d6fe640 1 --2- 172.21.15.28:0/3786772831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b980a5370 0x7f4b980c3bd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/3786772831 >> 172.21.15.28:0/3786772831 conn(0x7f4b9806a5b0 msgr2=0x7f4b9806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:51.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/3786772831 shutdown_connections 2023-12-16T03:25:51.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/3786772831 wait complete. 2023-12-16T03:25:51.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b9d6fe640 1 Processor -- start 2023-12-16T03:25:51.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.774+0000 7f4b9d6fe640 1 -- start start 2023-12-16T03:25:51.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b9d6fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b98072090 0x7f4b9806fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b9d6fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b980a5370 0x7f4b981ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b9d6fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b980c4110 0x7f4b981f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b9d6fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b981f1230 con 0x7f4b98072090 2023-12-16T03:25:51.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b9d6fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b981f0c70 con 0x7f4b980a5370 2023-12-16T03:25:51.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b9d6fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b981f0f50 con 0x7f4b980c4110 2023-12-16T03:25:51.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b96ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b98072090 0x7f4b9806fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b96ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b98072090 0x7f4b9806fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57542/0 (socket says 172.21.15.28:57542) 2023-12-16T03:25:51.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b96ffd640 1 -- 172.21.15.28:0/4203630434 learned_addr learned my addr 172.21.15.28:0/4203630434 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:51.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b96ffd640 1 -- 172.21.15.28:0/4203630434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b980c4110 msgr2=0x7f4b981f0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b96ffd640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b980c4110 0x7f4b981f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b96ffd640 1 -- 172.21.15.28:0/4203630434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b980a5370 msgr2=0x7f4b981ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b8ffff640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b980a5370 0x7f4b981ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b96ffd640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b980a5370 0x7f4b981ed710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b96ffd640 1 -- 172.21.15.28:0/4203630434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b80009420 con 0x7f4b98072090 2023-12-16T03:25:51.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b8ffff640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b980a5370 0x7f4b981ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:51.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b96ffd640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b98072090 0x7f4b9806fe50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4b8801cea0 tx=0x7f4b880193a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:51.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b8f7fe640 1 -- 172.21.15.28:0/4203630434 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880b7070 con 0x7f4b98072090 2023-12-16T03:25:51.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b8f7fe640 1 -- 172.21.15.28:0/4203630434 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b880a6920 con 0x7f4b98072090 2023-12-16T03:25:51.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/4203630434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8800a5c0 con 0x7f4b98072090 2023-12-16T03:25:51.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b8f7fe640 1 -- 172.21.15.28:0/4203630434 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880a6c90 con 0x7f4b98072090 2023-12-16T03:25:51.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/4203630434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b981ed1f0 con 0x7f4b98072090 2023-12-16T03:25:51.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/4203630434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b98068400 con 0x7f4b98072090 2023-12-16T03:25:51.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.778+0000 7f4b8f7fe640 1 -- 172.21.15.28:0/4203630434 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4b88003620 con 0x7f4b98072090 2023-12-16T03:25:51.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.782+0000 7f4b8f7fe640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4b78066470 0x7f4b78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:51.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.782+0000 7f4b8f7fe640 1 -- 172.21.15.28:0/4203630434 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b8811e480 con 0x7f4b98072090 2023-12-16T03:25:51.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.782+0000 7f4b8ffff640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4b78066470 0x7f4b78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:51.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.782+0000 7f4b8ffff640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4b78066470 0x7f4b78068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4b9806da50 tx=0x7f4b80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:51.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.786+0000 7f4b8f7fe640 1 -- 172.21.15.28:0/4203630434 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4b880eb990 con 0x7f4b98072090 2023-12-16T03:25:51.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.974+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/4203630434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4b980c6780 con 0x7f4b98072090 2023-12-16T03:25:51.978 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-12-16T03:25:51.974+0000 7f6a9e376640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T03:25:51.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.974+0000 7f4b8f7fe640 1 -- 172.21.15.28:0/4203630434 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4b880eefb0 con 0x7f4b98072090 2023-12-16T03:25:51.980 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-16T03:25:51.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/4203630434 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4b78066470 msgr2=0x7f4b78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4b78066470 0x7f4b78068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4b9806da50 tx=0x7f4b80008040 comp rx=0 tx=0).stop 2023-12-16T03:25:51.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/4203630434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b98072090 msgr2=0x7f4b9806fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:51.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b98072090 0x7f4b9806fe50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4b8801cea0 tx=0x7f4b880193a0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/4203630434 shutdown_connections 2023-12-16T03:25:51.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b980c4110 0x7f4b981f0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b980a5370 0x7f4b981ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4b78066470 0x7f4b78068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 --2- 172.21.15.28:0/4203630434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b98072090 0x7f4b9806fe50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:51.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/4203630434 >> 172.21.15.28:0/4203630434 conn(0x7f4b9806a5b0 msgr2=0x7f4b980c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:51.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/4203630434 shutdown_connections 2023-12-16T03:25:51.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:51.978+0000 7f4b9d6fe640 1 -- 172.21.15.28:0/4203630434 wait complete. 2023-12-16T03:25:51.995 INFO:tasks.ceph.mds.b.smithi134.stderr: -5436> 2023-12-16T03:25:20.176+0000 7f8e45f9a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:25:52.003 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-16T03:25:52.048 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-12-16T03:25:52.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2dfbd72640 1 Processor -- start 2023-12-16T03:25:52.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2dfbd72640 1 -- start start 2023-12-16T03:25:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2dfbd72640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c63c0 0x7f2df40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2dfbd72640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2df40c4100 0x7f2df40c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2dfbd72640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2df40c29e0 0x7f2df40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2dfbd72640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df40c31c0 con 0x7f2df40c4100 2023-12-16T03:25:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2dfbd72640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df40c34a0 con 0x7f2df40c29e0 2023-12-16T03:25:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2dfbd72640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40c1030 con 0x7f2df40c63c0 2023-12-16T03:25:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2df930d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2df40c4100 0x7f2df40c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2df930d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2df40c4100 0x7f2df40c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57544/0 (socket says 172.21.15.28:57544) 2023-12-16T03:25:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2df930d640 1 -- 172.21.15.28:0/3630591346 learned_addr learned my addr 172.21.15.28:0/3630591346 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:52.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2df930d640 1 -- 172.21.15.28:0/3630591346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c63c0 msgr2=0x7f2df40c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:52.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2df930d640 1 --2- 172.21.15.28:0/3630591346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c63c0 0x7f2df40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:52.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2df930d640 1 -- 172.21.15.28:0/3630591346 >> v2:172.21.15.134:3300/0 conn(0x7f2df40c29e0 msgr2=0x7f2df40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:52.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2dfa30f640 1 --2- 172.21.15.28:0/3630591346 >> v2:172.21.15.134:3300/0 conn(0x7f2df40c29e0 0x7f2df40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:52.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2df930d640 1 --2- 172.21.15.28:0/3630591346 >> v2:172.21.15.134:3300/0 conn(0x7f2df40c29e0 0x7f2df40a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:52.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2df930d640 1 -- 172.21.15.28:0/3630591346 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df40c1310 con 0x7f2df40c4100 2023-12-16T03:25:52.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.146+0000 7f2dfa30f640 1 --2- 172.21.15.28:0/3630591346 >> v2:172.21.15.134:3300/0 conn(0x7f2df40c29e0 0x7f2df40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:52.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2df930d640 1 --2- 172.21.15.28:0/3630591346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df40c24a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2df40a5760 tx=0x7f2de401ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bceae7fed0aa13c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:52.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2df8b0c640 1 -- 172.21.15.28:0/3630591346 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df40aa3d0 con 0x7f2df40c4100 2023-12-16T03:25:52.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2df8b0c640 1 -- 172.21.15.28:0/3630591346 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40a7b30 con 0x7f2df40c4100 2023-12-16T03:25:52.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2df8b0c640 1 -- 172.21.15.28:0/3630591346 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40af440 con 0x7f2df40c4100 2023-12-16T03:25:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2dfbd72640 1 -- 172.21.15.28:0/3630591346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 msgr2=0x7f2df40c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2dfbd72640 1 --2- 172.21.15.28:0/3630591346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df40c24a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2df40a5760 tx=0x7f2de401ea80 comp rx=0 tx=0).stop 2023-12-16T03:25:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2dfbd72640 1 -- 172.21.15.28:0/3630591346 shutdown_connections 2023-12-16T03:25:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2dfbd72640 1 --2- 172.21.15.28:0/3630591346 >> v2:172.21.15.134:3300/0 conn(0x7f2df40c29e0 0x7f2df40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2dfbd72640 1 --2- 172.21.15.28:0/3630591346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df40c24a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2dfbd72640 1 --2- 172.21.15.28:0/3630591346 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c63c0 0x7f2df40c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2dfbd72640 1 -- 172.21.15.28:0/3630591346 >> 172.21.15.28:0/3630591346 conn(0x7f2df406a5b0 msgr2=0x7f2df406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2dfbd72640 1 -- 172.21.15.28:0/3630591346 shutdown_connections 2023-12-16T03:25:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.150+0000 7f2dfbd72640 1 -- 172.21.15.28:0/3630591346 wait complete. 2023-12-16T03:25:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfbd72640 1 Processor -- start 2023-12-16T03:25:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfbd72640 1 -- start start 2023-12-16T03:25:52.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfbd72640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c29e0 0x7f2df4070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:52.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfbd72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df4154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfbd72640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40c63c0 0x7f2df41ed070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfbd72640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40bf2e0 con 0x7f2df40c4100 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfbd72640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4155410 con 0x7f2df40c63c0 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfbd72640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df41f0fd0 con 0x7f2df40c29e0 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2df930d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df4154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2df930d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df4154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57558/0 (socket says 172.21.15.28:57558) 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2df930d640 1 -- 172.21.15.28:0/470722892 learned_addr learned my addr 172.21.15.28:0/470722892 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfa30f640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40c63c0 0x7f2df41ed070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2df9b0e640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c29e0 0x7f2df4070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2df930d640 1 -- 172.21.15.28:0/470722892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c29e0 msgr2=0x7f2df4070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2df930d640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c29e0 0x7f2df4070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2df930d640 1 -- 172.21.15.28:0/470722892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40c63c0 msgr2=0x7f2df41ed070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2df930d640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40c63c0 0x7f2df41ed070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2df930d640 1 -- 172.21.15.28:0/470722892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de400b770 con 0x7f2df40c4100 2023-12-16T03:25:52.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfa30f640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40c63c0 0x7f2df41ed070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:52.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2df9b0e640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c29e0 0x7f2df4070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:52.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2df930d640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df4154670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2de400b2c0 tx=0x7f2de401b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:52.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dea7fc640 1 -- 172.21.15.28:0/470722892 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40ba640 con 0x7f2df40c4100 2023-12-16T03:25:52.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dea7fc640 1 -- 172.21.15.28:0/470722892 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40ba7a0 con 0x7f2df40c4100 2023-12-16T03:25:52.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dea7fc640 1 -- 172.21.15.28:0/470722892 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40bab50 con 0x7f2df40c4100 2023-12-16T03:25:52.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfbd72640 1 -- 172.21.15.28:0/470722892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df40c69b0 con 0x7f2df40c4100 2023-12-16T03:25:52.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.154+0000 7f2dfbd72640 1 -- 172.21.15.28:0/470722892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df40bef70 con 0x7f2df40c4100 2023-12-16T03:25:52.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.158+0000 7f2dfbd72640 1 -- 172.21.15.28:0/470722892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df4068400 con 0x7f2df40c4100 2023-12-16T03:25:52.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.158+0000 7f2dea7fc640 1 -- 172.21.15.28:0/470722892 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2de40b93e0 con 0x7f2df40c4100 2023-12-16T03:25:52.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.158+0000 7f2dea7fc640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd80664a0 0x7f2dd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:52.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.158+0000 7f2dea7fc640 1 -- 172.21.15.28:0/470722892 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2de411ebd0 con 0x7f2df40c4100 2023-12-16T03:25:52.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.158+0000 7f2df9b0e640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd80664a0 0x7f2dd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:52.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.158+0000 7f2df9b0e640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd80664a0 0x7f2dd8068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2df0006fd0 tx=0x7f2df0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:52.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.162+0000 7f2dea7fc640 1 -- 172.21.15.28:0/470722892 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2de40ec100 con 0x7f2df40c4100 2023-12-16T03:25:52.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.354+0000 7f2dfbd72640 1 -- 172.21.15.28:0/470722892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2df40a66e0 con 0x7f2df40c4100 2023-12-16T03:25:52.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.978+0000 7f2dea7fc640 1 -- 172.21.15.28:0/470722892 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2de40b40a0 con 0x7f2df40c4100 2023-12-16T03:25:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.978+0000 7f2dfbd72640 1 -- 172.21.15.28:0/470722892 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd80664a0 msgr2=0x7f2dd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.978+0000 7f2dfbd72640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd80664a0 0x7f2dd8068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2df0006fd0 tx=0x7f2df0008040 comp rx=0 tx=0).stop 2023-12-16T03:25:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.978+0000 7f2dfbd72640 1 -- 172.21.15.28:0/470722892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 msgr2=0x7f2df4154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.978+0000 7f2dfbd72640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df4154670 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2de400b2c0 tx=0x7f2de401b820 comp rx=0 tx=0).stop 2023-12-16T03:25:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.982+0000 7f2dfbd72640 1 -- 172.21.15.28:0/470722892 shutdown_connections 2023-12-16T03:25:52.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.982+0000 7f2dfbd72640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40c63c0 0x7f2df41ed070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:52.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.982+0000 7f2dfbd72640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd80664a0 0x7f2dd8068960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:52.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.982+0000 7f2dfbd72640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df4154670 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:52.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.982+0000 7f2dfbd72640 1 --2- 172.21.15.28:0/470722892 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c29e0 0x7f2df4070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:52.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.982+0000 7f2dfbd72640 1 -- 172.21.15.28:0/470722892 >> 172.21.15.28:0/470722892 conn(0x7f2df406a5b0 msgr2=0x7f2df40a6900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:52.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.982+0000 7f2dfbd72640 1 -- 172.21.15.28:0/470722892 shutdown_connections 2023-12-16T03:25:52.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:52.982+0000 7f2dfbd72640 1 -- 172.21.15.28:0/470722892 wait complete. 2023-12-16T03:25:53.007 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-16T03:25:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.150+0000 7f1e4378d640 1 Processor -- start 2023-12-16T03:25:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.150+0000 7f1e4378d640 1 -- start start 2023-12-16T03:25:53.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e4378d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e3c14eb30 0x7f1e3c154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e4378d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1e3c06e4c0 0x7f1e3c15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e4378d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c1553f0 con 0x7f1e3c06d240 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e4378d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c1556d0 con 0x7f1e3c06e4c0 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e4378d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0c2430 con 0x7f1e3c14eb30 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e40d28640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1e3c06d240 0x7f1e3c06ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47014/0 (socket says 172.21.15.28:47014) 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e40d28640 1 -- 172.21.15.28:0/983001696 learned_addr learned my addr 172.21.15.28:0/983001696 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e41529640 1 --2- 172.21.15.28:0/983001696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e3c14eb30 0x7f1e3c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e41d2a640 1 --2- 172.21.15.28:0/983001696 >> v2:172.21.15.134:3300/0 conn(0x7f1e3c06e4c0 0x7f1e3c15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e33fff640 1 -- 172.21.15.28:0/983001696 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7418368 0 0) 0x7f1e3c1553f0 con 0x7f1e3c06d240 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e33fff640 1 -- 172.21.15.28:0/983001696 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e28003530 con 0x7f1e3c06d240 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e41529640 1 -- 172.21.15.28:0/983001696 >> v2:172.21.15.134:3300/0 conn(0x7f1e3c06e4c0 msgr2=0x7f1e3c15bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e41529640 1 --2- 172.21.15.28:0/983001696 >> v2:172.21.15.134:3300/0 conn(0x7f1e3c06e4c0 0x7f1e3c15bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:53.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e41529640 1 -- 172.21.15.28:0/983001696 >> v1:172.21.15.28:6789/0 conn(0x7f1e3c06d240 legacy=0x7f1e3c06ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:53.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e33fff640 1 -- 172.21.15.28:0/983001696 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1227618213 0 0) 0x7f1e28003530 con 0x7f1e3c06d240 2023-12-16T03:25:53.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.154+0000 7f1e41529640 1 -- 172.21.15.28:0/983001696 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c0c2710 con 0x7f1e3c14eb30 2023-12-16T03:25:53.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e41529640 1 --2- 172.21.15.28:0/983001696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e3c14eb30 0x7f1e3c154940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1e380097c0 tx=0x7f1e3801c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b165b9b25570c841 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:53.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e33fff640 1 -- 172.21.15.28:0/983001696 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0016a0 con 0x7f1e3c14eb30 2023-12-16T03:25:53.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e33fff640 1 -- 172.21.15.28:0/983001696 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e380a7050 con 0x7f1e3c14eb30 2023-12-16T03:25:53.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e33fff640 1 -- 172.21.15.28:0/983001696 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380ab620 con 0x7f1e3c14eb30 2023-12-16T03:25:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e4378d640 1 -- 172.21.15.28:0/983001696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e3c14eb30 msgr2=0x7f1e3c154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e4378d640 1 --2- 172.21.15.28:0/983001696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e3c14eb30 0x7f1e3c154940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1e380097c0 tx=0x7f1e3801c2e0 comp rx=0 tx=0).stop 2023-12-16T03:25:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e4378d640 1 -- 172.21.15.28:0/983001696 shutdown_connections 2023-12-16T03:25:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e4378d640 1 --2- 172.21.15.28:0/983001696 >> v2:172.21.15.134:3300/0 conn(0x7f1e3c06e4c0 0x7f1e3c15bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e4378d640 1 --2- 172.21.15.28:0/983001696 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e3c14eb30 0x7f1e3c154940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e4378d640 1 -- 172.21.15.28:0/983001696 >> 172.21.15.28:0/983001696 conn(0x7f1e3c0c3980 msgr2=0x7f1e3c0c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e4378d640 1 -- 172.21.15.28:0/983001696 shutdown_connections 2023-12-16T03:25:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e4378d640 1 -- 172.21.15.28:0/983001696 wait complete. 2023-12-16T03:25:53.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e4378d640 1 Processor -- start 2023-12-16T03:25:53.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.158+0000 7f1e4378d640 1 -- start start 2023-12-16T03:25:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e4378d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e3c06d240 0x7f1e3c1f1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e4378d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e3c14eb30 0x7f1e3c1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e4378d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e3c0c6840 0x7f1e3c1ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e4378d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0ab390 con 0x7f1e3c0c6840 2023-12-16T03:25:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e4378d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c154430 con 0x7f1e3c06d240 2023-12-16T03:25:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e4378d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c154710 con 0x7f1e3c14eb30 2023-12-16T03:25:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e41d2a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e3c0c6840 0x7f1e3c1ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e41d2a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e3c0c6840 0x7f1e3c1ed620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57570/0 (socket says 172.21.15.28:57570) 2023-12-16T03:25:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e41d2a640 1 -- 172.21.15.28:0/1386994406 learned_addr learned my addr 172.21.15.28:0/1386994406 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e41529640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e3c06d240 0x7f1e3c1f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e40d28640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e3c14eb30 0x7f1e3c1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e41d2a640 1 -- 172.21.15.28:0/1386994406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e3c14eb30 msgr2=0x7f1e3c1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e41d2a640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e3c14eb30 0x7f1e3c1537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e41d2a640 1 -- 172.21.15.28:0/1386994406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e3c06d240 msgr2=0x7f1e3c1f1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e41d2a640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e3c06d240 0x7f1e3c1f1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e41d2a640 1 -- 172.21.15.28:0/1386994406 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38009420 con 0x7f1e3c0c6840 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e41529640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e3c06d240 0x7f1e3c1f1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e41d2a640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e3c0c6840 0x7f1e3c1ed620 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400ef90 tx=0x7f1e3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e31ffb640 1 -- 172.21.15.28:0/1386994406 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34009ca0 con 0x7f1e3c0c6840 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e31ffb640 1 -- 172.21.15.28:0/1386994406 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3400f040 con 0x7f1e3c0c6840 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e31ffb640 1 -- 172.21.15.28:0/1386994406 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e340146c0 con 0x7f1e3c0c6840 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e4378d640 1 -- 172.21.15.28:0/1386994406 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c1f0c30 con 0x7f1e3c0c6840 2023-12-16T03:25:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e4378d640 1 -- 172.21.15.28:0/1386994406 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c1f11f0 con 0x7f1e3c0c6840 2023-12-16T03:25:53.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.162+0000 7f1e4378d640 1 -- 172.21.15.28:0/1386994406 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c068400 con 0x7f1e3c0c6840 2023-12-16T03:25:53.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.166+0000 7f1e31ffb640 1 -- 172.21.15.28:0/1386994406 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1e34014820 con 0x7f1e3c0c6840 2023-12-16T03:25:53.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.166+0000 7f1e31ffb640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1e20066470 0x7f1e20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:53.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.166+0000 7f1e31ffb640 1 -- 172.21.15.28:0/1386994406 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1e34084cc0 con 0x7f1e3c0c6840 2023-12-16T03:25:53.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.166+0000 7f1e41529640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1e20066470 0x7f1e20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:53.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.166+0000 7f1e41529640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1e20066470 0x7f1e20068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e380ad000 tx=0x7f1e38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:53.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.170+0000 7f1e31ffb640 1 -- 172.21.15.28:0/1386994406 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1e3408b080 con 0x7f1e3c0c6840 2023-12-16T03:25:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.326+0000 7f1e4378d640 1 -- 172.21.15.28:0/1386994406 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e3c0c3590 con 0x7f1e3c0c6840 2023-12-16T03:25:53.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.978+0000 7f1e31ffb640 1 -- 172.21.15.28:0/1386994406 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1e340180d0 con 0x7f1e3c0c6840 2023-12-16T03:25:53.985 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2023-12-16T03:25:53.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 -- 172.21.15.28:0/1386994406 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1e20066470 msgr2=0x7f1e20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:53.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1e20066470 0x7f1e20068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e380ad000 tx=0x7f1e38008040 comp rx=0 tx=0).stop 2023-12-16T03:25:53.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 -- 172.21.15.28:0/1386994406 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e3c0c6840 msgr2=0x7f1e3c1ed620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:53.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e3c0c6840 0x7f1e3c1ed620 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400ef90 tx=0x7f1e3400c490 comp rx=0 tx=0).stop 2023-12-16T03:25:53.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 -- 172.21.15.28:0/1386994406 shutdown_connections 2023-12-16T03:25:53.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1e20066470 0x7f1e20068930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:53.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e3c0c6840 0x7f1e3c1ed620 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:53.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e3c14eb30 0x7f1e3c1537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:53.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 --2- 172.21.15.28:0/1386994406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e3c06d240 0x7f1e3c1f1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:53.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 -- 172.21.15.28:0/1386994406 >> 172.21.15.28:0/1386994406 conn(0x7f1e3c0c3980 msgr2=0x7f1e3c0c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:53.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 -- 172.21.15.28:0/1386994406 shutdown_connections 2023-12-16T03:25:53.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:53.982+0000 7f1e4378d640 1 -- 172.21.15.28:0/1386994406 wait complete. 2023-12-16T03:25:54.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-16T03:25:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.158+0000 7f020b165640 1 Processor -- start 2023-12-16T03:25:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.158+0000 7f020b165640 1 -- start start 2023-12-16T03:25:54.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f020b165640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f02040c07f0 0x7f02040c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:54.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f020b165640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0204073b70 con 0x7f02040c0370 2023-12-16T03:25:54.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f020b165640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02040c0c80 con 0x7f0204151e00 2023-12-16T03:25:54.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f020b165640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02040735b0 con 0x7f02040c07f0 2023-12-16T03:25:54.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0203fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f02040c0370 0x7f02040c12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47022/0 (socket says 172.21.15.28:47022) 2023-12-16T03:25:54.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0203fff640 1 -- 172.21.15.28:0/2664120672 learned_addr learned my addr 172.21.15.28:0/2664120672 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0209702640 1 --2- 172.21.15.28:0/2664120672 >> v2:172.21.15.134:3300/0 conn(0x7f02040c07f0 0x7f02040c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303713227 0 0) 0x7f0204073b70 con 0x7f02040c0370 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f4003530 con 0x7f02040c0370 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964387980 0 0) 0x7f02040c0c80 con 0x7f0204151e00 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0204073b70 con 0x7f0204151e00 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1957309702 0 0) 0x7f01f4003530 con 0x7f02040c0370 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 >> v2:172.21.15.134:3300/0 conn(0x7f02040c07f0 msgr2=0x7f02040c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 --2- 172.21.15.28:0/2664120672 >> v2:172.21.15.134:3300/0 conn(0x7f02040c07f0 0x7f02040c19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 >> v1:172.21.15.134:6789/0 conn(0x7f0204151e00 legacy=0x7f0204158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204073890 con 0x7f02040c0370 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f01f0001680 con 0x7f02040c0370 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 >> v1:172.21.15.28:6789/0 conn(0x7f02040c0370 legacy=0x7f02040c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 0x7f01f4003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40047d0 0x7f01f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f4005250 0x7f01f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02040735b0 con 0x7f01f4003b60 2023-12-16T03:25:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f400c190 con 0x7f01f4005250 2023-12-16T03:25:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f400c350 con 0x7f01f40047d0 2023-12-16T03:25:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0208f01640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 0x7f01f4003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0203fff640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40047d0 0x7f01f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0209702640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f4005250 0x7f01f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0208f01640 1 -- 172.21.15.28:0/2664120672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40047d0 msgr2=0x7f01f4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0208f01640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f40047d0 0x7f01f4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0208f01640 1 -- 172.21.15.28:0/2664120672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f4005250 msgr2=0x7f01f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:54.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0208f01640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f4005250 0x7f01f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:54.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0208f01640 1 -- 172.21.15.28:0/2664120672 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f4003530 con 0x7f01f4003b60 2023-12-16T03:25:54.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0209702640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f4005250 0x7f01f400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:54.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.162+0000 7f0209702640 1 -- 172.21.15.28:0/2664120672 reap_dead start 2023-12-16T03:25:54.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f0208f01640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 0x7f01f4003f60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f01f80018d0 tx=0x7f01f801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352624a761c908bc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:54.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80052d0 con 0x7f01f4003b60 2023-12-16T03:25:54.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f80a7050 con 0x7f01f4003b60 2023-12-16T03:25:54.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f02037fe640 1 -- 172.21.15.28:0/2664120672 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8003600 con 0x7f01f4003b60 2023-12-16T03:25:54.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f020b165640 1 -- 172.21.15.28:0/2664120672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 msgr2=0x7f01f4003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:54.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f020b165640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 0x7f01f4003f60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f01f80018d0 tx=0x7f01f801c500 comp rx=0 tx=0).stop 2023-12-16T03:25:54.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f020b165640 1 -- 172.21.15.28:0/2664120672 shutdown_connections 2023-12-16T03:25:54.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f020b165640 1 --2- 172.21.15.28:0/2664120672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 0x7f01f4003f60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:54.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f020b165640 1 -- 172.21.15.28:0/2664120672 >> 172.21.15.28:0/2664120672 conn(0x7f02040c31a0 msgr2=0x7f02040c35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:54.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f020b165640 1 -- 172.21.15.28:0/2664120672 shutdown_connections 2023-12-16T03:25:54.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f020b165640 1 -- 172.21.15.28:0/2664120672 wait complete. 2023-12-16T03:25:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f020b165640 1 Processor -- start 2023-12-16T03:25:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.166+0000 7f020b165640 1 -- start start 2023-12-16T03:25:54.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f020b165640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 0x7f02041502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:54.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f020b165640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f020414cb70 0x7f020414cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:54.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f020b165640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02040aac40 0x7f02040ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:54.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f020b165640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0204154a10 con 0x7f01f4003b60 2023-12-16T03:25:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f020b165640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02041f0c80 con 0x7f02040aac40 2023-12-16T03:25:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f020b165640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0204154c60 con 0x7f020414cb70 2023-12-16T03:25:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f0208f01640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 0x7f02041502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f0208f01640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 0x7f02041502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57584/0 (socket says 172.21.15.28:57584) 2023-12-16T03:25:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f0208f01640 1 -- 172.21.15.28:0/1001140706 learned_addr learned my addr 172.21.15.28:0/1001140706 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f0203fff640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f020414cb70 0x7f020414cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f0209702640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02040aac40 0x7f02040ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f0208f01640 1 -- 172.21.15.28:0/1001140706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f020414cb70 msgr2=0x7f020414cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f0208f01640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f020414cb70 0x7f020414cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f0208f01640 1 -- 172.21.15.28:0/1001140706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02040aac40 msgr2=0x7f02040ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f0208f01640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02040aac40 0x7f02040ab0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f0208f01640 1 -- 172.21.15.28:0/1001140706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204154f40 con 0x7f01f4003b60 2023-12-16T03:25:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f0208f01640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 0x7f02041502c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f01f8005040 tx=0x7f01f4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f02017fa640 1 -- 172.21.15.28:0/1001140706 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8007220 con 0x7f01f4003b60 2023-12-16T03:25:54.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f02017fa640 1 -- 172.21.15.28:0/1001140706 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f8007380 con 0x7f01f4003b60 2023-12-16T03:25:54.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f02017fa640 1 -- 172.21.15.28:0/1001140706 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80067e0 con 0x7f01f4003b60 2023-12-16T03:25:54.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f020b165640 1 -- 172.21.15.28:0/1001140706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020414d530 con 0x7f01f4003b60 2023-12-16T03:25:54.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f020b165640 1 -- 172.21.15.28:0/1001140706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02040ac4e0 con 0x7f01f4003b60 2023-12-16T03:25:54.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.170+0000 7f020b165640 1 -- 172.21.15.28:0/1001140706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0204068400 con 0x7f01f4003b60 2023-12-16T03:25:54.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.174+0000 7f02017fa640 1 -- 172.21.15.28:0/1001140706 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f01f8006940 con 0x7f01f4003b60 2023-12-16T03:25:54.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.174+0000 7f02017fa640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01e80664a0 0x7f01e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:54.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.174+0000 7f02017fa640 1 -- 172.21.15.28:0/1001140706 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f01f811db50 con 0x7f01f4003b60 2023-12-16T03:25:54.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.174+0000 7f0203fff640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01e80664a0 0x7f01e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:54.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.174+0000 7f0203fff640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01e80664a0 0x7f01e8068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0204066b80 tx=0x7f01f0001030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:54.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.178+0000 7f02017fa640 1 -- 172.21.15.28:0/1001140706 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f01f80eb150 con 0x7f01f4003b60 2023-12-16T03:25:54.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.342+0000 7f020b165640 1 -- 172.21.15.28:0/1001140706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02040c56a0 con 0x7f01f4003b60 2023-12-16T03:25:54.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.986+0000 7f02017fa640 1 -- 172.21.15.28:0/1001140706 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f01f80ee770 con 0x7f01f4003b60 2023-12-16T03:25:54.991 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2023-12-16T03:25:54.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 -- 172.21.15.28:0/1001140706 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01e80664a0 msgr2=0x7f01e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:54.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01e80664a0 0x7f01e8068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0204066b80 tx=0x7f01f0001030 comp rx=0 tx=0).stop 2023-12-16T03:25:54.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 -- 172.21.15.28:0/1001140706 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 msgr2=0x7f02041502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:54.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 0x7f02041502c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f01f8005040 tx=0x7f01f4005800 comp rx=0 tx=0).stop 2023-12-16T03:25:54.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 -- 172.21.15.28:0/1001140706 shutdown_connections 2023-12-16T03:25:54.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02040aac40 0x7f02040ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:54.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f020414cb70 0x7f020414cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:54.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01e80664a0 0x7f01e8068960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:54.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 --2- 172.21.15.28:0/1001140706 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01f4003b60 0x7f02041502c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:54.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 -- 172.21.15.28:0/1001140706 >> 172.21.15.28:0/1001140706 conn(0x7f02040c31a0 msgr2=0x7f02040c4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:54.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 -- 172.21.15.28:0/1001140706 shutdown_connections 2023-12-16T03:25:54.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:54.990+0000 7f020b165640 1 -- 172.21.15.28:0/1001140706 wait complete. 2023-12-16T03:25:55.022 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-16T03:25:55.022 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-16T03:25:55.022 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-16T03:25:55.022 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:25:55.023 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-16T03:25:55.023 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-16T03:25:55.023 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-16T03:25:55.023 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:25:55.024 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-16T03:25:55.024 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-16T03:25:55.024 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-16T03:25:55.024 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:25:55.025 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-16T03:25:55.025 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-16T03:25:55.025 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-16T03:25:55.025 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:25:55.038 INFO:tasks.ceph.mds.a:Stopped 2023-12-16T03:25:55.039 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-16T03:25:55.039 INFO:tasks.ceph.mds.c:Stopped 2023-12-16T03:25:55.040 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-16T03:25:55.046 INFO:tasks.ceph.mds.d:Stopped 2023-12-16T03:25:55.046 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-16T03:25:55.047 INFO:tasks.ceph.mds.b:Stopped 2023-12-16T03:25:55.047 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-16T03:25:55.084 INFO:tasks.ceph.mds.a:Started 2023-12-16T03:25:55.084 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:55.086 INFO:tasks.ceph.mds.c:Started 2023-12-16T03:25:55.086 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:55.095 INFO:tasks.ceph.mds.d:Started 2023-12-16T03:25:55.095 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:55.097 INFO:tasks.ceph.mds.b:Started 2023-12-16T03:25:55.097 DEBUG:teuthology.parallel:result is None 2023-12-16T03:25:55.098 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-16T03:25:55.172 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-12-16T03:25:55.173 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2023-12-16T03:25:55.184 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2023-12-16T03:25:55.184 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-12-16T03:25:55.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.242+0000 7f265b679640 1 Processor -- start 2023-12-16T03:25:55.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.242+0000 7f265b679640 1 -- start start 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f265b679640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2654151e90 0x7f26540c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f265b679640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f26540c4e60 0x7f265406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f265b679640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265406c860 con 0x7f26540c7ea0 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f265b679640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26540c8750 con 0x7f26540c4e60 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f265b679640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26541552d0 con 0x7f2654151e90 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f2659c16640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f26540c4e60 0x7f265406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f2659c16640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f26540c4e60 0x7f265406bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57638/0 (socket says 172.21.15.28:57638) 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f2659c16640 1 -- 172.21.15.28:0/1980156010 learned_addr learned my addr 172.21.15.28:0/1980156010 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f2659415640 1 --2- 172.21.15.28:0/1980156010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2654151e90 0x7f26540c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f2659c16640 1 -- 172.21.15.28:0/1980156010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2654151e90 msgr2=0x7f26540c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f2659c16640 1 --2- 172.21.15.28:0/1980156010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2654151e90 0x7f26540c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f2659c16640 1 -- 172.21.15.28:0/1980156010 >> v1:172.21.15.134:6789/0 conn(0x7f26540c7ea0 legacy=0x7f265406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:55.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f2659c16640 1 -- 172.21.15.28:0/1980156010 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2654154930 con 0x7f26540c4e60 2023-12-16T03:25:55.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.246+0000 7f2659c16640 1 --2- 172.21.15.28:0/1980156010 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26540c4e60 0x7f265406bbb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f264c009e50 tx=0x7f264c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2281a65251ca7d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:55.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f264bfff640 1 -- 172.21.15.28:0/1980156010 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c0a55b0 con 0x7f26540c4e60 2023-12-16T03:25:55.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f264bfff640 1 -- 172.21.15.28:0/1980156010 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c0a5710 con 0x7f26540c4e60 2023-12-16T03:25:55.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f264bfff640 1 -- 172.21.15.28:0/1980156010 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c0a5aa0 con 0x7f26540c4e60 2023-12-16T03:25:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 -- 172.21.15.28:0/1980156010 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26540c4e60 msgr2=0x7f265406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 --2- 172.21.15.28:0/1980156010 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26540c4e60 0x7f265406bbb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f264c009e50 tx=0x7f264c01c8f0 comp rx=0 tx=0).stop 2023-12-16T03:25:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 -- 172.21.15.28:0/1980156010 shutdown_connections 2023-12-16T03:25:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 --2- 172.21.15.28:0/1980156010 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26540c4e60 0x7f265406bbb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 --2- 172.21.15.28:0/1980156010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2654151e90 0x7f26540c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 -- 172.21.15.28:0/1980156010 >> 172.21.15.28:0/1980156010 conn(0x7f26540ca170 msgr2=0x7f26540ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 -- 172.21.15.28:0/1980156010 shutdown_connections 2023-12-16T03:25:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 -- 172.21.15.28:0/1980156010 wait complete. 2023-12-16T03:25:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 Processor -- start 2023-12-16T03:25:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 -- start start 2023-12-16T03:25:55.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26540c4e60 0x7f26540ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:55.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26540c7ea0 0x7f26541ee450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:55.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2654151e90 0x7f26541f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:55.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265414ba70 con 0x7f26540c4e60 2023-12-16T03:25:55.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26540ae580 con 0x7f26540c7ea0 2023-12-16T03:25:55.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f265b679640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26540ad5f0 con 0x7f2654151e90 2023-12-16T03:25:55.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f2659415640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26540c4e60 0x7f26540ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:55.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f2659415640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26540c4e60 0x7f26540ae040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57640/0 (socket says 172.21.15.28:57640) 2023-12-16T03:25:55.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f2659415640 1 -- 172.21.15.28:0/3004006441 learned_addr learned my addr 172.21.15.28:0/3004006441 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:55.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f2659c16640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2654151e90 0x7f26541f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:55.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f2658c14640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26540c7ea0 0x7f26541ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:55.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f2659415640 1 -- 172.21.15.28:0/3004006441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2654151e90 msgr2=0x7f26541f07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:55.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f2659415640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2654151e90 0x7f26541f07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:55.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f2659415640 1 -- 172.21.15.28:0/3004006441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26540c7ea0 msgr2=0x7f26541ee450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:55.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f2659415640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26540c7ea0 0x7f26541ee450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:55.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.250+0000 7f2659415640 1 -- 172.21.15.28:0/3004006441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c009b30 con 0x7f26540c4e60 2023-12-16T03:25:55.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.254+0000 7f2659415640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26540c4e60 0x7f26540ae040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f265000e930 tx=0x7f265000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:55.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.254+0000 7f2649ffb640 1 -- 172.21.15.28:0/3004006441 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650009690 con 0x7f26540c4e60 2023-12-16T03:25:55.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.254+0000 7f2649ffb640 1 -- 172.21.15.28:0/3004006441 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265000ca00 con 0x7f26540c4e60 2023-12-16T03:25:55.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.254+0000 7f265b679640 1 -- 172.21.15.28:0/3004006441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26540adbb0 con 0x7f26540c4e60 2023-12-16T03:25:55.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.254+0000 7f2649ffb640 1 -- 172.21.15.28:0/3004006441 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265000cd70 con 0x7f26540c4e60 2023-12-16T03:25:55.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.254+0000 7f265b679640 1 -- 172.21.15.28:0/3004006441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26540ad840 con 0x7f26540c4e60 2023-12-16T03:25:55.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.254+0000 7f265b679640 1 -- 172.21.15.28:0/3004006441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2654068400 con 0x7f26540c4e60 2023-12-16T03:25:55.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.254+0000 7f2649ffb640 1 -- 172.21.15.28:0/3004006441 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2650013470 con 0x7f26540c4e60 2023-12-16T03:25:55.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.254+0000 7f2649ffb640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2638066470 0x7f2638068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:55.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.254+0000 7f2649ffb640 1 -- 172.21.15.28:0/3004006441 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2650083d30 con 0x7f26540c4e60 2023-12-16T03:25:55.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.254+0000 7f2658c14640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2638066470 0x7f2638068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:55.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.258+0000 7f2658c14640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2638066470 0x7f2638068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2654150d80 tx=0x7f2644009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:55.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.258+0000 7f2649ffb640 1 -- 172.21.15.28:0/3004006441 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2650051610 con 0x7f26540c4e60 2023-12-16T03:25:55.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:55.434+0000 7f265b679640 1 -- 172.21.15.28:0/3004006441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2654154500 con 0x7f26540c4e60 2023-12-16T03:25:56.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f2649ffb640 1 -- 172.21.15.28:0/3004006441 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2650017080 con 0x7f26540c4e60 2023-12-16T03:25:56.450 INFO:teuthology.orchestra.run.smithi028.stderr: removed all blocklist entries 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 -- 172.21.15.28:0/3004006441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2638066470 msgr2=0x7f2638068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2638066470 0x7f2638068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2654150d80 tx=0x7f2644009040 comp rx=0 tx=0).stop 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 -- 172.21.15.28:0/3004006441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26540c4e60 msgr2=0x7f26540ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26540c4e60 0x7f26540ae040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f265000e930 tx=0x7f265000edf0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 -- 172.21.15.28:0/3004006441 shutdown_connections 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2654151e90 0x7f26541f07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26540c7ea0 0x7f26541ee450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2638066470 0x7f2638068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 --2- 172.21.15.28:0/3004006441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f26540c4e60 0x7f26540ae040 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 -- 172.21.15.28:0/3004006441 >> 172.21.15.28:0/3004006441 conn(0x7f26540ca170 msgr2=0x7f265415e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 -- 172.21.15.28:0/3004006441 shutdown_connections 2023-12-16T03:25:56.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.446+0000 7f265b679640 1 -- 172.21.15.28:0/3004006441 wait complete. 2023-12-16T03:25:56.476 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-16T03:25:56.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feebc3b8640 1 Processor -- start 2023-12-16T03:25:56.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feebc3b8640 1 -- start start 2023-12-16T03:25:56.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feebc3b8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feeb40c5260 0x7feeb406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:56.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feebc3b8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feeb4155de0 0x7feeb4156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:56.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feebc3b8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb40c2580 con 0x7feeb40c5640 2023-12-16T03:25:56.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feebc3b8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb4153510 con 0x7feeb40c5260 2023-12-16T03:25:56.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feebc3b8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb40c17f0 con 0x7feeb4155de0 2023-12-16T03:25:56.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feeba154640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feeb40c5260 0x7feeb406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:56.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feeba154640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feeb40c5260 0x7feeb406d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57656/0 (socket says 172.21.15.28:57656) 2023-12-16T03:25:56.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feeba154640 1 -- 172.21.15.28:0/893621914 learned_addr learned my addr 172.21.15.28:0/893621914 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:56.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feeba955640 1 --2- 172.21.15.28:0/893621914 >> v2:172.21.15.134:3300/0 conn(0x7feeb4155de0 0x7feeb4156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:56.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feeba154640 1 -- 172.21.15.28:0/893621914 >> v2:172.21.15.134:3300/0 conn(0x7feeb4155de0 msgr2=0x7feeb4156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:56.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feeba154640 1 --2- 172.21.15.28:0/893621914 >> v2:172.21.15.134:3300/0 conn(0x7feeb4155de0 0x7feeb4156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feeba154640 1 -- 172.21.15.28:0/893621914 >> v1:172.21.15.134:6789/0 conn(0x7feeb40c5640 legacy=0x7feeb40c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:56.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.618+0000 7feeba154640 1 -- 172.21.15.28:0/893621914 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40c1a00 con 0x7feeb40c5260 2023-12-16T03:25:56.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feeba154640 1 --2- 172.21.15.28:0/893621914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeb40c5260 0x7feeb406d5b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feeb40c6b10 tx=0x7feeb001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511bb60ca02c5ee8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:56.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feeb9152640 1 -- 172.21.15.28:0/893621914 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00ab640 con 0x7feeb40c5260 2023-12-16T03:25:56.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feeb9152640 1 -- 172.21.15.28:0/893621914 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb00a7070 con 0x7feeb40c5260 2023-12-16T03:25:56.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feeb9152640 1 -- 172.21.15.28:0/893621914 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00ab9c0 con 0x7feeb40c5260 2023-12-16T03:25:56.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feebc3b8640 1 -- 172.21.15.28:0/893621914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeb40c5260 msgr2=0x7feeb406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:56.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feebc3b8640 1 --2- 172.21.15.28:0/893621914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeb40c5260 0x7feeb406d5b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feeb40c6b10 tx=0x7feeb001c440 comp rx=0 tx=0).stop 2023-12-16T03:25:56.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feebc3b8640 1 -- 172.21.15.28:0/893621914 shutdown_connections 2023-12-16T03:25:56.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feebc3b8640 1 --2- 172.21.15.28:0/893621914 >> v2:172.21.15.134:3300/0 conn(0x7feeb4155de0 0x7feeb4156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feebc3b8640 1 --2- 172.21.15.28:0/893621914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeb40c5260 0x7feeb406d5b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feebc3b8640 1 -- 172.21.15.28:0/893621914 >> 172.21.15.28:0/893621914 conn(0x7feeb406a5b0 msgr2=0x7feeb406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:56.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feebc3b8640 1 -- 172.21.15.28:0/893621914 shutdown_connections 2023-12-16T03:25:56.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.622+0000 7feebc3b8640 1 -- 172.21.15.28:0/893621914 wait complete. 2023-12-16T03:25:56.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feebc3b8640 1 Processor -- start 2023-12-16T03:25:56.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feebc3b8640 1 -- start start 2023-12-16T03:25:56.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feebc3b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb40c5260 0x7feeb4154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:56.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feebc3b8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeb40c5640 0x7feeb40bd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:56.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feebc3b8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeb4155de0 0x7feeb40bda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:56.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feebc3b8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40bd070 con 0x7feeb40c5640 2023-12-16T03:25:56.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feebc3b8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb41eed30 con 0x7feeb40c5260 2023-12-16T03:25:56.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feebc3b8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb41ef010 con 0x7feeb4155de0 2023-12-16T03:25:56.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeb9953640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeb40c5640 0x7feeb40bd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeb9953640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeb40c5640 0x7feeb40bd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57670/0 (socket says 172.21.15.28:57670) 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeb9953640 1 -- 172.21.15.28:0/962210929 learned_addr learned my addr 172.21.15.28:0/962210929 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeba955640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeb4155de0 0x7feeb40bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeba154640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb40c5260 0x7feeb4154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeb9953640 1 -- 172.21.15.28:0/962210929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeb4155de0 msgr2=0x7feeb40bda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeb9953640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeb4155de0 0x7feeb40bda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeb9953640 1 -- 172.21.15.28:0/962210929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb40c5260 msgr2=0x7feeb4154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeb9953640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb40c5260 0x7feeb4154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeb9953640 1 -- 172.21.15.28:0/962210929 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00094d0 con 0x7feeb40c5640 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeb9953640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeb40c5640 0x7feeb40bd500 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feea400c390 tx=0x7feea400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeaaffd640 1 -- 172.21.15.28:0/962210929 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea40052d0 con 0x7feeb40c5640 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeaaffd640 1 -- 172.21.15.28:0/962210929 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4005430 con 0x7feeb40c5640 2023-12-16T03:25:56.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feeaaffd640 1 -- 172.21.15.28:0/962210929 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4003820 con 0x7feeb40c5640 2023-12-16T03:25:56.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feebc3b8640 1 -- 172.21.15.28:0/962210929 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb40bc0d0 con 0x7feeb40c5640 2023-12-16T03:25:56.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.626+0000 7feebc3b8640 1 -- 172.21.15.28:0/962210929 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb4154eb0 con 0x7feeb40c5640 2023-12-16T03:25:56.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.630+0000 7feebc3b8640 1 -- 172.21.15.28:0/962210929 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb4068400 con 0x7feeb40c5640 2023-12-16T03:25:56.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.630+0000 7feeaaffd640 1 -- 172.21.15.28:0/962210929 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7feea4003980 con 0x7feeb40c5640 2023-12-16T03:25:56.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.630+0000 7feeaaffd640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fee98066470 0x7fee98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:56.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.630+0000 7feeaaffd640 1 -- 172.21.15.28:0/962210929 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feea4083060 con 0x7feeb40c5640 2023-12-16T03:25:56.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.630+0000 7feeba154640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fee98066470 0x7fee98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:56.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.630+0000 7feeba154640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fee98066470 0x7fee98068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feeb00af000 tx=0x7feeb00b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:56.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.634+0000 7feeaaffd640 1 -- 172.21.15.28:0/962210929 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7feea40b4290 con 0x7feeb40c5640 2023-12-16T03:25:56.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 -- 172.21.15.28:0/962210929 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feeb40724f0 con 0x7feeb40c5640 2023-12-16T03:25:56.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feeaaffd640 1 -- 172.21.15.28:0/962210929 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6065 (secure 0 0 0) 0x7feea4017090 con 0x7feeb40c5640 2023-12-16T03:25:56.850 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: "auth_dump": [ 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.a", 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lGdUuDBAA9e6veUuYLf2+kocAK6lSbA==", 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.b", 2023-12-16T03:25:56.851 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lVwi5GBAAaUcDHi9WGhRuJZxdAF2qFA==", 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.c", 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lhw+xExAA3bRuBx2ItsL1Rc8see+tCQ==", 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:25:56.852 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.d", 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1ljr1CIBAAkEkWnhykut5uG4ARAKJvRA==", 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.853 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.0", 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBZGH1l80qNNRAA0+mdmZ1tm0i6Jc4XYM4aCw==", 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.1", 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBdGH1lJW/FABAAm5ylV9HO9EWb+06Y2OwfVw==", 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.854 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.2", 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBgGH1l9x5DBxAAYGKOx8uO5Nf5KROP8dcugA==", 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.3", 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBjGH1lEwhVDhAAA66C1s8baoujas3ncXfeiA==", 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.855 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.4", 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBpGH1lUKgjGRAACZa14hbBnIoe+pU4Z38i0w==", 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.856 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.5", 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBsGH1lzxWVIRAApu48WaE3/juZiozOmmbZnA==", 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.6", 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBvGH1laENmJxAAmYE1mukqTgUzVp+h5pRYVw==", 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.857 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.7", 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQByGH1lyEIXLhAAIfj8iGtpH2wLL/lvBoPkaA==", 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.0", 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lvVeHJBAAIUmgW3XLan0rUG31Cw+zwQ==", 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.858 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow r", 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw", 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rwx" 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.1", 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lgMMbKBAACWizLH1wqYLfSHVjCwyqHQ==", 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow r", 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw", 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rwx" 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.859 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.admin", 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBXGH1lPy/qKhAAAG+o0iL3cZoTmFmA7XqJdw==", 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-mds", 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQCCGH1lQfqZJRAApAFqDKMBaw5OLR2KBYZMRg==", 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-mds" 2023-12-16T03:25:56.860 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-mgr", 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQCCGH1ljQeaJRAA/Reu1Q3T9yvzFRulHsWMHA==", 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-osd", 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQCCGH1l2RCaJRAAYk/47wAD4pk2xojPoiNxIQ==", 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-osd" 2023-12-16T03:25:56.861 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rbd", 2023-12-16T03:25:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQCCGH1lcRmaJRAAI4EEwGhW3m3m/B9pkxHWGg==", 2023-12-16T03:25:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-16T03:25:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-16T03:25:56.862 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQCCGH1lFyKaJRAAmABCxy5sG5avnd0qUAfxJw==", 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rgw", 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQCCGH1lLiuaJRAAz0BiC5M7zPPyUDKYRgtFKQ==", 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.x", 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1l0bdlBxAA/aAGpB8vk/Ggs6Mi6E57sw==", 2023-12-16T03:25:56.863 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.y", 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1l2CKLAxAA1E6EQPvBVrOt77Tw/cAi3A==", 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2023-12-16T03:25:56.864 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:25:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 -- 172.21.15.28:0/962210929 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fee98066470 msgr2=0x7fee98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fee98066470 0x7fee98068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feeb00af000 tx=0x7feeb00b6040 comp rx=0 tx=0).stop 2023-12-16T03:25:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 -- 172.21.15.28:0/962210929 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeb40c5640 msgr2=0x7feeb40bd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeb40c5640 0x7feeb40bd500 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feea400c390 tx=0x7feea400c850 comp rx=0 tx=0).stop 2023-12-16T03:25:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 -- 172.21.15.28:0/962210929 shutdown_connections 2023-12-16T03:25:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeb4155de0 0x7feeb40bda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fee98066470 0x7fee98068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeb40c5640 0x7feeb40bd500 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 --2- 172.21.15.28:0/962210929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb40c5260 0x7feeb4154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 -- 172.21.15.28:0/962210929 >> 172.21.15.28:0/962210929 conn(0x7feeb406a5b0 msgr2=0x7feeb4152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 -- 172.21.15.28:0/962210929 shutdown_connections 2023-12-16T03:25:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:56.846+0000 7feebc3b8640 1 -- 172.21.15.28:0/962210929 wait complete. 2023-12-16T03:25:56.871 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-16T03:25:57.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.010+0000 7fc2ef1b5640 1 Processor -- start 2023-12-16T03:25:57.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.010+0000 7fc2ef1b5640 1 -- start start 2023-12-16T03:25:57.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.010+0000 7fc2ef1b5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e8151cd0 0x7fc2e80ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.010+0000 7fc2ef1b5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e80c8160 con 0x7fc2e8154be0 2023-12-16T03:25:57.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.010+0000 7fc2ef1b5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e8157b40 con 0x7fc2e80c7c50 2023-12-16T03:25:57.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.010+0000 7fc2ef1b5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8157e20 con 0x7fc2e8151cd0 2023-12-16T03:25:57.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.010+0000 7fc2ee9b4640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc2e8154be0 0x7fc2e815ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47054/0 (socket says 172.21.15.28:47054) 2023-12-16T03:25:57.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.010+0000 7fc2ee9b4640 1 -- 172.21.15.28:0/1453951040 learned_addr learned my addr 172.21.15.28:0/1453951040 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:57.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.010+0000 7fc2ee1b3640 1 --2- 172.21.15.28:0/1453951040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e8151cd0 0x7fc2e80ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.014+0000 7fc2ed1b1640 1 -- 172.21.15.28:0/1453951040 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410824903 0 0) 0x7fc2e80c8160 con 0x7fc2e8154be0 2023-12-16T03:25:57.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.014+0000 7fc2ed1b1640 1 -- 172.21.15.28:0/1453951040 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d4003530 con 0x7fc2e8154be0 2023-12-16T03:25:57.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.014+0000 7fc2ed1b1640 1 -- 172.21.15.28:0/1453951040 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011453886 0 0) 0x7fc2e8157b40 con 0x7fc2e80c7c50 2023-12-16T03:25:57.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.014+0000 7fc2ed1b1640 1 -- 172.21.15.28:0/1453951040 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e80c8160 con 0x7fc2e80c7c50 2023-12-16T03:25:57.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.014+0000 7fc2ee1b3640 1 -- 172.21.15.28:0/1453951040 >> v1:172.21.15.134:6789/0 conn(0x7fc2e80c7c50 legacy=0x7fc2e81544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.014+0000 7fc2ee1b3640 1 -- 172.21.15.28:0/1453951040 >> v1:172.21.15.28:6789/0 conn(0x7fc2e8154be0 legacy=0x7fc2e815ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.014+0000 7fc2ee1b3640 1 -- 172.21.15.28:0/1453951040 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8158100 con 0x7fc2e8151cd0 2023-12-16T03:25:57.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.014+0000 7fc2ee1b3640 1 --2- 172.21.15.28:0/1453951040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e8151cd0 0x7fc2e80ca460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40097f0 tx=0x7fc2e401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d173df80d6ed54c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:57.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.014+0000 7fc2ed1b1640 1 -- 172.21.15.28:0/1453951040 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40aa610 con 0x7fc2e8151cd0 2023-12-16T03:25:57.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.014+0000 7fc2ed1b1640 1 -- 172.21.15.28:0/1453951040 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e40a6040 con 0x7fc2e8151cd0 2023-12-16T03:25:57.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ed1b1640 1 -- 172.21.15.28:0/1453951040 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40aa990 con 0x7fc2e8151cd0 2023-12-16T03:25:57.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1453951040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e8151cd0 msgr2=0x7fc2e80ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 --2- 172.21.15.28:0/1453951040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e8151cd0 0x7fc2e80ca460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40097f0 tx=0x7fc2e401c490 comp rx=0 tx=0).stop 2023-12-16T03:25:57.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1453951040 shutdown_connections 2023-12-16T03:25:57.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 --2- 172.21.15.28:0/1453951040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e8151cd0 0x7fc2e80ca460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1453951040 >> 172.21.15.28:0/1453951040 conn(0x7fc2e80abee0 msgr2=0x7fc2e80c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:57.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1453951040 shutdown_connections 2023-12-16T03:25:57.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1453951040 wait complete. 2023-12-16T03:25:57.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 Processor -- start 2023-12-16T03:25:57.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 -- start start 2023-12-16T03:25:57.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e80c7c50 0x7fc2e8144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2e8151cd0 0x7fc2e8145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8154be0 0x7fc2e81467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8146030 con 0x7fc2e8151cd0 2023-12-16T03:25:57.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8146310 con 0x7fc2e8154be0 2023-12-16T03:25:57.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ef1b5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8147430 con 0x7fc2e80c7c50 2023-12-16T03:25:57.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ed9b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2e8151cd0 0x7fc2e8145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ed9b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2e8151cd0 0x7fc2e8145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57676/0 (socket says 172.21.15.28:57676) 2023-12-16T03:25:57.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ed9b2640 1 -- 172.21.15.28:0/1820670727 learned_addr learned my addr 172.21.15.28:0/1820670727 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:57.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ee9b4640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8154be0 0x7fc2e81467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ee1b3640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e80c7c50 0x7fc2e8144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ed9b2640 1 -- 172.21.15.28:0/1820670727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e80c7c50 msgr2=0x7fc2e8144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ed9b2640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e80c7c50 0x7fc2e8144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ed9b2640 1 -- 172.21.15.28:0/1820670727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8154be0 msgr2=0x7fc2e81467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ed9b2640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8154be0 0x7fc2e81467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ed9b2640 1 -- 172.21.15.28:0/1820670727 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4009420 con 0x7fc2e8151cd0 2023-12-16T03:25:57.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ee1b3640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e80c7c50 0x7fc2e8144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:57.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.018+0000 7fc2ee9b4640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8154be0 0x7fc2e81467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:57.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.022+0000 7fc2ed9b2640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2e8151cd0 0x7fc2e8145000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800c430 tx=0x7fc2d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:57.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.022+0000 7fc2deffd640 1 -- 172.21.15.28:0/1820670727 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80052d0 con 0x7fc2e8151cd0 2023-12-16T03:25:57.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.022+0000 7fc2deffd640 1 -- 172.21.15.28:0/1820670727 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8005450 con 0x7fc2e8151cd0 2023-12-16T03:25:57.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.022+0000 7fc2deffd640 1 -- 172.21.15.28:0/1820670727 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8003840 con 0x7fc2e8151cd0 2023-12-16T03:25:57.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.022+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1820670727 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e8157140 con 0x7fc2e8151cd0 2023-12-16T03:25:57.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.022+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1820670727 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e8157700 con 0x7fc2e8151cd0 2023-12-16T03:25:57.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.022+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1820670727 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e804e850 con 0x7fc2e8151cd0 2023-12-16T03:25:57.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.022+0000 7fc2deffd640 1 -- 172.21.15.28:0/1820670727 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc2d80039a0 con 0x7fc2e8151cd0 2023-12-16T03:25:57.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.022+0000 7fc2deffd640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2cc066470 0x7fc2cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.022+0000 7fc2deffd640 1 -- 172.21.15.28:0/1820670727 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc2d8083160 con 0x7fc2e8151cd0 2023-12-16T03:25:57.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.022+0000 7fc2ee1b3640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2cc066470 0x7fc2cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.026+0000 7fc2ee1b3640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2cc066470 0x7fc2cc068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40ae000 tx=0x7fc2e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:57.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.026+0000 7fc2deffd640 1 -- 172.21.15.28:0/1820670727 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc2d8050920 con 0x7fc2e8151cd0 2023-12-16T03:25:57.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.238+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1820670727 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc2e81550a0 con 0x7fc2e8151cd0 2023-12-16T03:25:57.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2deffd640 1 -- 172.21.15.28:0/1820670727 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc2d8053f40 con 0x7fc2e8151cd0 2023-12-16T03:25:57.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1820670727 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2cc066470 msgr2=0x7fc2cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2cc066470 0x7fc2cc068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40ae000 tx=0x7fc2e4008040 comp rx=0 tx=0).stop 2023-12-16T03:25:57.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1820670727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2e8151cd0 msgr2=0x7fc2e8145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2e8151cd0 0x7fc2e8145000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800c430 tx=0x7fc2d800c8f0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1820670727 shutdown_connections 2023-12-16T03:25:57.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e8154be0 0x7fc2e81467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2cc066470 0x7fc2cc068930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2e8151cd0 0x7fc2e8145000 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 --2- 172.21.15.28:0/1820670727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2e80c7c50 0x7fc2e8144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1820670727 >> 172.21.15.28:0/1820670727 conn(0x7fc2e80abee0 msgr2=0x7fc2e80c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:57.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1820670727 shutdown_connections 2023-12-16T03:25:57.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.242+0000 7fc2ef1b5640 1 -- 172.21.15.28:0/1820670727 wait complete. 2023-12-16T03:25:57.267 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-16T03:25:57.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.406+0000 7fa3a809a640 1 Processor -- start 2023-12-16T03:25:57.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.406+0000 7fa3a809a640 1 -- start start 2023-12-16T03:25:57.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a809a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa3a00c5260 0x7fa3a006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a809a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a00c2580 con 0x7fa3a00c5640 2023-12-16T03:25:57.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a809a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a0156940 con 0x7fa3a0155de0 2023-12-16T03:25:57.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a809a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a0153510 con 0x7fa3a00c5260 2023-12-16T03:25:57.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a5e36640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa3a00c5260 0x7fa3a006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a5635640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa3a00c5640 0x7fa3a00c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47070/0 (socket says 172.21.15.28:47070) 2023-12-16T03:25:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a5635640 1 -- 172.21.15.28:0/1318688756 learned_addr learned my addr 172.21.15.28:0/1318688756 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a5e36640 1 -- 172.21.15.28:0/1318688756 >> v1:172.21.15.134:6789/0 conn(0x7fa3a0155de0 legacy=0x7fa3a0156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a5e36640 1 -- 172.21.15.28:0/1318688756 >> v1:172.21.15.28:6789/0 conn(0x7fa3a00c5640 legacy=0x7fa3a00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a5e36640 1 -- 172.21.15.28:0/1318688756 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a00c1a00 con 0x7fa3a00c5260 2023-12-16T03:25:57.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a4e34640 1 -- 172.21.15.28:0/1318688756 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823093846 0 0) 0x7fa3a00c2580 con 0x7fa3a00c5640 2023-12-16T03:25:57.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a5e36640 1 --2- 172.21.15.28:0/1318688756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c5260 0x7fa3a006d5b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0097c0 tx=0x7fa39c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d688f21a178360f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:57.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.410+0000 7fa3a4e34640 1 -- 172.21.15.28:0/1318688756 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0ab600 con 0x7fa3a00c5260 2023-12-16T03:25:57.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a4e34640 1 -- 172.21.15.28:0/1318688756 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c0a7050 con 0x7fa3a00c5260 2023-12-16T03:25:57.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a4e34640 1 -- 172.21.15.28:0/1318688756 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0ab980 con 0x7fa3a00c5260 2023-12-16T03:25:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 -- 172.21.15.28:0/1318688756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c5260 msgr2=0x7fa3a006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 --2- 172.21.15.28:0/1318688756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c5260 0x7fa3a006d5b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0097c0 tx=0x7fa39c01c3b0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 -- 172.21.15.28:0/1318688756 shutdown_connections 2023-12-16T03:25:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 --2- 172.21.15.28:0/1318688756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c5260 0x7fa3a006d5b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 -- 172.21.15.28:0/1318688756 >> 172.21.15.28:0/1318688756 conn(0x7fa3a006a5b0 msgr2=0x7fa3a006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 -- 172.21.15.28:0/1318688756 shutdown_connections 2023-12-16T03:25:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 -- 172.21.15.28:0/1318688756 wait complete. 2023-12-16T03:25:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 Processor -- start 2023-12-16T03:25:57.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 -- start start 2023-12-16T03:25:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c5260 0x7fa3a00a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c5640 0x7fa3a00a9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a0155de0 0x7fa3a00a9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0155930 con 0x7fa3a00c5260 2023-12-16T03:25:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00a9cb0 con 0x7fa3a0155de0 2023-12-16T03:25:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a809a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0071330 con 0x7fa3a00c5640 2023-12-16T03:25:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a5e36640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c5260 0x7fa3a00a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a5e36640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c5260 0x7fa3a00a6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57696/0 (socket says 172.21.15.28:57696) 2023-12-16T03:25:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a5e36640 1 -- 172.21.15.28:0/3905662064 learned_addr learned my addr 172.21.15.28:0/3905662064 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a6637640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a0155de0 0x7fa3a00a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.414+0000 7fa3a5635640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c5640 0x7fa3a00a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3a5e36640 1 -- 172.21.15.28:0/3905662064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c5640 msgr2=0x7fa3a00a9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3a5e36640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c5640 0x7fa3a00a9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3a5e36640 1 -- 172.21.15.28:0/3905662064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a0155de0 msgr2=0x7fa3a00a9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3a5e36640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a0155de0 0x7fa3a00a9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3a5e36640 1 -- 172.21.15.28:0/3905662064 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c009420 con 0x7fa3a00c5260 2023-12-16T03:25:57.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3a6637640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a0155de0 0x7fa3a00a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3a5e36640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c5260 0x7fa3a00a6680 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa39c019fe0 tx=0x7fa39c01abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3967fc640 1 -- 172.21.15.28:0/3905662064 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c004230 con 0x7fa3a00c5260 2023-12-16T03:25:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3967fc640 1 -- 172.21.15.28:0/3905662064 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c004390 con 0x7fa3a00c5260 2023-12-16T03:25:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3967fc640 1 -- 172.21.15.28:0/3905662064 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c003820 con 0x7fa3a00c5260 2023-12-16T03:25:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3a809a640 1 -- 172.21.15.28:0/3905662064 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a00aa4d0 con 0x7fa3a00c5260 2023-12-16T03:25:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3a809a640 1 -- 172.21.15.28:0/3905662064 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a00aaa70 con 0x7fa3a00c5260 2023-12-16T03:25:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3a809a640 1 -- 172.21.15.28:0/3905662064 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a0068400 con 0x7fa3a00c5260 2023-12-16T03:25:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3967fc640 1 -- 172.21.15.28:0/3905662064 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa39c003980 con 0x7fa3a00c5260 2023-12-16T03:25:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3967fc640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa384066470 0x7fa384068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3967fc640 1 -- 172.21.15.28:0/3905662064 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa39c11e4a0 con 0x7fa3a00c5260 2023-12-16T03:25:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.418+0000 7fa3a5635640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa384066470 0x7fa384068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.422+0000 7fa3a5635640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa384066470 0x7fa384068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3a006aab0 tx=0x7fa390007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:57.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.422+0000 7fa3967fc640 1 -- 172.21.15.28:0/3905662064 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa39c0ebc60 con 0x7fa3a00c5260 2023-12-16T03:25:57.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.634+0000 7fa3a809a640 1 -- 172.21.15.28:0/3905662064 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fa3a006d390 con 0x7fa3a00c5260 2023-12-16T03:25:57.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3967fc640 1 -- 172.21.15.28:0/3905662064 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa39c0c40a0 con 0x7fa3a00c5260 2023-12-16T03:25:57.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 -- 172.21.15.28:0/3905662064 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa384066470 msgr2=0x7fa384068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa384066470 0x7fa384068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3a006aab0 tx=0x7fa390007c10 comp rx=0 tx=0).stop 2023-12-16T03:25:57.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 -- 172.21.15.28:0/3905662064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c5260 msgr2=0x7fa3a00a6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c5260 0x7fa3a00a6680 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa39c019fe0 tx=0x7fa39c01abf0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 -- 172.21.15.28:0/3905662064 shutdown_connections 2023-12-16T03:25:57.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a0155de0 0x7fa3a00a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c5640 0x7fa3a00a9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa384066470 0x7fa384068930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 --2- 172.21.15.28:0/3905662064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c5260 0x7fa3a00a6680 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 -- 172.21.15.28:0/3905662064 >> 172.21.15.28:0/3905662064 conn(0x7fa3a006a5b0 msgr2=0x7fa3a014f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:57.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 -- 172.21.15.28:0/3905662064 shutdown_connections 2023-12-16T03:25:57.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.638+0000 7fa3a809a640 1 -- 172.21.15.28:0/3905662064 wait complete. 2023-12-16T03:25:57.663 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-16T03:25:57.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd714ff8640 1 Processor -- start 2023-12-16T03:25:57.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd714ff8640 1 -- start start 2023-12-16T03:25:57.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd714ff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71014b010 0x7fd7100bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd714ff8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd710073a70 0x7fd71006b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd714ff8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71006a5b0 con 0x7fd71006b540 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd714ff8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7100c1d60 con 0x7fd710073a70 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd714ff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100c2040 con 0x7fd71014b010 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd707fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd710073a70 0x7fd71006b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd70ed9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd71006b540 0x7fd710157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47086/0 (socket says 172.21.15.28:47086) 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd70ed9d640 1 -- 172.21.15.28:0/628688213 learned_addr learned my addr 172.21.15.28:0/628688213 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd707fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd710073a70 0x7fd71006b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57702/0 (socket says 172.21.15.28:57702) 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd70e59c640 1 --2- 172.21.15.28:0/628688213 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71014b010 0x7fd7100bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd707fff640 1 -- 172.21.15.28:0/628688213 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71014b010 msgr2=0x7fd7100bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd707fff640 1 --2- 172.21.15.28:0/628688213 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71014b010 0x7fd7100bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd707fff640 1 -- 172.21.15.28:0/628688213 >> v1:172.21.15.28:6789/0 conn(0x7fd71006b540 legacy=0x7fd710157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd707fff640 1 -- 172.21.15.28:0/628688213 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71006a800 con 0x7fd710073a70 2023-12-16T03:25:57.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.802+0000 7fd70dd9b640 1 -- 172.21.15.28:0/628688213 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493679690 0 0) 0x7fd71006a5b0 con 0x7fd71006b540 2023-12-16T03:25:57.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd707fff640 1 --2- 172.21.15.28:0/628688213 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd710073a70 0x7fd71006b000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80097c0 tx=0x7fd6f801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c586b2f906a019c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:57.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd70dd9b640 1 -- 172.21.15.28:0/628688213 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80a8970 con 0x7fd710073a70 2023-12-16T03:25:57.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd70dd9b640 1 -- 172.21.15.28:0/628688213 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f80a8ad0 con 0x7fd710073a70 2023-12-16T03:25:57.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd70dd9b640 1 -- 172.21.15.28:0/628688213 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80a8e60 con 0x7fd710073a70 2023-12-16T03:25:57.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd714ff8640 1 -- 172.21.15.28:0/628688213 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd710073a70 msgr2=0x7fd71006b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd714ff8640 1 --2- 172.21.15.28:0/628688213 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd710073a70 0x7fd71006b000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80097c0 tx=0x7fd6f801ec70 comp rx=0 tx=0).stop 2023-12-16T03:25:57.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd714ff8640 1 -- 172.21.15.28:0/628688213 shutdown_connections 2023-12-16T03:25:57.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd714ff8640 1 --2- 172.21.15.28:0/628688213 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd710073a70 0x7fd71006b000 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd714ff8640 1 --2- 172.21.15.28:0/628688213 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71014b010 0x7fd7100bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd714ff8640 1 -- 172.21.15.28:0/628688213 >> 172.21.15.28:0/628688213 conn(0x7fd7100c30c0 msgr2=0x7fd7100c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:57.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd714ff8640 1 -- 172.21.15.28:0/628688213 shutdown_connections 2023-12-16T03:25:57.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.806+0000 7fd714ff8640 1 -- 172.21.15.28:0/628688213 wait complete. 2023-12-16T03:25:57.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd714ff8640 1 Processor -- start 2023-12-16T03:25:57.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd714ff8640 1 -- start start 2023-12-16T03:25:57.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd714ff8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd710073a70 0x7fd7101e9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd714ff8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71014b010 0x7fd710154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd714ff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd710153ac0 0x7fd710155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd714ff8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710153630 con 0x7fd710073a70 2023-12-16T03:25:57.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd714ff8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710152a20 con 0x7fd71014b010 2023-12-16T03:25:57.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd714ff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd710152d00 con 0x7fd710153ac0 2023-12-16T03:25:57.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd70e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd710073a70 0x7fd7101e9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd70e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd710073a70 0x7fd7101e9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57716/0 (socket says 172.21.15.28:57716) 2023-12-16T03:25:57.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd70e59c640 1 -- 172.21.15.28:0/4222077557 learned_addr learned my addr 172.21.15.28:0/4222077557 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:57.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd707fff640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71014b010 0x7fd710154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd70ed9d640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd710153ac0 0x7fd710155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd70e59c640 1 -- 172.21.15.28:0/4222077557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd710153ac0 msgr2=0x7fd710155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd70e59c640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd710153ac0 0x7fd710155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd70e59c640 1 -- 172.21.15.28:0/4222077557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71014b010 msgr2=0x7fd710154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:57.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd70e59c640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71014b010 0x7fd710154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:57.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd70e59c640 1 -- 172.21.15.28:0/4222077557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f8009420 con 0x7fd710073a70 2023-12-16T03:25:57.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd70ed9d640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd710153ac0 0x7fd710155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:57.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd70e59c640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd710073a70 0x7fd7101e9a90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd70000d5f0 tx=0x7fd70000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:57.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd706ffd640 1 -- 172.21.15.28:0/4222077557 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000125f0 con 0x7fd710073a70 2023-12-16T03:25:57.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd706ffd640 1 -- 172.21.15.28:0/4222077557 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700012750 con 0x7fd710073a70 2023-12-16T03:25:57.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd706ffd640 1 -- 172.21.15.28:0/4222077557 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700012ae0 con 0x7fd710073a70 2023-12-16T03:25:57.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd714ff8640 1 -- 172.21.15.28:0/4222077557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd710152fe0 con 0x7fd710073a70 2023-12-16T03:25:57.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.810+0000 7fd714ff8640 1 -- 172.21.15.28:0/4222077557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd710155080 con 0x7fd710073a70 2023-12-16T03:25:57.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.814+0000 7fd714ff8640 1 -- 172.21.15.28:0/4222077557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd710068400 con 0x7fd710073a70 2023-12-16T03:25:57.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.814+0000 7fd706ffd640 1 -- 172.21.15.28:0/4222077557 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd700012c40 con 0x7fd710073a70 2023-12-16T03:25:57.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.814+0000 7fd706ffd640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6f00664c0 0x7fd6f0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:57.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.814+0000 7fd706ffd640 1 -- 172.21.15.28:0/4222077557 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd700083de0 con 0x7fd710073a70 2023-12-16T03:25:57.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.814+0000 7fd707fff640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6f00664c0 0x7fd6f0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:57.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.814+0000 7fd707fff640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6f00664c0 0x7fd6f0068980 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80b2000 tx=0x7fd6f80aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:57.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:57.818+0000 7fd706ffd640 1 -- 172.21.15.28:0/4222077557 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd700051720 con 0x7fd710073a70 2023-12-16T03:25:58.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.034+0000 7fd714ff8640 1 -- 172.21.15.28:0/4222077557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd710073850 con 0x7fd710073a70 2023-12-16T03:25:58.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.034+0000 7fd706ffd640 1 -- 172.21.15.28:0/4222077557 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd700054d40 con 0x7fd710073a70 2023-12-16T03:25:58.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 -- 172.21.15.28:0/4222077557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6f00664c0 msgr2=0x7fd6f0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6f00664c0 0x7fd6f0068980 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80b2000 tx=0x7fd6f80aa070 comp rx=0 tx=0).stop 2023-12-16T03:25:58.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 -- 172.21.15.28:0/4222077557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd710073a70 msgr2=0x7fd7101e9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd710073a70 0x7fd7101e9a90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd70000d5f0 tx=0x7fd70000dab0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 -- 172.21.15.28:0/4222077557 shutdown_connections 2023-12-16T03:25:58.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd710153ac0 0x7fd710155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71014b010 0x7fd710154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6f00664c0 0x7fd6f0068980 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 --2- 172.21.15.28:0/4222077557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd710073a70 0x7fd7101e9a90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 -- 172.21.15.28:0/4222077557 >> 172.21.15.28:0/4222077557 conn(0x7fd7100c30c0 msgr2=0x7fd710146ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:58.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 -- 172.21.15.28:0/4222077557 shutdown_connections 2023-12-16T03:25:58.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.038+0000 7fd714ff8640 1 -- 172.21.15.28:0/4222077557 wait complete. 2023-12-16T03:25:58.062 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-16T03:25:58.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07fd7b8640 1 Processor -- start 2023-12-16T03:25:58.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07fd7b8640 1 -- start start 2023-12-16T03:25:58.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07fd7b8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f07f80c5260 0x7f07f806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:58.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07fd7b8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07f80c5640 0x7f07f80c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:58.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07fd7b8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f80c2580 con 0x7f07f80c60f0 2023-12-16T03:25:58.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07fd7b8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f8153510 con 0x7f07f80c5260 2023-12-16T03:25:58.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07fd7b8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80c17f0 con 0x7f07f80c5640 2023-12-16T03:25:58.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07f77fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f07f80c60f0 0x7f07f8155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47096/0 (socket says 172.21.15.28:47096) 2023-12-16T03:25:58.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07f77fe640 1 -- 172.21.15.28:0/3773596741 learned_addr learned my addr 172.21.15.28:0/3773596741 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:58.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07f67fc640 1 --2- 172.21.15.28:0/3773596741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07f80c5640 0x7f07f80c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:58.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07f6ffd640 1 --2- 172.21.15.28:0/3773596741 >> v2:172.21.15.134:3300/0 conn(0x7f07f80c5260 0x7f07f806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:58.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07f5ffb640 1 -- 172.21.15.28:0/3773596741 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523176219 0 0) 0x7f07f80c2580 con 0x7f07f80c60f0 2023-12-16T03:25:58.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07f5ffb640 1 -- 172.21.15.28:0/3773596741 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e0003530 con 0x7f07f80c60f0 2023-12-16T03:25:58.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07f67fc640 1 -- 172.21.15.28:0/3773596741 >> v2:172.21.15.134:3300/0 conn(0x7f07f80c5260 msgr2=0x7f07f806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:58.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07f67fc640 1 --2- 172.21.15.28:0/3773596741 >> v2:172.21.15.134:3300/0 conn(0x7f07f80c5260 0x7f07f806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07f67fc640 1 -- 172.21.15.28:0/3773596741 >> v1:172.21.15.28:6789/0 conn(0x7f07f80c60f0 legacy=0x7f07f8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.202+0000 7f07f67fc640 1 -- 172.21.15.28:0/3773596741 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80c1a00 con 0x7f07f80c5640 2023-12-16T03:25:58.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07f67fc640 1 --2- 172.21.15.28:0/3773596741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07f80c5640 0x7f07f80c5bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f07f80c1930 tx=0x7f07ec01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=483900ae0bd48cfa server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:58.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07f5ffb640 1 -- 172.21.15.28:0/3773596741 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0ab600 con 0x7f07f80c5640 2023-12-16T03:25:58.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07f5ffb640 1 -- 172.21.15.28:0/3773596741 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec0a7050 con 0x7f07f80c5640 2023-12-16T03:25:58.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07f5ffb640 1 -- 172.21.15.28:0/3773596741 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0ab980 con 0x7f07f80c5640 2023-12-16T03:25:58.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07fd7b8640 1 -- 172.21.15.28:0/3773596741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07f80c5640 msgr2=0x7f07f80c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07fd7b8640 1 --2- 172.21.15.28:0/3773596741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07f80c5640 0x7f07f80c5bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f07f80c1930 tx=0x7f07ec01c3c0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07fd7b8640 1 -- 172.21.15.28:0/3773596741 shutdown_connections 2023-12-16T03:25:58.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07fd7b8640 1 --2- 172.21.15.28:0/3773596741 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07f80c5640 0x7f07f80c5bb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07fd7b8640 1 --2- 172.21.15.28:0/3773596741 >> v2:172.21.15.134:3300/0 conn(0x7f07f80c5260 0x7f07f806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07fd7b8640 1 -- 172.21.15.28:0/3773596741 >> 172.21.15.28:0/3773596741 conn(0x7f07f806a5b0 msgr2=0x7f07f806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:58.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07fd7b8640 1 -- 172.21.15.28:0/3773596741 shutdown_connections 2023-12-16T03:25:58.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.206+0000 7f07fd7b8640 1 -- 172.21.15.28:0/3773596741 wait complete. 2023-12-16T03:25:58.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07fd7b8640 1 Processor -- start 2023-12-16T03:25:58.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07fd7b8640 1 -- start start 2023-12-16T03:25:58.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07fd7b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07f80c5260 0x7f07f80c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07fd7b8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f80c5640 0x7f07f8070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07fd7b8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07f80c60f0 0x7f07f80a6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07fd7b8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80aad80 con 0x7f07f80c5640 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07fd7b8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8158520 con 0x7f07f80c5260 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07fd7b8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f81f0d30 con 0x7f07f80c60f0 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07f67fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f80c5640 0x7f07f8070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07f67fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f80c5640 0x7f07f8070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57728/0 (socket says 172.21.15.28:57728) 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07f67fc640 1 -- 172.21.15.28:0/2159882813 learned_addr learned my addr 172.21.15.28:0/2159882813 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07f6ffd640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07f80c5260 0x7f07f80c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07f77fe640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07f80c60f0 0x7f07f80a6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07f67fc640 1 -- 172.21.15.28:0/2159882813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07f80c60f0 msgr2=0x7f07f80a6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07f67fc640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07f80c60f0 0x7f07f80a6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07f67fc640 1 -- 172.21.15.28:0/2159882813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07f80c5260 msgr2=0x7f07f80c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07f67fc640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07f80c5260 0x7f07f80c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07f67fc640 1 -- 172.21.15.28:0/2159882813 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec009420 con 0x7f07f80c5640 2023-12-16T03:25:58.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07f67fc640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f80c5640 0x7f07f8070700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0ae040 tx=0x7f07ec019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:58.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07df7fe640 1 -- 172.21.15.28:0/2159882813 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec006e20 con 0x7f07f80c5640 2023-12-16T03:25:58.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07df7fe640 1 -- 172.21.15.28:0/2159882813 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec0b4410 con 0x7f07f80c5640 2023-12-16T03:25:58.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07df7fe640 1 -- 172.21.15.28:0/2159882813 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0b4780 con 0x7f07f80c5640 2023-12-16T03:25:58.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07fd7b8640 1 -- 172.21.15.28:0/2159882813 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f80aaaa0 con 0x7f07f80c5640 2023-12-16T03:25:58.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07fd7b8640 1 -- 172.21.15.28:0/2159882813 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f81f0fd0 con 0x7f07f80c5640 2023-12-16T03:25:58.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.210+0000 7f07fd7b8640 1 -- 172.21.15.28:0/2159882813 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f81f0b90 con 0x7f07f80c5640 2023-12-16T03:25:58.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.214+0000 7f07df7fe640 1 -- 172.21.15.28:0/2159882813 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f07ec0b2040 con 0x7f07f80c5640 2023-12-16T03:25:58.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.214+0000 7f07df7fe640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07e4066470 0x7f07e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:58.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.214+0000 7f07df7fe640 1 -- 172.21.15.28:0/2159882813 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f07ec11da90 con 0x7f07f80c5640 2023-12-16T03:25:58.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.214+0000 7f07f6ffd640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07e4066470 0x7f07e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:58.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.214+0000 7f07f6ffd640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07e4066470 0x7f07e4068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f07f806da60 tx=0x7f07e8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:58.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.218+0000 7f07df7fe640 1 -- 172.21.15.28:0/2159882813 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f07f81f0b90 con 0x7f07f80c5640 2023-12-16T03:25:58.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.430+0000 7f07fd7b8640 1 -- 172.21.15.28:0/2159882813 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f07f8158310 con 0x7f07f80c5640 2023-12-16T03:25:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.434+0000 7f07df7fe640 1 -- 172.21.15.28:0/2159882813 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f07f8158310 con 0x7f07f80c5640 2023-12-16T03:25:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 -- 172.21.15.28:0/2159882813 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07e4066470 msgr2=0x7f07e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07e4066470 0x7f07e4068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f07f806da60 tx=0x7f07e8009190 comp rx=0 tx=0).stop 2023-12-16T03:25:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 -- 172.21.15.28:0/2159882813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f80c5640 msgr2=0x7f07f8070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f80c5640 0x7f07f8070700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0ae040 tx=0x7f07ec019160 comp rx=0 tx=0).stop 2023-12-16T03:25:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 -- 172.21.15.28:0/2159882813 shutdown_connections 2023-12-16T03:25:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07f80c60f0 0x7f07f80a6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07e4066470 0x7f07e4068930 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f80c5640 0x7f07f8070700 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 --2- 172.21.15.28:0/2159882813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07f80c5260 0x7f07f80c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 -- 172.21.15.28:0/2159882813 >> 172.21.15.28:0/2159882813 conn(0x7f07f806a5b0 msgr2=0x7f07f8152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 -- 172.21.15.28:0/2159882813 shutdown_connections 2023-12-16T03:25:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.438+0000 7f07fd7b8640 1 -- 172.21.15.28:0/2159882813 wait complete. 2023-12-16T03:25:58.462 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-16T03:25:58.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53d2e09640 1 Processor -- start 2023-12-16T03:25:58.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53d2e09640 1 -- start start 2023-12-16T03:25:58.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53d2e09640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f53cc0725c0 0x7f53cc1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:58.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53d2e09640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc0c2760 con 0x7f53cc072090 2023-12-16T03:25:58.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53d2e09640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc0a5750 con 0x7f53cc0a5370 2023-12-16T03:25:58.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53d2e09640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc0c3070 con 0x7f53cc0725c0 2023-12-16T03:25:58.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53cbfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f53cc072090 0x7f53cc150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47100/0 (socket says 172.21.15.28:47100) 2023-12-16T03:25:58.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53cbfff640 1 -- 172.21.15.28:0/84212956 learned_addr learned my addr 172.21.15.28:0/84212956 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:58.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53d13a6640 1 --2- 172.21.15.28:0/84212956 >> v2:172.21.15.28:3300/0 conn(0x7f53cc0725c0 0x7f53cc1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:58.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53d13a6640 1 -- 172.21.15.28:0/84212956 >> v1:172.21.15.134:6789/0 conn(0x7f53cc0a5370 legacy=0x7f53cc0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:58.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53d13a6640 1 -- 172.21.15.28:0/84212956 >> v1:172.21.15.28:6789/0 conn(0x7f53cc072090 legacy=0x7f53cc150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53cb7fe640 1 -- 172.21.15.28:0/84212956 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375685623 0 0) 0x7f53cc0c2760 con 0x7f53cc072090 2023-12-16T03:25:58.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.602+0000 7f53d13a6640 1 -- 172.21.15.28:0/84212956 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0aad20 con 0x7f53cc0725c0 2023-12-16T03:25:58.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53d13a6640 1 --2- 172.21.15.28:0/84212956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53cc0725c0 0x7f53cc1516b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009d90 tx=0x7f53c401d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578f92404758a88f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:58.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53cb7fe640 1 -- 172.21.15.28:0/84212956 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c40a6820 con 0x7f53cc0725c0 2023-12-16T03:25:58.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53cb7fe640 1 -- 172.21.15.28:0/84212956 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c40a6980 con 0x7f53cc0725c0 2023-12-16T03:25:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53cb7fe640 1 -- 172.21.15.28:0/84212956 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c40a6d10 con 0x7f53cc0725c0 2023-12-16T03:25:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53d2e09640 1 -- 172.21.15.28:0/84212956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53cc0725c0 msgr2=0x7f53cc1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53d2e09640 1 --2- 172.21.15.28:0/84212956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53cc0725c0 0x7f53cc1516b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009d90 tx=0x7f53c401d900 comp rx=0 tx=0).stop 2023-12-16T03:25:58.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53d2e09640 1 -- 172.21.15.28:0/84212956 shutdown_connections 2023-12-16T03:25:58.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53d2e09640 1 --2- 172.21.15.28:0/84212956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53cc0725c0 0x7f53cc1516b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53d2e09640 1 -- 172.21.15.28:0/84212956 >> 172.21.15.28:0/84212956 conn(0x7f53cc06a5b0 msgr2=0x7f53cc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:58.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53d2e09640 1 -- 172.21.15.28:0/84212956 shutdown_connections 2023-12-16T03:25:58.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53d2e09640 1 -- 172.21.15.28:0/84212956 wait complete. 2023-12-16T03:25:58.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53d2e09640 1 Processor -- start 2023-12-16T03:25:58.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.606+0000 7f53d2e09640 1 -- start start 2023-12-16T03:25:58.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d2e09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53cc072090 0x7f53cc1eb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:58.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d2e09640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53cc0725c0 0x7f53cc0c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:58.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d2e09640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0a5370 0x7f53cc1419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:58.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d2e09640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc1eb9e0 con 0x7f53cc072090 2023-12-16T03:25:58.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d2e09640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc1495e0 con 0x7f53cc0a5370 2023-12-16T03:25:58.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d2e09640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc149020 con 0x7f53cc0725c0 2023-12-16T03:25:58.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d0ba5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53cc072090 0x7f53cc1eb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d0ba5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53cc072090 0x7f53cc1eb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57750/0 (socket says 172.21.15.28:57750) 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d0ba5640 1 -- 172.21.15.28:0/3143252998 learned_addr learned my addr 172.21.15.28:0/3143252998 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d13a6640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0a5370 0x7f53cc1419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53cbfff640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53cc0725c0 0x7f53cc0c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d0ba5640 1 -- 172.21.15.28:0/3143252998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53cc0725c0 msgr2=0x7f53cc0c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d0ba5640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53cc0725c0 0x7f53cc0c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d0ba5640 1 -- 172.21.15.28:0/3143252998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0a5370 msgr2=0x7f53cc1419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d0ba5640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0a5370 0x7f53cc1419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d0ba5640 1 -- 172.21.15.28:0/3143252998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c4009a70 con 0x7f53cc072090 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d13a6640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0a5370 0x7f53cc1419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d0ba5640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53cc072090 0x7f53cc1eb4a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f53c000b410 tx=0x7f53c000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53c97fa640 1 -- 172.21.15.28:0/3143252998 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0004020 con 0x7f53cc072090 2023-12-16T03:25:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53c97fa640 1 -- 172.21.15.28:0/3143252998 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0004180 con 0x7f53cc072090 2023-12-16T03:25:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53c97fa640 1 -- 172.21.15.28:0/3143252998 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0011630 con 0x7f53cc072090 2023-12-16T03:25:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d2e09640 1 -- 172.21.15.28:0/3143252998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc149300 con 0x7f53cc072090 2023-12-16T03:25:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d2e09640 1 -- 172.21.15.28:0/3143252998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc0a7d60 con 0x7f53cc072090 2023-12-16T03:25:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.610+0000 7f53d2e09640 1 -- 172.21.15.28:0/3143252998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc0c1a20 con 0x7f53cc072090 2023-12-16T03:25:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.614+0000 7f53c97fa640 1 -- 172.21.15.28:0/3143252998 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f53c0011790 con 0x7f53cc072090 2023-12-16T03:25:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.614+0000 7f53c97fa640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53b0066470 0x7f53b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.614+0000 7f53c97fa640 1 -- 172.21.15.28:0/3143252998 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f53c00838c0 con 0x7f53cc072090 2023-12-16T03:25:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.614+0000 7f53cbfff640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53b0066470 0x7f53b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.614+0000 7f53cbfff640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53b0066470 0x7f53b0068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f53cc1e8890 tx=0x7f53b8007b60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:58.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.618+0000 7f53c97fa640 1 -- 172.21.15.28:0/3143252998 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f53c0051080 con 0x7f53cc072090 2023-12-16T03:25:58.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.830+0000 7f53d2e09640 1 -- 172.21.15.28:0/3143252998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f53cc068400 con 0x7f53cc072090 2023-12-16T03:25:58.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53c97fa640 1 -- 172.21.15.28:0/3143252998 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f53c00150a0 con 0x7f53cc072090 2023-12-16T03:25:58.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 -- 172.21.15.28:0/3143252998 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53b0066470 msgr2=0x7f53b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53b0066470 0x7f53b0068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f53cc1e8890 tx=0x7f53b8007b60 comp rx=0 tx=0).stop 2023-12-16T03:25:58.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 -- 172.21.15.28:0/3143252998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53cc072090 msgr2=0x7f53cc1eb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:58.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53cc072090 0x7f53cc1eb4a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f53c000b410 tx=0x7f53c000b8d0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 -- 172.21.15.28:0/3143252998 shutdown_connections 2023-12-16T03:25:58.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53cc0a5370 0x7f53cc1419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53cc0725c0 0x7f53cc0c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53b0066470 0x7f53b0068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 --2- 172.21.15.28:0/3143252998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53cc072090 0x7f53cc1eb4a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:58.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 -- 172.21.15.28:0/3143252998 >> 172.21.15.28:0/3143252998 conn(0x7f53cc06a5b0 msgr2=0x7f53cc0c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:58.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 -- 172.21.15.28:0/3143252998 shutdown_connections 2023-12-16T03:25:58.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.834+0000 7f53d2e09640 1 -- 172.21.15.28:0/3143252998 wait complete. 2023-12-16T03:25:58.860 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-16T03:25:59.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:58.998+0000 7fd3e2417640 1 Processor -- start 2023-12-16T03:25:59.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3e2417640 1 -- start start 2023-12-16T03:25:59.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3e2417640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd3dc0c7ea0 0x7fd3dc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3e2417640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3dc06c860 con 0x7fd3dc151e90 2023-12-16T03:25:59.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3e2417640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3dc154930 con 0x7fd3dc06b9e0 2023-12-16T03:25:59.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3e2417640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3dc0c8750 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3dbfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd3dc151e90 0x7fd3dc0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47112/0 (socket says 172.21.15.28:47112) 2023-12-16T03:25:59.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3dbfff640 1 -- 172.21.15.28:0/3310669279 learned_addr learned my addr 172.21.15.28:0/3310669279 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:59.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3db7fe640 1 --2- 172.21.15.28:0/3310669279 >> v2:172.21.15.134:3300/0 conn(0x7fd3dc0c7ea0 0x7fd3dc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3daffd640 1 -- 172.21.15.28:0/3310669279 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328452908 0 0) 0x7fd3dc06c860 con 0x7fd3dc151e90 2023-12-16T03:25:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3daffd640 1 -- 172.21.15.28:0/3310669279 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3c4003530 con 0x7fd3dc151e90 2023-12-16T03:25:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3daffd640 1 -- 172.21.15.28:0/3310669279 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267494231 0 0) 0x7fd3dc154930 con 0x7fd3dc06b9e0 2023-12-16T03:25:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3daffd640 1 -- 172.21.15.28:0/3310669279 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3dc06c860 con 0x7fd3dc06b9e0 2023-12-16T03:25:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3db7fe640 1 -- 172.21.15.28:0/3310669279 >> v1:172.21.15.134:6789/0 conn(0x7fd3dc06b9e0 legacy=0x7fd3dc15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3db7fe640 1 -- 172.21.15.28:0/3310669279 >> v1:172.21.15.28:6789/0 conn(0x7fd3dc151e90 legacy=0x7fd3dc0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3daffd640 1 -- 172.21.15.28:0/3310669279 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 315967113 0 0) 0x7fd3c4003530 con 0x7fd3dc151e90 2023-12-16T03:25:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.002+0000 7fd3db7fe640 1 -- 172.21.15.28:0/3310669279 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc154c10 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3db7fe640 1 --2- 172.21.15.28:0/3310669279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3dc0c7ea0 0x7fd3dc06b4a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00097c0 tx=0x7fd3d001c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98aef4b329ccfe8c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:59.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3daffd640 1 -- 172.21.15.28:0/3310669279 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc001680 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3daffd640 1 -- 172.21.15.28:0/3310669279 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d00a7050 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3daffd640 1 -- 172.21.15.28:0/3310669279 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00ab620 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3e2417640 1 -- 172.21.15.28:0/3310669279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3dc0c7ea0 msgr2=0x7fd3dc06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3e2417640 1 --2- 172.21.15.28:0/3310669279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3dc0c7ea0 0x7fd3dc06b4a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00097c0 tx=0x7fd3d001c280 comp rx=0 tx=0).stop 2023-12-16T03:25:59.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3e2417640 1 -- 172.21.15.28:0/3310669279 shutdown_connections 2023-12-16T03:25:59.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3e2417640 1 --2- 172.21.15.28:0/3310669279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3dc0c7ea0 0x7fd3dc06b4a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3e2417640 1 -- 172.21.15.28:0/3310669279 >> 172.21.15.28:0/3310669279 conn(0x7fd3dc0ca170 msgr2=0x7fd3dc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:59.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3e2417640 1 -- 172.21.15.28:0/3310669279 shutdown_connections 2023-12-16T03:25:59.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3e2417640 1 -- 172.21.15.28:0/3310669279 wait complete. 2023-12-16T03:25:59.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.006+0000 7fd3e2417640 1 Processor -- start 2023-12-16T03:25:59.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3e2417640 1 -- start start 2023-12-16T03:25:59.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3e2417640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3dc06b9e0 0x7fd3dc14b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3e2417640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3dc0c7ea0 0x7fd3dc144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3e2417640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3dc151e90 0x7fd3dc145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3e2417640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc1552d0 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3e2417640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc1459c0 con 0x7fd3dc06b9e0 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3e2417640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc14aca0 con 0x7fd3dc151e90 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3db7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3dc0c7ea0 0x7fd3dc144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3db7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3dc0c7ea0 0x7fd3dc144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57762/0 (socket says 172.21.15.28:57762) 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3db7fe640 1 -- 172.21.15.28:0/370933759 learned_addr learned my addr 172.21.15.28:0/370933759 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3dbfff640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3dc06b9e0 0x7fd3dc14b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3e09b4640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3dc151e90 0x7fd3dc145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3db7fe640 1 -- 172.21.15.28:0/370933759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3dc151e90 msgr2=0x7fd3dc145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3db7fe640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3dc151e90 0x7fd3dc145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3db7fe640 1 -- 172.21.15.28:0/370933759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3dc06b9e0 msgr2=0x7fd3dc14b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3db7fe640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3dc06b9e0 0x7fd3dc14b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3db7fe640 1 -- 172.21.15.28:0/370933759 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0009420 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3dbfff640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3dc06b9e0 0x7fd3dc14b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:25:59.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3db7fe640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3dc0c7ea0 0x7fd3dc144f40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00097c0 tx=0x7fd3d0019020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:59.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3d8ff9640 1 -- 172.21.15.28:0/370933759 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0004020 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3d8ff9640 1 -- 172.21.15.28:0/370933759 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d0004180 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3e2417640 1 -- 172.21.15.28:0/370933759 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc0a9eb0 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3d8ff9640 1 -- 172.21.15.28:0/370933759 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00044f0 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3e2417640 1 -- 172.21.15.28:0/370933759 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc1ee140 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.010+0000 7fd3e2417640 1 -- 172.21.15.28:0/370933759 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3dc068400 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.014+0000 7fd3d8ff9640 1 -- 172.21.15.28:0/370933759 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd3d00b2040 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.014+0000 7fd3d8ff9640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3c8066470 0x7fd3c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.014+0000 7fd3d8ff9640 1 -- 172.21.15.28:0/370933759 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd3d011d830 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.014+0000 7fd3dbfff640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3c8066470 0x7fd3c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.014+0000 7fd3dbfff640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3c8066470 0x7fd3c8068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc000f70 tx=0x7fd3cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:59.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.018+0000 7fd3d8ff9640 1 -- 172.21.15.28:0/370933759 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd3d00eaf70 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.230+0000 7fd3e2417640 1 -- 172.21.15.28:0/370933759 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd3dc0a9eb0 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.230+0000 7fd3d8ff9640 1 -- 172.21.15.28:0/370933759 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd3dc0a9eb0 con 0x7fd3dc0c7ea0 2023-12-16T03:25:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 -- 172.21.15.28:0/370933759 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3c8066470 msgr2=0x7fd3c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3c8066470 0x7fd3c8068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc000f70 tx=0x7fd3cc009040 comp rx=0 tx=0).stop 2023-12-16T03:25:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 -- 172.21.15.28:0/370933759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3dc0c7ea0 msgr2=0x7fd3dc144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3dc0c7ea0 0x7fd3dc144f40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00097c0 tx=0x7fd3d0019020 comp rx=0 tx=0).stop 2023-12-16T03:25:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 -- 172.21.15.28:0/370933759 shutdown_connections 2023-12-16T03:25:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd3dc151e90 0x7fd3dc145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd3c8066470 0x7fd3c8068930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3dc0c7ea0 0x7fd3dc144f40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 --2- 172.21.15.28:0/370933759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3dc06b9e0 0x7fd3dc14b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 -- 172.21.15.28:0/370933759 >> 172.21.15.28:0/370933759 conn(0x7fd3dc0ca170 msgr2=0x7fd3dc14fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 -- 172.21.15.28:0/370933759 shutdown_connections 2023-12-16T03:25:59.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.234+0000 7fd3e2417640 1 -- 172.21.15.28:0/370933759 wait complete. 2023-12-16T03:25:59.259 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:25:59.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1b252a640 1 Processor -- start 2023-12-16T03:25:59.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1b252a640 1 -- start start 2023-12-16T03:25:59.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1b252a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa1ac06bbb0 0x7fa1ac1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1b252a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ac06c860 con 0x7fa1ac151e90 2023-12-16T03:25:59.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1b252a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ac06c000 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1b252a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ac0c8750 con 0x7fa1ac06bbb0 2023-12-16T03:25:59.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1abfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa1ac151e90 0x7fa1ac0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47124/0 (socket says 172.21.15.28:47124) 2023-12-16T03:25:59.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1abfff640 1 -- 172.21.15.28:0/1414927563 learned_addr learned my addr 172.21.15.28:0/1414927563 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:25:59.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1b0ac7640 1 --2- 172.21.15.28:0/1414927563 >> v2:172.21.15.134:3300/0 conn(0x7fa1ac06bbb0 0x7fa1ac1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1aaffd640 1 -- 172.21.15.28:0/1414927563 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461995547 0 0) 0x7fa1ac06c860 con 0x7fa1ac151e90 2023-12-16T03:25:59.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1aaffd640 1 -- 172.21.15.28:0/1414927563 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa194003530 con 0x7fa1ac151e90 2023-12-16T03:25:59.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1aaffd640 1 -- 172.21.15.28:0/1414927563 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132188373 0 0) 0x7fa1ac06c000 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1b0ac7640 1 -- 172.21.15.28:0/1414927563 >> v1:172.21.15.134:6789/0 conn(0x7fa1ac0c7ea0 legacy=0x7fa1ac06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1b0ac7640 1 -- 172.21.15.28:0/1414927563 >> v1:172.21.15.28:6789/0 conn(0x7fa1ac151e90 legacy=0x7fa1ac0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.398+0000 7fa1b0ac7640 1 -- 172.21.15.28:0/1414927563 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac154930 con 0x7fa1ac06bbb0 2023-12-16T03:25:59.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1b0ac7640 1 --2- 172.21.15.28:0/1414927563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1ac06bbb0 0x7fa1ac1600b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009d90 tx=0x7fa1a401c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=decf6f498dec7e6e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:59.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1aaffd640 1 -- 172.21.15.28:0/1414927563 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40a6700 con 0x7fa1ac06bbb0 2023-12-16T03:25:59.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1aaffd640 1 -- 172.21.15.28:0/1414927563 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a40a6860 con 0x7fa1ac06bbb0 2023-12-16T03:25:59.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1aaffd640 1 -- 172.21.15.28:0/1414927563 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40a6bf0 con 0x7fa1ac06bbb0 2023-12-16T03:25:59.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1b252a640 1 -- 172.21.15.28:0/1414927563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1ac06bbb0 msgr2=0x7fa1ac1600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1b252a640 1 --2- 172.21.15.28:0/1414927563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1ac06bbb0 0x7fa1ac1600b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009d90 tx=0x7fa1a401c830 comp rx=0 tx=0).stop 2023-12-16T03:25:59.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1b252a640 1 -- 172.21.15.28:0/1414927563 shutdown_connections 2023-12-16T03:25:59.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1b252a640 1 --2- 172.21.15.28:0/1414927563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1ac06bbb0 0x7fa1ac1600b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1b252a640 1 -- 172.21.15.28:0/1414927563 >> 172.21.15.28:0/1414927563 conn(0x7fa1ac0ca170 msgr2=0x7fa1ac0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:59.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1b252a640 1 -- 172.21.15.28:0/1414927563 shutdown_connections 2023-12-16T03:25:59.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1b252a640 1 -- 172.21.15.28:0/1414927563 wait complete. 2023-12-16T03:25:59.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.402+0000 7fa1b252a640 1 Processor -- start 2023-12-16T03:25:59.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b252a640 1 -- start start 2023-12-16T03:25:59.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b252a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1ac06bbb0 0x7fa1ac1ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b252a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1ac0c7ea0 0x7fa1ac1455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b252a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1ac151e90 0x7fa1ac1ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b252a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac1552d0 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b252a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac14f2a0 con 0x7fa1ac151e90 2023-12-16T03:25:59.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b252a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac1464a0 con 0x7fa1ac06bbb0 2023-12-16T03:25:59.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1ac0c7ea0 0x7fa1ac1455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1ac0c7ea0 0x7fa1ac1455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57778/0 (socket says 172.21.15.28:57778) 2023-12-16T03:25:59.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1ab7fe640 1 -- 172.21.15.28:0/3461824249 learned_addr learned my addr 172.21.15.28:0/3461824249 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:59.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b0ac7640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1ac151e90 0x7fa1ac1ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1abfff640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1ac06bbb0 0x7fa1ac1ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1ab7fe640 1 -- 172.21.15.28:0/3461824249 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1ac06bbb0 msgr2=0x7fa1ac1ee1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1ab7fe640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1ac06bbb0 0x7fa1ac1ee1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1ab7fe640 1 -- 172.21.15.28:0/3461824249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1ac151e90 msgr2=0x7fa1ac1ef780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1ab7fe640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1ac151e90 0x7fa1ac1ef780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1ab7fe640 1 -- 172.21.15.28:0/3461824249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a4009a70 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b0ac7640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1ac151e90 0x7fa1ac1ef780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1abfff640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1ac06bbb0 0x7fa1ac1ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1ab7fe640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1ac0c7ea0 0x7fa1ac1455c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0001ec0 tx=0x7fa1a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1a8ff9640 1 -- 172.21.15.28:0/3461824249 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00054e0 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1a8ff9640 1 -- 172.21.15.28:0/3461824249 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0003600 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1a8ff9640 1 -- 172.21.15.28:0/3461824249 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00039b0 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b252a640 1 -- 172.21.15.28:0/3461824249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac146780 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b252a640 1 -- 172.21.15.28:0/3461824249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ac1450a0 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.406+0000 7fa1b252a640 1 -- 172.21.15.28:0/3461824249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ac068400 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.410+0000 7fa1a8ff9640 1 -- 172.21.15.28:0/3461824249 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa1a0003b10 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.410+0000 7fa1a8ff9640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa198066470 0x7fa198068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.410+0000 7fa1a8ff9640 1 -- 172.21.15.28:0/3461824249 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa1a0083060 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.410+0000 7fa1abfff640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa198066470 0x7fa198068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.410+0000 7fa1abfff640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa198066470 0x7fa198068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa19c005890 tx=0x7fa19c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:59.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.414+0000 7fa1a8ff9640 1 -- 172.21.15.28:0/3461824249 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa1a00508c0 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.574+0000 7fa1b252a640 1 -- 172.21.15.28:0/3461824249 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1ac06ca50 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.574+0000 7fa1a8ff9640 1 -- 172.21.15.28:0/3461824249 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12857 (secure 0 0 0) 0x7fa1a0017020 con 0x7fa1ac0c7ea0 2023-12-16T03:25:59.579 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:25:59.580 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":28,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:25:56.443535+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 -- 172.21.15.28:0/3461824249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa198066470 msgr2=0x7fa198068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa198066470 0x7fa198068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa19c005890 tx=0x7fa19c009040 comp rx=0 tx=0).stop 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 -- 172.21.15.28:0/3461824249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1ac0c7ea0 msgr2=0x7fa1ac1455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1ac0c7ea0 0x7fa1ac1455c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0001ec0 tx=0x7fa1a000c8e0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 -- 172.21.15.28:0/3461824249 shutdown_connections 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1ac151e90 0x7fa1ac1ef780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa198066470 0x7fa198068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1ac0c7ea0 0x7fa1ac1455c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 --2- 172.21.15.28:0/3461824249 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1ac06bbb0 0x7fa1ac1ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 -- 172.21.15.28:0/3461824249 >> 172.21.15.28:0/3461824249 conn(0x7fa1ac0ca170 msgr2=0x7fa1ac143090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 -- 172.21.15.28:0/3461824249 shutdown_connections 2023-12-16T03:25:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.578+0000 7fa1b252a640 1 -- 172.21.15.28:0/3461824249 wait complete. 2023-12-16T03:25:59.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:25:59.602 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:25:59.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0dba9f8640 1 Processor -- start 2023-12-16T03:25:59.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0dba9f8640 1 -- start start 2023-12-16T03:25:59.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0dba9f8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0db40c5260 0x7f0db406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0dba9f8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0db4155de0 0x7f0db4156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0dba9f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db40c2580 con 0x7f0db40c5640 2023-12-16T03:25:59.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0dba9f8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db4153510 con 0x7f0db40c5260 2023-12-16T03:25:59.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0dba9f8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db40c17f0 con 0x7f0db4155de0 2023-12-16T03:25:59.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0db3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0db40c5260 0x7f0db406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0db3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0db40c5260 0x7f0db406d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49282/0 (socket says 172.21.15.28:49282) 2023-12-16T03:25:59.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0db3fff640 1 -- 172.21.15.28:0/681028909 learned_addr learned my addr 172.21.15.28:0/681028909 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0db8f95640 1 --2- 172.21.15.28:0/681028909 >> v2:172.21.15.134:3300/0 conn(0x7f0db4155de0 0x7f0db4156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0db3fff640 1 -- 172.21.15.28:0/681028909 >> v2:172.21.15.134:3300/0 conn(0x7f0db4155de0 msgr2=0x7f0db4156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0db3fff640 1 --2- 172.21.15.28:0/681028909 >> v2:172.21.15.134:3300/0 conn(0x7f0db4155de0 0x7f0db4156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0db3fff640 1 -- 172.21.15.28:0/681028909 >> v1:172.21.15.134:6789/0 conn(0x7f0db40c5640 legacy=0x7f0db40c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0db3fff640 1 -- 172.21.15.28:0/681028909 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db40c1a00 con 0x7f0db40c5260 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.742+0000 7f0db8f95640 1 --2- 172.21.15.28:0/681028909 >> v2:172.21.15.134:3300/0 conn(0x7f0db4155de0 0x7f0db4156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0db3fff640 1 --2- 172.21.15.28:0/681028909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db40c5260 0x7f0db406d5b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0db40c6b10 tx=0x7f0da401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455234bb9ac07e67 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0db2ffd640 1 -- 172.21.15.28:0/681028909 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40ab600 con 0x7f0db40c5260 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0db2ffd640 1 -- 172.21.15.28:0/681028909 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da40ab760 con 0x7f0db40c5260 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0db2ffd640 1 -- 172.21.15.28:0/681028909 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40abaf0 con 0x7f0db40c5260 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0dba9f8640 1 -- 172.21.15.28:0/681028909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db40c5260 msgr2=0x7f0db406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0dba9f8640 1 --2- 172.21.15.28:0/681028909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db40c5260 0x7f0db406d5b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0db40c6b10 tx=0x7f0da401c400 comp rx=0 tx=0).stop 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0dba9f8640 1 -- 172.21.15.28:0/681028909 shutdown_connections 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0dba9f8640 1 --2- 172.21.15.28:0/681028909 >> v2:172.21.15.134:3300/0 conn(0x7f0db4155de0 0x7f0db4156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0dba9f8640 1 --2- 172.21.15.28:0/681028909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db40c5260 0x7f0db406d5b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0dba9f8640 1 -- 172.21.15.28:0/681028909 >> 172.21.15.28:0/681028909 conn(0x7f0db406a5b0 msgr2=0x7f0db406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0dba9f8640 1 -- 172.21.15.28:0/681028909 shutdown_connections 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.746+0000 7f0dba9f8640 1 -- 172.21.15.28:0/681028909 wait complete. 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0dba9f8640 1 Processor -- start 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0dba9f8640 1 -- start start 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0dba9f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db40c5260 0x7f0db40700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0dba9f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db40c5640 0x7f0db4154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0dba9f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db4155de0 0x7f0db4147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0dba9f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40708f0 con 0x7f0db40c5640 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0dba9f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4070bd0 con 0x7f0db40c5260 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0dba9f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4070eb0 con 0x7f0db4155de0 2023-12-16T03:25:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db40c5640 0x7f0db4154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db40c5640 0x7f0db4154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49284/0 (socket says 172.21.15.28:49284) 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db37fe640 1 -- 172.21.15.28:0/3545170056 learned_addr learned my addr 172.21.15.28:0/3545170056 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db3fff640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db40c5260 0x7f0db40700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db8f95640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db4155de0 0x7f0db4147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db37fe640 1 -- 172.21.15.28:0/3545170056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db4155de0 msgr2=0x7f0db4147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db37fe640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db4155de0 0x7f0db4147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db37fe640 1 -- 172.21.15.28:0/3545170056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db40c5260 msgr2=0x7f0db40700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db37fe640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db40c5260 0x7f0db40700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db37fe640 1 -- 172.21.15.28:0/3545170056 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da40094d0 con 0x7f0db40c5640 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db37fe640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db40c5640 0x7f0db4154b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c410 tx=0x7f0da800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db0ff9640 1 -- 172.21.15.28:0/3545170056 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8003600 con 0x7f0db40c5640 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db0ff9640 1 -- 172.21.15.28:0/3545170056 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8003780 con 0x7f0db40c5640 2023-12-16T03:25:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0db0ff9640 1 -- 172.21.15.28:0/3545170056 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8003b30 con 0x7f0db40c5640 2023-12-16T03:25:59.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0dba9f8640 1 -- 172.21.15.28:0/3545170056 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db4071190 con 0x7f0db40c5640 2023-12-16T03:25:59.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.750+0000 7f0dba9f8640 1 -- 172.21.15.28:0/3545170056 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db41ecf40 con 0x7f0db40c5640 2023-12-16T03:25:59.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.754+0000 7f0dba9f8640 1 -- 172.21.15.28:0/3545170056 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db41ed1c0 con 0x7f0db40c5640 2023-12-16T03:25:59.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.754+0000 7f0db0ff9640 1 -- 172.21.15.28:0/3545170056 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0da8003c90 con 0x7f0db40c5640 2023-12-16T03:25:59.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.754+0000 7f0db0ff9640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0da0066470 0x7f0da0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:25:59.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.754+0000 7f0db0ff9640 1 -- 172.21.15.28:0/3545170056 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0da8082d10 con 0x7f0db40c5640 2023-12-16T03:25:59.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.754+0000 7f0db3fff640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0da0066470 0x7f0da0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:25:59.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.754+0000 7f0db3fff640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0da0066470 0x7f0da0068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0da40af000 tx=0x7f0da40b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:25:59.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.758+0000 7f0db0ff9640 1 -- 172.21.15.28:0/3545170056 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0da8050620 con 0x7f0db40c5640 2023-12-16T03:25:59.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0dba9f8640 1 -- 172.21.15.28:0/3545170056 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0db4071380 con 0x7f0db40c5640 2023-12-16T03:25:59.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0db0ff9640 1 -- 172.21.15.28:0/3545170056 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0da80170a0 con 0x7f0db40c5640 2023-12-16T03:25:59.923 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:25:59.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0dba9f8640 1 -- 172.21.15.28:0/3545170056 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0da0066470 msgr2=0x7f0da0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0dba9f8640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0da0066470 0x7f0da0068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0da40af000 tx=0x7f0da40b6040 comp rx=0 tx=0).stop 2023-12-16T03:25:59.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0dba9f8640 1 -- 172.21.15.28:0/3545170056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db40c5640 msgr2=0x7f0db4154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:25:59.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0dba9f8640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db40c5640 0x7f0db4154b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c410 tx=0x7f0da800c8d0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0dba9f8640 1 -- 172.21.15.28:0/3545170056 shutdown_connections 2023-12-16T03:25:59.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0dba9f8640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db4155de0 0x7f0db4147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0dba9f8640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0da0066470 0x7f0da0068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0dba9f8640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db40c5640 0x7f0db4154b10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0dba9f8640 1 --2- 172.21.15.28:0/3545170056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db40c5260 0x7f0db40700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:25:59.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.918+0000 7f0dba9f8640 1 -- 172.21.15.28:0/3545170056 >> 172.21.15.28:0/3545170056 conn(0x7f0db406a5b0 msgr2=0x7f0db41561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:25:59.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.922+0000 7f0dba9f8640 1 -- 172.21.15.28:0/3545170056 shutdown_connections 2023-12-16T03:25:59.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:25:59.922+0000 7f0dba9f8640 1 -- 172.21.15.28:0/3545170056 wait complete. 2023-12-16T03:25:59.944 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-16T03:26:00.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.082+0000 7f234fac9640 1 Processor -- start 2023-12-16T03:26:00.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.082+0000 7f234fac9640 1 -- start start 2023-12-16T03:26:00.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234fac9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f23480c7ea0 0x7f234806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:00.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234fac9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234806c860 con 0x7f2348151e90 2023-12-16T03:26:00.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234fac9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2348154930 con 0x7f234806b9e0 2023-12-16T03:26:00.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234fac9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23480c8750 con 0x7f23480c7ea0 2023-12-16T03:26:00.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234d064640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f23480c7ea0 0x7f234806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:00.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234d865640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2348151e90 0x7f23480c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45050/0 (socket says 172.21.15.28:45050) 2023-12-16T03:26:00.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234d865640 1 -- 172.21.15.28:0/4143139251 learned_addr learned my addr 172.21.15.28:0/4143139251 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:00.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234d064640 1 -- 172.21.15.28:0/4143139251 >> v1:172.21.15.134:6789/0 conn(0x7f234806b9e0 legacy=0x7f234815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:00.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234d064640 1 -- 172.21.15.28:0/4143139251 >> v1:172.21.15.28:6789/0 conn(0x7f2348151e90 legacy=0x7f23480c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:00.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234d064640 1 -- 172.21.15.28:0/4143139251 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2348154c10 con 0x7f23480c7ea0 2023-12-16T03:26:00.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234d064640 1 --2- 172.21.15.28:0/4143139251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23480c7ea0 0x7f234806b4a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f23380097c0 tx=0x7f233801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475aa52802bb993 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:00.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.086+0000 7f234c863640 1 -- 172.21.15.28:0/4143139251 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23380ab600 con 0x7f23480c7ea0 2023-12-16T03:26:00.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234c863640 1 -- 172.21.15.28:0/4143139251 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23380a7050 con 0x7f23480c7ea0 2023-12-16T03:26:00.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234c863640 1 -- 172.21.15.28:0/4143139251 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23380ab980 con 0x7f23480c7ea0 2023-12-16T03:26:00.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 -- 172.21.15.28:0/4143139251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23480c7ea0 msgr2=0x7f234806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:00.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 --2- 172.21.15.28:0/4143139251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23480c7ea0 0x7f234806b4a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f23380097c0 tx=0x7f233801c360 comp rx=0 tx=0).stop 2023-12-16T03:26:00.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 -- 172.21.15.28:0/4143139251 shutdown_connections 2023-12-16T03:26:00.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 --2- 172.21.15.28:0/4143139251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23480c7ea0 0x7f234806b4a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 -- 172.21.15.28:0/4143139251 >> 172.21.15.28:0/4143139251 conn(0x7f23480ca170 msgr2=0x7f23480ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:00.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 -- 172.21.15.28:0/4143139251 shutdown_connections 2023-12-16T03:26:00.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 -- 172.21.15.28:0/4143139251 wait complete. 2023-12-16T03:26:00.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 Processor -- start 2023-12-16T03:26:00.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 -- start start 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f234806b9e0 0x7f23481f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23480c7ea0 0x7f23480c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2348151e90 0x7f23480c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23481552d0 con 0x7f234806b9e0 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2348150c20 con 0x7f2348151e90 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234fac9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c23f0 con 0x7f23480c7ea0 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234d865640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f234806b9e0 0x7f23481f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234d865640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f234806b9e0 0x7f23481f0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49298/0 (socket says 172.21.15.28:49298) 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234d865640 1 -- 172.21.15.28:0/680030360 learned_addr learned my addr 172.21.15.28:0/680030360 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.090+0000 7f234d064640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23480c7ea0 0x7f23480c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234e066640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2348151e90 0x7f23480c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234d865640 1 -- 172.21.15.28:0/680030360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23480c7ea0 msgr2=0x7f23480c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:00.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234d865640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23480c7ea0 0x7f23480c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234d865640 1 -- 172.21.15.28:0/680030360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2348151e90 msgr2=0x7f23480c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:00.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234d865640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2348151e90 0x7f23480c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234d865640 1 -- 172.21.15.28:0/680030360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2338009420 con 0x7f234806b9e0 2023-12-16T03:26:00.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234d064640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23480c7ea0 0x7f23480c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:00.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234e066640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2348151e90 0x7f23480c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:00.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234d865640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f234806b9e0 0x7f23481f0890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f234400c500 tx=0x7f234400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:00.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f233e7fc640 1 -- 172.21.15.28:0/680030360 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2344005cf0 con 0x7f234806b9e0 2023-12-16T03:26:00.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f233e7fc640 1 -- 172.21.15.28:0/680030360 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2344005e50 con 0x7f234806b9e0 2023-12-16T03:26:00.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234fac9640 1 -- 172.21.15.28:0/680030360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23481f1320 con 0x7f234806b9e0 2023-12-16T03:26:00.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f233e7fc640 1 -- 172.21.15.28:0/680030360 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23440072f0 con 0x7f234806b9e0 2023-12-16T03:26:00.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234fac9640 1 -- 172.21.15.28:0/680030360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2348158850 con 0x7f234806b9e0 2023-12-16T03:26:00.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f234fac9640 1 -- 172.21.15.28:0/680030360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2348158a40 con 0x7f234806b9e0 2023-12-16T03:26:00.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f233e7fc640 1 -- 172.21.15.28:0/680030360 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2344007450 con 0x7f234806b9e0 2023-12-16T03:26:00.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f233e7fc640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f232c066470 0x7f232c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:00.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.094+0000 7f233e7fc640 1 -- 172.21.15.28:0/680030360 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2344083040 con 0x7f234806b9e0 2023-12-16T03:26:00.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.098+0000 7f234d064640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f232c066470 0x7f232c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:00.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.098+0000 7f234d064640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f232c066470 0x7f232c068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23380ad000 tx=0x7f2338008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:00.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.102+0000 7f233e7fc640 1 -- 172.21.15.28:0/680030360 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f23440b4290 con 0x7f234806b9e0 2023-12-16T03:26:00.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.266+0000 7f234fac9640 1 -- 172.21.15.28:0/680030360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2348068400 con 0x7f234806b9e0 2023-12-16T03:26:00.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.266+0000 7f233e7fc640 1 -- 172.21.15.28:0/680030360 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2344017020 con 0x7f234806b9e0 2023-12-16T03:26:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:00.271 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2023-12-16T03:26:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2023-12-16T03:26:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2023-12-16T03:26:00.271 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:00.272 INFO:teuthology.orchestra.run.smithi028.stdout:] 2023-12-16T03:26:00.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.266+0000 7f234fac9640 1 -- 172.21.15.28:0/680030360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f232c066470 msgr2=0x7f232c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:00.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.266+0000 7f234fac9640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f232c066470 0x7f232c068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23380ad000 tx=0x7f2338008040 comp rx=0 tx=0).stop 2023-12-16T03:26:00.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.266+0000 7f234fac9640 1 -- 172.21.15.28:0/680030360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f234806b9e0 msgr2=0x7f23481f0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:00.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.266+0000 7f234fac9640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f234806b9e0 0x7f23481f0890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f234400c500 tx=0x7f234400c9c0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.266+0000 7f234fac9640 1 -- 172.21.15.28:0/680030360 shutdown_connections 2023-12-16T03:26:00.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.266+0000 7f234fac9640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2348151e90 0x7f23480c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.266+0000 7f234fac9640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23480c7ea0 0x7f23480c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.270+0000 7f234fac9640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f232c066470 0x7f232c068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.270+0000 7f234fac9640 1 --2- 172.21.15.28:0/680030360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f234806b9e0 0x7f23481f0890 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.270+0000 7f234fac9640 1 -- 172.21.15.28:0/680030360 >> 172.21.15.28:0/680030360 conn(0x7f23480ca170 msgr2=0x7f23480c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:00.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.270+0000 7f234fac9640 1 -- 172.21.15.28:0/680030360 shutdown_connections 2023-12-16T03:26:00.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.270+0000 7f234fac9640 1 -- 172.21.15.28:0/680030360 wait complete. 2023-12-16T03:26:00.292 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-16T03:26:00.292 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-16T03:26:00.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.434+0000 7f6101679640 1 Processor -- start 2023-12-16T03:26:00.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.434+0000 7f6101679640 1 -- start start 2023-12-16T03:26:00.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.434+0000 7f6101679640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f60fc0c4fb0 0x7f60fc0c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.434+0000 7f6101679640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60fc06db90 0x7f60fc06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.434+0000 7f6101679640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60fc0aa750 con 0x7f60fc06c840 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.434+0000 7f6101679640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60fc06e530 con 0x7f60fc0c4fb0 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.434+0000 7f6101679640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0a8f90 con 0x7f60fc06db90 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60faffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f60fc0c4fb0 0x7f60fc0c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60fb7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f60fc06c840 0x7f60fc06ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45052/0 (socket says 172.21.15.28:45052) 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60fb7fe640 1 -- 172.21.15.28:0/2614247864 learned_addr learned my addr 172.21.15.28:0/2614247864 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60fa7fc640 1 --2- 172.21.15.28:0/2614247864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60fc06db90 0x7f60fc06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60faffd640 1 -- 172.21.15.28:0/2614247864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60fc06db90 msgr2=0x7f60fc06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60faffd640 1 --2- 172.21.15.28:0/2614247864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60fc06db90 0x7f60fc06dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60faffd640 1 -- 172.21.15.28:0/2614247864 >> v1:172.21.15.28:6789/0 conn(0x7f60fc06c840 legacy=0x7f60fc06ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60faffd640 1 -- 172.21.15.28:0/2614247864 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc0a9270 con 0x7f60fc0c4fb0 2023-12-16T03:26:00.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60f9ffb640 1 -- 172.21.15.28:0/2614247864 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090946850 0 0) 0x7f60fc0aa750 con 0x7f60fc06c840 2023-12-16T03:26:00.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60faffd640 1 --2- 172.21.15.28:0/2614247864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60fc0c4fb0 0x7f60fc0c1320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0097c0 tx=0x7f60ec01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9574bafaef6ee267 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:00.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60f9ffb640 1 -- 172.21.15.28:0/2614247864 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0ad660 con 0x7f60fc0c4fb0 2023-12-16T03:26:00.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60f9ffb640 1 -- 172.21.15.28:0/2614247864 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec0ad7c0 con 0x7f60fc0c4fb0 2023-12-16T03:26:00.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.438+0000 7f60f9ffb640 1 -- 172.21.15.28:0/2614247864 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0adb50 con 0x7f60fc0c4fb0 2023-12-16T03:26:00.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 -- 172.21.15.28:0/2614247864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60fc0c4fb0 msgr2=0x7f60fc0c1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:00.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 --2- 172.21.15.28:0/2614247864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60fc0c4fb0 0x7f60fc0c1320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0097c0 tx=0x7f60ec01c360 comp rx=0 tx=0).stop 2023-12-16T03:26:00.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 -- 172.21.15.28:0/2614247864 shutdown_connections 2023-12-16T03:26:00.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 --2- 172.21.15.28:0/2614247864 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60fc06db90 0x7f60fc06dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 --2- 172.21.15.28:0/2614247864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60fc0c4fb0 0x7f60fc0c1320 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 -- 172.21.15.28:0/2614247864 >> 172.21.15.28:0/2614247864 conn(0x7f60fc0c5d40 msgr2=0x7f60fc0c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:00.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 -- 172.21.15.28:0/2614247864 shutdown_connections 2023-12-16T03:26:00.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 -- 172.21.15.28:0/2614247864 wait complete. 2023-12-16T03:26:00.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 Processor -- start 2023-12-16T03:26:00.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 -- start start 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60fc06c840 0x7f60fc0a7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60fc06db90 0x7f60fc070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60fc0bad60 0x7f60fc14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0bb700 con 0x7f60fc06db90 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0bb9e0 con 0x7f60fc0bad60 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f6101679640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0bbcc0 con 0x7f60fc06c840 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f60fa7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60fc06db90 0x7f60fc070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f60fa7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60fc06db90 0x7f60fc070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49324/0 (socket says 172.21.15.28:49324) 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f60fa7fc640 1 -- 172.21.15.28:0/2189024980 learned_addr learned my addr 172.21.15.28:0/2189024980 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f60fb7fe640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60fc0bad60 0x7f60fc14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.442+0000 7f60faffd640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60fc06c840 0x7f60fc0a7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60fa7fc640 1 -- 172.21.15.28:0/2189024980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60fc06c840 msgr2=0x7f60fc0a7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60fa7fc640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60fc06c840 0x7f60fc0a7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60fa7fc640 1 -- 172.21.15.28:0/2189024980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60fc0bad60 msgr2=0x7f60fc14bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:00.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60fa7fc640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60fc0bad60 0x7f60fc14bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:00.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60fa7fc640 1 -- 172.21.15.28:0/2189024980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec009420 con 0x7f60fc06db90 2023-12-16T03:26:00.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60fa7fc640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60fc06db90 0x7f60fc070f80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e870 tx=0x7f60f000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:00.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60e37fe640 1 -- 172.21.15.28:0/2189024980 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0009510 con 0x7f60fc06db90 2023-12-16T03:26:00.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60e37fe640 1 -- 172.21.15.28:0/2189024980 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f000eec0 con 0x7f60fc06db90 2023-12-16T03:26:00.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60e37fe640 1 -- 172.21.15.28:0/2189024980 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000cb40 con 0x7f60fc06db90 2023-12-16T03:26:00.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f6101679640 1 -- 172.21.15.28:0/2189024980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc0a5d60 con 0x7f60fc06db90 2023-12-16T03:26:00.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f6101679640 1 -- 172.21.15.28:0/2189024980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc0714c0 con 0x7f60fc06db90 2023-12-16T03:26:00.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f6101679640 1 -- 172.21.15.28:0/2189024980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc068400 con 0x7f60fc06db90 2023-12-16T03:26:00.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60e37fe640 1 -- 172.21.15.28:0/2189024980 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f60f000cca0 con 0x7f60fc06db90 2023-12-16T03:26:00.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60e37fe640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60e8066470 0x7f60e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:00.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60e37fe640 1 -- 172.21.15.28:0/2189024980 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60f0083f60 con 0x7f60fc06db90 2023-12-16T03:26:00.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.446+0000 7f60faffd640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60e8066470 0x7f60e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:00.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.450+0000 7f60faffd640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60e8066470 0x7f60e8068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0af000 tx=0x7f60ec0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:00.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.454+0000 7f60e37fe640 1 -- 172.21.15.28:0/2189024980 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f60f00517e0 con 0x7f60fc06db90 2023-12-16T03:26:00.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:00.610+0000 7f6101679640 1 -- 172.21.15.28:0/2189024980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f60fc0c1100 con 0x7f60fc06db90 2023-12-16T03:26:01.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.426+0000 7f60e37fe640 1 -- 172.21.15.28:0/2189024980 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f60f00170b0 con 0x7f60fc06db90 2023-12-16T03:26:01.430 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2023-12-16T03:26:01.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.426+0000 7f6101679640 1 -- 172.21.15.28:0/2189024980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60e8066470 msgr2=0x7f60e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:01.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.426+0000 7f6101679640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60e8066470 0x7f60e8068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0af000 tx=0x7f60ec0a7000 comp rx=0 tx=0).stop 2023-12-16T03:26:01.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.426+0000 7f6101679640 1 -- 172.21.15.28:0/2189024980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60fc06db90 msgr2=0x7f60fc070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:01.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.426+0000 7f6101679640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60fc06db90 0x7f60fc070f80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e870 tx=0x7f60f000ec70 comp rx=0 tx=0).stop 2023-12-16T03:26:01.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.426+0000 7f6101679640 1 -- 172.21.15.28:0/2189024980 shutdown_connections 2023-12-16T03:26:01.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.426+0000 7f6101679640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60fc0bad60 0x7f60fc14bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:01.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.430+0000 7f6101679640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60e8066470 0x7f60e8068930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:01.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.430+0000 7f6101679640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60fc06db90 0x7f60fc070f80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:01.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.430+0000 7f6101679640 1 --2- 172.21.15.28:0/2189024980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60fc06c840 0x7f60fc0a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:01.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.430+0000 7f6101679640 1 -- 172.21.15.28:0/2189024980 >> 172.21.15.28:0/2189024980 conn(0x7f60fc0c5d40 msgr2=0x7f60fc0723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:01.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.430+0000 7f6101679640 1 -- 172.21.15.28:0/2189024980 shutdown_connections 2023-12-16T03:26:01.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.430+0000 7f6101679640 1 -- 172.21.15.28:0/2189024980 wait complete. 2023-12-16T03:26:01.460 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-16T03:26:01.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.610+0000 7f1d85e32640 1 Processor -- start 2023-12-16T03:26:01.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.610+0000 7f1d85e32640 1 -- start start 2023-12-16T03:26:01.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.610+0000 7f1d85e32640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1d80072090 0x7f1d80150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:01.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.610+0000 7f1d85e32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d800725c0 0x7f1d801514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:01.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.610+0000 7f1d85e32640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d800c2760 con 0x7f1d800a5370 2023-12-16T03:26:01.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.610+0000 7f1d85e32640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d800c3070 con 0x7f1d80072090 2023-12-16T03:26:01.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.610+0000 7f1d85e32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800a5750 con 0x7f1d800725c0 2023-12-16T03:26:01.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.610+0000 7f1d7f7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1d800a5370 0x7f1d800c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45058/0 (socket says 172.21.15.28:45058) 2023-12-16T03:26:01.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.610+0000 7f1d7f7fe640 1 -- 172.21.15.28:0/1204262785 learned_addr learned my addr 172.21.15.28:0/1204262785 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:01.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.610+0000 7f1d7ffff640 1 --2- 172.21.15.28:0/1204262785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d800725c0 0x7f1d801514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:01.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.610+0000 7f1d7effd640 1 --2- 172.21.15.28:0/1204262785 >> v2:172.21.15.134:3300/0 conn(0x7f1d80072090 0x7f1d80150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:01.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d7e7fc640 1 -- 172.21.15.28:0/1204262785 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467431621 0 0) 0x7f1d800c2760 con 0x7f1d800a5370 2023-12-16T03:26:01.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d7e7fc640 1 -- 172.21.15.28:0/1204262785 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d68003530 con 0x7f1d800a5370 2023-12-16T03:26:01.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d7ffff640 1 -- 172.21.15.28:0/1204262785 >> v2:172.21.15.134:3300/0 conn(0x7f1d80072090 msgr2=0x7f1d80150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:01.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d7ffff640 1 --2- 172.21.15.28:0/1204262785 >> v2:172.21.15.134:3300/0 conn(0x7f1d80072090 0x7f1d80150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:01.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d7ffff640 1 -- 172.21.15.28:0/1204262785 >> v1:172.21.15.28:6789/0 conn(0x7f1d800a5370 legacy=0x7f1d800c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:01.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d7ffff640 1 -- 172.21.15.28:0/1204262785 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d800aad20 con 0x7f1d800725c0 2023-12-16T03:26:01.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d7effd640 1 --2- 172.21.15.28:0/1204262785 >> v2:172.21.15.134:3300/0 conn(0x7f1d80072090 0x7f1d80150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:01.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d7ffff640 1 --2- 172.21.15.28:0/1204262785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d800725c0 0x7f1d801514e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009d90 tx=0x7f1d7801c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a03d099b8dadfeb server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:01.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d7e7fc640 1 -- 172.21.15.28:0/1204262785 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780a5860 con 0x7f1d800725c0 2023-12-16T03:26:01.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d7e7fc640 1 -- 172.21.15.28:0/1204262785 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d780a59c0 con 0x7f1d800725c0 2023-12-16T03:26:01.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d7e7fc640 1 -- 172.21.15.28:0/1204262785 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780a5d30 con 0x7f1d800725c0 2023-12-16T03:26:01.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d85e32640 1 -- 172.21.15.28:0/1204262785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d800725c0 msgr2=0x7f1d801514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:01.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.614+0000 7f1d85e32640 1 --2- 172.21.15.28:0/1204262785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d800725c0 0x7f1d801514e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009d90 tx=0x7f1d7801c800 comp rx=0 tx=0).stop 2023-12-16T03:26:01.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 -- 172.21.15.28:0/1204262785 shutdown_connections 2023-12-16T03:26:01.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 --2- 172.21.15.28:0/1204262785 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d800725c0 0x7f1d801514e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:01.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 --2- 172.21.15.28:0/1204262785 >> v2:172.21.15.134:3300/0 conn(0x7f1d80072090 0x7f1d80150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:01.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 -- 172.21.15.28:0/1204262785 >> 172.21.15.28:0/1204262785 conn(0x7f1d8006a5b0 msgr2=0x7f1d8006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:01.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 -- 172.21.15.28:0/1204262785 shutdown_connections 2023-12-16T03:26:01.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 -- 172.21.15.28:0/1204262785 wait complete. 2023-12-16T03:26:01.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 Processor -- start 2023-12-16T03:26:01.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 -- start start 2023-12-16T03:26:01.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d80072090 0x7f1d80070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:01.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d800725c0 0x7f1d800a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:01.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d800a5370 0x7f1d80144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:01.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80146aa0 con 0x7f1d80072090 2023-12-16T03:26:01.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800a6450 con 0x7f1d800725c0 2023-12-16T03:26:01.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800a7020 con 0x7f1d800a5370 2023-12-16T03:26:01.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d7f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d80072090 0x7f1d80070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:01.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d7f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d80072090 0x7f1d80070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49336/0 (socket says 172.21.15.28:49336) 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d7f7fe640 1 -- 172.21.15.28:0/335442076 learned_addr learned my addr 172.21.15.28:0/335442076 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d7effd640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d800725c0 0x7f1d800a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d7ffff640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d800a5370 0x7f1d80144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d7f7fe640 1 -- 172.21.15.28:0/335442076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d800a5370 msgr2=0x7f1d80144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d7f7fe640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d800a5370 0x7f1d80144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d7f7fe640 1 -- 172.21.15.28:0/335442076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d800725c0 msgr2=0x7f1d800a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d7f7fe640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d800725c0 0x7f1d800a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d7f7fe640 1 -- 172.21.15.28:0/335442076 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74009420 con 0x7f1d80072090 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d7f7fe640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d80072090 0x7f1d80070180 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000c3c0 tx=0x7f1d7000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d67fff640 1 -- 172.21.15.28:0/335442076 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70005cf0 con 0x7f1d80072090 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d67fff640 1 -- 172.21.15.28:0/335442076 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d70005e50 con 0x7f1d80072090 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.618+0000 7f1d85e32640 1 -- 172.21.15.28:0/335442076 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d78009a70 con 0x7f1d80072090 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.622+0000 7f1d67fff640 1 -- 172.21.15.28:0/335442076 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d700072f0 con 0x7f1d80072090 2023-12-16T03:26:01.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.622+0000 7f1d85e32640 1 -- 172.21.15.28:0/335442076 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d800a69d0 con 0x7f1d80072090 2023-12-16T03:26:01.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.622+0000 7f1d85e32640 1 -- 172.21.15.28:0/335442076 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d80068400 con 0x7f1d80072090 2023-12-16T03:26:01.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.622+0000 7f1d67fff640 1 -- 172.21.15.28:0/335442076 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1d70007450 con 0x7f1d80072090 2023-12-16T03:26:01.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.622+0000 7f1d67fff640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d6c0664a0 0x7f1d6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:01.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.626+0000 7f1d67fff640 1 -- 172.21.15.28:0/335442076 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1d700835e0 con 0x7f1d80072090 2023-12-16T03:26:01.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.626+0000 7f1d7effd640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d6c0664a0 0x7f1d6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:01.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.626+0000 7f1d7effd640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d6c0664a0 0x7f1d6c068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d8006ff00 tx=0x7f1d74009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:01.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.626+0000 7f1d67fff640 1 -- 172.21.15.28:0/335442076 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1d70050d60 con 0x7f1d80072090 2023-12-16T03:26:01.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:01.786+0000 7f1d85e32640 1 -- 172.21.15.28:0/335442076 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1d801ea610 con 0x7f1d80072090 2023-12-16T03:26:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.434+0000 7f1d67fff640 1 -- 172.21.15.28:0/335442076 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1d70017020 con 0x7f1d80072090 2023-12-16T03:26:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.434+0000 7f1d85e32640 1 -- 172.21.15.28:0/335442076 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d6c0664a0 msgr2=0x7f1d6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.434+0000 7f1d85e32640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d6c0664a0 0x7f1d6c068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d8006ff00 tx=0x7f1d74009190 comp rx=0 tx=0).stop 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.434+0000 7f1d85e32640 1 -- 172.21.15.28:0/335442076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d80072090 msgr2=0x7f1d80070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.434+0000 7f1d85e32640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d80072090 0x7f1d80070180 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000c3c0 tx=0x7f1d7000c880 comp rx=0 tx=0).stop 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.438+0000 7f1d85e32640 1 -- 172.21.15.28:0/335442076 shutdown_connections 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.438+0000 7f1d85e32640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d800a5370 0x7f1d80144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.438+0000 7f1d85e32640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d800725c0 0x7f1d800a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.438+0000 7f1d85e32640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d6c0664a0 0x7f1d6c068960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.438+0000 7f1d85e32640 1 --2- 172.21.15.28:0/335442076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d80072090 0x7f1d80070180 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.438+0000 7f1d85e32640 1 -- 172.21.15.28:0/335442076 >> 172.21.15.28:0/335442076 conn(0x7f1d8006a5b0 msgr2=0x7f1d800c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.438+0000 7f1d85e32640 1 -- 172.21.15.28:0/335442076 shutdown_connections 2023-12-16T03:26:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.438+0000 7f1d85e32640 1 -- 172.21.15.28:0/335442076 wait complete. 2023-12-16T03:26:02.481 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-16T03:26:02.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.622+0000 7f2dcd409640 1 Processor -- start 2023-12-16T03:26:02.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dcd409640 1 -- start start 2023-12-16T03:26:02.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dcd409640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2dc80c4100 0x7f2dc80c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dcd409640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c06d0 0x7f2dc80a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dcd409640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc80c31c0 con 0x7f2dc80c63c0 2023-12-16T03:26:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dcd409640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc80c34a0 con 0x7f2dc80c4100 2023-12-16T03:26:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dcd409640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc80c1030 con 0x7f2dc80c06d0 2023-12-16T03:26:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dc67fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2dc80c4100 0x7f2dc80c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dc67fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2dc80c4100 0x7f2dc80c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49344/0 (socket says 172.21.15.28:49344) 2023-12-16T03:26:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dc67fc640 1 -- 172.21.15.28:0/4002140169 learned_addr learned my addr 172.21.15.28:0/4002140169 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dc6ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2dc80c63c0 0x7f2dc80c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45072/0 (socket says 172.21.15.28:45072) 2023-12-16T03:26:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dc77fe640 1 --2- 172.21.15.28:0/4002140169 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c06d0 0x7f2dc80a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:02.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dc67fc640 1 -- 172.21.15.28:0/4002140169 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c06d0 msgr2=0x7f2dc80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:02.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dc67fc640 1 --2- 172.21.15.28:0/4002140169 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c06d0 0x7f2dc80a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:02.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dc67fc640 1 -- 172.21.15.28:0/4002140169 >> v1:172.21.15.28:6789/0 conn(0x7f2dc80c63c0 legacy=0x7f2dc80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:02.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dc67fc640 1 -- 172.21.15.28:0/4002140169 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80c1310 con 0x7f2dc80c4100 2023-12-16T03:26:02.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dc77fe640 1 --2- 172.21.15.28:0/4002140169 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c06d0 0x7f2dc80a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:02.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.626+0000 7f2dc5ffb640 1 -- 172.21.15.28:0/4002140169 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098102939 0 0) 0x7f2dc80c31c0 con 0x7f2dc80c63c0 2023-12-16T03:26:02.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dc67fc640 1 --2- 172.21.15.28:0/4002140169 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2dc80c4100 0x7f2dc80c2bb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00bb10 tx=0x7f2dbc01eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5432eefa672d670 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:02.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dc5ffb640 1 -- 172.21.15.28:0/4002140169 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc80aa3d0 con 0x7f2dc80c4100 2023-12-16T03:26:02.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dc5ffb640 1 -- 172.21.15.28:0/4002140169 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc0a7ad0 con 0x7f2dc80c4100 2023-12-16T03:26:02.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dc5ffb640 1 -- 172.21.15.28:0/4002140169 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0a7e60 con 0x7f2dc80c4100 2023-12-16T03:26:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dcd409640 1 -- 172.21.15.28:0/4002140169 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2dc80c4100 msgr2=0x7f2dc80c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dcd409640 1 --2- 172.21.15.28:0/4002140169 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2dc80c4100 0x7f2dc80c2bb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00bb10 tx=0x7f2dbc01eaf0 comp rx=0 tx=0).stop 2023-12-16T03:26:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dcd409640 1 -- 172.21.15.28:0/4002140169 shutdown_connections 2023-12-16T03:26:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dcd409640 1 --2- 172.21.15.28:0/4002140169 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c06d0 0x7f2dc80a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dcd409640 1 --2- 172.21.15.28:0/4002140169 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2dc80c4100 0x7f2dc80c2bb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dcd409640 1 -- 172.21.15.28:0/4002140169 >> 172.21.15.28:0/4002140169 conn(0x7f2dc806a5b0 msgr2=0x7f2dc806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dcd409640 1 -- 172.21.15.28:0/4002140169 shutdown_connections 2023-12-16T03:26:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dcd409640 1 -- 172.21.15.28:0/4002140169 wait complete. 2023-12-16T03:26:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dcd409640 1 Processor -- start 2023-12-16T03:26:02.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.630+0000 7f2dcd409640 1 -- start start 2023-12-16T03:26:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dcd409640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2dc80c06d0 0x7f2dc815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dcd409640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c4100 0x7f2dc81534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dcd409640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc80c63c0 0x7f2dc8153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dcd409640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc80c0560 con 0x7f2dc80c06d0 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dcd409640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc81ec780 con 0x7f2dc80c63c0 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dcd409640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc81ecfe0 con 0x7f2dc80c4100 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dc6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2dc80c06d0 0x7f2dc815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dc6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2dc80c06d0 0x7f2dc815a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49350/0 (socket says 172.21.15.28:49350) 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dc6ffd640 1 -- 172.21.15.28:0/1288734502 learned_addr learned my addr 172.21.15.28:0/1288734502 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dc67fc640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c4100 0x7f2dc81534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dc77fe640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc80c63c0 0x7f2dc8153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dc6ffd640 1 -- 172.21.15.28:0/1288734502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c4100 msgr2=0x7f2dc81534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dc6ffd640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c4100 0x7f2dc81534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dc6ffd640 1 -- 172.21.15.28:0/1288734502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc80c63c0 msgr2=0x7f2dc8153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dc6ffd640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc80c63c0 0x7f2dc8153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dc6ffd640 1 -- 172.21.15.28:0/1288734502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc00b770 con 0x7f2dc80c06d0 2023-12-16T03:26:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dc6ffd640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2dc80c06d0 0x7f2dc815a420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c480 tx=0x7f2db800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2daf7fe640 1 -- 172.21.15.28:0/1288734502 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db80074e0 con 0x7f2dc80c06d0 2023-12-16T03:26:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2daf7fe640 1 -- 172.21.15.28:0/1288734502 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db8007660 con 0x7f2dc80c06d0 2023-12-16T03:26:02.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dcd409640 1 -- 172.21.15.28:0/1288734502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc80c0280 con 0x7f2dc80c06d0 2023-12-16T03:26:02.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2daf7fe640 1 -- 172.21.15.28:0/1288734502 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8004a30 con 0x7f2dc80c06d0 2023-12-16T03:26:02.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dcd409640 1 -- 172.21.15.28:0/1288734502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc81ecc70 con 0x7f2dc80c06d0 2023-12-16T03:26:02.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.634+0000 7f2dcd409640 1 -- 172.21.15.28:0/1288734502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc8068400 con 0x7f2dc80c06d0 2023-12-16T03:26:02.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.638+0000 7f2daf7fe640 1 -- 172.21.15.28:0/1288734502 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2db8004b90 con 0x7f2dc80c06d0 2023-12-16T03:26:02.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.638+0000 7f2daf7fe640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2db4066470 0x7f2db4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:02.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.638+0000 7f2daf7fe640 1 -- 172.21.15.28:0/1288734502 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2db8083260 con 0x7f2dc80c06d0 2023-12-16T03:26:02.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.638+0000 7f2dc67fc640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2db4066470 0x7f2db4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.638+0000 7f2dc67fc640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2db4066470 0x7f2db4068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0b1000 tx=0x7f2dbc0a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:02.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.642+0000 7f2daf7fe640 1 -- 172.21.15.28:0/1288734502 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2db8050880 con 0x7f2dc80c06d0 2023-12-16T03:26:02.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:02.830+0000 7f2dcd409640 1 -- 172.21.15.28:0/1288734502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2dc80c3e70 con 0x7f2dc80c06d0 2023-12-16T03:26:03.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.434+0000 7f2daf7fe640 1 -- 172.21.15.28:0/1288734502 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2db8053ea0 con 0x7f2dc80c06d0 2023-12-16T03:26:03.441 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 4 and data pool 5 2023-12-16T03:26:03.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.438+0000 7f2dcd409640 1 -- 172.21.15.28:0/1288734502 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2db4066470 msgr2=0x7f2db4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:03.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.438+0000 7f2dcd409640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2db4066470 0x7f2db4068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0b1000 tx=0x7f2dbc0a9070 comp rx=0 tx=0).stop 2023-12-16T03:26:03.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.438+0000 7f2dcd409640 1 -- 172.21.15.28:0/1288734502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2dc80c06d0 msgr2=0x7f2dc815a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:03.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.438+0000 7f2dcd409640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2dc80c06d0 0x7f2dc815a420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c480 tx=0x7f2db800c940 comp rx=0 tx=0).stop 2023-12-16T03:26:03.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.438+0000 7f2dcd409640 1 -- 172.21.15.28:0/1288734502 shutdown_connections 2023-12-16T03:26:03.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.438+0000 7f2dcd409640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc80c63c0 0x7f2dc8153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.438+0000 7f2dcd409640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2dc80c4100 0x7f2dc81534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.438+0000 7f2dcd409640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2db4066470 0x7f2db4068930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.438+0000 7f2dcd409640 1 --2- 172.21.15.28:0/1288734502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2dc80c06d0 0x7f2dc815a420 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.438+0000 7f2dcd409640 1 -- 172.21.15.28:0/1288734502 >> 172.21.15.28:0/1288734502 conn(0x7f2dc806a5b0 msgr2=0x7f2dc80a6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:03.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.438+0000 7f2dcd409640 1 -- 172.21.15.28:0/1288734502 shutdown_connections 2023-12-16T03:26:03.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.442+0000 7f2dcd409640 1 -- 172.21.15.28:0/1288734502 wait complete. 2023-12-16T03:26:03.501 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:03.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.638+0000 7f2ab4996640 1 Processor -- start 2023-12-16T03:26:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.638+0000 7f2ab4996640 1 -- start start 2023-12-16T03:26:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2ab4996640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ab00c63c0 0x7f2ab00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:03.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2ab4996640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00c4100 0x7f2ab00c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2ab4996640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab00c31c0 con 0x7f2ab00c29e0 2023-12-16T03:26:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2ab4996640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab00c34a0 con 0x7f2ab00c63c0 2023-12-16T03:26:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2ab4996640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab00c1030 con 0x7f2ab00c4100 2023-12-16T03:26:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2aae59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2ab00c63c0 0x7f2ab00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2aa7fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00c4100 0x7f2ab00c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2aaed9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f2ab00c29e0 0x7f2ab00a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:40784/0 (socket says 172.21.15.28:40784) 2023-12-16T03:26:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2aaed9d640 1 -- 172.21.15.28:0/2128868652 learned_addr learned my addr 172.21.15.28:0/2128868652 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2aae59c640 1 -- 172.21.15.28:0/2128868652 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00c4100 msgr2=0x7f2ab00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2aae59c640 1 --2- 172.21.15.28:0/2128868652 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00c4100 0x7f2ab00c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2aae59c640 1 -- 172.21.15.28:0/2128868652 >> v1:172.21.15.134:6789/0 conn(0x7f2ab00c29e0 legacy=0x7f2ab00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2aae59c640 1 -- 172.21.15.28:0/2128868652 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab00c1310 con 0x7f2ab00c63c0 2023-12-16T03:26:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2aa7fff640 1 --2- 172.21.15.28:0/2128868652 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00c4100 0x7f2ab00c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:03.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.642+0000 7f2aadd9b640 1 -- 172.21.15.28:0/2128868652 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208731059 0 0) 0x7f2ab00c31c0 con 0x7f2ab00c29e0 2023-12-16T03:26:03.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2aae59c640 1 --2- 172.21.15.28:0/2128868652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00c63c0 0x7f2ab00c06d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00097c0 tx=0x7f2aa001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72de240b60aa0be5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2aadd9b640 1 -- 172.21.15.28:0/2128868652 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0004230 con 0x7f2ab00c63c0 2023-12-16T03:26:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2aadd9b640 1 -- 172.21.15.28:0/2128868652 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa00a7050 con 0x7f2ab00c63c0 2023-12-16T03:26:03.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2aadd9b640 1 -- 172.21.15.28:0/2128868652 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0003620 con 0x7f2ab00c63c0 2023-12-16T03:26:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2ab4996640 1 -- 172.21.15.28:0/2128868652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00c63c0 msgr2=0x7f2ab00c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2ab4996640 1 --2- 172.21.15.28:0/2128868652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00c63c0 0x7f2ab00c06d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00097c0 tx=0x7f2aa001c330 comp rx=0 tx=0).stop 2023-12-16T03:26:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2ab4996640 1 -- 172.21.15.28:0/2128868652 shutdown_connections 2023-12-16T03:26:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2ab4996640 1 --2- 172.21.15.28:0/2128868652 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00c4100 0x7f2ab00c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2ab4996640 1 --2- 172.21.15.28:0/2128868652 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00c63c0 0x7f2ab00c06d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2ab4996640 1 -- 172.21.15.28:0/2128868652 >> 172.21.15.28:0/2128868652 conn(0x7f2ab006a5b0 msgr2=0x7f2ab006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2ab4996640 1 -- 172.21.15.28:0/2128868652 shutdown_connections 2023-12-16T03:26:03.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2ab4996640 1 -- 172.21.15.28:0/2128868652 wait complete. 2023-12-16T03:26:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2ab4996640 1 Processor -- start 2023-12-16T03:26:03.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.646+0000 7f2ab4996640 1 -- start start 2023-12-16T03:26:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2ab4996640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00c29e0 0x7f2ab01f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2ab4996640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00c4100 0x7f2ab00c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2ab4996640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab00c63c0 0x7f2ab00bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2ab4996640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab01f08c0 con 0x7f2ab00c63c0 2023-12-16T03:26:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2ab4996640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab01f02b0 con 0x7f2ab00c4100 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2ab4996640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab00c4ed0 con 0x7f2ab00c29e0 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aaed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab00c63c0 0x7f2ab00bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aaed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab00c63c0 0x7f2ab00bfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49364/0 (socket says 172.21.15.28:49364) 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aaed9d640 1 -- 172.21.15.28:0/2992964125 learned_addr learned my addr 172.21.15.28:0/2992964125 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aae59c640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00c29e0 0x7f2ab01f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aa7fff640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00c4100 0x7f2ab00c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aaed9d640 1 -- 172.21.15.28:0/2992964125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00c29e0 msgr2=0x7f2ab01f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aaed9d640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00c29e0 0x7f2ab01f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aaed9d640 1 -- 172.21.15.28:0/2992964125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00c4100 msgr2=0x7f2ab00c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aaed9d640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00c4100 0x7f2ab00c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aaed9d640 1 -- 172.21.15.28:0/2992964125 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a98009420 con 0x7f2ab00c63c0 2023-12-16T03:26:03.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aaed9d640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab00c63c0 0x7f2ab00bfaa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8001570 tx=0x7f2aa800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aa6ffd640 1 -- 172.21.15.28:0/2992964125 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa800a640 con 0x7f2ab00c63c0 2023-12-16T03:26:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aa6ffd640 1 -- 172.21.15.28:0/2992964125 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa800a7c0 con 0x7f2ab00c63c0 2023-12-16T03:26:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aa6ffd640 1 -- 172.21.15.28:0/2992964125 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa800ab70 con 0x7f2ab00c63c0 2023-12-16T03:26:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2ab4996640 1 -- 172.21.15.28:0/2992964125 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa0009420 con 0x7f2ab00c63c0 2023-12-16T03:26:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2ab4996640 1 -- 172.21.15.28:0/2992964125 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab01f0550 con 0x7f2ab00c63c0 2023-12-16T03:26:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2ab4996640 1 -- 172.21.15.28:0/2992964125 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab01f0a30 con 0x7f2ab00c63c0 2023-12-16T03:26:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.650+0000 7f2aa6ffd640 1 -- 172.21.15.28:0/2992964125 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2aa800acd0 con 0x7f2ab00c63c0 2023-12-16T03:26:03.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.654+0000 7f2aa6ffd640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a90066470 0x7f2a90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:03.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.654+0000 7f2aa6ffd640 1 -- 172.21.15.28:0/2992964125 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2aa80833d0 con 0x7f2ab00c63c0 2023-12-16T03:26:03.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.654+0000 7f2aae59c640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a90066470 0x7f2a90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:03.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.654+0000 7f2aae59c640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a90066470 0x7f2a90068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00ad000 tx=0x7f2aa0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:03.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.658+0000 7f2aa6ffd640 1 -- 172.21.15.28:0/2992964125 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2aa80508f0 con 0x7f2ab00c63c0 2023-12-16T03:26:03.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.818+0000 7f2ab4996640 1 -- 172.21.15.28:0/2992964125 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ab0068400 con 0x7f2ab00c63c0 2023-12-16T03:26:03.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.818+0000 7f2aa6ffd640 1 -- 172.21.15.28:0/2992964125 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f2aa8018090 con 0x7f2ab00c63c0 2023-12-16T03:26:03.825 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:03.825 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":31,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:02.836300+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:03.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 -- 172.21.15.28:0/2992964125 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a90066470 msgr2=0x7f2a90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:03.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a90066470 0x7f2a90068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00ad000 tx=0x7f2aa0008040 comp rx=0 tx=0).stop 2023-12-16T03:26:03.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 -- 172.21.15.28:0/2992964125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab00c63c0 msgr2=0x7f2ab00bfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:03.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab00c63c0 0x7f2ab00bfaa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8001570 tx=0x7f2aa800cca0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 -- 172.21.15.28:0/2992964125 shutdown_connections 2023-12-16T03:26:03.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2a90066470 0x7f2a90068930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab00c63c0 0x7f2ab00bfaa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00c4100 0x7f2ab00c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 --2- 172.21.15.28:0/2992964125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00c29e0 0x7f2ab01f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 -- 172.21.15.28:0/2992964125 >> 172.21.15.28:0/2992964125 conn(0x7f2ab006a5b0 msgr2=0x7f2ab0070040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:03.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 -- 172.21.15.28:0/2992964125 shutdown_connections 2023-12-16T03:26:03.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.822+0000 7f2ab4996640 1 -- 172.21.15.28:0/2992964125 wait complete. 2023-12-16T03:26:03.847 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:03.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c473e640 1 Processor -- start 2023-12-16T03:26:03.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c473e640 1 -- start start 2023-12-16T03:26:03.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c473e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb5bc0c7ea0 0x7fb5bc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:03.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c473e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5bc06c860 con 0x7fb5bc06b9e0 2023-12-16T03:26:03.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c473e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5bc154930 con 0x7fb5bc151e90 2023-12-16T03:26:03.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c473e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5bc0c8750 con 0x7fb5bc0c7ea0 2023-12-16T03:26:03.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c1cd9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb5bc0c7ea0 0x7fb5bc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:03.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c1cd9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb5bc0c7ea0 0x7fb5bc06b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49370/0 (socket says 172.21.15.28:49370) 2023-12-16T03:26:03.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c2cdb640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb5bc06b9e0 0x7fb5bc15f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45084/0 (socket says 172.21.15.28:45084) 2023-12-16T03:26:03.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c1cd9640 1 -- 172.21.15.28:0/682183703 learned_addr learned my addr 172.21.15.28:0/682183703 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:03.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c1cd9640 1 -- 172.21.15.28:0/682183703 >> v1:172.21.15.134:6789/0 conn(0x7fb5bc151e90 legacy=0x7fb5bc0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:03.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c1cd9640 1 -- 172.21.15.28:0/682183703 >> v1:172.21.15.28:6789/0 conn(0x7fb5bc06b9e0 legacy=0x7fb5bc15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:03.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.986+0000 7fb5c1cd9640 1 -- 172.21.15.28:0/682183703 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc154c10 con 0x7fb5bc0c7ea0 2023-12-16T03:26:03.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.990+0000 7fb5c1cd9640 1 --2- 172.21.15.28:0/682183703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5bc0c7ea0 0x7fb5bc06b4a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac009870 tx=0x7fb5ac01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3742df83b1b5e424 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:03.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.990+0000 7fb5c14d8640 1 -- 172.21.15.28:0/682183703 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0ab600 con 0x7fb5bc0c7ea0 2023-12-16T03:26:03.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.990+0000 7fb5c14d8640 1 -- 172.21.15.28:0/682183703 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac0a7050 con 0x7fb5bc0c7ea0 2023-12-16T03:26:03.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.990+0000 7fb5c14d8640 1 -- 172.21.15.28:0/682183703 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0ab980 con 0x7fb5bc0c7ea0 2023-12-16T03:26:03.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.990+0000 7fb5c473e640 1 -- 172.21.15.28:0/682183703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5bc0c7ea0 msgr2=0x7fb5bc06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:03.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.990+0000 7fb5c473e640 1 --2- 172.21.15.28:0/682183703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5bc0c7ea0 0x7fb5bc06b4a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac009870 tx=0x7fb5ac01c420 comp rx=0 tx=0).stop 2023-12-16T03:26:03.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.990+0000 7fb5c473e640 1 -- 172.21.15.28:0/682183703 shutdown_connections 2023-12-16T03:26:03.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.990+0000 7fb5c473e640 1 --2- 172.21.15.28:0/682183703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5bc0c7ea0 0x7fb5bc06b4a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:03.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.990+0000 7fb5c473e640 1 -- 172.21.15.28:0/682183703 >> 172.21.15.28:0/682183703 conn(0x7fb5bc0ca170 msgr2=0x7fb5bc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:03.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.990+0000 7fb5c473e640 1 -- 172.21.15.28:0/682183703 shutdown_connections 2023-12-16T03:26:03.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.990+0000 7fb5c473e640 1 -- 172.21.15.28:0/682183703 wait complete. 2023-12-16T03:26:03.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c473e640 1 Processor -- start 2023-12-16T03:26:03.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c473e640 1 -- start start 2023-12-16T03:26:04.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c473e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5bc06b9e0 0x7fb5bc153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:04.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c473e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5bc0c7ea0 0x7fb5bc148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:04.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c473e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5bc151e90 0x7fb5bc148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:04.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c473e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc1552d0 con 0x7fb5bc151e90 2023-12-16T03:26:04.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c473e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0ac170 con 0x7fb5bc06b9e0 2023-12-16T03:26:04.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c473e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc153cc0 con 0x7fb5bc0c7ea0 2023-12-16T03:26:04.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c2cdb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5bc151e90 0x7fb5bc148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c2cdb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5bc151e90 0x7fb5bc148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49372/0 (socket says 172.21.15.28:49372) 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c2cdb640 1 -- 172.21.15.28:0/2556160977 learned_addr learned my addr 172.21.15.28:0/2556160977 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c24da640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5bc06b9e0 0x7fb5bc153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c1cd9640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5bc0c7ea0 0x7fb5bc148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c2cdb640 1 -- 172.21.15.28:0/2556160977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5bc0c7ea0 msgr2=0x7fb5bc148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c2cdb640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5bc0c7ea0 0x7fb5bc148000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c2cdb640 1 -- 172.21.15.28:0/2556160977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5bc06b9e0 msgr2=0x7fb5bc153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c2cdb640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5bc06b9e0 0x7fb5bc153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c2cdb640 1 -- 172.21.15.28:0/2556160977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0094d0 con 0x7fb5bc151e90 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c1cd9640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5bc0c7ea0 0x7fb5bc148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c24da640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5bc06b9e0 0x7fb5bc153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c2cdb640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5bc151e90 0x7fb5bc148540 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c730 tx=0x7fb5b400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:04.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5b2ffd640 1 -- 172.21.15.28:0/2556160977 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400ce40 con 0x7fb5bc151e90 2023-12-16T03:26:04.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5b2ffd640 1 -- 172.21.15.28:0/2556160977 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b400a640 con 0x7fb5bc151e90 2023-12-16T03:26:04.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5b2ffd640 1 -- 172.21.15.28:0/2556160977 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400a9b0 con 0x7fb5bc151e90 2023-12-16T03:26:04.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c473e640 1 -- 172.21.15.28:0/2556160977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc148a80 con 0x7fb5bc151e90 2023-12-16T03:26:04.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.994+0000 7fb5c473e640 1 -- 172.21.15.28:0/2556160977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc1ee8b0 con 0x7fb5bc151e90 2023-12-16T03:26:04.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.998+0000 7fb5c473e640 1 -- 172.21.15.28:0/2556160977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc068400 con 0x7fb5bc151e90 2023-12-16T03:26:04.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.998+0000 7fb5b2ffd640 1 -- 172.21.15.28:0/2556160977 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb5b400ab10 con 0x7fb5bc151e90 2023-12-16T03:26:04.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.998+0000 7fb5b2ffd640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb5a00664a0 0x7fb5a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:04.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.998+0000 7fb5b2ffd640 1 -- 172.21.15.28:0/2556160977 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5b4083680 con 0x7fb5bc151e90 2023-12-16T03:26:04.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.998+0000 7fb5c24da640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb5a00664a0 0x7fb5a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:03.998+0000 7fb5c24da640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb5a00664a0 0x7fb5a0068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8000f70 tx=0x7fb5b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:04.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.002+0000 7fb5b2ffd640 1 -- 172.21.15.28:0/2556160977 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb5b4050a80 con 0x7fb5bc151e90 2023-12-16T03:26:04.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.162+0000 7fb5c473e640 1 -- 172.21.15.28:0/2556160977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5bc06b4a0 con 0x7fb5bc151e90 2023-12-16T03:26:04.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.162+0000 7fb5b2ffd640 1 -- 172.21.15.28:0/2556160977 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16582 (secure 0 0 0) 0x7fb5b4017090 con 0x7fb5bc151e90 2023-12-16T03:26:04.167 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:04.167 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":31,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:02.836300+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:04.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.162+0000 7fb5c473e640 1 -- 172.21.15.28:0/2556160977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb5a00664a0 msgr2=0x7fb5a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:04.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.162+0000 7fb5c473e640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb5a00664a0 0x7fb5a0068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8000f70 tx=0x7fb5b8009040 comp rx=0 tx=0).stop 2023-12-16T03:26:04.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.162+0000 7fb5c473e640 1 -- 172.21.15.28:0/2556160977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5bc151e90 msgr2=0x7fb5bc148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:04.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.162+0000 7fb5c473e640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5bc151e90 0x7fb5bc148540 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c730 tx=0x7fb5b400cbf0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.162+0000 7fb5c473e640 1 -- 172.21.15.28:0/2556160977 shutdown_connections 2023-12-16T03:26:04.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.162+0000 7fb5c473e640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb5a00664a0 0x7fb5a0068960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.166+0000 7fb5c473e640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5bc151e90 0x7fb5bc148540 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.166+0000 7fb5c473e640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb5bc0c7ea0 0x7fb5bc148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.166+0000 7fb5c473e640 1 --2- 172.21.15.28:0/2556160977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5bc06b9e0 0x7fb5bc153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.166+0000 7fb5c473e640 1 -- 172.21.15.28:0/2556160977 >> 172.21.15.28:0/2556160977 conn(0x7fb5bc0ca170 msgr2=0x7fb5bc0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:04.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.166+0000 7fb5c473e640 1 -- 172.21.15.28:0/2556160977 shutdown_connections 2023-12-16T03:26:04.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.166+0000 7fb5c473e640 1 -- 172.21.15.28:0/2556160977 wait complete. 2023-12-16T03:26:04.189 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-16T03:26:04.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f200306b640 1 Processor -- start 2023-12-16T03:26:04.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f200306b640 1 -- start start 2023-12-16T03:26:04.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f200306b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ffc0c63c0 0x7f1ffc0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:04.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f200306b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1ffc0c2bb0 0x7f1ffc0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:04.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f200306b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc0c31c0 con 0x7f1ffc0c4100 2023-12-16T03:26:04.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f200306b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc0c34a0 con 0x7f1ffc0c2bb0 2023-12-16T03:26:04.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f200306b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0c1030 con 0x7f1ffc0c63c0 2023-12-16T03:26:04.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f2001608640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1ffc0c2bb0 0x7f1ffc0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:04.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f1ffbfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1ffc0c4100 0x7f1ffc0c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:40812/0 (socket says 172.21.15.28:40812) 2023-12-16T03:26:04.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f1ffbfff640 1 -- 172.21.15.28:0/164373269 learned_addr learned my addr 172.21.15.28:0/164373269 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:04.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f2000e07640 1 --2- 172.21.15.28:0/164373269 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ffc0c63c0 0x7f1ffc0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:04.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f2001608640 1 -- 172.21.15.28:0/164373269 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ffc0c63c0 msgr2=0x7f1ffc0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:04.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f2001608640 1 --2- 172.21.15.28:0/164373269 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ffc0c63c0 0x7f1ffc0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f2001608640 1 -- 172.21.15.28:0/164373269 >> v1:172.21.15.134:6789/0 conn(0x7f1ffc0c4100 legacy=0x7f1ffc0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:04.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.330+0000 7f2001608640 1 -- 172.21.15.28:0/164373269 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0c1310 con 0x7f1ffc0c2bb0 2023-12-16T03:26:04.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f2001608640 1 --2- 172.21.15.28:0/164373269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ffc0c2bb0 0x7f1ffc0a9680 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009d90 tx=0x7f1ff401c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f491d735536fc68 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:04.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f1ffb7fe640 1 -- 172.21.15.28:0/164373269 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc0aa3d0 con 0x7f1ffc0c2bb0 2023-12-16T03:26:04.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f1ffb7fe640 1 -- 172.21.15.28:0/164373269 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff40a58e0 con 0x7f1ffc0c2bb0 2023-12-16T03:26:04.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f1ffb7fe640 1 -- 172.21.15.28:0/164373269 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff40a5c70 con 0x7f1ffc0c2bb0 2023-12-16T03:26:04.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f200306b640 1 -- 172.21.15.28:0/164373269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ffc0c2bb0 msgr2=0x7f1ffc0a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:04.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f200306b640 1 --2- 172.21.15.28:0/164373269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ffc0c2bb0 0x7f1ffc0a9680 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009d90 tx=0x7f1ff401c800 comp rx=0 tx=0).stop 2023-12-16T03:26:04.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f200306b640 1 -- 172.21.15.28:0/164373269 shutdown_connections 2023-12-16T03:26:04.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f200306b640 1 --2- 172.21.15.28:0/164373269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ffc0c2bb0 0x7f1ffc0a9680 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f200306b640 1 --2- 172.21.15.28:0/164373269 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ffc0c63c0 0x7f1ffc0c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f200306b640 1 -- 172.21.15.28:0/164373269 >> 172.21.15.28:0/164373269 conn(0x7f1ffc06a5b0 msgr2=0x7f1ffc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:04.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f200306b640 1 -- 172.21.15.28:0/164373269 shutdown_connections 2023-12-16T03:26:04.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.334+0000 7f200306b640 1 -- 172.21.15.28:0/164373269 wait complete. 2023-12-16T03:26:04.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f200306b640 1 Processor -- start 2023-12-16T03:26:04.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f200306b640 1 -- start start 2023-12-16T03:26:04.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f200306b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ffc0c2bb0 0x7f1ffc1f0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:04.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f200306b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ffc0c4100 0x7f1ffc15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:04.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f200306b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ffc0c63c0 0x7f1ffc1ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:04.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f200306b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc09a4e0 con 0x7f1ffc0c4100 2023-12-16T03:26:04.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f200306b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc1f0dc0 con 0x7f1ffc0c2bb0 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f200306b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc158090 con 0x7f1ffc0c63c0 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ffbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ffc0c4100 0x7f1ffc15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ffbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ffc0c4100 0x7f1ffc15b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49390/0 (socket says 172.21.15.28:49390) 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ffbfff640 1 -- 172.21.15.28:0/2324754067 learned_addr learned my addr 172.21.15.28:0/2324754067 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f2001608640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ffc0c63c0 0x7f1ffc1ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f2000e07640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ffc0c2bb0 0x7f1ffc1f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ffbfff640 1 -- 172.21.15.28:0/2324754067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ffc0c63c0 msgr2=0x7f1ffc1ecfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ffbfff640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ffc0c63c0 0x7f1ffc1ecfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ffbfff640 1 -- 172.21.15.28:0/2324754067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ffc0c2bb0 msgr2=0x7f1ffc1f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ffbfff640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ffc0c2bb0 0x7f1ffc1f0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ffbfff640 1 -- 172.21.15.28:0/2324754067 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff4009a70 con 0x7f1ffc0c4100 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ffbfff640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ffc0c4100 0x7f1ffc15b520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c500 tx=0x7f1fe800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ff97fa640 1 -- 172.21.15.28:0/2324754067 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8005cf0 con 0x7f1ffc0c4100 2023-12-16T03:26:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ff97fa640 1 -- 172.21.15.28:0/2324754067 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8005e50 con 0x7f1ffc0c4100 2023-12-16T03:26:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f1ff97fa640 1 -- 172.21.15.28:0/2324754067 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80072f0 con 0x7f1ffc0c4100 2023-12-16T03:26:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f200306b640 1 -- 172.21.15.28:0/2324754067 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc1ecb30 con 0x7f1ffc0c4100 2023-12-16T03:26:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.338+0000 7f200306b640 1 -- 172.21.15.28:0/2324754067 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc158bd0 con 0x7f1ffc0c4100 2023-12-16T03:26:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.342+0000 7f200306b640 1 -- 172.21.15.28:0/2324754067 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc1ec900 con 0x7f1ffc0c4100 2023-12-16T03:26:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.342+0000 7f1ff97fa640 1 -- 172.21.15.28:0/2324754067 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1fe8007450 con 0x7f1ffc0c4100 2023-12-16T03:26:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.342+0000 7f1ff97fa640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1fe0066470 0x7f1fe0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.342+0000 7f1ff97fa640 1 -- 172.21.15.28:0/2324754067 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fe8083330 con 0x7f1ffc0c4100 2023-12-16T03:26:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.342+0000 7f2000e07640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1fe0066470 0x7f1fe0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.342+0000 7f2000e07640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1fe0066470 0x7f1fe0068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009ac0 tx=0x7f1ff0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.346+0000 7f1ff97fa640 1 -- 172.21.15.28:0/2324754067 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1ffc1ec900 con 0x7f1ffc0c4100 2023-12-16T03:26:04.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:04.538+0000 7f200306b640 1 -- 172.21.15.28:0/2324754067 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1ffc1ec900 con 0x7f1ffc0c4100 2023-12-16T03:26:05.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.466+0000 7f1ff97fa640 1 -- 172.21.15.28:0/2324754067 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1fe8050850 con 0x7f1ffc0c4100 2023-12-16T03:26:05.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 -- 172.21.15.28:0/2324754067 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1fe0066470 msgr2=0x7f1fe0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:05.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1fe0066470 0x7f1fe0068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009ac0 tx=0x7f1ff0009190 comp rx=0 tx=0).stop 2023-12-16T03:26:05.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 -- 172.21.15.28:0/2324754067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ffc0c4100 msgr2=0x7f1ffc15b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:05.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ffc0c4100 0x7f1ffc15b520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c500 tx=0x7f1fe800c9c0 comp rx=0 tx=0).stop 2023-12-16T03:26:05.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 -- 172.21.15.28:0/2324754067 shutdown_connections 2023-12-16T03:26:05.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ffc0c63c0 0x7f1ffc1ecfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:05.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1fe0066470 0x7f1fe0068930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:05.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ffc0c4100 0x7f1ffc15b520 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:05.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 --2- 172.21.15.28:0/2324754067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ffc0c2bb0 0x7f1ffc1f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:05.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 -- 172.21.15.28:0/2324754067 >> 172.21.15.28:0/2324754067 conn(0x7f1ffc06a5b0 msgr2=0x7f1ffc071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:05.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 -- 172.21.15.28:0/2324754067 shutdown_connections 2023-12-16T03:26:05.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.470+0000 7f200306b640 1 -- 172.21.15.28:0/2324754067 wait complete. 2023-12-16T03:26:05.499 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-16T03:26:05.499 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-16T03:26:05.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb3292fe640 1 Processor -- start 2023-12-16T03:26:05.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb3292fe640 1 -- start start 2023-12-16T03:26:05.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb3292fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240a5370 0x7fb3240c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:05.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb3292fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb3240c4110 0x7fb324150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:05.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb3292fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3240c2760 con 0x7fb324072090 2023-12-16T03:26:05.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb3292fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3240c3070 con 0x7fb3240c4110 2023-12-16T03:26:05.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb3292fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb324151bf0 con 0x7fb3240a5370 2023-12-16T03:26:05.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb322ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240a5370 0x7fb3240c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:05.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb3227fc640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb3240c4110 0x7fb324150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:05.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb322ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240a5370 0x7fb3240c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:34986/0 (socket says 172.21.15.28:34986) 2023-12-16T03:26:05.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb322ffd640 1 -- 172.21.15.28:0/1113067162 learned_addr learned my addr 172.21.15.28:0/1113067162 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:05.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb322ffd640 1 -- 172.21.15.28:0/1113067162 >> v2:172.21.15.134:3300/0 conn(0x7fb3240c4110 msgr2=0x7fb324150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:05.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb322ffd640 1 --2- 172.21.15.28:0/1113067162 >> v2:172.21.15.134:3300/0 conn(0x7fb3240c4110 0x7fb324150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:05.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb322ffd640 1 -- 172.21.15.28:0/1113067162 >> v1:172.21.15.134:6789/0 conn(0x7fb324072090 legacy=0x7fb3241514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:05.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb322ffd640 1 -- 172.21.15.28:0/1113067162 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3240a5750 con 0x7fb3240a5370 2023-12-16T03:26:05.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb3227fc640 1 --2- 172.21.15.28:0/1113067162 >> v2:172.21.15.134:3300/0 conn(0x7fb3240c4110 0x7fb324150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:05.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.646+0000 7fb321ffb640 1 -- 172.21.15.28:0/1113067162 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847176825 0 0) 0x7fb3240c2760 con 0x7fb324072090 2023-12-16T03:26:05.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb322ffd640 1 --2- 172.21.15.28:0/1113067162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240a5370 0x7fb3240c3bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb314009870 tx=0x7fb31401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91df7e6088484a91 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:05.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb321ffb640 1 -- 172.21.15.28:0/1113067162 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3140ab600 con 0x7fb3240a5370 2023-12-16T03:26:05.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb321ffb640 1 -- 172.21.15.28:0/1113067162 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3140a7050 con 0x7fb3240a5370 2023-12-16T03:26:05.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb321ffb640 1 -- 172.21.15.28:0/1113067162 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3140ab980 con 0x7fb3240a5370 2023-12-16T03:26:05.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb3292fe640 1 -- 172.21.15.28:0/1113067162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240a5370 msgr2=0x7fb3240c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:05.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb3292fe640 1 --2- 172.21.15.28:0/1113067162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240a5370 0x7fb3240c3bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb314009870 tx=0x7fb31401c3f0 comp rx=0 tx=0).stop 2023-12-16T03:26:05.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb3292fe640 1 -- 172.21.15.28:0/1113067162 shutdown_connections 2023-12-16T03:26:05.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb3292fe640 1 --2- 172.21.15.28:0/1113067162 >> v2:172.21.15.134:3300/0 conn(0x7fb3240c4110 0x7fb324150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:05.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb3292fe640 1 --2- 172.21.15.28:0/1113067162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240a5370 0x7fb3240c3bd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:05.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb3292fe640 1 -- 172.21.15.28:0/1113067162 >> 172.21.15.28:0/1113067162 conn(0x7fb32406a5b0 msgr2=0x7fb32406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:05.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb3292fe640 1 -- 172.21.15.28:0/1113067162 shutdown_connections 2023-12-16T03:26:05.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.650+0000 7fb3292fe640 1 -- 172.21.15.28:0/1113067162 wait complete. 2023-12-16T03:26:05.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3292fe640 1 Processor -- start 2023-12-16T03:26:05.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3292fe640 1 -- start start 2023-12-16T03:26:05.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3292fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb324072090 0x7fb3240a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:05.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3292fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3240a5370 0x7fb324070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:05.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3292fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3240c4110 0x7fb3240711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:05.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3292fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb324152450 con 0x7fb3240c4110 2023-12-16T03:26:05.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3292fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb324149620 con 0x7fb3240a5370 2023-12-16T03:26:05.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3292fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb324149340 con 0x7fb324072090 2023-12-16T03:26:05.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3240c4110 0x7fb3240711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:05.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3227fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3240a5370 0x7fb324070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:05.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3240c4110 0x7fb3240711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49394/0 (socket says 172.21.15.28:49394) 2023-12-16T03:26:05.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb322ffd640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb324072090 0x7fb3240a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:05.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3237fe640 1 -- 172.21.15.28:0/549890464 learned_addr learned my addr 172.21.15.28:0/549890464 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:05.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3237fe640 1 -- 172.21.15.28:0/549890464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb324072090 msgr2=0x7fb3240a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:05.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3237fe640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb324072090 0x7fb3240a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:05.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3237fe640 1 -- 172.21.15.28:0/549890464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3240a5370 msgr2=0x7fb324070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:05.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3237fe640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3240a5370 0x7fb324070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:05.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3237fe640 1 -- 172.21.15.28:0/549890464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318009420 con 0x7fb3240c4110 2023-12-16T03:26:05.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3237fe640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3240c4110 0x7fb3240711f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb31c001570 tx=0x7fb31c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:05.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb30b7fe640 1 -- 172.21.15.28:0/549890464 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c003db0 con 0x7fb3240c4110 2023-12-16T03:26:05.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb30b7fe640 1 -- 172.21.15.28:0/549890464 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c005070 con 0x7fb3240c4110 2023-12-16T03:26:05.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3292fe640 1 -- 172.21.15.28:0/549890464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3140094d0 con 0x7fb3240c4110 2023-12-16T03:26:05.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb30b7fe640 1 -- 172.21.15.28:0/549890464 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c005420 con 0x7fb3240c4110 2023-12-16T03:26:05.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.654+0000 7fb3292fe640 1 -- 172.21.15.28:0/549890464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3240701d0 con 0x7fb3240c4110 2023-12-16T03:26:05.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.658+0000 7fb3292fe640 1 -- 172.21.15.28:0/549890464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb324068400 con 0x7fb3240c4110 2023-12-16T03:26:05.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.658+0000 7fb30b7fe640 1 -- 172.21.15.28:0/549890464 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb31c005580 con 0x7fb3240c4110 2023-12-16T03:26:05.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.658+0000 7fb30b7fe640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 0x7fb310068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:05.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.658+0000 7fb30b7fe640 1 -- 172.21.15.28:0/549890464 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb31c0836b0 con 0x7fb3240c4110 2023-12-16T03:26:05.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.658+0000 7fb322ffd640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 0x7fb310068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:05.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.658+0000 7fb322ffd640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 0x7fb310068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb314009870 tx=0x7fb3140a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:05.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.662+0000 7fb30b7fe640 1 -- 172.21.15.28:0/549890464 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb31c050be0 con 0x7fb3240c4110 2023-12-16T03:26:05.841 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:26:05.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:26:05.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:05.854+0000 7fb3292fe640 1 -- 172.21.15.28:0/549890464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb3240c6780 con 0x7fb3240c4110 2023-12-16T03:26:06.003 INFO:tasks.ceph.mds.a.smithi028.stderr:2023-12-16T03:26:05.998+0000 7ff6985ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:26:06.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.474+0000 7fb30b7fe640 1 -- 172.21.15.28:0/549890464 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb31c0170c0 con 0x7fb3240c4110 2023-12-16T03:26:06.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 -- 172.21.15.28:0/549890464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 msgr2=0x7fb310068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:06.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 0x7fb310068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb314009870 tx=0x7fb3140a6000 comp rx=0 tx=0).stop 2023-12-16T03:26:06.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 -- 172.21.15.28:0/549890464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3240c4110 msgr2=0x7fb3240711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:06.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3240c4110 0x7fb3240711f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb31c001570 tx=0x7fb31c00cd20 comp rx=0 tx=0).stop 2023-12-16T03:26:06.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 -- 172.21.15.28:0/549890464 shutdown_connections 2023-12-16T03:26:06.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 0x7fb310068930 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3240c4110 0x7fb3240711f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3240a5370 0x7fb324070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 --2- 172.21.15.28:0/549890464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb324072090 0x7fb3240a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 -- 172.21.15.28:0/549890464 >> 172.21.15.28:0/549890464 conn(0x7fb32406a5b0 msgr2=0x7fb324150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:06.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 -- 172.21.15.28:0/549890464 shutdown_connections 2023-12-16T03:26:06.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.478+0000 7fb3292fe640 1 -- 172.21.15.28:0/549890464 wait complete. 2023-12-16T03:26:06.505 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-16T03:26:06.506 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:26:06.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.646+0000 7f5c887c1640 1 Processor -- start 2023-12-16T03:26:06.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.646+0000 7f5c887c1640 1 -- start start 2023-12-16T03:26:06.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c887c1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5c800c4100 0x7f5c800c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:06.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c887c1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c800c06d0 0x7f5c800a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:06.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c887c1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c800c31c0 con 0x7f5c800c63c0 2023-12-16T03:26:06.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c887c1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c800c34a0 con 0x7f5c800c4100 2023-12-16T03:26:06.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c887c1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800c1030 con 0x7f5c800c06d0 2023-12-16T03:26:06.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c85d5c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5c800c4100 0x7f5c800c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:06.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c85d5c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5c800c4100 0x7f5c800c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49408/0 (socket says 172.21.15.28:49408) 2023-12-16T03:26:06.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c85d5c640 1 -- 172.21.15.28:0/2895629614 learned_addr learned my addr 172.21.15.28:0/2895629614 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:06.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c86d5e640 1 --2- 172.21.15.28:0/2895629614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c800c06d0 0x7f5c800a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:06.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c85d5c640 1 -- 172.21.15.28:0/2895629614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c800c06d0 msgr2=0x7f5c800a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:06.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c85d5c640 1 --2- 172.21.15.28:0/2895629614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c800c06d0 0x7f5c800a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c85d5c640 1 -- 172.21.15.28:0/2895629614 >> v1:172.21.15.134:6789/0 conn(0x7f5c800c63c0 legacy=0x7f5c800c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:06.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c85d5c640 1 -- 172.21.15.28:0/2895629614 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800c1310 con 0x7f5c800c4100 2023-12-16T03:26:06.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.650+0000 7f5c85d5c640 1 --2- 172.21.15.28:0/2895629614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c800c4100 0x7f5c800c2bb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009870 tx=0x7f5c7001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63aa651480fc63e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:06.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c8555b640 1 -- 172.21.15.28:0/2895629614 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c800aa3d0 con 0x7f5c800c4100 2023-12-16T03:26:06.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c8555b640 1 -- 172.21.15.28:0/2895629614 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c700a7050 con 0x7f5c800c4100 2023-12-16T03:26:06.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c8555b640 1 -- 172.21.15.28:0/2895629614 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c700ab820 con 0x7f5c800c4100 2023-12-16T03:26:06.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 -- 172.21.15.28:0/2895629614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c800c4100 msgr2=0x7f5c800c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:06.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 --2- 172.21.15.28:0/2895629614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c800c4100 0x7f5c800c2bb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009870 tx=0x7f5c7001c420 comp rx=0 tx=0).stop 2023-12-16T03:26:06.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 -- 172.21.15.28:0/2895629614 shutdown_connections 2023-12-16T03:26:06.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 --2- 172.21.15.28:0/2895629614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c800c06d0 0x7f5c800a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 --2- 172.21.15.28:0/2895629614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c800c4100 0x7f5c800c2bb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 -- 172.21.15.28:0/2895629614 >> 172.21.15.28:0/2895629614 conn(0x7f5c8006a5b0 msgr2=0x7f5c8006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:06.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 -- 172.21.15.28:0/2895629614 shutdown_connections 2023-12-16T03:26:06.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 -- 172.21.15.28:0/2895629614 wait complete. 2023-12-16T03:26:06.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 Processor -- start 2023-12-16T03:26:06.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 -- start start 2023-12-16T03:26:06.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c800c06d0 0x7f5c800a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:06.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c800c4100 0x7f5c801f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:06.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800c63c0 0x7f5c801518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800c56a0 con 0x7f5c800c4100 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80155590 con 0x7f5c800c63c0 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c887c1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80154070 con 0x7f5c800c06d0 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c85d5c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c800c4100 0x7f5c801f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c85d5c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c800c4100 0x7f5c801f02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49418/0 (socket says 172.21.15.28:49418) 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.654+0000 7f5c85d5c640 1 -- 172.21.15.28:0/2479726098 learned_addr learned my addr 172.21.15.28:0/2479726098 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c8655d640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c800c06d0 0x7f5c800a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c86d5e640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800c63c0 0x7f5c801518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c85d5c640 1 -- 172.21.15.28:0/2479726098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c800c06d0 msgr2=0x7f5c800a45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c85d5c640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c800c06d0 0x7f5c800a45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c85d5c640 1 -- 172.21.15.28:0/2479726098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800c63c0 msgr2=0x7f5c801518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c85d5c640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800c63c0 0x7f5c801518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c85d5c640 1 -- 172.21.15.28:0/2479726098 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c700094d0 con 0x7f5c800c4100 2023-12-16T03:26:06.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c86d5e640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800c63c0 0x7f5c801518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:06.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c85d5c640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c800c4100 0x7f5c801f02a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5c700ae040 tx=0x7f5c7001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:06.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c76ffd640 1 -- 172.21.15.28:0/2479726098 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c700b6620 con 0x7f5c800c4100 2023-12-16T03:26:06.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c76ffd640 1 -- 172.21.15.28:0/2479726098 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c700abe90 con 0x7f5c800c4100 2023-12-16T03:26:06.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c887c1640 1 -- 172.21.15.28:0/2479726098 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c801557a0 con 0x7f5c800c4100 2023-12-16T03:26:06.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c76ffd640 1 -- 172.21.15.28:0/2479726098 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c700b69c0 con 0x7f5c800c4100 2023-12-16T03:26:06.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c887c1640 1 -- 172.21.15.28:0/2479726098 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c800a5010 con 0x7f5c800c4100 2023-12-16T03:26:06.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c887c1640 1 -- 172.21.15.28:0/2479726098 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c80155930 con 0x7f5c800c4100 2023-12-16T03:26:06.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c76ffd640 1 -- 172.21.15.28:0/2479726098 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5c700b2040 con 0x7f5c800c4100 2023-12-16T03:26:06.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c76ffd640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c64066470 0x7f5c64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:06.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.658+0000 7f5c76ffd640 1 -- 172.21.15.28:0/2479726098 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c7011e220 con 0x7f5c800c4100 2023-12-16T03:26:06.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.662+0000 7f5c8655d640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c64066470 0x7f5c64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:06.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.662+0000 7f5c8655d640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c64066470 0x7f5c64068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5c800a79e0 tx=0x7f5c7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:06.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.662+0000 7f5c76ffd640 1 -- 172.21.15.28:0/2479726098 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5c700eb740 con 0x7f5c800c4100 2023-12-16T03:26:06.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.854+0000 7f5c887c1640 1 -- 172.21.15.28:0/2479726098 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c80066ba0 con 0x7f5c800c4100 2023-12-16T03:26:06.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c76ffd640 1 -- 172.21.15.28:0/2479726098 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f5c80066ba0 con 0x7f5c800c4100 2023-12-16T03:26:06.861 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:06.862 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3378969769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3378969769},{"type":"v1","addr":"172.21.15.134:6835","nonce":3378969769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2794220220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2794220220},{"type":"v1","addr":"172.21.15.134:6834","nonce":2794220220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5010,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/664267694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":664267694},{"type":"v1","addr":"172.21.15.28:6836","nonce":664267694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:02.836620+0000","modified":"2023-12-16T03:26:05.858917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.28:6837/1004873879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1004873879},{"type":"v1","addr":"172.21.15.28:6837","nonce":1004873879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-16T03:26:06.862 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 16 2023-12-16T03:26:06.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 -- 172.21.15.28:0/2479726098 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c64066470 msgr2=0x7f5c64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:06.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c64066470 0x7f5c64068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5c800a79e0 tx=0x7f5c7c009040 comp rx=0 tx=0).stop 2023-12-16T03:26:06.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 -- 172.21.15.28:0/2479726098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c800c4100 msgr2=0x7f5c801f02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:06.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c800c4100 0x7f5c801f02a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5c700ae040 tx=0x7f5c7001ac60 comp rx=0 tx=0).stop 2023-12-16T03:26:06.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 -- 172.21.15.28:0/2479726098 shutdown_connections 2023-12-16T03:26:06.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c800c63c0 0x7f5c801518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c64066470 0x7f5c64068930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c800c4100 0x7f5c801f02a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 --2- 172.21.15.28:0/2479726098 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c800c06d0 0x7f5c800a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:06.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 -- 172.21.15.28:0/2479726098 >> 172.21.15.28:0/2479726098 conn(0x7f5c8006a5b0 msgr2=0x7f5c80154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:06.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 -- 172.21.15.28:0/2479726098 shutdown_connections 2023-12-16T03:26:06.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:06.858+0000 7f5c887c1640 1 -- 172.21.15.28:0/2479726098 wait complete. 2023-12-16T03:26:06.882 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:07.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b8668640 1 Processor -- start 2023-12-16T03:26:07.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b8668640 1 -- start start 2023-12-16T03:26:07.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b8668640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa3b0151e90 0x7fa3b00c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b8668640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00c7ea0 0x7fa3b006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b8668640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b006c860 con 0x7fa3b00c4e60 2023-12-16T03:26:07.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b8668640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b00c8750 con 0x7fa3b0151e90 2023-12-16T03:26:07.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b8668640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01552d0 con 0x7fa3b00c7ea0 2023-12-16T03:26:07.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b6c05640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa3b00c4e60 0x7fa3b006b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45100/0 (socket says 172.21.15.28:45100) 2023-12-16T03:26:07.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b6c05640 1 -- 172.21.15.28:0/1864066582 learned_addr learned my addr 172.21.15.28:0/1864066582 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:07.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b6404640 1 --2- 172.21.15.28:0/1864066582 >> v2:172.21.15.134:3300/0 conn(0x7fa3b0151e90 0x7fa3b00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5c03640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00c7ea0 0x7fa3b006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610346547 0 0) 0x7fa3b006c860 con 0x7fa3b00c4e60 2023-12-16T03:26:07.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa39c003530 con 0x7fa3b00c4e60 2023-12-16T03:26:07.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1321417400 0 0) 0x7fa39c003530 con 0x7fa3b00c4e60 2023-12-16T03:26:07.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00c7ea0 msgr2=0x7fa3b006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:07.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00c7ea0 0x7fa3b006b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 >> v2:172.21.15.134:3300/0 conn(0x7fa3b0151e90 msgr2=0x7fa3b00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:07.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 --2- 172.21.15.28:0/1864066582 >> v2:172.21.15.134:3300/0 conn(0x7fa3b0151e90 0x7fa3b00c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0154930 con 0x7fa3b00c4e60 2023-12-16T03:26:07.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fa3a8001a00 con 0x7fa3b00c4e60 2023-12-16T03:26:07.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 >> v1:172.21.15.28:6789/0 conn(0x7fa3b00c4e60 legacy=0x7fa3b006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00c7ea0 0x7fa39c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa39c003f00 0x7fa39c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 0x7fa39c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00c8750 con 0x7fa39c004d10 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01552d0 con 0x7fa39c003f00 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c00ba70 con 0x7fa3b00c7ea0 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b6404640 1 --2- 172.21.15.28:0/1864066582 >> v2:172.21.15.134:3300/0 conn(0x7fa3b0151e90 0x7fa3b00c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b6c05640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 0x7fa39c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b5c03640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa39c003f00 0x7fa39c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b6404640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00c7ea0 0x7fa39c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b6c05640 1 -- 172.21.15.28:0/1864066582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00c7ea0 msgr2=0x7fa39c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b6c05640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00c7ea0 0x7fa39c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b6c05640 1 -- 172.21.15.28:0/1864066582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa39c003f00 msgr2=0x7fa39c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b6c05640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa39c003f00 0x7fa39c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.022+0000 7fa3b6c05640 1 -- 172.21.15.28:0/1864066582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c003530 con 0x7fa39c004d10 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.026+0000 7fa3b6c05640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 0x7fa39c005190 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800a860 tx=0x7fa3a801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8972de4b86817f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.026+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80ad630 con 0x7fa39c004d10 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.026+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a80a8070 con 0x7fa39c004d10 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.026+0000 7fa3b5402640 1 -- 172.21.15.28:0/1864066582 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80ada30 con 0x7fa39c004d10 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.026+0000 7fa3b8668640 1 -- 172.21.15.28:0/1864066582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 msgr2=0x7fa39c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.026+0000 7fa3b8668640 1 --2- 172.21.15.28:0/1864066582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 0x7fa39c005190 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800a860 tx=0x7fa3a801d360 comp rx=0 tx=0).stop 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.026+0000 7fa3b6c05640 1 -- 172.21.15.28:0/1864066582 reap_dead start 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.026+0000 7fa3b8668640 1 -- 172.21.15.28:0/1864066582 shutdown_connections 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.026+0000 7fa3b8668640 1 -- 172.21.15.28:0/1864066582 >> 172.21.15.28:0/1864066582 conn(0x7fa3b00ca170 msgr2=0x7fa3b00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b8668640 1 -- 172.21.15.28:0/1864066582 shutdown_connections 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b8668640 1 -- 172.21.15.28:0/1864066582 wait complete. 2023-12-16T03:26:07.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b8668640 1 Processor -- start 2023-12-16T03:26:07.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b8668640 1 -- start start 2023-12-16T03:26:07.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b8668640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 0x7fa3b0153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b8668640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00ac590 0x7fa3b014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b8668640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3b014e9f0 0x7fa3b00a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b8668640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01f0400 con 0x7fa39c004d10 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b8668640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01f06e0 con 0x7fa3b014e9f0 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b8668640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01f09c0 con 0x7fa3b00ac590 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b6404640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 0x7fa3b0153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b6404640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 0x7fa3b0153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49430/0 (socket says 172.21.15.28:49430) 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b6404640 1 -- 172.21.15.28:0/1613774688 learned_addr learned my addr 172.21.15.28:0/1613774688 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b6c05640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3b014e9f0 0x7fa3b00a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b5c03640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00ac590 0x7fa3b014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b6404640 1 -- 172.21.15.28:0/1613774688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00ac590 msgr2=0x7fa3b014e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b6404640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00ac590 0x7fa3b014e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b6404640 1 -- 172.21.15.28:0/1613774688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3b014e9f0 msgr2=0x7fa3b00a9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b6404640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3b014e9f0 0x7fa3b00a9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b6404640 1 -- 172.21.15.28:0/1613774688 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b01f0ca0 con 0x7fa39c004d10 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b5c03640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00ac590 0x7fa3b014e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:07.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b6c05640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3b014e9f0 0x7fa3b00a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:07.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b6404640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 0x7fa3b0153a60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac011900 tx=0x7fa3ac011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:07.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3a6ffd640 1 -- 172.21.15.28:0/1613774688 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00fbd0 con 0x7fa39c004d10 2023-12-16T03:26:07.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3a6ffd640 1 -- 172.21.15.28:0/1613774688 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac00fd30 con 0x7fa39c004d10 2023-12-16T03:26:07.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3a6ffd640 1 -- 172.21.15.28:0/1613774688 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac015660 con 0x7fa39c004d10 2023-12-16T03:26:07.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.030+0000 7fa3b8668640 1 -- 172.21.15.28:0/1613774688 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b01f0f80 con 0x7fa39c004d10 2023-12-16T03:26:07.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.034+0000 7fa3b8668640 1 -- 172.21.15.28:0/1613774688 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b0153fa0 con 0x7fa39c004d10 2023-12-16T03:26:07.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.034+0000 7fa3b8668640 1 -- 172.21.15.28:0/1613774688 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b0068400 con 0x7fa39c004d10 2023-12-16T03:26:07.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.034+0000 7fa3a6ffd640 1 -- 172.21.15.28:0/1613774688 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa3ac0157c0 con 0x7fa39c004d10 2023-12-16T03:26:07.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.034+0000 7fa3a6ffd640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3940664c0 0x7fa394068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.034+0000 7fa3a6ffd640 1 -- 172.21.15.28:0/1613774688 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3ac084930 con 0x7fa39c004d10 2023-12-16T03:26:07.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.034+0000 7fa3b5c03640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3940664c0 0x7fa394068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.034+0000 7fa3b5c03640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3940664c0 0x7fa394068980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00c8300 tx=0x7fa3a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:07.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.038+0000 7fa3a6ffd640 1 -- 172.21.15.28:0/1613774688 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa3ac051ed0 con 0x7fa39c004d10 2023-12-16T03:26:07.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.198+0000 7fa3b8668640 1 -- 172.21.15.28:0/1613774688 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3b00ca7c0 con 0x7fa39c004d10 2023-12-16T03:26:07.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.198+0000 7fa3a6ffd640 1 -- 172.21.15.28:0/1613774688 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fa3ac0554f0 con 0x7fa39c004d10 2023-12-16T03:26:07.204 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:07.204 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":32,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:04.457569+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:07.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 -- 172.21.15.28:0/1613774688 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3940664c0 msgr2=0x7fa394068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3940664c0 0x7fa394068980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00c8300 tx=0x7fa3a0008040 comp rx=0 tx=0).stop 2023-12-16T03:26:07.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 -- 172.21.15.28:0/1613774688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 msgr2=0x7fa3b0153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 0x7fa3b0153a60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac011900 tx=0x7fa3ac011dc0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 -- 172.21.15.28:0/1613774688 shutdown_connections 2023-12-16T03:26:07.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3b014e9f0 0x7fa3b00a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3b00ac590 0x7fa3b014e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3940664c0 0x7fa394068980 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 --2- 172.21.15.28:0/1613774688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa39c004d10 0x7fa3b0153a60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 -- 172.21.15.28:0/1613774688 >> 172.21.15.28:0/1613774688 conn(0x7fa3b00ca170 msgr2=0x7fa3b015d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:07.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 -- 172.21.15.28:0/1613774688 shutdown_connections 2023-12-16T03:26:07.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.202+0000 7fa3b8668640 1 -- 172.21.15.28:0/1613774688 wait complete. 2023-12-16T03:26:07.225 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-16T03:26:07.225 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:26:07.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.362+0000 7fea4ec79640 1 Processor -- start 2023-12-16T03:26:07.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea4ec79640 1 -- start start 2023-12-16T03:26:07.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea4ec79640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fea480c4100 0x7fea480c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea4ec79640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fea480c06d0 0x7fea480a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea4ec79640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea480c31c0 con 0x7fea480c63c0 2023-12-16T03:26:07.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea4ec79640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea480c34a0 con 0x7fea480c4100 2023-12-16T03:26:07.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea4ec79640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea480c1030 con 0x7fea480c06d0 2023-12-16T03:26:07.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea4ca15640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fea480c63c0 0x7fea480c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45106/0 (socket says 172.21.15.28:45106) 2023-12-16T03:26:07.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea4ca15640 1 -- 172.21.15.28:0/1290286955 learned_addr learned my addr 172.21.15.28:0/1290286955 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:07.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea47fff640 1 --2- 172.21.15.28:0/1290286955 >> v2:172.21.15.28:3300/0 conn(0x7fea480c4100 0x7fea480c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea4d216640 1 --2- 172.21.15.28:0/1290286955 >> v2:172.21.15.134:3300/0 conn(0x7fea480c06d0 0x7fea480a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea477fe640 1 -- 172.21.15.28:0/1290286955 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349542129 0 0) 0x7fea480c31c0 con 0x7fea480c63c0 2023-12-16T03:26:07.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea477fe640 1 -- 172.21.15.28:0/1290286955 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea38005740 con 0x7fea480c63c0 2023-12-16T03:26:07.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea47fff640 1 -- 172.21.15.28:0/1290286955 >> v2:172.21.15.134:3300/0 conn(0x7fea480c06d0 msgr2=0x7fea480a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:07.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea47fff640 1 --2- 172.21.15.28:0/1290286955 >> v2:172.21.15.134:3300/0 conn(0x7fea480c06d0 0x7fea480a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea47fff640 1 -- 172.21.15.28:0/1290286955 >> v1:172.21.15.28:6789/0 conn(0x7fea480c63c0 legacy=0x7fea480c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.366+0000 7fea47fff640 1 -- 172.21.15.28:0/1290286955 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480c1310 con 0x7fea480c4100 2023-12-16T03:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea47fff640 1 --2- 172.21.15.28:0/1290286955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea480c4100 0x7fea480c2bb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fea480c0ee0 tx=0x7fea3401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb29786a52aa28f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea477fe640 1 -- 172.21.15.28:0/1290286955 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea480aa3d0 con 0x7fea480c4100 2023-12-16T03:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea477fe640 1 -- 172.21.15.28:0/1290286955 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea340a7050 con 0x7fea480c4100 2023-12-16T03:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea477fe640 1 -- 172.21.15.28:0/1290286955 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea340ab820 con 0x7fea480c4100 2023-12-16T03:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea4ec79640 1 -- 172.21.15.28:0/1290286955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea480c4100 msgr2=0x7fea480c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea4ec79640 1 --2- 172.21.15.28:0/1290286955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea480c4100 0x7fea480c2bb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fea480c0ee0 tx=0x7fea3401c340 comp rx=0 tx=0).stop 2023-12-16T03:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea4ec79640 1 -- 172.21.15.28:0/1290286955 shutdown_connections 2023-12-16T03:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea4ec79640 1 --2- 172.21.15.28:0/1290286955 >> v2:172.21.15.134:3300/0 conn(0x7fea480c06d0 0x7fea480a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea4ec79640 1 --2- 172.21.15.28:0/1290286955 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea480c4100 0x7fea480c2bb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea4ec79640 1 -- 172.21.15.28:0/1290286955 >> 172.21.15.28:0/1290286955 conn(0x7fea4806a5b0 msgr2=0x7fea4806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea4ec79640 1 -- 172.21.15.28:0/1290286955 shutdown_connections 2023-12-16T03:26:07.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea4ec79640 1 -- 172.21.15.28:0/1290286955 wait complete. 2023-12-16T03:26:07.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea4ec79640 1 Processor -- start 2023-12-16T03:26:07.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.370+0000 7fea4ec79640 1 -- start start 2023-12-16T03:26:07.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ec79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea480c06d0 0x7fea4815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ec79640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea480c4100 0x7fea481ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ec79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea480c63c0 0x7fea481eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ec79640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea48072320 con 0x7fea480c06d0 2023-12-16T03:26:07.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ec79640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea48151a60 con 0x7fea480c4100 2023-12-16T03:26:07.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ec79640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea481ed0c0 con 0x7fea480c63c0 2023-12-16T03:26:07.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ca15640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea480c06d0 0x7fea4815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ca15640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea480c06d0 0x7fea4815a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49446/0 (socket says 172.21.15.28:49446) 2023-12-16T03:26:07.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ca15640 1 -- 172.21.15.28:0/3909437551 learned_addr learned my addr 172.21.15.28:0/3909437551 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:07.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ca15640 1 -- 172.21.15.28:0/3909437551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea480c63c0 msgr2=0x7fea481eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ca15640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea480c63c0 0x7fea481eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ca15640 1 -- 172.21.15.28:0/3909437551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea480c4100 msgr2=0x7fea481ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ca15640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea480c4100 0x7fea481ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ca15640 1 -- 172.21.15.28:0/3909437551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea34009420 con 0x7fea480c06d0 2023-12-16T03:26:07.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ca15640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea480c06d0 0x7fea4815a420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00c400 tx=0x7fea3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:07.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea457fa640 1 -- 172.21.15.28:0/3909437551 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c005cf0 con 0x7fea480c06d0 2023-12-16T03:26:07.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea457fa640 1 -- 172.21.15.28:0/3909437551 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c005e70 con 0x7fea480c06d0 2023-12-16T03:26:07.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea457fa640 1 -- 172.21.15.28:0/3909437551 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0072f0 con 0x7fea480c06d0 2023-12-16T03:26:07.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ec79640 1 -- 172.21.15.28:0/3909437551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea481f1210 con 0x7fea480c06d0 2023-12-16T03:26:07.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ec79640 1 -- 172.21.15.28:0/3909437551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea48151f90 con 0x7fea480c06d0 2023-12-16T03:26:07.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea4ec79640 1 -- 172.21.15.28:0/3909437551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea48068400 con 0x7fea480c06d0 2023-12-16T03:26:07.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.374+0000 7fea457fa640 1 -- 172.21.15.28:0/3909437551 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fea3c007450 con 0x7fea480c06d0 2023-12-16T03:26:07.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.378+0000 7fea457fa640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea2c066470 0x7fea2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.378+0000 7fea457fa640 1 -- 172.21.15.28:0/3909437551 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea3c083420 con 0x7fea480c06d0 2023-12-16T03:26:07.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.378+0000 7fea47fff640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea2c066470 0x7fea2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.378+0000 7fea47fff640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea2c066470 0x7fea2c068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea340ad000 tx=0x7fea34004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.382+0000 7fea457fa640 1 -- 172.21.15.28:0/3909437551 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fea3c050890 con 0x7fea480c06d0 2023-12-16T03:26:07.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.538+0000 7fea4ec79640 1 -- 172.21.15.28:0/3909437551 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea481ed200 con 0x7fea2c066470 2023-12-16T03:26:07.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.546+0000 7fea457fa640 1 -- 172.21.15.28:0/3909437551 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259388 (secure 0 0 0) 0x7fea340b4400 con 0x7fea2c066470 2023-12-16T03:26:07.552 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:07.554 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:26:07.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.546+0000 7fea4ec79640 1 -- 172.21.15.28:0/3909437551 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea2c066470 msgr2=0x7fea2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.546+0000 7fea4ec79640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea2c066470 0x7fea2c068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea340ad000 tx=0x7fea34004740 comp rx=0 tx=0).stop 2023-12-16T03:26:07.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.546+0000 7fea4ec79640 1 -- 172.21.15.28:0/3909437551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea480c06d0 msgr2=0x7fea4815a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.546+0000 7fea4ec79640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea480c06d0 0x7fea4815a420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00c400 tx=0x7fea3c00c8c0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.550+0000 7fea4ec79640 1 -- 172.21.15.28:0/3909437551 shutdown_connections 2023-12-16T03:26:07.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.550+0000 7fea4ec79640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea480c63c0 0x7fea481eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.550+0000 7fea4ec79640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea480c4100 0x7fea481ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.550+0000 7fea4ec79640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea2c066470 0x7fea2c068930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.550+0000 7fea4ec79640 1 --2- 172.21.15.28:0/3909437551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea480c06d0 0x7fea4815a420 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.550+0000 7fea4ec79640 1 -- 172.21.15.28:0/3909437551 >> 172.21.15.28:0/3909437551 conn(0x7fea4806a5b0 msgr2=0x7fea4806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:07.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.550+0000 7fea4ec79640 1 -- 172.21.15.28:0/3909437551 shutdown_connections 2023-12-16T03:26:07.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.550+0000 7fea4ec79640 1 -- 172.21.15.28:0/3909437551 wait complete. 2023-12-16T03:26:07.572 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-12-16T03:26:05.808492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236520,"kb_used_data":3712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738200,"statfs":{"total":773094113280,"available":772851916800,"internally_reserved":0,"allocated":3801088,"data_stored":2153870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.377757"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455072+0000","last_change":"2023-12-16T03:26:02.455072+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455072+0000","last_undegraded":"2023-12-16T03:26:02.455072+0000","last_fullsized":"2023-12-16T03:26:02.455072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455099+0000","last_change":"2023-12-16T03:26:02.455099+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455099+0000","last_undegraded":"2023-12-16T03:26:02.455099+0000","last_fullsized":"2023-12-16T03:26:02.455099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445002+0000","last_change":"2023-12-16T03:26:02.445002+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445002+0000","last_undegraded":"2023-12-16T03:26:02.445002+0000","last_fullsized":"2023-12-16T03:26:02.445002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450723+0000","last_change":"2023-12-16T03:26:02.450723+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450723+0000","last_undegraded":"2023-12-16T03:26:02.450723+0000","last_fullsized":"2023-12-16T03:26:02.450723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455291+0000","last_change":"2023-12-16T03:26:02.455291+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455291+0000","last_undegraded":"2023-12-16T03:26:02.455291+0000","last_fullsized":"2023-12-16T03:26:02.455291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451114+0000","last_change":"2023-12-16T03:26:02.451114+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451114+0000","last_undegraded":"2023-12-16T03:26:02.451114+0000","last_fullsized":"2023-12-16T03:26:02.451114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452611+0000","last_change":"2023-12-16T03:26:02.452611+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452611+0000","last_undegraded":"2023-12-16T03:26:02.452611+0000","last_fullsized":"2023-12-16T03:26:02.452611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455580+0000","last_change":"2023-12-16T03:26:02.455580+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455580+0000","last_undegraded":"2023-12-16T03:26:02.455580+0000","last_fullsized":"2023-12-16T03:26:02.455580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449887+0000","last_change":"2023-12-16T03:26:02.449887+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449887+0000","last_undegraded":"2023-12-16T03:26:02.449887+0000","last_fullsized":"2023-12-16T03:26:02.449887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.464569+0000","last_change":"2023-12-16T03:26:02.464569+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.464569+0000","last_undegraded":"2023-12-16T03:26:02.464569+0000","last_fullsized":"2023-12-16T03:26:02.464569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454609+0000","last_change":"2023-12-16T03:26:02.454609+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454609+0000","last_undegraded":"2023-12-16T03:26:02.454609+0000","last_fullsized":"2023-12-16T03:26:02.454609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445786+0000","last_change":"2023-12-16T03:26:02.445786+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445786+0000","last_undegraded":"2023-12-16T03:26:02.445786+0000","last_fullsized":"2023-12-16T03:26:02.445786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454699+0000","last_change":"2023-12-16T03:26:02.454699+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454699+0000","last_undegraded":"2023-12-16T03:26:02.454699+0000","last_fullsized":"2023-12-16T03:26:02.454699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450561+0000","last_change":"2023-12-16T03:26:02.450561+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450561+0000","last_undegraded":"2023-12-16T03:26:02.450561+0000","last_fullsized":"2023-12-16T03:26:02.450561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444964+0000","last_change":"2023-12-16T03:26:02.444964+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444964+0000","last_undegraded":"2023-12-16T03:26:02.444964+0000","last_fullsized":"2023-12-16T03:26:02.444964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450772+0000","last_change":"2023-12-16T03:26:02.450772+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450772+0000","last_undegraded":"2023-12-16T03:26:02.450772+0000","last_fullsized":"2023-12-16T03:26:02.450772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453842+0000","last_change":"2023-12-16T03:26:02.453842+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453842+0000","last_undegraded":"2023-12-16T03:26:02.453842+0000","last_fullsized":"2023-12-16T03:26:02.453842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451495+0000","last_change":"2023-12-16T03:26:02.451495+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451495+0000","last_undegraded":"2023-12-16T03:26:02.451495+0000","last_fullsized":"2023-12-16T03:26:02.451495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453743+0000","last_change":"2023-12-16T03:26:02.453743+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453743+0000","last_undegraded":"2023-12-16T03:26:02.453743+0000","last_fullsized":"2023-12-16T03:26:02.453743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.457767+0000","last_change":"2023-12-16T03:26:02.457767+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.457767+0000","last_undegraded":"2023-12-16T03:26:02.457767+0000","last_fullsized":"2023-12-16T03:26:02.457767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448732+0000","last_change":"2023-12-16T03:26:02.448732+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448732+0000","last_undegraded":"2023-12-16T03:26:02.448732+0000","last_fullsized":"2023-12-16T03:26:02.448732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448834+0000","last_change":"2023-12-16T03:26:02.448834+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448834+0000","last_undegraded":"2023-12-16T03:26:02.448834+0000","last_fullsized":"2023-12-16T03:26:02.448834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447166+0000","last_change":"2023-12-16T03:26:02.447166+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447166+0000","last_undegraded":"2023-12-16T03:26:02.447166+0000","last_fullsized":"2023-12-16T03:26:02.447166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444970+0000","last_change":"2023-12-16T03:26:02.444970+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444970+0000","last_undegraded":"2023-12-16T03:26:02.444970+0000","last_fullsized":"2023-12-16T03:26:02.444970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.463174+0000","last_change":"2023-12-16T03:26:02.463174+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.463174+0000","last_undegraded":"2023-12-16T03:26:02.463174+0000","last_fullsized":"2023-12-16T03:26:02.463174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451052+0000","last_change":"2023-12-16T03:26:02.451052+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451052+0000","last_undegraded":"2023-12-16T03:26:02.451052+0000","last_fullsized":"2023-12-16T03:26:02.451052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.460874+0000","last_change":"2023-12-16T03:26:02.460874+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.460874+0000","last_undegraded":"2023-12-16T03:26:02.460874+0000","last_fullsized":"2023-12-16T03:26:02.460874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445333+0000","last_change":"2023-12-16T03:26:02.445333+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445333+0000","last_undegraded":"2023-12-16T03:26:02.445333+0000","last_fullsized":"2023-12-16T03:26:02.445333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448106+0000","last_change":"2023-12-16T03:26:02.448106+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448106+0000","last_undegraded":"2023-12-16T03:26:02.448106+0000","last_fullsized":"2023-12-16T03:26:02.448106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451895+0000","last_change":"2023-12-16T03:26:02.451895+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451895+0000","last_undegraded":"2023-12-16T03:26:02.451895+0000","last_fullsized":"2023-12-16T03:26:02.451895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452514+0000","last_change":"2023-12-16T03:26:02.452514+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452514+0000","last_undegraded":"2023-12-16T03:26:02.452514+0000","last_fullsized":"2023-12-16T03:26:02.452514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454851+0000","last_change":"2023-12-16T03:26:02.454851+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454851+0000","last_undegraded":"2023-12-16T03:26:02.454851+0000","last_fullsized":"2023-12-16T03:26:02.454851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446356+0000","last_change":"2023-12-16T03:26:02.446356+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446356+0000","last_undegraded":"2023-12-16T03:26:02.446356+0000","last_fullsized":"2023-12-16T03:26:02.446356+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473417+0000","last_change":"2023-12-16T03:26:02.466777+0000","last_active":"2023-12-16T03:26:02.473417+0000","last_peered":"2023-12-16T03:26:02.473417+0000","last_clean":"2023-12-16T03:26:02.473417+0000","last_became_active":"2023-12-16T03:26:02.466486+0000","last_became_peered":"2023-12-16T03:26:02.466486+0000","last_unstale":"2023-12-16T03:26:02.473417+0000","last_undegraded":"2023-12-16T03:26:02.473417+0000","last_fullsized":"2023-12-16T03:26:02.473417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454034+0000","last_change":"2023-12-16T03:26:02.454034+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454034+0000","last_undegraded":"2023-12-16T03:26:02.454034+0000","last_fullsized":"2023-12-16T03:26:02.454034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465472+0000","last_change":"2023-12-16T03:26:02.464156+0000","last_active":"2023-12-16T03:26:02.465472+0000","last_peered":"2023-12-16T03:26:02.465472+0000","last_clean":"2023-12-16T03:26:02.465472+0000","last_became_active":"2023-12-16T03:26:02.463875+0000","last_became_peered":"2023-12-16T03:26:02.463875+0000","last_unstale":"2023-12-16T03:26:02.465472+0000","last_undegraded":"2023-12-16T03:26:02.465472+0000","last_fullsized":"2023-12-16T03:26:02.465472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447295+0000","last_change":"2023-12-16T03:26:02.447295+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447295+0000","last_undegraded":"2023-12-16T03:26:02.447295+0000","last_fullsized":"2023-12-16T03:26:02.447295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.478635+0000","last_change":"2023-12-16T03:26:02.475790+0000","last_active":"2023-12-16T03:26:02.478635+0000","last_peered":"2023-12-16T03:26:02.478635+0000","last_clean":"2023-12-16T03:26:02.478635+0000","last_became_active":"2023-12-16T03:26:02.475486+0000","last_became_peered":"2023-12-16T03:26:02.475486+0000","last_unstale":"2023-12-16T03:26:02.478635+0000","last_undegraded":"2023-12-16T03:26:02.478635+0000","last_fullsized":"2023-12-16T03:26:02.478635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449229+0000","last_change":"2023-12-16T03:26:02.449229+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449229+0000","last_undegraded":"2023-12-16T03:26:02.449229+0000","last_fullsized":"2023-12-16T03:26:02.449229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.476059+0000","last_change":"2023-12-16T03:26:02.473812+0000","last_active":"2023-12-16T03:26:02.476059+0000","last_peered":"2023-12-16T03:26:02.476059+0000","last_clean":"2023-12-16T03:26:02.476059+0000","last_became_active":"2023-12-16T03:26:02.473426+0000","last_became_peered":"2023-12-16T03:26:02.473426+0000","last_unstale":"2023-12-16T03:26:02.476059+0000","last_undegraded":"2023-12-16T03:26:02.476059+0000","last_fullsized":"2023-12-16T03:26:02.476059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:48.463304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451342+0000","last_change":"2023-12-16T03:26:02.451342+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451342+0000","last_undegraded":"2023-12-16T03:26:02.451342+0000","last_fullsized":"2023-12-16T03:26:02.451342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475157+0000","last_change":"2023-12-16T03:26:02.469331+0000","last_active":"2023-12-16T03:26:02.475157+0000","last_peered":"2023-12-16T03:26:02.475157+0000","last_clean":"2023-12-16T03:26:02.475157+0000","last_became_active":"2023-12-16T03:26:02.469083+0000","last_became_peered":"2023-12-16T03:26:02.469083+0000","last_unstale":"2023-12-16T03:26:02.475157+0000","last_undegraded":"2023-12-16T03:26:02.475157+0000","last_fullsized":"2023-12-16T03:26:02.475157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:15.539658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446350+0000","last_change":"2023-12-16T03:26:02.446350+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446350+0000","last_undegraded":"2023-12-16T03:26:02.446350+0000","last_fullsized":"2023-12-16T03:26:02.446350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475188+0000","last_change":"2023-12-16T03:26:02.472832+0000","last_active":"2023-12-16T03:26:02.475188+0000","last_peered":"2023-12-16T03:26:02.475188+0000","last_clean":"2023-12-16T03:26:02.475188+0000","last_became_active":"2023-12-16T03:26:02.472574+0000","last_became_peered":"2023-12-16T03:26:02.472574+0000","last_unstale":"2023-12-16T03:26:02.475188+0000","last_undegraded":"2023-12-16T03:26:02.475188+0000","last_fullsized":"2023-12-16T03:26:02.475188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.446606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447222+0000","last_change":"2023-12-16T03:26:02.447222+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447222+0000","last_undegraded":"2023-12-16T03:26:02.447222+0000","last_fullsized":"2023-12-16T03:26:02.447222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.471594+0000","last_change":"2023-12-16T03:26:02.467098+0000","last_active":"2023-12-16T03:26:02.471594+0000","last_peered":"2023-12-16T03:26:02.471594+0000","last_clean":"2023-12-16T03:26:02.471594+0000","last_became_active":"2023-12-16T03:26:02.464042+0000","last_became_peered":"2023-12-16T03:26:02.464042+0000","last_unstale":"2023-12-16T03:26:02.471594+0000","last_undegraded":"2023-12-16T03:26:02.471594+0000","last_fullsized":"2023-12-16T03:26:02.471594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:23:51.458474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448410+0000","last_change":"2023-12-16T03:26:02.448410+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448410+0000","last_undegraded":"2023-12-16T03:26:02.448410+0000","last_fullsized":"2023-12-16T03:26:02.448410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473421+0000","last_change":"2023-12-16T03:26:02.465231+0000","last_active":"2023-12-16T03:26:02.473421+0000","last_peered":"2023-12-16T03:26:02.473421+0000","last_clean":"2023-12-16T03:26:02.473421+0000","last_became_active":"2023-12-16T03:26:02.464573+0000","last_became_peered":"2023-12-16T03:26:02.464573+0000","last_unstale":"2023-12-16T03:26:02.473421+0000","last_undegraded":"2023-12-16T03:26:02.473421+0000","last_fullsized":"2023-12-16T03:26:02.473421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:44:36.877503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444993+0000","last_change":"2023-12-16T03:26:02.444993+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444993+0000","last_undegraded":"2023-12-16T03:26:02.444993+0000","last_fullsized":"2023-12-16T03:26:02.444993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.470229+0000","last_change":"2023-12-16T03:26:02.468514+0000","last_active":"2023-12-16T03:26:02.470229+0000","last_peered":"2023-12-16T03:26:02.470229+0000","last_clean":"2023-12-16T03:26:02.470229+0000","last_became_active":"2023-12-16T03:26:02.467879+0000","last_became_peered":"2023-12-16T03:26:02.467879+0000","last_unstale":"2023-12-16T03:26:02.470229+0000","last_undegraded":"2023-12-16T03:26:02.470229+0000","last_fullsized":"2023-12-16T03:26:02.470229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:19.149617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453258+0000","last_change":"2023-12-16T03:26:02.453258+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453258+0000","last_undegraded":"2023-12-16T03:26:02.453258+0000","last_fullsized":"2023-12-16T03:26:02.453258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.452298+0000","last_change":"2023-12-16T03:26:02.449876+0000","last_active":"2023-12-16T03:26:02.452298+0000","last_peered":"2023-12-16T03:26:02.452298+0000","last_clean":"2023-12-16T03:26:02.452298+0000","last_became_active":"2023-12-16T03:26:02.449358+0000","last_became_peered":"2023-12-16T03:26:02.449358+0000","last_unstale":"2023-12-16T03:26:02.452298+0000","last_undegraded":"2023-12-16T03:26:02.452298+0000","last_fullsized":"2023-12-16T03:26:02.452298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450370+0000","last_change":"2023-12-16T03:26:02.450370+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450370+0000","last_undegraded":"2023-12-16T03:26:02.450370+0000","last_fullsized":"2023-12-16T03:26:02.450370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.466050+0000","last_change":"2023-12-16T03:26:02.461467+0000","last_active":"2023-12-16T03:26:02.466050+0000","last_peered":"2023-12-16T03:26:02.466050+0000","last_clean":"2023-12-16T03:26:02.466050+0000","last_became_active":"2023-12-16T03:26:02.461144+0000","last_became_peered":"2023-12-16T03:26:02.461144+0000","last_unstale":"2023-12-16T03:26:02.466050+0000","last_undegraded":"2023-12-16T03:26:02.466050+0000","last_fullsized":"2023-12-16T03:26:02.466050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448074+0000","last_change":"2023-12-16T03:26:02.448074+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448074+0000","last_undegraded":"2023-12-16T03:26:02.448074+0000","last_fullsized":"2023-12-16T03:26:02.448074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477932+0000","last_change":"2023-12-16T03:26:02.474073+0000","last_active":"2023-12-16T03:26:02.477932+0000","last_peered":"2023-12-16T03:26:02.477932+0000","last_clean":"2023-12-16T03:26:02.477932+0000","last_became_active":"2023-12-16T03:26:02.473771+0000","last_became_peered":"2023-12-16T03:26:02.473771+0000","last_unstale":"2023-12-16T03:26:02.477932+0000","last_undegraded":"2023-12-16T03:26:02.477932+0000","last_fullsized":"2023-12-16T03:26:02.477932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:51:41.152969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450511+0000","last_change":"2023-12-16T03:26:02.450511+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450511+0000","last_undegraded":"2023-12-16T03:26:02.450511+0000","last_fullsized":"2023-12-16T03:26:02.450511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.467941+0000","last_change":"2023-12-16T03:26:02.464973+0000","last_active":"2023-12-16T03:26:02.467941+0000","last_peered":"2023-12-16T03:26:02.467941+0000","last_clean":"2023-12-16T03:26:02.467941+0000","last_became_active":"2023-12-16T03:26:02.464672+0000","last_became_peered":"2023-12-16T03:26:02.464672+0000","last_unstale":"2023-12-16T03:26:02.467941+0000","last_undegraded":"2023-12-16T03:26:02.467941+0000","last_fullsized":"2023-12-16T03:26:02.467941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:45.759262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448256+0000","last_change":"2023-12-16T03:26:02.448256+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448256+0000","last_undegraded":"2023-12-16T03:26:02.448256+0000","last_fullsized":"2023-12-16T03:26:02.448256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475711+0000","last_change":"2023-12-16T03:26:02.465815+0000","last_active":"2023-12-16T03:26:02.475711+0000","last_peered":"2023-12-16T03:26:02.475711+0000","last_clean":"2023-12-16T03:26:02.475711+0000","last_became_active":"2023-12-16T03:26:02.465505+0000","last_became_peered":"2023-12-16T03:26:02.465505+0000","last_unstale":"2023-12-16T03:26:02.475711+0000","last_undegraded":"2023-12-16T03:26:02.475711+0000","last_fullsized":"2023-12-16T03:26:02.475711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452661+0000","last_change":"2023-12-16T03:26:02.452661+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452661+0000","last_undegraded":"2023-12-16T03:26:02.452661+0000","last_fullsized":"2023-12-16T03:26:02.452661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474177+0000","last_change":"2023-12-16T03:26:02.471444+0000","last_active":"2023-12-16T03:26:02.474177+0000","last_peered":"2023-12-16T03:26:02.474177+0000","last_clean":"2023-12-16T03:26:02.474177+0000","last_became_active":"2023-12-16T03:26:02.468577+0000","last_became_peered":"2023-12-16T03:26:02.468577+0000","last_unstale":"2023-12-16T03:26:02.474177+0000","last_undegraded":"2023-12-16T03:26:02.474177+0000","last_fullsized":"2023-12-16T03:26:02.474177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451895+0000","last_change":"2023-12-16T03:26:02.451895+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451895+0000","last_undegraded":"2023-12-16T03:26:02.451895+0000","last_fullsized":"2023-12-16T03:26:02.451895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.478029+0000","last_change":"2023-12-16T03:26:02.475063+0000","last_active":"2023-12-16T03:26:02.478029+0000","last_peered":"2023-12-16T03:26:02.478029+0000","last_clean":"2023-12-16T03:26:02.478029+0000","last_became_active":"2023-12-16T03:26:02.474759+0000","last_became_peered":"2023-12-16T03:26:02.474759+0000","last_unstale":"2023-12-16T03:26:02.478029+0000","last_undegraded":"2023-12-16T03:26:02.478029+0000","last_fullsized":"2023-12-16T03:26:02.478029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:47.788469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449444+0000","last_change":"2023-12-16T03:26:02.449444+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449444+0000","last_undegraded":"2023-12-16T03:26:02.449444+0000","last_fullsized":"2023-12-16T03:26:02.449444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477863+0000","last_change":"2023-12-16T03:26:02.473227+0000","last_active":"2023-12-16T03:26:02.477863+0000","last_peered":"2023-12-16T03:26:02.477863+0000","last_clean":"2023-12-16T03:26:02.477863+0000","last_became_active":"2023-12-16T03:26:02.472888+0000","last_became_peered":"2023-12-16T03:26:02.472888+0000","last_unstale":"2023-12-16T03:26:02.477863+0000","last_undegraded":"2023-12-16T03:26:02.477863+0000","last_fullsized":"2023-12-16T03:26:02.477863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447130+0000","last_change":"2023-12-16T03:26:02.447130+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447130+0000","last_undegraded":"2023-12-16T03:26:02.447130+0000","last_fullsized":"2023-12-16T03:26:02.447130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473449+0000","last_change":"2023-12-16T03:26:02.465496+0000","last_active":"2023-12-16T03:26:02.473449+0000","last_peered":"2023-12-16T03:26:02.473449+0000","last_clean":"2023-12-16T03:26:02.473449+0000","last_became_active":"2023-12-16T03:26:02.465106+0000","last_became_peered":"2023-12-16T03:26:02.465106+0000","last_unstale":"2023-12-16T03:26:02.473449+0000","last_undegraded":"2023-12-16T03:26:02.473449+0000","last_fullsized":"2023-12-16T03:26:02.473449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:46.860441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450023+0000","last_change":"2023-12-16T03:26:02.450023+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450023+0000","last_undegraded":"2023-12-16T03:26:02.450023+0000","last_fullsized":"2023-12-16T03:26:02.450023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.467979+0000","last_change":"2023-12-16T03:26:02.462818+0000","last_active":"2023-12-16T03:26:02.467979+0000","last_peered":"2023-12-16T03:26:02.467979+0000","last_clean":"2023-12-16T03:26:02.467979+0000","last_became_active":"2023-12-16T03:26:02.462408+0000","last_became_peered":"2023-12-16T03:26:02.462408+0000","last_unstale":"2023-12-16T03:26:02.467979+0000","last_undegraded":"2023-12-16T03:26:02.467979+0000","last_fullsized":"2023-12-16T03:26:02.467979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:54.350741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.461211+0000","last_change":"2023-12-16T03:26:02.461211+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.461211+0000","last_undegraded":"2023-12-16T03:26:02.461211+0000","last_fullsized":"2023-12-16T03:26:02.461211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475131+0000","last_change":"2023-12-16T03:26:02.468837+0000","last_active":"2023-12-16T03:26:02.475131+0000","last_peered":"2023-12-16T03:26:02.475131+0000","last_clean":"2023-12-16T03:26:02.475131+0000","last_became_active":"2023-12-16T03:26:02.468492+0000","last_became_peered":"2023-12-16T03:26:02.468492+0000","last_unstale":"2023-12-16T03:26:02.475131+0000","last_undegraded":"2023-12-16T03:26:02.475131+0000","last_fullsized":"2023-12-16T03:26:02.475131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:48.463304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452995+0000","last_change":"2023-12-16T03:26:02.452995+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452995+0000","last_undegraded":"2023-12-16T03:26:02.452995+0000","last_fullsized":"2023-12-16T03:26:02.452995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.463266+0000","last_change":"2023-12-16T03:26:02.462344+0000","last_active":"2023-12-16T03:26:02.463266+0000","last_peered":"2023-12-16T03:26:02.463266+0000","last_clean":"2023-12-16T03:26:02.463266+0000","last_became_active":"2023-12-16T03:26:02.462089+0000","last_became_peered":"2023-12-16T03:26:02.462089+0000","last_unstale":"2023-12-16T03:26:02.463266+0000","last_undegraded":"2023-12-16T03:26:02.463266+0000","last_fullsized":"2023-12-16T03:26:02.463266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452938+0000","last_change":"2023-12-16T03:26:02.452938+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452938+0000","last_undegraded":"2023-12-16T03:26:02.452938+0000","last_fullsized":"2023-12-16T03:26:02.452938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477418+0000","last_change":"2023-12-16T03:26:02.474673+0000","last_active":"2023-12-16T03:26:02.477418+0000","last_peered":"2023-12-16T03:26:02.477418+0000","last_clean":"2023-12-16T03:26:02.477418+0000","last_became_active":"2023-12-16T03:26:02.474398+0000","last_became_peered":"2023-12-16T03:26:02.474398+0000","last_unstale":"2023-12-16T03:26:02.477418+0000","last_undegraded":"2023-12-16T03:26:02.477418+0000","last_fullsized":"2023-12-16T03:26:02.477418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453994+0000","last_change":"2023-12-16T03:26:02.453994+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453994+0000","last_undegraded":"2023-12-16T03:26:02.453994+0000","last_fullsized":"2023-12-16T03:26:02.453994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477126+0000","last_change":"2023-12-16T03:26:02.473193+0000","last_active":"2023-12-16T03:26:02.477126+0000","last_peered":"2023-12-16T03:26:02.477126+0000","last_clean":"2023-12-16T03:26:02.477126+0000","last_became_active":"2023-12-16T03:26:02.472836+0000","last_became_peered":"2023-12-16T03:26:02.472836+0000","last_unstale":"2023-12-16T03:26:02.477126+0000","last_undegraded":"2023-12-16T03:26:02.477126+0000","last_fullsized":"2023-12-16T03:26:02.477126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:21:40.835921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453109+0000","last_change":"2023-12-16T03:26:02.453109+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453109+0000","last_undegraded":"2023-12-16T03:26:02.453109+0000","last_fullsized":"2023-12-16T03:26:02.453109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465898+0000","last_change":"2023-12-16T03:26:02.456879+0000","last_active":"2023-12-16T03:26:02.465898+0000","last_peered":"2023-12-16T03:26:02.465898+0000","last_clean":"2023-12-16T03:26:02.465898+0000","last_became_active":"2023-12-16T03:26:02.456571+0000","last_became_peered":"2023-12-16T03:26:02.456571+0000","last_unstale":"2023-12-16T03:26:02.465898+0000","last_undegraded":"2023-12-16T03:26:02.465898+0000","last_fullsized":"2023-12-16T03:26:02.465898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.456757+0000","last_change":"2023-12-16T03:26:02.456757+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.456757+0000","last_undegraded":"2023-12-16T03:26:02.456757+0000","last_fullsized":"2023-12-16T03:26:02.456757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.476026+0000","last_change":"2023-12-16T03:26:02.472212+0000","last_active":"2023-12-16T03:26:02.476026+0000","last_peered":"2023-12-16T03:26:02.476026+0000","last_clean":"2023-12-16T03:26:02.476026+0000","last_became_active":"2023-12-16T03:26:02.471791+0000","last_became_peered":"2023-12-16T03:26:02.471791+0000","last_unstale":"2023-12-16T03:26:02.476026+0000","last_undegraded":"2023-12-16T03:26:02.476026+0000","last_fullsized":"2023-12-16T03:26:02.476026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446607+0000","last_change":"2023-12-16T03:26:02.446607+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446607+0000","last_undegraded":"2023-12-16T03:26:02.446607+0000","last_fullsized":"2023-12-16T03:26:02.446607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477243+0000","last_change":"2023-12-16T03:26:02.476238+0000","last_active":"2023-12-16T03:26:02.477243+0000","last_peered":"2023-12-16T03:26:02.477243+0000","last_clean":"2023-12-16T03:26:02.477243+0000","last_became_active":"2023-12-16T03:26:02.475844+0000","last_became_peered":"2023-12-16T03:26:02.475844+0000","last_unstale":"2023-12-16T03:26:02.477243+0000","last_undegraded":"2023-12-16T03:26:02.477243+0000","last_fullsized":"2023-12-16T03:26:02.477243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:23:51.458474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445987+0000","last_change":"2023-12-16T03:26:02.445987+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445987+0000","last_undegraded":"2023-12-16T03:26:02.445987+0000","last_fullsized":"2023-12-16T03:26:02.445987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474844+0000","last_change":"2023-12-16T03:26:02.465084+0000","last_active":"2023-12-16T03:26:02.474844+0000","last_peered":"2023-12-16T03:26:02.474844+0000","last_clean":"2023-12-16T03:26:02.474844+0000","last_became_active":"2023-12-16T03:26:02.464706+0000","last_became_peered":"2023-12-16T03:26:02.464706+0000","last_unstale":"2023-12-16T03:26:02.474844+0000","last_undegraded":"2023-12-16T03:26:02.474844+0000","last_fullsized":"2023-12-16T03:26:02.474844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.456412+0000","last_change":"2023-12-16T03:26:02.456412+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.456412+0000","last_undegraded":"2023-12-16T03:26:02.456412+0000","last_fullsized":"2023-12-16T03:26:02.456412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.459970+0000","last_change":"2023-12-16T03:26:02.456023+0000","last_active":"2023-12-16T03:26:02.459970+0000","last_peered":"2023-12-16T03:26:02.459970+0000","last_clean":"2023-12-16T03:26:02.459970+0000","last_became_active":"2023-12-16T03:26:02.455703+0000","last_became_peered":"2023-12-16T03:26:02.455703+0000","last_unstale":"2023-12-16T03:26:02.459970+0000","last_undegraded":"2023-12-16T03:26:02.459970+0000","last_fullsized":"2023-12-16T03:26:02.459970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445317+0000","last_change":"2023-12-16T03:26:02.445317+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445317+0000","last_undegraded":"2023-12-16T03:26:02.445317+0000","last_fullsized":"2023-12-16T03:26:02.445317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474463+0000","last_change":"2023-12-16T03:26:02.462695+0000","last_active":"2023-12-16T03:26:02.474463+0000","last_peered":"2023-12-16T03:26:02.474463+0000","last_clean":"2023-12-16T03:26:02.474463+0000","last_became_active":"2023-12-16T03:26:02.461706+0000","last_became_peered":"2023-12-16T03:26:02.461706+0000","last_unstale":"2023-12-16T03:26:02.474463+0000","last_undegraded":"2023-12-16T03:26:02.474463+0000","last_fullsized":"2023-12-16T03:26:02.474463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:03:33.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446457+0000","last_change":"2023-12-16T03:26:02.446457+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446457+0000","last_undegraded":"2023-12-16T03:26:02.446457+0000","last_fullsized":"2023-12-16T03:26:02.446457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465414+0000","last_change":"2023-12-16T03:26:02.459691+0000","last_active":"2023-12-16T03:26:02.465414+0000","last_peered":"2023-12-16T03:26:02.465414+0000","last_clean":"2023-12-16T03:26:02.465414+0000","last_became_active":"2023-12-16T03:26:02.458861+0000","last_became_peered":"2023-12-16T03:26:02.458861+0000","last_unstale":"2023-12-16T03:26:02.465414+0000","last_undegraded":"2023-12-16T03:26:02.465414+0000","last_fullsized":"2023-12-16T03:26:02.465414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:57.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447698+0000","last_change":"2023-12-16T03:26:02.447698+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447698+0000","last_undegraded":"2023-12-16T03:26:02.447698+0000","last_fullsized":"2023-12-16T03:26:02.447698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.470194+0000","last_change":"2023-12-16T03:26:02.468114+0000","last_active":"2023-12-16T03:26:02.470194+0000","last_peered":"2023-12-16T03:26:02.470194+0000","last_clean":"2023-12-16T03:26:02.470194+0000","last_became_active":"2023-12-16T03:26:02.467813+0000","last_became_peered":"2023-12-16T03:26:02.467813+0000","last_unstale":"2023-12-16T03:26:02.470194+0000","last_undegraded":"2023-12-16T03:26:02.470194+0000","last_fullsized":"2023-12-16T03:26:02.470194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:33.098551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452445+0000","last_change":"2023-12-16T03:26:02.452445+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452445+0000","last_undegraded":"2023-12-16T03:26:02.452445+0000","last_fullsized":"2023-12-16T03:26:02.452445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473697+0000","last_change":"2023-12-16T03:26:02.467483+0000","last_active":"2023-12-16T03:26:02.473697+0000","last_peered":"2023-12-16T03:26:02.473697+0000","last_clean":"2023-12-16T03:26:02.473697+0000","last_became_active":"2023-12-16T03:26:02.467186+0000","last_became_peered":"2023-12-16T03:26:02.467186+0000","last_unstale":"2023-12-16T03:26:02.473697+0000","last_undegraded":"2023-12-16T03:26:02.473697+0000","last_fullsized":"2023-12-16T03:26:02.473697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-16T03:26:01.437045+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:26:01.437045+0000","last_peered":"2023-12-16T03:26:01.437045+0000","last_clean":"2023-12-16T03:26:01.437045+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:26:01.437045+0000","last_undegraded":"2023-12-16T03:26:01.437045+0000","last_fullsized":"2023-12-16T03:26:01.437045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":710443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":710443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:26:07.577 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:26:07.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.750+0000 7f23b9584640 1 Processor -- start 2023-12-16T03:26:07.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.750+0000 7f23b9584640 1 -- start start 2023-12-16T03:26:07.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.750+0000 7f23b9584640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c7ed0 0x7f23b40c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.750+0000 7f23b9584640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f23b40c4bb0 0x7f23b406c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.750+0000 7f23b9584640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b4151ff0 con 0x7f23b40c4730 2023-12-16T03:26:07.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.750+0000 7f23b9584640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b406c600 con 0x7f23b40c4bb0 2023-12-16T03:26:07.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.750+0000 7f23b9584640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b4155160 con 0x7f23b40c7ed0 2023-12-16T03:26:07.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.750+0000 7f23b8d83640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f23b40c4bb0 0x7f23b406c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.750+0000 7f23b3fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c7ed0 0x7f23b40c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b8d83640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f23b40c4bb0 0x7f23b406c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:48550/0 (socket says 172.21.15.28:48550) 2023-12-16T03:26:07.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b3fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c7ed0 0x7f23b40c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:35070/0 (socket says 172.21.15.28:35070) 2023-12-16T03:26:07.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b8d83640 1 -- 172.21.15.28:0/1574137863 learned_addr learned my addr 172.21.15.28:0/1574137863 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:07.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b37fe640 1 --1- 172.21.15.28:0/1574137863 >> v1:172.21.15.134:6789/0 conn(0x7f23b40c4730 0x7f23b406b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:40858/0 (socket says 172.21.15.28:40858) 2023-12-16T03:26:07.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b3fff640 1 -- 172.21.15.28:0/1574137863 >> v2:172.21.15.134:3300/0 conn(0x7f23b40c4bb0 msgr2=0x7f23b406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:07.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b3fff640 1 --2- 172.21.15.28:0/1574137863 >> v2:172.21.15.134:3300/0 conn(0x7f23b40c4bb0 0x7f23b406c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b3fff640 1 -- 172.21.15.28:0/1574137863 >> v1:172.21.15.134:6789/0 conn(0x7f23b40c4730 legacy=0x7f23b406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b3fff640 1 -- 172.21.15.28:0/1574137863 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b40c5040 con 0x7f23b40c7ed0 2023-12-16T03:26:07.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b8d83640 1 --2- 172.21.15.28:0/1574137863 >> v2:172.21.15.134:3300/0 conn(0x7f23b40c4bb0 0x7f23b406c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:07.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b3fff640 1 --2- 172.21.15.28:0/1574137863 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c7ed0 0x7f23b40c82b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23a40097c0 tx=0x7f23a401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31c273ab6366e86a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:07.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b2ffd640 1 -- 172.21.15.28:0/1574137863 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a40ab610 con 0x7f23b40c7ed0 2023-12-16T03:26:07.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b2ffd640 1 -- 172.21.15.28:0/1574137863 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a40ab770 con 0x7f23b40c7ed0 2023-12-16T03:26:07.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.754+0000 7f23b2ffd640 1 -- 172.21.15.28:0/1574137863 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a40abb00 con 0x7f23b40c7ed0 2023-12-16T03:26:07.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 -- 172.21.15.28:0/1574137863 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c7ed0 msgr2=0x7f23b40c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 --2- 172.21.15.28:0/1574137863 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c7ed0 0x7f23b40c82b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23a40097c0 tx=0x7f23a401c3f0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 -- 172.21.15.28:0/1574137863 shutdown_connections 2023-12-16T03:26:07.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 --2- 172.21.15.28:0/1574137863 >> v2:172.21.15.134:3300/0 conn(0x7f23b40c4bb0 0x7f23b406c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 --2- 172.21.15.28:0/1574137863 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c7ed0 0x7f23b40c82b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 -- 172.21.15.28:0/1574137863 >> 172.21.15.28:0/1574137863 conn(0x7f23b40ab940 msgr2=0x7f23b40abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:07.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 -- 172.21.15.28:0/1574137863 shutdown_connections 2023-12-16T03:26:07.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 -- 172.21.15.28:0/1574137863 wait complete. 2023-12-16T03:26:07.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 Processor -- start 2023-12-16T03:26:07.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 -- start start 2023-12-16T03:26:07.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23b40c4730 0x7f23b41f05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c4bb0 0x7f23b40ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23b40c7ed0 0x7f23b40addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b4157c90 con 0x7f23b40c7ed0 2023-12-16T03:26:07.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b41f10b0 con 0x7f23b40c4730 2023-12-16T03:26:07.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b9584640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b40aec50 con 0x7f23b40c4bb0 2023-12-16T03:26:07.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b8d83640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23b40c7ed0 0x7f23b40addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b8d83640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23b40c7ed0 0x7f23b40addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49452/0 (socket says 172.21.15.28:49452) 2023-12-16T03:26:07.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b8d83640 1 -- 172.21.15.28:0/3378081034 learned_addr learned my addr 172.21.15.28:0/3378081034 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:07.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b3fff640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23b40c4730 0x7f23b41f05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b37fe640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c4bb0 0x7f23b40ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b8d83640 1 -- 172.21.15.28:0/3378081034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c4bb0 msgr2=0x7f23b40ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b8d83640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c4bb0 0x7f23b40ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b8d83640 1 -- 172.21.15.28:0/3378081034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23b40c4730 msgr2=0x7f23b41f05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b8d83640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23b40c4730 0x7f23b41f05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.758+0000 7f23b8d83640 1 -- 172.21.15.28:0/3378081034 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac009b30 con 0x7f23b40c7ed0 2023-12-16T03:26:07.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.762+0000 7f23b8d83640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23b40c7ed0 0x7f23b40addf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00efc0 tx=0x7f23ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:07.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.762+0000 7f23b0ff9640 1 -- 172.21.15.28:0/3378081034 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac018070 con 0x7f23b40c7ed0 2023-12-16T03:26:07.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.762+0000 7f23b0ff9640 1 -- 172.21.15.28:0/3378081034 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac00f040 con 0x7f23b40c7ed0 2023-12-16T03:26:07.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.762+0000 7f23b0ff9640 1 -- 172.21.15.28:0/3378081034 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac00ce00 con 0x7f23b40c7ed0 2023-12-16T03:26:07.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.762+0000 7f23b9584640 1 -- 172.21.15.28:0/3378081034 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a4009420 con 0x7f23b40c7ed0 2023-12-16T03:26:07.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.762+0000 7f23b9584640 1 -- 172.21.15.28:0/3378081034 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b40af210 con 0x7f23b40c7ed0 2023-12-16T03:26:07.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.762+0000 7f23b9584640 1 -- 172.21.15.28:0/3378081034 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b404e850 con 0x7f23b40c7ed0 2023-12-16T03:26:07.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.762+0000 7f23b0ff9640 1 -- 172.21.15.28:0/3378081034 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f23ac014480 con 0x7f23b40c7ed0 2023-12-16T03:26:07.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.762+0000 7f23b0ff9640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23a00664a0 0x7f23a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:07.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.762+0000 7f23b0ff9640 1 -- 172.21.15.28:0/3378081034 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23ac083ff0 con 0x7f23b40c7ed0 2023-12-16T03:26:07.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.762+0000 7f23b3fff640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23a00664a0 0x7f23a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:07.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.766+0000 7f23b3fff640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23a00664a0 0x7f23a0068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f23a40af000 tx=0x7f23a40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:07.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.766+0000 7f23b0ff9640 1 -- 172.21.15.28:0/3378081034 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f23ac051590 con 0x7f23b40c7ed0 2023-12-16T03:26:07.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.922+0000 7f23b9584640 1 -- 172.21.15.28:0/3378081034 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23b4154df0 con 0x7f23a00664a0 2023-12-16T03:26:07.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.930+0000 7f23b0ff9640 1 -- 172.21.15.28:0/3378081034 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259388 (secure 0 0 0) 0x7f23a4006e20 con 0x7f23a00664a0 2023-12-16T03:26:07.937 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:07.939 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:26:07.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 -- 172.21.15.28:0/3378081034 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23a00664a0 msgr2=0x7f23a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23a00664a0 0x7f23a0068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f23a40af000 tx=0x7f23a40a7000 comp rx=0 tx=0).stop 2023-12-16T03:26:07.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 -- 172.21.15.28:0/3378081034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23b40c7ed0 msgr2=0x7f23b40addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:07.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23b40c7ed0 0x7f23b40addf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00efc0 tx=0x7f23ac00c490 comp rx=0 tx=0).stop 2023-12-16T03:26:07.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 -- 172.21.15.28:0/3378081034 shutdown_connections 2023-12-16T03:26:07.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23a00664a0 0x7f23a0068960 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23b40c7ed0 0x7f23b40addf0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23b40c4bb0 0x7f23b40ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 --2- 172.21.15.28:0/3378081034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23b40c4730 0x7f23b41f05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 -- 172.21.15.28:0/3378081034 >> 172.21.15.28:0/3378081034 conn(0x7f23b40ab940 msgr2=0x7f23b40abd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 -- 172.21.15.28:0/3378081034 shutdown_connections 2023-12-16T03:26:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:07.934+0000 7f23b9584640 1 -- 172.21.15.28:0/3378081034 wait complete. 2023-12-16T03:26:07.958 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-12-16T03:26:07.808839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236520,"kb_used_data":3712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738200,"statfs":{"total":773094113280,"available":772851916800,"internally_reserved":0,"allocated":3801088,"data_stored":2153870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001040"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455072+0000","last_change":"2023-12-16T03:26:02.455072+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455072+0000","last_undegraded":"2023-12-16T03:26:02.455072+0000","last_fullsized":"2023-12-16T03:26:02.455072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455099+0000","last_change":"2023-12-16T03:26:02.455099+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455099+0000","last_undegraded":"2023-12-16T03:26:02.455099+0000","last_fullsized":"2023-12-16T03:26:02.455099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445002+0000","last_change":"2023-12-16T03:26:02.445002+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445002+0000","last_undegraded":"2023-12-16T03:26:02.445002+0000","last_fullsized":"2023-12-16T03:26:02.445002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450723+0000","last_change":"2023-12-16T03:26:02.450723+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450723+0000","last_undegraded":"2023-12-16T03:26:02.450723+0000","last_fullsized":"2023-12-16T03:26:02.450723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455291+0000","last_change":"2023-12-16T03:26:02.455291+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455291+0000","last_undegraded":"2023-12-16T03:26:02.455291+0000","last_fullsized":"2023-12-16T03:26:02.455291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451114+0000","last_change":"2023-12-16T03:26:02.451114+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451114+0000","last_undegraded":"2023-12-16T03:26:02.451114+0000","last_fullsized":"2023-12-16T03:26:02.451114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452611+0000","last_change":"2023-12-16T03:26:02.452611+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452611+0000","last_undegraded":"2023-12-16T03:26:02.452611+0000","last_fullsized":"2023-12-16T03:26:02.452611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455580+0000","last_change":"2023-12-16T03:26:02.455580+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455580+0000","last_undegraded":"2023-12-16T03:26:02.455580+0000","last_fullsized":"2023-12-16T03:26:02.455580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449887+0000","last_change":"2023-12-16T03:26:02.449887+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449887+0000","last_undegraded":"2023-12-16T03:26:02.449887+0000","last_fullsized":"2023-12-16T03:26:02.449887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.464569+0000","last_change":"2023-12-16T03:26:02.464569+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.464569+0000","last_undegraded":"2023-12-16T03:26:02.464569+0000","last_fullsized":"2023-12-16T03:26:02.464569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454609+0000","last_change":"2023-12-16T03:26:02.454609+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454609+0000","last_undegraded":"2023-12-16T03:26:02.454609+0000","last_fullsized":"2023-12-16T03:26:02.454609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445786+0000","last_change":"2023-12-16T03:26:02.445786+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445786+0000","last_undegraded":"2023-12-16T03:26:02.445786+0000","last_fullsized":"2023-12-16T03:26:02.445786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454699+0000","last_change":"2023-12-16T03:26:02.454699+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454699+0000","last_undegraded":"2023-12-16T03:26:02.454699+0000","last_fullsized":"2023-12-16T03:26:02.454699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450561+0000","last_change":"2023-12-16T03:26:02.450561+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450561+0000","last_undegraded":"2023-12-16T03:26:02.450561+0000","last_fullsized":"2023-12-16T03:26:02.450561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444964+0000","last_change":"2023-12-16T03:26:02.444964+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444964+0000","last_undegraded":"2023-12-16T03:26:02.444964+0000","last_fullsized":"2023-12-16T03:26:02.444964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450772+0000","last_change":"2023-12-16T03:26:02.450772+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450772+0000","last_undegraded":"2023-12-16T03:26:02.450772+0000","last_fullsized":"2023-12-16T03:26:02.450772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453842+0000","last_change":"2023-12-16T03:26:02.453842+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453842+0000","last_undegraded":"2023-12-16T03:26:02.453842+0000","last_fullsized":"2023-12-16T03:26:02.453842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451495+0000","last_change":"2023-12-16T03:26:02.451495+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451495+0000","last_undegraded":"2023-12-16T03:26:02.451495+0000","last_fullsized":"2023-12-16T03:26:02.451495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453743+0000","last_change":"2023-12-16T03:26:02.453743+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453743+0000","last_undegraded":"2023-12-16T03:26:02.453743+0000","last_fullsized":"2023-12-16T03:26:02.453743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.457767+0000","last_change":"2023-12-16T03:26:02.457767+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.457767+0000","last_undegraded":"2023-12-16T03:26:02.457767+0000","last_fullsized":"2023-12-16T03:26:02.457767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448732+0000","last_change":"2023-12-16T03:26:02.448732+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448732+0000","last_undegraded":"2023-12-16T03:26:02.448732+0000","last_fullsized":"2023-12-16T03:26:02.448732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448834+0000","last_change":"2023-12-16T03:26:02.448834+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448834+0000","last_undegraded":"2023-12-16T03:26:02.448834+0000","last_fullsized":"2023-12-16T03:26:02.448834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447166+0000","last_change":"2023-12-16T03:26:02.447166+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447166+0000","last_undegraded":"2023-12-16T03:26:02.447166+0000","last_fullsized":"2023-12-16T03:26:02.447166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444970+0000","last_change":"2023-12-16T03:26:02.444970+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444970+0000","last_undegraded":"2023-12-16T03:26:02.444970+0000","last_fullsized":"2023-12-16T03:26:02.444970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.463174+0000","last_change":"2023-12-16T03:26:02.463174+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.463174+0000","last_undegraded":"2023-12-16T03:26:02.463174+0000","last_fullsized":"2023-12-16T03:26:02.463174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451052+0000","last_change":"2023-12-16T03:26:02.451052+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451052+0000","last_undegraded":"2023-12-16T03:26:02.451052+0000","last_fullsized":"2023-12-16T03:26:02.451052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.460874+0000","last_change":"2023-12-16T03:26:02.460874+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.460874+0000","last_undegraded":"2023-12-16T03:26:02.460874+0000","last_fullsized":"2023-12-16T03:26:02.460874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445333+0000","last_change":"2023-12-16T03:26:02.445333+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445333+0000","last_undegraded":"2023-12-16T03:26:02.445333+0000","last_fullsized":"2023-12-16T03:26:02.445333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448106+0000","last_change":"2023-12-16T03:26:02.448106+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448106+0000","last_undegraded":"2023-12-16T03:26:02.448106+0000","last_fullsized":"2023-12-16T03:26:02.448106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451895+0000","last_change":"2023-12-16T03:26:02.451895+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451895+0000","last_undegraded":"2023-12-16T03:26:02.451895+0000","last_fullsized":"2023-12-16T03:26:02.451895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452514+0000","last_change":"2023-12-16T03:26:02.452514+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452514+0000","last_undegraded":"2023-12-16T03:26:02.452514+0000","last_fullsized":"2023-12-16T03:26:02.452514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454851+0000","last_change":"2023-12-16T03:26:02.454851+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454851+0000","last_undegraded":"2023-12-16T03:26:02.454851+0000","last_fullsized":"2023-12-16T03:26:02.454851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446356+0000","last_change":"2023-12-16T03:26:02.446356+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446356+0000","last_undegraded":"2023-12-16T03:26:02.446356+0000","last_fullsized":"2023-12-16T03:26:02.446356+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473417+0000","last_change":"2023-12-16T03:26:02.466777+0000","last_active":"2023-12-16T03:26:02.473417+0000","last_peered":"2023-12-16T03:26:02.473417+0000","last_clean":"2023-12-16T03:26:02.473417+0000","last_became_active":"2023-12-16T03:26:02.466486+0000","last_became_peered":"2023-12-16T03:26:02.466486+0000","last_unstale":"2023-12-16T03:26:02.473417+0000","last_undegraded":"2023-12-16T03:26:02.473417+0000","last_fullsized":"2023-12-16T03:26:02.473417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454034+0000","last_change":"2023-12-16T03:26:02.454034+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454034+0000","last_undegraded":"2023-12-16T03:26:02.454034+0000","last_fullsized":"2023-12-16T03:26:02.454034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465472+0000","last_change":"2023-12-16T03:26:02.464156+0000","last_active":"2023-12-16T03:26:02.465472+0000","last_peered":"2023-12-16T03:26:02.465472+0000","last_clean":"2023-12-16T03:26:02.465472+0000","last_became_active":"2023-12-16T03:26:02.463875+0000","last_became_peered":"2023-12-16T03:26:02.463875+0000","last_unstale":"2023-12-16T03:26:02.465472+0000","last_undegraded":"2023-12-16T03:26:02.465472+0000","last_fullsized":"2023-12-16T03:26:02.465472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447295+0000","last_change":"2023-12-16T03:26:02.447295+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447295+0000","last_undegraded":"2023-12-16T03:26:02.447295+0000","last_fullsized":"2023-12-16T03:26:02.447295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.478635+0000","last_change":"2023-12-16T03:26:02.475790+0000","last_active":"2023-12-16T03:26:02.478635+0000","last_peered":"2023-12-16T03:26:02.478635+0000","last_clean":"2023-12-16T03:26:02.478635+0000","last_became_active":"2023-12-16T03:26:02.475486+0000","last_became_peered":"2023-12-16T03:26:02.475486+0000","last_unstale":"2023-12-16T03:26:02.478635+0000","last_undegraded":"2023-12-16T03:26:02.478635+0000","last_fullsized":"2023-12-16T03:26:02.478635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449229+0000","last_change":"2023-12-16T03:26:02.449229+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449229+0000","last_undegraded":"2023-12-16T03:26:02.449229+0000","last_fullsized":"2023-12-16T03:26:02.449229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.476059+0000","last_change":"2023-12-16T03:26:02.473812+0000","last_active":"2023-12-16T03:26:02.476059+0000","last_peered":"2023-12-16T03:26:02.476059+0000","last_clean":"2023-12-16T03:26:02.476059+0000","last_became_active":"2023-12-16T03:26:02.473426+0000","last_became_peered":"2023-12-16T03:26:02.473426+0000","last_unstale":"2023-12-16T03:26:02.476059+0000","last_undegraded":"2023-12-16T03:26:02.476059+0000","last_fullsized":"2023-12-16T03:26:02.476059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:48.463304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451342+0000","last_change":"2023-12-16T03:26:02.451342+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451342+0000","last_undegraded":"2023-12-16T03:26:02.451342+0000","last_fullsized":"2023-12-16T03:26:02.451342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475157+0000","last_change":"2023-12-16T03:26:02.469331+0000","last_active":"2023-12-16T03:26:02.475157+0000","last_peered":"2023-12-16T03:26:02.475157+0000","last_clean":"2023-12-16T03:26:02.475157+0000","last_became_active":"2023-12-16T03:26:02.469083+0000","last_became_peered":"2023-12-16T03:26:02.469083+0000","last_unstale":"2023-12-16T03:26:02.475157+0000","last_undegraded":"2023-12-16T03:26:02.475157+0000","last_fullsized":"2023-12-16T03:26:02.475157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:15.539658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446350+0000","last_change":"2023-12-16T03:26:02.446350+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446350+0000","last_undegraded":"2023-12-16T03:26:02.446350+0000","last_fullsized":"2023-12-16T03:26:02.446350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475188+0000","last_change":"2023-12-16T03:26:02.472832+0000","last_active":"2023-12-16T03:26:02.475188+0000","last_peered":"2023-12-16T03:26:02.475188+0000","last_clean":"2023-12-16T03:26:02.475188+0000","last_became_active":"2023-12-16T03:26:02.472574+0000","last_became_peered":"2023-12-16T03:26:02.472574+0000","last_unstale":"2023-12-16T03:26:02.475188+0000","last_undegraded":"2023-12-16T03:26:02.475188+0000","last_fullsized":"2023-12-16T03:26:02.475188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.446606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447222+0000","last_change":"2023-12-16T03:26:02.447222+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447222+0000","last_undegraded":"2023-12-16T03:26:02.447222+0000","last_fullsized":"2023-12-16T03:26:02.447222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.471594+0000","last_change":"2023-12-16T03:26:02.467098+0000","last_active":"2023-12-16T03:26:02.471594+0000","last_peered":"2023-12-16T03:26:02.471594+0000","last_clean":"2023-12-16T03:26:02.471594+0000","last_became_active":"2023-12-16T03:26:02.464042+0000","last_became_peered":"2023-12-16T03:26:02.464042+0000","last_unstale":"2023-12-16T03:26:02.471594+0000","last_undegraded":"2023-12-16T03:26:02.471594+0000","last_fullsized":"2023-12-16T03:26:02.471594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:23:51.458474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448410+0000","last_change":"2023-12-16T03:26:02.448410+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448410+0000","last_undegraded":"2023-12-16T03:26:02.448410+0000","last_fullsized":"2023-12-16T03:26:02.448410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473421+0000","last_change":"2023-12-16T03:26:02.465231+0000","last_active":"2023-12-16T03:26:02.473421+0000","last_peered":"2023-12-16T03:26:02.473421+0000","last_clean":"2023-12-16T03:26:02.473421+0000","last_became_active":"2023-12-16T03:26:02.464573+0000","last_became_peered":"2023-12-16T03:26:02.464573+0000","last_unstale":"2023-12-16T03:26:02.473421+0000","last_undegraded":"2023-12-16T03:26:02.473421+0000","last_fullsized":"2023-12-16T03:26:02.473421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:44:36.877503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444993+0000","last_change":"2023-12-16T03:26:02.444993+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444993+0000","last_undegraded":"2023-12-16T03:26:02.444993+0000","last_fullsized":"2023-12-16T03:26:02.444993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.470229+0000","last_change":"2023-12-16T03:26:02.468514+0000","last_active":"2023-12-16T03:26:02.470229+0000","last_peered":"2023-12-16T03:26:02.470229+0000","last_clean":"2023-12-16T03:26:02.470229+0000","last_became_active":"2023-12-16T03:26:02.467879+0000","last_became_peered":"2023-12-16T03:26:02.467879+0000","last_unstale":"2023-12-16T03:26:02.470229+0000","last_undegraded":"2023-12-16T03:26:02.470229+0000","last_fullsized":"2023-12-16T03:26:02.470229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:19.149617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453258+0000","last_change":"2023-12-16T03:26:02.453258+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453258+0000","last_undegraded":"2023-12-16T03:26:02.453258+0000","last_fullsized":"2023-12-16T03:26:02.453258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.452298+0000","last_change":"2023-12-16T03:26:02.449876+0000","last_active":"2023-12-16T03:26:02.452298+0000","last_peered":"2023-12-16T03:26:02.452298+0000","last_clean":"2023-12-16T03:26:02.452298+0000","last_became_active":"2023-12-16T03:26:02.449358+0000","last_became_peered":"2023-12-16T03:26:02.449358+0000","last_unstale":"2023-12-16T03:26:02.452298+0000","last_undegraded":"2023-12-16T03:26:02.452298+0000","last_fullsized":"2023-12-16T03:26:02.452298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450370+0000","last_change":"2023-12-16T03:26:02.450370+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450370+0000","last_undegraded":"2023-12-16T03:26:02.450370+0000","last_fullsized":"2023-12-16T03:26:02.450370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.466050+0000","last_change":"2023-12-16T03:26:02.461467+0000","last_active":"2023-12-16T03:26:02.466050+0000","last_peered":"2023-12-16T03:26:02.466050+0000","last_clean":"2023-12-16T03:26:02.466050+0000","last_became_active":"2023-12-16T03:26:02.461144+0000","last_became_peered":"2023-12-16T03:26:02.461144+0000","last_unstale":"2023-12-16T03:26:02.466050+0000","last_undegraded":"2023-12-16T03:26:02.466050+0000","last_fullsized":"2023-12-16T03:26:02.466050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448074+0000","last_change":"2023-12-16T03:26:02.448074+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448074+0000","last_undegraded":"2023-12-16T03:26:02.448074+0000","last_fullsized":"2023-12-16T03:26:02.448074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477932+0000","last_change":"2023-12-16T03:26:02.474073+0000","last_active":"2023-12-16T03:26:02.477932+0000","last_peered":"2023-12-16T03:26:02.477932+0000","last_clean":"2023-12-16T03:26:02.477932+0000","last_became_active":"2023-12-16T03:26:02.473771+0000","last_became_peered":"2023-12-16T03:26:02.473771+0000","last_unstale":"2023-12-16T03:26:02.477932+0000","last_undegraded":"2023-12-16T03:26:02.477932+0000","last_fullsized":"2023-12-16T03:26:02.477932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:51:41.152969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450511+0000","last_change":"2023-12-16T03:26:02.450511+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450511+0000","last_undegraded":"2023-12-16T03:26:02.450511+0000","last_fullsized":"2023-12-16T03:26:02.450511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.467941+0000","last_change":"2023-12-16T03:26:02.464973+0000","last_active":"2023-12-16T03:26:02.467941+0000","last_peered":"2023-12-16T03:26:02.467941+0000","last_clean":"2023-12-16T03:26:02.467941+0000","last_became_active":"2023-12-16T03:26:02.464672+0000","last_became_peered":"2023-12-16T03:26:02.464672+0000","last_unstale":"2023-12-16T03:26:02.467941+0000","last_undegraded":"2023-12-16T03:26:02.467941+0000","last_fullsized":"2023-12-16T03:26:02.467941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:45.759262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448256+0000","last_change":"2023-12-16T03:26:02.448256+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448256+0000","last_undegraded":"2023-12-16T03:26:02.448256+0000","last_fullsized":"2023-12-16T03:26:02.448256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475711+0000","last_change":"2023-12-16T03:26:02.465815+0000","last_active":"2023-12-16T03:26:02.475711+0000","last_peered":"2023-12-16T03:26:02.475711+0000","last_clean":"2023-12-16T03:26:02.475711+0000","last_became_active":"2023-12-16T03:26:02.465505+0000","last_became_peered":"2023-12-16T03:26:02.465505+0000","last_unstale":"2023-12-16T03:26:02.475711+0000","last_undegraded":"2023-12-16T03:26:02.475711+0000","last_fullsized":"2023-12-16T03:26:02.475711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452661+0000","last_change":"2023-12-16T03:26:02.452661+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452661+0000","last_undegraded":"2023-12-16T03:26:02.452661+0000","last_fullsized":"2023-12-16T03:26:02.452661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474177+0000","last_change":"2023-12-16T03:26:02.471444+0000","last_active":"2023-12-16T03:26:02.474177+0000","last_peered":"2023-12-16T03:26:02.474177+0000","last_clean":"2023-12-16T03:26:02.474177+0000","last_became_active":"2023-12-16T03:26:02.468577+0000","last_became_peered":"2023-12-16T03:26:02.468577+0000","last_unstale":"2023-12-16T03:26:02.474177+0000","last_undegraded":"2023-12-16T03:26:02.474177+0000","last_fullsized":"2023-12-16T03:26:02.474177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451895+0000","last_change":"2023-12-16T03:26:02.451895+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451895+0000","last_undegraded":"2023-12-16T03:26:02.451895+0000","last_fullsized":"2023-12-16T03:26:02.451895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.478029+0000","last_change":"2023-12-16T03:26:02.475063+0000","last_active":"2023-12-16T03:26:02.478029+0000","last_peered":"2023-12-16T03:26:02.478029+0000","last_clean":"2023-12-16T03:26:02.478029+0000","last_became_active":"2023-12-16T03:26:02.474759+0000","last_became_peered":"2023-12-16T03:26:02.474759+0000","last_unstale":"2023-12-16T03:26:02.478029+0000","last_undegraded":"2023-12-16T03:26:02.478029+0000","last_fullsized":"2023-12-16T03:26:02.478029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:47.788469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449444+0000","last_change":"2023-12-16T03:26:02.449444+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449444+0000","last_undegraded":"2023-12-16T03:26:02.449444+0000","last_fullsized":"2023-12-16T03:26:02.449444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477863+0000","last_change":"2023-12-16T03:26:02.473227+0000","last_active":"2023-12-16T03:26:02.477863+0000","last_peered":"2023-12-16T03:26:02.477863+0000","last_clean":"2023-12-16T03:26:02.477863+0000","last_became_active":"2023-12-16T03:26:02.472888+0000","last_became_peered":"2023-12-16T03:26:02.472888+0000","last_unstale":"2023-12-16T03:26:02.477863+0000","last_undegraded":"2023-12-16T03:26:02.477863+0000","last_fullsized":"2023-12-16T03:26:02.477863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447130+0000","last_change":"2023-12-16T03:26:02.447130+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447130+0000","last_undegraded":"2023-12-16T03:26:02.447130+0000","last_fullsized":"2023-12-16T03:26:02.447130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473449+0000","last_change":"2023-12-16T03:26:02.465496+0000","last_active":"2023-12-16T03:26:02.473449+0000","last_peered":"2023-12-16T03:26:02.473449+0000","last_clean":"2023-12-16T03:26:02.473449+0000","last_became_active":"2023-12-16T03:26:02.465106+0000","last_became_peered":"2023-12-16T03:26:02.465106+0000","last_unstale":"2023-12-16T03:26:02.473449+0000","last_undegraded":"2023-12-16T03:26:02.473449+0000","last_fullsized":"2023-12-16T03:26:02.473449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:46.860441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450023+0000","last_change":"2023-12-16T03:26:02.450023+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450023+0000","last_undegraded":"2023-12-16T03:26:02.450023+0000","last_fullsized":"2023-12-16T03:26:02.450023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.467979+0000","last_change":"2023-12-16T03:26:02.462818+0000","last_active":"2023-12-16T03:26:02.467979+0000","last_peered":"2023-12-16T03:26:02.467979+0000","last_clean":"2023-12-16T03:26:02.467979+0000","last_became_active":"2023-12-16T03:26:02.462408+0000","last_became_peered":"2023-12-16T03:26:02.462408+0000","last_unstale":"2023-12-16T03:26:02.467979+0000","last_undegraded":"2023-12-16T03:26:02.467979+0000","last_fullsized":"2023-12-16T03:26:02.467979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:54.350741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.461211+0000","last_change":"2023-12-16T03:26:02.461211+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.461211+0000","last_undegraded":"2023-12-16T03:26:02.461211+0000","last_fullsized":"2023-12-16T03:26:02.461211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475131+0000","last_change":"2023-12-16T03:26:02.468837+0000","last_active":"2023-12-16T03:26:02.475131+0000","last_peered":"2023-12-16T03:26:02.475131+0000","last_clean":"2023-12-16T03:26:02.475131+0000","last_became_active":"2023-12-16T03:26:02.468492+0000","last_became_peered":"2023-12-16T03:26:02.468492+0000","last_unstale":"2023-12-16T03:26:02.475131+0000","last_undegraded":"2023-12-16T03:26:02.475131+0000","last_fullsized":"2023-12-16T03:26:02.475131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:48.463304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452995+0000","last_change":"2023-12-16T03:26:02.452995+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452995+0000","last_undegraded":"2023-12-16T03:26:02.452995+0000","last_fullsized":"2023-12-16T03:26:02.452995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.463266+0000","last_change":"2023-12-16T03:26:02.462344+0000","last_active":"2023-12-16T03:26:02.463266+0000","last_peered":"2023-12-16T03:26:02.463266+0000","last_clean":"2023-12-16T03:26:02.463266+0000","last_became_active":"2023-12-16T03:26:02.462089+0000","last_became_peered":"2023-12-16T03:26:02.462089+0000","last_unstale":"2023-12-16T03:26:02.463266+0000","last_undegraded":"2023-12-16T03:26:02.463266+0000","last_fullsized":"2023-12-16T03:26:02.463266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452938+0000","last_change":"2023-12-16T03:26:02.452938+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452938+0000","last_undegraded":"2023-12-16T03:26:02.452938+0000","last_fullsized":"2023-12-16T03:26:02.452938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477418+0000","last_change":"2023-12-16T03:26:02.474673+0000","last_active":"2023-12-16T03:26:02.477418+0000","last_peered":"2023-12-16T03:26:02.477418+0000","last_clean":"2023-12-16T03:26:02.477418+0000","last_became_active":"2023-12-16T03:26:02.474398+0000","last_became_peered":"2023-12-16T03:26:02.474398+0000","last_unstale":"2023-12-16T03:26:02.477418+0000","last_undegraded":"2023-12-16T03:26:02.477418+0000","last_fullsized":"2023-12-16T03:26:02.477418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453994+0000","last_change":"2023-12-16T03:26:02.453994+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453994+0000","last_undegraded":"2023-12-16T03:26:02.453994+0000","last_fullsized":"2023-12-16T03:26:02.453994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477126+0000","last_change":"2023-12-16T03:26:02.473193+0000","last_active":"2023-12-16T03:26:02.477126+0000","last_peered":"2023-12-16T03:26:02.477126+0000","last_clean":"2023-12-16T03:26:02.477126+0000","last_became_active":"2023-12-16T03:26:02.472836+0000","last_became_peered":"2023-12-16T03:26:02.472836+0000","last_unstale":"2023-12-16T03:26:02.477126+0000","last_undegraded":"2023-12-16T03:26:02.477126+0000","last_fullsized":"2023-12-16T03:26:02.477126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:21:40.835921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453109+0000","last_change":"2023-12-16T03:26:02.453109+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453109+0000","last_undegraded":"2023-12-16T03:26:02.453109+0000","last_fullsized":"2023-12-16T03:26:02.453109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465898+0000","last_change":"2023-12-16T03:26:02.456879+0000","last_active":"2023-12-16T03:26:02.465898+0000","last_peered":"2023-12-16T03:26:02.465898+0000","last_clean":"2023-12-16T03:26:02.465898+0000","last_became_active":"2023-12-16T03:26:02.456571+0000","last_became_peered":"2023-12-16T03:26:02.456571+0000","last_unstale":"2023-12-16T03:26:02.465898+0000","last_undegraded":"2023-12-16T03:26:02.465898+0000","last_fullsized":"2023-12-16T03:26:02.465898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.456757+0000","last_change":"2023-12-16T03:26:02.456757+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.456757+0000","last_undegraded":"2023-12-16T03:26:02.456757+0000","last_fullsized":"2023-12-16T03:26:02.456757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.476026+0000","last_change":"2023-12-16T03:26:02.472212+0000","last_active":"2023-12-16T03:26:02.476026+0000","last_peered":"2023-12-16T03:26:02.476026+0000","last_clean":"2023-12-16T03:26:02.476026+0000","last_became_active":"2023-12-16T03:26:02.471791+0000","last_became_peered":"2023-12-16T03:26:02.471791+0000","last_unstale":"2023-12-16T03:26:02.476026+0000","last_undegraded":"2023-12-16T03:26:02.476026+0000","last_fullsized":"2023-12-16T03:26:02.476026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446607+0000","last_change":"2023-12-16T03:26:02.446607+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446607+0000","last_undegraded":"2023-12-16T03:26:02.446607+0000","last_fullsized":"2023-12-16T03:26:02.446607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477243+0000","last_change":"2023-12-16T03:26:02.476238+0000","last_active":"2023-12-16T03:26:02.477243+0000","last_peered":"2023-12-16T03:26:02.477243+0000","last_clean":"2023-12-16T03:26:02.477243+0000","last_became_active":"2023-12-16T03:26:02.475844+0000","last_became_peered":"2023-12-16T03:26:02.475844+0000","last_unstale":"2023-12-16T03:26:02.477243+0000","last_undegraded":"2023-12-16T03:26:02.477243+0000","last_fullsized":"2023-12-16T03:26:02.477243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:23:51.458474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445987+0000","last_change":"2023-12-16T03:26:02.445987+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445987+0000","last_undegraded":"2023-12-16T03:26:02.445987+0000","last_fullsized":"2023-12-16T03:26:02.445987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474844+0000","last_change":"2023-12-16T03:26:02.465084+0000","last_active":"2023-12-16T03:26:02.474844+0000","last_peered":"2023-12-16T03:26:02.474844+0000","last_clean":"2023-12-16T03:26:02.474844+0000","last_became_active":"2023-12-16T03:26:02.464706+0000","last_became_peered":"2023-12-16T03:26:02.464706+0000","last_unstale":"2023-12-16T03:26:02.474844+0000","last_undegraded":"2023-12-16T03:26:02.474844+0000","last_fullsized":"2023-12-16T03:26:02.474844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.456412+0000","last_change":"2023-12-16T03:26:02.456412+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.456412+0000","last_undegraded":"2023-12-16T03:26:02.456412+0000","last_fullsized":"2023-12-16T03:26:02.456412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.459970+0000","last_change":"2023-12-16T03:26:02.456023+0000","last_active":"2023-12-16T03:26:02.459970+0000","last_peered":"2023-12-16T03:26:02.459970+0000","last_clean":"2023-12-16T03:26:02.459970+0000","last_became_active":"2023-12-16T03:26:02.455703+0000","last_became_peered":"2023-12-16T03:26:02.455703+0000","last_unstale":"2023-12-16T03:26:02.459970+0000","last_undegraded":"2023-12-16T03:26:02.459970+0000","last_fullsized":"2023-12-16T03:26:02.459970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445317+0000","last_change":"2023-12-16T03:26:02.445317+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445317+0000","last_undegraded":"2023-12-16T03:26:02.445317+0000","last_fullsized":"2023-12-16T03:26:02.445317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474463+0000","last_change":"2023-12-16T03:26:02.462695+0000","last_active":"2023-12-16T03:26:02.474463+0000","last_peered":"2023-12-16T03:26:02.474463+0000","last_clean":"2023-12-16T03:26:02.474463+0000","last_became_active":"2023-12-16T03:26:02.461706+0000","last_became_peered":"2023-12-16T03:26:02.461706+0000","last_unstale":"2023-12-16T03:26:02.474463+0000","last_undegraded":"2023-12-16T03:26:02.474463+0000","last_fullsized":"2023-12-16T03:26:02.474463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:03:33.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446457+0000","last_change":"2023-12-16T03:26:02.446457+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446457+0000","last_undegraded":"2023-12-16T03:26:02.446457+0000","last_fullsized":"2023-12-16T03:26:02.446457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465414+0000","last_change":"2023-12-16T03:26:02.459691+0000","last_active":"2023-12-16T03:26:02.465414+0000","last_peered":"2023-12-16T03:26:02.465414+0000","last_clean":"2023-12-16T03:26:02.465414+0000","last_became_active":"2023-12-16T03:26:02.458861+0000","last_became_peered":"2023-12-16T03:26:02.458861+0000","last_unstale":"2023-12-16T03:26:02.465414+0000","last_undegraded":"2023-12-16T03:26:02.465414+0000","last_fullsized":"2023-12-16T03:26:02.465414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:57.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447698+0000","last_change":"2023-12-16T03:26:02.447698+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447698+0000","last_undegraded":"2023-12-16T03:26:02.447698+0000","last_fullsized":"2023-12-16T03:26:02.447698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.470194+0000","last_change":"2023-12-16T03:26:02.468114+0000","last_active":"2023-12-16T03:26:02.470194+0000","last_peered":"2023-12-16T03:26:02.470194+0000","last_clean":"2023-12-16T03:26:02.470194+0000","last_became_active":"2023-12-16T03:26:02.467813+0000","last_became_peered":"2023-12-16T03:26:02.467813+0000","last_unstale":"2023-12-16T03:26:02.470194+0000","last_undegraded":"2023-12-16T03:26:02.470194+0000","last_fullsized":"2023-12-16T03:26:02.470194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:33.098551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452445+0000","last_change":"2023-12-16T03:26:02.452445+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452445+0000","last_undegraded":"2023-12-16T03:26:02.452445+0000","last_fullsized":"2023-12-16T03:26:02.452445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473697+0000","last_change":"2023-12-16T03:26:02.467483+0000","last_active":"2023-12-16T03:26:02.473697+0000","last_peered":"2023-12-16T03:26:02.473697+0000","last_clean":"2023-12-16T03:26:02.473697+0000","last_became_active":"2023-12-16T03:26:02.467186+0000","last_became_peered":"2023-12-16T03:26:02.467186+0000","last_unstale":"2023-12-16T03:26:02.473697+0000","last_undegraded":"2023-12-16T03:26:02.473697+0000","last_fullsized":"2023-12-16T03:26:02.473697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-16T03:26:01.437045+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:26:01.437045+0000","last_peered":"2023-12-16T03:26:01.437045+0000","last_clean":"2023-12-16T03:26:01.437045+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:26:01.437045+0000","last_undegraded":"2023-12-16T03:26:01.437045+0000","last_fullsized":"2023-12-16T03:26:01.437045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":710443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":710443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:26:07.962 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:26:08.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.138+0000 7feb7469a640 1 Processor -- start 2023-12-16T03:26:08.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.138+0000 7feb7469a640 1 -- start start 2023-12-16T03:26:08.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb7469a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb6c0a7450 0x7feb6c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb7469a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feb6c1526e0 0x7feb6c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb7469a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6c156820 con 0x7feb6c0c76a0 2023-12-16T03:26:08.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb7469a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6c06ec40 con 0x7feb6c1526e0 2023-12-16T03:26:08.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb7469a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c0a7830 con 0x7feb6c0a7450 2023-12-16T03:26:08.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb72c37640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feb6c1526e0 0x7feb6c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb72c37640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feb6c1526e0 0x7feb6c152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49462/0 (socket says 172.21.15.28:49462) 2023-12-16T03:26:08.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb72c37640 1 -- 172.21.15.28:0/4090239513 learned_addr learned my addr 172.21.15.28:0/4090239513 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:08.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb72436640 1 --2- 172.21.15.28:0/4090239513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb6c0a7450 0x7feb6c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb72c37640 1 -- 172.21.15.28:0/4090239513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb6c0a7450 msgr2=0x7feb6c06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:08.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb72c37640 1 --2- 172.21.15.28:0/4090239513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb6c0a7450 0x7feb6c06dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb72c37640 1 -- 172.21.15.28:0/4090239513 >> v1:172.21.15.134:6789/0 conn(0x7feb6c0c76a0 legacy=0x7feb6c06f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.142+0000 7feb72c37640 1 -- 172.21.15.28:0/4090239513 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c06e1b0 con 0x7feb6c1526e0 2023-12-16T03:26:08.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb72c37640 1 --2- 172.21.15.28:0/4090239513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb6c1526e0 0x7feb6c152b70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feb64009e50 tx=0x7feb6401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7933056ba48799c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:08.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb71434640 1 -- 172.21.15.28:0/4090239513 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb640a5810 con 0x7feb6c1526e0 2023-12-16T03:26:08.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb71434640 1 -- 172.21.15.28:0/4090239513 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb640a5970 con 0x7feb6c1526e0 2023-12-16T03:26:08.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb71434640 1 -- 172.21.15.28:0/4090239513 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb640a5d00 con 0x7feb6c1526e0 2023-12-16T03:26:08.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb7469a640 1 -- 172.21.15.28:0/4090239513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb6c1526e0 msgr2=0x7feb6c152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb7469a640 1 --2- 172.21.15.28:0/4090239513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb6c1526e0 0x7feb6c152b70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feb64009e50 tx=0x7feb6401c950 comp rx=0 tx=0).stop 2023-12-16T03:26:08.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb7469a640 1 -- 172.21.15.28:0/4090239513 shutdown_connections 2023-12-16T03:26:08.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb7469a640 1 --2- 172.21.15.28:0/4090239513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb6c1526e0 0x7feb6c152b70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb7469a640 1 --2- 172.21.15.28:0/4090239513 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb6c0a7450 0x7feb6c06dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb7469a640 1 -- 172.21.15.28:0/4090239513 >> 172.21.15.28:0/4090239513 conn(0x7feb6c0c7e40 msgr2=0x7feb6c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:08.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb7469a640 1 -- 172.21.15.28:0/4090239513 shutdown_connections 2023-12-16T03:26:08.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb7469a640 1 -- 172.21.15.28:0/4090239513 wait complete. 2023-12-16T03:26:08.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb7469a640 1 Processor -- start 2023-12-16T03:26:08.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.146+0000 7feb7469a640 1 -- start start 2023-12-16T03:26:08.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb7469a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb6c0a7450 0x7feb6c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb7469a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb6c0c76a0 0x7feb6c15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb7469a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb6c1526e0 0x7feb6c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb7469a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c1f0f40 con 0x7feb6c0c76a0 2023-12-16T03:26:08.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb7469a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c1f0330 con 0x7feb6c1526e0 2023-12-16T03:26:08.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb7469a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c1f0610 con 0x7feb6c0a7450 2023-12-16T03:26:08.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb71c35640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb6c0c76a0 0x7feb6c15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb71c35640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb6c0c76a0 0x7feb6c15c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49476/0 (socket says 172.21.15.28:49476) 2023-12-16T03:26:08.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb71c35640 1 -- 172.21.15.28:0/2212720393 learned_addr learned my addr 172.21.15.28:0/2212720393 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:08.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb72c37640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb6c1526e0 0x7feb6c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb72436640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb6c0a7450 0x7feb6c0c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb71c35640 1 -- 172.21.15.28:0/2212720393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb6c0a7450 msgr2=0x7feb6c0c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb71c35640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb6c0a7450 0x7feb6c0c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb71c35640 1 -- 172.21.15.28:0/2212720393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb6c1526e0 msgr2=0x7feb6c0c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb71c35640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb6c1526e0 0x7feb6c0c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb71c35640 1 -- 172.21.15.28:0/2212720393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb64009b30 con 0x7feb6c0c76a0 2023-12-16T03:26:08.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb71c35640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb6c0c76a0 0x7feb6c15c0d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00c3c0 tx=0x7feb5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:08.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb62ffd640 1 -- 172.21.15.28:0/2212720393 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0052d0 con 0x7feb6c0c76a0 2023-12-16T03:26:08.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb62ffd640 1 -- 172.21.15.28:0/2212720393 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c005430 con 0x7feb6c0c76a0 2023-12-16T03:26:08.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb62ffd640 1 -- 172.21.15.28:0/2212720393 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c003840 con 0x7feb6c0c76a0 2023-12-16T03:26:08.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb7469a640 1 -- 172.21.15.28:0/2212720393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6c1f08f0 con 0x7feb6c0c76a0 2023-12-16T03:26:08.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb7469a640 1 -- 172.21.15.28:0/2212720393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6c0aa8d0 con 0x7feb6c0c76a0 2023-12-16T03:26:08.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb7469a640 1 -- 172.21.15.28:0/2212720393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6c068400 con 0x7feb6c0c76a0 2023-12-16T03:26:08.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.150+0000 7feb62ffd640 1 -- 172.21.15.28:0/2212720393 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7feb5c0039a0 con 0x7feb6c0c76a0 2023-12-16T03:26:08.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.154+0000 7feb62ffd640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb50066470 0x7feb50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.154+0000 7feb62ffd640 1 -- 172.21.15.28:0/2212720393 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb5c0832b0 con 0x7feb6c0c76a0 2023-12-16T03:26:08.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.154+0000 7feb72436640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb50066470 0x7feb50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.154+0000 7feb72436640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb50066470 0x7feb50068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feb68009ac0 tx=0x7feb68009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:08.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.158+0000 7feb62ffd640 1 -- 172.21.15.28:0/2212720393 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7feb5c050850 con 0x7feb6c0c76a0 2023-12-16T03:26:08.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.314+0000 7feb7469a640 1 -- 172.21.15.28:0/2212720393 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb6c0adca0 con 0x7feb50066470 2023-12-16T03:26:08.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.322+0000 7feb62ffd640 1 -- 172.21.15.28:0/2212720393 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259388 (secure 0 0 0) 0x7feb6c0adca0 con 0x7feb50066470 2023-12-16T03:26:08.328 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:08.329 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:26:08.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.322+0000 7feb7469a640 1 -- 172.21.15.28:0/2212720393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb50066470 msgr2=0x7feb50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.322+0000 7feb7469a640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb50066470 0x7feb50068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feb68009ac0 tx=0x7feb68009190 comp rx=0 tx=0).stop 2023-12-16T03:26:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.322+0000 7feb7469a640 1 -- 172.21.15.28:0/2212720393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb6c0c76a0 msgr2=0x7feb6c15c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.322+0000 7feb7469a640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb6c0c76a0 0x7feb6c15c0d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00c3c0 tx=0x7feb5c00c880 comp rx=0 tx=0).stop 2023-12-16T03:26:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.326+0000 7feb7469a640 1 -- 172.21.15.28:0/2212720393 shutdown_connections 2023-12-16T03:26:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.326+0000 7feb7469a640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb6c1526e0 0x7feb6c0c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.326+0000 7feb7469a640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feb50066470 0x7feb50068930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.326+0000 7feb7469a640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb6c0c76a0 0x7feb6c15c0d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.326+0000 7feb7469a640 1 --2- 172.21.15.28:0/2212720393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb6c0a7450 0x7feb6c0c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.326+0000 7feb7469a640 1 -- 172.21.15.28:0/2212720393 >> 172.21.15.28:0/2212720393 conn(0x7feb6c0c7e40 msgr2=0x7feb6c0ad320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.326+0000 7feb7469a640 1 -- 172.21.15.28:0/2212720393 shutdown_connections 2023-12-16T03:26:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.326+0000 7feb7469a640 1 -- 172.21.15.28:0/2212720393 wait complete. 2023-12-16T03:26:08.348 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-12-16T03:26:07.808839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236520,"kb_used_data":3712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738200,"statfs":{"total":773094113280,"available":772851916800,"internally_reserved":0,"allocated":3801088,"data_stored":2153870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001040"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455072+0000","last_change":"2023-12-16T03:26:02.455072+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455072+0000","last_undegraded":"2023-12-16T03:26:02.455072+0000","last_fullsized":"2023-12-16T03:26:02.455072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455099+0000","last_change":"2023-12-16T03:26:02.455099+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455099+0000","last_undegraded":"2023-12-16T03:26:02.455099+0000","last_fullsized":"2023-12-16T03:26:02.455099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445002+0000","last_change":"2023-12-16T03:26:02.445002+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445002+0000","last_undegraded":"2023-12-16T03:26:02.445002+0000","last_fullsized":"2023-12-16T03:26:02.445002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450723+0000","last_change":"2023-12-16T03:26:02.450723+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450723+0000","last_undegraded":"2023-12-16T03:26:02.450723+0000","last_fullsized":"2023-12-16T03:26:02.450723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455291+0000","last_change":"2023-12-16T03:26:02.455291+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455291+0000","last_undegraded":"2023-12-16T03:26:02.455291+0000","last_fullsized":"2023-12-16T03:26:02.455291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451114+0000","last_change":"2023-12-16T03:26:02.451114+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451114+0000","last_undegraded":"2023-12-16T03:26:02.451114+0000","last_fullsized":"2023-12-16T03:26:02.451114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452611+0000","last_change":"2023-12-16T03:26:02.452611+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452611+0000","last_undegraded":"2023-12-16T03:26:02.452611+0000","last_fullsized":"2023-12-16T03:26:02.452611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455580+0000","last_change":"2023-12-16T03:26:02.455580+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455580+0000","last_undegraded":"2023-12-16T03:26:02.455580+0000","last_fullsized":"2023-12-16T03:26:02.455580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449887+0000","last_change":"2023-12-16T03:26:02.449887+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449887+0000","last_undegraded":"2023-12-16T03:26:02.449887+0000","last_fullsized":"2023-12-16T03:26:02.449887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.464569+0000","last_change":"2023-12-16T03:26:02.464569+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.464569+0000","last_undegraded":"2023-12-16T03:26:02.464569+0000","last_fullsized":"2023-12-16T03:26:02.464569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454609+0000","last_change":"2023-12-16T03:26:02.454609+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454609+0000","last_undegraded":"2023-12-16T03:26:02.454609+0000","last_fullsized":"2023-12-16T03:26:02.454609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445786+0000","last_change":"2023-12-16T03:26:02.445786+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445786+0000","last_undegraded":"2023-12-16T03:26:02.445786+0000","last_fullsized":"2023-12-16T03:26:02.445786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454699+0000","last_change":"2023-12-16T03:26:02.454699+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454699+0000","last_undegraded":"2023-12-16T03:26:02.454699+0000","last_fullsized":"2023-12-16T03:26:02.454699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450561+0000","last_change":"2023-12-16T03:26:02.450561+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450561+0000","last_undegraded":"2023-12-16T03:26:02.450561+0000","last_fullsized":"2023-12-16T03:26:02.450561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444964+0000","last_change":"2023-12-16T03:26:02.444964+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444964+0000","last_undegraded":"2023-12-16T03:26:02.444964+0000","last_fullsized":"2023-12-16T03:26:02.444964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450772+0000","last_change":"2023-12-16T03:26:02.450772+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450772+0000","last_undegraded":"2023-12-16T03:26:02.450772+0000","last_fullsized":"2023-12-16T03:26:02.450772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453842+0000","last_change":"2023-12-16T03:26:02.453842+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453842+0000","last_undegraded":"2023-12-16T03:26:02.453842+0000","last_fullsized":"2023-12-16T03:26:02.453842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451495+0000","last_change":"2023-12-16T03:26:02.451495+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451495+0000","last_undegraded":"2023-12-16T03:26:02.451495+0000","last_fullsized":"2023-12-16T03:26:02.451495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453743+0000","last_change":"2023-12-16T03:26:02.453743+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453743+0000","last_undegraded":"2023-12-16T03:26:02.453743+0000","last_fullsized":"2023-12-16T03:26:02.453743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.457767+0000","last_change":"2023-12-16T03:26:02.457767+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.457767+0000","last_undegraded":"2023-12-16T03:26:02.457767+0000","last_fullsized":"2023-12-16T03:26:02.457767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448732+0000","last_change":"2023-12-16T03:26:02.448732+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448732+0000","last_undegraded":"2023-12-16T03:26:02.448732+0000","last_fullsized":"2023-12-16T03:26:02.448732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448834+0000","last_change":"2023-12-16T03:26:02.448834+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448834+0000","last_undegraded":"2023-12-16T03:26:02.448834+0000","last_fullsized":"2023-12-16T03:26:02.448834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447166+0000","last_change":"2023-12-16T03:26:02.447166+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447166+0000","last_undegraded":"2023-12-16T03:26:02.447166+0000","last_fullsized":"2023-12-16T03:26:02.447166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444970+0000","last_change":"2023-12-16T03:26:02.444970+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444970+0000","last_undegraded":"2023-12-16T03:26:02.444970+0000","last_fullsized":"2023-12-16T03:26:02.444970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.463174+0000","last_change":"2023-12-16T03:26:02.463174+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.463174+0000","last_undegraded":"2023-12-16T03:26:02.463174+0000","last_fullsized":"2023-12-16T03:26:02.463174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451052+0000","last_change":"2023-12-16T03:26:02.451052+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451052+0000","last_undegraded":"2023-12-16T03:26:02.451052+0000","last_fullsized":"2023-12-16T03:26:02.451052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.460874+0000","last_change":"2023-12-16T03:26:02.460874+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.460874+0000","last_undegraded":"2023-12-16T03:26:02.460874+0000","last_fullsized":"2023-12-16T03:26:02.460874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445333+0000","last_change":"2023-12-16T03:26:02.445333+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445333+0000","last_undegraded":"2023-12-16T03:26:02.445333+0000","last_fullsized":"2023-12-16T03:26:02.445333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448106+0000","last_change":"2023-12-16T03:26:02.448106+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448106+0000","last_undegraded":"2023-12-16T03:26:02.448106+0000","last_fullsized":"2023-12-16T03:26:02.448106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451895+0000","last_change":"2023-12-16T03:26:02.451895+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451895+0000","last_undegraded":"2023-12-16T03:26:02.451895+0000","last_fullsized":"2023-12-16T03:26:02.451895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452514+0000","last_change":"2023-12-16T03:26:02.452514+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452514+0000","last_undegraded":"2023-12-16T03:26:02.452514+0000","last_fullsized":"2023-12-16T03:26:02.452514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454851+0000","last_change":"2023-12-16T03:26:02.454851+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454851+0000","last_undegraded":"2023-12-16T03:26:02.454851+0000","last_fullsized":"2023-12-16T03:26:02.454851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446356+0000","last_change":"2023-12-16T03:26:02.446356+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446356+0000","last_undegraded":"2023-12-16T03:26:02.446356+0000","last_fullsized":"2023-12-16T03:26:02.446356+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473417+0000","last_change":"2023-12-16T03:26:02.466777+0000","last_active":"2023-12-16T03:26:02.473417+0000","last_peered":"2023-12-16T03:26:02.473417+0000","last_clean":"2023-12-16T03:26:02.473417+0000","last_became_active":"2023-12-16T03:26:02.466486+0000","last_became_peered":"2023-12-16T03:26:02.466486+0000","last_unstale":"2023-12-16T03:26:02.473417+0000","last_undegraded":"2023-12-16T03:26:02.473417+0000","last_fullsized":"2023-12-16T03:26:02.473417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454034+0000","last_change":"2023-12-16T03:26:02.454034+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454034+0000","last_undegraded":"2023-12-16T03:26:02.454034+0000","last_fullsized":"2023-12-16T03:26:02.454034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465472+0000","last_change":"2023-12-16T03:26:02.464156+0000","last_active":"2023-12-16T03:26:02.465472+0000","last_peered":"2023-12-16T03:26:02.465472+0000","last_clean":"2023-12-16T03:26:02.465472+0000","last_became_active":"2023-12-16T03:26:02.463875+0000","last_became_peered":"2023-12-16T03:26:02.463875+0000","last_unstale":"2023-12-16T03:26:02.465472+0000","last_undegraded":"2023-12-16T03:26:02.465472+0000","last_fullsized":"2023-12-16T03:26:02.465472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447295+0000","last_change":"2023-12-16T03:26:02.447295+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447295+0000","last_undegraded":"2023-12-16T03:26:02.447295+0000","last_fullsized":"2023-12-16T03:26:02.447295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.478635+0000","last_change":"2023-12-16T03:26:02.475790+0000","last_active":"2023-12-16T03:26:02.478635+0000","last_peered":"2023-12-16T03:26:02.478635+0000","last_clean":"2023-12-16T03:26:02.478635+0000","last_became_active":"2023-12-16T03:26:02.475486+0000","last_became_peered":"2023-12-16T03:26:02.475486+0000","last_unstale":"2023-12-16T03:26:02.478635+0000","last_undegraded":"2023-12-16T03:26:02.478635+0000","last_fullsized":"2023-12-16T03:26:02.478635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449229+0000","last_change":"2023-12-16T03:26:02.449229+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449229+0000","last_undegraded":"2023-12-16T03:26:02.449229+0000","last_fullsized":"2023-12-16T03:26:02.449229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.476059+0000","last_change":"2023-12-16T03:26:02.473812+0000","last_active":"2023-12-16T03:26:02.476059+0000","last_peered":"2023-12-16T03:26:02.476059+0000","last_clean":"2023-12-16T03:26:02.476059+0000","last_became_active":"2023-12-16T03:26:02.473426+0000","last_became_peered":"2023-12-16T03:26:02.473426+0000","last_unstale":"2023-12-16T03:26:02.476059+0000","last_undegraded":"2023-12-16T03:26:02.476059+0000","last_fullsized":"2023-12-16T03:26:02.476059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:48.463304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451342+0000","last_change":"2023-12-16T03:26:02.451342+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451342+0000","last_undegraded":"2023-12-16T03:26:02.451342+0000","last_fullsized":"2023-12-16T03:26:02.451342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475157+0000","last_change":"2023-12-16T03:26:02.469331+0000","last_active":"2023-12-16T03:26:02.475157+0000","last_peered":"2023-12-16T03:26:02.475157+0000","last_clean":"2023-12-16T03:26:02.475157+0000","last_became_active":"2023-12-16T03:26:02.469083+0000","last_became_peered":"2023-12-16T03:26:02.469083+0000","last_unstale":"2023-12-16T03:26:02.475157+0000","last_undegraded":"2023-12-16T03:26:02.475157+0000","last_fullsized":"2023-12-16T03:26:02.475157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:15.539658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446350+0000","last_change":"2023-12-16T03:26:02.446350+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446350+0000","last_undegraded":"2023-12-16T03:26:02.446350+0000","last_fullsized":"2023-12-16T03:26:02.446350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475188+0000","last_change":"2023-12-16T03:26:02.472832+0000","last_active":"2023-12-16T03:26:02.475188+0000","last_peered":"2023-12-16T03:26:02.475188+0000","last_clean":"2023-12-16T03:26:02.475188+0000","last_became_active":"2023-12-16T03:26:02.472574+0000","last_became_peered":"2023-12-16T03:26:02.472574+0000","last_unstale":"2023-12-16T03:26:02.475188+0000","last_undegraded":"2023-12-16T03:26:02.475188+0000","last_fullsized":"2023-12-16T03:26:02.475188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.446606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447222+0000","last_change":"2023-12-16T03:26:02.447222+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447222+0000","last_undegraded":"2023-12-16T03:26:02.447222+0000","last_fullsized":"2023-12-16T03:26:02.447222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.471594+0000","last_change":"2023-12-16T03:26:02.467098+0000","last_active":"2023-12-16T03:26:02.471594+0000","last_peered":"2023-12-16T03:26:02.471594+0000","last_clean":"2023-12-16T03:26:02.471594+0000","last_became_active":"2023-12-16T03:26:02.464042+0000","last_became_peered":"2023-12-16T03:26:02.464042+0000","last_unstale":"2023-12-16T03:26:02.471594+0000","last_undegraded":"2023-12-16T03:26:02.471594+0000","last_fullsized":"2023-12-16T03:26:02.471594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:23:51.458474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448410+0000","last_change":"2023-12-16T03:26:02.448410+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448410+0000","last_undegraded":"2023-12-16T03:26:02.448410+0000","last_fullsized":"2023-12-16T03:26:02.448410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473421+0000","last_change":"2023-12-16T03:26:02.465231+0000","last_active":"2023-12-16T03:26:02.473421+0000","last_peered":"2023-12-16T03:26:02.473421+0000","last_clean":"2023-12-16T03:26:02.473421+0000","last_became_active":"2023-12-16T03:26:02.464573+0000","last_became_peered":"2023-12-16T03:26:02.464573+0000","last_unstale":"2023-12-16T03:26:02.473421+0000","last_undegraded":"2023-12-16T03:26:02.473421+0000","last_fullsized":"2023-12-16T03:26:02.473421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:44:36.877503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444993+0000","last_change":"2023-12-16T03:26:02.444993+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444993+0000","last_undegraded":"2023-12-16T03:26:02.444993+0000","last_fullsized":"2023-12-16T03:26:02.444993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.470229+0000","last_change":"2023-12-16T03:26:02.468514+0000","last_active":"2023-12-16T03:26:02.470229+0000","last_peered":"2023-12-16T03:26:02.470229+0000","last_clean":"2023-12-16T03:26:02.470229+0000","last_became_active":"2023-12-16T03:26:02.467879+0000","last_became_peered":"2023-12-16T03:26:02.467879+0000","last_unstale":"2023-12-16T03:26:02.470229+0000","last_undegraded":"2023-12-16T03:26:02.470229+0000","last_fullsized":"2023-12-16T03:26:02.470229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:19.149617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453258+0000","last_change":"2023-12-16T03:26:02.453258+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453258+0000","last_undegraded":"2023-12-16T03:26:02.453258+0000","last_fullsized":"2023-12-16T03:26:02.453258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.452298+0000","last_change":"2023-12-16T03:26:02.449876+0000","last_active":"2023-12-16T03:26:02.452298+0000","last_peered":"2023-12-16T03:26:02.452298+0000","last_clean":"2023-12-16T03:26:02.452298+0000","last_became_active":"2023-12-16T03:26:02.449358+0000","last_became_peered":"2023-12-16T03:26:02.449358+0000","last_unstale":"2023-12-16T03:26:02.452298+0000","last_undegraded":"2023-12-16T03:26:02.452298+0000","last_fullsized":"2023-12-16T03:26:02.452298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450370+0000","last_change":"2023-12-16T03:26:02.450370+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450370+0000","last_undegraded":"2023-12-16T03:26:02.450370+0000","last_fullsized":"2023-12-16T03:26:02.450370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.466050+0000","last_change":"2023-12-16T03:26:02.461467+0000","last_active":"2023-12-16T03:26:02.466050+0000","last_peered":"2023-12-16T03:26:02.466050+0000","last_clean":"2023-12-16T03:26:02.466050+0000","last_became_active":"2023-12-16T03:26:02.461144+0000","last_became_peered":"2023-12-16T03:26:02.461144+0000","last_unstale":"2023-12-16T03:26:02.466050+0000","last_undegraded":"2023-12-16T03:26:02.466050+0000","last_fullsized":"2023-12-16T03:26:02.466050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448074+0000","last_change":"2023-12-16T03:26:02.448074+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448074+0000","last_undegraded":"2023-12-16T03:26:02.448074+0000","last_fullsized":"2023-12-16T03:26:02.448074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477932+0000","last_change":"2023-12-16T03:26:02.474073+0000","last_active":"2023-12-16T03:26:02.477932+0000","last_peered":"2023-12-16T03:26:02.477932+0000","last_clean":"2023-12-16T03:26:02.477932+0000","last_became_active":"2023-12-16T03:26:02.473771+0000","last_became_peered":"2023-12-16T03:26:02.473771+0000","last_unstale":"2023-12-16T03:26:02.477932+0000","last_undegraded":"2023-12-16T03:26:02.477932+0000","last_fullsized":"2023-12-16T03:26:02.477932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:51:41.152969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450511+0000","last_change":"2023-12-16T03:26:02.450511+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450511+0000","last_undegraded":"2023-12-16T03:26:02.450511+0000","last_fullsized":"2023-12-16T03:26:02.450511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.467941+0000","last_change":"2023-12-16T03:26:02.464973+0000","last_active":"2023-12-16T03:26:02.467941+0000","last_peered":"2023-12-16T03:26:02.467941+0000","last_clean":"2023-12-16T03:26:02.467941+0000","last_became_active":"2023-12-16T03:26:02.464672+0000","last_became_peered":"2023-12-16T03:26:02.464672+0000","last_unstale":"2023-12-16T03:26:02.467941+0000","last_undegraded":"2023-12-16T03:26:02.467941+0000","last_fullsized":"2023-12-16T03:26:02.467941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:45.759262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448256+0000","last_change":"2023-12-16T03:26:02.448256+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448256+0000","last_undegraded":"2023-12-16T03:26:02.448256+0000","last_fullsized":"2023-12-16T03:26:02.448256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475711+0000","last_change":"2023-12-16T03:26:02.465815+0000","last_active":"2023-12-16T03:26:02.475711+0000","last_peered":"2023-12-16T03:26:02.475711+0000","last_clean":"2023-12-16T03:26:02.475711+0000","last_became_active":"2023-12-16T03:26:02.465505+0000","last_became_peered":"2023-12-16T03:26:02.465505+0000","last_unstale":"2023-12-16T03:26:02.475711+0000","last_undegraded":"2023-12-16T03:26:02.475711+0000","last_fullsized":"2023-12-16T03:26:02.475711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452661+0000","last_change":"2023-12-16T03:26:02.452661+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452661+0000","last_undegraded":"2023-12-16T03:26:02.452661+0000","last_fullsized":"2023-12-16T03:26:02.452661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474177+0000","last_change":"2023-12-16T03:26:02.471444+0000","last_active":"2023-12-16T03:26:02.474177+0000","last_peered":"2023-12-16T03:26:02.474177+0000","last_clean":"2023-12-16T03:26:02.474177+0000","last_became_active":"2023-12-16T03:26:02.468577+0000","last_became_peered":"2023-12-16T03:26:02.468577+0000","last_unstale":"2023-12-16T03:26:02.474177+0000","last_undegraded":"2023-12-16T03:26:02.474177+0000","last_fullsized":"2023-12-16T03:26:02.474177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451895+0000","last_change":"2023-12-16T03:26:02.451895+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451895+0000","last_undegraded":"2023-12-16T03:26:02.451895+0000","last_fullsized":"2023-12-16T03:26:02.451895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.478029+0000","last_change":"2023-12-16T03:26:02.475063+0000","last_active":"2023-12-16T03:26:02.478029+0000","last_peered":"2023-12-16T03:26:02.478029+0000","last_clean":"2023-12-16T03:26:02.478029+0000","last_became_active":"2023-12-16T03:26:02.474759+0000","last_became_peered":"2023-12-16T03:26:02.474759+0000","last_unstale":"2023-12-16T03:26:02.478029+0000","last_undegraded":"2023-12-16T03:26:02.478029+0000","last_fullsized":"2023-12-16T03:26:02.478029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:47.788469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449444+0000","last_change":"2023-12-16T03:26:02.449444+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449444+0000","last_undegraded":"2023-12-16T03:26:02.449444+0000","last_fullsized":"2023-12-16T03:26:02.449444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477863+0000","last_change":"2023-12-16T03:26:02.473227+0000","last_active":"2023-12-16T03:26:02.477863+0000","last_peered":"2023-12-16T03:26:02.477863+0000","last_clean":"2023-12-16T03:26:02.477863+0000","last_became_active":"2023-12-16T03:26:02.472888+0000","last_became_peered":"2023-12-16T03:26:02.472888+0000","last_unstale":"2023-12-16T03:26:02.477863+0000","last_undegraded":"2023-12-16T03:26:02.477863+0000","last_fullsized":"2023-12-16T03:26:02.477863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447130+0000","last_change":"2023-12-16T03:26:02.447130+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447130+0000","last_undegraded":"2023-12-16T03:26:02.447130+0000","last_fullsized":"2023-12-16T03:26:02.447130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473449+0000","last_change":"2023-12-16T03:26:02.465496+0000","last_active":"2023-12-16T03:26:02.473449+0000","last_peered":"2023-12-16T03:26:02.473449+0000","last_clean":"2023-12-16T03:26:02.473449+0000","last_became_active":"2023-12-16T03:26:02.465106+0000","last_became_peered":"2023-12-16T03:26:02.465106+0000","last_unstale":"2023-12-16T03:26:02.473449+0000","last_undegraded":"2023-12-16T03:26:02.473449+0000","last_fullsized":"2023-12-16T03:26:02.473449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:46.860441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450023+0000","last_change":"2023-12-16T03:26:02.450023+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450023+0000","last_undegraded":"2023-12-16T03:26:02.450023+0000","last_fullsized":"2023-12-16T03:26:02.450023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.467979+0000","last_change":"2023-12-16T03:26:02.462818+0000","last_active":"2023-12-16T03:26:02.467979+0000","last_peered":"2023-12-16T03:26:02.467979+0000","last_clean":"2023-12-16T03:26:02.467979+0000","last_became_active":"2023-12-16T03:26:02.462408+0000","last_became_peered":"2023-12-16T03:26:02.462408+0000","last_unstale":"2023-12-16T03:26:02.467979+0000","last_undegraded":"2023-12-16T03:26:02.467979+0000","last_fullsized":"2023-12-16T03:26:02.467979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:54.350741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.461211+0000","last_change":"2023-12-16T03:26:02.461211+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.461211+0000","last_undegraded":"2023-12-16T03:26:02.461211+0000","last_fullsized":"2023-12-16T03:26:02.461211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475131+0000","last_change":"2023-12-16T03:26:02.468837+0000","last_active":"2023-12-16T03:26:02.475131+0000","last_peered":"2023-12-16T03:26:02.475131+0000","last_clean":"2023-12-16T03:26:02.475131+0000","last_became_active":"2023-12-16T03:26:02.468492+0000","last_became_peered":"2023-12-16T03:26:02.468492+0000","last_unstale":"2023-12-16T03:26:02.475131+0000","last_undegraded":"2023-12-16T03:26:02.475131+0000","last_fullsized":"2023-12-16T03:26:02.475131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:48.463304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452995+0000","last_change":"2023-12-16T03:26:02.452995+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452995+0000","last_undegraded":"2023-12-16T03:26:02.452995+0000","last_fullsized":"2023-12-16T03:26:02.452995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.463266+0000","last_change":"2023-12-16T03:26:02.462344+0000","last_active":"2023-12-16T03:26:02.463266+0000","last_peered":"2023-12-16T03:26:02.463266+0000","last_clean":"2023-12-16T03:26:02.463266+0000","last_became_active":"2023-12-16T03:26:02.462089+0000","last_became_peered":"2023-12-16T03:26:02.462089+0000","last_unstale":"2023-12-16T03:26:02.463266+0000","last_undegraded":"2023-12-16T03:26:02.463266+0000","last_fullsized":"2023-12-16T03:26:02.463266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452938+0000","last_change":"2023-12-16T03:26:02.452938+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452938+0000","last_undegraded":"2023-12-16T03:26:02.452938+0000","last_fullsized":"2023-12-16T03:26:02.452938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477418+0000","last_change":"2023-12-16T03:26:02.474673+0000","last_active":"2023-12-16T03:26:02.477418+0000","last_peered":"2023-12-16T03:26:02.477418+0000","last_clean":"2023-12-16T03:26:02.477418+0000","last_became_active":"2023-12-16T03:26:02.474398+0000","last_became_peered":"2023-12-16T03:26:02.474398+0000","last_unstale":"2023-12-16T03:26:02.477418+0000","last_undegraded":"2023-12-16T03:26:02.477418+0000","last_fullsized":"2023-12-16T03:26:02.477418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453994+0000","last_change":"2023-12-16T03:26:02.453994+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453994+0000","last_undegraded":"2023-12-16T03:26:02.453994+0000","last_fullsized":"2023-12-16T03:26:02.453994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477126+0000","last_change":"2023-12-16T03:26:02.473193+0000","last_active":"2023-12-16T03:26:02.477126+0000","last_peered":"2023-12-16T03:26:02.477126+0000","last_clean":"2023-12-16T03:26:02.477126+0000","last_became_active":"2023-12-16T03:26:02.472836+0000","last_became_peered":"2023-12-16T03:26:02.472836+0000","last_unstale":"2023-12-16T03:26:02.477126+0000","last_undegraded":"2023-12-16T03:26:02.477126+0000","last_fullsized":"2023-12-16T03:26:02.477126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:21:40.835921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453109+0000","last_change":"2023-12-16T03:26:02.453109+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453109+0000","last_undegraded":"2023-12-16T03:26:02.453109+0000","last_fullsized":"2023-12-16T03:26:02.453109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465898+0000","last_change":"2023-12-16T03:26:02.456879+0000","last_active":"2023-12-16T03:26:02.465898+0000","last_peered":"2023-12-16T03:26:02.465898+0000","last_clean":"2023-12-16T03:26:02.465898+0000","last_became_active":"2023-12-16T03:26:02.456571+0000","last_became_peered":"2023-12-16T03:26:02.456571+0000","last_unstale":"2023-12-16T03:26:02.465898+0000","last_undegraded":"2023-12-16T03:26:02.465898+0000","last_fullsized":"2023-12-16T03:26:02.465898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.456757+0000","last_change":"2023-12-16T03:26:02.456757+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.456757+0000","last_undegraded":"2023-12-16T03:26:02.456757+0000","last_fullsized":"2023-12-16T03:26:02.456757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.476026+0000","last_change":"2023-12-16T03:26:02.472212+0000","last_active":"2023-12-16T03:26:02.476026+0000","last_peered":"2023-12-16T03:26:02.476026+0000","last_clean":"2023-12-16T03:26:02.476026+0000","last_became_active":"2023-12-16T03:26:02.471791+0000","last_became_peered":"2023-12-16T03:26:02.471791+0000","last_unstale":"2023-12-16T03:26:02.476026+0000","last_undegraded":"2023-12-16T03:26:02.476026+0000","last_fullsized":"2023-12-16T03:26:02.476026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446607+0000","last_change":"2023-12-16T03:26:02.446607+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446607+0000","last_undegraded":"2023-12-16T03:26:02.446607+0000","last_fullsized":"2023-12-16T03:26:02.446607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477243+0000","last_change":"2023-12-16T03:26:02.476238+0000","last_active":"2023-12-16T03:26:02.477243+0000","last_peered":"2023-12-16T03:26:02.477243+0000","last_clean":"2023-12-16T03:26:02.477243+0000","last_became_active":"2023-12-16T03:26:02.475844+0000","last_became_peered":"2023-12-16T03:26:02.475844+0000","last_unstale":"2023-12-16T03:26:02.477243+0000","last_undegraded":"2023-12-16T03:26:02.477243+0000","last_fullsized":"2023-12-16T03:26:02.477243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:23:51.458474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445987+0000","last_change":"2023-12-16T03:26:02.445987+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445987+0000","last_undegraded":"2023-12-16T03:26:02.445987+0000","last_fullsized":"2023-12-16T03:26:02.445987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474844+0000","last_change":"2023-12-16T03:26:02.465084+0000","last_active":"2023-12-16T03:26:02.474844+0000","last_peered":"2023-12-16T03:26:02.474844+0000","last_clean":"2023-12-16T03:26:02.474844+0000","last_became_active":"2023-12-16T03:26:02.464706+0000","last_became_peered":"2023-12-16T03:26:02.464706+0000","last_unstale":"2023-12-16T03:26:02.474844+0000","last_undegraded":"2023-12-16T03:26:02.474844+0000","last_fullsized":"2023-12-16T03:26:02.474844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.456412+0000","last_change":"2023-12-16T03:26:02.456412+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.456412+0000","last_undegraded":"2023-12-16T03:26:02.456412+0000","last_fullsized":"2023-12-16T03:26:02.456412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.459970+0000","last_change":"2023-12-16T03:26:02.456023+0000","last_active":"2023-12-16T03:26:02.459970+0000","last_peered":"2023-12-16T03:26:02.459970+0000","last_clean":"2023-12-16T03:26:02.459970+0000","last_became_active":"2023-12-16T03:26:02.455703+0000","last_became_peered":"2023-12-16T03:26:02.455703+0000","last_unstale":"2023-12-16T03:26:02.459970+0000","last_undegraded":"2023-12-16T03:26:02.459970+0000","last_fullsized":"2023-12-16T03:26:02.459970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445317+0000","last_change":"2023-12-16T03:26:02.445317+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445317+0000","last_undegraded":"2023-12-16T03:26:02.445317+0000","last_fullsized":"2023-12-16T03:26:02.445317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474463+0000","last_change":"2023-12-16T03:26:02.462695+0000","last_active":"2023-12-16T03:26:02.474463+0000","last_peered":"2023-12-16T03:26:02.474463+0000","last_clean":"2023-12-16T03:26:02.474463+0000","last_became_active":"2023-12-16T03:26:02.461706+0000","last_became_peered":"2023-12-16T03:26:02.461706+0000","last_unstale":"2023-12-16T03:26:02.474463+0000","last_undegraded":"2023-12-16T03:26:02.474463+0000","last_fullsized":"2023-12-16T03:26:02.474463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:03:33.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446457+0000","last_change":"2023-12-16T03:26:02.446457+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446457+0000","last_undegraded":"2023-12-16T03:26:02.446457+0000","last_fullsized":"2023-12-16T03:26:02.446457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465414+0000","last_change":"2023-12-16T03:26:02.459691+0000","last_active":"2023-12-16T03:26:02.465414+0000","last_peered":"2023-12-16T03:26:02.465414+0000","last_clean":"2023-12-16T03:26:02.465414+0000","last_became_active":"2023-12-16T03:26:02.458861+0000","last_became_peered":"2023-12-16T03:26:02.458861+0000","last_unstale":"2023-12-16T03:26:02.465414+0000","last_undegraded":"2023-12-16T03:26:02.465414+0000","last_fullsized":"2023-12-16T03:26:02.465414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:57.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447698+0000","last_change":"2023-12-16T03:26:02.447698+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447698+0000","last_undegraded":"2023-12-16T03:26:02.447698+0000","last_fullsized":"2023-12-16T03:26:02.447698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.470194+0000","last_change":"2023-12-16T03:26:02.468114+0000","last_active":"2023-12-16T03:26:02.470194+0000","last_peered":"2023-12-16T03:26:02.470194+0000","last_clean":"2023-12-16T03:26:02.470194+0000","last_became_active":"2023-12-16T03:26:02.467813+0000","last_became_peered":"2023-12-16T03:26:02.467813+0000","last_unstale":"2023-12-16T03:26:02.470194+0000","last_undegraded":"2023-12-16T03:26:02.470194+0000","last_fullsized":"2023-12-16T03:26:02.470194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:33.098551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452445+0000","last_change":"2023-12-16T03:26:02.452445+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452445+0000","last_undegraded":"2023-12-16T03:26:02.452445+0000","last_fullsized":"2023-12-16T03:26:02.452445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473697+0000","last_change":"2023-12-16T03:26:02.467483+0000","last_active":"2023-12-16T03:26:02.473697+0000","last_peered":"2023-12-16T03:26:02.473697+0000","last_clean":"2023-12-16T03:26:02.473697+0000","last_became_active":"2023-12-16T03:26:02.467186+0000","last_became_peered":"2023-12-16T03:26:02.467186+0000","last_unstale":"2023-12-16T03:26:02.473697+0000","last_undegraded":"2023-12-16T03:26:02.473697+0000","last_fullsized":"2023-12-16T03:26:02.473697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-16T03:26:01.437045+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:26:01.437045+0000","last_peered":"2023-12-16T03:26:01.437045+0000","last_clean":"2023-12-16T03:26:01.437045+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:26:01.437045+0000","last_undegraded":"2023-12-16T03:26:01.437045+0000","last_fullsized":"2023-12-16T03:26:01.437045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":710443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":710443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:26:08.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-12-16T03:26:08.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.455072+0000', 'last_change': '2023-12-16T03:26:02.455072+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.455072+0000', 'last_undegraded': '2023-12-16T03:26:02.455072+0000', 'last_fullsized': '2023-12-16T03:26:02.455072+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:26:08.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-12-16T03:26:08.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.455099+0000', 'last_change': '2023-12-16T03:26:02.455099+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.455099+0000', 'last_undegraded': '2023-12-16T03:26:02.455099+0000', 'last_fullsized': '2023-12-16T03:26:02.455099+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:26:08.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-12-16T03:26:08.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.445002+0000', 'last_change': '2023-12-16T03:26:02.445002+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.445002+0000', 'last_undegraded': '2023-12-16T03:26:02.445002+0000', 'last_fullsized': '2023-12-16T03:26:02.445002+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:26:08.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-12-16T03:26:08.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.450723+0000', 'last_change': '2023-12-16T03:26:02.450723+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.450723+0000', 'last_undegraded': '2023-12-16T03:26:02.450723+0000', 'last_fullsized': '2023-12-16T03:26:02.450723+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:26:08.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-12-16T03:26:08.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.455291+0000', 'last_change': '2023-12-16T03:26:02.455291+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.455291+0000', 'last_undegraded': '2023-12-16T03:26:02.455291+0000', 'last_fullsized': '2023-12-16T03:26:02.455291+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-16T03:26:08.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-12-16T03:26:08.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.451114+0000', 'last_change': '2023-12-16T03:26:02.451114+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.451114+0000', 'last_undegraded': '2023-12-16T03:26:02.451114+0000', 'last_fullsized': '2023-12-16T03:26:02.451114+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:26:08.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-12-16T03:26:08.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.452611+0000', 'last_change': '2023-12-16T03:26:02.452611+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.452611+0000', 'last_undegraded': '2023-12-16T03:26:02.452611+0000', 'last_fullsized': '2023-12-16T03:26:02.452611+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:26:08.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-12-16T03:26:08.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.455580+0000', 'last_change': '2023-12-16T03:26:02.455580+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.455580+0000', 'last_undegraded': '2023-12-16T03:26:02.455580+0000', 'last_fullsized': '2023-12-16T03:26:02.455580+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:26:08.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-12-16T03:26:08.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.449887+0000', 'last_change': '2023-12-16T03:26:02.449887+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.449887+0000', 'last_undegraded': '2023-12-16T03:26:02.449887+0000', 'last_fullsized': '2023-12-16T03:26:02.449887+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:26:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-12-16T03:26:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.464569+0000', 'last_change': '2023-12-16T03:26:02.464569+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.464569+0000', 'last_undegraded': '2023-12-16T03:26:02.464569+0000', 'last_fullsized': '2023-12-16T03:26:02.464569+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:26:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-12-16T03:26:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.454609+0000', 'last_change': '2023-12-16T03:26:02.454609+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.454609+0000', 'last_undegraded': '2023-12-16T03:26:02.454609+0000', 'last_fullsized': '2023-12-16T03:26:02.454609+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:26:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-12-16T03:26:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.445786+0000', 'last_change': '2023-12-16T03:26:02.445786+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.445786+0000', 'last_undegraded': '2023-12-16T03:26:02.445786+0000', 'last_fullsized': '2023-12-16T03:26:02.445786+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:26:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-12-16T03:26:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.454699+0000', 'last_change': '2023-12-16T03:26:02.454699+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.454699+0000', 'last_undegraded': '2023-12-16T03:26:02.454699+0000', 'last_fullsized': '2023-12-16T03:26:02.454699+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-16T03:26:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-12-16T03:26:08.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.450561+0000', 'last_change': '2023-12-16T03:26:02.450561+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.450561+0000', 'last_undegraded': '2023-12-16T03:26:02.450561+0000', 'last_fullsized': '2023-12-16T03:26:02.450561+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:26:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-12-16T03:26:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.444964+0000', 'last_change': '2023-12-16T03:26:02.444964+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.444964+0000', 'last_undegraded': '2023-12-16T03:26:02.444964+0000', 'last_fullsized': '2023-12-16T03:26:02.444964+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:26:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-12-16T03:26:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.450772+0000', 'last_change': '2023-12-16T03:26:02.450772+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.450772+0000', 'last_undegraded': '2023-12-16T03:26:02.450772+0000', 'last_fullsized': '2023-12-16T03:26:02.450772+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:26:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-12-16T03:26:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.453842+0000', 'last_change': '2023-12-16T03:26:02.453842+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.453842+0000', 'last_undegraded': '2023-12-16T03:26:02.453842+0000', 'last_fullsized': '2023-12-16T03:26:02.453842+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:26:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-12-16T03:26:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.451495+0000', 'last_change': '2023-12-16T03:26:02.451495+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.451495+0000', 'last_undegraded': '2023-12-16T03:26:02.451495+0000', 'last_fullsized': '2023-12-16T03:26:02.451495+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:26:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-12-16T03:26:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.453743+0000', 'last_change': '2023-12-16T03:26:02.453743+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.453743+0000', 'last_undegraded': '2023-12-16T03:26:02.453743+0000', 'last_fullsized': '2023-12-16T03:26:02.453743+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:26:08.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-12-16T03:26:08.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.457767+0000', 'last_change': '2023-12-16T03:26:02.457767+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.457767+0000', 'last_undegraded': '2023-12-16T03:26:02.457767+0000', 'last_fullsized': '2023-12-16T03:26:02.457767+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-16T03:26:08.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-12-16T03:26:08.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.448732+0000', 'last_change': '2023-12-16T03:26:02.448732+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.448732+0000', 'last_undegraded': '2023-12-16T03:26:02.448732+0000', 'last_fullsized': '2023-12-16T03:26:02.448732+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:26:08.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-12-16T03:26:08.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.448834+0000', 'last_change': '2023-12-16T03:26:02.448834+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.448834+0000', 'last_undegraded': '2023-12-16T03:26:02.448834+0000', 'last_fullsized': '2023-12-16T03:26:02.448834+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:26:08.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-12-16T03:26:08.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.447166+0000', 'last_change': '2023-12-16T03:26:02.447166+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.447166+0000', 'last_undegraded': '2023-12-16T03:26:02.447166+0000', 'last_fullsized': '2023-12-16T03:26:02.447166+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-16T03:26:08.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-12-16T03:26:08.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.444970+0000', 'last_change': '2023-12-16T03:26:02.444970+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.444970+0000', 'last_undegraded': '2023-12-16T03:26:02.444970+0000', 'last_fullsized': '2023-12-16T03:26:02.444970+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.463174+0000', 'last_change': '2023-12-16T03:26:02.463174+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.463174+0000', 'last_undegraded': '2023-12-16T03:26:02.463174+0000', 'last_fullsized': '2023-12-16T03:26:02.463174+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.451052+0000', 'last_change': '2023-12-16T03:26:02.451052+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.451052+0000', 'last_undegraded': '2023-12-16T03:26:02.451052+0000', 'last_fullsized': '2023-12-16T03:26:02.451052+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.460874+0000', 'last_change': '2023-12-16T03:26:02.460874+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.460874+0000', 'last_undegraded': '2023-12-16T03:26:02.460874+0000', 'last_fullsized': '2023-12-16T03:26:02.460874+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.445333+0000', 'last_change': '2023-12-16T03:26:02.445333+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.445333+0000', 'last_undegraded': '2023-12-16T03:26:02.445333+0000', 'last_fullsized': '2023-12-16T03:26:02.445333+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.448106+0000', 'last_change': '2023-12-16T03:26:02.448106+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.448106+0000', 'last_undegraded': '2023-12-16T03:26:02.448106+0000', 'last_fullsized': '2023-12-16T03:26:02.448106+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-12-16T03:26:08.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.451895+0000', 'last_change': '2023-12-16T03:26:02.451895+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.451895+0000', 'last_undegraded': '2023-12-16T03:26:02.451895+0000', 'last_fullsized': '2023-12-16T03:26:02.451895+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:26:08.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-12-16T03:26:08.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.452514+0000', 'last_change': '2023-12-16T03:26:02.452514+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.452514+0000', 'last_undegraded': '2023-12-16T03:26:02.452514+0000', 'last_fullsized': '2023-12-16T03:26:02.452514+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:26:08.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-12-16T03:26:08.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.454851+0000', 'last_change': '2023-12-16T03:26:02.454851+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.454851+0000', 'last_undegraded': '2023-12-16T03:26:02.454851+0000', 'last_fullsized': '2023-12-16T03:26:02.454851+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:26:08.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-12-16T03:26:08.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.446356+0000', 'last_change': '2023-12-16T03:26:02.446356+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.446356+0000', 'last_undegraded': '2023-12-16T03:26:02.446356+0000', 'last_fullsized': '2023-12-16T03:26:02.446356+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-16T03:26:08.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-12-16T03:26:08.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.454034+0000', 'last_change': '2023-12-16T03:26:02.454034+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.454034+0000', 'last_undegraded': '2023-12-16T03:26:02.454034+0000', 'last_fullsized': '2023-12-16T03:26:02.454034+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:26:08.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-12-16T03:26:08.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.447295+0000', 'last_change': '2023-12-16T03:26:02.447295+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.447295+0000', 'last_undegraded': '2023-12-16T03:26:02.447295+0000', 'last_fullsized': '2023-12-16T03:26:02.447295+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.449229+0000', 'last_change': '2023-12-16T03:26:02.449229+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.449229+0000', 'last_undegraded': '2023-12-16T03:26:02.449229+0000', 'last_fullsized': '2023-12-16T03:26:02.449229+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.451342+0000', 'last_change': '2023-12-16T03:26:02.451342+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.451342+0000', 'last_undegraded': '2023-12-16T03:26:02.451342+0000', 'last_fullsized': '2023-12-16T03:26:02.451342+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.446350+0000', 'last_change': '2023-12-16T03:26:02.446350+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.446350+0000', 'last_undegraded': '2023-12-16T03:26:02.446350+0000', 'last_fullsized': '2023-12-16T03:26:02.446350+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.447222+0000', 'last_change': '2023-12-16T03:26:02.447222+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.447222+0000', 'last_undegraded': '2023-12-16T03:26:02.447222+0000', 'last_fullsized': '2023-12-16T03:26:02.447222+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.448410+0000', 'last_change': '2023-12-16T03:26:02.448410+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.448410+0000', 'last_undegraded': '2023-12-16T03:26:02.448410+0000', 'last_fullsized': '2023-12-16T03:26:02.448410+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-12-16T03:26:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.444993+0000', 'last_change': '2023-12-16T03:26:02.444993+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.444993+0000', 'last_undegraded': '2023-12-16T03:26:02.444993+0000', 'last_fullsized': '2023-12-16T03:26:02.444993+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:26:08.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-12-16T03:26:08.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.453258+0000', 'last_change': '2023-12-16T03:26:02.453258+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.453258+0000', 'last_undegraded': '2023-12-16T03:26:02.453258+0000', 'last_fullsized': '2023-12-16T03:26:02.453258+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:26:08.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-12-16T03:26:08.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.450370+0000', 'last_change': '2023-12-16T03:26:02.450370+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.450370+0000', 'last_undegraded': '2023-12-16T03:26:02.450370+0000', 'last_fullsized': '2023-12-16T03:26:02.450370+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:26:08.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-12-16T03:26:08.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.448074+0000', 'last_change': '2023-12-16T03:26:02.448074+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.448074+0000', 'last_undegraded': '2023-12-16T03:26:02.448074+0000', 'last_fullsized': '2023-12-16T03:26:02.448074+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:26:08.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-12-16T03:26:08.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.450511+0000', 'last_change': '2023-12-16T03:26:02.450511+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.450511+0000', 'last_undegraded': '2023-12-16T03:26:02.450511+0000', 'last_fullsized': '2023-12-16T03:26:02.450511+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:26:08.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-12-16T03:26:08.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.448256+0000', 'last_change': '2023-12-16T03:26:02.448256+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.448256+0000', 'last_undegraded': '2023-12-16T03:26:02.448256+0000', 'last_fullsized': '2023-12-16T03:26:02.448256+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:26:08.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-12-16T03:26:08.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.452661+0000', 'last_change': '2023-12-16T03:26:02.452661+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.452661+0000', 'last_undegraded': '2023-12-16T03:26:02.452661+0000', 'last_fullsized': '2023-12-16T03:26:02.452661+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:26:08.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-12-16T03:26:08.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.451895+0000', 'last_change': '2023-12-16T03:26:02.451895+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.451895+0000', 'last_undegraded': '2023-12-16T03:26:02.451895+0000', 'last_fullsized': '2023-12-16T03:26:02.451895+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:26:08.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-12-16T03:26:08.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.449444+0000', 'last_change': '2023-12-16T03:26:02.449444+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.449444+0000', 'last_undegraded': '2023-12-16T03:26:02.449444+0000', 'last_fullsized': '2023-12-16T03:26:02.449444+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:26:08.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-12-16T03:26:08.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.447130+0000', 'last_change': '2023-12-16T03:26:02.447130+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.447130+0000', 'last_undegraded': '2023-12-16T03:26:02.447130+0000', 'last_fullsized': '2023-12-16T03:26:02.447130+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:26:08.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-12-16T03:26:08.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.450023+0000', 'last_change': '2023-12-16T03:26:02.450023+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.450023+0000', 'last_undegraded': '2023-12-16T03:26:02.450023+0000', 'last_fullsized': '2023-12-16T03:26:02.450023+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:26:08.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-12-16T03:26:08.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.461211+0000', 'last_change': '2023-12-16T03:26:02.461211+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.461211+0000', 'last_undegraded': '2023-12-16T03:26:02.461211+0000', 'last_fullsized': '2023-12-16T03:26:02.461211+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-16T03:26:08.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-12-16T03:26:08.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.452995+0000', 'last_change': '2023-12-16T03:26:02.452995+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.452995+0000', 'last_undegraded': '2023-12-16T03:26:02.452995+0000', 'last_fullsized': '2023-12-16T03:26:02.452995+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-16T03:26:08.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-12-16T03:26:08.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.452938+0000', 'last_change': '2023-12-16T03:26:02.452938+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.452938+0000', 'last_undegraded': '2023-12-16T03:26:02.452938+0000', 'last_fullsized': '2023-12-16T03:26:02.452938+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-16T03:26:08.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-12-16T03:26:08.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.453994+0000', 'last_change': '2023-12-16T03:26:02.453994+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.453994+0000', 'last_undegraded': '2023-12-16T03:26:02.453994+0000', 'last_fullsized': '2023-12-16T03:26:02.453994+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-16T03:26:08.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-12-16T03:26:08.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.453109+0000', 'last_change': '2023-12-16T03:26:02.453109+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.453109+0000', 'last_undegraded': '2023-12-16T03:26:02.453109+0000', 'last_fullsized': '2023-12-16T03:26:02.453109+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:26:08.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-12-16T03:26:08.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.456757+0000', 'last_change': '2023-12-16T03:26:02.456757+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.456757+0000', 'last_undegraded': '2023-12-16T03:26:02.456757+0000', 'last_fullsized': '2023-12-16T03:26:02.456757+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-16T03:26:08.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-12-16T03:26:08.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.446607+0000', 'last_change': '2023-12-16T03:26:02.446607+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.446607+0000', 'last_undegraded': '2023-12-16T03:26:02.446607+0000', 'last_fullsized': '2023-12-16T03:26:02.446607+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:26:08.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-12-16T03:26:08.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.445987+0000', 'last_change': '2023-12-16T03:26:02.445987+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.445987+0000', 'last_undegraded': '2023-12-16T03:26:02.445987+0000', 'last_fullsized': '2023-12-16T03:26:02.445987+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-16T03:26:08.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-12-16T03:26:08.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.456412+0000', 'last_change': '2023-12-16T03:26:02.456412+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.456412+0000', 'last_undegraded': '2023-12-16T03:26:02.456412+0000', 'last_fullsized': '2023-12-16T03:26:02.456412+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:26:08.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-12-16T03:26:08.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.445317+0000', 'last_change': '2023-12-16T03:26:02.445317+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.445317+0000', 'last_undegraded': '2023-12-16T03:26:02.445317+0000', 'last_fullsized': '2023-12-16T03:26:02.445317+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-16T03:26:08.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-12-16T03:26:08.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.446457+0000', 'last_change': '2023-12-16T03:26:02.446457+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.446457+0000', 'last_undegraded': '2023-12-16T03:26:02.446457+0000', 'last_fullsized': '2023-12-16T03:26:02.446457+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:26:08.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-12-16T03:26:08.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.447698+0000', 'last_change': '2023-12-16T03:26:02.447698+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.447698+0000', 'last_undegraded': '2023-12-16T03:26:02.447698+0000', 'last_fullsized': '2023-12-16T03:26:02.447698+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:26:08.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-12-16T03:26:08.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:26:02.452445+0000', 'last_change': '2023-12-16T03:26:02.452445+0000', 'last_active': '2023-12-16T03:26:02.430292+0000', 'last_peered': '2023-12-16T03:26:02.430292+0000', 'last_clean': '2023-12-16T03:26:02.430292+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:26:02.452445+0000', 'last_undegraded': '2023-12-16T03:26:02.452445+0000', 'last_fullsized': '2023-12-16T03:26:02.452445+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'last_clean_scrub_stamp': '2023-12-16T03:26:02.430292+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:26:08.380 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-16T03:26:08.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.526+0000 7f30511df640 1 Processor -- start 2023-12-16T03:26:08.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.526+0000 7f30511df640 1 -- start start 2023-12-16T03:26:08.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.526+0000 7f30511df640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.526+0000 7f30511df640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0c31c0 con 0x7f304c0c63c0 2023-12-16T03:26:08.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f30511df640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0c34a0 con 0x7f304c0c4100 2023-12-16T03:26:08.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f30511df640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0c1030 con 0x7f304c0c2bb0 2023-12-16T03:26:08.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304ad9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f304c0c63c0 0x7f304c0c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45122/0 (socket says 172.21.15.28:45122) 2023-12-16T03:26:08.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304ad9d640 1 -- 172.21.15.28:0/4234866837 learned_addr learned my addr 172.21.15.28:0/4234866837 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:08.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304b59e640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514953545 0 0) 0x7f304c0c31c0 con 0x7f304c0c63c0 2023-12-16T03:26:08.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3038003530 con 0x7f304c0c63c0 2023-12-16T03:26:08.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 896327767 0 0) 0x7f3038003530 con 0x7f304c0c63c0 2023-12-16T03:26:08.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 msgr2=0x7f304c0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 >> v1:172.21.15.134:6789/0 conn(0x7f304c0c4100 legacy=0x7f304c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0c1310 con 0x7f304c0c63c0 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f303c001680 con 0x7f304c0c63c0 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 >> v1:172.21.15.28:6789/0 conn(0x7f304c0c63c0 legacy=0x7f304c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30380039b0 0x7f3038003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f30380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3038004d10 0x7f3038005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0c1030 con 0x7f30380039b0 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303800ddb0 con 0x7f3038004d10 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303800df70 con 0x7f304c0c2bb0 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304ad9d640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30380039b0 0x7f3038003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304b59e640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3038004d10 0x7f3038005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f3043fff640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f30380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304ad9d640 1 -- 172.21.15.28:0/4234866837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 msgr2=0x7f30380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:08.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304ad9d640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f30380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304ad9d640 1 -- 172.21.15.28:0/4234866837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3038004d10 msgr2=0x7f3038005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:08.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304ad9d640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3038004d10 0x7f3038005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.530+0000 7f304ad9d640 1 -- 172.21.15.28:0/4234866837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3038003530 con 0x7f30380039b0 2023-12-16T03:26:08.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f304ad9d640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30380039b0 0x7f3038003dd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c0e0 tx=0x7f303c01cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b5cca99a4a3824 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:08.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c005ae0 con 0x7f30380039b0 2023-12-16T03:26:08.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c005c40 con 0x7f30380039b0 2023-12-16T03:26:08.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f304a59c640 1 -- 172.21.15.28:0/4234866837 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c007070 con 0x7f30380039b0 2023-12-16T03:26:08.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f30511df640 1 -- 172.21.15.28:0/4234866837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30380039b0 msgr2=0x7f3038003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f30511df640 1 --2- 172.21.15.28:0/4234866837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30380039b0 0x7f3038003dd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c0e0 tx=0x7f303c01cb30 comp rx=0 tx=0).stop 2023-12-16T03:26:08.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f304b59e640 1 -- 172.21.15.28:0/4234866837 reap_dead start 2023-12-16T03:26:08.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f30511df640 1 -- 172.21.15.28:0/4234866837 shutdown_connections 2023-12-16T03:26:08.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f30511df640 1 -- 172.21.15.28:0/4234866837 >> 172.21.15.28:0/4234866837 conn(0x7f304c06a5b0 msgr2=0x7f304c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:08.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f30511df640 1 -- 172.21.15.28:0/4234866837 shutdown_connections 2023-12-16T03:26:08.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f30511df640 1 -- 172.21.15.28:0/4234866837 wait complete. 2023-12-16T03:26:08.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f30511df640 1 Processor -- start 2023-12-16T03:26:08.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.534+0000 7f30511df640 1 -- start start 2023-12-16T03:26:08.542 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30511df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30380039b0 0x7f304c0bd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.542 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30511df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c1f1210 0x7f304c155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.542 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30511df640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0bf140 0x7f304c0bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.542 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30511df640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0becb0 con 0x7f304c1f1210 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30511df640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0be3c0 con 0x7f30380039b0 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30511df640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0bd6b0 con 0x7f304c0bf140 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f3043fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c1f1210 0x7f304c155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f3043fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c1f1210 0x7f304c155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49492/0 (socket says 172.21.15.28:49492) 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f3043fff640 1 -- 172.21.15.28:0/3296836234 learned_addr learned my addr 172.21.15.28:0/3296836234 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f304ad9d640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30380039b0 0x7f304c0bd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f304b59e640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0bf140 0x7f304c0bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f3043fff640 1 -- 172.21.15.28:0/3296836234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0bf140 msgr2=0x7f304c0bf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f3043fff640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0bf140 0x7f304c0bf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f3043fff640 1 -- 172.21.15.28:0/3296836234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30380039b0 msgr2=0x7f304c0bd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f3043fff640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30380039b0 0x7f304c0bd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f3043fff640 1 -- 172.21.15.28:0/3296836234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0c69b0 con 0x7f304c1f1210 2023-12-16T03:26:08.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f3043fff640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c1f1210 0x7f304c155370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f303400f820 tx=0x7f303400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:08.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30437fe640 1 -- 172.21.15.28:0/3296836234 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034001cf0 con 0x7f304c1f1210 2023-12-16T03:26:08.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30437fe640 1 -- 172.21.15.28:0/3296836234 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30340052e0 con 0x7f304c1f1210 2023-12-16T03:26:08.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30437fe640 1 -- 172.21.15.28:0/3296836234 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303400d950 con 0x7f304c1f1210 2023-12-16T03:26:08.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30511df640 1 -- 172.21.15.28:0/3296836234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c0be660 con 0x7f304c1f1210 2023-12-16T03:26:08.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30511df640 1 -- 172.21.15.28:0/3296836234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c1558b0 con 0x7f304c1f1210 2023-12-16T03:26:08.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30511df640 1 -- 172.21.15.28:0/3296836234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c068400 con 0x7f304c1f1210 2023-12-16T03:26:08.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.538+0000 7f30437fe640 1 -- 172.21.15.28:0/3296836234 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f303400dab0 con 0x7f304c1f1210 2023-12-16T03:26:08.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.542+0000 7f30437fe640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c0664c0 0x7f302c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.542+0000 7f30437fe640 1 -- 172.21.15.28:0/3296836234 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3034083cf0 con 0x7f304c1f1210 2023-12-16T03:26:08.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.542+0000 7f304ad9d640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c0664c0 0x7f302c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.542+0000 7f304ad9d640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c0664c0 0x7f302c068980 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f303c0ab000 tx=0x7f303c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:08.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.546+0000 7f30437fe640 1 -- 172.21.15.28:0/3296836234 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f30340511e0 con 0x7f304c1f1210 2023-12-16T03:26:08.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 -- 172.21.15.28:0/3296836234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f304c0c3e70 con 0x7f304c1f1210 2023-12-16T03:26:08.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30437fe640 1 -- 172.21.15.28:0/3296836234 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1580 (secure 0 0 0) 0x7f3034054800 con 0x7f304c1f1210 2023-12-16T03:26:08.762 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:08.763 INFO:teuthology.orchestra.run.smithi028.stdout:{"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":78,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1702697102,"num_in_osds":8,"osd_in_since":1702697093,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":242196480,"bytes_avail":772851916800,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5013}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-12-16T03:26:03.808244+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-16T03:26:08.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 -- 172.21.15.28:0/3296836234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c0664c0 msgr2=0x7f302c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c0664c0 0x7f302c068980 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f303c0ab000 tx=0x7f303c0a7070 comp rx=0 tx=0).stop 2023-12-16T03:26:08.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 -- 172.21.15.28:0/3296836234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c1f1210 msgr2=0x7f304c155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c1f1210 0x7f304c155370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f303400f820 tx=0x7f303400fce0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 -- 172.21.15.28:0/3296836234 shutdown_connections 2023-12-16T03:26:08.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0bf140 0x7f304c0bf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c0664c0 0x7f302c068980 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c1f1210 0x7f304c155370 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 --2- 172.21.15.28:0/3296836234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30380039b0 0x7f304c0bd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 -- 172.21.15.28:0/3296836234 >> 172.21.15.28:0/3296836234 conn(0x7f304c06a5b0 msgr2=0x7f304c0a7060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:08.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 -- 172.21.15.28:0/3296836234 shutdown_connections 2023-12-16T03:26:08.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.758+0000 7f30511df640 1 -- 172.21.15.28:0/3296836234 wait complete. 2023-12-16T03:26:08.784 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-16T03:26:08.784 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:26:08.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed85c17640 1 Processor -- start 2023-12-16T03:26:08.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed85c17640 1 -- start start 2023-12-16T03:26:08.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed85c17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed800c63c0 0x7fed800c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed85c17640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fed800c4100 0x7fed800c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed85c17640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fed800c29e0 0x7fed800a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed85c17640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed800c31c0 con 0x7fed800c29e0 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed85c17640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed800c34a0 con 0x7fed800c4100 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed85c17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed800c1030 con 0x7fed800c63c0 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed7ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fed800c29e0 0x7fed800a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed7ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fed800c29e0 0x7fed800a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49504/0 (socket says 172.21.15.28:49504) 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed7ffff640 1 -- 172.21.15.28:0/998448205 learned_addr learned my addr 172.21.15.28:0/998448205 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed7f7fe640 1 --2- 172.21.15.28:0/998448205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed800c63c0 0x7fed800c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.922+0000 7fed7effd640 1 --2- 172.21.15.28:0/998448205 >> v2:172.21.15.134:3300/0 conn(0x7fed800c4100 0x7fed800c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed7ffff640 1 -- 172.21.15.28:0/998448205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed800c63c0 msgr2=0x7fed800c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed7ffff640 1 --2- 172.21.15.28:0/998448205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed800c63c0 0x7fed800c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed7ffff640 1 -- 172.21.15.28:0/998448205 >> v2:172.21.15.134:3300/0 conn(0x7fed800c4100 msgr2=0x7fed800c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed7ffff640 1 --2- 172.21.15.28:0/998448205 >> v2:172.21.15.134:3300/0 conn(0x7fed800c4100 0x7fed800c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed7ffff640 1 -- 172.21.15.28:0/998448205 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed800c1310 con 0x7fed800c29e0 2023-12-16T03:26:08.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed7ffff640 1 --2- 172.21.15.28:0/998448205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed800c29e0 0x7fed800a9680 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fed8006b390 tx=0x7fed7801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702d2caf0aee32e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:08.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed7e7fc640 1 -- 172.21.15.28:0/998448205 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800aa3d0 con 0x7fed800c29e0 2023-12-16T03:26:08.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed7e7fc640 1 -- 172.21.15.28:0/998448205 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed780a5720 con 0x7fed800c29e0 2023-12-16T03:26:08.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed7e7fc640 1 -- 172.21.15.28:0/998448205 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed780a5ab0 con 0x7fed800c29e0 2023-12-16T03:26:08.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed85c17640 1 -- 172.21.15.28:0/998448205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed800c29e0 msgr2=0x7fed800a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed85c17640 1 --2- 172.21.15.28:0/998448205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed800c29e0 0x7fed800a9680 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fed8006b390 tx=0x7fed7801c880 comp rx=0 tx=0).stop 2023-12-16T03:26:08.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed85c17640 1 -- 172.21.15.28:0/998448205 shutdown_connections 2023-12-16T03:26:08.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed85c17640 1 --2- 172.21.15.28:0/998448205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed800c29e0 0x7fed800a9680 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed85c17640 1 --2- 172.21.15.28:0/998448205 >> v2:172.21.15.134:3300/0 conn(0x7fed800c4100 0x7fed800c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed85c17640 1 --2- 172.21.15.28:0/998448205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed800c63c0 0x7fed800c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed85c17640 1 -- 172.21.15.28:0/998448205 >> 172.21.15.28:0/998448205 conn(0x7fed8006a5b0 msgr2=0x7fed8006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:08.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed85c17640 1 -- 172.21.15.28:0/998448205 shutdown_connections 2023-12-16T03:26:08.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.926+0000 7fed85c17640 1 -- 172.21.15.28:0/998448205 wait complete. 2023-12-16T03:26:08.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed85c17640 1 Processor -- start 2023-12-16T03:26:08.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed85c17640 1 -- start start 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed85c17640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed800c29e0 0x7fed801f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed85c17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed800c4100 0x7fed8014cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed85c17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed800c63c0 0x7fed8014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed85c17640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8014da50 con 0x7fed800c29e0 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed85c17640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed801551f0 con 0x7fed800c63c0 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed85c17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed801f0ef0 con 0x7fed800c4100 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed800c29e0 0x7fed801f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed800c29e0 0x7fed801f0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49510/0 (socket says 172.21.15.28:49510) 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7f7fe640 1 -- 172.21.15.28:0/263854754 learned_addr learned my addr 172.21.15.28:0/263854754 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7effd640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed800c4100 0x7fed8014cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7ffff640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed800c63c0 0x7fed8014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7f7fe640 1 -- 172.21.15.28:0/263854754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed800c4100 msgr2=0x7fed8014cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7f7fe640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed800c4100 0x7fed8014cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7f7fe640 1 -- 172.21.15.28:0/263854754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed800c63c0 msgr2=0x7fed8014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7f7fe640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed800c63c0 0x7fed8014d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7f7fe640 1 -- 172.21.15.28:0/263854754 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed78009b30 con 0x7fed800c29e0 2023-12-16T03:26:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7effd640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed800c4100 0x7fed8014cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed7f7fe640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed800c29e0 0x7fed801f0460 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fed7000e870 tx=0x7fed7000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed67fff640 1 -- 172.21.15.28:0/263854754 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70009510 con 0x7fed800c29e0 2023-12-16T03:26:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed67fff640 1 -- 172.21.15.28:0/263854754 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7000eec0 con 0x7fed800c29e0 2023-12-16T03:26:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed85c17640 1 -- 172.21.15.28:0/263854754 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed800c69b0 con 0x7fed800c29e0 2023-12-16T03:26:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed67fff640 1 -- 172.21.15.28:0/263854754 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7000cb40 con 0x7fed800c29e0 2023-12-16T03:26:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.930+0000 7fed85c17640 1 -- 172.21.15.28:0/263854754 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed80144450 con 0x7fed800c29e0 2023-12-16T03:26:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.934+0000 7fed85c17640 1 -- 172.21.15.28:0/263854754 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed80068400 con 0x7fed800c29e0 2023-12-16T03:26:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.934+0000 7fed67fff640 1 -- 172.21.15.28:0/263854754 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fed7000ccc0 con 0x7fed800c29e0 2023-12-16T03:26:08.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.934+0000 7fed67fff640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed6c066470 0x7fed6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:08.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.934+0000 7fed67fff640 1 -- 172.21.15.28:0/263854754 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed70083ed0 con 0x7fed800c29e0 2023-12-16T03:26:08.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.934+0000 7fed7effd640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed6c066470 0x7fed6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:08.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.934+0000 7fed7effd640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed6c066470 0x7fed6c068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed8014e620 tx=0x7fed74008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:08.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:08.938+0000 7fed67fff640 1 -- 172.21.15.28:0/263854754 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fed700513e0 con 0x7fed800c29e0 2023-12-16T03:26:09.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.094+0000 7fed85c17640 1 -- 172.21.15.28:0/263854754 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed800c03b0 con 0x7fed6c066470 2023-12-16T03:26:09.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.098+0000 7fed67fff640 1 -- 172.21.15.28:0/263854754 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259388 (secure 0 0 0) 0x7fed800c03b0 con 0x7fed6c066470 2023-12-16T03:26:09.107 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:09.108 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 -- 172.21.15.28:0/263854754 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed6c066470 msgr2=0x7fed6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed6c066470 0x7fed6c068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed8014e620 tx=0x7fed74008040 comp rx=0 tx=0).stop 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 -- 172.21.15.28:0/263854754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed800c29e0 msgr2=0x7fed801f0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed800c29e0 0x7fed801f0460 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fed7000e870 tx=0x7fed7000ec70 comp rx=0 tx=0).stop 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 -- 172.21.15.28:0/263854754 shutdown_connections 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed800c63c0 0x7fed8014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed800c4100 0x7fed8014cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed6c066470 0x7fed6c068930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 --2- 172.21.15.28:0/263854754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed800c29e0 0x7fed801f0460 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 -- 172.21.15.28:0/263854754 >> 172.21.15.28:0/263854754 conn(0x7fed8006a5b0 msgr2=0x7fed8006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 -- 172.21.15.28:0/263854754 shutdown_connections 2023-12-16T03:26:09.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:09.102+0000 7fed85c17640 1 -- 172.21.15.28:0/263854754 wait complete. 2023-12-16T03:26:09.127 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-12-16T03:26:07.808839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236520,"kb_used_data":3712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738200,"statfs":{"total":773094113280,"available":772851916800,"internally_reserved":0,"allocated":3801088,"data_stored":2153870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001040"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455072+0000","last_change":"2023-12-16T03:26:02.455072+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455072+0000","last_undegraded":"2023-12-16T03:26:02.455072+0000","last_fullsized":"2023-12-16T03:26:02.455072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455099+0000","last_change":"2023-12-16T03:26:02.455099+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455099+0000","last_undegraded":"2023-12-16T03:26:02.455099+0000","last_fullsized":"2023-12-16T03:26:02.455099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445002+0000","last_change":"2023-12-16T03:26:02.445002+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445002+0000","last_undegraded":"2023-12-16T03:26:02.445002+0000","last_fullsized":"2023-12-16T03:26:02.445002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450723+0000","last_change":"2023-12-16T03:26:02.450723+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450723+0000","last_undegraded":"2023-12-16T03:26:02.450723+0000","last_fullsized":"2023-12-16T03:26:02.450723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455291+0000","last_change":"2023-12-16T03:26:02.455291+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455291+0000","last_undegraded":"2023-12-16T03:26:02.455291+0000","last_fullsized":"2023-12-16T03:26:02.455291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451114+0000","last_change":"2023-12-16T03:26:02.451114+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451114+0000","last_undegraded":"2023-12-16T03:26:02.451114+0000","last_fullsized":"2023-12-16T03:26:02.451114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452611+0000","last_change":"2023-12-16T03:26:02.452611+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452611+0000","last_undegraded":"2023-12-16T03:26:02.452611+0000","last_fullsized":"2023-12-16T03:26:02.452611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.455580+0000","last_change":"2023-12-16T03:26:02.455580+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.455580+0000","last_undegraded":"2023-12-16T03:26:02.455580+0000","last_fullsized":"2023-12-16T03:26:02.455580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449887+0000","last_change":"2023-12-16T03:26:02.449887+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449887+0000","last_undegraded":"2023-12-16T03:26:02.449887+0000","last_fullsized":"2023-12-16T03:26:02.449887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.464569+0000","last_change":"2023-12-16T03:26:02.464569+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.464569+0000","last_undegraded":"2023-12-16T03:26:02.464569+0000","last_fullsized":"2023-12-16T03:26:02.464569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454609+0000","last_change":"2023-12-16T03:26:02.454609+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454609+0000","last_undegraded":"2023-12-16T03:26:02.454609+0000","last_fullsized":"2023-12-16T03:26:02.454609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445786+0000","last_change":"2023-12-16T03:26:02.445786+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445786+0000","last_undegraded":"2023-12-16T03:26:02.445786+0000","last_fullsized":"2023-12-16T03:26:02.445786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454699+0000","last_change":"2023-12-16T03:26:02.454699+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454699+0000","last_undegraded":"2023-12-16T03:26:02.454699+0000","last_fullsized":"2023-12-16T03:26:02.454699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450561+0000","last_change":"2023-12-16T03:26:02.450561+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450561+0000","last_undegraded":"2023-12-16T03:26:02.450561+0000","last_fullsized":"2023-12-16T03:26:02.450561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444964+0000","last_change":"2023-12-16T03:26:02.444964+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444964+0000","last_undegraded":"2023-12-16T03:26:02.444964+0000","last_fullsized":"2023-12-16T03:26:02.444964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450772+0000","last_change":"2023-12-16T03:26:02.450772+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450772+0000","last_undegraded":"2023-12-16T03:26:02.450772+0000","last_fullsized":"2023-12-16T03:26:02.450772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453842+0000","last_change":"2023-12-16T03:26:02.453842+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453842+0000","last_undegraded":"2023-12-16T03:26:02.453842+0000","last_fullsized":"2023-12-16T03:26:02.453842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451495+0000","last_change":"2023-12-16T03:26:02.451495+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451495+0000","last_undegraded":"2023-12-16T03:26:02.451495+0000","last_fullsized":"2023-12-16T03:26:02.451495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453743+0000","last_change":"2023-12-16T03:26:02.453743+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453743+0000","last_undegraded":"2023-12-16T03:26:02.453743+0000","last_fullsized":"2023-12-16T03:26:02.453743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.457767+0000","last_change":"2023-12-16T03:26:02.457767+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.457767+0000","last_undegraded":"2023-12-16T03:26:02.457767+0000","last_fullsized":"2023-12-16T03:26:02.457767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448732+0000","last_change":"2023-12-16T03:26:02.448732+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448732+0000","last_undegraded":"2023-12-16T03:26:02.448732+0000","last_fullsized":"2023-12-16T03:26:02.448732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448834+0000","last_change":"2023-12-16T03:26:02.448834+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448834+0000","last_undegraded":"2023-12-16T03:26:02.448834+0000","last_fullsized":"2023-12-16T03:26:02.448834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447166+0000","last_change":"2023-12-16T03:26:02.447166+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447166+0000","last_undegraded":"2023-12-16T03:26:02.447166+0000","last_fullsized":"2023-12-16T03:26:02.447166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444970+0000","last_change":"2023-12-16T03:26:02.444970+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444970+0000","last_undegraded":"2023-12-16T03:26:02.444970+0000","last_fullsized":"2023-12-16T03:26:02.444970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.463174+0000","last_change":"2023-12-16T03:26:02.463174+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.463174+0000","last_undegraded":"2023-12-16T03:26:02.463174+0000","last_fullsized":"2023-12-16T03:26:02.463174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451052+0000","last_change":"2023-12-16T03:26:02.451052+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451052+0000","last_undegraded":"2023-12-16T03:26:02.451052+0000","last_fullsized":"2023-12-16T03:26:02.451052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.460874+0000","last_change":"2023-12-16T03:26:02.460874+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.460874+0000","last_undegraded":"2023-12-16T03:26:02.460874+0000","last_fullsized":"2023-12-16T03:26:02.460874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445333+0000","last_change":"2023-12-16T03:26:02.445333+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445333+0000","last_undegraded":"2023-12-16T03:26:02.445333+0000","last_fullsized":"2023-12-16T03:26:02.445333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448106+0000","last_change":"2023-12-16T03:26:02.448106+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448106+0000","last_undegraded":"2023-12-16T03:26:02.448106+0000","last_fullsized":"2023-12-16T03:26:02.448106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451895+0000","last_change":"2023-12-16T03:26:02.451895+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451895+0000","last_undegraded":"2023-12-16T03:26:02.451895+0000","last_fullsized":"2023-12-16T03:26:02.451895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452514+0000","last_change":"2023-12-16T03:26:02.452514+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452514+0000","last_undegraded":"2023-12-16T03:26:02.452514+0000","last_fullsized":"2023-12-16T03:26:02.452514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454851+0000","last_change":"2023-12-16T03:26:02.454851+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454851+0000","last_undegraded":"2023-12-16T03:26:02.454851+0000","last_fullsized":"2023-12-16T03:26:02.454851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446356+0000","last_change":"2023-12-16T03:26:02.446356+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446356+0000","last_undegraded":"2023-12-16T03:26:02.446356+0000","last_fullsized":"2023-12-16T03:26:02.446356+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473417+0000","last_change":"2023-12-16T03:26:02.466777+0000","last_active":"2023-12-16T03:26:02.473417+0000","last_peered":"2023-12-16T03:26:02.473417+0000","last_clean":"2023-12-16T03:26:02.473417+0000","last_became_active":"2023-12-16T03:26:02.466486+0000","last_became_peered":"2023-12-16T03:26:02.466486+0000","last_unstale":"2023-12-16T03:26:02.473417+0000","last_undegraded":"2023-12-16T03:26:02.473417+0000","last_fullsized":"2023-12-16T03:26:02.473417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.454034+0000","last_change":"2023-12-16T03:26:02.454034+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.454034+0000","last_undegraded":"2023-12-16T03:26:02.454034+0000","last_fullsized":"2023-12-16T03:26:02.454034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465472+0000","last_change":"2023-12-16T03:26:02.464156+0000","last_active":"2023-12-16T03:26:02.465472+0000","last_peered":"2023-12-16T03:26:02.465472+0000","last_clean":"2023-12-16T03:26:02.465472+0000","last_became_active":"2023-12-16T03:26:02.463875+0000","last_became_peered":"2023-12-16T03:26:02.463875+0000","last_unstale":"2023-12-16T03:26:02.465472+0000","last_undegraded":"2023-12-16T03:26:02.465472+0000","last_fullsized":"2023-12-16T03:26:02.465472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447295+0000","last_change":"2023-12-16T03:26:02.447295+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447295+0000","last_undegraded":"2023-12-16T03:26:02.447295+0000","last_fullsized":"2023-12-16T03:26:02.447295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.478635+0000","last_change":"2023-12-16T03:26:02.475790+0000","last_active":"2023-12-16T03:26:02.478635+0000","last_peered":"2023-12-16T03:26:02.478635+0000","last_clean":"2023-12-16T03:26:02.478635+0000","last_became_active":"2023-12-16T03:26:02.475486+0000","last_became_peered":"2023-12-16T03:26:02.475486+0000","last_unstale":"2023-12-16T03:26:02.478635+0000","last_undegraded":"2023-12-16T03:26:02.478635+0000","last_fullsized":"2023-12-16T03:26:02.478635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449229+0000","last_change":"2023-12-16T03:26:02.449229+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449229+0000","last_undegraded":"2023-12-16T03:26:02.449229+0000","last_fullsized":"2023-12-16T03:26:02.449229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.476059+0000","last_change":"2023-12-16T03:26:02.473812+0000","last_active":"2023-12-16T03:26:02.476059+0000","last_peered":"2023-12-16T03:26:02.476059+0000","last_clean":"2023-12-16T03:26:02.476059+0000","last_became_active":"2023-12-16T03:26:02.473426+0000","last_became_peered":"2023-12-16T03:26:02.473426+0000","last_unstale":"2023-12-16T03:26:02.476059+0000","last_undegraded":"2023-12-16T03:26:02.476059+0000","last_fullsized":"2023-12-16T03:26:02.476059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:48.463304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451342+0000","last_change":"2023-12-16T03:26:02.451342+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451342+0000","last_undegraded":"2023-12-16T03:26:02.451342+0000","last_fullsized":"2023-12-16T03:26:02.451342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475157+0000","last_change":"2023-12-16T03:26:02.469331+0000","last_active":"2023-12-16T03:26:02.475157+0000","last_peered":"2023-12-16T03:26:02.475157+0000","last_clean":"2023-12-16T03:26:02.475157+0000","last_became_active":"2023-12-16T03:26:02.469083+0000","last_became_peered":"2023-12-16T03:26:02.469083+0000","last_unstale":"2023-12-16T03:26:02.475157+0000","last_undegraded":"2023-12-16T03:26:02.475157+0000","last_fullsized":"2023-12-16T03:26:02.475157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:02:15.539658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446350+0000","last_change":"2023-12-16T03:26:02.446350+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446350+0000","last_undegraded":"2023-12-16T03:26:02.446350+0000","last_fullsized":"2023-12-16T03:26:02.446350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475188+0000","last_change":"2023-12-16T03:26:02.472832+0000","last_active":"2023-12-16T03:26:02.475188+0000","last_peered":"2023-12-16T03:26:02.475188+0000","last_clean":"2023-12-16T03:26:02.475188+0000","last_became_active":"2023-12-16T03:26:02.472574+0000","last_became_peered":"2023-12-16T03:26:02.472574+0000","last_unstale":"2023-12-16T03:26:02.475188+0000","last_undegraded":"2023-12-16T03:26:02.475188+0000","last_fullsized":"2023-12-16T03:26:02.475188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:55:25.446606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447222+0000","last_change":"2023-12-16T03:26:02.447222+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447222+0000","last_undegraded":"2023-12-16T03:26:02.447222+0000","last_fullsized":"2023-12-16T03:26:02.447222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.471594+0000","last_change":"2023-12-16T03:26:02.467098+0000","last_active":"2023-12-16T03:26:02.471594+0000","last_peered":"2023-12-16T03:26:02.471594+0000","last_clean":"2023-12-16T03:26:02.471594+0000","last_became_active":"2023-12-16T03:26:02.464042+0000","last_became_peered":"2023-12-16T03:26:02.464042+0000","last_unstale":"2023-12-16T03:26:02.471594+0000","last_undegraded":"2023-12-16T03:26:02.471594+0000","last_fullsized":"2023-12-16T03:26:02.471594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:23:51.458474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448410+0000","last_change":"2023-12-16T03:26:02.448410+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448410+0000","last_undegraded":"2023-12-16T03:26:02.448410+0000","last_fullsized":"2023-12-16T03:26:02.448410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473421+0000","last_change":"2023-12-16T03:26:02.465231+0000","last_active":"2023-12-16T03:26:02.473421+0000","last_peered":"2023-12-16T03:26:02.473421+0000","last_clean":"2023-12-16T03:26:02.473421+0000","last_became_active":"2023-12-16T03:26:02.464573+0000","last_became_peered":"2023-12-16T03:26:02.464573+0000","last_unstale":"2023-12-16T03:26:02.473421+0000","last_undegraded":"2023-12-16T03:26:02.473421+0000","last_fullsized":"2023-12-16T03:26:02.473421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:44:36.877503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.444993+0000","last_change":"2023-12-16T03:26:02.444993+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.444993+0000","last_undegraded":"2023-12-16T03:26:02.444993+0000","last_fullsized":"2023-12-16T03:26:02.444993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.470229+0000","last_change":"2023-12-16T03:26:02.468514+0000","last_active":"2023-12-16T03:26:02.470229+0000","last_peered":"2023-12-16T03:26:02.470229+0000","last_clean":"2023-12-16T03:26:02.470229+0000","last_became_active":"2023-12-16T03:26:02.467879+0000","last_became_peered":"2023-12-16T03:26:02.467879+0000","last_unstale":"2023-12-16T03:26:02.470229+0000","last_undegraded":"2023-12-16T03:26:02.470229+0000","last_fullsized":"2023-12-16T03:26:02.470229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:19.149617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453258+0000","last_change":"2023-12-16T03:26:02.453258+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453258+0000","last_undegraded":"2023-12-16T03:26:02.453258+0000","last_fullsized":"2023-12-16T03:26:02.453258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.452298+0000","last_change":"2023-12-16T03:26:02.449876+0000","last_active":"2023-12-16T03:26:02.452298+0000","last_peered":"2023-12-16T03:26:02.452298+0000","last_clean":"2023-12-16T03:26:02.452298+0000","last_became_active":"2023-12-16T03:26:02.449358+0000","last_became_peered":"2023-12-16T03:26:02.449358+0000","last_unstale":"2023-12-16T03:26:02.452298+0000","last_undegraded":"2023-12-16T03:26:02.452298+0000","last_fullsized":"2023-12-16T03:26:02.452298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450370+0000","last_change":"2023-12-16T03:26:02.450370+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450370+0000","last_undegraded":"2023-12-16T03:26:02.450370+0000","last_fullsized":"2023-12-16T03:26:02.450370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.466050+0000","last_change":"2023-12-16T03:26:02.461467+0000","last_active":"2023-12-16T03:26:02.466050+0000","last_peered":"2023-12-16T03:26:02.466050+0000","last_clean":"2023-12-16T03:26:02.466050+0000","last_became_active":"2023-12-16T03:26:02.461144+0000","last_became_peered":"2023-12-16T03:26:02.461144+0000","last_unstale":"2023-12-16T03:26:02.466050+0000","last_undegraded":"2023-12-16T03:26:02.466050+0000","last_fullsized":"2023-12-16T03:26:02.466050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448074+0000","last_change":"2023-12-16T03:26:02.448074+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448074+0000","last_undegraded":"2023-12-16T03:26:02.448074+0000","last_fullsized":"2023-12-16T03:26:02.448074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477932+0000","last_change":"2023-12-16T03:26:02.474073+0000","last_active":"2023-12-16T03:26:02.477932+0000","last_peered":"2023-12-16T03:26:02.477932+0000","last_clean":"2023-12-16T03:26:02.477932+0000","last_became_active":"2023-12-16T03:26:02.473771+0000","last_became_peered":"2023-12-16T03:26:02.473771+0000","last_unstale":"2023-12-16T03:26:02.477932+0000","last_undegraded":"2023-12-16T03:26:02.477932+0000","last_fullsized":"2023-12-16T03:26:02.477932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:51:41.152969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450511+0000","last_change":"2023-12-16T03:26:02.450511+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450511+0000","last_undegraded":"2023-12-16T03:26:02.450511+0000","last_fullsized":"2023-12-16T03:26:02.450511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.467941+0000","last_change":"2023-12-16T03:26:02.464973+0000","last_active":"2023-12-16T03:26:02.467941+0000","last_peered":"2023-12-16T03:26:02.467941+0000","last_clean":"2023-12-16T03:26:02.467941+0000","last_became_active":"2023-12-16T03:26:02.464672+0000","last_became_peered":"2023-12-16T03:26:02.464672+0000","last_unstale":"2023-12-16T03:26:02.467941+0000","last_undegraded":"2023-12-16T03:26:02.467941+0000","last_fullsized":"2023-12-16T03:26:02.467941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:44:45.759262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.448256+0000","last_change":"2023-12-16T03:26:02.448256+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.448256+0000","last_undegraded":"2023-12-16T03:26:02.448256+0000","last_fullsized":"2023-12-16T03:26:02.448256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475711+0000","last_change":"2023-12-16T03:26:02.465815+0000","last_active":"2023-12-16T03:26:02.475711+0000","last_peered":"2023-12-16T03:26:02.475711+0000","last_clean":"2023-12-16T03:26:02.475711+0000","last_became_active":"2023-12-16T03:26:02.465505+0000","last_became_peered":"2023-12-16T03:26:02.465505+0000","last_unstale":"2023-12-16T03:26:02.475711+0000","last_undegraded":"2023-12-16T03:26:02.475711+0000","last_fullsized":"2023-12-16T03:26:02.475711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452661+0000","last_change":"2023-12-16T03:26:02.452661+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452661+0000","last_undegraded":"2023-12-16T03:26:02.452661+0000","last_fullsized":"2023-12-16T03:26:02.452661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474177+0000","last_change":"2023-12-16T03:26:02.471444+0000","last_active":"2023-12-16T03:26:02.474177+0000","last_peered":"2023-12-16T03:26:02.474177+0000","last_clean":"2023-12-16T03:26:02.474177+0000","last_became_active":"2023-12-16T03:26:02.468577+0000","last_became_peered":"2023-12-16T03:26:02.468577+0000","last_unstale":"2023-12-16T03:26:02.474177+0000","last_undegraded":"2023-12-16T03:26:02.474177+0000","last_fullsized":"2023-12-16T03:26:02.474177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.451895+0000","last_change":"2023-12-16T03:26:02.451895+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.451895+0000","last_undegraded":"2023-12-16T03:26:02.451895+0000","last_fullsized":"2023-12-16T03:26:02.451895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.478029+0000","last_change":"2023-12-16T03:26:02.475063+0000","last_active":"2023-12-16T03:26:02.478029+0000","last_peered":"2023-12-16T03:26:02.478029+0000","last_clean":"2023-12-16T03:26:02.478029+0000","last_became_active":"2023-12-16T03:26:02.474759+0000","last_became_peered":"2023-12-16T03:26:02.474759+0000","last_unstale":"2023-12-16T03:26:02.478029+0000","last_undegraded":"2023-12-16T03:26:02.478029+0000","last_fullsized":"2023-12-16T03:26:02.478029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:47.788469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.449444+0000","last_change":"2023-12-16T03:26:02.449444+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.449444+0000","last_undegraded":"2023-12-16T03:26:02.449444+0000","last_fullsized":"2023-12-16T03:26:02.449444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477863+0000","last_change":"2023-12-16T03:26:02.473227+0000","last_active":"2023-12-16T03:26:02.477863+0000","last_peered":"2023-12-16T03:26:02.477863+0000","last_clean":"2023-12-16T03:26:02.477863+0000","last_became_active":"2023-12-16T03:26:02.472888+0000","last_became_peered":"2023-12-16T03:26:02.472888+0000","last_unstale":"2023-12-16T03:26:02.477863+0000","last_undegraded":"2023-12-16T03:26:02.477863+0000","last_fullsized":"2023-12-16T03:26:02.477863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447130+0000","last_change":"2023-12-16T03:26:02.447130+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447130+0000","last_undegraded":"2023-12-16T03:26:02.447130+0000","last_fullsized":"2023-12-16T03:26:02.447130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473449+0000","last_change":"2023-12-16T03:26:02.465496+0000","last_active":"2023-12-16T03:26:02.473449+0000","last_peered":"2023-12-16T03:26:02.473449+0000","last_clean":"2023-12-16T03:26:02.473449+0000","last_became_active":"2023-12-16T03:26:02.465106+0000","last_became_peered":"2023-12-16T03:26:02.465106+0000","last_unstale":"2023-12-16T03:26:02.473449+0000","last_undegraded":"2023-12-16T03:26:02.473449+0000","last_fullsized":"2023-12-16T03:26:02.473449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:18:46.860441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.450023+0000","last_change":"2023-12-16T03:26:02.450023+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.450023+0000","last_undegraded":"2023-12-16T03:26:02.450023+0000","last_fullsized":"2023-12-16T03:26:02.450023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.467979+0000","last_change":"2023-12-16T03:26:02.462818+0000","last_active":"2023-12-16T03:26:02.467979+0000","last_peered":"2023-12-16T03:26:02.467979+0000","last_clean":"2023-12-16T03:26:02.467979+0000","last_became_active":"2023-12-16T03:26:02.462408+0000","last_became_peered":"2023-12-16T03:26:02.462408+0000","last_unstale":"2023-12-16T03:26:02.467979+0000","last_undegraded":"2023-12-16T03:26:02.467979+0000","last_fullsized":"2023-12-16T03:26:02.467979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:45:54.350741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.461211+0000","last_change":"2023-12-16T03:26:02.461211+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.461211+0000","last_undegraded":"2023-12-16T03:26:02.461211+0000","last_fullsized":"2023-12-16T03:26:02.461211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.475131+0000","last_change":"2023-12-16T03:26:02.468837+0000","last_active":"2023-12-16T03:26:02.475131+0000","last_peered":"2023-12-16T03:26:02.475131+0000","last_clean":"2023-12-16T03:26:02.475131+0000","last_became_active":"2023-12-16T03:26:02.468492+0000","last_became_peered":"2023-12-16T03:26:02.468492+0000","last_unstale":"2023-12-16T03:26:02.475131+0000","last_undegraded":"2023-12-16T03:26:02.475131+0000","last_fullsized":"2023-12-16T03:26:02.475131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:36:48.463304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452995+0000","last_change":"2023-12-16T03:26:02.452995+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452995+0000","last_undegraded":"2023-12-16T03:26:02.452995+0000","last_fullsized":"2023-12-16T03:26:02.452995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.463266+0000","last_change":"2023-12-16T03:26:02.462344+0000","last_active":"2023-12-16T03:26:02.463266+0000","last_peered":"2023-12-16T03:26:02.463266+0000","last_clean":"2023-12-16T03:26:02.463266+0000","last_became_active":"2023-12-16T03:26:02.462089+0000","last_became_peered":"2023-12-16T03:26:02.462089+0000","last_unstale":"2023-12-16T03:26:02.463266+0000","last_undegraded":"2023-12-16T03:26:02.463266+0000","last_fullsized":"2023-12-16T03:26:02.463266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:57.963393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452938+0000","last_change":"2023-12-16T03:26:02.452938+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452938+0000","last_undegraded":"2023-12-16T03:26:02.452938+0000","last_fullsized":"2023-12-16T03:26:02.452938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477418+0000","last_change":"2023-12-16T03:26:02.474673+0000","last_active":"2023-12-16T03:26:02.477418+0000","last_peered":"2023-12-16T03:26:02.477418+0000","last_clean":"2023-12-16T03:26:02.477418+0000","last_became_active":"2023-12-16T03:26:02.474398+0000","last_became_peered":"2023-12-16T03:26:02.474398+0000","last_unstale":"2023-12-16T03:26:02.477418+0000","last_undegraded":"2023-12-16T03:26:02.477418+0000","last_fullsized":"2023-12-16T03:26:02.477418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453994+0000","last_change":"2023-12-16T03:26:02.453994+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453994+0000","last_undegraded":"2023-12-16T03:26:02.453994+0000","last_fullsized":"2023-12-16T03:26:02.453994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477126+0000","last_change":"2023-12-16T03:26:02.473193+0000","last_active":"2023-12-16T03:26:02.477126+0000","last_peered":"2023-12-16T03:26:02.477126+0000","last_clean":"2023-12-16T03:26:02.477126+0000","last_became_active":"2023-12-16T03:26:02.472836+0000","last_became_peered":"2023-12-16T03:26:02.472836+0000","last_unstale":"2023-12-16T03:26:02.477126+0000","last_undegraded":"2023-12-16T03:26:02.477126+0000","last_fullsized":"2023-12-16T03:26:02.477126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:21:40.835921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.453109+0000","last_change":"2023-12-16T03:26:02.453109+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.453109+0000","last_undegraded":"2023-12-16T03:26:02.453109+0000","last_fullsized":"2023-12-16T03:26:02.453109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465898+0000","last_change":"2023-12-16T03:26:02.456879+0000","last_active":"2023-12-16T03:26:02.465898+0000","last_peered":"2023-12-16T03:26:02.465898+0000","last_clean":"2023-12-16T03:26:02.465898+0000","last_became_active":"2023-12-16T03:26:02.456571+0000","last_became_peered":"2023-12-16T03:26:02.456571+0000","last_unstale":"2023-12-16T03:26:02.465898+0000","last_undegraded":"2023-12-16T03:26:02.465898+0000","last_fullsized":"2023-12-16T03:26:02.465898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.456757+0000","last_change":"2023-12-16T03:26:02.456757+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.456757+0000","last_undegraded":"2023-12-16T03:26:02.456757+0000","last_fullsized":"2023-12-16T03:26:02.456757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.476026+0000","last_change":"2023-12-16T03:26:02.472212+0000","last_active":"2023-12-16T03:26:02.476026+0000","last_peered":"2023-12-16T03:26:02.476026+0000","last_clean":"2023-12-16T03:26:02.476026+0000","last_became_active":"2023-12-16T03:26:02.471791+0000","last_became_peered":"2023-12-16T03:26:02.471791+0000","last_unstale":"2023-12-16T03:26:02.476026+0000","last_undegraded":"2023-12-16T03:26:02.476026+0000","last_fullsized":"2023-12-16T03:26:02.476026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:49.113512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446607+0000","last_change":"2023-12-16T03:26:02.446607+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446607+0000","last_undegraded":"2023-12-16T03:26:02.446607+0000","last_fullsized":"2023-12-16T03:26:02.446607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.477243+0000","last_change":"2023-12-16T03:26:02.476238+0000","last_active":"2023-12-16T03:26:02.477243+0000","last_peered":"2023-12-16T03:26:02.477243+0000","last_clean":"2023-12-16T03:26:02.477243+0000","last_became_active":"2023-12-16T03:26:02.475844+0000","last_became_peered":"2023-12-16T03:26:02.475844+0000","last_unstale":"2023-12-16T03:26:02.477243+0000","last_undegraded":"2023-12-16T03:26:02.477243+0000","last_fullsized":"2023-12-16T03:26:02.477243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:23:51.458474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445987+0000","last_change":"2023-12-16T03:26:02.445987+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445987+0000","last_undegraded":"2023-12-16T03:26:02.445987+0000","last_fullsized":"2023-12-16T03:26:02.445987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474844+0000","last_change":"2023-12-16T03:26:02.465084+0000","last_active":"2023-12-16T03:26:02.474844+0000","last_peered":"2023-12-16T03:26:02.474844+0000","last_clean":"2023-12-16T03:26:02.474844+0000","last_became_active":"2023-12-16T03:26:02.464706+0000","last_became_peered":"2023-12-16T03:26:02.464706+0000","last_unstale":"2023-12-16T03:26:02.474844+0000","last_undegraded":"2023-12-16T03:26:02.474844+0000","last_fullsized":"2023-12-16T03:26:02.474844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.456412+0000","last_change":"2023-12-16T03:26:02.456412+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.456412+0000","last_undegraded":"2023-12-16T03:26:02.456412+0000","last_fullsized":"2023-12-16T03:26:02.456412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.459970+0000","last_change":"2023-12-16T03:26:02.456023+0000","last_active":"2023-12-16T03:26:02.459970+0000","last_peered":"2023-12-16T03:26:02.459970+0000","last_clean":"2023-12-16T03:26:02.459970+0000","last_became_active":"2023-12-16T03:26:02.455703+0000","last_became_peered":"2023-12-16T03:26:02.455703+0000","last_unstale":"2023-12-16T03:26:02.459970+0000","last_undegraded":"2023-12-16T03:26:02.459970+0000","last_fullsized":"2023-12-16T03:26:02.459970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.445317+0000","last_change":"2023-12-16T03:26:02.445317+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.445317+0000","last_undegraded":"2023-12-16T03:26:02.445317+0000","last_fullsized":"2023-12-16T03:26:02.445317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.474463+0000","last_change":"2023-12-16T03:26:02.462695+0000","last_active":"2023-12-16T03:26:02.474463+0000","last_peered":"2023-12-16T03:26:02.474463+0000","last_clean":"2023-12-16T03:26:02.474463+0000","last_became_active":"2023-12-16T03:26:02.461706+0000","last_became_peered":"2023-12-16T03:26:02.461706+0000","last_unstale":"2023-12-16T03:26:02.474463+0000","last_undegraded":"2023-12-16T03:26:02.474463+0000","last_fullsized":"2023-12-16T03:26:02.474463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:03:33.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.446457+0000","last_change":"2023-12-16T03:26:02.446457+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.446457+0000","last_undegraded":"2023-12-16T03:26:02.446457+0000","last_fullsized":"2023-12-16T03:26:02.446457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.465414+0000","last_change":"2023-12-16T03:26:02.459691+0000","last_active":"2023-12-16T03:26:02.465414+0000","last_peered":"2023-12-16T03:26:02.465414+0000","last_clean":"2023-12-16T03:26:02.465414+0000","last_became_active":"2023-12-16T03:26:02.458861+0000","last_became_peered":"2023-12-16T03:26:02.458861+0000","last_unstale":"2023-12-16T03:26:02.465414+0000","last_undegraded":"2023-12-16T03:26:02.465414+0000","last_fullsized":"2023-12-16T03:26:02.465414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:53:57.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.447698+0000","last_change":"2023-12-16T03:26:02.447698+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.447698+0000","last_undegraded":"2023-12-16T03:26:02.447698+0000","last_fullsized":"2023-12-16T03:26:02.447698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.470194+0000","last_change":"2023-12-16T03:26:02.468114+0000","last_active":"2023-12-16T03:26:02.470194+0000","last_peered":"2023-12-16T03:26:02.470194+0000","last_clean":"2023-12-16T03:26:02.470194+0000","last_became_active":"2023-12-16T03:26:02.467813+0000","last_became_peered":"2023-12-16T03:26:02.467813+0000","last_unstale":"2023-12-16T03:26:02.470194+0000","last_undegraded":"2023-12-16T03:26:02.470194+0000","last_fullsized":"2023-12-16T03:26:02.470194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:33.098551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-12-16T03:26:02.452445+0000","last_change":"2023-12-16T03:26:02.452445+0000","last_active":"2023-12-16T03:26:02.430292+0000","last_peered":"2023-12-16T03:26:02.430292+0000","last_clean":"2023-12-16T03:26:02.430292+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:26:02.452445+0000","last_undegraded":"2023-12-16T03:26:02.452445+0000","last_fullsized":"2023-12-16T03:26:02.452445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-16T03:26:02.473697+0000","last_change":"2023-12-16T03:26:02.467483+0000","last_active":"2023-12-16T03:26:02.473697+0000","last_peered":"2023-12-16T03:26:02.473697+0000","last_clean":"2023-12-16T03:26:02.473697+0000","last_became_active":"2023-12-16T03:26:02.467186+0000","last_became_peered":"2023-12-16T03:26:02.467186+0000","last_unstale":"2023-12-16T03:26:02.473697+0000","last_undegraded":"2023-12-16T03:26:02.473697+0000","last_fullsized":"2023-12-16T03:26:02.473697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-16T03:26:01.437045+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:26:01.437045+0000","last_peered":"2023-12-16T03:26:01.437045+0000","last_clean":"2023-12-16T03:26:01.437045+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:26:01.437045+0000","last_undegraded":"2023-12-16T03:26:01.437045+0000","last_fullsized":"2023-12-16T03:26:01.437045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":710443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":126342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":120075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":710443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:26:12.132 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:26:12.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79b5172640 1 Processor -- start 2023-12-16T03:26:12.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79b5172640 1 -- start start 2023-12-16T03:26:12.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79b5172640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79b00725c0 0x7f79b01516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79b5172640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b00c2760 con 0x7f79b00a5370 2023-12-16T03:26:12.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79b5172640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b00a5750 con 0x7f79b0072090 2023-12-16T03:26:12.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79b5172640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b00c3070 con 0x7f79b00725c0 2023-12-16T03:26:12.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79aed9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f79b00a5370 0x7f79b00c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:35048/0 (socket says 172.21.15.28:35048) 2023-12-16T03:26:12.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79aed9d640 1 -- 172.21.15.28:0/4279372184 learned_addr learned my addr 172.21.15.28:0/4279372184 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:12.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063430507 0 0) 0x7f79b00c2760 con 0x7f79b00a5370 2023-12-16T03:26:12.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79af59e640 1 --2- 172.21.15.28:0/4279372184 >> v2:172.21.15.134:3300/0 conn(0x7f79b00725c0 0x7f79b01516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f799c003530 con 0x7f79b00a5370 2023-12-16T03:26:12.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1766950819 0 0) 0x7f799c003530 con 0x7f79b00a5370 2023-12-16T03:26:12.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 >> v2:172.21.15.134:3300/0 conn(0x7f79b00725c0 msgr2=0x7f79b01516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:12.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79ae59c640 1 --2- 172.21.15.28:0/4279372184 >> v2:172.21.15.134:3300/0 conn(0x7f79b00725c0 0x7f79b01516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 >> v1:172.21.15.134:6789/0 conn(0x7f79b0072090 legacy=0x7f79b0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.281+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00aad20 con 0x7f79b00a5370 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f79a0001680 con 0x7f79b00a5370 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 >> v1:172.21.15.28:6789/0 conn(0x7f79b00a5370 legacy=0x7f79b00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79ae59c640 1 --2- 172.21.15.28:0/4279372184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f799c003980 0x7f799c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79ae59c640 1 --2- 172.21.15.28:0/4279372184 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f799c0047d0 0x7f799c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79ae59c640 1 --2- 172.21.15.28:0/4279372184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c005190 0x7f799c00caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00c3070 con 0x7f799c003980 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c00d1f0 con 0x7f799c005190 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c00d3b0 con 0x7f799c0047d0 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79aed9d640 1 --2- 172.21.15.28:0/4279372184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f799c003980 0x7f799c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79af59e640 1 --2- 172.21.15.28:0/4279372184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c005190 0x7f799c00caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79a7fff640 1 --2- 172.21.15.28:0/4279372184 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f799c0047d0 0x7f799c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79aed9d640 1 -- 172.21.15.28:0/4279372184 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f799c0047d0 msgr2=0x7f799c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79aed9d640 1 --2- 172.21.15.28:0/4279372184 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f799c0047d0 0x7f799c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79aed9d640 1 -- 172.21.15.28:0/4279372184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c005190 msgr2=0x7f799c00caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:12.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79aed9d640 1 --2- 172.21.15.28:0/4279372184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c005190 0x7f799c00caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79aed9d640 1 -- 172.21.15.28:0/4279372184 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c003530 con 0x7f799c003980 2023-12-16T03:26:12.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79af59e640 1 -- 172.21.15.28:0/4279372184 reap_dead start 2023-12-16T03:26:12.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.285+0000 7f79aed9d640 1 --2- 172.21.15.28:0/4279372184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f799c003980 0x7f799c003d60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f79a000c210 tx=0x7f79a001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15db8c60aa4c8f1d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:12.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0005ae0 con 0x7f799c003980 2023-12-16T03:26:12.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a0005c60 con 0x7f799c003980 2023-12-16T03:26:12.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79ae59c640 1 -- 172.21.15.28:0/4279372184 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a00a5a50 con 0x7f799c003980 2023-12-16T03:26:12.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 -- 172.21.15.28:0/4279372184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f799c003980 msgr2=0x7f799c003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 --2- 172.21.15.28:0/4279372184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f799c003980 0x7f799c003d60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f79a000c210 tx=0x7f79a001cbb0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 -- 172.21.15.28:0/4279372184 shutdown_connections 2023-12-16T03:26:12.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 --2- 172.21.15.28:0/4279372184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f799c003980 0x7f799c003d60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 -- 172.21.15.28:0/4279372184 >> 172.21.15.28:0/4279372184 conn(0x7f79b006a5b0 msgr2=0x7f79b006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:12.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 -- 172.21.15.28:0/4279372184 shutdown_connections 2023-12-16T03:26:12.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 -- 172.21.15.28:0/4279372184 wait complete. 2023-12-16T03:26:12.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 Processor -- start 2023-12-16T03:26:12.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 -- start start 2023-12-16T03:26:12.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c003980 0x7f79b00a8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79b01ed530 0x7f79b014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79b014c0b0 0x7f79b0071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00a6a70 con 0x7f79b01ed530 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00a7a90 con 0x7f799c003980 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79b5172640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b01f0d60 con 0x7f79b014c0b0 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79a7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79b01ed530 0x7f79b014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.289+0000 7f79aed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c003980 0x7f79b00a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79af59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79b014c0b0 0x7f79b0071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79aed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c003980 0x7f79b00a8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:59558/0 (socket says 172.21.15.28:59558) 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79aed9d640 1 -- 172.21.15.28:0/1324926650 learned_addr learned my addr 172.21.15.28:0/1324926650 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79a7fff640 1 -- 172.21.15.28:0/1324926650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79b014c0b0 msgr2=0x7f79b0071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79a7fff640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79b014c0b0 0x7f79b0071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79a7fff640 1 -- 172.21.15.28:0/1324926650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c003980 msgr2=0x7f79b00a8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79a7fff640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c003980 0x7f79b00a8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79a7fff640 1 -- 172.21.15.28:0/1324926650 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b01ed0a0 con 0x7f79b01ed530 2023-12-16T03:26:12.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79a7fff640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79b01ed530 0x7f79b014bb70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f799800f7c0 tx=0x7f799800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:12.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79a77fe640 1 -- 172.21.15.28:0/1324926650 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998005110 con 0x7f79b01ed530 2023-12-16T03:26:12.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79a77fe640 1 -- 172.21.15.28:0/1324926650 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7998005270 con 0x7f79b01ed530 2023-12-16T03:26:12.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79a77fe640 1 -- 172.21.15.28:0/1324926650 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998007050 con 0x7f79b01ed530 2023-12-16T03:26:12.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79b5172640 1 -- 172.21.15.28:0/1324926650 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b01f07e0 con 0x7f79b01ed530 2023-12-16T03:26:12.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79b5172640 1 -- 172.21.15.28:0/1324926650 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b01eca50 con 0x7f79b01ed530 2023-12-16T03:26:12.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79b5172640 1 -- 172.21.15.28:0/1324926650 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b01ec8b0 con 0x7f79b01ed530 2023-12-16T03:26:12.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.293+0000 7f79a77fe640 1 -- 172.21.15.28:0/1324926650 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f79980071b0 con 0x7f79b01ed530 2023-12-16T03:26:12.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.297+0000 7f79a77fe640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79900664a0 0x7f7990068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.297+0000 7f79a77fe640 1 -- 172.21.15.28:0/1324926650 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7998083370 con 0x7f79b01ed530 2023-12-16T03:26:12.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.297+0000 7f79aed9d640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79900664a0 0x7f7990068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.297+0000 7f79aed9d640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79900664a0 0x7f7990068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f79b0150710 tx=0x7f79a00b1040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:12.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.301+0000 7f79a77fe640 1 -- 172.21.15.28:0/1324926650 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f79b01ec8b0 con 0x7f79b01ed530 2023-12-16T03:26:12.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.457+0000 7f79b5172640 1 -- 172.21.15.28:0/1324926650 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79b01ec8b0 con 0x7f79900664a0 2023-12-16T03:26:12.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.465+0000 7f79a77fe640 1 -- 172.21.15.28:0/1324926650 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289329 (secure 0 0 0) 0x7f79b01ec8b0 con 0x7f79900664a0 2023-12-16T03:26:12.474 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:12.475 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:26:12.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 -- 172.21.15.28:0/1324926650 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79900664a0 msgr2=0x7f7990068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79900664a0 0x7f7990068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f79b0150710 tx=0x7f79a00b1040 comp rx=0 tx=0).stop 2023-12-16T03:26:12.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 -- 172.21.15.28:0/1324926650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79b01ed530 msgr2=0x7f79b014bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79b01ed530 0x7f79b014bb70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f799800f7c0 tx=0x7f799800fc80 comp rx=0 tx=0).stop 2023-12-16T03:26:12.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 -- 172.21.15.28:0/1324926650 shutdown_connections 2023-12-16T03:26:12.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79b014c0b0 0x7f79b0071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79900664a0 0x7f7990068960 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79b01ed530 0x7f79b014bb70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 --2- 172.21.15.28:0/1324926650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f799c003980 0x7f79b00a8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 -- 172.21.15.28:0/1324926650 >> 172.21.15.28:0/1324926650 conn(0x7f79b006a5b0 msgr2=0x7f79b006d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:12.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 -- 172.21.15.28:0/1324926650 shutdown_connections 2023-12-16T03:26:12.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.469+0000 7f79b5172640 1 -- 172.21.15.28:0/1324926650 wait complete. 2023-12-16T03:26:12.494 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2023-12-16T03:26:11.809813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236840,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737880,"statfs":{"total":773094113280,"available":772851589120,"internally_reserved":0,"allocated":4136960,"data_stored":2300892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.368198"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983691+0000","last_change":"2023-12-16T03:26:03.471860+0000","last_active":"2023-12-16T03:26:04.983691+0000","last_peered":"2023-12-16T03:26:04.983691+0000","last_clean":"2023-12-16T03:26:04.983691+0000","last_became_active":"2023-12-16T03:26:03.470857+0000","last_became_peered":"2023-12-16T03:26:03.470857+0000","last_unstale":"2023-12-16T03:26:04.983691+0000","last_undegraded":"2023-12-16T03:26:04.983691+0000","last_fullsized":"2023-12-16T03:26:04.983691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:02.166310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467467+0000","last_change":"2023-12-16T03:26:03.484118+0000","last_active":"2023-12-16T03:26:04.467467+0000","last_peered":"2023-12-16T03:26:04.467467+0000","last_clean":"2023-12-16T03:26:04.467467+0000","last_became_active":"2023-12-16T03:26:03.483621+0000","last_became_peered":"2023-12-16T03:26:03.483621+0000","last_unstale":"2023-12-16T03:26:04.467467+0000","last_undegraded":"2023-12-16T03:26:04.467467+0000","last_fullsized":"2023-12-16T03:26:04.467467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.515046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467955+0000","last_change":"2023-12-16T03:26:03.463854+0000","last_active":"2023-12-16T03:26:04.467955+0000","last_peered":"2023-12-16T03:26:04.467955+0000","last_clean":"2023-12-16T03:26:04.467955+0000","last_became_active":"2023-12-16T03:26:03.463146+0000","last_became_peered":"2023-12-16T03:26:03.463146+0000","last_unstale":"2023-12-16T03:26:04.467955+0000","last_undegraded":"2023-12-16T03:26:04.467955+0000","last_fullsized":"2023-12-16T03:26:04.467955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:26.451963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.984041+0000","last_change":"2023-12-16T03:26:03.477293+0000","last_active":"2023-12-16T03:26:04.984041+0000","last_peered":"2023-12-16T03:26:04.984041+0000","last_clean":"2023-12-16T03:26:04.984041+0000","last_became_active":"2023-12-16T03:26:03.476572+0000","last_became_peered":"2023-12-16T03:26:03.476572+0000","last_unstale":"2023-12-16T03:26:04.984041+0000","last_undegraded":"2023-12-16T03:26:04.984041+0000","last_fullsized":"2023-12-16T03:26:04.984041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:50.606603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983502+0000","last_change":"2023-12-16T03:26:03.468853+0000","last_active":"2023-12-16T03:26:04.983502+0000","last_peered":"2023-12-16T03:26:04.983502+0000","last_clean":"2023-12-16T03:26:04.983502+0000","last_became_active":"2023-12-16T03:26:03.468601+0000","last_became_peered":"2023-12-16T03:26:03.468601+0000","last_unstale":"2023-12-16T03:26:04.983502+0000","last_undegraded":"2023-12-16T03:26:04.983502+0000","last_fullsized":"2023-12-16T03:26:04.983502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:58.967330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.466927+0000","last_change":"2023-12-16T03:26:03.484378+0000","last_active":"2023-12-16T03:26:04.466927+0000","last_peered":"2023-12-16T03:26:04.466927+0000","last_clean":"2023-12-16T03:26:04.466927+0000","last_became_active":"2023-12-16T03:26:03.484145+0000","last_became_peered":"2023-12-16T03:26:03.484145+0000","last_unstale":"2023-12-16T03:26:04.466927+0000","last_undegraded":"2023-12-16T03:26:04.466927+0000","last_fullsized":"2023-12-16T03:26:04.466927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:47:58.231120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983122+0000","last_change":"2023-12-16T03:26:03.475485+0000","last_active":"2023-12-16T03:26:04.983122+0000","last_peered":"2023-12-16T03:26:04.983122+0000","last_clean":"2023-12-16T03:26:04.983122+0000","last_became_active":"2023-12-16T03:26:03.474992+0000","last_became_peered":"2023-12-16T03:26:03.474992+0000","last_unstale":"2023-12-16T03:26:04.983122+0000","last_undegraded":"2023-12-16T03:26:04.983122+0000","last_fullsized":"2023-12-16T03:26:04.983122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:26.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.982780+0000","last_change":"2023-12-16T03:26:03.468531+0000","last_active":"2023-12-16T03:26:04.982780+0000","last_peered":"2023-12-16T03:26:04.982780+0000","last_clean":"2023-12-16T03:26:04.982780+0000","last_became_active":"2023-12-16T03:26:03.468087+0000","last_became_peered":"2023-12-16T03:26:03.468087+0000","last_unstale":"2023-12-16T03:26:04.982780+0000","last_undegraded":"2023-12-16T03:26:04.982780+0000","last_fullsized":"2023-12-16T03:26:04.982780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:24:48.750612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.469686+0000","last_change":"2023-12-16T03:26:03.470373+0000","last_active":"2023-12-16T03:26:04.469686+0000","last_peered":"2023-12-16T03:26:04.469686+0000","last_clean":"2023-12-16T03:26:04.469686+0000","last_became_active":"2023-12-16T03:26:03.470054+0000","last_became_peered":"2023-12-16T03:26:03.470054+0000","last_unstale":"2023-12-16T03:26:04.469686+0000","last_undegraded":"2023-12-16T03:26:04.469686+0000","last_fullsized":"2023-12-16T03:26:04.469686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:50.606603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.984517+0000","last_change":"2023-12-16T03:26:03.484306+0000","last_active":"2023-12-16T03:26:04.984517+0000","last_peered":"2023-12-16T03:26:04.984517+0000","last_clean":"2023-12-16T03:26:04.984517+0000","last_became_active":"2023-12-16T03:26:03.484039+0000","last_became_peered":"2023-12-16T03:26:03.484039+0000","last_unstale":"2023-12-16T03:26:04.984517+0000","last_undegraded":"2023-12-16T03:26:04.984517+0000","last_fullsized":"2023-12-16T03:26:04.984517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:24:48.750612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983212+0000","last_change":"2023-12-16T03:26:03.470445+0000","last_active":"2023-12-16T03:26:04.983212+0000","last_peered":"2023-12-16T03:26:04.983212+0000","last_clean":"2023-12-16T03:26:04.983212+0000","last_became_active":"2023-12-16T03:26:03.470102+0000","last_became_peered":"2023-12-16T03:26:03.470102+0000","last_unstale":"2023-12-16T03:26:04.983212+0000","last_undegraded":"2023-12-16T03:26:04.983212+0000","last_fullsized":"2023-12-16T03:26:04.983212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:26.451963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.468183+0000","last_change":"2023-12-16T03:26:03.479988+0000","last_active":"2023-12-16T03:26:04.468183+0000","last_peered":"2023-12-16T03:26:04.468183+0000","last_clean":"2023-12-16T03:26:04.468183+0000","last_became_active":"2023-12-16T03:26:03.479695+0000","last_became_peered":"2023-12-16T03:26:03.479695+0000","last_unstale":"2023-12-16T03:26:04.468183+0000","last_undegraded":"2023-12-16T03:26:04.468183+0000","last_fullsized":"2023-12-16T03:26:04.468183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:21.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983418+0000","last_change":"2023-12-16T03:26:03.465388+0000","last_active":"2023-12-16T03:26:04.983418+0000","last_peered":"2023-12-16T03:26:04.983418+0000","last_clean":"2023-12-16T03:26:04.983418+0000","last_became_active":"2023-12-16T03:26:03.464429+0000","last_became_peered":"2023-12-16T03:26:03.464429+0000","last_unstale":"2023-12-16T03:26:04.983418+0000","last_undegraded":"2023-12-16T03:26:04.983418+0000","last_fullsized":"2023-12-16T03:26:04.983418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:58.471344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.466952+0000","last_change":"2023-12-16T03:26:03.475323+0000","last_active":"2023-12-16T03:26:04.466952+0000","last_peered":"2023-12-16T03:26:04.466952+0000","last_clean":"2023-12-16T03:26:04.466952+0000","last_became_active":"2023-12-16T03:26:03.475008+0000","last_became_peered":"2023-12-16T03:26:03.475008+0000","last_unstale":"2023-12-16T03:26:04.466952+0000","last_undegraded":"2023-12-16T03:26:04.466952+0000","last_fullsized":"2023-12-16T03:26:04.466952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:21.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467315+0000","last_change":"2023-12-16T03:26:03.461119+0000","last_active":"2023-12-16T03:26:04.467315+0000","last_peered":"2023-12-16T03:26:04.467315+0000","last_clean":"2023-12-16T03:26:04.467315+0000","last_became_active":"2023-12-16T03:26:03.460789+0000","last_became_peered":"2023-12-16T03:26:03.460789+0000","last_unstale":"2023-12-16T03:26:04.467315+0000","last_undegraded":"2023-12-16T03:26:04.467315+0000","last_fullsized":"2023-12-16T03:26:04.467315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:49:54.036423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983320+0000","last_change":"2023-12-16T03:26:03.475298+0000","last_active":"2023-12-16T03:26:04.983320+0000","last_peered":"2023-12-16T03:26:04.983320+0000","last_clean":"2023-12-16T03:26:04.983320+0000","last_became_active":"2023-12-16T03:26:03.475023+0000","last_became_peered":"2023-12-16T03:26:03.475023+0000","last_unstale":"2023-12-16T03:26:04.983320+0000","last_undegraded":"2023-12-16T03:26:04.983320+0000","last_fullsized":"2023-12-16T03:26:04.983320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:47:58.231120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983383+0000","last_change":"2023-12-16T03:26:03.470602+0000","last_active":"2023-12-16T03:26:04.983383+0000","last_peered":"2023-12-16T03:26:04.983383+0000","last_clean":"2023-12-16T03:26:04.983383+0000","last_became_active":"2023-12-16T03:26:03.465595+0000","last_became_peered":"2023-12-16T03:26:03.465595+0000","last_unstale":"2023-12-16T03:26:04.983383+0000","last_undegraded":"2023-12-16T03:26:04.983383+0000","last_fullsized":"2023-12-16T03:26:04.983383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:02.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467487+0000","last_change":"2023-12-16T03:26:03.478015+0000","last_active":"2023-12-16T03:26:04.467487+0000","last_peered":"2023-12-16T03:26:04.467487+0000","last_clean":"2023-12-16T03:26:04.467487+0000","last_became_active":"2023-12-16T03:26:03.477762+0000","last_became_peered":"2023-12-16T03:26:03.477762+0000","last_unstale":"2023-12-16T03:26:04.467487+0000","last_undegraded":"2023-12-16T03:26:04.467487+0000","last_fullsized":"2023-12-16T03:26:04.467487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:23:26.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467204+0000","last_change":"2023-12-16T03:26:03.483084+0000","last_active":"2023-12-16T03:26:04.467204+0000","last_peered":"2023-12-16T03:26:04.467204+0000","last_clean":"2023-12-16T03:26:04.467204+0000","last_became_active":"2023-12-16T03:26:03.479314+0000","last_became_peered":"2023-12-16T03:26:03.479314+0000","last_unstale":"2023-12-16T03:26:04.467204+0000","last_undegraded":"2023-12-16T03:26:04.467204+0000","last_fullsized":"2023-12-16T03:26:04.467204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:54.768138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983823+0000","last_change":"2023-12-16T03:26:03.471216+0000","last_active":"2023-12-16T03:26:04.983823+0000","last_peered":"2023-12-16T03:26:04.983823+0000","last_clean":"2023-12-16T03:26:04.983823+0000","last_became_active":"2023-12-16T03:26:03.470906+0000","last_became_peered":"2023-12-16T03:26:03.470906+0000","last_unstale":"2023-12-16T03:26:04.983823+0000","last_undegraded":"2023-12-16T03:26:04.983823+0000","last_fullsized":"2023-12-16T03:26:04.983823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:23:52.462412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.469081+0000","last_change":"2023-12-16T03:26:03.485028+0000","last_active":"2023-12-16T03:26:04.469081+0000","last_peered":"2023-12-16T03:26:04.469081+0000","last_clean":"2023-12-16T03:26:04.469081+0000","last_became_active":"2023-12-16T03:26:03.484817+0000","last_became_peered":"2023-12-16T03:26:03.484817+0000","last_unstale":"2023-12-16T03:26:04.469081+0000","last_undegraded":"2023-12-16T03:26:04.469081+0000","last_fullsized":"2023-12-16T03:26:04.469081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:34.342031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.468947+0000","last_change":"2023-12-16T03:26:03.476899+0000","last_active":"2023-12-16T03:26:04.468947+0000","last_peered":"2023-12-16T03:26:04.468947+0000","last_clean":"2023-12-16T03:26:04.468947+0000","last_became_active":"2023-12-16T03:26:03.476444+0000","last_became_peered":"2023-12-16T03:26:03.476444+0000","last_unstale":"2023-12-16T03:26:04.468947+0000","last_undegraded":"2023-12-16T03:26:04.468947+0000","last_fullsized":"2023-12-16T03:26:04.468947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:02.166310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.984184+0000","last_change":"2023-12-16T03:26:03.472522+0000","last_active":"2023-12-16T03:26:04.984184+0000","last_peered":"2023-12-16T03:26:04.984184+0000","last_clean":"2023-12-16T03:26:04.984184+0000","last_became_active":"2023-12-16T03:26:03.472310+0000","last_became_peered":"2023-12-16T03:26:03.472310+0000","last_unstale":"2023-12-16T03:26:04.984184+0000","last_undegraded":"2023-12-16T03:26:04.984184+0000","last_fullsized":"2023-12-16T03:26:04.984184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:02.166310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467221+0000","last_change":"2023-12-16T03:26:03.466573+0000","last_active":"2023-12-16T03:26:04.467221+0000","last_peered":"2023-12-16T03:26:04.467221+0000","last_clean":"2023-12-16T03:26:04.467221+0000","last_became_active":"2023-12-16T03:26:03.463565+0000","last_became_peered":"2023-12-16T03:26:03.463565+0000","last_unstale":"2023-12-16T03:26:04.467221+0000","last_undegraded":"2023-12-16T03:26:04.467221+0000","last_fullsized":"2023-12-16T03:26:04.467221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:47.050435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.985012+0000","last_change":"2023-12-16T03:26:03.480210+0000","last_active":"2023-12-16T03:26:04.985012+0000","last_peered":"2023-12-16T03:26:04.985012+0000","last_clean":"2023-12-16T03:26:04.985012+0000","last_became_active":"2023-12-16T03:26:03.479763+0000","last_became_peered":"2023-12-16T03:26:03.479763+0000","last_unstale":"2023-12-16T03:26:04.985012+0000","last_undegraded":"2023-12-16T03:26:04.985012+0000","last_fullsized":"2023-12-16T03:26:04.985012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:47.050435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467600+0000","last_change":"2023-12-16T03:26:03.480845+0000","last_active":"2023-12-16T03:26:04.467600+0000","last_peered":"2023-12-16T03:26:04.467600+0000","last_clean":"2023-12-16T03:26:04.467600+0000","last_became_active":"2023-12-16T03:26:03.480622+0000","last_became_peered":"2023-12-16T03:26:03.480622+0000","last_unstale":"2023-12-16T03:26:04.467600+0000","last_undegraded":"2023-12-16T03:26:04.467600+0000","last_fullsized":"2023-12-16T03:26:04.467600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:38.877161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.984326+0000","last_change":"2023-12-16T03:26:03.470354+0000","last_active":"2023-12-16T03:26:04.984326+0000","last_peered":"2023-12-16T03:26:04.984326+0000","last_clean":"2023-12-16T03:26:04.984326+0000","last_became_active":"2023-12-16T03:26:03.469032+0000","last_became_peered":"2023-12-16T03:26:03.469032+0000","last_unstale":"2023-12-16T03:26:04.984326+0000","last_undegraded":"2023-12-16T03:26:04.984326+0000","last_fullsized":"2023-12-16T03:26:04.984326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:02.717527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467799+0000","last_change":"2023-12-16T03:26:03.460615+0000","last_active":"2023-12-16T03:26:04.467799+0000","last_peered":"2023-12-16T03:26:04.467799+0000","last_clean":"2023-12-16T03:26:04.467799+0000","last_became_active":"2023-12-16T03:26:03.460298+0000","last_became_peered":"2023-12-16T03:26:03.460298+0000","last_unstale":"2023-12-16T03:26:04.467799+0000","last_undegraded":"2023-12-16T03:26:04.467799+0000","last_fullsized":"2023-12-16T03:26:04.467799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:17.425373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.469155+0000","last_change":"2023-12-16T03:26:03.461340+0000","last_active":"2023-12-16T03:26:04.469155+0000","last_peered":"2023-12-16T03:26:04.469155+0000","last_clean":"2023-12-16T03:26:04.469155+0000","last_became_active":"2023-12-16T03:26:03.459869+0000","last_became_peered":"2023-12-16T03:26:03.459869+0000","last_unstale":"2023-12-16T03:26:04.469155+0000","last_undegraded":"2023-12-16T03:26:04.469155+0000","last_fullsized":"2023-12-16T03:26:04.469155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:54.963780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.982930+0000","last_change":"2023-12-16T03:26:03.469084+0000","last_active":"2023-12-16T03:26:04.982930+0000","last_peered":"2023-12-16T03:26:04.982930+0000","last_clean":"2023-12-16T03:26:04.982930+0000","last_became_active":"2023-12-16T03:26:03.467963+0000","last_became_peered":"2023-12-16T03:26:03.467963+0000","last_unstale":"2023-12-16T03:26:04.982930+0000","last_undegraded":"2023-12-16T03:26:04.982930+0000","last_fullsized":"2023-12-16T03:26:04.982930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:47.050435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983077+0000","last_change":"2023-12-16T03:26:03.469300+0000","last_active":"2023-12-16T03:26:04.983077+0000","last_peered":"2023-12-16T03:26:04.983077+0000","last_clean":"2023-12-16T03:26:04.983077+0000","last_became_active":"2023-12-16T03:26:03.468972+0000","last_became_peered":"2023-12-16T03:26:03.468972+0000","last_unstale":"2023-12-16T03:26:04.983077+0000","last_undegraded":"2023-12-16T03:26:04.983077+0000","last_fullsized":"2023-12-16T03:26:04.983077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:51.930122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983427+0000","last_change":"2023-12-16T03:26:03.466192+0000","last_active":"2023-12-16T03:26:04.983427+0000","last_peered":"2023-12-16T03:26:04.983427+0000","last_clean":"2023-12-16T03:26:04.983427+0000","last_became_active":"2023-12-16T03:26:03.465781+0000","last_became_peered":"2023-12-16T03:26:03.465781+0000","last_unstale":"2023-12-16T03:26:04.983427+0000","last_undegraded":"2023-12-16T03:26:04.983427+0000","last_fullsized":"2023-12-16T03:26:04.983427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:54.768138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.984684+0000","last_change":"2023-12-16T03:26:03.480845+0000","last_active":"2023-12-16T03:26:04.984684+0000","last_peered":"2023-12-16T03:26:04.984684+0000","last_clean":"2023-12-16T03:26:04.984684+0000","last_became_active":"2023-12-16T03:26:03.477465+0000","last_became_peered":"2023-12-16T03:26:03.477465+0000","last_unstale":"2023-12-16T03:26:04.984684+0000","last_undegraded":"2023-12-16T03:26:04.984684+0000","last_fullsized":"2023-12-16T03:26:04.984684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:54.963780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.475607+0000","last_change":"2023-12-16T03:26:02.466777+0000","last_active":"2023-12-16T03:26:03.475607+0000","last_peered":"2023-12-16T03:26:03.475607+0000","last_clean":"2023-12-16T03:26:03.475607+0000","last_became_active":"2023-12-16T03:26:02.466486+0000","last_became_peered":"2023-12-16T03:26:02.466486+0000","last_unstale":"2023-12-16T03:26:03.475607+0000","last_undegraded":"2023-12-16T03:26:03.475607+0000","last_fullsized":"2023-12-16T03:26:03.475607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983906+0000","last_change":"2023-12-16T03:26:03.470105+0000","last_active":"2023-12-16T03:26:04.983906+0000","last_peered":"2023-12-16T03:26:04.983906+0000","last_clean":"2023-12-16T03:26:04.983906+0000","last_became_active":"2023-12-16T03:26:03.469690+0000","last_became_peered":"2023-12-16T03:26:03.469690+0000","last_unstale":"2023-12-16T03:26:04.983906+0000","last_undegraded":"2023-12-16T03:26:04.983906+0000","last_fullsized":"2023-12-16T03:26:04.983906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:54.963780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.488850+0000","last_change":"2023-12-16T03:26:02.464156+0000","last_active":"2023-12-16T03:26:03.488850+0000","last_peered":"2023-12-16T03:26:03.488850+0000","last_clean":"2023-12-16T03:26:03.488850+0000","last_became_active":"2023-12-16T03:26:02.463875+0000","last_became_peered":"2023-12-16T03:26:02.463875+0000","last_unstale":"2023-12-16T03:26:03.488850+0000","last_undegraded":"2023-12-16T03:26:03.488850+0000","last_fullsized":"2023-12-16T03:26:03.488850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.469381+0000","last_change":"2023-12-16T03:26:03.459560+0000","last_active":"2023-12-16T03:26:04.469381+0000","last_peered":"2023-12-16T03:26:04.469381+0000","last_clean":"2023-12-16T03:26:04.469381+0000","last_became_active":"2023-12-16T03:26:03.459280+0000","last_became_peered":"2023-12-16T03:26:03.459280+0000","last_unstale":"2023-12-16T03:26:04.469381+0000","last_undegraded":"2023-12-16T03:26:04.469381+0000","last_fullsized":"2023-12-16T03:26:04.469381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:49.203240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.488635+0000","last_change":"2023-12-16T03:26:02.475790+0000","last_active":"2023-12-16T03:26:03.488635+0000","last_peered":"2023-12-16T03:26:03.488635+0000","last_clean":"2023-12-16T03:26:03.488635+0000","last_became_active":"2023-12-16T03:26:02.475486+0000","last_became_peered":"2023-12-16T03:26:02.475486+0000","last_unstale":"2023-12-16T03:26:03.488635+0000","last_undegraded":"2023-12-16T03:26:03.488635+0000","last_fullsized":"2023-12-16T03:26:03.488635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:46.046497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.984380+0000","last_change":"2023-12-16T03:26:03.472003+0000","last_active":"2023-12-16T03:26:04.984380+0000","last_peered":"2023-12-16T03:26:04.984380+0000","last_clean":"2023-12-16T03:26:04.984380+0000","last_became_active":"2023-12-16T03:26:03.468759+0000","last_became_peered":"2023-12-16T03:26:03.468759+0000","last_unstale":"2023-12-16T03:26:04.984380+0000","last_undegraded":"2023-12-16T03:26:04.984380+0000","last_fullsized":"2023-12-16T03:26:04.984380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:20:30.016150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.468056+0000","last_change":"2023-12-16T03:26:02.473812+0000","last_active":"2023-12-16T03:26:03.468056+0000","last_peered":"2023-12-16T03:26:03.468056+0000","last_clean":"2023-12-16T03:26:03.468056+0000","last_became_active":"2023-12-16T03:26:02.473426+0000","last_became_peered":"2023-12-16T03:26:02.473426+0000","last_unstale":"2023-12-16T03:26:03.468056+0000","last_undegraded":"2023-12-16T03:26:03.468056+0000","last_fullsized":"2023-12-16T03:26:03.468056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:03:40.485273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.982984+0000","last_change":"2023-12-16T03:26:03.469292+0000","last_active":"2023-12-16T03:26:04.982984+0000","last_peered":"2023-12-16T03:26:04.982984+0000","last_clean":"2023-12-16T03:26:04.982984+0000","last_became_active":"2023-12-16T03:26:03.468311+0000","last_became_peered":"2023-12-16T03:26:03.468311+0000","last_unstale":"2023-12-16T03:26:04.982984+0000","last_undegraded":"2023-12-16T03:26:04.982984+0000","last_fullsized":"2023-12-16T03:26:04.982984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:49:54.036423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.488968+0000","last_change":"2023-12-16T03:26:02.469331+0000","last_active":"2023-12-16T03:26:03.488968+0000","last_peered":"2023-12-16T03:26:03.488968+0000","last_clean":"2023-12-16T03:26:03.488968+0000","last_became_active":"2023-12-16T03:26:02.469083+0000","last_became_peered":"2023-12-16T03:26:02.469083+0000","last_unstale":"2023-12-16T03:26:03.488968+0000","last_undegraded":"2023-12-16T03:26:03.488968+0000","last_fullsized":"2023-12-16T03:26:03.488968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:03:33.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.468326+0000","last_change":"2023-12-16T03:26:03.479561+0000","last_active":"2023-12-16T03:26:04.468326+0000","last_peered":"2023-12-16T03:26:04.468326+0000","last_clean":"2023-12-16T03:26:04.468326+0000","last_became_active":"2023-12-16T03:26:03.478239+0000","last_became_peered":"2023-12-16T03:26:03.478239+0000","last_unstale":"2023-12-16T03:26:04.468326+0000","last_undegraded":"2023-12-16T03:26:04.468326+0000","last_fullsized":"2023-12-16T03:26:04.468326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:54.768138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.483277+0000","last_change":"2023-12-16T03:26:02.472832+0000","last_active":"2023-12-16T03:26:03.483277+0000","last_peered":"2023-12-16T03:26:03.483277+0000","last_clean":"2023-12-16T03:26:03.483277+0000","last_became_active":"2023-12-16T03:26:02.472574+0000","last_became_peered":"2023-12-16T03:26:02.472574+0000","last_unstale":"2023-12-16T03:26:03.483277+0000","last_undegraded":"2023-12-16T03:26:03.483277+0000","last_fullsized":"2023-12-16T03:26:03.483277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:19.149617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.468085+0000","last_change":"2023-12-16T03:26:03.457030+0000","last_active":"2023-12-16T03:26:04.468085+0000","last_peered":"2023-12-16T03:26:04.468085+0000","last_clean":"2023-12-16T03:26:04.468085+0000","last_became_active":"2023-12-16T03:26:03.456705+0000","last_became_peered":"2023-12-16T03:26:03.456705+0000","last_unstale":"2023-12-16T03:26:04.468085+0000","last_undegraded":"2023-12-16T03:26:04.468085+0000","last_fullsized":"2023-12-16T03:26:04.468085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:51.930122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.459589+0000","last_change":"2023-12-16T03:26:02.467098+0000","last_active":"2023-12-16T03:26:03.459589+0000","last_peered":"2023-12-16T03:26:03.459589+0000","last_clean":"2023-12-16T03:26:03.459589+0000","last_became_active":"2023-12-16T03:26:02.464042+0000","last_became_peered":"2023-12-16T03:26:02.464042+0000","last_unstale":"2023-12-16T03:26:03.459589+0000","last_undegraded":"2023-12-16T03:26:03.459589+0000","last_fullsized":"2023-12-16T03:26:03.459589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:02.312606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983545+0000","last_change":"2023-12-16T03:26:03.471650+0000","last_active":"2023-12-16T03:26:04.983545+0000","last_peered":"2023-12-16T03:26:04.983545+0000","last_clean":"2023-12-16T03:26:04.983545+0000","last_became_active":"2023-12-16T03:26:03.471351+0000","last_became_peered":"2023-12-16T03:26:03.471351+0000","last_unstale":"2023-12-16T03:26:04.983545+0000","last_undegraded":"2023-12-16T03:26:04.983545+0000","last_fullsized":"2023-12-16T03:26:04.983545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:49.203240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.445652+0000","last_change":"2023-12-16T03:26:02.465231+0000","last_active":"2023-12-16T03:26:03.445652+0000","last_peered":"2023-12-16T03:26:03.445652+0000","last_clean":"2023-12-16T03:26:03.445652+0000","last_became_active":"2023-12-16T03:26:02.464573+0000","last_became_peered":"2023-12-16T03:26:02.464573+0000","last_unstale":"2023-12-16T03:26:03.445652+0000","last_undegraded":"2023-12-16T03:26:03.445652+0000","last_fullsized":"2023-12-16T03:26:03.445652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.468193+0000","last_change":"2023-12-16T03:26:03.479982+0000","last_active":"2023-12-16T03:26:04.468193+0000","last_peered":"2023-12-16T03:26:04.468193+0000","last_clean":"2023-12-16T03:26:04.468193+0000","last_became_active":"2023-12-16T03:26:03.479683+0000","last_became_peered":"2023-12-16T03:26:03.479683+0000","last_unstale":"2023-12-16T03:26:04.468193+0000","last_undegraded":"2023-12-16T03:26:04.468193+0000","last_fullsized":"2023-12-16T03:26:04.468193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:02.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.467267+0000","last_change":"2023-12-16T03:26:02.468514+0000","last_active":"2023-12-16T03:26:03.467267+0000","last_peered":"2023-12-16T03:26:03.467267+0000","last_clean":"2023-12-16T03:26:03.467267+0000","last_became_active":"2023-12-16T03:26:02.467879+0000","last_became_peered":"2023-12-16T03:26:02.467879+0000","last_unstale":"2023-12-16T03:26:03.467267+0000","last_undegraded":"2023-12-16T03:26:03.467267+0000","last_fullsized":"2023-12-16T03:26:03.467267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:49:53.032485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467484+0000","last_change":"2023-12-16T03:26:03.477278+0000","last_active":"2023-12-16T03:26:04.467484+0000","last_peered":"2023-12-16T03:26:04.467484+0000","last_clean":"2023-12-16T03:26:04.467484+0000","last_became_active":"2023-12-16T03:26:03.476986+0000","last_became_peered":"2023-12-16T03:26:03.476986+0000","last_unstale":"2023-12-16T03:26:04.467484+0000","last_undegraded":"2023-12-16T03:26:04.467484+0000","last_fullsized":"2023-12-16T03:26:04.467484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:48.840305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.444244+0000","last_change":"2023-12-16T03:26:02.449876+0000","last_active":"2023-12-16T03:26:03.444244+0000","last_peered":"2023-12-16T03:26:03.444244+0000","last_clean":"2023-12-16T03:26:03.444244+0000","last_became_active":"2023-12-16T03:26:02.449358+0000","last_became_peered":"2023-12-16T03:26:02.449358+0000","last_unstale":"2023-12-16T03:26:03.444244+0000","last_undegraded":"2023-12-16T03:26:03.444244+0000","last_fullsized":"2023-12-16T03:26:03.444244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:31.574264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467239+0000","last_change":"2023-12-16T03:26:03.477196+0000","last_active":"2023-12-16T03:26:04.467239+0000","last_peered":"2023-12-16T03:26:04.467239+0000","last_clean":"2023-12-16T03:26:04.467239+0000","last_became_active":"2023-12-16T03:26:03.473620+0000","last_became_peered":"2023-12-16T03:26:03.473620+0000","last_unstale":"2023-12-16T03:26:04.467239+0000","last_undegraded":"2023-12-16T03:26:04.467239+0000","last_fullsized":"2023-12-16T03:26:04.467239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:57:09.113670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.482413+0000","last_change":"2023-12-16T03:26:02.461467+0000","last_active":"2023-12-16T03:26:03.482413+0000","last_peered":"2023-12-16T03:26:03.482413+0000","last_clean":"2023-12-16T03:26:03.482413+0000","last_became_active":"2023-12-16T03:26:02.461144+0000","last_became_peered":"2023-12-16T03:26:02.461144+0000","last_unstale":"2023-12-16T03:26:03.482413+0000","last_undegraded":"2023-12-16T03:26:03.482413+0000","last_fullsized":"2023-12-16T03:26:03.482413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:02.312606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467957+0000","last_change":"2023-12-16T03:26:03.464062+0000","last_active":"2023-12-16T03:26:04.467957+0000","last_peered":"2023-12-16T03:26:04.467957+0000","last_clean":"2023-12-16T03:26:04.467957+0000","last_became_active":"2023-12-16T03:26:03.463527+0000","last_became_peered":"2023-12-16T03:26:03.463527+0000","last_unstale":"2023-12-16T03:26:04.467957+0000","last_undegraded":"2023-12-16T03:26:04.467957+0000","last_fullsized":"2023-12-16T03:26:04.467957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:58:06.441852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.493126+0000","last_change":"2023-12-16T03:26:02.474073+0000","last_active":"2023-12-16T03:26:03.493126+0000","last_peered":"2023-12-16T03:26:03.493126+0000","last_clean":"2023-12-16T03:26:03.493126+0000","last_became_active":"2023-12-16T03:26:02.473771+0000","last_became_peered":"2023-12-16T03:26:02.473771+0000","last_unstale":"2023-12-16T03:26:03.493126+0000","last_undegraded":"2023-12-16T03:26:03.493126+0000","last_fullsized":"2023-12-16T03:26:03.493126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:16.421435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983674+0000","last_change":"2023-12-16T03:26:03.478499+0000","last_active":"2023-12-16T03:26:04.983674+0000","last_peered":"2023-12-16T03:26:04.983674+0000","last_clean":"2023-12-16T03:26:04.983674+0000","last_became_active":"2023-12-16T03:26:03.478234+0000","last_became_peered":"2023-12-16T03:26:03.478234+0000","last_unstale":"2023-12-16T03:26:04.983674+0000","last_undegraded":"2023-12-16T03:26:04.983674+0000","last_fullsized":"2023-12-16T03:26:04.983674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:54:09.793159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.478679+0000","last_change":"2023-12-16T03:26:02.464973+0000","last_active":"2023-12-16T03:26:03.478679+0000","last_peered":"2023-12-16T03:26:03.478679+0000","last_clean":"2023-12-16T03:26:03.478679+0000","last_became_active":"2023-12-16T03:26:02.464672+0000","last_became_peered":"2023-12-16T03:26:02.464672+0000","last_unstale":"2023-12-16T03:26:03.478679+0000","last_undegraded":"2023-12-16T03:26:03.478679+0000","last_fullsized":"2023-12-16T03:26:03.478679+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467167+0000","last_change":"2023-12-16T03:26:03.488277+0000","last_active":"2023-12-16T03:26:04.467167+0000","last_peered":"2023-12-16T03:26:04.467167+0000","last_clean":"2023-12-16T03:26:04.467167+0000","last_became_active":"2023-12-16T03:26:03.488021+0000","last_became_peered":"2023-12-16T03:26:03.488021+0000","last_unstale":"2023-12-16T03:26:04.467167+0000","last_undegraded":"2023-12-16T03:26:04.467167+0000","last_fullsized":"2023-12-16T03:26:04.467167+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:02.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.455429+0000","last_change":"2023-12-16T03:26:02.465815+0000","last_active":"2023-12-16T03:26:03.455429+0000","last_peered":"2023-12-16T03:26:03.455429+0000","last_clean":"2023-12-16T03:26:03.455429+0000","last_became_active":"2023-12-16T03:26:02.465505+0000","last_became_peered":"2023-12-16T03:26:02.465505+0000","last_unstale":"2023-12-16T03:26:03.455429+0000","last_undegraded":"2023-12-16T03:26:03.455429+0000","last_fullsized":"2023-12-16T03:26:03.455429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:50.926184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.982985+0000","last_change":"2023-12-16T03:26:03.470996+0000","last_active":"2023-12-16T03:26:04.982985+0000","last_peered":"2023-12-16T03:26:04.982985+0000","last_clean":"2023-12-16T03:26:04.982985+0000","last_became_active":"2023-12-16T03:26:03.465985+0000","last_became_peered":"2023-12-16T03:26:03.465985+0000","last_unstale":"2023-12-16T03:26:04.982985+0000","last_undegraded":"2023-12-16T03:26:04.982985+0000","last_fullsized":"2023-12-16T03:26:04.982985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:17.425373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.459720+0000","last_change":"2023-12-16T03:26:02.471444+0000","last_active":"2023-12-16T03:26:03.459720+0000","last_peered":"2023-12-16T03:26:03.459720+0000","last_clean":"2023-12-16T03:26:03.459720+0000","last_became_active":"2023-12-16T03:26:02.468577+0000","last_became_peered":"2023-12-16T03:26:02.468577+0000","last_unstale":"2023-12-16T03:26:03.459720+0000","last_undegraded":"2023-12-16T03:26:03.459720+0000","last_fullsized":"2023-12-16T03:26:03.459720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:01.713589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983357+0000","last_change":"2023-12-16T03:26:03.461431+0000","last_active":"2023-12-16T03:26:04.983357+0000","last_peered":"2023-12-16T03:26:04.983357+0000","last_clean":"2023-12-16T03:26:04.983357+0000","last_became_active":"2023-12-16T03:26:03.460669+0000","last_became_peered":"2023-12-16T03:26:03.460669+0000","last_unstale":"2023-12-16T03:26:04.983357+0000","last_undegraded":"2023-12-16T03:26:04.983357+0000","last_fullsized":"2023-12-16T03:26:04.983357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:05:14.653208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.485759+0000","last_change":"2023-12-16T03:26:02.475063+0000","last_active":"2023-12-16T03:26:03.485759+0000","last_peered":"2023-12-16T03:26:03.485759+0000","last_clean":"2023-12-16T03:26:03.485759+0000","last_became_active":"2023-12-16T03:26:02.474759+0000","last_became_peered":"2023-12-16T03:26:02.474759+0000","last_unstale":"2023-12-16T03:26:03.485759+0000","last_undegraded":"2023-12-16T03:26:03.485759+0000","last_fullsized":"2023-12-16T03:26:03.485759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:20:29.012213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.469566+0000","last_change":"2023-12-16T03:26:03.463781+0000","last_active":"2023-12-16T03:26:04.469566+0000","last_peered":"2023-12-16T03:26:04.469566+0000","last_clean":"2023-12-16T03:26:04.469566+0000","last_became_active":"2023-12-16T03:26:03.463448+0000","last_became_peered":"2023-12-16T03:26:03.463448+0000","last_unstale":"2023-12-16T03:26:04.469566+0000","last_undegraded":"2023-12-16T03:26:04.469566+0000","last_fullsized":"2023-12-16T03:26:04.469566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:54:09.793159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.489239+0000","last_change":"2023-12-16T03:26:02.473227+0000","last_active":"2023-12-16T03:26:03.489239+0000","last_peered":"2023-12-16T03:26:03.489239+0000","last_clean":"2023-12-16T03:26:03.489239+0000","last_became_active":"2023-12-16T03:26:02.472888+0000","last_became_peered":"2023-12-16T03:26:02.472888+0000","last_unstale":"2023-12-16T03:26:03.489239+0000","last_undegraded":"2023-12-16T03:26:03.489239+0000","last_fullsized":"2023-12-16T03:26:03.489239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:33.338093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467855+0000","last_change":"2023-12-16T03:26:03.468251+0000","last_active":"2023-12-16T03:26:04.467855+0000","last_peered":"2023-12-16T03:26:04.467855+0000","last_clean":"2023-12-16T03:26:04.467855+0000","last_became_active":"2023-12-16T03:26:03.467778+0000","last_became_peered":"2023-12-16T03:26:03.467778+0000","last_unstale":"2023-12-16T03:26:04.467855+0000","last_undegraded":"2023-12-16T03:26:04.467855+0000","last_fullsized":"2023-12-16T03:26:04.467855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:26.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.478189+0000","last_change":"2023-12-16T03:26:02.465496+0000","last_active":"2023-12-16T03:26:03.478189+0000","last_peered":"2023-12-16T03:26:03.478189+0000","last_clean":"2023-12-16T03:26:03.478189+0000","last_became_active":"2023-12-16T03:26:02.465106+0000","last_became_peered":"2023-12-16T03:26:02.465106+0000","last_unstale":"2023-12-16T03:26:03.478189+0000","last_undegraded":"2023-12-16T03:26:03.478189+0000","last_fullsized":"2023-12-16T03:26:03.478189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:47.788469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.984061+0000","last_change":"2023-12-16T03:26:03.467717+0000","last_active":"2023-12-16T03:26:04.984061+0000","last_peered":"2023-12-16T03:26:04.984061+0000","last_clean":"2023-12-16T03:26:04.984061+0000","last_became_active":"2023-12-16T03:26:03.467375+0000","last_became_peered":"2023-12-16T03:26:03.467375+0000","last_unstale":"2023-12-16T03:26:04.984061+0000","last_undegraded":"2023-12-16T03:26:04.984061+0000","last_fullsized":"2023-12-16T03:26:04.984061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:03.316544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.475955+0000","last_change":"2023-12-16T03:26:02.462818+0000","last_active":"2023-12-16T03:26:03.475955+0000","last_peered":"2023-12-16T03:26:03.475955+0000","last_clean":"2023-12-16T03:26:03.475955+0000","last_became_active":"2023-12-16T03:26:02.462408+0000","last_became_peered":"2023-12-16T03:26:02.462408+0000","last_unstale":"2023-12-16T03:26:03.475955+0000","last_undegraded":"2023-12-16T03:26:03.475955+0000","last_fullsized":"2023-12-16T03:26:03.475955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:03:40.485273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983385+0000","last_change":"2023-12-16T03:26:03.478083+0000","last_active":"2023-12-16T03:26:04.983385+0000","last_peered":"2023-12-16T03:26:04.983385+0000","last_clean":"2023-12-16T03:26:04.983385+0000","last_became_active":"2023-12-16T03:26:03.477716+0000","last_became_peered":"2023-12-16T03:26:03.477716+0000","last_unstale":"2023-12-16T03:26:04.983385+0000","last_undegraded":"2023-12-16T03:26:04.983385+0000","last_fullsized":"2023-12-16T03:26:04.983385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:57.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.447203+0000","last_change":"2023-12-16T03:26:02.468837+0000","last_active":"2023-12-16T03:26:03.447203+0000","last_peered":"2023-12-16T03:26:03.447203+0000","last_clean":"2023-12-16T03:26:03.447203+0000","last_became_active":"2023-12-16T03:26:02.468492+0000","last_became_peered":"2023-12-16T03:26:02.468492+0000","last_unstale":"2023-12-16T03:26:03.447203+0000","last_undegraded":"2023-12-16T03:26:03.447203+0000","last_fullsized":"2023-12-16T03:26:03.447203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:51:41.152969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983378+0000","last_change":"2023-12-16T03:26:03.465370+0000","last_active":"2023-12-16T03:26:04.983378+0000","last_peered":"2023-12-16T03:26:04.983378+0000","last_clean":"2023-12-16T03:26:04.983378+0000","last_became_active":"2023-12-16T03:26:03.464404+0000","last_became_peered":"2023-12-16T03:26:03.464404+0000","last_unstale":"2023-12-16T03:26:04.983378+0000","last_undegraded":"2023-12-16T03:26:04.983378+0000","last_fullsized":"2023-12-16T03:26:04.983378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:03:34.552057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.486431+0000","last_change":"2023-12-16T03:26:02.462344+0000","last_active":"2023-12-16T03:26:03.486431+0000","last_peered":"2023-12-16T03:26:03.486431+0000","last_clean":"2023-12-16T03:26:03.486431+0000","last_became_active":"2023-12-16T03:26:02.462089+0000","last_became_peered":"2023-12-16T03:26:02.462089+0000","last_unstale":"2023-12-16T03:26:03.486431+0000","last_undegraded":"2023-12-16T03:26:03.486431+0000","last_fullsized":"2023-12-16T03:26:03.486431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983526+0000","last_change":"2023-12-16T03:26:03.488357+0000","last_active":"2023-12-16T03:26:04.983526+0000","last_peered":"2023-12-16T03:26:04.983526+0000","last_clean":"2023-12-16T03:26:04.983526+0000","last_became_active":"2023-12-16T03:26:03.488037+0000","last_became_peered":"2023-12-16T03:26:03.488037+0000","last_unstale":"2023-12-16T03:26:04.983526+0000","last_undegraded":"2023-12-16T03:26:04.983526+0000","last_fullsized":"2023-12-16T03:26:04.983526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:50.117449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.453699+0000","last_change":"2023-12-16T03:26:02.474673+0000","last_active":"2023-12-16T03:26:03.453699+0000","last_peered":"2023-12-16T03:26:03.453699+0000","last_clean":"2023-12-16T03:26:03.453699+0000","last_became_active":"2023-12-16T03:26:02.474398+0000","last_became_peered":"2023-12-16T03:26:02.474398+0000","last_unstale":"2023-12-16T03:26:03.453699+0000","last_undegraded":"2023-12-16T03:26:03.453699+0000","last_fullsized":"2023-12-16T03:26:03.453699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:19.149617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983133+0000","last_change":"2023-12-16T03:26:03.474142+0000","last_active":"2023-12-16T03:26:04.983133+0000","last_peered":"2023-12-16T03:26:04.983133+0000","last_clean":"2023-12-16T03:26:04.983133+0000","last_became_active":"2023-12-16T03:26:03.472456+0000","last_became_peered":"2023-12-16T03:26:03.472456+0000","last_unstale":"2023-12-16T03:26:04.983133+0000","last_undegraded":"2023-12-16T03:26:04.983133+0000","last_fullsized":"2023-12-16T03:26:04.983133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:34.845852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.449343+0000","last_change":"2023-12-16T03:26:02.473193+0000","last_active":"2023-12-16T03:26:03.449343+0000","last_peered":"2023-12-16T03:26:03.449343+0000","last_clean":"2023-12-16T03:26:03.449343+0000","last_became_active":"2023-12-16T03:26:02.472836+0000","last_became_peered":"2023-12-16T03:26:02.472836+0000","last_unstale":"2023-12-16T03:26:03.449343+0000","last_undegraded":"2023-12-16T03:26:03.449343+0000","last_fullsized":"2023-12-16T03:26:03.449343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983271+0000","last_change":"2023-12-16T03:26:03.474960+0000","last_active":"2023-12-16T03:26:04.983271+0000","last_peered":"2023-12-16T03:26:04.983271+0000","last_clean":"2023-12-16T03:26:04.983271+0000","last_became_active":"2023-12-16T03:26:03.474646+0000","last_became_peered":"2023-12-16T03:26:03.474646+0000","last_unstale":"2023-12-16T03:26:04.983271+0000","last_undegraded":"2023-12-16T03:26:04.983271+0000","last_fullsized":"2023-12-16T03:26:04.983271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:58:06.441852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.449111+0000","last_change":"2023-12-16T03:26:02.456879+0000","last_active":"2023-12-16T03:26:03.449111+0000","last_peered":"2023-12-16T03:26:03.449111+0000","last_clean":"2023-12-16T03:26:03.449111+0000","last_became_active":"2023-12-16T03:26:02.456571+0000","last_became_peered":"2023-12-16T03:26:02.456571+0000","last_unstale":"2023-12-16T03:26:03.449111+0000","last_undegraded":"2023-12-16T03:26:03.449111+0000","last_fullsized":"2023-12-16T03:26:03.449111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:20:29.012213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983294+0000","last_change":"2023-12-16T03:26:03.465923+0000","last_active":"2023-12-16T03:26:04.983294+0000","last_peered":"2023-12-16T03:26:04.983294+0000","last_clean":"2023-12-16T03:26:04.983294+0000","last_became_active":"2023-12-16T03:26:03.464781+0000","last_became_peered":"2023-12-16T03:26:03.464781+0000","last_unstale":"2023-12-16T03:26:04.983294+0000","last_undegraded":"2023-12-16T03:26:04.983294+0000","last_fullsized":"2023-12-16T03:26:04.983294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:51.446792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.471445+0000","last_change":"2023-12-16T03:26:02.472212+0000","last_active":"2023-12-16T03:26:03.471445+0000","last_peered":"2023-12-16T03:26:03.471445+0000","last_clean":"2023-12-16T03:26:03.471445+0000","last_became_active":"2023-12-16T03:26:02.471791+0000","last_became_peered":"2023-12-16T03:26:02.471791+0000","last_unstale":"2023-12-16T03:26:03.471445+0000","last_undegraded":"2023-12-16T03:26:03.471445+0000","last_fullsized":"2023-12-16T03:26:03.471445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:53.959842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.467989+0000","last_change":"2023-12-16T03:26:03.463996+0000","last_active":"2023-12-16T03:26:04.467989+0000","last_peered":"2023-12-16T03:26:04.467989+0000","last_clean":"2023-12-16T03:26:04.467989+0000","last_became_active":"2023-12-16T03:26:03.463705+0000","last_became_peered":"2023-12-16T03:26:03.463705+0000","last_unstale":"2023-12-16T03:26:04.467989+0000","last_undegraded":"2023-12-16T03:26:04.467989+0000","last_fullsized":"2023-12-16T03:26:04.467989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:47:58.231120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.984852+0000","last_change":"2023-12-16T03:26:02.476238+0000","last_active":"2023-12-16T03:26:04.984852+0000","last_peered":"2023-12-16T03:26:04.984852+0000","last_clean":"2023-12-16T03:26:04.984852+0000","last_became_active":"2023-12-16T03:26:02.475844+0000","last_became_peered":"2023-12-16T03:26:02.475844+0000","last_unstale":"2023-12-16T03:26:04.984852+0000","last_undegraded":"2023-12-16T03:26:04.984852+0000","last_fullsized":"2023-12-16T03:26:04.984852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:50.926184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.984746+0000","last_change":"2023-12-16T03:26:03.471971+0000","last_active":"2023-12-16T03:26:04.984746+0000","last_peered":"2023-12-16T03:26:04.984746+0000","last_clean":"2023-12-16T03:26:04.984746+0000","last_became_active":"2023-12-16T03:26:03.471769+0000","last_became_peered":"2023-12-16T03:26:03.471769+0000","last_unstale":"2023-12-16T03:26:04.984746+0000","last_undegraded":"2023-12-16T03:26:04.984746+0000","last_fullsized":"2023-12-16T03:26:04.984746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:49.203240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.452739+0000","last_change":"2023-12-16T03:26:02.465084+0000","last_active":"2023-12-16T03:26:03.452739+0000","last_peered":"2023-12-16T03:26:03.452739+0000","last_clean":"2023-12-16T03:26:03.452739+0000","last_became_active":"2023-12-16T03:26:02.464706+0000","last_became_peered":"2023-12-16T03:26:02.464706+0000","last_unstale":"2023-12-16T03:26:03.452739+0000","last_undegraded":"2023-12-16T03:26:03.452739+0000","last_fullsized":"2023-12-16T03:26:03.452739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983713+0000","last_change":"2023-12-16T03:26:03.483286+0000","last_active":"2023-12-16T03:26:04.983713+0000","last_peered":"2023-12-16T03:26:04.983713+0000","last_clean":"2023-12-16T03:26:04.983713+0000","last_became_active":"2023-12-16T03:26:03.483003+0000","last_became_peered":"2023-12-16T03:26:03.483003+0000","last_unstale":"2023-12-16T03:26:04.983713+0000","last_undegraded":"2023-12-16T03:26:04.983713+0000","last_fullsized":"2023-12-16T03:26:04.983713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:34.342031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.444352+0000","last_change":"2023-12-16T03:26:02.456023+0000","last_active":"2023-12-16T03:26:03.444352+0000","last_peered":"2023-12-16T03:26:03.444352+0000","last_clean":"2023-12-16T03:26:03.444352+0000","last_became_active":"2023-12-16T03:26:02.455703+0000","last_became_peered":"2023-12-16T03:26:02.455703+0000","last_unstale":"2023-12-16T03:26:03.444352+0000","last_undegraded":"2023-12-16T03:26:03.444352+0000","last_fullsized":"2023-12-16T03:26:03.444352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:05:13.649270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.984498+0000","last_change":"2023-12-16T03:26:03.475970+0000","last_active":"2023-12-16T03:26:04.984498+0000","last_peered":"2023-12-16T03:26:04.984498+0000","last_clean":"2023-12-16T03:26:04.984498+0000","last_became_active":"2023-12-16T03:26:03.475704+0000","last_became_peered":"2023-12-16T03:26:03.475704+0000","last_unstale":"2023-12-16T03:26:04.984498+0000","last_undegraded":"2023-12-16T03:26:04.984498+0000","last_fullsized":"2023-12-16T03:26:04.984498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:34.342031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.455213+0000","last_change":"2023-12-16T03:26:02.462695+0000","last_active":"2023-12-16T03:26:03.455213+0000","last_peered":"2023-12-16T03:26:03.455213+0000","last_clean":"2023-12-16T03:26:03.455213+0000","last_became_active":"2023-12-16T03:26:02.461706+0000","last_became_peered":"2023-12-16T03:26:02.461706+0000","last_unstale":"2023-12-16T03:26:03.455213+0000","last_undegraded":"2023-12-16T03:26:03.455213+0000","last_fullsized":"2023-12-16T03:26:03.455213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:31.574264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.466596+0000","last_change":"2023-12-16T03:26:03.474528+0000","last_active":"2023-12-16T03:26:04.466596+0000","last_peered":"2023-12-16T03:26:04.466596+0000","last_clean":"2023-12-16T03:26:04.466596+0000","last_became_active":"2023-12-16T03:26:03.472731+0000","last_became_peered":"2023-12-16T03:26:03.472731+0000","last_unstale":"2023-12-16T03:26:04.466596+0000","last_undegraded":"2023-12-16T03:26:04.466596+0000","last_fullsized":"2023-12-16T03:26:04.466596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:58:06.441852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.449482+0000","last_change":"2023-12-16T03:26:02.459691+0000","last_active":"2023-12-16T03:26:03.449482+0000","last_peered":"2023-12-16T03:26:03.449482+0000","last_clean":"2023-12-16T03:26:03.449482+0000","last_became_active":"2023-12-16T03:26:02.458861+0000","last_became_peered":"2023-12-16T03:26:02.458861+0000","last_unstale":"2023-12-16T03:26:03.449482+0000","last_undegraded":"2023-12-16T03:26:03.449482+0000","last_fullsized":"2023-12-16T03:26:03.449482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:31.574264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.468191+0000","last_change":"2023-12-16T03:26:03.461564+0000","last_active":"2023-12-16T03:26:04.468191+0000","last_peered":"2023-12-16T03:26:04.468191+0000","last_clean":"2023-12-16T03:26:04.468191+0000","last_became_active":"2023-12-16T03:26:03.459570+0000","last_became_peered":"2023-12-16T03:26:03.459570+0000","last_unstale":"2023-12-16T03:26:04.468191+0000","last_undegraded":"2023-12-16T03:26:04.468191+0000","last_fullsized":"2023-12-16T03:26:04.468191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:05:14.653208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.460665+0000","last_change":"2023-12-16T03:26:02.468114+0000","last_active":"2023-12-16T03:26:03.460665+0000","last_peered":"2023-12-16T03:26:03.460665+0000","last_clean":"2023-12-16T03:26:03.460665+0000","last_became_active":"2023-12-16T03:26:02.467813+0000","last_became_peered":"2023-12-16T03:26:02.467813+0000","last_unstale":"2023-12-16T03:26:03.460665+0000","last_undegraded":"2023-12-16T03:26:03.460665+0000","last_fullsized":"2023-12-16T03:26:03.460665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:24:47.746674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-16T03:26:04.983374+0000","last_change":"2023-12-16T03:26:03.470811+0000","last_active":"2023-12-16T03:26:04.983374+0000","last_peered":"2023-12-16T03:26:04.983374+0000","last_clean":"2023-12-16T03:26:04.983374+0000","last_became_active":"2023-12-16T03:26:03.469335+0000","last_became_peered":"2023-12-16T03:26:03.469335+0000","last_unstale":"2023-12-16T03:26:04.983374+0000","last_undegraded":"2023-12-16T03:26:04.983374+0000","last_fullsized":"2023-12-16T03:26:04.983374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:21.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.454800+0000","last_change":"2023-12-16T03:26:02.467483+0000","last_active":"2023-12-16T03:26:03.454800+0000","last_peered":"2023-12-16T03:26:03.454800+0000","last_clean":"2023-12-16T03:26:03.454800+0000","last_became_active":"2023-12-16T03:26:02.467186+0000","last_became_peered":"2023-12-16T03:26:02.467186+0000","last_unstale":"2023-12-16T03:26:03.454800+0000","last_undegraded":"2023-12-16T03:26:03.454800+0000","last_fullsized":"2023-12-16T03:26:03.454800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-16T03:26:03.452506+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:26:03.452506+0000","last_peered":"2023-12-16T03:26:03.452506+0000","last_clean":"2023-12-16T03:26:03.452506+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:26:03.452506+0000","last_undegraded":"2023-12-16T03:26:03.452506+0000","last_fullsized":"2023-12-16T03:26:03.452506+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":729875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.877},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.94099999999999995}]},{"osd":1,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.98499999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.92500000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.028}]},{"osd":4,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.90300000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.79700000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.84099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.1890000000000001,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.6870000000000003,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.2560000000000002,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.69699999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.876}]},{"osd":5,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.90100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.65300000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.73599999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.69699999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47799999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.194,"5min":4.194,"15min":4.194},"last":0.872},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81799999999999995}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.1689999999999996,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.0209999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.2759999999999998,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.99099999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.502},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.70899999999999996}]},{"osd":6,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.76500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":141051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":5.4710000000000001,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":6.1189999999999998,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.49299999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.7890000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.39700000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.5779999999999998,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.78800000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.67100000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.71499999999999997}]},{"osd":7,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.6309999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":0.83899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":139487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.60399999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":0.84699999999999998}]},{"osd":5,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.752}]},{"osd":6,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.93400000000000005}]},{"osd":7,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.76800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":141051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":4.3479999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.372},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.476,"5min":4.476,"15min":4.476},"last":0.47799999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.4269999999999996,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.44},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.6319999999999997,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.3849999999999998,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":7.5650000000000004,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.984,"5min":4.984,"15min":4.984},"last":0.60399999999999998}]},{"osd":5,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":4.7720000000000002,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":7.6109999999999998,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.70999999999999996}]},{"osd":6,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":7.681,"5min":7.681,"15min":7.681},"last":0.67900000000000005}]},{"osd":7,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.8609999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":729785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.1210000000000004,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.59699999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.1719999999999997,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.2350000000000003,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.55500000000000005}]},{"osd":3,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.0970000000000004,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.437},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.254,"5min":3.254,"15min":3.254},"last":0.57599999999999996}]},{"osd":4,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":0.872}]},{"osd":5,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.93000000000000005}]},{"osd":6,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.3979999999999997,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.80300000000000005}]},{"osd":7,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.88600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:26:12.499 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-16T03:26:12.499 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-16T03:26:12.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba29701640 1 Processor -- start 2023-12-16T03:26:12.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba29701640 1 -- start start 2023-12-16T03:26:12.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba29701640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fba24151e90 0x7fba240c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba29701640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba240c4e60 0x7fba2406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba29701640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2406c860 con 0x7fba240c7ea0 2023-12-16T03:26:12.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba29701640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba240c8750 con 0x7fba24151e90 2023-12-16T03:26:12.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba29701640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba241552d0 con 0x7fba240c4e60 2023-12-16T03:26:12.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba237fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba240c4e60 0x7fba2406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba22ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fba24151e90 0x7fba240c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba22ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fba24151e90 0x7fba240c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:59564/0 (socket says 172.21.15.28:59564) 2023-12-16T03:26:12.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba237fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba240c4e60 0x7fba2406bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:42222/0 (socket says 172.21.15.28:42222) 2023-12-16T03:26:12.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba22ffd640 1 -- 172.21.15.28:0/2989778355 learned_addr learned my addr 172.21.15.28:0/2989778355 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:12.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba1bfff640 1 --1- 172.21.15.28:0/2989778355 >> v1:172.21.15.134:6789/0 conn(0x7fba240c7ea0 0x7fba2406b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:44926/0 (socket says 172.21.15.28:44926) 2023-12-16T03:26:12.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba22ffd640 1 -- 172.21.15.28:0/2989778355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba240c4e60 msgr2=0x7fba2406bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:12.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba22ffd640 1 --2- 172.21.15.28:0/2989778355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba240c4e60 0x7fba2406bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba22ffd640 1 -- 172.21.15.28:0/2989778355 >> v1:172.21.15.134:6789/0 conn(0x7fba240c7ea0 legacy=0x7fba2406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.681+0000 7fba22ffd640 1 -- 172.21.15.28:0/2989778355 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba24154930 con 0x7fba24151e90 2023-12-16T03:26:12.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba22ffd640 1 --2- 172.21.15.28:0/2989778355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba24151e90 0x7fba240c4920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba1401c020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dac79b5fe2387aa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:12.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba227fc640 1 -- 172.21.15.28:0/2989778355 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140a9620 con 0x7fba24151e90 2023-12-16T03:26:12.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba227fc640 1 -- 172.21.15.28:0/2989778355 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba140a9780 con 0x7fba24151e90 2023-12-16T03:26:12.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba227fc640 1 -- 172.21.15.28:0/2989778355 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140a9b10 con 0x7fba24151e90 2023-12-16T03:26:12.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba29701640 1 -- 172.21.15.28:0/2989778355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba24151e90 msgr2=0x7fba240c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba29701640 1 --2- 172.21.15.28:0/2989778355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba24151e90 0x7fba240c4920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba1401c020 comp rx=0 tx=0).stop 2023-12-16T03:26:12.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba29701640 1 -- 172.21.15.28:0/2989778355 shutdown_connections 2023-12-16T03:26:12.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba29701640 1 --2- 172.21.15.28:0/2989778355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba240c4e60 0x7fba2406bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba29701640 1 --2- 172.21.15.28:0/2989778355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba24151e90 0x7fba240c4920 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba29701640 1 -- 172.21.15.28:0/2989778355 >> 172.21.15.28:0/2989778355 conn(0x7fba240ca170 msgr2=0x7fba240ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:12.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba29701640 1 -- 172.21.15.28:0/2989778355 shutdown_connections 2023-12-16T03:26:12.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.685+0000 7fba29701640 1 -- 172.21.15.28:0/2989778355 wait complete. 2023-12-16T03:26:12.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba29701640 1 Processor -- start 2023-12-16T03:26:12.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba29701640 1 -- start start 2023-12-16T03:26:12.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba29701640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba240c4e60 0x7fba2414ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba29701640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba240c7ea0 0x7fba240c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba29701640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba24151e90 0x7fba240c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba29701640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba240c3810 con 0x7fba240c4e60 2023-12-16T03:26:12.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba29701640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba240a9aa0 con 0x7fba240c7ea0 2023-12-16T03:26:12.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba29701640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba240a9d80 con 0x7fba24151e90 2023-12-16T03:26:12.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba22ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba240c4e60 0x7fba2414ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba22ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba240c4e60 0x7fba2414ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35336/0 (socket says 172.21.15.28:35336) 2023-12-16T03:26:12.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba22ffd640 1 -- 172.21.15.28:0/3624693635 learned_addr learned my addr 172.21.15.28:0/3624693635 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:12.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba1bfff640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba240c7ea0 0x7fba240c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba237fe640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba24151e90 0x7fba240c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba22ffd640 1 -- 172.21.15.28:0/3624693635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba24151e90 msgr2=0x7fba240c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba22ffd640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba24151e90 0x7fba240c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba22ffd640 1 -- 172.21.15.28:0/3624693635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba240c7ea0 msgr2=0x7fba240c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba22ffd640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba240c7ea0 0x7fba240c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba22ffd640 1 -- 172.21.15.28:0/3624693635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140094d0 con 0x7fba240c4e60 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba1bfff640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba240c7ea0 0x7fba240c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba22ffd640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba240c4e60 0x7fba2414ad30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fba140ab040 tx=0x7fba1401a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba1b7fe640 1 -- 172.21.15.28:0/3624693635 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140a9c70 con 0x7fba240c4e60 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba1b7fe640 1 -- 172.21.15.28:0/3624693635 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba140a9dd0 con 0x7fba240c4e60 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba1b7fe640 1 -- 172.21.15.28:0/3624693635 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140bc630 con 0x7fba240c4e60 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba29701640 1 -- 172.21.15.28:0/3624693635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba240aa060 con 0x7fba240c4e60 2023-12-16T03:26:12.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.689+0000 7fba29701640 1 -- 172.21.15.28:0/3624693635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba240aa620 con 0x7fba240c4e60 2023-12-16T03:26:12.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.693+0000 7fba29701640 1 -- 172.21.15.28:0/3624693635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba240aa810 con 0x7fba240c4e60 2023-12-16T03:26:12.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.693+0000 7fba1b7fe640 1 -- 172.21.15.28:0/3624693635 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fba140c5440 con 0x7fba240c4e60 2023-12-16T03:26:12.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.693+0000 7fba1b7fe640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fba040664a0 0x7fba04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:12.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.693+0000 7fba1b7fe640 1 -- 172.21.15.28:0/3624693635 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba1411d3f0 con 0x7fba240c4e60 2023-12-16T03:26:12.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.693+0000 7fba1bfff640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fba040664a0 0x7fba04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:12.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.693+0000 7fba1bfff640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fba040664a0 0x7fba04068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fba24150f30 tx=0x7fba0c007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:12.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.697+0000 7fba1b7fe640 1 -- 172.21.15.28:0/3624693635 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fba140ea920 con 0x7fba240c4e60 2023-12-16T03:26:12.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.909+0000 7fba29701640 1 -- 172.21.15.28:0/3624693635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fba24068400 con 0x7fba240c4e60 2023-12-16T03:26:12.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.913+0000 7fba1b7fe640 1 -- 172.21.15.28:0/3624693635 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fba140edf40 con 0x7fba240c4e60 2023-12-16T03:26:12.919 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2023-12-16T03:26:12.919 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1lvVeHJBAAIUmgW3XLan0rUG31Cw+zwQ== 2023-12-16T03:26:12.920 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2023-12-16T03:26:12.920 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2023-12-16T03:26:12.920 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-16T03:26:12.920 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2023-12-16T03:26:12.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 -- 172.21.15.28:0/3624693635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fba040664a0 msgr2=0x7fba04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fba040664a0 0x7fba04068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fba24150f30 tx=0x7fba0c007d10 comp rx=0 tx=0).stop 2023-12-16T03:26:12.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 -- 172.21.15.28:0/3624693635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba240c4e60 msgr2=0x7fba2414ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:12.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba240c4e60 0x7fba2414ad30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fba140ab040 tx=0x7fba1401a860 comp rx=0 tx=0).stop 2023-12-16T03:26:12.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 -- 172.21.15.28:0/3624693635 shutdown_connections 2023-12-16T03:26:12.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba24151e90 0x7fba240c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba240c7ea0 0x7fba240c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fba040664a0 0x7fba04068960 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 --2- 172.21.15.28:0/3624693635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba240c4e60 0x7fba2414ad30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:12.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 -- 172.21.15.28:0/3624693635 >> 172.21.15.28:0/3624693635 conn(0x7fba240ca170 msgr2=0x7fba24150650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:12.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 -- 172.21.15.28:0/3624693635 shutdown_connections 2023-12-16T03:26:12.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:12.917+0000 7fba29701640 1 -- 172.21.15.28:0/3624693635 wait complete. 2023-12-16T03:26:12.940 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:26:13.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.077+0000 7fd0207aa640 1 Processor -- start 2023-12-16T03:26:13.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.077+0000 7fd0207aa640 1 -- start start 2023-12-16T03:26:13.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.077+0000 7fd0207aa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd0180c2bb0 0x7fd0180c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.077+0000 7fd0207aa640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0180c31c0 con 0x7fd0180c63c0 2023-12-16T03:26:13.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.077+0000 7fd0207aa640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0180c34a0 con 0x7fd0180c4100 2023-12-16T03:26:13.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.077+0000 7fd0207aa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0180c1030 con 0x7fd0180c2bb0 2023-12-16T03:26:13.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.077+0000 7fd01e546640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd0180c63c0 0x7fd0180c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:35056/0 (socket says 172.21.15.28:35056) 2023-12-16T03:26:13.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.077+0000 7fd01e546640 1 -- 172.21.15.28:0/2442424769 learned_addr learned my addr 172.21.15.28:0/2442424769 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:13.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.077+0000 7fd01ed47640 1 --2- 172.21.15.28:0/2442424769 >> v2:172.21.15.28:3300/0 conn(0x7fd0180c2bb0 0x7fd0180c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.081+0000 7fd01ed47640 1 -- 172.21.15.28:0/2442424769 >> v1:172.21.15.134:6789/0 conn(0x7fd0180c4100 legacy=0x7fd0180a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.081+0000 7fd01ed47640 1 -- 172.21.15.28:0/2442424769 >> v1:172.21.15.28:6789/0 conn(0x7fd0180c63c0 legacy=0x7fd0180c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.081+0000 7fd01d544640 1 -- 172.21.15.28:0/2442424769 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952100246 0 0) 0x7fd0180c31c0 con 0x7fd0180c63c0 2023-12-16T03:26:13.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.081+0000 7fd01ed47640 1 -- 172.21.15.28:0/2442424769 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0180c1310 con 0x7fd0180c2bb0 2023-12-16T03:26:13.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.081+0000 7fd01ed47640 1 --2- 172.21.15.28:0/2442424769 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0180c2bb0 0x7fd0180c06d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd010009d90 tx=0x7fd01001ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c507e571fed138e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:13.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.081+0000 7fd01d544640 1 -- 172.21.15.28:0/2442424769 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0100a7a30 con 0x7fd0180c2bb0 2023-12-16T03:26:13.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.081+0000 7fd01d544640 1 -- 172.21.15.28:0/2442424769 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0100a7b90 con 0x7fd0180c2bb0 2023-12-16T03:26:13.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.081+0000 7fd01d544640 1 -- 172.21.15.28:0/2442424769 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0100af440 con 0x7fd0180c2bb0 2023-12-16T03:26:13.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.081+0000 7fd0207aa640 1 -- 172.21.15.28:0/2442424769 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0180c2bb0 msgr2=0x7fd0180c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.081+0000 7fd0207aa640 1 --2- 172.21.15.28:0/2442424769 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0180c2bb0 0x7fd0180c06d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd010009d90 tx=0x7fd01001ea40 comp rx=0 tx=0).stop 2023-12-16T03:26:13.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 -- 172.21.15.28:0/2442424769 shutdown_connections 2023-12-16T03:26:13.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 --2- 172.21.15.28:0/2442424769 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0180c2bb0 0x7fd0180c06d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 -- 172.21.15.28:0/2442424769 >> 172.21.15.28:0/2442424769 conn(0x7fd01806a5b0 msgr2=0x7fd01806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:13.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 -- 172.21.15.28:0/2442424769 shutdown_connections 2023-12-16T03:26:13.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 -- 172.21.15.28:0/2442424769 wait complete. 2023-12-16T03:26:13.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 Processor -- start 2023-12-16T03:26:13.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 -- start start 2023-12-16T03:26:13.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0180c2bb0 0x7fd018156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0180c4100 0x7fd0180be660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0180c63c0 0x7fd0180beba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd018159ff0 con 0x7fd0180c4100 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0181e9c30 con 0x7fd0180c63c0 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd0207aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01815acc0 con 0x7fd0180c2bb0 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd01dd45640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0180c4100 0x7fd0180be660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd01dd45640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0180c4100 0x7fd0180be660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35346/0 (socket says 172.21.15.28:35346) 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd01dd45640 1 -- 172.21.15.28:0/3857461962 learned_addr learned my addr 172.21.15.28:0/3857461962 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd01e546640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0180c2bb0 0x7fd018156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd01ed47640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0180c63c0 0x7fd0180beba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd01dd45640 1 -- 172.21.15.28:0/3857461962 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0180c2bb0 msgr2=0x7fd018156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd01dd45640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0180c2bb0 0x7fd018156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd01dd45640 1 -- 172.21.15.28:0/3857461962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0180c63c0 msgr2=0x7fd0180beba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd01dd45640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0180c63c0 0x7fd0180beba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd01dd45640 1 -- 172.21.15.28:0/3857461962 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd010009a70 con 0x7fd0180c4100 2023-12-16T03:26:13.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd01dd45640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0180c4100 0x7fd0180be660 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd00800c500 tx=0x7fd00800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:13.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.085+0000 7fd00effd640 1 -- 172.21.15.28:0/3857461962 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008005220 con 0x7fd0180c4100 2023-12-16T03:26:13.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.089+0000 7fd00effd640 1 -- 172.21.15.28:0/3857461962 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd008005380 con 0x7fd0180c4100 2023-12-16T03:26:13.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.089+0000 7fd0207aa640 1 -- 172.21.15.28:0/3857461962 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0181e90b0 con 0x7fd0180c4100 2023-12-16T03:26:13.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.089+0000 7fd00effd640 1 -- 172.21.15.28:0/3857461962 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008007270 con 0x7fd0180c4100 2023-12-16T03:26:13.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.089+0000 7fd0207aa640 1 -- 172.21.15.28:0/3857461962 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0181e9670 con 0x7fd0180c4100 2023-12-16T03:26:13.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.089+0000 7fd0207aa640 1 -- 172.21.15.28:0/3857461962 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0180be380 con 0x7fd0180c4100 2023-12-16T03:26:13.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.089+0000 7fd00effd640 1 -- 172.21.15.28:0/3857461962 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd0080073d0 con 0x7fd0180c4100 2023-12-16T03:26:13.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.089+0000 7fd00effd640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcffc066470 0x7fcffc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.089+0000 7fd00effd640 1 -- 172.21.15.28:0/3857461962 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd008083110 con 0x7fd0180c4100 2023-12-16T03:26:13.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.089+0000 7fd01e546640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcffc066470 0x7fcffc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.089+0000 7fd01e546640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcffc066470 0x7fcffc068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd014007bc0 tx=0x7fd014007b10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:13.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.093+0000 7fd00effd640 1 -- 172.21.15.28:0/3857461962 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd0180be380 con 0x7fd0180c4100 2023-12-16T03:26:13.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.281+0000 7fd0207aa640 1 -- 172.21.15.28:0/3857461962 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0180be380 con 0x7fd0180c4100 2023-12-16T03:26:13.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd00effd640 1 -- 172.21.15.28:0/3857461962 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fd0180be380 con 0x7fd0180c4100 2023-12-16T03:26:13.290 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:13.290 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3378969769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3378969769},{"type":"v1","addr":"172.21.15.134:6835","nonce":3378969769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2794220220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2794220220},{"type":"v1","addr":"172.21.15.134:6834","nonce":2794220220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5010,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/664267694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":664267694},{"type":"v1","addr":"172.21.15.28:6836","nonce":664267694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:02.836620+0000","modified":"2023-12-16T03:26:05.858917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.28:6837/1004873879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1004873879},{"type":"v1","addr":"172.21.15.28:6837","nonce":1004873879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-16T03:26:13.290 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 16 2023-12-16T03:26:13.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 -- 172.21.15.28:0/3857461962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcffc066470 msgr2=0x7fcffc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcffc066470 0x7fcffc068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd014007bc0 tx=0x7fd014007b10 comp rx=0 tx=0).stop 2023-12-16T03:26:13.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 -- 172.21.15.28:0/3857461962 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0180c4100 msgr2=0x7fd0180be660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0180c4100 0x7fd0180be660 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd00800c500 tx=0x7fd00800c9c0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 -- 172.21.15.28:0/3857461962 shutdown_connections 2023-12-16T03:26:13.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0180c63c0 0x7fd0180beba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcffc066470 0x7fcffc068930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0180c4100 0x7fd0180be660 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 --2- 172.21.15.28:0/3857461962 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0180c2bb0 0x7fd018156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 -- 172.21.15.28:0/3857461962 >> 172.21.15.28:0/3857461962 conn(0x7fd01806a5b0 msgr2=0x7fd0180c4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:13.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 -- 172.21.15.28:0/3857461962 shutdown_connections 2023-12-16T03:26:13.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.285+0000 7fd0207aa640 1 -- 172.21.15.28:0/3857461962 wait complete. 2023-12-16T03:26:13.713 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-16T03:26:02.836620+0000', 'modified': '2023-12-16T03:26:05.858917+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5013}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5013': {'gid': 5013, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.28:6837/1004873879', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6835', 'nonce': 1004873879}, {'type': 'v1', 'addr': '172.21.15.28:6837', 'nonce': 1004873879}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-16T03:26:13.713 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-16T03:26:13.713 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-16T03:26:13.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc92fe640 1 Processor -- start 2023-12-16T03:26:13.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc92fe640 1 -- start start 2023-12-16T03:26:13.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc92fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbbc40a5240 0x7fbbc40bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc92fe640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc40c3bd0 con 0x7fbbc40c01c0 2023-12-16T03:26:13.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc92fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc40bf1e0 con 0x7fbbc41561f0 2023-12-16T03:26:13.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc92fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc40c3e20 con 0x7fbbc40a5240 2023-12-16T03:26:13.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbba7fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbbc40c01c0 0x7fbbc40c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:35058/0 (socket says 172.21.15.28:35058) 2023-12-16T03:26:13.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbba7fc640 1 -- 172.21.15.28:0/1180901101 learned_addr learned my addr 172.21.15.28:0/1180901101 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:13.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/1180901101 >> v2:172.21.15.134:3300/0 conn(0x7fbbc40a5240 0x7fbbc40bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305305459 0 0) 0x7fbbc40c3bd0 con 0x7fbbc40c01c0 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba4003530 con 0x7fbbc40c01c0 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3812523648 0 0) 0x7fbba4003530 con 0x7fbbc40c01c0 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 >> v2:172.21.15.134:3300/0 conn(0x7fbbc40a5240 msgr2=0x7fbbc40bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 --2- 172.21.15.28:0/1180901101 >> v2:172.21.15.134:3300/0 conn(0x7fbbc40a5240 0x7fbbc40bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 >> v1:172.21.15.134:6789/0 conn(0x7fbbc41561f0 legacy=0x7fbbc4156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40c4100 con 0x7fbbc40c01c0 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fbbb4001680 con 0x7fbbc40c01c0 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 >> v1:172.21.15.28:6789/0 conn(0x7fbbc40c01c0 legacy=0x7fbbc40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 --2- 172.21.15.28:0/1180901101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 0x7fbba4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 --2- 172.21.15.28:0/1180901101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba40047d0 0x7fbba4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 --2- 172.21.15.28:0/1180901101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba4005190 0x7fbba400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40c3e20 con 0x7fbba4003980 2023-12-16T03:26:13.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba400c130 con 0x7fbba40047d0 2023-12-16T03:26:13.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba400c2f0 con 0x7fbba4005190 2023-12-16T03:26:13.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/1180901101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 0x7fbba4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbba7fc640 1 --2- 172.21.15.28:0/1180901101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba40047d0 0x7fbba4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc37fe640 1 --2- 172.21.15.28:0/1180901101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba4005190 0x7fbba400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/1180901101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba4005190 msgr2=0x7fbba400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:13.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/1180901101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba4005190 0x7fbba400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/1180901101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba40047d0 msgr2=0x7fbba4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:13.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/1180901101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba40047d0 0x7fbba4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/1180901101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba4003530 con 0x7fbba4003980 2023-12-16T03:26:13.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.857+0000 7fbbc37fe640 1 -- 172.21.15.28:0/1180901101 reap_dead start 2023-12-16T03:26:13.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.861+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/1180901101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 0x7fbba4003da0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009ae0 tx=0x7fbbac01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba9f92619a33442 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:13.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.861+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0a6510 con 0x7fbba4003980 2023-12-16T03:26:13.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.861+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac0a6670 con 0x7fbba4003980 2023-12-16T03:26:13.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.861+0000 7fbbc27fc640 1 -- 172.21.15.28:0/1180901101 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0a6a20 con 0x7fbba4003980 2023-12-16T03:26:13.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.861+0000 7fbbc92fe640 1 -- 172.21.15.28:0/1180901101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 msgr2=0x7fbba4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.861+0000 7fbbc92fe640 1 --2- 172.21.15.28:0/1180901101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 0x7fbba4003da0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009ae0 tx=0x7fbbac01ca20 comp rx=0 tx=0).stop 2023-12-16T03:26:13.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.861+0000 7fbbc92fe640 1 -- 172.21.15.28:0/1180901101 shutdown_connections 2023-12-16T03:26:13.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.861+0000 7fbbc92fe640 1 --2- 172.21.15.28:0/1180901101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 0x7fbba4003da0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.861+0000 7fbbc92fe640 1 -- 172.21.15.28:0/1180901101 >> 172.21.15.28:0/1180901101 conn(0x7fbbc406a5b0 msgr2=0x7fbbc406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:13.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.861+0000 7fbbc92fe640 1 -- 172.21.15.28:0/1180901101 shutdown_connections 2023-12-16T03:26:13.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.861+0000 7fbbc92fe640 1 -- 172.21.15.28:0/1180901101 wait complete. 2023-12-16T03:26:13.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc92fe640 1 Processor -- start 2023-12-16T03:26:13.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc92fe640 1 -- start start 2023-12-16T03:26:13.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc92fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 0x7fbbc41e0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc92fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc41f0790 0x7fbbc40719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc92fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbc41f0bd0 0x7fbbc4071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc92fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc4151420 con 0x7fbba4003980 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc92fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc41e4cb0 con 0x7fbbc41f0790 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc92fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc41f1170 con 0x7fbbc41f0bd0 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 0x7fbbc41e0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 0x7fbbc41e0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35358/0 (socket says 172.21.15.28:35358) 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/265317023 learned_addr learned my addr 172.21.15.28:0/265317023 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbba7fc640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc41f0790 0x7fbbc40719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc37fe640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbc41f0bd0 0x7fbbc4071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/265317023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbc41f0bd0 msgr2=0x7fbbc4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbc41f0bd0 0x7fbbc4071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/265317023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc41f0790 msgr2=0x7fbbc40719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc41f0790 0x7fbbc40719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/265317023 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc406adb0 con 0x7fbba4003980 2023-12-16T03:26:13.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 0x7fbbc41e0d60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0b0040 tx=0x7fbba4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:13.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbbbfff640 1 -- 172.21.15.28:0/265317023 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00f080 con 0x7fbba4003980 2023-12-16T03:26:13.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbbbfff640 1 -- 172.21.15.28:0/265317023 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac0a67e0 con 0x7fbba4003980 2023-12-16T03:26:13.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbbbfff640 1 -- 172.21.15.28:0/265317023 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0a6b90 con 0x7fbba4003980 2023-12-16T03:26:13.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc92fe640 1 -- 172.21.15.28:0/265317023 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc4151140 con 0x7fbba4003980 2023-12-16T03:26:13.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.865+0000 7fbbc92fe640 1 -- 172.21.15.28:0/265317023 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc4154890 con 0x7fbba4003980 2023-12-16T03:26:13.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbbbfff640 1 -- 172.21.15.28:0/265317023 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbbac0a6cf0 con 0x7fbba4003980 2023-12-16T03:26:13.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbbbfff640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbba8066470 0x7fbba8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbbbfff640 1 -- 172.21.15.28:0/265317023 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbac0aa070 con 0x7fbba4003980 2023-12-16T03:26:13.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbba7fc640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbba8066470 0x7fbba8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbcc66b000 1 Processor -- start 2023-12-16T03:26:13.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbba7fc640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbba8066470 0x7fbba8068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40a6b80 tx=0x7fbbb4007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:13.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbcc66b000 1 -- start start 2023-12-16T03:26:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 0x5561bf5cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5ccf70 0x5561bf5cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cd890 0x5561bf616de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bf496f00 con 0x5561bf5cd890 2023-12-16T03:26:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bf426dd0 con 0x5561bf5cc650 2023-12-16T03:26:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.869+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561bf424300 con 0x5561bf5ccf70 2023-12-16T03:26:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbba7fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5ccf70 0x5561bf5cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbc2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 0x5561bf5cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbc37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cd890 0x5561bf616de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbc2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 0x5561bf5cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:59602/0 (socket says 172.21.15.28:59602) 2023-12-16T03:26:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbba7fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5ccf70 0x5561bf5cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:42288/0 (socket says 172.21.15.28:42288) 2023-12-16T03:26:13.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/4198715327 learned_addr learned my addr 172.21.15.28:0/4198715327 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/4198715327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5ccf70 msgr2=0x5561bf5cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/4198715327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5ccf70 0x5561bf5cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/4198715327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cd890 msgr2=0x5561bf616de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/4198715327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cd890 0x5561bf616de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/4198715327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561bf117890 con 0x5561bf5cc650 2023-12-16T03:26:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbc37fe640 1 --2- 172.21.15.28:0/4198715327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cd890 0x5561bf616de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:13.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/4198715327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 0x5561bf5cca30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0efb40 tx=0x7fbbac0f0370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e4e402cad76a948 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbb8ff9640 1 -- 172.21.15.28:0/4198715327 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0f7eb0 con 0x5561bf5cc650 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbb8ff9640 1 -- 172.21.15.28:0/4198715327 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac0edf50 con 0x5561bf5cc650 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbb8ff9640 1 -- 172.21.15.28:0/4198715327 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0ec2c0 con 0x5561bf5cc650 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 -- 172.21.15.28:0/4198715327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 msgr2=0x5561bf5cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/4198715327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 0x5561bf5cca30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0efb40 tx=0x7fbbac0f0370 comp rx=0 tx=0).stop 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 -- 172.21.15.28:0/4198715327 shutdown_connections 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/4198715327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cd890 0x5561bf616de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/4198715327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5ccf70 0x5561bf5cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/4198715327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 0x5561bf5cca30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 -- 172.21.15.28:0/4198715327 >> 172.21.15.28:0/4198715327 conn(0x5561bf5d52f0 msgr2=0x5561bf60cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 -- 172.21.15.28:0/4198715327 shutdown_connections 2023-12-16T03:26:13.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 -- 172.21.15.28:0/4198715327 wait complete. 2023-12-16T03:26:13.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 -- start start 2023-12-16T03:26:13.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 Processor -- start 2023-12-16T03:26:13.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 0x5561bf5d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf5d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5cd890 0x5561bf5d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bf41fbf0 con 0x5561bf5ccf70 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bf3d7c60 con 0x5561bf5cc650 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561bf3ddb00 con 0x5561bf5cd890 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.873+0000 7fbbcc66b000 10 client.0 _ll_register_callbacks cb 0x5561bf5ba710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbba7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf5d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbba7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf5d1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35384/0 (socket says 172.21.15.28:35384) 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbba7fc640 1 -- 172.21.15.28:0/276981298 learned_addr learned my addr 172.21.15.28:0/276981298 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 0x5561bf5d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbc37fe640 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5cd890 0x5561bf5d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbba7fc640 1 -- 172.21.15.28:0/276981298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5cd890 msgr2=0x5561bf5d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbba7fc640 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5cd890 0x5561bf5d1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbba7fc640 1 -- 172.21.15.28:0/276981298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 msgr2=0x5561bf5d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbba7fc640 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 0x5561bf5d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbba7fc640 1 -- 172.21.15.28:0/276981298 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbbc00f040 con 0x5561bf5ccf70 2023-12-16T03:26:13.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbba7fc640 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf5d1940 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40c05a0 tx=0x7fbbb4001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ab26897a31d50c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/276981298 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4028070 con 0x5561bf5ccf70 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/276981298 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbb401d070 con 0x5561bf5ccf70 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 -- 172.21.15.28:0/276981298 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561bf3dd490 con 0x5561bf5ccf70 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/276981298 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbb4015470 con 0x5561bf5ccf70 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 10 client.5220 fetch_fsmap learned FSMap version 16 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 -- 172.21.15.28:0/276981298 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7fbbc4154890 con 0x5561bf5ccf70 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/276981298 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561bf3dd490 con 0x5561bf5ccf70 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/276981298 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbbb40155d0 con 0x5561bf5ccf70 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 10 client.5220 fetch_fsmap finished waiting for FSMap version 16 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 10 client.5220 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 20 client.5220 populate_metadata read hostname 'smithi028' 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.28:6835/1004873879,v1:172.21.15.28:6837/1004873879] conn(0x5561bf61f140 0x5561bf621530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 4 client.5220 mds_command: new command op to 5013 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-16T03:26:13.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 -- 172.21.15.28:0/276981298 --> [v2:172.21.15.28:6835/1004873879,v1:172.21.15.28:6837/1004873879] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561bf41e540 con 0x5561bf61f140 2023-12-16T03:26:13.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.28:6835/1004873879,v1:172.21.15.28:6837/1004873879] conn(0x5561bf61f140 0x5561bf621530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.28:6835/1004873879,v1:172.21.15.28:6837/1004873879] conn(0x5561bf61f140 0x5561bf621530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38060cdf4a56d3df server_cookie=63b29e3b389b9c90 in_seq=0 out_seq=0 2023-12-16T03:26:13.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbb1ffb640 10 client.5220 ms_handle_connect on v2:172.21.15.28:6835/1004873879 2023-12-16T03:26:13.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/276981298 <== mds.0 v2:172.21.15.28:6835/1004873879 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5561bf41e540 con 0x5561bf61f140 2023-12-16T03:26:13.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbb1ffb640 10 client.5220 handle_command_reply: tid=0 2023-12-16T03:26:13.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 client.5220 shutdown 2023-12-16T03:26:13.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 -- 172.21.15.28:0/276981298 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 msgr2=0x5561bf5d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf5d1940 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40c05a0 tx=0x7fbbb4001a10 comp rx=0 tx=0).stop 2023-12-16T03:26:13.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 -- 172.21.15.28:0/276981298 shutdown_connections 2023-12-16T03:26:13.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.28:6835/1004873879,v1:172.21.15.28:6837/1004873879] conn(0x5561bf61f140 0x5561bf621530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5cd890 0x5561bf5d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf5d1940 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/276981298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5cc650 0x5561bf5d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbb1ffb640 0 client.5220 ms_handle_reset on v2:172.21.15.28:6835/1004873879 2023-12-16T03:26:13.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 -- 172.21.15.28:0/276981298 >> 172.21.15.28:0/276981298 conn(0x5561bf5d52f0 msgr2=0x5561bf5cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:13.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 -- 172.21.15.28:0/276981298 shutdown_connections 2023-12-16T03:26:13.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 1 -- 172.21.15.28:0/276981298 wait complete. 2023-12-16T03:26:13.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.877+0000 7fbbcc66b000 20 client.5220 trim_cache size 0 max 16384 2023-12-16T03:26:13.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.893+0000 7fbbcc66b000 1 Processor -- start 2023-12-16T03:26:13.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.893+0000 7fbbcc66b000 1 -- start start 2023-12-16T03:26:13.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5d52f0 0x5561bf61c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5cc650 0x5561bf621530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf621a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bf0d8940 con 0x5561bf5ccf70 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bf41ea80 con 0x5561bf5d52f0 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561bf3d8dd0 con 0x5561bf5cc650 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf621a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf621a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35398/0 (socket says 172.21.15.28:35398) 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc37fe640 1 -- 172.21.15.28:0/2875081191 learned_addr learned my addr 172.21.15.28:0/2875081191 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc37fe640 1 -- 172.21.15.28:0/2875081191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5cc650 msgr2=0x5561bf621530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc37fe640 1 --2- 172.21.15.28:0/2875081191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5cc650 0x5561bf621530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc37fe640 1 -- 172.21.15.28:0/2875081191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5d52f0 msgr2=0x5561bf61c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc37fe640 1 --2- 172.21.15.28:0/2875081191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5d52f0 0x5561bf61c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc37fe640 1 -- 172.21.15.28:0/2875081191 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561bf3e0200 con 0x5561bf5ccf70 2023-12-16T03:26:13.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc37fe640 1 --2- 172.21.15.28:0/2875081191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf621a70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4158dd0 tx=0x7fbbbc001ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23a3cfab20d488 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbb97fa640 1 -- 172.21.15.28:0/2875081191 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc002110 con 0x5561bf5ccf70 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbb97fa640 1 -- 172.21.15.28:0/2875081191 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc003b40 con 0x5561bf5ccf70 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbb97fa640 1 -- 172.21.15.28:0/2875081191 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc001790 con 0x5561bf5ccf70 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- 172.21.15.28:0/2875081191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 msgr2=0x5561bf621a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/2875081191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf621a70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4158dd0 tx=0x7fbbbc001ec0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- 172.21.15.28:0/2875081191 shutdown_connections 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/2875081191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5ccf70 0x5561bf621a70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/2875081191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5cc650 0x5561bf621530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/2875081191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5d52f0 0x5561bf61c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- 172.21.15.28:0/2875081191 >> 172.21.15.28:0/2875081191 conn(0x5561bf5cbe50 msgr2=0x5561bf608c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- 172.21.15.28:0/2875081191 shutdown_connections 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- 172.21.15.28:0/2875081191 wait complete. 2023-12-16T03:26:13.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- start start 2023-12-16T03:26:13.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 Processor -- start 2023-12-16T03:26:13.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cc650 0x5561bf635310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5ccf70 0x5561bf635850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5d52f0 0x5561bf635d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bf461250 con 0x5561bf5cc650 2023-12-16T03:26:13.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561bf3f5cd0 con 0x5561bf5d52f0 2023-12-16T03:26:13.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561bf426360 con 0x5561bf5ccf70 2023-12-16T03:26:13.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbcc66b000 10 client.0 _ll_register_callbacks cb 0x5561bf59af60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cc650 0x5561bf635310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cc650 0x5561bf635310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35408/0 (socket says 172.21.15.28:35408) 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.897+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/1229970646 learned_addr learned my addr 172.21.15.28:0/1229970646 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbba7fc640 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5ccf70 0x5561bf635850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc37fe640 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5d52f0 0x5561bf635d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/1229970646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5ccf70 msgr2=0x5561bf635850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5ccf70 0x5561bf635850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/1229970646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5d52f0 msgr2=0x5561bf635d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5d52f0 0x5561bf635d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc2ffd640 1 -- 172.21.15.28:0/1229970646 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc40bf1e0 con 0x5561bf5cc650 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc37fe640 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5d52f0 0x5561bf635d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc2ffd640 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cc650 0x5561bf635310 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0efb40 tx=0x7fbbac11ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24f7b1396f741d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/1229970646 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac11c040 con 0x5561bf5cc650 2023-12-16T03:26:13.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/1229970646 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbac0f7eb0 con 0x5561bf5cc650 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 -- 172.21.15.28:0/1229970646 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561bf3a6a50 con 0x5561bf5cc650 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/1229970646 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbac009110 con 0x5561bf5cc650 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 10 client.5226 fetch_fsmap learned FSMap version 16 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 -- 172.21.15.28:0/1229970646 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5561bf3c6500 con 0x5561bf5cc650 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/1229970646 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561bf3a6a50 con 0x5561bf5cc650 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/1229970646 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbbac0b6070 con 0x5561bf5cc650 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 10 client.5226 fetch_fsmap finished waiting for FSMap version 16 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 10 client.5226 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 20 client.5226 populate_metadata read hostname 'smithi028' 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.28:6835/1004873879,v1:172.21.15.28:6837/1004873879] conn(0x5561bf5cd890 0x5561bf636750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 4 client.5226 mds_command: new command op to 5013 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 -- 172.21.15.28:0/1229970646 --> [v2:172.21.15.28:6835/1004873879,v1:172.21.15.28:6837/1004873879] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5561bf44df30 con 0x5561bf5cd890 2023-12-16T03:26:13.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbba7fc640 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.28:6835/1004873879,v1:172.21.15.28:6837/1004873879] conn(0x5561bf5cd890 0x5561bf636750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbb1ffb640 10 client.5226 ms_handle_connect on v2:172.21.15.28:6835/1004873879 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbba7fc640 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.28:6835/1004873879,v1:172.21.15.28:6837/1004873879] conn(0x5561bf5cd890 0x5561bf636750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec497c7167efd1d1 server_cookie=3f5fd489db76d232 in_seq=0 out_seq=0 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbb1ffb640 1 -- 172.21.15.28:0/1229970646 <== mds.0 v2:172.21.15.28:6835/1004873879 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5561bf44df30 con 0x5561bf5cd890 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbb1ffb640 10 client.5226 handle_command_reply: tid=0 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 client.5226 shutdown 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 -- 172.21.15.28:0/1229970646 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cc650 msgr2=0x5561bf635310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cc650 0x5561bf635310 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0efb40 tx=0x7fbbac11ce70 comp rx=0 tx=0).stop 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 -- 172.21.15.28:0/1229970646 shutdown_connections 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.28:6835/1004873879,v1:172.21.15.28:6837/1004873879] conn(0x5561bf5cd890 0x5561bf636750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5561bf5d52f0 0x5561bf635d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5561bf5ccf70 0x5561bf635850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 --2- 172.21.15.28:0/1229970646 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5561bf5cc650 0x5561bf635310 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbb1ffb640 0 client.5226 ms_handle_reset on v2:172.21.15.28:6835/1004873879 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 -- 172.21.15.28:0/1229970646 >> 172.21.15.28:0/1229970646 conn(0x5561bf5cbe50 msgr2=0x5561bf61b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:13.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 -- 172.21.15.28:0/1229970646 shutdown_connections 2023-12-16T03:26:13.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 1 -- 172.21.15.28:0/1229970646 wait complete. 2023-12-16T03:26:13.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbcc66b000 20 client.5226 trim_cache size 0 max 16384 2023-12-16T03:26:13.915 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:26:13.915 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "96b65b79-be1d-4832-b923-85c874d6fb27", 2023-12-16T03:26:13.915 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2023-12-16T03:26:13.915 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 5013, 2023-12-16T03:26:13.915 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2023-12-16T03:26:13.916 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2023-12-16T03:26:13.916 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2023-12-16T03:26:13.916 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 10.466440366, 2023-12-16T03:26:13.916 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 16, 2023-12-16T03:26:13.916 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 32, 2023-12-16T03:26:13.916 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 32, 2023-12-16T03:26:13.916 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 18.730344818999999 2023-12-16T03:26:13.916 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:26:13.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc92fe640 1 -- 172.21.15.28:0/265317023 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbba8066470 msgr2=0x7fbba8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc92fe640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbba8066470 0x7fbba8068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40a6b80 tx=0x7fbbb4007040 comp rx=0 tx=0).stop 2023-12-16T03:26:13.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc92fe640 1 -- 172.21.15.28:0/265317023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 msgr2=0x7fbbc41e0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:13.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.901+0000 7fbbc92fe640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 0x7fbbc41e0d60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0b0040 tx=0x7fbba4005800 comp rx=0 tx=0).stop 2023-12-16T03:26:13.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.905+0000 7fbbc92fe640 1 -- 172.21.15.28:0/265317023 shutdown_connections 2023-12-16T03:26:13.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.905+0000 7fbbc92fe640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbc41f0bd0 0x7fbbc4071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.905+0000 7fbbc92fe640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc41f0790 0x7fbbc40719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.905+0000 7fbbc92fe640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbba8066470 0x7fbba8068930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.905+0000 7fbbc92fe640 1 --2- 172.21.15.28:0/265317023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba4003980 0x7fbbc41e0d60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:13.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.905+0000 7fbbc92fe640 1 -- 172.21.15.28:0/265317023 >> 172.21.15.28:0/265317023 conn(0x7fbbc406a5b0 msgr2=0x7fbbc40a7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:13.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.905+0000 7fbbc92fe640 1 -- 172.21.15.28:0/265317023 shutdown_connections 2023-12-16T03:26:13.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:13.905+0000 7fbbc92fe640 1 -- 172.21.15.28:0/265317023 wait complete. 2023-12-16T03:26:13.928 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:26:14.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.065+0000 7fd6fbae3640 1 Processor -- start 2023-12-16T03:26:14.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.065+0000 7fd6fbae3640 1 -- start start 2023-12-16T03:26:14.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.065+0000 7fd6fbae3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd6f41560e0 0x7fd6f415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:14.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.065+0000 7fd6fbae3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd6f406d520 0x7fd6f4159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:14.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.065+0000 7fd6fbae3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6f40bffc0 0x7fd6f40c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:14.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.065+0000 7fd6fbae3640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f415c600 con 0x7fd6f406d520 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.065+0000 7fd6fbae3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f41594e0 con 0x7fd6f41560e0 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.065+0000 7fd6fbae3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f41597c0 con 0x7fd6f40bffc0 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.065+0000 7fd6f907e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd6f406d520 0x7fd6f4159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.065+0000 7fd6f907e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd6f406d520 0x7fd6f4159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35420/0 (socket says 172.21.15.28:35420) 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.065+0000 7fd6f907e640 1 -- 172.21.15.28:0/2669318189 learned_addr learned my addr 172.21.15.28:0/2669318189 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6f987f640 1 --2- 172.21.15.28:0/2669318189 >> v2:172.21.15.134:3300/0 conn(0x7fd6f41560e0 0x7fd6f415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6fa080640 1 --2- 172.21.15.28:0/2669318189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6f40bffc0 0x7fd6f40c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6f907e640 1 -- 172.21.15.28:0/2669318189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6f40bffc0 msgr2=0x7fd6f40c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6f907e640 1 --2- 172.21.15.28:0/2669318189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6f40bffc0 0x7fd6f40c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6f907e640 1 -- 172.21.15.28:0/2669318189 >> v2:172.21.15.134:3300/0 conn(0x7fd6f41560e0 msgr2=0x7fd6f415ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6f907e640 1 --2- 172.21.15.28:0/2669318189 >> v2:172.21.15.134:3300/0 conn(0x7fd6f41560e0 0x7fd6f415ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6f907e640 1 -- 172.21.15.28:0/2669318189 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f415bfb0 con 0x7fd6f406d520 2023-12-16T03:26:14.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6f907e640 1 --2- 172.21.15.28:0/2669318189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6f406d520 0x7fd6f4159eb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd6f406b390 tx=0x7fd6e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc31b0c913eeff2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:14.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6f887d640 1 -- 172.21.15.28:0/2669318189 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40ac600 con 0x7fd6f406d520 2023-12-16T03:26:14.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6f887d640 1 -- 172.21.15.28:0/2669318189 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e40a8050 con 0x7fd6f406d520 2023-12-16T03:26:14.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6f887d640 1 -- 172.21.15.28:0/2669318189 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40ac980 con 0x7fd6f406d520 2023-12-16T03:26:14.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6fbae3640 1 -- 172.21.15.28:0/2669318189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6f406d520 msgr2=0x7fd6f4159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:14.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.069+0000 7fd6fbae3640 1 --2- 172.21.15.28:0/2669318189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6f406d520 0x7fd6f4159eb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd6f406b390 tx=0x7fd6e401c4d0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 -- 172.21.15.28:0/2669318189 shutdown_connections 2023-12-16T03:26:14.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 --2- 172.21.15.28:0/2669318189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6f40bffc0 0x7fd6f40c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 --2- 172.21.15.28:0/2669318189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6f406d520 0x7fd6f4159eb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 --2- 172.21.15.28:0/2669318189 >> v2:172.21.15.134:3300/0 conn(0x7fd6f41560e0 0x7fd6f415ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 -- 172.21.15.28:0/2669318189 >> 172.21.15.28:0/2669318189 conn(0x7fd6f406a5b0 msgr2=0x7fd6f406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:14.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 -- 172.21.15.28:0/2669318189 shutdown_connections 2023-12-16T03:26:14.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 -- 172.21.15.28:0/2669318189 wait complete. 2023-12-16T03:26:14.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 Processor -- start 2023-12-16T03:26:14.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 -- start start 2023-12-16T03:26:14.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6f406d520 0x7fd6f40aa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:14.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6f40bffc0 0x7fd6f4156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:14.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6f41560e0 0x7fd6f41f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:14.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f41f15d0 con 0x7fd6f406d520 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40aa990 con 0x7fd6f41560e0 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fbae3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40aac70 con 0x7fd6f40bffc0 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6f987f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6f406d520 0x7fd6f40aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6f987f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6f406d520 0x7fd6f40aa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35426/0 (socket says 172.21.15.28:35426) 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6f987f640 1 -- 172.21.15.28:0/1565938549 learned_addr learned my addr 172.21.15.28:0/1565938549 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6fa080640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6f41560e0 0x7fd6f41f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6f907e640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6f40bffc0 0x7fd6f4156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6f987f640 1 -- 172.21.15.28:0/1565938549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6f40bffc0 msgr2=0x7fd6f4156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6f987f640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6f40bffc0 0x7fd6f4156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6f987f640 1 -- 172.21.15.28:0/1565938549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6f41560e0 msgr2=0x7fd6f41f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6f987f640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6f41560e0 0x7fd6f41f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6f987f640 1 -- 172.21.15.28:0/1565938549 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e40094d0 con 0x7fd6f406d520 2023-12-16T03:26:14.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.073+0000 7fd6f987f640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6f406d520 0x7fd6f40aa360 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000e930 tx=0x7fd6f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:14.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.077+0000 7fd6ea7fc640 1 -- 172.21.15.28:0/1565938549 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0009690 con 0x7fd6f406d520 2023-12-16T03:26:14.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.077+0000 7fd6ea7fc640 1 -- 172.21.15.28:0/1565938549 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f000ca00 con 0x7fd6f406d520 2023-12-16T03:26:14.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.077+0000 7fd6ea7fc640 1 -- 172.21.15.28:0/1565938549 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000cd70 con 0x7fd6f406d520 2023-12-16T03:26:14.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.077+0000 7fd6fbae3640 1 -- 172.21.15.28:0/1565938549 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f41f1870 con 0x7fd6f406d520 2023-12-16T03:26:14.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.077+0000 7fd6fbae3640 1 -- 172.21.15.28:0/1565938549 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f40aaf50 con 0x7fd6f406d520 2023-12-16T03:26:14.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.077+0000 7fd6fbae3640 1 -- 172.21.15.28:0/1565938549 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f4068400 con 0x7fd6f406d520 2023-12-16T03:26:14.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.077+0000 7fd6ea7fc640 1 -- 172.21.15.28:0/1565938549 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd6f0013470 con 0x7fd6f406d520 2023-12-16T03:26:14.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.077+0000 7fd6ea7fc640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6d8066470 0x7fd6d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:14.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.077+0000 7fd6ea7fc640 1 -- 172.21.15.28:0/1565938549 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6f00840c0 con 0x7fd6f406d520 2023-12-16T03:26:14.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.077+0000 7fd6f907e640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6d8066470 0x7fd6d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:14.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.077+0000 7fd6f907e640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6d8066470 0x7fd6d8068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40ae000 tx=0x7fd6e40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:14.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.081+0000 7fd6ea7fc640 1 -- 172.21.15.28:0/1565938549 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd6f00b5290 con 0x7fd6f406d520 2023-12-16T03:26:14.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 -- 172.21.15.28:0/1565938549 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd6f40c4e70 con 0x7fd6f406d520 2023-12-16T03:26:14.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6ea7fc640 1 -- 172.21.15.28:0/1565938549 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd6f0017070 con 0x7fd6f406d520 2023-12-16T03:26:14.279 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:26:14.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 -- 172.21.15.28:0/1565938549 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6d8066470 msgr2=0x7fd6d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:14.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6d8066470 0x7fd6d8068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40ae000 tx=0x7fd6e40a7000 comp rx=0 tx=0).stop 2023-12-16T03:26:14.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 -- 172.21.15.28:0/1565938549 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6f406d520 msgr2=0x7fd6f40aa360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:14.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6f406d520 0x7fd6f40aa360 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000e930 tx=0x7fd6f000edf0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 -- 172.21.15.28:0/1565938549 shutdown_connections 2023-12-16T03:26:14.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6f41560e0 0x7fd6f41f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd6f40bffc0 0x7fd6f4156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6d8066470 0x7fd6d8068930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 --2- 172.21.15.28:0/1565938549 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6f406d520 0x7fd6f40aa360 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:14.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 -- 172.21.15.28:0/1565938549 >> 172.21.15.28:0/1565938549 conn(0x7fd6f406a5b0 msgr2=0x7fd6f4072680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:14.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 -- 172.21.15.28:0/1565938549 shutdown_connections 2023-12-16T03:26:14.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:14.273+0000 7fd6fbae3640 1 -- 172.21.15.28:0/1565938549 wait complete. 2023-12-16T03:26:14.300 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-16T03:26:14.300 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:26:14.300 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2023-12-16T03:26:14.300 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-16T03:26:14.300 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T03:26:14.300 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-16T03:26:14.300 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:26:14.300 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:26:14.300 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:26:14.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:14.301 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:14.311 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42331sec preferred_lft 42331sec 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:9f:0c:41:28 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:14.312 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:26:14.313 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:14.313 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:26:14.313 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:14.313 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:26:14.313 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:14.313 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:26:14.313 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T03:26:14.313 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:26:14.313 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:14.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:14.314 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:26:14.376 INFO:teuthology.orchestra.run.smithi028.stdout:1 2023-12-16T03:26:14.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:14.378 DEBUG:teuthology.orchestra.run.smithi028:> route 2023-12-16T03:26:14.435 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2023-12-16T03:26:14.435 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:26:14.435 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-16T03:26:14.436 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:26:14.436 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-16T03:26:14.436 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:26:14.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:14.436 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec bash -c ' 2023-12-16T03:26:14.436 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2023-12-16T03:26:14.437 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-16T03:26:14.437 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-16T03:26:14.437 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-16T03:26:14.437 DEBUG:teuthology.orchestra.run.smithi028:> ') 2023-12-16T03:26:14.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:14.531 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2023-12-16T03:26:14.541 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T03:26:14.541 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:26:14.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:14.541 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2023-12-16T03:26:14.610 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:26:14.611 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T03:26:14.661 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:26:14.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:26:14.662 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:26:14.713 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-16T03:26:14.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:14.713 DEBUG:teuthology.orchestra.run.smithi028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:14.809 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:14.809 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:26:14.823 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:14.824 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:26:14.824 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:26:14.824 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: trying mount with new device syntax: 0@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs=/ 2023-12-16T03:26:14.824 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:26:14.827 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:26:14.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:14.827 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:26:14.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:14.848 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:26:14.908 INFO:teuthology.orchestra.run.smithi028.stdout:client5143 2023-12-16T03:26:14.908 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:26:14.908 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:14.958 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:26:15.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6276d5f640 1 Processor -- start 2023-12-16T03:26:15.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6276d5f640 1 -- start start 2023-12-16T03:26:15.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6276d5f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6270151cd0 0x7f62700ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:15.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6276d5f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154be0 0x7f627015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:15.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6276d5f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700c8160 con 0x7f62700c7c50 2023-12-16T03:26:15.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6276d5f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6270157b40 con 0x7f6270151cd0 2023-12-16T03:26:15.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6276d5f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6270157e20 con 0x7f6270154be0 2023-12-16T03:26:15.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f627555c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f62700c7c50 0x7f62701544d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:35068/0 (socket says 172.21.15.28:35068) 2023-12-16T03:26:15.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f627555c640 1 -- 172.21.15.28:0/2284897751 learned_addr learned my addr 172.21.15.28:0/2284897751 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:15.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6275d5d640 1 --2- 172.21.15.28:0/2284897751 >> v2:172.21.15.134:3300/0 conn(0x7f6270151cd0 0x7f62700ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:15.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f627655e640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154be0 0x7f627015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:15.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274287876 0 0) 0x7f62700c8160 con 0x7f62700c7c50 2023-12-16T03:26:15.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f625c003530 con 0x7f62700c7c50 2023-12-16T03:26:15.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4070468491 0 0) 0x7f625c003530 con 0x7f62700c7c50 2023-12-16T03:26:15.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154be0 msgr2=0x7f627015ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154be0 0x7f627015ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 >> v2:172.21.15.134:3300/0 conn(0x7f6270151cd0 msgr2=0x7f62700ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 --2- 172.21.15.28:0/2284897751 >> v2:172.21.15.134:3300/0 conn(0x7f6270151cd0 0x7f62700ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270158100 con 0x7f62700c7c50 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f6260001680 con 0x7f62700c7c50 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 >> v1:172.21.15.28:6789/0 conn(0x7f62700c7c50 legacy=0x7f62701544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f625c003980 0x7f625c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.137+0000 7f6274d5b640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154be0 0x7f625c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6274d5b640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c004d10 0x7f625c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6270157b40 con 0x7f625c003980 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6270157e20 con 0x7f625c004d10 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c00b990 con 0x7f6270154be0 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6275d5d640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f625c003980 0x7f625c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f627555c640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154be0 0x7f625c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f627655e640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c004d10 0x7f625c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:15.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6275d5d640 1 -- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154be0 msgr2=0x7f625c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:15.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6275d5d640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154be0 0x7f625c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:15.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6275d5d640 1 -- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c004d10 msgr2=0x7f625c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:15.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6275d5d640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c004d10 0x7f625c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:15.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6275d5d640 1 -- 172.21.15.28:0/2284897751 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c003530 con 0x7f625c003980 2023-12-16T03:26:15.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f627655e640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c004d10 0x7f625c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:15.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f627555c640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154be0 0x7f625c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:15.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6275d5d640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f625c003980 0x7f625c003da0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f626c009ae0 tx=0x7f626c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b2783d0121cae5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:15.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0a5650 con 0x7f625c003980 2023-12-16T03:26:15.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c0a57b0 con 0x7f625c003980 2023-12-16T03:26:15.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.141+0000 7f6274d5b640 1 -- 172.21.15.28:0/2284897751 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0a5b60 con 0x7f625c003980 2023-12-16T03:26:15.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 -- 172.21.15.28:0/2284897751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f625c003980 msgr2=0x7f625c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:15.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 --2- 172.21.15.28:0/2284897751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f625c003980 0x7f625c003da0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f626c009ae0 tx=0x7f626c01ca60 comp rx=0 tx=0).stop 2023-12-16T03:26:15.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f627655e640 1 -- 172.21.15.28:0/2284897751 reap_dead start 2023-12-16T03:26:15.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 -- 172.21.15.28:0/2284897751 shutdown_connections 2023-12-16T03:26:15.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 -- 172.21.15.28:0/2284897751 >> 172.21.15.28:0/2284897751 conn(0x7f62700abee0 msgr2=0x7f62700c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:15.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 -- 172.21.15.28:0/2284897751 shutdown_connections 2023-12-16T03:26:15.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 -- 172.21.15.28:0/2284897751 wait complete. 2023-12-16T03:26:15.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 Processor -- start 2023-12-16T03:26:15.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 -- start start 2023-12-16T03:26:15.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c003980 0x7f6270153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:15.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62700c3740 0x7f6270152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154690 0x7f627015b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62701591e0 con 0x7f62700c3740 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6270159b90 con 0x7f625c003980 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6276d5f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62701ed8a0 con 0x7f6270154690 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f627555c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62700c3740 0x7f6270152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f627555c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62700c3740 0x7f6270152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35448/0 (socket says 172.21.15.28:35448) 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f627555c640 1 -- 172.21.15.28:0/4233220283 learned_addr learned my addr 172.21.15.28:0/4233220283 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f627655e640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154690 0x7f627015b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6275d5d640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c003980 0x7f6270153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f627555c640 1 -- 172.21.15.28:0/4233220283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154690 msgr2=0x7f627015b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f627555c640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154690 0x7f627015b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f627555c640 1 -- 172.21.15.28:0/4233220283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c003980 msgr2=0x7f6270153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f627555c640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c003980 0x7f6270153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:15.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f627555c640 1 -- 172.21.15.28:0/4233220283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62701ed240 con 0x7f62700c3740 2023-12-16T03:26:15.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f6275d5d640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c003980 0x7f6270153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:15.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.145+0000 7f627655e640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154690 0x7f627015b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:15.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.149+0000 7f627555c640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62700c3740 0x7f6270152910 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f626000e7b0 tx=0x7f626000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:15.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.149+0000 7f62667fc640 1 -- 172.21.15.28:0/4233220283 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000ee60 con 0x7f62700c3740 2023-12-16T03:26:15.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.149+0000 7f62667fc640 1 -- 172.21.15.28:0/4233220283 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626000c870 con 0x7f62700c3740 2023-12-16T03:26:15.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.149+0000 7f6276d5f640 1 -- 172.21.15.28:0/4233220283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6270153ba0 con 0x7f62700c3740 2023-12-16T03:26:15.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.149+0000 7f62667fc640 1 -- 172.21.15.28:0/4233220283 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000cc00 con 0x7f62700c3740 2023-12-16T03:26:15.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.149+0000 7f6276d5f640 1 -- 172.21.15.28:0/4233220283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62701ed4c0 con 0x7f62700c3740 2023-12-16T03:26:15.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.149+0000 7f6276d5f640 1 -- 172.21.15.28:0/4233220283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62701543b0 con 0x7f62700c3740 2023-12-16T03:26:15.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.149+0000 7f62667fc640 1 -- 172.21.15.28:0/4233220283 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6260013420 con 0x7f62700c3740 2023-12-16T03:26:15.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.149+0000 7f62667fc640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62540664a0 0x7f6254068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:15.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.149+0000 7f62667fc640 1 -- 172.21.15.28:0/4233220283 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6260083be0 con 0x7f62700c3740 2023-12-16T03:26:15.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.149+0000 7f6275d5d640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62540664a0 0x7f6254068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:15.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.153+0000 7f6275d5d640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62540664a0 0x7f6254068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f626c0af000 tx=0x7f626c0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:15.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.153+0000 7f62667fc640 1 -- 172.21.15.28:0/4233220283 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f62701543b0 con 0x7f62700c3740 2023-12-16T03:26:15.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 -- 172.21.15.28:0/4233220283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f62701543b0 con 0x7f62700c3740 2023-12-16T03:26:15.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f62667fc640 1 -- 172.21.15.28:0/4233220283 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f62701543b0 con 0x7f62700c3740 2023-12-16T03:26:15.351 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:26:15.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 -- 172.21.15.28:0/4233220283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62540664a0 msgr2=0x7f6254068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:15.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62540664a0 0x7f6254068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f626c0af000 tx=0x7f626c0046d0 comp rx=0 tx=0).stop 2023-12-16T03:26:15.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 -- 172.21.15.28:0/4233220283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62700c3740 msgr2=0x7f6270152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:15.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62700c3740 0x7f6270152910 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f626000e7b0 tx=0x7f626000ec70 comp rx=0 tx=0).stop 2023-12-16T03:26:15.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 -- 172.21.15.28:0/4233220283 shutdown_connections 2023-12-16T03:26:15.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6270154690 0x7f627015b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:15.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62540664a0 0x7f6254068960 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:15.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62700c3740 0x7f6270152910 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:15.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 --2- 172.21.15.28:0/4233220283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c003980 0x7f6270153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:15.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 -- 172.21.15.28:0/4233220283 >> 172.21.15.28:0/4233220283 conn(0x7f62700abee0 msgr2=0x7f627015c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:15.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 -- 172.21.15.28:0/4233220283 shutdown_connections 2023-12-16T03:26:15.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:15.345+0000 7f6276d5f640 1 -- 172.21.15.28:0/4233220283 wait complete. 2023-12-16T03:26:15.372 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-16T03:26:15.372 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:26:15.373 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-12-16T03:26:15.373 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-16T03:26:15.373 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:26:15.373 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-16T03:26:15.373 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:26:15.373 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:26:15.373 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:26:15.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:15.373 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-12-16T03:26:15.384 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:26:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:26:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:15.385 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42364sec preferred_lft 42364sec 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 02:42:8f:0f:48:af brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:26:15.386 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T03:26:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:26:15.387 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:15.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:15.387 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:26:15.453 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-12-16T03:26:15.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:15.456 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-12-16T03:26:15.508 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-12-16T03:26:15.508 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:26:15.508 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-16T03:26:15.508 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T03:26:15.508 INFO:teuthology.orchestra.run.smithi134.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:26:15.509 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T03:26:15.509 INFO:teuthology.orchestra.run.smithi134.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:26:15.509 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:26:15.509 INFO:teuthology.orchestra.run.smithi134.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:26:15.509 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:26:15.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:15.509 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:26:15.509 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:26:15.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T03:26:15.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T03:26:15.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T03:26:15.510 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:26:15.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:15.611 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-16T03:26:15.620 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T03:26:15.621 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:26:15.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:15.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-12-16T03:26:15.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:26:15.690 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T03:26:15.745 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:26:15.745 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:26:15.745 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:26:15.796 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-16T03:26:15.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:15.796 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:26:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:26:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:26:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: 1@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs=/ 2023-12-16T03:26:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:26:15.909 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:26:15.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:15.909 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:26:15.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:15.930 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:26:15.984 INFO:teuthology.orchestra.run.smithi134.stdout:client5149 2023-12-16T03:26:15.984 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:26:15.984 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:16.041 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-16T03:26:16.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.189+0000 7fedf68bb640 1 Processor -- start 2023-12-16T03:26:16.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.189+0000 7fedf68bb640 1 -- start start 2023-12-16T03:26:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.189+0000 7fedf68bb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fedf00bf9f0 0x7fedf0158330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.189+0000 7fedf68bb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf006a5b0 con 0x7fedf014b010 2023-12-16T03:26:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.189+0000 7fedf68bb640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf006b710 con 0x7fedf0073a70 2023-12-16T03:26:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.189+0000 7fedf68bb640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf00bfe10 con 0x7fedf00bf9f0 2023-12-16T03:26:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.189+0000 7fedeffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fedf014b010 0x7fedf006b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:35070/0 (socket says 172.21.15.28:35070) 2023-12-16T03:26:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.189+0000 7fedeffff640 1 -- 172.21.15.28:0/3239047157 learned_addr learned my addr 172.21.15.28:0/3239047157 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedf4e58640 1 --2- 172.21.15.28:0/3239047157 >> v2:172.21.15.134:3300/0 conn(0x7fedf00bf9f0 0x7fedf0158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141616252 0 0) 0x7fedf006a5b0 con 0x7fedf014b010 2023-12-16T03:26:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd8003530 con 0x7fedf014b010 2023-12-16T03:26:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3787949898 0 0) 0x7fedd8003530 con 0x7fedf014b010 2023-12-16T03:26:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 >> v2:172.21.15.134:3300/0 conn(0x7fedf00bf9f0 msgr2=0x7fedf0158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 --2- 172.21.15.28:0/3239047157 >> v2:172.21.15.134:3300/0 conn(0x7fedf00bf9f0 0x7fedf0158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 >> v1:172.21.15.134:6789/0 conn(0x7fedf0073a70 legacy=0x7fedf0157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00c1d60 con 0x7fedf014b010 2023-12-16T03:26:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fede0001680 con 0x7fedf014b010 2023-12-16T03:26:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 >> v1:172.21.15.28:6789/0 conn(0x7fedf014b010 legacy=0x7fedf006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 --2- 172.21.15.28:0/3239047157 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedd8003980 0x7fedd8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 --2- 172.21.15.28:0/3239047157 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedd8004380 0x7fedd8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 --2- 172.21.15.28:0/3239047157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd8005050 0x7fedd800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf00bfe10 con 0x7fedd8004380 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd800bf00 con 0x7fedd8005050 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd800c0c0 con 0x7fedd8003980 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedef7fe640 1 --2- 172.21.15.28:0/3239047157 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedd8004380 0x7fedd8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedeffff640 1 --2- 172.21.15.28:0/3239047157 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedd8003980 0x7fedd8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedf4e58640 1 --2- 172.21.15.28:0/3239047157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd8005050 0x7fedd800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedef7fe640 1 -- 172.21.15.28:0/3239047157 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedd8003980 msgr2=0x7fedd8003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedef7fe640 1 --2- 172.21.15.28:0/3239047157 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedd8003980 0x7fedd8003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedef7fe640 1 -- 172.21.15.28:0/3239047157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd8005050 msgr2=0x7fedd800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedef7fe640 1 --2- 172.21.15.28:0/3239047157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd8005050 0x7fedd800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedef7fe640 1 -- 172.21.15.28:0/3239047157 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd8003530 con 0x7fedd8004380 2023-12-16T03:26:16.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.193+0000 7fedf4e58640 1 -- 172.21.15.28:0/3239047157 reap_dead start 2023-12-16T03:26:16.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedef7fe640 1 --2- 172.21.15.28:0/3239047157 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedd8004380 0x7fedd8004850 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fede4001910 tx=0x7fede401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaefb15b513f728 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0007ea0 con 0x7fedd8004380 2023-12-16T03:26:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede40ab680 con 0x7fedd8004380 2023-12-16T03:26:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedeeffd640 1 -- 172.21.15.28:0/3239047157 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede40aba30 con 0x7fedd8004380 2023-12-16T03:26:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedf68bb640 1 -- 172.21.15.28:0/3239047157 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedd8004380 msgr2=0x7fedd8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedf68bb640 1 --2- 172.21.15.28:0/3239047157 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedd8004380 0x7fedd8004850 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fede4001910 tx=0x7fede401c520 comp rx=0 tx=0).stop 2023-12-16T03:26:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedf68bb640 1 -- 172.21.15.28:0/3239047157 shutdown_connections 2023-12-16T03:26:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedf68bb640 1 --2- 172.21.15.28:0/3239047157 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedd8004380 0x7fedd8004850 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedf68bb640 1 -- 172.21.15.28:0/3239047157 >> 172.21.15.28:0/3239047157 conn(0x7fedf00c30c0 msgr2=0x7fedf00c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedf68bb640 1 -- 172.21.15.28:0/3239047157 shutdown_connections 2023-12-16T03:26:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedf68bb640 1 -- 172.21.15.28:0/3239047157 wait complete. 2023-12-16T03:26:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedf68bb640 1 Processor -- start 2023-12-16T03:26:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.197+0000 7fedf68bb640 1 -- start start 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedf68bb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd8004380 0x7fedf00ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedf68bb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedf0158880 0x7fedf01ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedf68bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedf01ea470 0x7fedf0150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedf68bb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf00aa880 con 0x7fedf0158880 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedf68bb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf01e9a60 con 0x7fedd8004380 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedf68bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf00ab3d0 con 0x7fedf01ea470 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedef7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedf0158880 0x7fedf01ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedef7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedf0158880 0x7fedf01ed050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35460/0 (socket says 172.21.15.28:35460) 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedef7fe640 1 -- 172.21.15.28:0/817448501 learned_addr learned my addr 172.21.15.28:0/817448501 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedf4e58640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedf01ea470 0x7fedf0150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedeffff640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd8004380 0x7fedf00ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedef7fe640 1 -- 172.21.15.28:0/817448501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedf01ea470 msgr2=0x7fedf0150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedef7fe640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedf01ea470 0x7fedf0150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedef7fe640 1 -- 172.21.15.28:0/817448501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd8004380 msgr2=0x7fedf00ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedef7fe640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd8004380 0x7fedf00ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedef7fe640 1 -- 172.21.15.28:0/817448501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00ab6b0 con 0x7fedf0158880 2023-12-16T03:26:16.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedef7fe640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedf0158880 0x7fedf01ed050 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fede40ad040 tx=0x7fede40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:16.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedecff9640 1 -- 172.21.15.28:0/817448501 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede40069e0 con 0x7fedf0158880 2023-12-16T03:26:16.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedecff9640 1 -- 172.21.15.28:0/817448501 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede4006b40 con 0x7fedf0158880 2023-12-16T03:26:16.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedecff9640 1 -- 172.21.15.28:0/817448501 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4007a80 con 0x7fedf0158880 2023-12-16T03:26:16.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedf68bb640 1 -- 172.21.15.28:0/817448501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf00ab990 con 0x7fedf0158880 2023-12-16T03:26:16.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedf68bb640 1 -- 172.21.15.28:0/817448501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf01e9f50 con 0x7fedf0158880 2023-12-16T03:26:16.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedf68bb640 1 -- 172.21.15.28:0/817448501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf00abb80 con 0x7fedf0158880 2023-12-16T03:26:16.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.201+0000 7fedecff9640 1 -- 172.21.15.28:0/817448501 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fede40a9070 con 0x7fedf0158880 2023-12-16T03:26:16.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.205+0000 7fedecff9640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feddc066470 0x7feddc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.205+0000 7fedecff9640 1 -- 172.21.15.28:0/817448501 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fede411e700 con 0x7fedf0158880 2023-12-16T03:26:16.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.205+0000 7fedeffff640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feddc066470 0x7feddc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.205+0000 7fedeffff640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feddc066470 0x7feddc068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fede0001060 tx=0x7fede0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:16.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.209+0000 7fedecff9640 1 -- 172.21.15.28:0/817448501 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fede40ebcb0 con 0x7fedf0158880 2023-12-16T03:26:16.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 -- 172.21.15.28:0/817448501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fedf0068400 con 0x7fedf0158880 2023-12-16T03:26:16.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedecff9640 1 -- 172.21.15.28:0/817448501 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v11) v1 ==== 84+0+0 (secure 0 0 0) 0x7fede40ef2d0 con 0x7fedf0158880 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 -- 172.21.15.28:0/817448501 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feddc066470 msgr2=0x7feddc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feddc066470 0x7feddc068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fede0001060 tx=0x7fede0009040 comp rx=0 tx=0).stop 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 -- 172.21.15.28:0/817448501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedf0158880 msgr2=0x7fedf01ed050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedf0158880 0x7fedf01ed050 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fede40ad040 tx=0x7fede40192c0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 -- 172.21.15.28:0/817448501 shutdown_connections 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedf01ea470 0x7fedf0150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feddc066470 0x7feddc068930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedf0158880 0x7fedf01ed050 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 --2- 172.21.15.28:0/817448501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedd8004380 0x7fedf00ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 -- 172.21.15.28:0/817448501 >> 172.21.15.28:0/817448501 conn(0x7fedf00c30c0 msgr2=0x7fedf00c0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 -- 172.21.15.28:0/817448501 shutdown_connections 2023-12-16T03:26:16.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.421+0000 7fedf68bb640 1 -- 172.21.15.28:0/817448501 wait complete. 2023-12-16T03:26:16.447 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:16.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c3e17640 1 Processor -- start 2023-12-16T03:26:16.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c3e17640 1 -- start start 2023-12-16T03:26:16.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c3e17640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff6bc06bbb0 0x7ff6bc1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c3e17640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc06c860 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c3e17640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc06c000 con 0x7ff6bc151e90 2023-12-16T03:26:16.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c3e17640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6bc0c8750 con 0x7ff6bc06bbb0 2023-12-16T03:26:16.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c13b2640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff6bc0c7ea0 0x7ff6bc06b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:35074/0 (socket says 172.21.15.28:35074) 2023-12-16T03:26:16.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c13b2640 1 -- 172.21.15.28:0/3556445847 learned_addr learned my addr 172.21.15.28:0/3556445847 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:16.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c23b4640 1 --2- 172.21.15.28:0/3556445847 >> v2:172.21.15.134:3300/0 conn(0x7ff6bc06bbb0 0x7ff6bc1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c0bb1640 1 -- 172.21.15.28:0/3556445847 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943083947 0 0) 0x7ff6bc06c860 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c0bb1640 1 -- 172.21.15.28:0/3556445847 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a8003530 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c23b4640 1 -- 172.21.15.28:0/3556445847 >> v1:172.21.15.134:6789/0 conn(0x7ff6bc151e90 legacy=0x7ff6bc0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c0bb1640 1 -- 172.21.15.28:0/3556445847 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915860226 0 0) 0x7ff6bc06c000 con 0x7ff6bc151e90 2023-12-16T03:26:16.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c23b4640 1 -- 172.21.15.28:0/3556445847 >> v1:172.21.15.28:6789/0 conn(0x7ff6bc0c7ea0 legacy=0x7ff6bc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.585+0000 7ff6c23b4640 1 -- 172.21.15.28:0/3556445847 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc154930 con 0x7ff6bc06bbb0 2023-12-16T03:26:16.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.589+0000 7ff6c23b4640 1 --2- 172.21.15.28:0/3556445847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc06bbb0 0x7ff6bc1600b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009d90 tx=0x7ff6b401c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c43e8ee0bd35882e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:16.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.589+0000 7ff6c0bb1640 1 -- 172.21.15.28:0/3556445847 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40a6700 con 0x7ff6bc06bbb0 2023-12-16T03:26:16.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.589+0000 7ff6c0bb1640 1 -- 172.21.15.28:0/3556445847 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b40a6860 con 0x7ff6bc06bbb0 2023-12-16T03:26:16.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.589+0000 7ff6c0bb1640 1 -- 172.21.15.28:0/3556445847 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40a6bf0 con 0x7ff6bc06bbb0 2023-12-16T03:26:16.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.589+0000 7ff6c3e17640 1 -- 172.21.15.28:0/3556445847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc06bbb0 msgr2=0x7ff6bc1600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.589+0000 7ff6c3e17640 1 --2- 172.21.15.28:0/3556445847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc06bbb0 0x7ff6bc1600b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009d90 tx=0x7ff6b401c830 comp rx=0 tx=0).stop 2023-12-16T03:26:16.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.589+0000 7ff6c3e17640 1 -- 172.21.15.28:0/3556445847 shutdown_connections 2023-12-16T03:26:16.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.589+0000 7ff6c3e17640 1 --2- 172.21.15.28:0/3556445847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc06bbb0 0x7ff6bc1600b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.589+0000 7ff6c3e17640 1 -- 172.21.15.28:0/3556445847 >> 172.21.15.28:0/3556445847 conn(0x7ff6bc0ca170 msgr2=0x7ff6bc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:16.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.589+0000 7ff6c3e17640 1 -- 172.21.15.28:0/3556445847 shutdown_connections 2023-12-16T03:26:16.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.589+0000 7ff6c3e17640 1 -- 172.21.15.28:0/3556445847 wait complete. 2023-12-16T03:26:16.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c3e17640 1 Processor -- start 2023-12-16T03:26:16.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c3e17640 1 -- start start 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c3e17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc06bbb0 0x7ff6bc0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c3e17640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6bc0c7ea0 0x7ff6bc0af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c3e17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6bc151e90 0x7ff6bc157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c3e17640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc1552d0 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c3e17640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc0af870 con 0x7ff6bc06bbb0 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c3e17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc0ae960 con 0x7ff6bc151e90 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c13b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6bc0c7ea0 0x7ff6bc0af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c13b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6bc0c7ea0 0x7ff6bc0af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35464/0 (socket says 172.21.15.28:35464) 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c13b2640 1 -- 172.21.15.28:0/4161158 learned_addr learned my addr 172.21.15.28:0/4161158 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c1bb3640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc06bbb0 0x7ff6bc0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c23b4640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6bc151e90 0x7ff6bc157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c13b2640 1 -- 172.21.15.28:0/4161158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6bc151e90 msgr2=0x7ff6bc157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c13b2640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6bc151e90 0x7ff6bc157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c13b2640 1 -- 172.21.15.28:0/4161158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc06bbb0 msgr2=0x7ff6bc0aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c13b2640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc06bbb0 0x7ff6bc0aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c13b2640 1 -- 172.21.15.28:0/4161158 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4009a70 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c13b2640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6bc0c7ea0 0x7ff6bc0af330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00c3f0 tx=0x7ff6ac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:16.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6b27fc640 1 -- 172.21.15.28:0/4161158 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac005cf0 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6b27fc640 1 -- 172.21.15.28:0/4161158 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac005e50 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6b27fc640 1 -- 172.21.15.28:0/4161158 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0072f0 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c3e17640 1 -- 172.21.15.28:0/4161158 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc0add50 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.593+0000 7ff6c3e17640 1 -- 172.21.15.28:0/4161158 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc0ae310 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.597+0000 7ff6c3e17640 1 -- 172.21.15.28:0/4161158 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6bc068400 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.597+0000 7ff6b27fc640 1 -- 172.21.15.28:0/4161158 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff6ac007450 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.597+0000 7ff6b27fc640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff6a0066470 0x7ff6a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.597+0000 7ff6b27fc640 1 -- 172.21.15.28:0/4161158 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6ac0833c0 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.597+0000 7ff6c1bb3640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff6a0066470 0x7ff6a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.597+0000 7ff6c1bb3640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff6a0066470 0x7ff6a0068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8000f70 tx=0x7ff6b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:16.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.601+0000 7ff6b27fc640 1 -- 172.21.15.28:0/4161158 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff6ac0508e0 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.757+0000 7ff6c3e17640 1 -- 172.21.15.28:0/4161158 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6bc0aeaa0 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.757+0000 7ff6b27fc640 1 -- 172.21.15.28:0/4161158 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16569 (secure 0 0 0) 0x7ff6ac053f00 con 0x7ff6bc0c7ea0 2023-12-16T03:26:16.765 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:16.765 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":32,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:04.457569+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:16.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 -- 172.21.15.28:0/4161158 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff6a0066470 msgr2=0x7ff6a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff6a0066470 0x7ff6a0068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8000f70 tx=0x7ff6b8009040 comp rx=0 tx=0).stop 2023-12-16T03:26:16.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 -- 172.21.15.28:0/4161158 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6bc0c7ea0 msgr2=0x7ff6bc0af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6bc0c7ea0 0x7ff6bc0af330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00c3f0 tx=0x7ff6ac00c8b0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 -- 172.21.15.28:0/4161158 shutdown_connections 2023-12-16T03:26:16.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6bc151e90 0x7ff6bc157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff6a0066470 0x7ff6a0068930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff6bc0c7ea0 0x7ff6bc0af330 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 --2- 172.21.15.28:0/4161158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6bc06bbb0 0x7ff6bc0aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 -- 172.21.15.28:0/4161158 >> 172.21.15.28:0/4161158 conn(0x7ff6bc0ca170 msgr2=0x7ff6bc0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:16.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 -- 172.21.15.28:0/4161158 shutdown_connections 2023-12-16T03:26:16.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.761+0000 7ff6c3e17640 1 -- 172.21.15.28:0/4161158 wait complete. 2023-12-16T03:26:16.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:26:00.659571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:26:01.837383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:26:16.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:26:16.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.925+0000 7fc844172640 1 Processor -- start 2023-12-16T03:26:16.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc844172640 1 -- start start 2023-12-16T03:26:16.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc844172640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc83c0c5260 0x7fc83c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc844172640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc83c155de0 0x7fc83c156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc844172640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c0c2580 con 0x7fc83c0c5640 2023-12-16T03:26:16.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc844172640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c153510 con 0x7fc83c155de0 2023-12-16T03:26:16.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc844172640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0c17f0 con 0x7fc83c0c5260 2023-12-16T03:26:16.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc84170d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc83c0c5640 0x7fc83c0c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:35082/0 (socket says 172.21.15.28:35082) 2023-12-16T03:26:16.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc84170d640 1 -- 172.21.15.28:0/2852197416 learned_addr learned my addr 172.21.15.28:0/2852197416 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:16.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc84270f640 1 --2- 172.21.15.28:0/2852197416 >> v2:172.21.15.134:3300/0 conn(0x7fc83c155de0 0x7fc83c156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc841f0e640 1 --2- 172.21.15.28:0/2852197416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc83c0c5260 0x7fc83c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc840f0c640 1 -- 172.21.15.28:0/2852197416 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154346686 0 0) 0x7fc83c0c2580 con 0x7fc83c0c5640 2023-12-16T03:26:16.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc840f0c640 1 -- 172.21.15.28:0/2852197416 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc828003530 con 0x7fc83c0c5640 2023-12-16T03:26:16.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc84270f640 1 -- 172.21.15.28:0/2852197416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc83c0c5260 msgr2=0x7fc83c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:16.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc84270f640 1 --2- 172.21.15.28:0/2852197416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc83c0c5260 0x7fc83c06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc84270f640 1 -- 172.21.15.28:0/2852197416 >> v1:172.21.15.28:6789/0 conn(0x7fc83c0c5640 legacy=0x7fc83c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.929+0000 7fc84270f640 1 -- 172.21.15.28:0/2852197416 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0c1a00 con 0x7fc83c155de0 2023-12-16T03:26:16.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc84270f640 1 --2- 172.21.15.28:0/2852197416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc83c155de0 0x7fc83c156250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0c1930 tx=0x7fc83401c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f77e4bf52b646578 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:16.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc840f0c640 1 -- 172.21.15.28:0/2852197416 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340a5930 con 0x7fc83c155de0 2023-12-16T03:26:16.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc840f0c640 1 -- 172.21.15.28:0/2852197416 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8340a5a90 con 0x7fc83c155de0 2023-12-16T03:26:16.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc840f0c640 1 -- 172.21.15.28:0/2852197416 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340a5e20 con 0x7fc83c155de0 2023-12-16T03:26:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc844172640 1 -- 172.21.15.28:0/2852197416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc83c155de0 msgr2=0x7fc83c156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc844172640 1 --2- 172.21.15.28:0/2852197416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc83c155de0 0x7fc83c156250 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0c1930 tx=0x7fc83401c870 comp rx=0 tx=0).stop 2023-12-16T03:26:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc844172640 1 -- 172.21.15.28:0/2852197416 shutdown_connections 2023-12-16T03:26:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc844172640 1 --2- 172.21.15.28:0/2852197416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc83c155de0 0x7fc83c156250 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc844172640 1 --2- 172.21.15.28:0/2852197416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc83c0c5260 0x7fc83c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc844172640 1 -- 172.21.15.28:0/2852197416 >> 172.21.15.28:0/2852197416 conn(0x7fc83c06a5b0 msgr2=0x7fc83c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc844172640 1 -- 172.21.15.28:0/2852197416 shutdown_connections 2023-12-16T03:26:16.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc844172640 1 -- 172.21.15.28:0/2852197416 wait complete. 2023-12-16T03:26:16.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc844172640 1 Processor -- start 2023-12-16T03:26:16.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.933+0000 7fc844172640 1 -- start start 2023-12-16T03:26:16.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc844172640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc83c0c5260 0x7fc83c0bf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc844172640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83c0c5640 0x7fc83c151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc844172640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc83c155de0 0x7fc83c0bc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc844172640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1ee780 con 0x7fc83c0c5640 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc844172640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0bfc90 con 0x7fc83c155de0 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc844172640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1ede50 con 0x7fc83c0c5260 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc84170d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83c0c5640 0x7fc83c151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc84170d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83c0c5640 0x7fc83c151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35478/0 (socket says 172.21.15.28:35478) 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc84170d640 1 -- 172.21.15.28:0/1985279907 learned_addr learned my addr 172.21.15.28:0/1985279907 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc841f0e640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc83c0c5260 0x7fc83c0bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc84270f640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc83c155de0 0x7fc83c0bc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc84170d640 1 -- 172.21.15.28:0/1985279907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc83c0c5260 msgr2=0x7fc83c0bf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc84170d640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc83c0c5260 0x7fc83c0bf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc84170d640 1 -- 172.21.15.28:0/1985279907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc83c155de0 msgr2=0x7fc83c0bc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:16.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc84170d640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc83c155de0 0x7fc83c0bc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:16.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc84170d640 1 -- 172.21.15.28:0/1985279907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc834009a70 con 0x7fc83c0c5640 2023-12-16T03:26:16.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc84170d640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83c0c5640 0x7fc83c151070 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc82c001ec0 tx=0x7fc82c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:16.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc8327fc640 1 -- 172.21.15.28:0/1985279907 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c005d50 con 0x7fc83c0c5640 2023-12-16T03:26:16.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc8327fc640 1 -- 172.21.15.28:0/1985279907 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c007070 con 0x7fc83c0c5640 2023-12-16T03:26:16.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc8327fc640 1 -- 172.21.15.28:0/1985279907 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c007420 con 0x7fc83c0c5640 2023-12-16T03:26:16.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc844172640 1 -- 172.21.15.28:0/1985279907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c1ee130 con 0x7fc83c0c5640 2023-12-16T03:26:16.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc844172640 1 -- 172.21.15.28:0/1985279907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c1519b0 con 0x7fc83c0c5640 2023-12-16T03:26:16.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.937+0000 7fc844172640 1 -- 172.21.15.28:0/1985279907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c1ee8f0 con 0x7fc83c0c5640 2023-12-16T03:26:16.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.941+0000 7fc8327fc640 1 -- 172.21.15.28:0/1985279907 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc82c007580 con 0x7fc83c0c5640 2023-12-16T03:26:16.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.941+0000 7fc8327fc640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc820066470 0x7fc820068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:16.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.941+0000 7fc8327fc640 1 -- 172.21.15.28:0/1985279907 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc82c082ff0 con 0x7fc83c0c5640 2023-12-16T03:26:16.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.941+0000 7fc841f0e640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc820066470 0x7fc820068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:16.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.941+0000 7fc841f0e640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc820066470 0x7fc820068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc838009a50 tx=0x7fc838008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:16.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:16.945+0000 7fc8327fc640 1 -- 172.21.15.28:0/1985279907 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc82c0b4290 con 0x7fc83c0c5640 2023-12-16T03:26:17.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.101+0000 7fc844172640 1 -- 172.21.15.28:0/1985279907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc83c068400 con 0x7fc83c0c5640 2023-12-16T03:26:17.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.101+0000 7fc8327fc640 1 -- 172.21.15.28:0/1985279907 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc82c017020 con 0x7fc83c0c5640 2023-12-16T03:26:17.109 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:26:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 -- 172.21.15.28:0/1985279907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc820066470 msgr2=0x7fc820068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc820066470 0x7fc820068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc838009a50 tx=0x7fc838008040 comp rx=0 tx=0).stop 2023-12-16T03:26:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 -- 172.21.15.28:0/1985279907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83c0c5640 msgr2=0x7fc83c151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83c0c5640 0x7fc83c151070 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc82c001ec0 tx=0x7fc82c00c960 comp rx=0 tx=0).stop 2023-12-16T03:26:17.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 -- 172.21.15.28:0/1985279907 shutdown_connections 2023-12-16T03:26:17.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc83c155de0 0x7fc83c0bc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc820066470 0x7fc820068930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83c0c5640 0x7fc83c151070 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 --2- 172.21.15.28:0/1985279907 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc83c0c5260 0x7fc83c0bf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 -- 172.21.15.28:0/1985279907 >> 172.21.15.28:0/1985279907 conn(0x7fc83c06a5b0 msgr2=0x7fc83c0a5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:17.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 -- 172.21.15.28:0/1985279907 shutdown_connections 2023-12-16T03:26:17.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.105+0000 7fc844172640 1 -- 172.21.15.28:0/1985279907 wait complete. 2023-12-16T03:26:17.129 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:26:17.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f7186b640 1 Processor -- start 2023-12-16T03:26:17.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f7186b640 1 -- start start 2023-12-16T03:26:17.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f7186b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 0x7f7f6c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f7186b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c06c860 con 0x7f7f6c0c7ea0 2023-12-16T03:26:17.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f7186b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c154930 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f7186b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0c8750 con 0x7f7f6c151e90 2023-12-16T03:26:17.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f63fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7f6c0c7ea0 0x7f7f6c06b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:35094/0 (socket says 172.21.15.28:35094) 2023-12-16T03:26:17.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f63fff640 1 -- 172.21.15.28:0/1270567689 learned_addr learned my addr 172.21.15.28:0/1270567689 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:17.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f6affd640 1 --2- 172.21.15.28:0/1270567689 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 0x7f7f6c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f6a7fc640 1 -- 172.21.15.28:0/1270567689 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772247111 0 0) 0x7f7f6c06c860 con 0x7f7f6c0c7ea0 2023-12-16T03:26:17.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f6a7fc640 1 -- 172.21.15.28:0/1270567689 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f58003530 con 0x7f7f6c0c7ea0 2023-12-16T03:26:17.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f6affd640 1 -- 172.21.15.28:0/1270567689 >> v1:172.21.15.134:6789/0 conn(0x7f7f6c0c4e60 legacy=0x7f7f6c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f6a7fc640 1 -- 172.21.15.28:0/1270567689 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226711605 0 0) 0x7f7f6c154930 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f6affd640 1 -- 172.21.15.28:0/1270567689 >> v1:172.21.15.28:6789/0 conn(0x7f7f6c0c7ea0 legacy=0x7f7f6c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.273+0000 7f7f6affd640 1 -- 172.21.15.28:0/1270567689 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c154c10 con 0x7f7f6c151e90 2023-12-16T03:26:17.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.277+0000 7f7f6affd640 1 --2- 172.21.15.28:0/1270567689 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 0x7f7f6c0c4920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0097f0 tx=0x7f7f5c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b72eca83e57df6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:17.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.277+0000 7f7f6a7fc640 1 -- 172.21.15.28:0/1270567689 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0ab600 con 0x7f7f6c151e90 2023-12-16T03:26:17.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.277+0000 7f7f6a7fc640 1 -- 172.21.15.28:0/1270567689 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c0a7050 con 0x7f7f6c151e90 2023-12-16T03:26:17.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.277+0000 7f7f6a7fc640 1 -- 172.21.15.28:0/1270567689 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0ab980 con 0x7f7f6c151e90 2023-12-16T03:26:17.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.277+0000 7f7f7186b640 1 -- 172.21.15.28:0/1270567689 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 msgr2=0x7f7f6c0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.277+0000 7f7f7186b640 1 --2- 172.21.15.28:0/1270567689 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 0x7f7f6c0c4920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0097f0 tx=0x7f7f5c01c3a0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.277+0000 7f7f7186b640 1 -- 172.21.15.28:0/1270567689 shutdown_connections 2023-12-16T03:26:17.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.277+0000 7f7f7186b640 1 --2- 172.21.15.28:0/1270567689 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 0x7f7f6c0c4920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.277+0000 7f7f7186b640 1 -- 172.21.15.28:0/1270567689 >> 172.21.15.28:0/1270567689 conn(0x7f7f6c0ca170 msgr2=0x7f7f6c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:17.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.277+0000 7f7f7186b640 1 -- 172.21.15.28:0/1270567689 shutdown_connections 2023-12-16T03:26:17.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.277+0000 7f7f7186b640 1 -- 172.21.15.28:0/1270567689 wait complete. 2023-12-16T03:26:17.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f7186b640 1 Processor -- start 2023-12-16T03:26:17.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f7186b640 1 -- start start 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f7186b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f6c0c4e60 0x7f7f6c14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f7186b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f6c0c7ea0 0x7f7f6c1f0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f7186b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 0x7f7f6c1f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f7186b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c1552d0 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f7186b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c1f12b0 con 0x7f7f6c0c7ea0 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f7186b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c1ee560 con 0x7f7f6c151e90 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f6affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f6c0c4e60 0x7f7f6c14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f6affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f6c0c4e60 0x7f7f6c14bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35490/0 (socket says 172.21.15.28:35490) 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f6affd640 1 -- 172.21.15.28:0/895695605 learned_addr learned my addr 172.21.15.28:0/895695605 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f6b7fe640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 0x7f7f6c1f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f63fff640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f6c0c7ea0 0x7f7f6c1f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f6affd640 1 -- 172.21.15.28:0/895695605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 msgr2=0x7f7f6c1f0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f6affd640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 0x7f7f6c1f0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f6affd640 1 -- 172.21.15.28:0/895695605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f6c0c7ea0 msgr2=0x7f7f6c1f0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f6affd640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f6c0c7ea0 0x7f7f6c1f0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f6affd640 1 -- 172.21.15.28:0/895695605 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c009420 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f6b7fe640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 0x7f7f6c1f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:17.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f6affd640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f6c0c4e60 0x7f7f6c14bd80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c018fb0 tx=0x7f7f5c019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:17.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f68ff9640 1 -- 172.21.15.28:0/895695605 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0b6480 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f68ff9640 1 -- 172.21.15.28:0/895695605 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c0b6600 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f68ff9640 1 -- 172.21.15.28:0/895695605 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0b69b0 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f7186b640 1 -- 172.21.15.28:0/895695605 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c1ee840 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.281+0000 7f7f7186b640 1 -- 172.21.15.28:0/895695605 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c1eee00 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.285+0000 7f7f7186b640 1 -- 172.21.15.28:0/895695605 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c068400 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.285+0000 7f7f68ff9640 1 -- 172.21.15.28:0/895695605 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7f5c0b2040 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.285+0000 7f7f68ff9640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f4c0664a0 0x7f7f4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.285+0000 7f7f68ff9640 1 -- 172.21.15.28:0/895695605 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f5c11e2f0 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.285+0000 7f7f63fff640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f4c0664a0 0x7f7f4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.285+0000 7f7f63fff640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f4c0664a0 0x7f7f4c068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c1f0520 tx=0x7f7f54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.289+0000 7f7f68ff9640 1 -- 172.21.15.28:0/895695605 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7f5c0eb760 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.445+0000 7f7f7186b640 1 -- 172.21.15.28:0/895695605 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f6c1ee6a0 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.445+0000 7f7f68ff9640 1 -- 172.21.15.28:0/895695605 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f6c1ee6a0 con 0x7f7f6c0c4e60 2023-12-16T03:26:17.453 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:26:17.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 -- 172.21.15.28:0/895695605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f4c0664a0 msgr2=0x7f7f4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f4c0664a0 0x7f7f4c068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c1f0520 tx=0x7f7f54009040 comp rx=0 tx=0).stop 2023-12-16T03:26:17.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 -- 172.21.15.28:0/895695605 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f6c0c4e60 msgr2=0x7f7f6c14bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f6c0c4e60 0x7f7f6c14bd80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c018fb0 tx=0x7f7f5c019140 comp rx=0 tx=0).stop 2023-12-16T03:26:17.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 -- 172.21.15.28:0/895695605 shutdown_connections 2023-12-16T03:26:17.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f6c151e90 0x7f7f6c1f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f6c0c7ea0 0x7f7f6c1f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f4c0664a0 0x7f7f4c068960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 --2- 172.21.15.28:0/895695605 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f6c0c4e60 0x7f7f6c14bd80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 -- 172.21.15.28:0/895695605 >> 172.21.15.28:0/895695605 conn(0x7f7f6c0ca170 msgr2=0x7f7f6c0c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:17.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 -- 172.21.15.28:0/895695605 shutdown_connections 2023-12-16T03:26:17.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.449+0000 7f7f7186b640 1 -- 172.21.15.28:0/895695605 wait complete. 2023-12-16T03:26:17.474 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:26:17.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.613+0000 7f5ca06d6640 1 Processor -- start 2023-12-16T03:26:17.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.613+0000 7f5ca06d6640 1 -- start start 2023-12-16T03:26:17.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5ca06d6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5c980a6c60 0x7f5c980c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5ca06d6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5c980c2840 0x7f5c980c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5ca06d6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c98157cd0 con 0x7f5c981578f0 2023-12-16T03:26:17.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5ca06d6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c980c2e00 con 0x7f5c980a6c60 2023-12-16T03:26:17.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5ca06d6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c98158850 con 0x7f5c980c2840 2023-12-16T03:26:17.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9e472640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5c981578f0 0x7f5c980c30e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:35110/0 (socket says 172.21.15.28:35110) 2023-12-16T03:26:17.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9e472640 1 -- 172.21.15.28:0/1716900240 learned_addr learned my addr 172.21.15.28:0/1716900240 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:17.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9dc71640 1 --2- 172.21.15.28:0/1716900240 >> v2:172.21.15.28:3300/0 conn(0x7f5c980a6c60 0x7f5c980c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9ec73640 1 --2- 172.21.15.28:0/1716900240 >> v2:172.21.15.134:3300/0 conn(0x7f5c980c2840 0x7f5c980c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9d470640 1 -- 172.21.15.28:0/1716900240 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37217578 0 0) 0x7f5c98157cd0 con 0x7f5c981578f0 2023-12-16T03:26:17.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9dc71640 1 -- 172.21.15.28:0/1716900240 >> v2:172.21.15.134:3300/0 conn(0x7f5c980c2840 msgr2=0x7f5c980c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:17.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9dc71640 1 --2- 172.21.15.28:0/1716900240 >> v2:172.21.15.134:3300/0 conn(0x7f5c980c2840 0x7f5c980c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9dc71640 1 -- 172.21.15.28:0/1716900240 >> v1:172.21.15.28:6789/0 conn(0x7f5c981578f0 legacy=0x7f5c980c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9dc71640 1 -- 172.21.15.28:0/1716900240 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c98157f20 con 0x7f5c980a6c60 2023-12-16T03:26:17.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9ec73640 1 --2- 172.21.15.28:0/1716900240 >> v2:172.21.15.134:3300/0 conn(0x7f5c980c2840 0x7f5c980c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:17.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9dc71640 1 --2- 172.21.15.28:0/1716900240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980a6c60 0x7f5c980c1270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5c98066c60 tx=0x7f5c8801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b413cd7a2fe1dad1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:17.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9d470640 1 -- 172.21.15.28:0/1716900240 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880ab600 con 0x7f5c980a6c60 2023-12-16T03:26:17.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9d470640 1 -- 172.21.15.28:0/1716900240 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c880a7050 con 0x7f5c980a6c60 2023-12-16T03:26:17.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.617+0000 7f5c9d470640 1 -- 172.21.15.28:0/1716900240 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880ab980 con 0x7f5c980a6c60 2023-12-16T03:26:17.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 -- 172.21.15.28:0/1716900240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980a6c60 msgr2=0x7f5c980c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 --2- 172.21.15.28:0/1716900240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980a6c60 0x7f5c980c1270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5c98066c60 tx=0x7f5c8801c3d0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 -- 172.21.15.28:0/1716900240 shutdown_connections 2023-12-16T03:26:17.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 --2- 172.21.15.28:0/1716900240 >> v2:172.21.15.134:3300/0 conn(0x7f5c980c2840 0x7f5c980c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 --2- 172.21.15.28:0/1716900240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980a6c60 0x7f5c980c1270 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 -- 172.21.15.28:0/1716900240 >> 172.21.15.28:0/1716900240 conn(0x7f5c980c7e40 msgr2=0x7f5c980c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:17.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 -- 172.21.15.28:0/1716900240 shutdown_connections 2023-12-16T03:26:17.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 -- 172.21.15.28:0/1716900240 wait complete. 2023-12-16T03:26:17.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 Processor -- start 2023-12-16T03:26:17.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 -- start start 2023-12-16T03:26:17.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980a6c60 0x7f5c980c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c980c2840 0x7f5c98148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c981578f0 0x7f5c981ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c980a80e0 con 0x7f5c980a6c60 2023-12-16T03:26:17.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c980a8f50 con 0x7f5c981578f0 2023-12-16T03:26:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5ca06d6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c980a7e00 con 0x7f5c980c2840 2023-12-16T03:26:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5c9e472640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980a6c60 0x7f5c980c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5c9e472640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980a6c60 0x7f5c980c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35506/0 (socket says 172.21.15.28:35506) 2023-12-16T03:26:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5c9e472640 1 -- 172.21.15.28:0/3099796791 learned_addr learned my addr 172.21.15.28:0/3099796791 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5c9ec73640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c981578f0 0x7f5c981ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.621+0000 7f5c9dc71640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c980c2840 0x7f5c98148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c9e472640 1 -- 172.21.15.28:0/3099796791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c980c2840 msgr2=0x7f5c98148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c9e472640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c980c2840 0x7f5c98148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c9e472640 1 -- 172.21.15.28:0/3099796791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c981578f0 msgr2=0x7f5c981ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c9e472640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c981578f0 0x7f5c981ece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c9e472640 1 -- 172.21.15.28:0/3099796791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c88009420 con 0x7f5c980a6c60 2023-12-16T03:26:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c9e472640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980a6c60 0x7f5c980c48d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5c940011f0 tx=0x7f5c9400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c8effd640 1 -- 172.21.15.28:0/3099796791 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c940074e0 con 0x7f5c980a6c60 2023-12-16T03:26:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c8effd640 1 -- 172.21.15.28:0/3099796791 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c94007640 con 0x7f5c980a6c60 2023-12-16T03:26:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c8effd640 1 -- 172.21.15.28:0/3099796791 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94004a10 con 0x7f5c980a6c60 2023-12-16T03:26:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5ca06d6640 1 -- 172.21.15.28:0/3099796791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c981f04c0 con 0x7f5c980a6c60 2023-12-16T03:26:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5ca06d6640 1 -- 172.21.15.28:0/3099796791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c981f0a80 con 0x7f5c980a6c60 2023-12-16T03:26:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5ca06d6640 1 -- 172.21.15.28:0/3099796791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c980c7c10 con 0x7f5c980a6c60 2023-12-16T03:26:17.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c8effd640 1 -- 172.21.15.28:0/3099796791 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5c94004b70 con 0x7f5c980a6c60 2023-12-16T03:26:17.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c8effd640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c7c0664a0 0x7f5c7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.625+0000 7f5c8effd640 1 -- 172.21.15.28:0/3099796791 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c94082f80 con 0x7f5c980a6c60 2023-12-16T03:26:17.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.629+0000 7f5c9dc71640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c7c0664a0 0x7f5c7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.629+0000 7f5c9dc71640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c7c0664a0 0x7f5c7c068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c880ad000 tx=0x7f5c88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:17.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.629+0000 7f5c8effd640 1 -- 172.21.15.28:0/3099796791 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5c940504a0 con 0x7f5c980a6c60 2023-12-16T03:26:17.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 -- 172.21.15.28:0/3099796791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c98068400 con 0x7f5c980a6c60 2023-12-16T03:26:17.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5c8effd640 1 -- 172.21.15.28:0/3099796791 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c940180a0 con 0x7f5c980a6c60 2023-12-16T03:26:17.795 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:26:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 -- 172.21.15.28:0/3099796791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c7c0664a0 msgr2=0x7f5c7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c7c0664a0 0x7f5c7c068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c880ad000 tx=0x7f5c88008040 comp rx=0 tx=0).stop 2023-12-16T03:26:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 -- 172.21.15.28:0/3099796791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980a6c60 msgr2=0x7f5c980c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980a6c60 0x7f5c980c48d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5c940011f0 tx=0x7f5c9400c9b0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 -- 172.21.15.28:0/3099796791 shutdown_connections 2023-12-16T03:26:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c981578f0 0x7f5c981ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c980c2840 0x7f5c98148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c7c0664a0 0x7f5c7c068960 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 --2- 172.21.15.28:0/3099796791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c980a6c60 0x7f5c980c48d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 -- 172.21.15.28:0/3099796791 >> 172.21.15.28:0/3099796791 conn(0x7f5c980c7e40 msgr2=0x7f5c98155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 -- 172.21.15.28:0/3099796791 shutdown_connections 2023-12-16T03:26:17.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.789+0000 7f5ca06d6640 1 -- 172.21.15.28:0/3099796791 wait complete. 2023-12-16T03:26:17.816 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-16T03:26:17.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.953+0000 7f70caa32640 1 Processor -- start 2023-12-16T03:26:17.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.953+0000 7f70caa32640 1 -- start start 2023-12-16T03:26:17.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70caa32640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f70c40c5640 0x7f70c40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70caa32640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f70c40c60f0 0x7f70c4155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70caa32640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c40c2580 con 0x7f70c40c5260 2023-12-16T03:26:17.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70caa32640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c4153510 con 0x7f70c40c5640 2023-12-16T03:26:17.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70caa32640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c40c17f0 con 0x7f70c40c60f0 2023-12-16T03:26:17.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70c37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f70c40c5640 0x7f70c40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70c37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f70c40c5640 0x7f70c40c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35514/0 (socket says 172.21.15.28:35514) 2023-12-16T03:26:17.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70c37fe640 1 -- 172.21.15.28:0/246384033 learned_addr learned my addr 172.21.15.28:0/246384033 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:17.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70c37fe640 1 -- 172.21.15.28:0/246384033 >> v2:172.21.15.134:3300/0 conn(0x7f70c40c60f0 msgr2=0x7f70c4155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:17.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70c37fe640 1 --2- 172.21.15.28:0/246384033 >> v2:172.21.15.134:3300/0 conn(0x7f70c40c60f0 0x7f70c4155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70c37fe640 1 -- 172.21.15.28:0/246384033 >> v1:172.21.15.28:6789/0 conn(0x7f70c40c5260 legacy=0x7f70c406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.957+0000 7f70c37fe640 1 -- 172.21.15.28:0/246384033 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c40c1a00 con 0x7f70c40c5640 2023-12-16T03:26:17.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70c37fe640 1 --2- 172.21.15.28:0/246384033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c40c5640 0x7f70c40c5bb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f70c40c6b10 tx=0x7f70b801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222d3e4c07f58c53 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:17.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70c2ffd640 1 -- 172.21.15.28:0/246384033 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b80ab660 con 0x7f70c40c5640 2023-12-16T03:26:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70c2ffd640 1 -- 172.21.15.28:0/246384033 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b80ab7c0 con 0x7f70c40c5640 2023-12-16T03:26:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70c2ffd640 1 -- 172.21.15.28:0/246384033 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b80abb50 con 0x7f70c40c5640 2023-12-16T03:26:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 -- 172.21.15.28:0/246384033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c40c5640 msgr2=0x7f70c40c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 --2- 172.21.15.28:0/246384033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c40c5640 0x7f70c40c5bb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f70c40c6b10 tx=0x7f70b801c440 comp rx=0 tx=0).stop 2023-12-16T03:26:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 -- 172.21.15.28:0/246384033 shutdown_connections 2023-12-16T03:26:17.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 --2- 172.21.15.28:0/246384033 >> v2:172.21.15.134:3300/0 conn(0x7f70c40c60f0 0x7f70c4155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 --2- 172.21.15.28:0/246384033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c40c5640 0x7f70c40c5bb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 -- 172.21.15.28:0/246384033 >> 172.21.15.28:0/246384033 conn(0x7f70c406a5b0 msgr2=0x7f70c406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:17.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 -- 172.21.15.28:0/246384033 shutdown_connections 2023-12-16T03:26:17.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 -- 172.21.15.28:0/246384033 wait complete. 2023-12-16T03:26:17.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 Processor -- start 2023-12-16T03:26:17.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 -- start start 2023-12-16T03:26:17.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c5260 0x7f70c406fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c40c5640 0x7f70c414dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c40c60f0 0x7f70c40aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c40a9130 con 0x7f70c40c5640 2023-12-16T03:26:17.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c41f1140 con 0x7f70c40c60f0 2023-12-16T03:26:17.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70caa32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c41f1670 con 0x7f70c40c5260 2023-12-16T03:26:17.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70c37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c40c5640 0x7f70c414dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70c37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c40c5640 0x7f70c414dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35522/0 (socket says 172.21.15.28:35522) 2023-12-16T03:26:17.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.961+0000 7f70c37fe640 1 -- 172.21.15.28:0/1737257585 learned_addr learned my addr 172.21.15.28:0/1737257585 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:17.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c3fff640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c5260 0x7f70c406fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c8fcf640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c40c60f0 0x7f70c40aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c37fe640 1 -- 172.21.15.28:0/1737257585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c5260 msgr2=0x7f70c406fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c37fe640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c5260 0x7f70c406fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c37fe640 1 -- 172.21.15.28:0/1737257585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c40c60f0 msgr2=0x7f70c40aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c37fe640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c40c60f0 0x7f70c40aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c37fe640 1 -- 172.21.15.28:0/1737257585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80094d0 con 0x7f70c40c5640 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c8fcf640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c40c60f0 0x7f70c40aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c3fff640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c5260 0x7f70c406fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c37fe640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c40c5640 0x7f70c414dda0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f70b80ad040 tx=0x7f70b801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c0ff9640 1 -- 172.21.15.28:0/1737257585 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b80b4800 con 0x7f70c40c5640 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c0ff9640 1 -- 172.21.15.28:0/1737257585 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b80b4960 con 0x7f70c40c5640 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c0ff9640 1 -- 172.21.15.28:0/1737257585 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b80b4d10 con 0x7f70c40c5640 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70caa32640 1 -- 172.21.15.28:0/1737257585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c40a8b70 con 0x7f70c40c5640 2023-12-16T03:26:17.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70caa32640 1 -- 172.21.15.28:0/1737257585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c41f1390 con 0x7f70c40c5640 2023-12-16T03:26:17.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70caa32640 1 -- 172.21.15.28:0/1737257585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c4072620 con 0x7f70c40c5640 2023-12-16T03:26:17.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c0ff9640 1 -- 172.21.15.28:0/1737257585 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f70b80a9070 con 0x7f70c40c5640 2023-12-16T03:26:17.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c0ff9640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70b0066470 0x7f70b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:17.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c0ff9640 1 -- 172.21.15.28:0/1737257585 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70b811ea30 con 0x7f70c40c5640 2023-12-16T03:26:17.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.965+0000 7f70c3fff640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70b0066470 0x7f70b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:17.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.969+0000 7f70c3fff640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70b0066470 0x7f70b0068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f70b4000f70 tx=0x7f70b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:17.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:17.969+0000 7f70c0ff9640 1 -- 172.21.15.28:0/1737257585 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f70b80ebfc0 con 0x7f70c40c5640 2023-12-16T03:26:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.129+0000 7f70caa32640 1 -- 172.21.15.28:0/1737257585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f70c4068400 con 0x7f70c40c5640 2023-12-16T03:26:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.129+0000 7f70c0ff9640 1 -- 172.21.15.28:0/1737257585 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+207 (secure 0 0 0) 0x7f70b80ef5e0 con 0x7f70c40c5640 2023-12-16T03:26:18.137 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:18.137 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2023-12-16T03:26:18.137 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:18.137 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2023-12-16T03:26:18.137 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2023-12-16T03:26:18.137 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:18.137 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:18.137 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 4, 2023-12-16T03:26:18.137 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": "cephfs_metadata" 2023-12-16T03:26:18.137 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:18.138 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:18.138 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 5, 2023-12-16T03:26:18.138 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": "cephfs_data" 2023-12-16T03:26:18.138 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:18.138 INFO:teuthology.orchestra.run.smithi028.stdout:] 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 -- 172.21.15.28:0/1737257585 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70b0066470 msgr2=0x7f70b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70b0066470 0x7f70b0068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f70b4000f70 tx=0x7f70b4009040 comp rx=0 tx=0).stop 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 -- 172.21.15.28:0/1737257585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c40c5640 msgr2=0x7f70c414dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c40c5640 0x7f70c414dda0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f70b80ad040 tx=0x7f70b801ac80 comp rx=0 tx=0).stop 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 -- 172.21.15.28:0/1737257585 shutdown_connections 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c40c60f0 0x7f70c40aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70b0066470 0x7f70b0068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70c40c5640 0x7f70c414dda0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 --2- 172.21.15.28:0/1737257585 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70c40c5260 0x7f70c406fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 -- 172.21.15.28:0/1737257585 >> 172.21.15.28:0/1737257585 conn(0x7f70c406a5b0 msgr2=0x7f70c41510c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 -- 172.21.15.28:0/1737257585 shutdown_connections 2023-12-16T03:26:18.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.133+0000 7f70caa32640 1 -- 172.21.15.28:0/1737257585 wait complete. 2023-12-16T03:26:18.158 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-16T03:26:18.158 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-16T03:26:18.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c78fd8640 1 Processor -- start 2023-12-16T03:26:18.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c78fd8640 1 -- start start 2023-12-16T03:26:18.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c78fd8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c7414f9f0 0x7f8c740c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c78fd8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8c740c07b0 0x7f8c7406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c78fd8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8c740c2d10 0x7f8c7406dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c78fd8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c740c5ba0 con 0x7f8c740c07b0 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c78fd8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7406c160 con 0x7f8c740c2d10 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c78fd8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740c5410 con 0x7f8c7414f9f0 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c6bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8c740c07b0 0x7f8c7406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c6bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8c740c07b0 0x7f8c7406d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35534/0 (socket says 172.21.15.28:35534) 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c6bfff640 1 -- 172.21.15.28:0/3947867777 learned_addr learned my addr 172.21.15.28:0/3947867777 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c72d9d640 1 --2- 172.21.15.28:0/3947867777 >> v2:172.21.15.134:3300/0 conn(0x7f8c740c2d10 0x7f8c7406dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c7259c640 1 --2- 172.21.15.28:0/3947867777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c7414f9f0 0x7f8c740c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c6bfff640 1 -- 172.21.15.28:0/3947867777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c7414f9f0 msgr2=0x7f8c740c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c6bfff640 1 --2- 172.21.15.28:0/3947867777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c7414f9f0 0x7f8c740c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c6bfff640 1 -- 172.21.15.28:0/3947867777 >> v2:172.21.15.134:3300/0 conn(0x7f8c740c2d10 msgr2=0x7f8c7406dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c6bfff640 1 --2- 172.21.15.28:0/3947867777 >> v2:172.21.15.134:3300/0 conn(0x7f8c740c2d10 0x7f8c7406dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.301+0000 7f8c6bfff640 1 -- 172.21.15.28:0/3947867777 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740c2210 con 0x7f8c740c07b0 2023-12-16T03:26:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c6bfff640 1 --2- 172.21.15.28:0/3947867777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c740c07b0 0x7f8c7406d6d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8c740c5100 tx=0x7f8c5c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16ad092d19df49c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c71d9b640 1 -- 172.21.15.28:0/3947867777 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0ab620 con 0x7f8c740c07b0 2023-12-16T03:26:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c71d9b640 1 -- 172.21.15.28:0/3947867777 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c0ab780 con 0x7f8c740c07b0 2023-12-16T03:26:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c71d9b640 1 -- 172.21.15.28:0/3947867777 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0abb10 con 0x7f8c740c07b0 2023-12-16T03:26:18.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c78fd8640 1 -- 172.21.15.28:0/3947867777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c740c07b0 msgr2=0x7f8c7406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:18.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c78fd8640 1 --2- 172.21.15.28:0/3947867777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c740c07b0 0x7f8c7406d6d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8c740c5100 tx=0x7f8c5c01c440 comp rx=0 tx=0).stop 2023-12-16T03:26:18.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c78fd8640 1 -- 172.21.15.28:0/3947867777 shutdown_connections 2023-12-16T03:26:18.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c78fd8640 1 --2- 172.21.15.28:0/3947867777 >> v2:172.21.15.134:3300/0 conn(0x7f8c740c2d10 0x7f8c7406dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c78fd8640 1 --2- 172.21.15.28:0/3947867777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c740c07b0 0x7f8c7406d6d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c78fd8640 1 --2- 172.21.15.28:0/3947867777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c7414f9f0 0x7f8c740c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c78fd8640 1 -- 172.21.15.28:0/3947867777 >> 172.21.15.28:0/3947867777 conn(0x7f8c740c5d40 msgr2=0x7f8c740c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:18.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c78fd8640 1 -- 172.21.15.28:0/3947867777 shutdown_connections 2023-12-16T03:26:18.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c78fd8640 1 -- 172.21.15.28:0/3947867777 wait complete. 2023-12-16T03:26:18.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.305+0000 7f8c78fd8640 1 Processor -- start 2023-12-16T03:26:18.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c78fd8640 1 -- start start 2023-12-16T03:26:18.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c78fd8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c740c07b0 0x7f8c7414e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c78fd8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c740c2d10 0x7f8c740a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c78fd8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7414f9f0 0x7f8c74148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c78fd8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740aacb0 con 0x7f8c7414f9f0 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c78fd8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c741566c0 con 0x7f8c740c2d10 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c78fd8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740aa7d0 con 0x7f8c740c07b0 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c72d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7414f9f0 0x7f8c74148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c72d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7414f9f0 0x7f8c74148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35544/0 (socket says 172.21.15.28:35544) 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c72d9d640 1 -- 172.21.15.28:0/1290752132 learned_addr learned my addr 172.21.15.28:0/1290752132 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c6bfff640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c740c2d10 0x7f8c740a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c7259c640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c740c07b0 0x7f8c7414e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c72d9d640 1 -- 172.21.15.28:0/1290752132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c740c07b0 msgr2=0x7f8c7414e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c72d9d640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c740c07b0 0x7f8c7414e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c72d9d640 1 -- 172.21.15.28:0/1290752132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c740c2d10 msgr2=0x7f8c740a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c72d9d640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c740c2d10 0x7f8c740a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c72d9d640 1 -- 172.21.15.28:0/1290752132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c0094d0 con 0x7f8c7414f9f0 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c72d9d640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7414f9f0 0x7f8c74148bd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c007e60 tx=0x7f8c6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:18.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c6affd640 1 -- 172.21.15.28:0/1290752132 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c014620 con 0x7f8c7414f9f0 2023-12-16T03:26:18.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c6affd640 1 -- 172.21.15.28:0/1290752132 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00ee90 con 0x7f8c7414f9f0 2023-12-16T03:26:18.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c78fd8640 1 -- 172.21.15.28:0/1290752132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7406ff60 con 0x7f8c7414f9f0 2023-12-16T03:26:18.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c6affd640 1 -- 172.21.15.28:0/1290752132 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0149e0 con 0x7f8c7414f9f0 2023-12-16T03:26:18.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c78fd8640 1 -- 172.21.15.28:0/1290752132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c74070240 con 0x7f8c7414f9f0 2023-12-16T03:26:18.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.309+0000 7f8c78fd8640 1 -- 172.21.15.28:0/1290752132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c740aa990 con 0x7f8c7414f9f0 2023-12-16T03:26:18.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.313+0000 7f8c6affd640 1 -- 172.21.15.28:0/1290752132 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8c6c014b40 con 0x7f8c7414f9f0 2023-12-16T03:26:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.313+0000 7f8c6affd640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8c54066470 0x7f8c54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.313+0000 7f8c6affd640 1 -- 172.21.15.28:0/1290752132 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c6c084680 con 0x7f8c7414f9f0 2023-12-16T03:26:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.313+0000 7f8c7259c640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8c54066470 0x7f8c54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.313+0000 7f8c7259c640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8c54066470 0x7f8c54068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8c64006aa0 tx=0x7f8c64008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:18.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.317+0000 7f8c6affd640 1 -- 172.21.15.28:0/1290752132 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8c6c051ba0 con 0x7f8c7414f9f0 2023-12-16T03:26:18.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.477+0000 7f8c78fd8640 1 -- 172.21.15.28:0/1290752132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8c74068400 con 0x7f8c7414f9f0 2023-12-16T03:26:18.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.573+0000 7f8c6affd640 1 -- 172.21.15.28:0/1290752132 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v33) v1 ==== 140+0+0 (secure 0 0 0) 0x7f8c6c0551c0 con 0x7f8c7414f9f0 2023-12-16T03:26:18.581 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_metadata' created 2023-12-16T03:26:18.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 -- 172.21.15.28:0/1290752132 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8c54066470 msgr2=0x7f8c54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:18.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8c54066470 0x7f8c54068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8c64006aa0 tx=0x7f8c64008040 comp rx=0 tx=0).stop 2023-12-16T03:26:18.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 -- 172.21.15.28:0/1290752132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7414f9f0 msgr2=0x7f8c74148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:18.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7414f9f0 0x7f8c74148bd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c007e60 tx=0x7f8c6c00e4b0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 -- 172.21.15.28:0/1290752132 shutdown_connections 2023-12-16T03:26:18.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8c54066470 0x7f8c54068930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c7414f9f0 0x7f8c74148bd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c740c2d10 0x7f8c740a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 --2- 172.21.15.28:0/1290752132 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8c740c07b0 0x7f8c7414e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 -- 172.21.15.28:0/1290752132 >> 172.21.15.28:0/1290752132 conn(0x7f8c740c5d40 msgr2=0x7f8c7414acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:18.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 -- 172.21.15.28:0/1290752132 shutdown_connections 2023-12-16T03:26:18.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.577+0000 7f8c78fd8640 1 -- 172.21.15.28:0/1290752132 wait complete. 2023-12-16T03:26:18.609 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-16T03:26:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f398133e640 1 Processor -- start 2023-12-16T03:26:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f398133e640 1 -- start start 2023-12-16T03:26:18.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f398133e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397c0c4100 0x7f397c0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f398133e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f397c0c06d0 0x7f397c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f398133e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397c0c31c0 con 0x7f397c0c63c0 2023-12-16T03:26:18.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f398133e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397c0c34a0 con 0x7f397c0c06d0 2023-12-16T03:26:18.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f398133e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c0c1030 con 0x7f397c0c4100 2023-12-16T03:26:18.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f397affd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f397c0c63c0 0x7f397c0c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:35128/0 (socket says 172.21.15.28:35128) 2023-12-16T03:26:18.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f397affd640 1 -- 172.21.15.28:0/302687025 learned_addr learned my addr 172.21.15.28:0/302687025 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:18.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f397b7fe640 1 --2- 172.21.15.28:0/302687025 >> v2:172.21.15.28:3300/0 conn(0x7f397c0c06d0 0x7f397c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f397a7fc640 1 -- 172.21.15.28:0/302687025 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767475191 0 0) 0x7f397c0c31c0 con 0x7f397c0c63c0 2023-12-16T03:26:18.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.753+0000 7f3973fff640 1 --2- 172.21.15.28:0/302687025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397c0c4100 0x7f397c0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f397a7fc640 1 -- 172.21.15.28:0/302687025 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3968005740 con 0x7f397c0c63c0 2023-12-16T03:26:18.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f397b7fe640 1 -- 172.21.15.28:0/302687025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397c0c4100 msgr2=0x7f397c0c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:18.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f397b7fe640 1 --2- 172.21.15.28:0/302687025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397c0c4100 0x7f397c0c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f397b7fe640 1 -- 172.21.15.28:0/302687025 >> v1:172.21.15.28:6789/0 conn(0x7f397c0c63c0 legacy=0x7f397c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:18.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f397b7fe640 1 -- 172.21.15.28:0/302687025 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c0c1310 con 0x7f397c0c06d0 2023-12-16T03:26:18.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f3973fff640 1 --2- 172.21.15.28:0/302687025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397c0c4100 0x7f397c0c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:18.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f397b7fe640 1 --2- 172.21.15.28:0/302687025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f397c0c06d0 0x7f397c0a9680 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3974009d90 tx=0x7f397401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b366525d3a3179 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:18.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f397a7fc640 1 -- 172.21.15.28:0/302687025 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c0aa3d0 con 0x7f397c0c06d0 2023-12-16T03:26:18.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f397a7fc640 1 -- 172.21.15.28:0/302687025 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39740a5800 con 0x7f397c0c06d0 2023-12-16T03:26:18.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f397a7fc640 1 -- 172.21.15.28:0/302687025 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740a5b90 con 0x7f397c0c06d0 2023-12-16T03:26:18.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f398133e640 1 -- 172.21.15.28:0/302687025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f397c0c06d0 msgr2=0x7f397c0a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:18.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f398133e640 1 --2- 172.21.15.28:0/302687025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f397c0c06d0 0x7f397c0a9680 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3974009d90 tx=0x7f397401c830 comp rx=0 tx=0).stop 2023-12-16T03:26:18.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f398133e640 1 -- 172.21.15.28:0/302687025 shutdown_connections 2023-12-16T03:26:18.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f398133e640 1 --2- 172.21.15.28:0/302687025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f397c0c06d0 0x7f397c0a9680 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f398133e640 1 --2- 172.21.15.28:0/302687025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397c0c4100 0x7f397c0c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f398133e640 1 -- 172.21.15.28:0/302687025 >> 172.21.15.28:0/302687025 conn(0x7f397c06a5b0 msgr2=0x7f397c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:18.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f398133e640 1 -- 172.21.15.28:0/302687025 shutdown_connections 2023-12-16T03:26:18.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.757+0000 7f398133e640 1 -- 172.21.15.28:0/302687025 wait complete. 2023-12-16T03:26:18.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f398133e640 1 Processor -- start 2023-12-16T03:26:18.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f398133e640 1 -- start start 2023-12-16T03:26:18.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f398133e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f397c0c06d0 0x7f397c155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f398133e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f397c0c4100 0x7f397c151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f398133e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397c0c63c0 0x7f397c153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f398133e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c153740 con 0x7f397c0c4100 2023-12-16T03:26:18.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f398133e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c155200 con 0x7f397c0c06d0 2023-12-16T03:26:18.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f398133e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c1e8ec0 con 0x7f397c0c63c0 2023-12-16T03:26:18.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f3973fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f397c0c4100 0x7f397c151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f3973fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f397c0c4100 0x7f397c151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35558/0 (socket says 172.21.15.28:35558) 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f3973fff640 1 -- 172.21.15.28:0/582729293 learned_addr learned my addr 172.21.15.28:0/582729293 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f397b7fe640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397c0c63c0 0x7f397c153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f397affd640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f397c0c06d0 0x7f397c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f3973fff640 1 -- 172.21.15.28:0/582729293 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397c0c63c0 msgr2=0x7f397c153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f3973fff640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397c0c63c0 0x7f397c153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f3973fff640 1 -- 172.21.15.28:0/582729293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f397c0c06d0 msgr2=0x7f397c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f3973fff640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f397c0c06d0 0x7f397c155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f3973fff640 1 -- 172.21.15.28:0/582729293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3974009a70 con 0x7f397c0c4100 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f3973fff640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f397c0c4100 0x7f397c151590 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f396400c7f0 tx=0x7f396400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f39737fe640 1 -- 172.21.15.28:0/582729293 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396400cea0 con 0x7f397c0c4100 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f39737fe640 1 -- 172.21.15.28:0/582729293 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3964007a30 con 0x7f397c0c4100 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f39737fe640 1 -- 172.21.15.28:0/582729293 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3964007de0 con 0x7f397c0c4100 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f398133e640 1 -- 172.21.15.28:0/582729293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c1e91a0 con 0x7f397c0c4100 2023-12-16T03:26:18.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.761+0000 7f398133e640 1 -- 172.21.15.28:0/582729293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c151ad0 con 0x7f397c0c4100 2023-12-16T03:26:18.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.765+0000 7f398133e640 1 -- 172.21.15.28:0/582729293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397c068400 con 0x7f397c0c4100 2023-12-16T03:26:18.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.765+0000 7f39737fe640 1 -- 172.21.15.28:0/582729293 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3964004020 con 0x7f397c0c4100 2023-12-16T03:26:18.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.765+0000 7f39737fe640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f395c066470 0x7f395c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:18.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.765+0000 7f39737fe640 1 -- 172.21.15.28:0/582729293 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f3964084590 con 0x7f397c0c4100 2023-12-16T03:26:18.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.765+0000 7f397affd640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f395c066470 0x7f395c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:18.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.769+0000 7f397affd640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f395c066470 0x7f395c068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f396c0011f0 tx=0x7f396c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:18.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.769+0000 7f39737fe640 1 -- 172.21.15.28:0/582729293 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3964051930 con 0x7f397c0c4100 2023-12-16T03:26:18.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:18.929+0000 7f398133e640 1 -- 172.21.15.28:0/582729293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f397c0c3e70 con 0x7f397c0c4100 2023-12-16T03:26:19.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.585+0000 7f39737fe640 1 -- 172.21.15.28:0/582729293 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v34) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3964054f50 con 0x7f397c0c4100 2023-12-16T03:26:19.593 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_data' created 2023-12-16T03:26:19.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.589+0000 7f398133e640 1 -- 172.21.15.28:0/582729293 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f395c066470 msgr2=0x7f395c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:19.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.589+0000 7f398133e640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f395c066470 0x7f395c068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f396c0011f0 tx=0x7f396c009040 comp rx=0 tx=0).stop 2023-12-16T03:26:19.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.589+0000 7f398133e640 1 -- 172.21.15.28:0/582729293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f397c0c4100 msgr2=0x7f397c151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:19.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.589+0000 7f398133e640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f397c0c4100 0x7f397c151590 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f396400c7f0 tx=0x7f396400ccb0 comp rx=0 tx=0).stop 2023-12-16T03:26:19.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.589+0000 7f398133e640 1 -- 172.21.15.28:0/582729293 shutdown_connections 2023-12-16T03:26:19.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.589+0000 7f398133e640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f397c0c63c0 0x7f397c153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:19.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.589+0000 7f398133e640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f395c066470 0x7f395c068930 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:19.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.589+0000 7f398133e640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f397c0c4100 0x7f397c151590 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:19.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.589+0000 7f398133e640 1 --2- 172.21.15.28:0/582729293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f397c0c06d0 0x7f397c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:19.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.589+0000 7f398133e640 1 -- 172.21.15.28:0/582729293 >> 172.21.15.28:0/582729293 conn(0x7f397c06a5b0 msgr2=0x7f397c0c22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:19.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.589+0000 7f398133e640 1 -- 172.21.15.28:0/582729293 shutdown_connections 2023-12-16T03:26:19.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.593+0000 7f398133e640 1 -- 172.21.15.28:0/582729293 wait complete. 2023-12-16T03:26:19.640 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-16T03:26:19.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.781+0000 7f25a351d640 1 Processor -- start 2023-12-16T03:26:19.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.781+0000 7f25a351d640 1 -- start start 2023-12-16T03:26:19.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.781+0000 7f25a351d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f259c06ecb0 0x7f259c15cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:19.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.781+0000 7f25a351d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c06f350 con 0x7f259c0c1400 2023-12-16T03:26:19.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.781+0000 7f25a351d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c071a00 con 0x7f259c14ec10 2023-12-16T03:26:19.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.781+0000 7f25a351d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c1521e0 con 0x7f259c06ecb0 2023-12-16T03:26:19.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.781+0000 7f25a1aba640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f259c06ecb0 0x7f259c15cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:19.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.781+0000 7f25a1aba640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f259c06ecb0 0x7f259c15cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51170/0 (socket says 172.21.15.28:51170) 2023-12-16T03:26:19.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.781+0000 7f25a1aba640 1 -- 172.21.15.28:0/843368133 learned_addr learned my addr 172.21.15.28:0/843368133 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:19.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.781+0000 7f25a0ab8640 1 --1- 172.21.15.28:0/843368133 >> v1:172.21.15.28:6789/0 conn(0x7f259c0c1400 0x7f259c06e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58448/0 (socket says 172.21.15.28:58448) 2023-12-16T03:26:19.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f25a1aba640 1 -- 172.21.15.28:0/843368133 >> v1:172.21.15.134:6789/0 conn(0x7f259c14ec10 legacy=0x7f259c070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:19.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f25a1aba640 1 -- 172.21.15.28:0/843368133 >> v1:172.21.15.28:6789/0 conn(0x7f259c0c1400 legacy=0x7f259c06e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:19.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f25a1aba640 1 -- 172.21.15.28:0/843368133 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c06f5a0 con 0x7f259c06ecb0 2023-12-16T03:26:19.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f25a1aba640 1 --2- 172.21.15.28:0/843368133 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f259c06ecb0 0x7f259c15cca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2594009e50 tx=0x7f259401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fff48554207e94 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:19.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f2593fff640 1 -- 172.21.15.28:0/843368133 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25940a5810 con 0x7f259c06ecb0 2023-12-16T03:26:19.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f2593fff640 1 -- 172.21.15.28:0/843368133 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25940a5970 con 0x7f259c06ecb0 2023-12-16T03:26:19.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f2593fff640 1 -- 172.21.15.28:0/843368133 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25940a5d00 con 0x7f259c06ecb0 2023-12-16T03:26:19.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f25a351d640 1 -- 172.21.15.28:0/843368133 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f259c06ecb0 msgr2=0x7f259c15cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:19.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f25a351d640 1 --2- 172.21.15.28:0/843368133 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f259c06ecb0 0x7f259c15cca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2594009e50 tx=0x7f259401c950 comp rx=0 tx=0).stop 2023-12-16T03:26:19.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f25a351d640 1 -- 172.21.15.28:0/843368133 shutdown_connections 2023-12-16T03:26:19.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f25a351d640 1 --2- 172.21.15.28:0/843368133 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f259c06ecb0 0x7f259c15cca0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:19.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f25a351d640 1 -- 172.21.15.28:0/843368133 >> 172.21.15.28:0/843368133 conn(0x7f259c0c6ef0 msgr2=0x7f259c0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:19.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f25a351d640 1 -- 172.21.15.28:0/843368133 shutdown_connections 2023-12-16T03:26:19.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.785+0000 7f25a351d640 1 -- 172.21.15.28:0/843368133 wait complete. 2023-12-16T03:26:19.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a351d640 1 Processor -- start 2023-12-16T03:26:19.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a351d640 1 -- start start 2023-12-16T03:26:19.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a351d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f259c06ecb0 0x7f259c143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:19.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a351d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f259c14ec10 0x7f259c13e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:19.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a351d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f259c150300 0x7f259c150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:19.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a351d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c150150 con 0x7f259c150300 2023-12-16T03:26:19.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a351d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c13a060 con 0x7f259c14ec10 2023-12-16T03:26:19.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a351d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c142e90 con 0x7f259c06ecb0 2023-12-16T03:26:19.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a1aba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f259c150300 0x7f259c150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:19.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a1aba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f259c150300 0x7f259c150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51184/0 (socket says 172.21.15.28:51184) 2023-12-16T03:26:19.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a1aba640 1 -- 172.21.15.28:0/3286527879 learned_addr learned my addr 172.21.15.28:0/3286527879 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:19.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a0ab8640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f259c14ec10 0x7f259c13e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:19.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a12b9640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f259c06ecb0 0x7f259c143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:19.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a1aba640 1 -- 172.21.15.28:0/3286527879 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f259c06ecb0 msgr2=0x7f259c143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:19.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a1aba640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f259c06ecb0 0x7f259c143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:19.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a1aba640 1 -- 172.21.15.28:0/3286527879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f259c14ec10 msgr2=0x7f259c13e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:19.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a1aba640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f259c14ec10 0x7f259c13e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:19.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a1aba640 1 -- 172.21.15.28:0/3286527879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2594009b30 con 0x7f259c150300 2023-12-16T03:26:19.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a1aba640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f259c150300 0x7f259c150790 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2594019560 tx=0x7f25940196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:19.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f2591ffb640 1 -- 172.21.15.28:0/3286527879 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25940b8670 con 0x7f259c150300 2023-12-16T03:26:19.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f2591ffb640 1 -- 172.21.15.28:0/3286527879 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25940b87d0 con 0x7f259c150300 2023-12-16T03:26:19.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.789+0000 7f25a351d640 1 -- 172.21.15.28:0/3286527879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259c143320 con 0x7f259c150300 2023-12-16T03:26:19.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.793+0000 7f2591ffb640 1 -- 172.21.15.28:0/3286527879 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25940b8b80 con 0x7f259c150300 2023-12-16T03:26:19.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.793+0000 7f25a351d640 1 -- 172.21.15.28:0/3286527879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c142b20 con 0x7f259c150300 2023-12-16T03:26:19.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.793+0000 7f25a351d640 1 -- 172.21.15.28:0/3286527879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c068400 con 0x7f259c150300 2023-12-16T03:26:19.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.793+0000 7f2591ffb640 1 -- 172.21.15.28:0/3286527879 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f25940b8ce0 con 0x7f259c150300 2023-12-16T03:26:19.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.797+0000 7f2591ffb640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2580066470 0x7f2580068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:19.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.797+0000 7f2591ffb640 1 -- 172.21.15.28:0/3286527879 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f259411fa60 con 0x7f259c150300 2023-12-16T03:26:19.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.797+0000 7f25a12b9640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2580066470 0x7f2580068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:19.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.797+0000 7f25a12b9640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2580066470 0x7f2580068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f259c1412a0 tx=0x7f2598009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:19.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.797+0000 7f2591ffb640 1 -- 172.21.15.28:0/3286527879 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f25940ecd10 con 0x7f259c150300 2023-12-16T03:26:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:19.993+0000 7f25a351d640 1 -- 172.21.15.28:0/3286527879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f259c142fd0 con 0x7f259c150300 2023-12-16T03:26:20.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f2591ffb640 1 -- 172.21.15.28:0/3286527879 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v17) v1 ==== 175+0+0 (secure 0 0 0) 0x7f25940f0330 con 0x7f259c150300 2023-12-16T03:26:20.598 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 6 and data pool 7 2023-12-16T03:26:20.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 -- 172.21.15.28:0/3286527879 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2580066470 msgr2=0x7f2580068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:20.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2580066470 0x7f2580068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f259c1412a0 tx=0x7f2598009040 comp rx=0 tx=0).stop 2023-12-16T03:26:20.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 -- 172.21.15.28:0/3286527879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f259c150300 msgr2=0x7f259c150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:20.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f259c150300 0x7f259c150790 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2594019560 tx=0x7f25940196f0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 -- 172.21.15.28:0/3286527879 shutdown_connections 2023-12-16T03:26:20.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2580066470 0x7f2580068930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f259c150300 0x7f259c150790 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f259c14ec10 0x7f259c13e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 --2- 172.21.15.28:0/3286527879 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f259c06ecb0 0x7f259c143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 -- 172.21.15.28:0/3286527879 >> 172.21.15.28:0/3286527879 conn(0x7f259c0c6ef0 msgr2=0x7f259c151570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:20.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 -- 172.21.15.28:0/3286527879 shutdown_connections 2023-12-16T03:26:20.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.593+0000 7f25a351d640 1 -- 172.21.15.28:0/3286527879 wait complete. 2023-12-16T03:26:20.627 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:20.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f616269c640 1 Processor -- start 2023-12-16T03:26:20.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f616269c640 1 -- start start 2023-12-16T03:26:20.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f616269c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f615c0af5c0 0x7f615c0c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:20.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f616269c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f615c0c4750 0x7f615c0c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:20.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f616269c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c06c660 con 0x7f615c1544c0 2023-12-16T03:26:20.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f616269c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615c06ba50 con 0x7f615c0c4750 2023-12-16T03:26:20.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f616269c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615c06bd30 con 0x7f615c0af5c0 2023-12-16T03:26:20.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f6160e99640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f615c0c4750 0x7f615c0c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:20.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f6160e99640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f615c0c4750 0x7f615c0c4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51198/0 (socket says 172.21.15.28:51198) 2023-12-16T03:26:20.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f6160e99640 1 -- 172.21.15.28:0/2848597145 learned_addr learned my addr 172.21.15.28:0/2848597145 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:20.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f616169a640 1 --2- 172.21.15.28:0/2848597145 >> v2:172.21.15.134:3300/0 conn(0x7f615c0af5c0 0x7f615c0c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:20.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f6160e99640 1 -- 172.21.15.28:0/2848597145 >> v2:172.21.15.134:3300/0 conn(0x7f615c0af5c0 msgr2=0x7f615c0c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:20.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f6160e99640 1 --2- 172.21.15.28:0/2848597145 >> v2:172.21.15.134:3300/0 conn(0x7f615c0af5c0 0x7f615c0c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f6160e99640 1 -- 172.21.15.28:0/2848597145 >> v1:172.21.15.134:6789/0 conn(0x7f615c1544c0 legacy=0x7f615c154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:20.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.765+0000 7f6160e99640 1 -- 172.21.15.28:0/2848597145 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c06c010 con 0x7f615c0c4750 2023-12-16T03:26:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f6160e99640 1 --2- 172.21.15.28:0/2848597145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f615c0c4750 0x7f615c0c4bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f615c0c6730 tx=0x7f614c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9497e72eaf6d59d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f6153fff640 1 -- 172.21.15.28:0/2848597145 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c0ab600 con 0x7f615c0c4750 2023-12-16T03:26:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f6153fff640 1 -- 172.21.15.28:0/2848597145 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c0a7050 con 0x7f615c0c4750 2023-12-16T03:26:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f6153fff640 1 -- 172.21.15.28:0/2848597145 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c0ab980 con 0x7f615c0c4750 2023-12-16T03:26:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f616269c640 1 -- 172.21.15.28:0/2848597145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f615c0c4750 msgr2=0x7f615c0c4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f616269c640 1 --2- 172.21.15.28:0/2848597145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f615c0c4750 0x7f615c0c4bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f615c0c6730 tx=0x7f614c01c4c0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f616269c640 1 -- 172.21.15.28:0/2848597145 shutdown_connections 2023-12-16T03:26:20.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f616269c640 1 --2- 172.21.15.28:0/2848597145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f615c0c4750 0x7f615c0c4bc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f616269c640 1 --2- 172.21.15.28:0/2848597145 >> v2:172.21.15.134:3300/0 conn(0x7f615c0af5c0 0x7f615c0c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f616269c640 1 -- 172.21.15.28:0/2848597145 >> 172.21.15.28:0/2848597145 conn(0x7f615c0ab960 msgr2=0x7f615c0abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:20.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f616269c640 1 -- 172.21.15.28:0/2848597145 shutdown_connections 2023-12-16T03:26:20.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f616269c640 1 -- 172.21.15.28:0/2848597145 wait complete. 2023-12-16T03:26:20.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f616269c640 1 Processor -- start 2023-12-16T03:26:20.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.769+0000 7f616269c640 1 -- start start 2023-12-16T03:26:20.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f616269c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f615c0af5c0 0x7f615c0ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:20.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f616269c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f615c0c4750 0x7f615c0bcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:20.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f616269c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f615c1544c0 0x7f615c14bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:20.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f616269c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1f1370 con 0x7f615c1544c0 2023-12-16T03:26:20.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f616269c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1f18a0 con 0x7f615c0c4750 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f616269c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0adc60 con 0x7f615c0af5c0 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6161e9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f615c1544c0 0x7f615c14bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6161e9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f615c1544c0 0x7f615c14bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51202/0 (socket says 172.21.15.28:51202) 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6161e9b640 1 -- 172.21.15.28:0/1088203435 learned_addr learned my addr 172.21.15.28:0/1088203435 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f616169a640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f615c0af5c0 0x7f615c0ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6160e99640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f615c0c4750 0x7f615c0bcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6161e9b640 1 -- 172.21.15.28:0/1088203435 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f615c0af5c0 msgr2=0x7f615c0ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6161e9b640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f615c0af5c0 0x7f615c0ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6161e9b640 1 -- 172.21.15.28:0/1088203435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f615c0c4750 msgr2=0x7f615c0bcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6161e9b640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f615c0c4750 0x7f615c0bcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6161e9b640 1 -- 172.21.15.28:0/1088203435 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c0094d0 con 0x7f615c1544c0 2023-12-16T03:26:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6161e9b640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f615c1544c0 0x7f615c14bcf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f615400c7b0 tx=0x7f615400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:20.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6151ffb640 1 -- 172.21.15.28:0/1088203435 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154004b70 con 0x7f615c1544c0 2023-12-16T03:26:20.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6151ffb640 1 -- 172.21.15.28:0/1088203435 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154004cd0 con 0x7f615c1544c0 2023-12-16T03:26:20.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f6151ffb640 1 -- 172.21.15.28:0/1088203435 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400aa90 con 0x7f615c1544c0 2023-12-16T03:26:20.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f616269c640 1 -- 172.21.15.28:0/1088203435 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c0adf40 con 0x7f615c1544c0 2023-12-16T03:26:20.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f616269c640 1 -- 172.21.15.28:0/1088203435 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c155d40 con 0x7f615c1544c0 2023-12-16T03:26:20.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.773+0000 7f616269c640 1 -- 172.21.15.28:0/1088203435 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c155ba0 con 0x7f615c1544c0 2023-12-16T03:26:20.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.777+0000 7f6151ffb640 1 -- 172.21.15.28:0/1088203435 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f615400abf0 con 0x7f615c1544c0 2023-12-16T03:26:20.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.777+0000 7f6151ffb640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61400664c0 0x7f6140068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:20.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.777+0000 7f6151ffb640 1 -- 172.21.15.28:0/1088203435 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f61540841f0 con 0x7f615c1544c0 2023-12-16T03:26:20.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.777+0000 7f616169a640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61400664c0 0x7f6140068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:20.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.777+0000 7f616169a640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61400664c0 0x7f6140068980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f61580079c0 tx=0x7f6158008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:20.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.781+0000 7f6151ffb640 1 -- 172.21.15.28:0/1088203435 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f615c155ba0 con 0x7f615c1544c0 2023-12-16T03:26:20.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.945+0000 7f616269c640 1 -- 172.21.15.28:0/1088203435 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f615c155ba0 con 0x7f615c1544c0 2023-12-16T03:26:20.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.945+0000 7f6151ffb640 1 -- 172.21.15.28:0/1088203435 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20242 (secure 0 0 0) 0x7f615c155ba0 con 0x7f615c1544c0 2023-12-16T03:26:20.953 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:20.953 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":35,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:19.999072+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 -- 172.21.15.28:0/1088203435 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61400664c0 msgr2=0x7f6140068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61400664c0 0x7f6140068980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f61580079c0 tx=0x7f6158008040 comp rx=0 tx=0).stop 2023-12-16T03:26:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 -- 172.21.15.28:0/1088203435 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f615c1544c0 msgr2=0x7f615c14bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f615c1544c0 0x7f615c14bcf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f615400c7b0 tx=0x7f615400cc70 comp rx=0 tx=0).stop 2023-12-16T03:26:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 -- 172.21.15.28:0/1088203435 shutdown_connections 2023-12-16T03:26:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61400664c0 0x7f6140068980 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f615c1544c0 0x7f615c14bcf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f615c0c4750 0x7f615c0bcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 --2- 172.21.15.28:0/1088203435 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f615c0af5c0 0x7f615c0ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:20.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 -- 172.21.15.28:0/1088203435 >> 172.21.15.28:0/1088203435 conn(0x7f615c0ab960 msgr2=0x7f615c0c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:20.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 -- 172.21.15.28:0/1088203435 shutdown_connections 2023-12-16T03:26:20.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:20.949+0000 7f616269c640 1 -- 172.21.15.28:0/1088203435 wait complete. 2023-12-16T03:26:20.975 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad915f640 1 Processor -- start 2023-12-16T03:26:21.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad915f640 1 -- start start 2023-12-16T03:26:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad915f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8ad406d990 0x7f8ad40c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad915f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ad41546c0 0x7f8ad4154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad915f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406c070 0x7f8ad406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad915f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad40c1e30 con 0x7f8ad406d990 2023-12-16T03:26:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad915f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad406dd70 con 0x7f8ad41546c0 2023-12-16T03:26:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad915f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad40c1220 con 0x7f8ad406c070 2023-12-16T03:26:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8ad406d990 0x7f8ad40c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8ad406d990 0x7f8ad40c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51212/0 (socket says 172.21.15.28:51212) 2023-12-16T03:26:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad3fff640 1 -- 172.21.15.28:0/4170128373 learned_addr learned my addr 172.21.15.28:0/4170128373 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:21.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad895e640 1 --2- 172.21.15.28:0/4170128373 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406c070 0x7f8ad406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad37fe640 1 --2- 172.21.15.28:0/4170128373 >> v2:172.21.15.134:3300/0 conn(0x7f8ad41546c0 0x7f8ad4154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad3fff640 1 -- 172.21.15.28:0/4170128373 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406c070 msgr2=0x7f8ad406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:21.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad3fff640 1 --2- 172.21.15.28:0/4170128373 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406c070 0x7f8ad406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad3fff640 1 -- 172.21.15.28:0/4170128373 >> v2:172.21.15.134:3300/0 conn(0x7f8ad41546c0 msgr2=0x7f8ad4154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:21.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad3fff640 1 --2- 172.21.15.28:0/4170128373 >> v2:172.21.15.134:3300/0 conn(0x7f8ad41546c0 0x7f8ad4154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad3fff640 1 -- 172.21.15.28:0/4170128373 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad40c1500 con 0x7f8ad406d990 2023-12-16T03:26:21.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.113+0000 7f8ad37fe640 1 --2- 172.21.15.28:0/4170128373 >> v2:172.21.15.134:3300/0 conn(0x7f8ad41546c0 0x7f8ad4154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:21.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad3fff640 1 --2- 172.21.15.28:0/4170128373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ad406d990 0x7f8ad40c5360 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40abdc0 tx=0x7f8ac401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7404e4de8a89c311 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:21.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad2ffd640 1 -- 172.21.15.28:0/4170128373 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac40ac410 con 0x7f8ad406d990 2023-12-16T03:26:21.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad2ffd640 1 -- 172.21.15.28:0/4170128373 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac40ac570 con 0x7f8ad406d990 2023-12-16T03:26:21.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad2ffd640 1 -- 172.21.15.28:0/4170128373 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac40ac900 con 0x7f8ad406d990 2023-12-16T03:26:21.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad915f640 1 -- 172.21.15.28:0/4170128373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ad406d990 msgr2=0x7f8ad40c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:21.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad915f640 1 --2- 172.21.15.28:0/4170128373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ad406d990 0x7f8ad40c5360 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40abdc0 tx=0x7f8ac401c500 comp rx=0 tx=0).stop 2023-12-16T03:26:21.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad915f640 1 -- 172.21.15.28:0/4170128373 shutdown_connections 2023-12-16T03:26:21.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad915f640 1 --2- 172.21.15.28:0/4170128373 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406c070 0x7f8ad406c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad915f640 1 --2- 172.21.15.28:0/4170128373 >> v2:172.21.15.134:3300/0 conn(0x7f8ad41546c0 0x7f8ad4154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad915f640 1 --2- 172.21.15.28:0/4170128373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ad406d990 0x7f8ad40c5360 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad915f640 1 -- 172.21.15.28:0/4170128373 >> 172.21.15.28:0/4170128373 conn(0x7f8ad40a7800 msgr2=0x7f8ad40a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:21.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad915f640 1 -- 172.21.15.28:0/4170128373 shutdown_connections 2023-12-16T03:26:21.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.117+0000 7f8ad915f640 1 -- 172.21.15.28:0/4170128373 wait complete. 2023-12-16T03:26:21.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad915f640 1 Processor -- start 2023-12-16T03:26:21.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad915f640 1 -- start start 2023-12-16T03:26:21.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad915f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406c070 0x7f8ad4147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad915f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ad406d990 0x7f8ad4148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad915f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad41546c0 0x7f8ad41f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad915f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad40baa70 con 0x7f8ad406d990 2023-12-16T03:26:21.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad915f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad414f740 con 0x7f8ad41546c0 2023-12-16T03:26:21.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad915f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad4151c00 con 0x7f8ad406c070 2023-12-16T03:26:21.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ad406d990 0x7f8ad4148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ad406d990 0x7f8ad4148260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51222/0 (socket says 172.21.15.28:51222) 2023-12-16T03:26:21.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad37fe640 1 -- 172.21.15.28:0/1002301800 learned_addr learned my addr 172.21.15.28:0/1002301800 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:21.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad3fff640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406c070 0x7f8ad4147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad895e640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad41546c0 0x7f8ad41f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad37fe640 1 -- 172.21.15.28:0/1002301800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406c070 msgr2=0x7f8ad4147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:21.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad37fe640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406c070 0x7f8ad4147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad37fe640 1 -- 172.21.15.28:0/1002301800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad41546c0 msgr2=0x7f8ad41f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:21.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad37fe640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad41546c0 0x7f8ad41f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad37fe640 1 -- 172.21.15.28:0/1002301800 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac40094d0 con 0x7f8ad406d990 2023-12-16T03:26:21.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad37fe640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ad406d990 0x7f8ad4148260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800d800 tx=0x7f8ac800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:21.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad0ff9640 1 -- 172.21.15.28:0/1002301800 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80096c0 con 0x7f8ad406d990 2023-12-16T03:26:21.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad0ff9640 1 -- 172.21.15.28:0/1002301800 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8009820 con 0x7f8ad406d990 2023-12-16T03:26:21.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad915f640 1 -- 172.21.15.28:0/1002301800 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad4150b00 con 0x7f8ad406d990 2023-12-16T03:26:21.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad0ff9640 1 -- 172.21.15.28:0/1002301800 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8009bd0 con 0x7f8ad406d990 2023-12-16T03:26:21.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.121+0000 7f8ad915f640 1 -- 172.21.15.28:0/1002301800 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad41510c0 con 0x7f8ad406d990 2023-12-16T03:26:21.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.125+0000 7f8ad915f640 1 -- 172.21.15.28:0/1002301800 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad404e850 con 0x7f8ad406d990 2023-12-16T03:26:21.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.125+0000 7f8ad0ff9640 1 -- 172.21.15.28:0/1002301800 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8ac8009d30 con 0x7f8ad406d990 2023-12-16T03:26:21.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.125+0000 7f8ad0ff9640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ac0066470 0x7f8ac0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.125+0000 7f8ad0ff9640 1 -- 172.21.15.28:0/1002301800 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8ac80847c0 con 0x7f8ad406d990 2023-12-16T03:26:21.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.125+0000 7f8ad3fff640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ac0066470 0x7f8ac0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.125+0000 7f8ad3fff640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ac0066470 0x7f8ac0068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40ae000 tx=0x7f8ac4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:21.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.129+0000 7f8ad0ff9640 1 -- 172.21.15.28:0/1002301800 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8ac8051980 con 0x7f8ad406d990 2023-12-16T03:26:21.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.285+0000 7f8ad915f640 1 -- 172.21.15.28:0/1002301800 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ad40c21b0 con 0x7f8ad406d990 2023-12-16T03:26:21.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.285+0000 7f8ad0ff9640 1 -- 172.21.15.28:0/1002301800 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20242 (secure 0 0 0) 0x7f8ac8054fa0 con 0x7f8ad406d990 2023-12-16T03:26:21.293 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:21.293 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":35,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:19.999072+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:21.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 -- 172.21.15.28:0/1002301800 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ac0066470 msgr2=0x7f8ac0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:21.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ac0066470 0x7f8ac0068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40ae000 tx=0x7f8ac4008040 comp rx=0 tx=0).stop 2023-12-16T03:26:21.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 -- 172.21.15.28:0/1002301800 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ad406d990 msgr2=0x7f8ad4148260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:21.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ad406d990 0x7f8ad4148260 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800d800 tx=0x7f8ac800dcc0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 -- 172.21.15.28:0/1002301800 shutdown_connections 2023-12-16T03:26:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad41546c0 0x7f8ad41f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8ac0066470 0x7f8ac0068930 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ad406d990 0x7f8ad4148260 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 --2- 172.21.15.28:0/1002301800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406c070 0x7f8ad4147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 -- 172.21.15.28:0/1002301800 >> 172.21.15.28:0/1002301800 conn(0x7f8ad40a7800 msgr2=0x7f8ad4149e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 -- 172.21.15.28:0/1002301800 shutdown_connections 2023-12-16T03:26:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.289+0000 7f8ad915f640 1 -- 172.21.15.28:0/1002301800 wait complete. 2023-12-16T03:26:21.315 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-16T03:26:21.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f54328c9640 1 Processor -- start 2023-12-16T03:26:21.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f54328c9640 1 -- start start 2023-12-16T03:26:21.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f54328c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f542c0c7ea0 0x7f542c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f54328c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f542c06b9e0 0x7f542c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f54328c9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c06c860 con 0x7f542c151e90 2023-12-16T03:26:21.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f54328c9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c0c8750 con 0x7f542c06b9e0 2023-12-16T03:26:21.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f54328c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c1552d0 con 0x7f542c0c7ea0 2023-12-16T03:26:21.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f5430e66640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f542c06b9e0 0x7f542c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f542b7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f542c0c7ea0 0x7f542c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f5430e66640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f542c06b9e0 0x7f542c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:34616/0 (socket says 172.21.15.28:34616) 2023-12-16T03:26:21.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f5430e66640 1 -- 172.21.15.28:0/4260612717 learned_addr learned my addr 172.21.15.28:0/4260612717 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:21.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f542bfff640 1 --1- 172.21.15.28:0/4260612717 >> v1:172.21.15.134:6789/0 conn(0x7f542c151e90 0x7f542c0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:36920/0 (socket says 172.21.15.28:36920) 2023-12-16T03:26:21.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f5430e66640 1 -- 172.21.15.28:0/4260612717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f542c0c7ea0 msgr2=0x7f542c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:21.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f5430e66640 1 --2- 172.21.15.28:0/4260612717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f542c0c7ea0 0x7f542c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f5430e66640 1 -- 172.21.15.28:0/4260612717 >> v1:172.21.15.134:6789/0 conn(0x7f542c151e90 legacy=0x7f542c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:21.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f5430e66640 1 -- 172.21.15.28:0/4260612717 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c154930 con 0x7f542c06b9e0 2023-12-16T03:26:21.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.457+0000 7f542b7fe640 1 --2- 172.21.15.28:0/4260612717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f542c0c7ea0 0x7f542c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:21.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f5430e66640 1 --2- 172.21.15.28:0/4260612717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f542c06b9e0 0x7f542c15f0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5424009e50 tx=0x7f542401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=865d3cd18d151e6d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:21.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f542affd640 1 -- 172.21.15.28:0/4260612717 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240a4760 con 0x7f542c06b9e0 2023-12-16T03:26:21.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f542affd640 1 -- 172.21.15.28:0/4260612717 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54240a48c0 con 0x7f542c06b9e0 2023-12-16T03:26:21.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f542affd640 1 -- 172.21.15.28:0/4260612717 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240a4c50 con 0x7f542c06b9e0 2023-12-16T03:26:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f54328c9640 1 -- 172.21.15.28:0/4260612717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f542c06b9e0 msgr2=0x7f542c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f54328c9640 1 --2- 172.21.15.28:0/4260612717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f542c06b9e0 0x7f542c15f0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5424009e50 tx=0x7f542401c4f0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f54328c9640 1 -- 172.21.15.28:0/4260612717 shutdown_connections 2023-12-16T03:26:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f54328c9640 1 --2- 172.21.15.28:0/4260612717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f542c06b9e0 0x7f542c15f0a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f54328c9640 1 --2- 172.21.15.28:0/4260612717 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f542c0c7ea0 0x7f542c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f54328c9640 1 -- 172.21.15.28:0/4260612717 >> 172.21.15.28:0/4260612717 conn(0x7f542c0ca170 msgr2=0x7f542c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f54328c9640 1 -- 172.21.15.28:0/4260612717 shutdown_connections 2023-12-16T03:26:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.461+0000 7f54328c9640 1 -- 172.21.15.28:0/4260612717 wait complete. 2023-12-16T03:26:21.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f54328c9640 1 Processor -- start 2023-12-16T03:26:21.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f54328c9640 1 -- start start 2023-12-16T03:26:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f54328c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f542c06b9e0 0x7f542c148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f54328c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f542c0c7ea0 0x7f542c0c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f54328c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f542c151e90 0x7f542c0c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f54328c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0c4120 con 0x7f542c151e90 2023-12-16T03:26:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f54328c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c1f2150 con 0x7f542c0c7ea0 2023-12-16T03:26:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f54328c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0c2520 con 0x7f542c06b9e0 2023-12-16T03:26:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5430e66640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f542c151e90 0x7f542c0c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5430e66640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f542c151e90 0x7f542c0c32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51236/0 (socket says 172.21.15.28:51236) 2023-12-16T03:26:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5430e66640 1 -- 172.21.15.28:0/3719867628 learned_addr learned my addr 172.21.15.28:0/3719867628 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f542bfff640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f542c06b9e0 0x7f542c148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f542b7fe640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f542c0c7ea0 0x7f542c0c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5430e66640 1 -- 172.21.15.28:0/3719867628 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f542c06b9e0 msgr2=0x7f542c148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5430e66640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f542c06b9e0 0x7f542c148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5430e66640 1 -- 172.21.15.28:0/3719867628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f542c0c7ea0 msgr2=0x7f542c0c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5430e66640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f542c0c7ea0 0x7f542c0c2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5430e66640 1 -- 172.21.15.28:0/3719867628 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420009420 con 0x7f542c151e90 2023-12-16T03:26:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5430e66640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f542c151e90 0x7f542c0c32b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f54240ae040 tx=0x7f54240195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5428ff9640 1 -- 172.21.15.28:0/3719867628 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424009510 con 0x7f542c151e90 2023-12-16T03:26:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5428ff9640 1 -- 172.21.15.28:0/3719867628 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54240b7470 con 0x7f542c151e90 2023-12-16T03:26:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f54328c9640 1 -- 172.21.15.28:0/3719867628 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5424009b30 con 0x7f542c151e90 2023-12-16T03:26:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.465+0000 7f5428ff9640 1 -- 172.21.15.28:0/3719867628 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240b7800 con 0x7f542c151e90 2023-12-16T03:26:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.469+0000 7f54328c9640 1 -- 172.21.15.28:0/3719867628 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c1eec30 con 0x7f542c151e90 2023-12-16T03:26:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.469+0000 7f54328c9640 1 -- 172.21.15.28:0/3719867628 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c068400 con 0x7f542c151e90 2023-12-16T03:26:21.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.469+0000 7f5428ff9640 1 -- 172.21.15.28:0/3719867628 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f54240b7960 con 0x7f542c151e90 2023-12-16T03:26:21.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.469+0000 7f5428ff9640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5418066470 0x7f5418068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:21.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.469+0000 7f5428ff9640 1 -- 172.21.15.28:0/3719867628 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f542411e3c0 con 0x7f542c151e90 2023-12-16T03:26:21.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.469+0000 7f542bfff640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5418066470 0x7f5418068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:21.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.469+0000 7f542bfff640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5418066470 0x7f5418068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f541c000c10 tx=0x7f541c007e10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:21.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.473+0000 7f5428ff9640 1 -- 172.21.15.28:0/3719867628 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f54240eb580 con 0x7f542c151e90 2023-12-16T03:26:21.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:21.665+0000 7f54328c9640 1 -- 172.21.15.28:0/3719867628 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f542c1531d0 con 0x7f542c151e90 2023-12-16T03:26:22.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f5428ff9640 1 -- 172.21.15.28:0/3719867628 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 119+0+0 (secure 0 0 0) 0x7f54240eeba0 con 0x7f542c151e90 2023-12-16T03:26:22.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 -- 172.21.15.28:0/3719867628 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5418066470 msgr2=0x7f5418068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:22.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5418066470 0x7f5418068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f541c000c10 tx=0x7f541c007e10 comp rx=0 tx=0).stop 2023-12-16T03:26:22.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 -- 172.21.15.28:0/3719867628 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f542c151e90 msgr2=0x7f542c0c32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:22.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f542c151e90 0x7f542c0c32b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f54240ae040 tx=0x7f54240195b0 comp rx=0 tx=0).stop 2023-12-16T03:26:22.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 -- 172.21.15.28:0/3719867628 shutdown_connections 2023-12-16T03:26:22.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5418066470 0x7f5418068930 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:22.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f542c151e90 0x7f542c0c32b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f542c0c7ea0 0x7f542c0c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 --2- 172.21.15.28:0/3719867628 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f542c06b9e0 0x7f542c148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 -- 172.21.15.28:0/3719867628 >> 172.21.15.28:0/3719867628 conn(0x7f542c0ca170 msgr2=0x7f542c152550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 -- 172.21.15.28:0/3719867628 shutdown_connections 2023-12-16T03:26:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.609+0000 7f54328c9640 1 -- 172.21.15.28:0/3719867628 wait complete. 2023-12-16T03:26:22.640 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-16T03:26:22.640 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-16T03:26:22.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f720d772640 1 Processor -- start 2023-12-16T03:26:22.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f720d772640 1 -- start start 2023-12-16T03:26:22.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f720d772640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f72080725c0 0x7f72080a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:22.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f720d772640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72080c3bd0 0x7f72080c4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:22.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f720d772640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72080c2760 con 0x7f7208072090 2023-12-16T03:26:22.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f720d772640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72080c3070 con 0x7f72080725c0 2023-12-16T03:26:22.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f720d772640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72080c63e0 con 0x7f72080c3bd0 2023-12-16T03:26:22.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f71fffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f72080725c0 0x7f72080a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:22.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f71fffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f72080725c0 0x7f72080a5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51252/0 (socket says 172.21.15.28:51252) 2023-12-16T03:26:22.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f71fffff640 1 -- 172.21.15.28:0/881581172 learned_addr learned my addr 172.21.15.28:0/881581172 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:22.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f72077fe640 1 --2- 172.21.15.28:0/881581172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72080c3bd0 0x7f72080c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:22.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f71fffff640 1 -- 172.21.15.28:0/881581172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72080c3bd0 msgr2=0x7f72080c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:22.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f71fffff640 1 --2- 172.21.15.28:0/881581172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72080c3bd0 0x7f72080c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:22.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f71fffff640 1 -- 172.21.15.28:0/881581172 >> v1:172.21.15.134:6789/0 conn(0x7f7208072090 legacy=0x7f72080c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:22.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f71fffff640 1 -- 172.21.15.28:0/881581172 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72080aad20 con 0x7f72080725c0 2023-12-16T03:26:22.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.785+0000 7f72077fe640 1 --2- 172.21.15.28:0/881581172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72080c3bd0 0x7f72080c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:22.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f71fffff640 1 --2- 172.21.15.28:0/881581172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f72080725c0 0x7f72080a5370 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f71f00098a0 tx=0x7f71f001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367b0aeb362865c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:22.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f72067fc640 1 -- 172.21.15.28:0/881581172 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f00ad680 con 0x7f72080725c0 2023-12-16T03:26:22.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f72067fc640 1 -- 172.21.15.28:0/881581172 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f00ad7e0 con 0x7f72080725c0 2023-12-16T03:26:22.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f72067fc640 1 -- 172.21.15.28:0/881581172 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f00adb70 con 0x7f72080725c0 2023-12-16T03:26:22.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f720d772640 1 -- 172.21.15.28:0/881581172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f72080725c0 msgr2=0x7f72080a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:22.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f720d772640 1 --2- 172.21.15.28:0/881581172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f72080725c0 0x7f72080a5370 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f71f00098a0 tx=0x7f71f001c3c0 comp rx=0 tx=0).stop 2023-12-16T03:26:22.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f720d772640 1 -- 172.21.15.28:0/881581172 shutdown_connections 2023-12-16T03:26:22.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f720d772640 1 --2- 172.21.15.28:0/881581172 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72080c3bd0 0x7f72080c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:22.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f720d772640 1 --2- 172.21.15.28:0/881581172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f72080725c0 0x7f72080a5370 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:22.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f720d772640 1 -- 172.21.15.28:0/881581172 >> 172.21.15.28:0/881581172 conn(0x7f720806a5b0 msgr2=0x7f720806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:22.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f720d772640 1 -- 172.21.15.28:0/881581172 shutdown_connections 2023-12-16T03:26:22.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.789+0000 7f720d772640 1 -- 172.21.15.28:0/881581172 wait complete. 2023-12-16T03:26:22.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f720d772640 1 Processor -- start 2023-12-16T03:26:22.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f720d772640 1 -- start start 2023-12-16T03:26:22.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f720d772640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7208072090 0x7f720814f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:22.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f720d772640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72080725c0 0x7f72081ed060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:22.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f720d772640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f72080c3bd0 0x7f72081ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f720d772640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72080a6720 con 0x7f72080c3bd0 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f720d772640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72080a54a0 con 0x7f72080725c0 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f720d772640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7208154aa0 con 0x7f7208072090 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f72077fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f72080c3bd0 0x7f72081ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f72077fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f72080c3bd0 0x7f72081ed5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51266/0 (socket says 172.21.15.28:51266) 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f72077fe640 1 -- 172.21.15.28:0/2670007318 learned_addr learned my addr 172.21.15.28:0/2670007318 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f71fffff640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72080725c0 0x7f72081ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f7206ffd640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7208072090 0x7f720814f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f72077fe640 1 -- 172.21.15.28:0/2670007318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7208072090 msgr2=0x7f720814f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f72077fe640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7208072090 0x7f720814f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f72077fe640 1 -- 172.21.15.28:0/2670007318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72080725c0 msgr2=0x7f72081ed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f72077fe640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72080725c0 0x7f72081ed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:22.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f72077fe640 1 -- 172.21.15.28:0/2670007318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00094d0 con 0x7f72080c3bd0 2023-12-16T03:26:22.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f72077fe640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f72080c3bd0 0x7f72081ed5a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f720000cf20 tx=0x7f720000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:22.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f71ff7fe640 1 -- 172.21.15.28:0/2670007318 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000d840 con 0x7f72080c3bd0 2023-12-16T03:26:22.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f71ff7fe640 1 -- 172.21.15.28:0/2670007318 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720000d9a0 con 0x7f72080c3bd0 2023-12-16T03:26:22.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f71ff7fe640 1 -- 172.21.15.28:0/2670007318 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000dd50 con 0x7f72080c3bd0 2023-12-16T03:26:22.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f720d772640 1 -- 172.21.15.28:0/2670007318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72080a6970 con 0x7f72080c3bd0 2023-12-16T03:26:22.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.793+0000 7f720d772640 1 -- 172.21.15.28:0/2670007318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7208155040 con 0x7f72080c3bd0 2023-12-16T03:26:22.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.797+0000 7f720d772640 1 -- 172.21.15.28:0/2670007318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7208068400 con 0x7f72080c3bd0 2023-12-16T03:26:22.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.797+0000 7f71ff7fe640 1 -- 172.21.15.28:0/2670007318 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f720001e3b0 con 0x7f72080c3bd0 2023-12-16T03:26:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.797+0000 7f71ff7fe640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71e8066470 0x7f71e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.797+0000 7f71ff7fe640 1 -- 172.21.15.28:0/2670007318 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7200084c90 con 0x7f72080c3bd0 2023-12-16T03:26:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.797+0000 7f7206ffd640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71e8066470 0x7f71e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.797+0000 7f7206ffd640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71e8066470 0x7f71e8068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f71f80098e0 tx=0x7f71f8009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:22.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.801+0000 7f71ff7fe640 1 -- 172.21.15.28:0/2670007318 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7200051e80 con 0x7f72080c3bd0 2023-12-16T03:26:22.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:22.993+0000 7f720d772640 1 -- 172.21.15.28:0/2670007318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f72080a55e0 con 0x7f72080c3bd0 2023-12-16T03:26:23.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.609+0000 7f71ff7fe640 1 -- 172.21.15.28:0/2670007318 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 123+0+0 (secure 0 0 0) 0x7f720001a020 con 0x7f72080c3bd0 2023-12-16T03:26:23.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 -- 172.21.15.28:0/2670007318 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71e8066470 msgr2=0x7f71e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:23.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71e8066470 0x7f71e8068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f71f80098e0 tx=0x7f71f8009060 comp rx=0 tx=0).stop 2023-12-16T03:26:23.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 -- 172.21.15.28:0/2670007318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f72080c3bd0 msgr2=0x7f72081ed5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:23.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f72080c3bd0 0x7f72081ed5a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f720000cf20 tx=0x7f720000a7d0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 -- 172.21.15.28:0/2670007318 shutdown_connections 2023-12-16T03:26:23.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f71e8066470 0x7f71e8068930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f72080c3bd0 0x7f72081ed5a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72080725c0 0x7f72081ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 --2- 172.21.15.28:0/2670007318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7208072090 0x7f720814f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 -- 172.21.15.28:0/2670007318 >> 172.21.15.28:0/2670007318 conn(0x7f720806a5b0 msgr2=0x7f72080c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:23.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 -- 172.21.15.28:0/2670007318 shutdown_connections 2023-12-16T03:26:23.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.613+0000 7f720d772640 1 -- 172.21.15.28:0/2670007318 wait complete. 2023-12-16T03:26:23.642 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-16T03:26:23.642 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:26:23.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.781+0000 7fe5a072a640 1 Processor -- start 2023-12-16T03:26:23.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.781+0000 7fe5a072a640 1 -- start start 2023-12-16T03:26:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.781+0000 7fe5a072a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe59814b010 0x7fe5980bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.781+0000 7fe5a072a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe598073a70 0x7fe59806b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.781+0000 7fe5a072a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59806a5b0 con 0x7fe59806b540 2023-12-16T03:26:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.781+0000 7fe5a072a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5980c1d60 con 0x7fe598073a70 2023-12-16T03:26:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.781+0000 7fe5a072a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980c2040 con 0x7fe59814b010 2023-12-16T03:26:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59dcc5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe598073a70 0x7fe59806b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59ecc7640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe59806b540 0x7fe598157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58458/0 (socket says 172.21.15.28:58458) 2023-12-16T03:26:23.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59ecc7640 1 -- 172.21.15.28:0/1740032765 learned_addr learned my addr 172.21.15.28:0/1740032765 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:23.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59e4c6640 1 --2- 172.21.15.28:0/1740032765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe59814b010 0x7fe5980bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:23.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59dcc5640 1 -- 172.21.15.28:0/1740032765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe59814b010 msgr2=0x7fe5980bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:23.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59dcc5640 1 --2- 172.21.15.28:0/1740032765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe59814b010 0x7fe5980bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59dcc5640 1 -- 172.21.15.28:0/1740032765 >> v1:172.21.15.28:6789/0 conn(0x7fe59806b540 legacy=0x7fe598157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:23.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59dcc5640 1 -- 172.21.15.28:0/1740032765 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59806a800 con 0x7fe598073a70 2023-12-16T03:26:23.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59e4c6640 1 --2- 172.21.15.28:0/1740032765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe59814b010 0x7fe5980bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:23.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59d4c4640 1 -- 172.21.15.28:0/1740032765 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825595969 0 0) 0x7fe59806a5b0 con 0x7fe59806b540 2023-12-16T03:26:23.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59dcc5640 1 --2- 172.21.15.28:0/1740032765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe598073a70 0x7fe59806b000 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe5880097c0 tx=0x7fe58801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456a9ba91e79c7a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:23.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59d4c4640 1 -- 172.21.15.28:0/1740032765 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5880a8970 con 0x7fe598073a70 2023-12-16T03:26:23.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59d4c4640 1 -- 172.21.15.28:0/1740032765 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5880a8ad0 con 0x7fe598073a70 2023-12-16T03:26:23.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.785+0000 7fe59d4c4640 1 -- 172.21.15.28:0/1740032765 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5880a8e60 con 0x7fe598073a70 2023-12-16T03:26:23.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 -- 172.21.15.28:0/1740032765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe598073a70 msgr2=0x7fe59806b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:23.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 --2- 172.21.15.28:0/1740032765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe598073a70 0x7fe59806b000 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe5880097c0 tx=0x7fe58801ec70 comp rx=0 tx=0).stop 2023-12-16T03:26:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 -- 172.21.15.28:0/1740032765 shutdown_connections 2023-12-16T03:26:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 --2- 172.21.15.28:0/1740032765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe598073a70 0x7fe59806b000 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 --2- 172.21.15.28:0/1740032765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe59814b010 0x7fe5980bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 -- 172.21.15.28:0/1740032765 >> 172.21.15.28:0/1740032765 conn(0x7fe5980c30c0 msgr2=0x7fe5980c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 -- 172.21.15.28:0/1740032765 shutdown_connections 2023-12-16T03:26:23.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 -- 172.21.15.28:0/1740032765 wait complete. 2023-12-16T03:26:23.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 Processor -- start 2023-12-16T03:26:23.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 -- start start 2023-12-16T03:26:23.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe598073a70 0x7fe5981582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:23.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe59814b010 0x7fe5980abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:23.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe598155280 0x7fe5980ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5981537c0 con 0x7fe59814b010 2023-12-16T03:26:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe598153aa0 con 0x7fe598155280 2023-12-16T03:26:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe5a072a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe598153d80 con 0x7fe598073a70 2023-12-16T03:26:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe59dcc5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe59814b010 0x7fe5980abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe59dcc5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe59814b010 0x7fe5980abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51286/0 (socket says 172.21.15.28:51286) 2023-12-16T03:26:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe59dcc5640 1 -- 172.21.15.28:0/3685255881 learned_addr learned my addr 172.21.15.28:0/3685255881 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe59dcc5640 1 -- 172.21.15.28:0/3685255881 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe598073a70 msgr2=0x7fe5981582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe59dcc5640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe598073a70 0x7fe5981582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe59dcc5640 1 -- 172.21.15.28:0/3685255881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe598155280 msgr2=0x7fe5980ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:23.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe59dcc5640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe598155280 0x7fe5980ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe59dcc5640 1 -- 172.21.15.28:0/3685255881 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe588009420 con 0x7fe59814b010 2023-12-16T03:26:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.789+0000 7fe59dcc5640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe59814b010 0x7fe5980abeb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe58801c8a0 tx=0x7fe58801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.793+0000 7fe58effd640 1 -- 172.21.15.28:0/3685255881 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5880a8970 con 0x7fe59814b010 2023-12-16T03:26:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.793+0000 7fe58effd640 1 -- 172.21.15.28:0/3685255881 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5880b9410 con 0x7fe59814b010 2023-12-16T03:26:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.793+0000 7fe58effd640 1 -- 172.21.15.28:0/3685255881 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5880b97a0 con 0x7fe59814b010 2023-12-16T03:26:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.793+0000 7fe5a072a640 1 -- 172.21.15.28:0/3685255881 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe598154060 con 0x7fe59814b010 2023-12-16T03:26:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.793+0000 7fe5a072a640 1 -- 172.21.15.28:0/3685255881 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5980ac930 con 0x7fe59814b010 2023-12-16T03:26:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.793+0000 7fe5a072a640 1 -- 172.21.15.28:0/3685255881 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe598068400 con 0x7fe59814b010 2023-12-16T03:26:23.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.793+0000 7fe58effd640 1 -- 172.21.15.28:0/3685255881 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe5880b7040 con 0x7fe59814b010 2023-12-16T03:26:23.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.793+0000 7fe58effd640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe57c0664a0 0x7fe57c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:23.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.793+0000 7fe58effd640 1 -- 172.21.15.28:0/3685255881 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe588121f70 con 0x7fe59814b010 2023-12-16T03:26:23.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.793+0000 7fe59e4c6640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe57c0664a0 0x7fe57c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:23.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.793+0000 7fe59e4c6640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe57c0664a0 0x7fe57c068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe59400a890 tx=0x7fe594008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:23.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.797+0000 7fe58effd640 1 -- 172.21.15.28:0/3685255881 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe5880eeff0 con 0x7fe59814b010 2023-12-16T03:26:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.985+0000 7fe5a072a640 1 -- 172.21.15.28:0/3685255881 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe598155a50 con 0x7fe59814b010 2023-12-16T03:26:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe58effd640 1 -- 172.21.15.28:0/3685255881 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6183 (secure 0 0 0) 0x7fe5880b5020 con 0x7fe59814b010 2023-12-16T03:26:23.994 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3378969769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3378969769},{"type":"v1","addr":"172.21.15.134:6835","nonce":3378969769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2794220220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2794220220},{"type":"v1","addr":"172.21.15.134:6834","nonce":2794220220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:02.836620+0000","modified":"2023-12-16T03:26:05.858917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.28:6837/1004873879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1004873879},{"type":"v1","addr":"172.21.15.28:6837","nonce":1004873879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:19.999425+0000","modified":"2023-12-16T03:26:22.999486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5010":{"gid":5010,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.28:6836/664267694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":664267694},{"type":"v1","addr":"172.21.15.28:6836","nonce":664267694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-16T03:26:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 21 2023-12-16T03:26:23.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 -- 172.21.15.28:0/3685255881 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe57c0664a0 msgr2=0x7fe57c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:23.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe57c0664a0 0x7fe57c068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe59400a890 tx=0x7fe594008040 comp rx=0 tx=0).stop 2023-12-16T03:26:23.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 -- 172.21.15.28:0/3685255881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe59814b010 msgr2=0x7fe5980abeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:23.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe59814b010 0x7fe5980abeb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe58801c8a0 tx=0x7fe58801ba10 comp rx=0 tx=0).stop 2023-12-16T03:26:23.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 -- 172.21.15.28:0/3685255881 shutdown_connections 2023-12-16T03:26:23.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe598155280 0x7fe5980ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe57c0664a0 0x7fe57c068960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe59814b010 0x7fe5980abeb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 --2- 172.21.15.28:0/3685255881 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe598073a70 0x7fe5981582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 -- 172.21.15.28:0/3685255881 >> 172.21.15.28:0/3685255881 conn(0x7fe5980c30c0 msgr2=0x7fe598070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 -- 172.21.15.28:0/3685255881 shutdown_connections 2023-12-16T03:26:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:23.989+0000 7fe5a072a640 1 -- 172.21.15.28:0/3685255881 wait complete. 2023-12-16T03:26:24.015 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:24.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a4468640 1 Processor -- start 2023-12-16T03:26:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a4468640 1 -- start start 2023-12-16T03:26:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a4468640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb69c0c7ea0 0x7fb69c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a4468640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69c06c860 con 0x7fb69c06b9e0 2023-12-16T03:26:24.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a4468640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69c154930 con 0x7fb69c151e90 2023-12-16T03:26:24.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a4468640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69c0c8750 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a2a05640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb69c06b9e0 0x7fb69c15f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58472/0 (socket says 172.21.15.28:58472) 2023-12-16T03:26:24.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a2a05640 1 -- 172.21.15.28:0/733186143 learned_addr learned my addr 172.21.15.28:0/733186143 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:24.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a1a03640 1 --2- 172.21.15.28:0/733186143 >> v2:172.21.15.28:3300/0 conn(0x7fb69c0c7ea0 0x7fb69c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a1202640 1 -- 172.21.15.28:0/733186143 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663649156 0 0) 0x7fb69c06c860 con 0x7fb69c06b9e0 2023-12-16T03:26:24.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a1202640 1 -- 172.21.15.28:0/733186143 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb688003530 con 0x7fb69c06b9e0 2023-12-16T03:26:24.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a1a03640 1 -- 172.21.15.28:0/733186143 >> v1:172.21.15.134:6789/0 conn(0x7fb69c151e90 legacy=0x7fb69c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a1a03640 1 -- 172.21.15.28:0/733186143 >> v1:172.21.15.28:6789/0 conn(0x7fb69c06b9e0 legacy=0x7fb69c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.153+0000 7fb6a1a03640 1 -- 172.21.15.28:0/733186143 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c154c10 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.157+0000 7fb6a1a03640 1 --2- 172.21.15.28:0/733186143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb69c0c7ea0 0x7fb69c06b4a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097c0 tx=0x7fb68c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6111f56c3ff0a09 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.157+0000 7fb6a1202640 1 -- 172.21.15.28:0/733186143 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0ab600 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.157+0000 7fb6a1202640 1 -- 172.21.15.28:0/733186143 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c0a7050 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.157+0000 7fb6a1202640 1 -- 172.21.15.28:0/733186143 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0ab980 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.157+0000 7fb6a4468640 1 -- 172.21.15.28:0/733186143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb69c0c7ea0 msgr2=0x7fb69c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.157+0000 7fb6a4468640 1 --2- 172.21.15.28:0/733186143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb69c0c7ea0 0x7fb69c06b4a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097c0 tx=0x7fb68c01c360 comp rx=0 tx=0).stop 2023-12-16T03:26:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.157+0000 7fb6a4468640 1 -- 172.21.15.28:0/733186143 shutdown_connections 2023-12-16T03:26:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.157+0000 7fb6a4468640 1 --2- 172.21.15.28:0/733186143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb69c0c7ea0 0x7fb69c06b4a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.157+0000 7fb6a4468640 1 -- 172.21.15.28:0/733186143 >> 172.21.15.28:0/733186143 conn(0x7fb69c0ca170 msgr2=0x7fb69c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.157+0000 7fb6a4468640 1 -- 172.21.15.28:0/733186143 shutdown_connections 2023-12-16T03:26:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.157+0000 7fb6a4468640 1 -- 172.21.15.28:0/733186143 wait complete. 2023-12-16T03:26:24.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a4468640 1 Processor -- start 2023-12-16T03:26:24.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a4468640 1 -- start start 2023-12-16T03:26:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a4468640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb69c06b9e0 0x7fb69c1f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a4468640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb69c0c7ea0 0x7fb69c14b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a4468640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb69c151e90 0x7fb69c14c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a4468640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c1552d0 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a4468640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c156d90 con 0x7fb69c06b9e0 2023-12-16T03:26:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a4468640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c1f1d40 con 0x7fb69c151e90 2023-12-16T03:26:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a1a03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb69c0c7ea0 0x7fb69c14b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a1a03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb69c0c7ea0 0x7fb69c14b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51310/0 (socket says 172.21.15.28:51310) 2023-12-16T03:26:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a1a03640 1 -- 172.21.15.28:0/498160792 learned_addr learned my addr 172.21.15.28:0/498160792 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a2a05640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb69c151e90 0x7fb69c14c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a2204640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb69c06b9e0 0x7fb69c1f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a1a03640 1 -- 172.21.15.28:0/498160792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb69c151e90 msgr2=0x7fb69c14c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a1a03640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb69c151e90 0x7fb69c14c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a1a03640 1 -- 172.21.15.28:0/498160792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb69c06b9e0 msgr2=0x7fb69c1f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a1a03640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb69c06b9e0 0x7fb69c1f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a1a03640 1 -- 172.21.15.28:0/498160792 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c009420 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a2a05640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb69c151e90 0x7fb69c14c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:24.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a1a03640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb69c0c7ea0 0x7fb69c14b540 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0ae040 tx=0x7fb68c019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb692ffd640 1 -- 172.21.15.28:0/498160792 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0abdd0 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb692ffd640 1 -- 172.21.15.28:0/498160792 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c0b4430 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a4468640 1 -- 172.21.15.28:0/498160792 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c147430 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb692ffd640 1 -- 172.21.15.28:0/498160792 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0b47e0 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.161+0000 7fb6a4468640 1 -- 172.21.15.28:0/498160792 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69c157cf0 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.165+0000 7fb6a4468640 1 -- 172.21.15.28:0/498160792 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69c068400 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.165+0000 7fb692ffd640 1 -- 172.21.15.28:0/498160792 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb68c0b2040 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.165+0000 7fb692ffd640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb680066470 0x7fb680068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.165+0000 7fb692ffd640 1 -- 172.21.15.28:0/498160792 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb68c11ddd0 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.165+0000 7fb6a2204640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb680066470 0x7fb680068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.165+0000 7fb6a2204640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb680066470 0x7fb680068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb698007fd0 tx=0x7fb698009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:24.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.169+0000 7fb692ffd640 1 -- 172.21.15.28:0/498160792 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb68c122070 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.329+0000 7fb6a4468640 1 -- 172.21.15.28:0/498160792 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb69c158c40 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.329+0000 7fb692ffd640 1 -- 172.21.15.28:0/498160792 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20229 (secure 0 0 0) 0x7fb68c0eaee0 con 0x7fb69c0c7ea0 2023-12-16T03:26:24.336 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:24.336 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:21.432053+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:24.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 -- 172.21.15.28:0/498160792 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb680066470 msgr2=0x7fb680068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb680066470 0x7fb680068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb698007fd0 tx=0x7fb698009040 comp rx=0 tx=0).stop 2023-12-16T03:26:24.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 -- 172.21.15.28:0/498160792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb69c0c7ea0 msgr2=0x7fb69c14b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb69c0c7ea0 0x7fb69c14b540 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0ae040 tx=0x7fb68c019100 comp rx=0 tx=0).stop 2023-12-16T03:26:24.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 -- 172.21.15.28:0/498160792 shutdown_connections 2023-12-16T03:26:24.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb69c151e90 0x7fb69c14c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb680066470 0x7fb680068930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb69c0c7ea0 0x7fb69c14b540 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 --2- 172.21.15.28:0/498160792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb69c06b9e0 0x7fb69c1f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 -- 172.21.15.28:0/498160792 >> 172.21.15.28:0/498160792 conn(0x7fb69c0ca170 msgr2=0x7fb69c0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:24.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 -- 172.21.15.28:0/498160792 shutdown_connections 2023-12-16T03:26:24.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.333+0000 7fb6a4468640 1 -- 172.21.15.28:0/498160792 wait complete. 2023-12-16T03:26:24.358 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-16T03:26:24.359 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:26:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e8d2a640 1 Processor -- start 2023-12-16T03:26:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e8d2a640 1 -- start start 2023-12-16T03:26:24.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e8d2a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62e40c7ea0 0x7f62e406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e8d2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f62e406b9e0 0x7f62e415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e8d2a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e406c860 con 0x7f62e4151e90 2023-12-16T03:26:24.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e8d2a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e40c8750 con 0x7f62e40c7ea0 2023-12-16T03:26:24.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e8d2a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e41552d0 con 0x7f62e406b9e0 2023-12-16T03:26:24.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e1d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62e40c7ea0 0x7f62e406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e1d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62e40c7ea0 0x7f62e406b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51320/0 (socket says 172.21.15.28:51320) 2023-12-16T03:26:24.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e1d9b640 1 -- 172.21.15.28:0/2192971532 learned_addr learned my addr 172.21.15.28:0/2192971532 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:24.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e2d9d640 1 --2- 172.21.15.28:0/2192971532 >> v2:172.21.15.134:3300/0 conn(0x7f62e406b9e0 0x7f62e415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e1d9b640 1 -- 172.21.15.28:0/2192971532 >> v2:172.21.15.134:3300/0 conn(0x7f62e406b9e0 msgr2=0x7f62e415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:24.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e1d9b640 1 --2- 172.21.15.28:0/2192971532 >> v2:172.21.15.134:3300/0 conn(0x7f62e406b9e0 0x7f62e415f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e1d9b640 1 -- 172.21.15.28:0/2192971532 >> v1:172.21.15.134:6789/0 conn(0x7f62e4151e90 legacy=0x7f62e40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.497+0000 7f62e1d9b640 1 -- 172.21.15.28:0/2192971532 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e4154930 con 0x7f62e40c7ea0 2023-12-16T03:26:24.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e1d9b640 1 --2- 172.21.15.28:0/2192971532 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e40c7ea0 0x7f62e406b4a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f62e408c190 tx=0x7f62d801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c991a3bfcbbac0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:24.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e159a640 1 -- 172.21.15.28:0/2192971532 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d80ab600 con 0x7f62e40c7ea0 2023-12-16T03:26:24.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e159a640 1 -- 172.21.15.28:0/2192971532 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d80a7050 con 0x7f62e40c7ea0 2023-12-16T03:26:24.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e159a640 1 -- 172.21.15.28:0/2192971532 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d80ab980 con 0x7f62e40c7ea0 2023-12-16T03:26:24.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e8d2a640 1 -- 172.21.15.28:0/2192971532 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e40c7ea0 msgr2=0x7f62e406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e8d2a640 1 --2- 172.21.15.28:0/2192971532 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e40c7ea0 0x7f62e406b4a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f62e408c190 tx=0x7f62d801c3e0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e8d2a640 1 -- 172.21.15.28:0/2192971532 shutdown_connections 2023-12-16T03:26:24.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e8d2a640 1 --2- 172.21.15.28:0/2192971532 >> v2:172.21.15.134:3300/0 conn(0x7f62e406b9e0 0x7f62e415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e8d2a640 1 --2- 172.21.15.28:0/2192971532 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e40c7ea0 0x7f62e406b4a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e8d2a640 1 -- 172.21.15.28:0/2192971532 >> 172.21.15.28:0/2192971532 conn(0x7f62e40ca170 msgr2=0x7f62e40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:24.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e8d2a640 1 -- 172.21.15.28:0/2192971532 shutdown_connections 2023-12-16T03:26:24.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.501+0000 7f62e8d2a640 1 -- 172.21.15.28:0/2192971532 wait complete. 2023-12-16T03:26:24.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e8d2a640 1 Processor -- start 2023-12-16T03:26:24.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e8d2a640 1 -- start start 2023-12-16T03:26:24.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e8d2a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e406b9e0 0x7f62e414e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e8d2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e40c7ea0 0x7f62e40ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e8d2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62e4151e90 0x7f62e40a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e8d2a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e414e570 con 0x7f62e406b9e0 2023-12-16T03:26:24.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e8d2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40ab7d0 con 0x7f62e40c7ea0 2023-12-16T03:26:24.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e8d2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40abd70 con 0x7f62e4151e90 2023-12-16T03:26:24.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e406b9e0 0x7f62e414e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e406b9e0 0x7f62e414e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51328/0 (socket says 172.21.15.28:51328) 2023-12-16T03:26:24.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e259c640 1 -- 172.21.15.28:0/908216165 learned_addr learned my addr 172.21.15.28:0/908216165 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:24.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e1d9b640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e40c7ea0 0x7f62e40ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e2d9d640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62e4151e90 0x7f62e40a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e259c640 1 -- 172.21.15.28:0/908216165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62e4151e90 msgr2=0x7f62e40a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e259c640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62e4151e90 0x7f62e40a9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e259c640 1 -- 172.21.15.28:0/908216165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e40c7ea0 msgr2=0x7f62e40ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e259c640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e40c7ea0 0x7f62e40ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e259c640 1 -- 172.21.15.28:0/908216165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80094d0 con 0x7f62e406b9e0 2023-12-16T03:26:24.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e259c640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e406b9e0 0x7f62e414e030 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c530 tx=0x7f62d400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:24.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62d2ffd640 1 -- 172.21.15.28:0/908216165 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4005220 con 0x7f62e406b9e0 2023-12-16T03:26:24.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62d2ffd640 1 -- 172.21.15.28:0/908216165 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d4005380 con 0x7f62e406b9e0 2023-12-16T03:26:24.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62d2ffd640 1 -- 172.21.15.28:0/908216165 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4007270 con 0x7f62e406b9e0 2023-12-16T03:26:24.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e8d2a640 1 -- 172.21.15.28:0/908216165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e40bd6b0 con 0x7f62e406b9e0 2023-12-16T03:26:24.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e8d2a640 1 -- 172.21.15.28:0/908216165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e41ed100 con 0x7f62e406b9e0 2023-12-16T03:26:24.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.505+0000 7f62e8d2a640 1 -- 172.21.15.28:0/908216165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e41ed2f0 con 0x7f62e406b9e0 2023-12-16T03:26:24.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.509+0000 7f62d2ffd640 1 -- 172.21.15.28:0/908216165 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f62d40073d0 con 0x7f62e406b9e0 2023-12-16T03:26:24.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.509+0000 7f62d2ffd640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62c40664a0 0x7f62c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.509+0000 7f62d2ffd640 1 -- 172.21.15.28:0/908216165 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f62d40839a0 con 0x7f62e406b9e0 2023-12-16T03:26:24.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.509+0000 7f62e1d9b640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62c40664a0 0x7f62c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.509+0000 7f62e1d9b640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62c40664a0 0x7f62c4068960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f62d80ad000 tx=0x7f62d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:24.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.513+0000 7f62d2ffd640 1 -- 172.21.15.28:0/908216165 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f62d4050b60 con 0x7f62e406b9e0 2023-12-16T03:26:24.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.669+0000 7f62e8d2a640 1 -- 172.21.15.28:0/908216165 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62e414f300 con 0x7f62c40664a0 2023-12-16T03:26:24.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.685+0000 7f62d2ffd640 1 -- 172.21.15.28:0/908216165 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527810 (secure 0 0 0) 0x7f62e414f300 con 0x7f62c40664a0 2023-12-16T03:26:24.696 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:24.700 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:26:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 -- 172.21.15.28:0/908216165 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62c40664a0 msgr2=0x7f62c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62c40664a0 0x7f62c4068960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f62d80ad000 tx=0x7f62d8008040 comp rx=0 tx=0).stop 2023-12-16T03:26:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 -- 172.21.15.28:0/908216165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e406b9e0 msgr2=0x7f62e414e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e406b9e0 0x7f62e414e030 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c530 tx=0x7f62d400c9f0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 -- 172.21.15.28:0/908216165 shutdown_connections 2023-12-16T03:26:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62e4151e90 0x7f62e40a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e40c7ea0 0x7f62e40ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f62c40664a0 0x7f62c4068960 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 --2- 172.21.15.28:0/908216165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e406b9e0 0x7f62e414e030 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 -- 172.21.15.28:0/908216165 >> 172.21.15.28:0/908216165 conn(0x7f62e40ca170 msgr2=0x7f62e4150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 -- 172.21.15.28:0/908216165 shutdown_connections 2023-12-16T03:26:24.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.689+0000 7f62e8d2a640 1 -- 172.21.15.28:0/908216165 wait complete. 2023-12-16T03:26:24.716 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-12-16T03:26:23.811985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":332,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237272,"kb_used_data":4428,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737448,"statfs":{"total":773094113280,"available":772851146752,"internally_reserved":0,"allocated":4534272,"data_stored":2501581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.231232"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.420012+0000","last_change":"2023-12-16T03:26:20.455600+0000","last_active":"2023-12-16T03:26:22.420012+0000","last_peered":"2023-12-16T03:26:22.420012+0000","last_clean":"2023-12-16T03:26:22.420012+0000","last_became_active":"2023-12-16T03:26:20.454435+0000","last_became_peered":"2023-12-16T03:26:20.454435+0000","last_unstale":"2023-12-16T03:26:22.420012+0000","last_undegraded":"2023-12-16T03:26:22.420012+0000","last_fullsized":"2023-12-16T03:26:22.420012+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:29.167009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.437574+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:26:20.437574+0000","last_peered":"2023-12-16T03:26:20.437574+0000","last_clean":"2023-12-16T03:26:20.437574+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:26:20.437574+0000","last_undegraded":"2023-12-16T03:26:20.437574+0000","last_fullsized":"2023-12-16T03:26:20.437574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.465848+0000","last_change":"2023-12-16T03:26:02.467483+0000","last_active":"2023-12-16T03:26:20.465848+0000","last_peered":"2023-12-16T03:26:20.465848+0000","last_clean":"2023-12-16T03:26:20.465848+0000","last_became_active":"2023-12-16T03:26:02.467186+0000","last_became_peered":"2023-12-16T03:26:02.467186+0000","last_unstale":"2023-12-16T03:26:20.465848+0000","last_undegraded":"2023-12-16T03:26:20.465848+0000","last_fullsized":"2023-12-16T03:26:20.465848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.441743+0000","last_change":"2023-12-16T03:26:03.470811+0000","last_active":"2023-12-16T03:26:20.441743+0000","last_peered":"2023-12-16T03:26:20.441743+0000","last_clean":"2023-12-16T03:26:20.441743+0000","last_became_active":"2023-12-16T03:26:03.469335+0000","last_became_peered":"2023-12-16T03:26:03.469335+0000","last_unstale":"2023-12-16T03:26:20.441743+0000","last_undegraded":"2023-12-16T03:26:20.441743+0000","last_fullsized":"2023-12-16T03:26:20.441743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:21.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440873+0000","last_change":"2023-12-16T03:26:19.618339+0000","last_active":"2023-12-16T03:26:21.440873+0000","last_peered":"2023-12-16T03:26:21.440873+0000","last_clean":"2023-12-16T03:26:21.440873+0000","last_became_active":"2023-12-16T03:26:19.618039+0000","last_became_peered":"2023-12-16T03:26:19.618039+0000","last_unstale":"2023-12-16T03:26:21.440873+0000","last_undegraded":"2023-12-16T03:26:21.440873+0000","last_fullsized":"2023-12-16T03:26:21.440873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:44.950332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417801+0000","last_change":"2023-12-16T03:26:20.458383+0000","last_active":"2023-12-16T03:26:22.417801+0000","last_peered":"2023-12-16T03:26:22.417801+0000","last_clean":"2023-12-16T03:26:22.417801+0000","last_became_active":"2023-12-16T03:26:20.457188+0000","last_became_peered":"2023-12-16T03:26:20.457188+0000","last_unstale":"2023-12-16T03:26:22.417801+0000","last_undegraded":"2023-12-16T03:26:22.417801+0000","last_fullsized":"2023-12-16T03:26:22.417801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:00:41.256641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449609+0000","last_change":"2023-12-16T03:26:02.468114+0000","last_active":"2023-12-16T03:26:20.449609+0000","last_peered":"2023-12-16T03:26:20.449609+0000","last_clean":"2023-12-16T03:26:20.449609+0000","last_became_active":"2023-12-16T03:26:02.467813+0000","last_became_peered":"2023-12-16T03:26:02.467813+0000","last_unstale":"2023-12-16T03:26:20.449609+0000","last_undegraded":"2023-12-16T03:26:20.449609+0000","last_fullsized":"2023-12-16T03:26:20.449609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:24:47.746674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438852+0000","last_change":"2023-12-16T03:26:03.461564+0000","last_active":"2023-12-16T03:26:20.438852+0000","last_peered":"2023-12-16T03:26:20.438852+0000","last_clean":"2023-12-16T03:26:20.438852+0000","last_became_active":"2023-12-16T03:26:03.459570+0000","last_became_peered":"2023-12-16T03:26:03.459570+0000","last_unstale":"2023-12-16T03:26:20.438852+0000","last_undegraded":"2023-12-16T03:26:20.438852+0000","last_fullsized":"2023-12-16T03:26:20.438852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:05:14.653208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439431+0000","last_change":"2023-12-16T03:26:19.624241+0000","last_active":"2023-12-16T03:26:21.439431+0000","last_peered":"2023-12-16T03:26:21.439431+0000","last_clean":"2023-12-16T03:26:21.439431+0000","last_became_active":"2023-12-16T03:26:19.623935+0000","last_became_peered":"2023-12-16T03:26:19.623935+0000","last_unstale":"2023-12-16T03:26:21.439431+0000","last_undegraded":"2023-12-16T03:26:21.439431+0000","last_fullsized":"2023-12-16T03:26:21.439431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:00.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418351+0000","last_change":"2023-12-16T03:26:20.462407+0000","last_active":"2023-12-16T03:26:22.418351+0000","last_peered":"2023-12-16T03:26:22.418351+0000","last_clean":"2023-12-16T03:26:22.418351+0000","last_became_active":"2023-12-16T03:26:20.457618+0000","last_became_peered":"2023-12-16T03:26:20.457618+0000","last_unstale":"2023-12-16T03:26:22.418351+0000","last_undegraded":"2023-12-16T03:26:22.418351+0000","last_fullsized":"2023-12-16T03:26:22.418351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:20:24.208327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439045+0000","last_change":"2023-12-16T03:26:02.459691+0000","last_active":"2023-12-16T03:26:20.439045+0000","last_peered":"2023-12-16T03:26:20.439045+0000","last_clean":"2023-12-16T03:26:20.439045+0000","last_became_active":"2023-12-16T03:26:02.458861+0000","last_became_peered":"2023-12-16T03:26:02.458861+0000","last_unstale":"2023-12-16T03:26:20.439045+0000","last_undegraded":"2023-12-16T03:26:20.439045+0000","last_fullsized":"2023-12-16T03:26:20.439045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:31.574264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449531+0000","last_change":"2023-12-16T03:26:03.474528+0000","last_active":"2023-12-16T03:26:20.449531+0000","last_peered":"2023-12-16T03:26:20.449531+0000","last_clean":"2023-12-16T03:26:20.449531+0000","last_became_active":"2023-12-16T03:26:03.472731+0000","last_became_peered":"2023-12-16T03:26:03.472731+0000","last_unstale":"2023-12-16T03:26:20.449531+0000","last_undegraded":"2023-12-16T03:26:20.449531+0000","last_fullsized":"2023-12-16T03:26:20.449531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:58:06.441852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419060+0000","last_change":"2023-12-16T03:26:19.615958+0000","last_active":"2023-12-16T03:26:22.419060+0000","last_peered":"2023-12-16T03:26:22.419060+0000","last_clean":"2023-12-16T03:26:22.419060+0000","last_became_active":"2023-12-16T03:26:19.615619+0000","last_became_peered":"2023-12-16T03:26:19.615619+0000","last_unstale":"2023-12-16T03:26:22.419060+0000","last_undegraded":"2023-12-16T03:26:22.419060+0000","last_fullsized":"2023-12-16T03:26:22.419060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:03.030525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439052+0000","last_change":"2023-12-16T03:26:20.456698+0000","last_active":"2023-12-16T03:26:21.439052+0000","last_peered":"2023-12-16T03:26:21.439052+0000","last_clean":"2023-12-16T03:26:21.439052+0000","last_became_active":"2023-12-16T03:26:20.456218+0000","last_became_peered":"2023-12-16T03:26:20.456218+0000","last_unstale":"2023-12-16T03:26:21.439052+0000","last_undegraded":"2023-12-16T03:26:21.439052+0000","last_fullsized":"2023-12-16T03:26:21.439052+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:05.243547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.434859+0000","last_change":"2023-12-16T03:26:02.462695+0000","last_active":"2023-12-16T03:26:20.434859+0000","last_peered":"2023-12-16T03:26:20.434859+0000","last_clean":"2023-12-16T03:26:20.434859+0000","last_became_active":"2023-12-16T03:26:02.461706+0000","last_became_peered":"2023-12-16T03:26:02.461706+0000","last_unstale":"2023-12-16T03:26:20.434859+0000","last_undegraded":"2023-12-16T03:26:20.434859+0000","last_fullsized":"2023-12-16T03:26:20.434859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:31.574264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.441654+0000","last_change":"2023-12-16T03:26:03.475970+0000","last_active":"2023-12-16T03:26:20.441654+0000","last_peered":"2023-12-16T03:26:20.441654+0000","last_clean":"2023-12-16T03:26:20.441654+0000","last_became_active":"2023-12-16T03:26:03.475704+0000","last_became_peered":"2023-12-16T03:26:03.475704+0000","last_unstale":"2023-12-16T03:26:20.441654+0000","last_undegraded":"2023-12-16T03:26:20.441654+0000","last_fullsized":"2023-12-16T03:26:20.441654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:34.342031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418310+0000","last_change":"2023-12-16T03:26:19.619984+0000","last_active":"2023-12-16T03:26:22.418310+0000","last_peered":"2023-12-16T03:26:22.418310+0000","last_clean":"2023-12-16T03:26:22.418310+0000","last_became_active":"2023-12-16T03:26:19.619636+0000","last_became_peered":"2023-12-16T03:26:19.619636+0000","last_unstale":"2023-12-16T03:26:22.418310+0000","last_undegraded":"2023-12-16T03:26:22.418310+0000","last_fullsized":"2023-12-16T03:26:22.418310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:00.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438342+0000","last_change":"2023-12-16T03:26:20.454806+0000","last_active":"2023-12-16T03:26:21.438342+0000","last_peered":"2023-12-16T03:26:21.438342+0000","last_clean":"2023-12-16T03:26:21.438342+0000","last_became_active":"2023-12-16T03:26:20.454401+0000","last_became_peered":"2023-12-16T03:26:20.454401+0000","last_unstale":"2023-12-16T03:26:21.438342+0000","last_undegraded":"2023-12-16T03:26:21.438342+0000","last_fullsized":"2023-12-16T03:26:21.438342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:13.539226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.441936+0000","last_change":"2023-12-16T03:26:02.456023+0000","last_active":"2023-12-16T03:26:20.441936+0000","last_peered":"2023-12-16T03:26:20.441936+0000","last_clean":"2023-12-16T03:26:20.441936+0000","last_became_active":"2023-12-16T03:26:02.455703+0000","last_became_peered":"2023-12-16T03:26:02.455703+0000","last_unstale":"2023-12-16T03:26:20.441936+0000","last_undegraded":"2023-12-16T03:26:20.441936+0000","last_fullsized":"2023-12-16T03:26:20.441936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:05:13.649270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467180+0000","last_change":"2023-12-16T03:26:03.483286+0000","last_active":"2023-12-16T03:26:20.467180+0000","last_peered":"2023-12-16T03:26:20.467180+0000","last_clean":"2023-12-16T03:26:20.467180+0000","last_became_active":"2023-12-16T03:26:03.483003+0000","last_became_peered":"2023-12-16T03:26:03.483003+0000","last_unstale":"2023-12-16T03:26:20.467180+0000","last_undegraded":"2023-12-16T03:26:20.467180+0000","last_fullsized":"2023-12-16T03:26:20.467180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:34.342031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418468+0000","last_change":"2023-12-16T03:26:19.612166+0000","last_active":"2023-12-16T03:26:22.418468+0000","last_peered":"2023-12-16T03:26:22.418468+0000","last_clean":"2023-12-16T03:26:22.418468+0000","last_became_active":"2023-12-16T03:26:19.611770+0000","last_became_peered":"2023-12-16T03:26:19.611770+0000","last_unstale":"2023-12-16T03:26:22.418468+0000","last_undegraded":"2023-12-16T03:26:22.418468+0000","last_fullsized":"2023-12-16T03:26:22.418468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:57:25.261038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419512+0000","last_change":"2023-12-16T03:26:20.465191+0000","last_active":"2023-12-16T03:26:22.419512+0000","last_peered":"2023-12-16T03:26:22.419512+0000","last_clean":"2023-12-16T03:26:22.419512+0000","last_became_active":"2023-12-16T03:26:20.462358+0000","last_became_peered":"2023-12-16T03:26:20.462358+0000","last_unstale":"2023-12-16T03:26:22.419512+0000","last_undegraded":"2023-12-16T03:26:22.419512+0000","last_fullsized":"2023-12-16T03:26:22.419512+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:05.243547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436207+0000","last_change":"2023-12-16T03:26:02.465084+0000","last_active":"2023-12-16T03:26:20.436207+0000","last_peered":"2023-12-16T03:26:20.436207+0000","last_clean":"2023-12-16T03:26:20.436207+0000","last_became_active":"2023-12-16T03:26:02.464706+0000","last_became_peered":"2023-12-16T03:26:02.464706+0000","last_unstale":"2023-12-16T03:26:20.436207+0000","last_undegraded":"2023-12-16T03:26:20.436207+0000","last_fullsized":"2023-12-16T03:26:20.436207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.442464+0000","last_change":"2023-12-16T03:26:03.471971+0000","last_active":"2023-12-16T03:26:20.442464+0000","last_peered":"2023-12-16T03:26:20.442464+0000","last_clean":"2023-12-16T03:26:20.442464+0000","last_became_active":"2023-12-16T03:26:03.471769+0000","last_became_peered":"2023-12-16T03:26:03.471769+0000","last_unstale":"2023-12-16T03:26:20.442464+0000","last_undegraded":"2023-12-16T03:26:20.442464+0000","last_fullsized":"2023-12-16T03:26:20.442464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:49.203240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417825+0000","last_change":"2023-12-16T03:26:19.625819+0000","last_active":"2023-12-16T03:26:22.417825+0000","last_peered":"2023-12-16T03:26:22.417825+0000","last_clean":"2023-12-16T03:26:22.417825+0000","last_became_active":"2023-12-16T03:26:19.625491+0000","last_became_peered":"2023-12-16T03:26:19.625491+0000","last_unstale":"2023-12-16T03:26:22.417825+0000","last_undegraded":"2023-12-16T03:26:22.417825+0000","last_fullsized":"2023-12-16T03:26:22.417825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:48:59.755641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419431+0000","last_change":"2023-12-16T03:26:20.452924+0000","last_active":"2023-12-16T03:26:22.419431+0000","last_peered":"2023-12-16T03:26:22.419431+0000","last_clean":"2023-12-16T03:26:22.419431+0000","last_became_active":"2023-12-16T03:26:20.452596+0000","last_became_peered":"2023-12-16T03:26:20.452596+0000","last_unstale":"2023-12-16T03:26:22.419431+0000","last_undegraded":"2023-12-16T03:26:22.419431+0000","last_fullsized":"2023-12-16T03:26:22.419431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:20:08.420830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443892+0000","last_change":"2023-12-16T03:26:02.476238+0000","last_active":"2023-12-16T03:26:20.443892+0000","last_peered":"2023-12-16T03:26:20.443892+0000","last_clean":"2023-12-16T03:26:20.443892+0000","last_became_active":"2023-12-16T03:26:02.475844+0000","last_became_peered":"2023-12-16T03:26:02.475844+0000","last_unstale":"2023-12-16T03:26:20.443892+0000","last_undegraded":"2023-12-16T03:26:20.443892+0000","last_fullsized":"2023-12-16T03:26:20.443892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:50.926184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.451342+0000","last_change":"2023-12-16T03:26:03.463996+0000","last_active":"2023-12-16T03:26:20.451342+0000","last_peered":"2023-12-16T03:26:20.451342+0000","last_clean":"2023-12-16T03:26:20.451342+0000","last_became_active":"2023-12-16T03:26:03.463705+0000","last_became_peered":"2023-12-16T03:26:03.463705+0000","last_unstale":"2023-12-16T03:26:20.451342+0000","last_undegraded":"2023-12-16T03:26:20.451342+0000","last_fullsized":"2023-12-16T03:26:20.451342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:47:58.231120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.420155+0000","last_change":"2023-12-16T03:26:19.616119+0000","last_active":"2023-12-16T03:26:22.420155+0000","last_peered":"2023-12-16T03:26:22.420155+0000","last_clean":"2023-12-16T03:26:22.420155+0000","last_became_active":"2023-12-16T03:26:19.615793+0000","last_became_peered":"2023-12-16T03:26:19.615793+0000","last_unstale":"2023-12-16T03:26:22.420155+0000","last_undegraded":"2023-12-16T03:26:22.420155+0000","last_fullsized":"2023-12-16T03:26:22.420155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:23:42.587704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419473+0000","last_change":"2023-12-16T03:26:20.454089+0000","last_active":"2023-12-16T03:26:22.419473+0000","last_peered":"2023-12-16T03:26:22.419473+0000","last_clean":"2023-12-16T03:26:22.419473+0000","last_became_active":"2023-12-16T03:26:20.453737+0000","last_became_peered":"2023-12-16T03:26:20.453737+0000","last_unstale":"2023-12-16T03:26:22.419473+0000","last_undegraded":"2023-12-16T03:26:22.419473+0000","last_fullsized":"2023-12-16T03:26:22.419473+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:44:05.177453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436794+0000","last_change":"2023-12-16T03:26:02.472212+0000","last_active":"2023-12-16T03:26:20.436794+0000","last_peered":"2023-12-16T03:26:20.436794+0000","last_clean":"2023-12-16T03:26:20.436794+0000","last_became_active":"2023-12-16T03:26:02.471791+0000","last_became_peered":"2023-12-16T03:26:02.471791+0000","last_unstale":"2023-12-16T03:26:20.436794+0000","last_undegraded":"2023-12-16T03:26:20.436794+0000","last_fullsized":"2023-12-16T03:26:20.436794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:53.959842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440665+0000","last_change":"2023-12-16T03:26:03.465923+0000","last_active":"2023-12-16T03:26:20.440665+0000","last_peered":"2023-12-16T03:26:20.440665+0000","last_clean":"2023-12-16T03:26:20.440665+0000","last_became_active":"2023-12-16T03:26:03.464781+0000","last_became_peered":"2023-12-16T03:26:03.464781+0000","last_unstale":"2023-12-16T03:26:20.440665+0000","last_undegraded":"2023-12-16T03:26:20.440665+0000","last_fullsized":"2023-12-16T03:26:20.440665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:51.446792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419593+0000","last_change":"2023-12-16T03:26:19.626629+0000","last_active":"2023-12-16T03:26:22.419593+0000","last_peered":"2023-12-16T03:26:22.419593+0000","last_clean":"2023-12-16T03:26:22.419593+0000","last_became_active":"2023-12-16T03:26:19.626293+0000","last_became_peered":"2023-12-16T03:26:19.626293+0000","last_unstale":"2023-12-16T03:26:22.419593+0000","last_undegraded":"2023-12-16T03:26:22.419593+0000","last_fullsized":"2023-12-16T03:26:22.419593+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:12.536210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.421285+0000","last_change":"2023-12-16T03:26:20.450919+0000","last_active":"2023-12-16T03:26:22.421285+0000","last_peered":"2023-12-16T03:26:22.421285+0000","last_clean":"2023-12-16T03:26:22.421285+0000","last_became_active":"2023-12-16T03:26:20.450739+0000","last_became_peered":"2023-12-16T03:26:20.450739+0000","last_unstale":"2023-12-16T03:26:22.421285+0000","last_undegraded":"2023-12-16T03:26:22.421285+0000","last_fullsized":"2023-12-16T03:26:22.421285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:31.461913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449118+0000","last_change":"2023-12-16T03:26:02.456879+0000","last_active":"2023-12-16T03:26:20.449118+0000","last_peered":"2023-12-16T03:26:20.449118+0000","last_clean":"2023-12-16T03:26:20.449118+0000","last_became_active":"2023-12-16T03:26:02.456571+0000","last_became_peered":"2023-12-16T03:26:02.456571+0000","last_unstale":"2023-12-16T03:26:20.449118+0000","last_undegraded":"2023-12-16T03:26:20.449118+0000","last_fullsized":"2023-12-16T03:26:20.449118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:20:29.012213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438440+0000","last_change":"2023-12-16T03:26:03.474960+0000","last_active":"2023-12-16T03:26:20.438440+0000","last_peered":"2023-12-16T03:26:20.438440+0000","last_clean":"2023-12-16T03:26:20.438440+0000","last_became_active":"2023-12-16T03:26:03.474646+0000","last_became_peered":"2023-12-16T03:26:03.474646+0000","last_unstale":"2023-12-16T03:26:20.438440+0000","last_undegraded":"2023-12-16T03:26:20.438440+0000","last_fullsized":"2023-12-16T03:26:20.438440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:58:06.441852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438351+0000","last_change":"2023-12-16T03:26:19.609502+0000","last_active":"2023-12-16T03:26:21.438351+0000","last_peered":"2023-12-16T03:26:21.438351+0000","last_clean":"2023-12-16T03:26:21.438351+0000","last_became_active":"2023-12-16T03:26:19.608698+0000","last_became_peered":"2023-12-16T03:26:19.608698+0000","last_unstale":"2023-12-16T03:26:21.438351+0000","last_undegraded":"2023-12-16T03:26:21.438351+0000","last_fullsized":"2023-12-16T03:26:21.438351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:16.967864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418177+0000","last_change":"2023-12-16T03:26:20.463298+0000","last_active":"2023-12-16T03:26:22.418177+0000","last_peered":"2023-12-16T03:26:22.418177+0000","last_clean":"2023-12-16T03:26:22.418177+0000","last_became_active":"2023-12-16T03:26:20.462713+0000","last_became_peered":"2023-12-16T03:26:20.462713+0000","last_unstale":"2023-12-16T03:26:22.418177+0000","last_undegraded":"2023-12-16T03:26:22.418177+0000","last_fullsized":"2023-12-16T03:26:22.418177+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:06.502049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438942+0000","last_change":"2023-12-16T03:26:02.473193+0000","last_active":"2023-12-16T03:26:20.438942+0000","last_peered":"2023-12-16T03:26:20.438942+0000","last_clean":"2023-12-16T03:26:20.438942+0000","last_became_active":"2023-12-16T03:26:02.472836+0000","last_became_peered":"2023-12-16T03:26:02.472836+0000","last_unstale":"2023-12-16T03:26:20.438942+0000","last_undegraded":"2023-12-16T03:26:20.438942+0000","last_fullsized":"2023-12-16T03:26:20.438942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439646+0000","last_change":"2023-12-16T03:26:03.474142+0000","last_active":"2023-12-16T03:26:20.439646+0000","last_peered":"2023-12-16T03:26:20.439646+0000","last_clean":"2023-12-16T03:26:20.439646+0000","last_became_active":"2023-12-16T03:26:03.472456+0000","last_became_peered":"2023-12-16T03:26:03.472456+0000","last_unstale":"2023-12-16T03:26:20.439646+0000","last_undegraded":"2023-12-16T03:26:20.439646+0000","last_fullsized":"2023-12-16T03:26:20.439646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:34.845852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418211+0000","last_change":"2023-12-16T03:26:19.618531+0000","last_active":"2023-12-16T03:26:22.418211+0000","last_peered":"2023-12-16T03:26:22.418211+0000","last_clean":"2023-12-16T03:26:22.418211+0000","last_became_active":"2023-12-16T03:26:19.617852+0000","last_became_peered":"2023-12-16T03:26:19.617852+0000","last_unstale":"2023-12-16T03:26:22.418211+0000","last_undegraded":"2023-12-16T03:26:22.418211+0000","last_fullsized":"2023-12-16T03:26:22.418211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:20:07.417814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417751+0000","last_change":"2023-12-16T03:26:20.455224+0000","last_active":"2023-12-16T03:26:22.417751+0000","last_peered":"2023-12-16T03:26:22.417751+0000","last_clean":"2023-12-16T03:26:22.417751+0000","last_became_active":"2023-12-16T03:26:20.454681+0000","last_became_peered":"2023-12-16T03:26:20.454681+0000","last_unstale":"2023-12-16T03:26:22.417751+0000","last_undegraded":"2023-12-16T03:26:22.417751+0000","last_fullsized":"2023-12-16T03:26:22.417751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:50:56.670673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467786+0000","last_change":"2023-12-16T03:26:02.474673+0000","last_active":"2023-12-16T03:26:20.467786+0000","last_peered":"2023-12-16T03:26:20.467786+0000","last_clean":"2023-12-16T03:26:20.467786+0000","last_became_active":"2023-12-16T03:26:02.474398+0000","last_became_peered":"2023-12-16T03:26:02.474398+0000","last_unstale":"2023-12-16T03:26:20.467786+0000","last_undegraded":"2023-12-16T03:26:20.467786+0000","last_fullsized":"2023-12-16T03:26:20.467786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:19.149617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440533+0000","last_change":"2023-12-16T03:26:03.488357+0000","last_active":"2023-12-16T03:26:20.440533+0000","last_peered":"2023-12-16T03:26:20.440533+0000","last_clean":"2023-12-16T03:26:20.440533+0000","last_became_active":"2023-12-16T03:26:03.488037+0000","last_became_peered":"2023-12-16T03:26:03.488037+0000","last_unstale":"2023-12-16T03:26:20.440533+0000","last_undegraded":"2023-12-16T03:26:20.440533+0000","last_fullsized":"2023-12-16T03:26:20.440533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:50.117449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418252+0000","last_change":"2023-12-16T03:26:19.619617+0000","last_active":"2023-12-16T03:26:22.418252+0000","last_peered":"2023-12-16T03:26:22.418252+0000","last_clean":"2023-12-16T03:26:22.418252+0000","last_became_active":"2023-12-16T03:26:19.619204+0000","last_became_peered":"2023-12-16T03:26:19.619204+0000","last_unstale":"2023-12-16T03:26:22.418252+0000","last_undegraded":"2023-12-16T03:26:22.418252+0000","last_fullsized":"2023-12-16T03:26:22.418252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:04.240531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.437540+0000","last_change":"2023-12-16T03:26:20.448535+0000","last_active":"2023-12-16T03:26:21.437540+0000","last_peered":"2023-12-16T03:26:21.437540+0000","last_clean":"2023-12-16T03:26:21.437540+0000","last_became_active":"2023-12-16T03:26:20.448268+0000","last_became_peered":"2023-12-16T03:26:20.448268+0000","last_unstale":"2023-12-16T03:26:21.437540+0000","last_undegraded":"2023-12-16T03:26:21.437540+0000","last_fullsized":"2023-12-16T03:26:21.437540+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:19.867911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.441786+0000","last_change":"2023-12-16T03:26:02.462344+0000","last_active":"2023-12-16T03:26:20.441786+0000","last_peered":"2023-12-16T03:26:20.441786+0000","last_clean":"2023-12-16T03:26:20.441786+0000","last_became_active":"2023-12-16T03:26:02.462089+0000","last_became_peered":"2023-12-16T03:26:02.462089+0000","last_unstale":"2023-12-16T03:26:20.441786+0000","last_undegraded":"2023-12-16T03:26:20.441786+0000","last_fullsized":"2023-12-16T03:26:20.441786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440149+0000","last_change":"2023-12-16T03:26:03.465370+0000","last_active":"2023-12-16T03:26:20.440149+0000","last_peered":"2023-12-16T03:26:20.440149+0000","last_clean":"2023-12-16T03:26:20.440149+0000","last_became_active":"2023-12-16T03:26:03.464404+0000","last_became_peered":"2023-12-16T03:26:03.464404+0000","last_unstale":"2023-12-16T03:26:20.440149+0000","last_undegraded":"2023-12-16T03:26:20.440149+0000","last_fullsized":"2023-12-16T03:26:20.440149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:03:34.552057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417865+0000","last_change":"2023-12-16T03:26:19.627153+0000","last_active":"2023-12-16T03:26:22.417865+0000","last_peered":"2023-12-16T03:26:22.417865+0000","last_clean":"2023-12-16T03:26:22.417865+0000","last_became_active":"2023-12-16T03:26:19.626881+0000","last_became_peered":"2023-12-16T03:26:19.626881+0000","last_unstale":"2023-12-16T03:26:22.417865+0000","last_undegraded":"2023-12-16T03:26:22.417865+0000","last_fullsized":"2023-12-16T03:26:22.417865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:30.194895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419840+0000","last_change":"2023-12-16T03:26:20.456281+0000","last_active":"2023-12-16T03:26:22.419840+0000","last_peered":"2023-12-16T03:26:22.419840+0000","last_clean":"2023-12-16T03:26:22.419840+0000","last_became_active":"2023-12-16T03:26:20.455939+0000","last_became_peered":"2023-12-16T03:26:20.455939+0000","last_unstale":"2023-12-16T03:26:22.419840+0000","last_undegraded":"2023-12-16T03:26:22.419840+0000","last_fullsized":"2023-12-16T03:26:22.419840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:12.620002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439880+0000","last_change":"2023-12-16T03:26:02.468837+0000","last_active":"2023-12-16T03:26:20.439880+0000","last_peered":"2023-12-16T03:26:20.439880+0000","last_clean":"2023-12-16T03:26:20.439880+0000","last_became_active":"2023-12-16T03:26:02.468492+0000","last_became_peered":"2023-12-16T03:26:02.468492+0000","last_unstale":"2023-12-16T03:26:20.439880+0000","last_undegraded":"2023-12-16T03:26:20.439880+0000","last_fullsized":"2023-12-16T03:26:20.439880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:51:41.152969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440301+0000","last_change":"2023-12-16T03:26:03.478083+0000","last_active":"2023-12-16T03:26:20.440301+0000","last_peered":"2023-12-16T03:26:20.440301+0000","last_clean":"2023-12-16T03:26:20.440301+0000","last_became_active":"2023-12-16T03:26:03.477716+0000","last_became_peered":"2023-12-16T03:26:03.477716+0000","last_unstale":"2023-12-16T03:26:20.440301+0000","last_undegraded":"2023-12-16T03:26:20.440301+0000","last_fullsized":"2023-12-16T03:26:20.440301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:57.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439872+0000","last_change":"2023-12-16T03:26:19.624459+0000","last_active":"2023-12-16T03:26:21.439872+0000","last_peered":"2023-12-16T03:26:21.439872+0000","last_clean":"2023-12-16T03:26:21.439872+0000","last_became_active":"2023-12-16T03:26:19.624025+0000","last_became_peered":"2023-12-16T03:26:19.624025+0000","last_unstale":"2023-12-16T03:26:21.439872+0000","last_undegraded":"2023-12-16T03:26:21.439872+0000","last_fullsized":"2023-12-16T03:26:21.439872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:52.017636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438213+0000","last_change":"2023-12-16T03:26:20.456022+0000","last_active":"2023-12-16T03:26:21.438213+0000","last_peered":"2023-12-16T03:26:21.438213+0000","last_clean":"2023-12-16T03:26:21.438213+0000","last_became_active":"2023-12-16T03:26:20.455422+0000","last_became_peered":"2023-12-16T03:26:20.455422+0000","last_unstale":"2023-12-16T03:26:21.438213+0000","last_undegraded":"2023-12-16T03:26:21.438213+0000","last_fullsized":"2023-12-16T03:26:21.438213+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:34.575757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439694+0000","last_change":"2023-12-16T03:26:02.462818+0000","last_active":"2023-12-16T03:26:20.439694+0000","last_peered":"2023-12-16T03:26:20.439694+0000","last_clean":"2023-12-16T03:26:20.439694+0000","last_became_active":"2023-12-16T03:26:02.462408+0000","last_became_peered":"2023-12-16T03:26:02.462408+0000","last_unstale":"2023-12-16T03:26:20.439694+0000","last_undegraded":"2023-12-16T03:26:20.439694+0000","last_fullsized":"2023-12-16T03:26:20.439694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:03:40.485273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436207+0000","last_change":"2023-12-16T03:26:03.467717+0000","last_active":"2023-12-16T03:26:20.436207+0000","last_peered":"2023-12-16T03:26:20.436207+0000","last_clean":"2023-12-16T03:26:20.436207+0000","last_became_active":"2023-12-16T03:26:03.467375+0000","last_became_peered":"2023-12-16T03:26:03.467375+0000","last_unstale":"2023-12-16T03:26:20.436207+0000","last_undegraded":"2023-12-16T03:26:20.436207+0000","last_fullsized":"2023-12-16T03:26:20.436207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:03.316544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438153+0000","last_change":"2023-12-16T03:26:19.617998+0000","last_active":"2023-12-16T03:26:21.438153+0000","last_peered":"2023-12-16T03:26:21.438153+0000","last_clean":"2023-12-16T03:26:21.438153+0000","last_became_active":"2023-12-16T03:26:19.617693+0000","last_became_peered":"2023-12-16T03:26:19.617693+0000","last_unstale":"2023-12-16T03:26:21.438153+0000","last_undegraded":"2023-12-16T03:26:21.438153+0000","last_fullsized":"2023-12-16T03:26:21.438153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:19.463912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419040+0000","last_change":"2023-12-16T03:26:20.465562+0000","last_active":"2023-12-16T03:26:22.419040+0000","last_peered":"2023-12-16T03:26:22.419040+0000","last_clean":"2023-12-16T03:26:22.419040+0000","last_became_active":"2023-12-16T03:26:20.464938+0000","last_became_peered":"2023-12-16T03:26:20.464938+0000","last_unstale":"2023-12-16T03:26:22.419040+0000","last_undegraded":"2023-12-16T03:26:22.419040+0000","last_fullsized":"2023-12-16T03:26:22.419040+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:40:35.259144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440602+0000","last_change":"2023-12-16T03:26:02.465496+0000","last_active":"2023-12-16T03:26:20.440602+0000","last_peered":"2023-12-16T03:26:20.440602+0000","last_clean":"2023-12-16T03:26:20.440602+0000","last_became_active":"2023-12-16T03:26:02.465106+0000","last_became_peered":"2023-12-16T03:26:02.465106+0000","last_unstale":"2023-12-16T03:26:20.440602+0000","last_undegraded":"2023-12-16T03:26:20.440602+0000","last_fullsized":"2023-12-16T03:26:20.440602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:47.788469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.451274+0000","last_change":"2023-12-16T03:26:03.468251+0000","last_active":"2023-12-16T03:26:20.451274+0000","last_peered":"2023-12-16T03:26:20.451274+0000","last_clean":"2023-12-16T03:26:20.451274+0000","last_became_active":"2023-12-16T03:26:03.467778+0000","last_became_peered":"2023-12-16T03:26:03.467778+0000","last_unstale":"2023-12-16T03:26:20.451274+0000","last_undegraded":"2023-12-16T03:26:20.451274+0000","last_fullsized":"2023-12-16T03:26:20.451274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:26.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418396+0000","last_change":"2023-12-16T03:26:19.607952+0000","last_active":"2023-12-16T03:26:22.418396+0000","last_peered":"2023-12-16T03:26:22.418396+0000","last_clean":"2023-12-16T03:26:22.418396+0000","last_became_active":"2023-12-16T03:26:19.607665+0000","last_became_peered":"2023-12-16T03:26:19.607665+0000","last_unstale":"2023-12-16T03:26:22.418396+0000","last_undegraded":"2023-12-16T03:26:22.418396+0000","last_fullsized":"2023-12-16T03:26:22.418396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:05:23.233712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418705+0000","last_change":"2023-12-16T03:26:20.465797+0000","last_active":"2023-12-16T03:26:22.418705+0000","last_peered":"2023-12-16T03:26:22.418705+0000","last_clean":"2023-12-16T03:26:22.418705+0000","last_became_active":"2023-12-16T03:26:20.465412+0000","last_became_peered":"2023-12-16T03:26:20.465412+0000","last_unstale":"2023-12-16T03:26:22.418705+0000","last_undegraded":"2023-12-16T03:26:22.418705+0000","last_fullsized":"2023-12-16T03:26:22.418705+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:23:05.990689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436794+0000","last_change":"2023-12-16T03:26:02.473227+0000","last_active":"2023-12-16T03:26:20.436794+0000","last_peered":"2023-12-16T03:26:20.436794+0000","last_clean":"2023-12-16T03:26:20.436794+0000","last_became_active":"2023-12-16T03:26:02.472888+0000","last_became_peered":"2023-12-16T03:26:02.472888+0000","last_unstale":"2023-12-16T03:26:20.436794+0000","last_undegraded":"2023-12-16T03:26:20.436794+0000","last_fullsized":"2023-12-16T03:26:20.436794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:33.338093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440523+0000","last_change":"2023-12-16T03:26:03.463781+0000","last_active":"2023-12-16T03:26:20.440523+0000","last_peered":"2023-12-16T03:26:20.440523+0000","last_clean":"2023-12-16T03:26:20.440523+0000","last_became_active":"2023-12-16T03:26:03.463448+0000","last_became_peered":"2023-12-16T03:26:03.463448+0000","last_unstale":"2023-12-16T03:26:20.440523+0000","last_undegraded":"2023-12-16T03:26:20.440523+0000","last_fullsized":"2023-12-16T03:26:20.440523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:54:09.793159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440509+0000","last_change":"2023-12-16T03:26:19.617206+0000","last_active":"2023-12-16T03:26:21.440509+0000","last_peered":"2023-12-16T03:26:21.440509+0000","last_clean":"2023-12-16T03:26:21.440509+0000","last_became_active":"2023-12-16T03:26:19.616070+0000","last_became_peered":"2023-12-16T03:26:19.616070+0000","last_unstale":"2023-12-16T03:26:21.440509+0000","last_undegraded":"2023-12-16T03:26:21.440509+0000","last_fullsized":"2023-12-16T03:26:21.440509+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:23:56.774020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419471+0000","last_change":"2023-12-16T03:26:20.452010+0000","last_active":"2023-12-16T03:26:22.419471+0000","last_peered":"2023-12-16T03:26:22.419471+0000","last_clean":"2023-12-16T03:26:22.419471+0000","last_became_active":"2023-12-16T03:26:20.451299+0000","last_became_peered":"2023-12-16T03:26:20.451299+0000","last_unstale":"2023-12-16T03:26:22.419471+0000","last_undegraded":"2023-12-16T03:26:22.419471+0000","last_fullsized":"2023-12-16T03:26:22.419471+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:13.539226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449567+0000","last_change":"2023-12-16T03:26:02.475063+0000","last_active":"2023-12-16T03:26:20.449567+0000","last_peered":"2023-12-16T03:26:20.449567+0000","last_clean":"2023-12-16T03:26:20.449567+0000","last_became_active":"2023-12-16T03:26:02.474759+0000","last_became_peered":"2023-12-16T03:26:02.474759+0000","last_unstale":"2023-12-16T03:26:20.449567+0000","last_undegraded":"2023-12-16T03:26:20.449567+0000","last_fullsized":"2023-12-16T03:26:20.449567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:20:29.012213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467844+0000","last_change":"2023-12-16T03:26:03.461431+0000","last_active":"2023-12-16T03:26:20.467844+0000","last_peered":"2023-12-16T03:26:20.467844+0000","last_clean":"2023-12-16T03:26:20.467844+0000","last_became_active":"2023-12-16T03:26:03.460669+0000","last_became_peered":"2023-12-16T03:26:03.460669+0000","last_unstale":"2023-12-16T03:26:20.467844+0000","last_undegraded":"2023-12-16T03:26:20.467844+0000","last_fullsized":"2023-12-16T03:26:20.467844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:05:14.653208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418852+0000","last_change":"2023-12-16T03:26:19.616483+0000","last_active":"2023-12-16T03:26:22.418852+0000","last_peered":"2023-12-16T03:26:22.418852+0000","last_clean":"2023-12-16T03:26:22.418852+0000","last_became_active":"2023-12-16T03:26:19.616075+0000","last_became_peered":"2023-12-16T03:26:19.616075+0000","last_unstale":"2023-12-16T03:26:22.418852+0000","last_undegraded":"2023-12-16T03:26:22.418852+0000","last_fullsized":"2023-12-16T03:26:22.418852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:50:55.667657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418416+0000","last_change":"2023-12-16T03:26:20.465602+0000","last_active":"2023-12-16T03:26:22.418416+0000","last_peered":"2023-12-16T03:26:22.418416+0000","last_clean":"2023-12-16T03:26:22.418416+0000","last_became_active":"2023-12-16T03:26:20.465128+0000","last_became_peered":"2023-12-16T03:26:20.465128+0000","last_unstale":"2023-12-16T03:26:22.418416+0000","last_undegraded":"2023-12-16T03:26:22.418416+0000","last_fullsized":"2023-12-16T03:26:22.418416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:09.665430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449402+0000","last_change":"2023-12-16T03:26:02.471444+0000","last_active":"2023-12-16T03:26:20.449402+0000","last_peered":"2023-12-16T03:26:20.449402+0000","last_clean":"2023-12-16T03:26:20.449402+0000","last_became_active":"2023-12-16T03:26:02.468577+0000","last_became_peered":"2023-12-16T03:26:02.468577+0000","last_unstale":"2023-12-16T03:26:20.449402+0000","last_undegraded":"2023-12-16T03:26:20.449402+0000","last_fullsized":"2023-12-16T03:26:20.449402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:01.713589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.437151+0000","last_change":"2023-12-16T03:26:03.470996+0000","last_active":"2023-12-16T03:26:20.437151+0000","last_peered":"2023-12-16T03:26:20.437151+0000","last_clean":"2023-12-16T03:26:20.437151+0000","last_became_active":"2023-12-16T03:26:03.465985+0000","last_became_peered":"2023-12-16T03:26:03.465985+0000","last_unstale":"2023-12-16T03:26:20.437151+0000","last_undegraded":"2023-12-16T03:26:20.437151+0000","last_fullsized":"2023-12-16T03:26:20.437151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:17.425373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418008+0000","last_change":"2023-12-16T03:26:19.623263+0000","last_active":"2023-12-16T03:26:22.418008+0000","last_peered":"2023-12-16T03:26:22.418008+0000","last_clean":"2023-12-16T03:26:22.418008+0000","last_became_active":"2023-12-16T03:26:19.622800+0000","last_became_peered":"2023-12-16T03:26:19.622800+0000","last_unstale":"2023-12-16T03:26:22.418008+0000","last_undegraded":"2023-12-16T03:26:22.418008+0000","last_fullsized":"2023-12-16T03:26:22.418008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:23.181079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418760+0000","last_change":"2023-12-16T03:26:20.469018+0000","last_active":"2023-12-16T03:26:22.418760+0000","last_peered":"2023-12-16T03:26:22.418760+0000","last_clean":"2023-12-16T03:26:22.418760+0000","last_became_active":"2023-12-16T03:26:20.468716+0000","last_became_peered":"2023-12-16T03:26:20.468716+0000","last_unstale":"2023-12-16T03:26:22.418760+0000","last_undegraded":"2023-12-16T03:26:22.418760+0000","last_fullsized":"2023-12-16T03:26:22.418760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:08:20.172514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.434817+0000","last_change":"2023-12-16T03:26:02.465815+0000","last_active":"2023-12-16T03:26:20.434817+0000","last_peered":"2023-12-16T03:26:20.434817+0000","last_clean":"2023-12-16T03:26:20.434817+0000","last_became_active":"2023-12-16T03:26:02.465505+0000","last_became_peered":"2023-12-16T03:26:02.465505+0000","last_unstale":"2023-12-16T03:26:20.434817+0000","last_undegraded":"2023-12-16T03:26:20.434817+0000","last_fullsized":"2023-12-16T03:26:20.434817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:50.926184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449230+0000","last_change":"2023-12-16T03:26:03.488277+0000","last_active":"2023-12-16T03:26:20.449230+0000","last_peered":"2023-12-16T03:26:20.449230+0000","last_clean":"2023-12-16T03:26:20.449230+0000","last_became_active":"2023-12-16T03:26:03.488021+0000","last_became_peered":"2023-12-16T03:26:03.488021+0000","last_unstale":"2023-12-16T03:26:20.449230+0000","last_undegraded":"2023-12-16T03:26:20.449230+0000","last_fullsized":"2023-12-16T03:26:20.449230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:02.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418222+0000","last_change":"2023-12-16T03:26:19.624536+0000","last_active":"2023-12-16T03:26:22.418222+0000","last_peered":"2023-12-16T03:26:22.418222+0000","last_clean":"2023-12-16T03:26:22.418222+0000","last_became_active":"2023-12-16T03:26:19.624198+0000","last_became_peered":"2023-12-16T03:26:19.624198+0000","last_unstale":"2023-12-16T03:26:22.418222+0000","last_undegraded":"2023-12-16T03:26:22.418222+0000","last_fullsized":"2023-12-16T03:26:22.418222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:55.024529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417501+0000","last_change":"2023-12-16T03:26:20.458063+0000","last_active":"2023-12-16T03:26:22.417501+0000","last_peered":"2023-12-16T03:26:22.417501+0000","last_clean":"2023-12-16T03:26:22.417501+0000","last_became_active":"2023-12-16T03:26:20.457750+0000","last_became_peered":"2023-12-16T03:26:20.457750+0000","last_unstale":"2023-12-16T03:26:22.417501+0000","last_undegraded":"2023-12-16T03:26:22.417501+0000","last_fullsized":"2023-12-16T03:26:22.417501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:46:24.768721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439563+0000","last_change":"2023-12-16T03:26:02.464973+0000","last_active":"2023-12-16T03:26:20.439563+0000","last_peered":"2023-12-16T03:26:20.439563+0000","last_clean":"2023-12-16T03:26:20.439563+0000","last_became_active":"2023-12-16T03:26:02.464672+0000","last_became_peered":"2023-12-16T03:26:02.464672+0000","last_unstale":"2023-12-16T03:26:20.439563+0000","last_undegraded":"2023-12-16T03:26:20.439563+0000","last_fullsized":"2023-12-16T03:26:20.439563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.434700+0000","last_change":"2023-12-16T03:26:03.478499+0000","last_active":"2023-12-16T03:26:20.434700+0000","last_peered":"2023-12-16T03:26:20.434700+0000","last_clean":"2023-12-16T03:26:20.434700+0000","last_became_active":"2023-12-16T03:26:03.478234+0000","last_became_peered":"2023-12-16T03:26:03.478234+0000","last_unstale":"2023-12-16T03:26:20.434700+0000","last_undegraded":"2023-12-16T03:26:20.434700+0000","last_fullsized":"2023-12-16T03:26:20.434700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:54:09.793159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419618+0000","last_change":"2023-12-16T03:26:19.619836+0000","last_active":"2023-12-16T03:26:22.419618+0000","last_peered":"2023-12-16T03:26:22.419618+0000","last_clean":"2023-12-16T03:26:22.419618+0000","last_became_active":"2023-12-16T03:26:19.619564+0000","last_became_peered":"2023-12-16T03:26:19.619564+0000","last_unstale":"2023-12-16T03:26:22.419618+0000","last_undegraded":"2023-12-16T03:26:22.419618+0000","last_fullsized":"2023-12-16T03:26:22.419618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:47.160233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419306+0000","last_change":"2023-12-16T03:26:20.459542+0000","last_active":"2023-12-16T03:26:22.419306+0000","last_peered":"2023-12-16T03:26:22.419306+0000","last_clean":"2023-12-16T03:26:22.419306+0000","last_became_active":"2023-12-16T03:26:20.459202+0000","last_became_peered":"2023-12-16T03:26:20.459202+0000","last_unstale":"2023-12-16T03:26:22.419306+0000","last_undegraded":"2023-12-16T03:26:22.419306+0000","last_fullsized":"2023-12-16T03:26:22.419306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:24.184095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"32'9","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453577+0000","last_change":"2023-12-16T03:26:02.474073+0000","last_active":"2023-12-16T03:26:20.453577+0000","last_peered":"2023-12-16T03:26:20.453577+0000","last_clean":"2023-12-16T03:26:20.453577+0000","last_became_active":"2023-12-16T03:26:02.473771+0000","last_became_peered":"2023-12-16T03:26:02.473771+0000","last_unstale":"2023-12-16T03:26:20.453577+0000","last_undegraded":"2023-12-16T03:26:20.453577+0000","last_fullsized":"2023-12-16T03:26:20.453577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:16.421435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450587+0000","last_change":"2023-12-16T03:26:03.464062+0000","last_active":"2023-12-16T03:26:20.450587+0000","last_peered":"2023-12-16T03:26:20.450587+0000","last_clean":"2023-12-16T03:26:20.450587+0000","last_became_active":"2023-12-16T03:26:03.463527+0000","last_became_peered":"2023-12-16T03:26:03.463527+0000","last_unstale":"2023-12-16T03:26:20.450587+0000","last_undegraded":"2023-12-16T03:26:20.450587+0000","last_fullsized":"2023-12-16T03:26:20.450587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:58:06.441852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419861+0000","last_change":"2023-12-16T03:26:19.624138+0000","last_active":"2023-12-16T03:26:22.419861+0000","last_peered":"2023-12-16T03:26:22.419861+0000","last_clean":"2023-12-16T03:26:22.419861+0000","last_became_active":"2023-12-16T03:26:19.623526+0000","last_became_peered":"2023-12-16T03:26:19.623526+0000","last_unstale":"2023-12-16T03:26:22.419861+0000","last_undegraded":"2023-12-16T03:26:22.419861+0000","last_fullsized":"2023-12-16T03:26:22.419861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:04.240531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439837+0000","last_change":"2023-12-16T03:26:20.456569+0000","last_active":"2023-12-16T03:26:21.439837+0000","last_peered":"2023-12-16T03:26:21.439837+0000","last_clean":"2023-12-16T03:26:21.439837+0000","last_became_active":"2023-12-16T03:26:20.455970+0000","last_became_peered":"2023-12-16T03:26:20.455970+0000","last_unstale":"2023-12-16T03:26:21.439837+0000","last_undegraded":"2023-12-16T03:26:21.439837+0000","last_fullsized":"2023-12-16T03:26:21.439837+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:04.033541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450754+0000","last_change":"2023-12-16T03:26:02.461467+0000","last_active":"2023-12-16T03:26:20.450754+0000","last_peered":"2023-12-16T03:26:20.450754+0000","last_clean":"2023-12-16T03:26:20.450754+0000","last_became_active":"2023-12-16T03:26:02.461144+0000","last_became_peered":"2023-12-16T03:26:02.461144+0000","last_unstale":"2023-12-16T03:26:20.450754+0000","last_undegraded":"2023-12-16T03:26:20.450754+0000","last_fullsized":"2023-12-16T03:26:20.450754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:02.312606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453436+0000","last_change":"2023-12-16T03:26:03.477196+0000","last_active":"2023-12-16T03:26:20.453436+0000","last_peered":"2023-12-16T03:26:20.453436+0000","last_clean":"2023-12-16T03:26:20.453436+0000","last_became_active":"2023-12-16T03:26:03.473620+0000","last_became_peered":"2023-12-16T03:26:03.473620+0000","last_unstale":"2023-12-16T03:26:20.453436+0000","last_undegraded":"2023-12-16T03:26:20.453436+0000","last_fullsized":"2023-12-16T03:26:20.453436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:57:09.113670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440019+0000","last_change":"2023-12-16T03:26:19.625092+0000","last_active":"2023-12-16T03:26:21.440019+0000","last_peered":"2023-12-16T03:26:21.440019+0000","last_clean":"2023-12-16T03:26:21.440019+0000","last_became_active":"2023-12-16T03:26:19.624783+0000","last_became_peered":"2023-12-16T03:26:19.624783+0000","last_unstale":"2023-12-16T03:26:21.440019+0000","last_undegraded":"2023-12-16T03:26:21.440019+0000","last_fullsized":"2023-12-16T03:26:21.440019+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:40:34.256128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419269+0000","last_change":"2023-12-16T03:26:20.448413+0000","last_active":"2023-12-16T03:26:22.419269+0000","last_peered":"2023-12-16T03:26:22.419269+0000","last_clean":"2023-12-16T03:26:22.419269+0000","last_became_active":"2023-12-16T03:26:20.447923+0000","last_became_peered":"2023-12-16T03:26:20.447923+0000","last_unstale":"2023-12-16T03:26:22.419269+0000","last_undegraded":"2023-12-16T03:26:22.419269+0000","last_fullsized":"2023-12-16T03:26:22.419269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:29.167009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443814+0000","last_change":"2023-12-16T03:26:02.449876+0000","last_active":"2023-12-16T03:26:20.443814+0000","last_peered":"2023-12-16T03:26:20.443814+0000","last_clean":"2023-12-16T03:26:20.443814+0000","last_became_active":"2023-12-16T03:26:02.449358+0000","last_became_peered":"2023-12-16T03:26:02.449358+0000","last_unstale":"2023-12-16T03:26:20.443814+0000","last_undegraded":"2023-12-16T03:26:20.443814+0000","last_fullsized":"2023-12-16T03:26:20.443814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:31.574264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453803+0000","last_change":"2023-12-16T03:26:03.477278+0000","last_active":"2023-12-16T03:26:20.453803+0000","last_peered":"2023-12-16T03:26:20.453803+0000","last_clean":"2023-12-16T03:26:20.453803+0000","last_became_active":"2023-12-16T03:26:03.476986+0000","last_became_peered":"2023-12-16T03:26:03.476986+0000","last_unstale":"2023-12-16T03:26:20.453803+0000","last_undegraded":"2023-12-16T03:26:20.453803+0000","last_fullsized":"2023-12-16T03:26:20.453803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:48.840305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.437914+0000","last_change":"2023-12-16T03:26:19.626506+0000","last_active":"2023-12-16T03:26:21.437914+0000","last_peered":"2023-12-16T03:26:21.437914+0000","last_clean":"2023-12-16T03:26:21.437914+0000","last_became_active":"2023-12-16T03:26:19.626121+0000","last_became_peered":"2023-12-16T03:26:19.626121+0000","last_unstale":"2023-12-16T03:26:21.437914+0000","last_undegraded":"2023-12-16T03:26:21.437914+0000","last_fullsized":"2023-12-16T03:26:21.437914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:06.753971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418305+0000","last_change":"2023-12-16T03:26:20.464292+0000","last_active":"2023-12-16T03:26:22.418305+0000","last_peered":"2023-12-16T03:26:22.418305+0000","last_clean":"2023-12-16T03:26:22.418305+0000","last_became_active":"2023-12-16T03:26:20.464032+0000","last_became_peered":"2023-12-16T03:26:20.464032+0000","last_unstale":"2023-12-16T03:26:22.418305+0000","last_undegraded":"2023-12-16T03:26:22.418305+0000","last_fullsized":"2023-12-16T03:26:22.418305+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:14:56.935089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453885+0000","last_change":"2023-12-16T03:26:02.468514+0000","last_active":"2023-12-16T03:26:20.453885+0000","last_peered":"2023-12-16T03:26:20.453885+0000","last_clean":"2023-12-16T03:26:20.453885+0000","last_became_active":"2023-12-16T03:26:02.467879+0000","last_became_peered":"2023-12-16T03:26:02.467879+0000","last_unstale":"2023-12-16T03:26:20.453885+0000","last_undegraded":"2023-12-16T03:26:20.453885+0000","last_fullsized":"2023-12-16T03:26:20.453885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:49:53.032485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.452784+0000","last_change":"2023-12-16T03:26:03.479982+0000","last_active":"2023-12-16T03:26:20.452784+0000","last_peered":"2023-12-16T03:26:20.452784+0000","last_clean":"2023-12-16T03:26:20.452784+0000","last_became_active":"2023-12-16T03:26:03.479683+0000","last_became_peered":"2023-12-16T03:26:03.479683+0000","last_unstale":"2023-12-16T03:26:20.452784+0000","last_undegraded":"2023-12-16T03:26:20.452784+0000","last_fullsized":"2023-12-16T03:26:20.452784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:02.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419518+0000","last_change":"2023-12-16T03:26:19.624445+0000","last_active":"2023-12-16T03:26:22.419518+0000","last_peered":"2023-12-16T03:26:22.419518+0000","last_clean":"2023-12-16T03:26:22.419518+0000","last_became_active":"2023-12-16T03:26:19.624069+0000","last_became_peered":"2023-12-16T03:26:19.624069+0000","last_unstale":"2023-12-16T03:26:22.419518+0000","last_undegraded":"2023-12-16T03:26:22.419518+0000","last_fullsized":"2023-12-16T03:26:22.419518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:17.854097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419300+0000","last_change":"2023-12-16T03:26:20.448920+0000","last_active":"2023-12-16T03:26:22.419300+0000","last_peered":"2023-12-16T03:26:22.419300+0000","last_clean":"2023-12-16T03:26:22.419300+0000","last_became_active":"2023-12-16T03:26:20.448642+0000","last_became_peered":"2023-12-16T03:26:20.448642+0000","last_unstale":"2023-12-16T03:26:22.419300+0000","last_undegraded":"2023-12-16T03:26:22.419300+0000","last_fullsized":"2023-12-16T03:26:22.419300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:18.857113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438831+0000","last_change":"2023-12-16T03:26:02.465231+0000","last_active":"2023-12-16T03:26:20.438831+0000","last_peered":"2023-12-16T03:26:20.438831+0000","last_clean":"2023-12-16T03:26:20.438831+0000","last_became_active":"2023-12-16T03:26:02.464573+0000","last_became_peered":"2023-12-16T03:26:02.464573+0000","last_unstale":"2023-12-16T03:26:20.438831+0000","last_undegraded":"2023-12-16T03:26:20.438831+0000","last_fullsized":"2023-12-16T03:26:20.438831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.434796+0000","last_change":"2023-12-16T03:26:03.471650+0000","last_active":"2023-12-16T03:26:20.434796+0000","last_peered":"2023-12-16T03:26:20.434796+0000","last_clean":"2023-12-16T03:26:20.434796+0000","last_became_active":"2023-12-16T03:26:03.471351+0000","last_became_peered":"2023-12-16T03:26:03.471351+0000","last_unstale":"2023-12-16T03:26:20.434796+0000","last_undegraded":"2023-12-16T03:26:20.434796+0000","last_fullsized":"2023-12-16T03:26:20.434796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:49.203240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439193+0000","last_change":"2023-12-16T03:26:19.626708+0000","last_active":"2023-12-16T03:26:21.439193+0000","last_peered":"2023-12-16T03:26:21.439193+0000","last_clean":"2023-12-16T03:26:21.439193+0000","last_became_active":"2023-12-16T03:26:19.626435+0000","last_became_peered":"2023-12-16T03:26:19.626435+0000","last_unstale":"2023-12-16T03:26:21.439193+0000","last_undegraded":"2023-12-16T03:26:21.439193+0000","last_fullsized":"2023-12-16T03:26:21.439193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:55.024529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439173+0000","last_change":"2023-12-16T03:26:20.468976+0000","last_active":"2023-12-16T03:26:21.439173+0000","last_peered":"2023-12-16T03:26:21.439173+0000","last_clean":"2023-12-16T03:26:21.439173+0000","last_became_active":"2023-12-16T03:26:20.468590+0000","last_became_peered":"2023-12-16T03:26:20.468590+0000","last_unstale":"2023-12-16T03:26:21.439173+0000","last_undegraded":"2023-12-16T03:26:21.439173+0000","last_fullsized":"2023-12-16T03:26:21.439173+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:31.197911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449282+0000","last_change":"2023-12-16T03:26:02.467098+0000","last_active":"2023-12-16T03:26:20.449282+0000","last_peered":"2023-12-16T03:26:20.449282+0000","last_clean":"2023-12-16T03:26:20.449282+0000","last_became_active":"2023-12-16T03:26:02.464042+0000","last_became_peered":"2023-12-16T03:26:02.464042+0000","last_unstale":"2023-12-16T03:26:20.449282+0000","last_undegraded":"2023-12-16T03:26:20.449282+0000","last_fullsized":"2023-12-16T03:26:20.449282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:02.312606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439139+0000","last_change":"2023-12-16T03:26:03.457030+0000","last_active":"2023-12-16T03:26:20.439139+0000","last_peered":"2023-12-16T03:26:20.439139+0000","last_clean":"2023-12-16T03:26:20.439139+0000","last_became_active":"2023-12-16T03:26:03.456705+0000","last_became_peered":"2023-12-16T03:26:03.456705+0000","last_unstale":"2023-12-16T03:26:20.439139+0000","last_undegraded":"2023-12-16T03:26:20.439139+0000","last_fullsized":"2023-12-16T03:26:20.439139+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:51.930122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417899+0000","last_change":"2023-12-16T03:26:19.618708+0000","last_active":"2023-12-16T03:26:22.417899+0000","last_peered":"2023-12-16T03:26:22.417899+0000","last_clean":"2023-12-16T03:26:22.417899+0000","last_became_active":"2023-12-16T03:26:19.618259+0000","last_became_peered":"2023-12-16T03:26:19.618259+0000","last_unstale":"2023-12-16T03:26:22.417899+0000","last_undegraded":"2023-12-16T03:26:22.417899+0000","last_fullsized":"2023-12-16T03:26:22.417899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:28.163993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418730+0000","last_change":"2023-12-16T03:26:20.469361+0000","last_active":"2023-12-16T03:26:22.418730+0000","last_peered":"2023-12-16T03:26:22.418730+0000","last_clean":"2023-12-16T03:26:22.418730+0000","last_became_active":"2023-12-16T03:26:20.468034+0000","last_became_peered":"2023-12-16T03:26:20.468034+0000","last_unstale":"2023-12-16T03:26:22.418730+0000","last_undegraded":"2023-12-16T03:26:22.418730+0000","last_fullsized":"2023-12-16T03:26:22.418730+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:56.027545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439567+0000","last_change":"2023-12-16T03:26:02.472832+0000","last_active":"2023-12-16T03:26:20.439567+0000","last_peered":"2023-12-16T03:26:20.439567+0000","last_clean":"2023-12-16T03:26:20.439567+0000","last_became_active":"2023-12-16T03:26:02.472574+0000","last_became_peered":"2023-12-16T03:26:02.472574+0000","last_unstale":"2023-12-16T03:26:20.439567+0000","last_undegraded":"2023-12-16T03:26:20.439567+0000","last_fullsized":"2023-12-16T03:26:20.439567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:19.149617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450780+0000","last_change":"2023-12-16T03:26:03.479561+0000","last_active":"2023-12-16T03:26:20.450780+0000","last_peered":"2023-12-16T03:26:20.450780+0000","last_clean":"2023-12-16T03:26:20.450780+0000","last_became_active":"2023-12-16T03:26:03.478239+0000","last_became_peered":"2023-12-16T03:26:03.478239+0000","last_unstale":"2023-12-16T03:26:20.450780+0000","last_undegraded":"2023-12-16T03:26:20.450780+0000","last_fullsized":"2023-12-16T03:26:20.450780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:54.768138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418132+0000","last_change":"2023-12-16T03:26:19.617290+0000","last_active":"2023-12-16T03:26:22.418132+0000","last_peered":"2023-12-16T03:26:22.418132+0000","last_clean":"2023-12-16T03:26:22.418132+0000","last_became_active":"2023-12-16T03:26:19.616895+0000","last_became_peered":"2023-12-16T03:26:19.616895+0000","last_unstale":"2023-12-16T03:26:22.418132+0000","last_undegraded":"2023-12-16T03:26:22.418132+0000","last_fullsized":"2023-12-16T03:26:22.418132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:23:04.987673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418047+0000","last_change":"2023-12-16T03:26:20.452871+0000","last_active":"2023-12-16T03:26:22.418047+0000","last_peered":"2023-12-16T03:26:22.418047+0000","last_clean":"2023-12-16T03:26:22.418047+0000","last_became_active":"2023-12-16T03:26:20.452589+0000","last_became_peered":"2023-12-16T03:26:20.452589+0000","last_unstale":"2023-12-16T03:26:22.418047+0000","last_undegraded":"2023-12-16T03:26:22.418047+0000","last_fullsized":"2023-12-16T03:26:22.418047+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:17.970880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439462+0000","last_change":"2023-12-16T03:26:02.469331+0000","last_active":"2023-12-16T03:26:20.439462+0000","last_peered":"2023-12-16T03:26:20.439462+0000","last_clean":"2023-12-16T03:26:20.439462+0000","last_became_active":"2023-12-16T03:26:02.469083+0000","last_became_peered":"2023-12-16T03:26:02.469083+0000","last_unstale":"2023-12-16T03:26:20.439462+0000","last_undegraded":"2023-12-16T03:26:20.439462+0000","last_fullsized":"2023-12-16T03:26:20.439462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:03:33.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438140+0000","last_change":"2023-12-16T03:26:03.469292+0000","last_active":"2023-12-16T03:26:20.438140+0000","last_peered":"2023-12-16T03:26:20.438140+0000","last_clean":"2023-12-16T03:26:20.438140+0000","last_became_active":"2023-12-16T03:26:03.468311+0000","last_became_peered":"2023-12-16T03:26:03.468311+0000","last_unstale":"2023-12-16T03:26:20.438140+0000","last_undegraded":"2023-12-16T03:26:20.438140+0000","last_fullsized":"2023-12-16T03:26:20.438140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:49:54.036423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438385+0000","last_change":"2023-12-16T03:26:19.615945+0000","last_active":"2023-12-16T03:26:21.438385+0000","last_peered":"2023-12-16T03:26:21.438385+0000","last_clean":"2023-12-16T03:26:21.438385+0000","last_became_active":"2023-12-16T03:26:19.615613+0000","last_became_peered":"2023-12-16T03:26:19.615613+0000","last_unstale":"2023-12-16T03:26:21.438385+0000","last_undegraded":"2023-12-16T03:26:21.438385+0000","last_fullsized":"2023-12-16T03:26:21.438385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:50:55.667657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419187+0000","last_change":"2023-12-16T03:26:20.465884+0000","last_active":"2023-12-16T03:26:22.419187+0000","last_peered":"2023-12-16T03:26:22.419187+0000","last_clean":"2023-12-16T03:26:22.419187+0000","last_became_active":"2023-12-16T03:26:20.465542+0000","last_became_peered":"2023-12-16T03:26:20.465542+0000","last_unstale":"2023-12-16T03:26:22.419187+0000","last_undegraded":"2023-12-16T03:26:22.419187+0000","last_fullsized":"2023-12-16T03:26:22.419187+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:31.461913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440019+0000","last_change":"2023-12-16T03:26:19.624375+0000","last_active":"2023-12-16T03:26:21.440019+0000","last_peered":"2023-12-16T03:26:21.440019+0000","last_clean":"2023-12-16T03:26:21.440019+0000","last_became_active":"2023-12-16T03:26:19.624022+0000","last_became_peered":"2023-12-16T03:26:19.624022+0000","last_unstale":"2023-12-16T03:26:21.440019+0000","last_undegraded":"2023-12-16T03:26:21.440019+0000","last_fullsized":"2023-12-16T03:26:21.440019+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:30.458897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440563+0000","last_change":"2023-12-16T03:26:02.473812+0000","last_active":"2023-12-16T03:26:20.440563+0000","last_peered":"2023-12-16T03:26:20.440563+0000","last_clean":"2023-12-16T03:26:20.440563+0000","last_became_active":"2023-12-16T03:26:02.473426+0000","last_became_peered":"2023-12-16T03:26:02.473426+0000","last_unstale":"2023-12-16T03:26:20.440563+0000","last_undegraded":"2023-12-16T03:26:20.440563+0000","last_fullsized":"2023-12-16T03:26:20.440563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:03:40.485273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436231+0000","last_change":"2023-12-16T03:26:03.472003+0000","last_active":"2023-12-16T03:26:20.436231+0000","last_peered":"2023-12-16T03:26:20.436231+0000","last_clean":"2023-12-16T03:26:20.436231+0000","last_became_active":"2023-12-16T03:26:03.468759+0000","last_became_peered":"2023-12-16T03:26:03.468759+0000","last_unstale":"2023-12-16T03:26:20.436231+0000","last_undegraded":"2023-12-16T03:26:20.436231+0000","last_fullsized":"2023-12-16T03:26:20.436231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:20:30.016150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.421167+0000","last_change":"2023-12-16T03:26:20.457713+0000","last_active":"2023-12-16T03:26:22.421167+0000","last_peered":"2023-12-16T03:26:22.421167+0000","last_clean":"2023-12-16T03:26:22.421167+0000","last_became_active":"2023-12-16T03:26:20.457476+0000","last_became_peered":"2023-12-16T03:26:20.457476+0000","last_unstale":"2023-12-16T03:26:22.421167+0000","last_undegraded":"2023-12-16T03:26:22.421167+0000","last_fullsized":"2023-12-16T03:26:22.421167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:53.020651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"35'4","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.420349+0000","last_change":"2023-12-16T03:26:19.609573+0000","last_active":"2023-12-16T03:26:22.420349+0000","last_peered":"2023-12-16T03:26:22.420349+0000","last_clean":"2023-12-16T03:26:22.420349+0000","last_became_active":"2023-12-16T03:26:19.609247+0000","last_became_peered":"2023-12-16T03:26:19.609247+0000","last_unstale":"2023-12-16T03:26:22.420349+0000","last_undegraded":"2023-12-16T03:26:22.420349+0000","last_fullsized":"2023-12-16T03:26:22.420349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:03:53.843632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453059+0000","last_change":"2023-12-16T03:26:02.475790+0000","last_active":"2023-12-16T03:26:20.453059+0000","last_peered":"2023-12-16T03:26:20.453059+0000","last_clean":"2023-12-16T03:26:20.453059+0000","last_became_active":"2023-12-16T03:26:02.475486+0000","last_became_peered":"2023-12-16T03:26:02.475486+0000","last_unstale":"2023-12-16T03:26:20.453059+0000","last_undegraded":"2023-12-16T03:26:20.453059+0000","last_fullsized":"2023-12-16T03:26:20.453059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:46.046497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439803+0000","last_change":"2023-12-16T03:26:03.459560+0000","last_active":"2023-12-16T03:26:20.439803+0000","last_peered":"2023-12-16T03:26:20.439803+0000","last_clean":"2023-12-16T03:26:20.439803+0000","last_became_active":"2023-12-16T03:26:03.459280+0000","last_became_peered":"2023-12-16T03:26:03.459280+0000","last_unstale":"2023-12-16T03:26:20.439803+0000","last_undegraded":"2023-12-16T03:26:20.439803+0000","last_fullsized":"2023-12-16T03:26:20.439803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:49.203240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.420891+0000","last_change":"2023-12-16T03:26:20.463003+0000","last_active":"2023-12-16T03:26:22.420891+0000","last_peered":"2023-12-16T03:26:22.420891+0000","last_clean":"2023-12-16T03:26:22.420891+0000","last_became_active":"2023-12-16T03:26:20.462747+0000","last_became_peered":"2023-12-16T03:26:20.462747+0000","last_unstale":"2023-12-16T03:26:22.420891+0000","last_undegraded":"2023-12-16T03:26:22.420891+0000","last_fullsized":"2023-12-16T03:26:22.420891+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:40:35.259144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443736+0000","last_change":"2023-12-16T03:26:02.464156+0000","last_active":"2023-12-16T03:26:20.443736+0000","last_peered":"2023-12-16T03:26:20.443736+0000","last_clean":"2023-12-16T03:26:20.443736+0000","last_became_active":"2023-12-16T03:26:02.463875+0000","last_became_peered":"2023-12-16T03:26:02.463875+0000","last_unstale":"2023-12-16T03:26:20.443736+0000","last_undegraded":"2023-12-16T03:26:20.443736+0000","last_fullsized":"2023-12-16T03:26:20.443736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467415+0000","last_change":"2023-12-16T03:26:03.470105+0000","last_active":"2023-12-16T03:26:20.467415+0000","last_peered":"2023-12-16T03:26:20.467415+0000","last_clean":"2023-12-16T03:26:20.467415+0000","last_became_active":"2023-12-16T03:26:03.469690+0000","last_became_peered":"2023-12-16T03:26:03.469690+0000","last_unstale":"2023-12-16T03:26:20.467415+0000","last_undegraded":"2023-12-16T03:26:20.467415+0000","last_fullsized":"2023-12-16T03:26:20.467415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:54.963780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419016+0000","last_change":"2023-12-16T03:26:19.620484+0000","last_active":"2023-12-16T03:26:22.419016+0000","last_peered":"2023-12-16T03:26:22.419016+0000","last_clean":"2023-12-16T03:26:22.419016+0000","last_became_active":"2023-12-16T03:26:19.620086+0000","last_became_peered":"2023-12-16T03:26:19.620086+0000","last_unstale":"2023-12-16T03:26:22.419016+0000","last_undegraded":"2023-12-16T03:26:22.419016+0000","last_fullsized":"2023-12-16T03:26:22.419016+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:16.967864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440451+0000","last_change":"2023-12-16T03:26:20.464891+0000","last_active":"2023-12-16T03:26:21.440451+0000","last_peered":"2023-12-16T03:26:21.440451+0000","last_clean":"2023-12-16T03:26:21.440451+0000","last_became_active":"2023-12-16T03:26:20.464534+0000","last_became_peered":"2023-12-16T03:26:20.464534+0000","last_unstale":"2023-12-16T03:26:21.440451+0000","last_undegraded":"2023-12-16T03:26:21.440451+0000","last_fullsized":"2023-12-16T03:26:21.440451+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:08:20.172514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467561+0000","last_change":"2023-12-16T03:26:02.466777+0000","last_active":"2023-12-16T03:26:20.467561+0000","last_peered":"2023-12-16T03:26:20.467561+0000","last_clean":"2023-12-16T03:26:20.467561+0000","last_became_active":"2023-12-16T03:26:02.466486+0000","last_became_peered":"2023-12-16T03:26:02.466486+0000","last_unstale":"2023-12-16T03:26:20.467561+0000","last_undegraded":"2023-12-16T03:26:20.467561+0000","last_fullsized":"2023-12-16T03:26:20.467561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443648+0000","last_change":"2023-12-16T03:26:03.480845+0000","last_active":"2023-12-16T03:26:20.443648+0000","last_peered":"2023-12-16T03:26:20.443648+0000","last_clean":"2023-12-16T03:26:20.443648+0000","last_became_active":"2023-12-16T03:26:03.477465+0000","last_became_peered":"2023-12-16T03:26:03.477465+0000","last_unstale":"2023-12-16T03:26:20.443648+0000","last_undegraded":"2023-12-16T03:26:20.443648+0000","last_fullsized":"2023-12-16T03:26:20.443648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:54.963780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.421313+0000","last_change":"2023-12-16T03:26:19.616156+0000","last_active":"2023-12-16T03:26:22.421313+0000","last_peered":"2023-12-16T03:26:22.421313+0000","last_clean":"2023-12-16T03:26:22.421313+0000","last_became_active":"2023-12-16T03:26:19.615909+0000","last_became_peered":"2023-12-16T03:26:19.615909+0000","last_unstale":"2023-12-16T03:26:22.421313+0000","last_undegraded":"2023-12-16T03:26:22.421313+0000","last_fullsized":"2023-12-16T03:26:22.421313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:00.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438994+0000","last_change":"2023-12-16T03:26:20.455289+0000","last_active":"2023-12-16T03:26:21.438994+0000","last_peered":"2023-12-16T03:26:21.438994+0000","last_clean":"2023-12-16T03:26:21.438994+0000","last_became_active":"2023-12-16T03:26:20.454862+0000","last_became_peered":"2023-12-16T03:26:20.454862+0000","last_unstale":"2023-12-16T03:26:21.438994+0000","last_undegraded":"2023-12-16T03:26:21.438994+0000","last_fullsized":"2023-12-16T03:26:21.438994+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:41:24.758954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.437068+0000","last_change":"2023-12-16T03:26:03.466192+0000","last_active":"2023-12-16T03:26:20.437068+0000","last_peered":"2023-12-16T03:26:20.437068+0000","last_clean":"2023-12-16T03:26:20.437068+0000","last_became_active":"2023-12-16T03:26:03.465781+0000","last_became_peered":"2023-12-16T03:26:03.465781+0000","last_unstale":"2023-12-16T03:26:20.437068+0000","last_undegraded":"2023-12-16T03:26:20.437068+0000","last_fullsized":"2023-12-16T03:26:20.437068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:54.768138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418395+0000","last_change":"2023-12-16T03:26:20.467127+0000","last_active":"2023-12-16T03:26:22.418395+0000","last_peered":"2023-12-16T03:26:22.418395+0000","last_clean":"2023-12-16T03:26:22.418395+0000","last_became_active":"2023-12-16T03:26:20.462881+0000","last_became_peered":"2023-12-16T03:26:20.462881+0000","last_unstale":"2023-12-16T03:26:22.418395+0000","last_undegraded":"2023-12-16T03:26:22.418395+0000","last_fullsized":"2023-12-16T03:26:22.418395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:57:26.264054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467562+0000","last_change":"2023-12-16T03:26:03.469300+0000","last_active":"2023-12-16T03:26:20.467562+0000","last_peered":"2023-12-16T03:26:20.467562+0000","last_clean":"2023-12-16T03:26:20.467562+0000","last_became_active":"2023-12-16T03:26:03.468972+0000","last_became_peered":"2023-12-16T03:26:03.468972+0000","last_unstale":"2023-12-16T03:26:20.467562+0000","last_undegraded":"2023-12-16T03:26:20.467562+0000","last_fullsized":"2023-12-16T03:26:20.467562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:51.930122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.437592+0000","last_change":"2023-12-16T03:26:20.442113+0000","last_active":"2023-12-16T03:26:21.437592+0000","last_peered":"2023-12-16T03:26:21.437592+0000","last_clean":"2023-12-16T03:26:21.437592+0000","last_became_active":"2023-12-16T03:26:20.441831+0000","last_became_peered":"2023-12-16T03:26:20.441831+0000","last_unstale":"2023-12-16T03:26:21.437592+0000","last_undegraded":"2023-12-16T03:26:21.437592+0000","last_fullsized":"2023-12-16T03:26:21.437592+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:20:47.166534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.437992+0000","last_change":"2023-12-16T03:26:03.469084+0000","last_active":"2023-12-16T03:26:20.437992+0000","last_peered":"2023-12-16T03:26:20.437992+0000","last_clean":"2023-12-16T03:26:20.437992+0000","last_became_active":"2023-12-16T03:26:03.467963+0000","last_became_peered":"2023-12-16T03:26:03.467963+0000","last_unstale":"2023-12-16T03:26:20.437992+0000","last_undegraded":"2023-12-16T03:26:20.437992+0000","last_fullsized":"2023-12-16T03:26:20.437992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:47.050435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419532+0000","last_change":"2023-12-16T03:26:20.462683+0000","last_active":"2023-12-16T03:26:22.419532+0000","last_peered":"2023-12-16T03:26:22.419532+0000","last_clean":"2023-12-16T03:26:22.419532+0000","last_became_active":"2023-12-16T03:26:20.462383+0000","last_became_peered":"2023-12-16T03:26:20.462383+0000","last_unstale":"2023-12-16T03:26:22.419532+0000","last_undegraded":"2023-12-16T03:26:22.419532+0000","last_fullsized":"2023-12-16T03:26:22.419532+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:09.871179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439350+0000","last_change":"2023-12-16T03:26:03.461340+0000","last_active":"2023-12-16T03:26:20.439350+0000","last_peered":"2023-12-16T03:26:20.439350+0000","last_clean":"2023-12-16T03:26:20.439350+0000","last_became_active":"2023-12-16T03:26:03.459869+0000","last_became_peered":"2023-12-16T03:26:03.459869+0000","last_unstale":"2023-12-16T03:26:20.439350+0000","last_undegraded":"2023-12-16T03:26:20.439350+0000","last_fullsized":"2023-12-16T03:26:20.439350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:54.963780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438095+0000","last_change":"2023-12-16T03:26:20.456191+0000","last_active":"2023-12-16T03:26:21.438095+0000","last_peered":"2023-12-16T03:26:21.438095+0000","last_clean":"2023-12-16T03:26:21.438095+0000","last_became_active":"2023-12-16T03:26:20.455761+0000","last_became_peered":"2023-12-16T03:26:20.455761+0000","last_unstale":"2023-12-16T03:26:21.438095+0000","last_undegraded":"2023-12-16T03:26:21.438095+0000","last_fullsized":"2023-12-16T03:26:21.438095+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:11.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.451783+0000","last_change":"2023-12-16T03:26:03.460615+0000","last_active":"2023-12-16T03:26:20.451783+0000","last_peered":"2023-12-16T03:26:20.451783+0000","last_clean":"2023-12-16T03:26:20.451783+0000","last_became_active":"2023-12-16T03:26:03.460298+0000","last_became_peered":"2023-12-16T03:26:03.460298+0000","last_unstale":"2023-12-16T03:26:20.451783+0000","last_undegraded":"2023-12-16T03:26:20.451783+0000","last_fullsized":"2023-12-16T03:26:20.451783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:17.425373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419416+0000","last_change":"2023-12-16T03:26:20.465570+0000","last_active":"2023-12-16T03:26:22.419416+0000","last_peered":"2023-12-16T03:26:22.419416+0000","last_clean":"2023-12-16T03:26:22.419416+0000","last_became_active":"2023-12-16T03:26:20.465184+0000","last_became_peered":"2023-12-16T03:26:20.465184+0000","last_unstale":"2023-12-16T03:26:22.419416+0000","last_undegraded":"2023-12-16T03:26:22.419416+0000","last_fullsized":"2023-12-16T03:26:22.419416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:41:24.758954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436308+0000","last_change":"2023-12-16T03:26:03.470354+0000","last_active":"2023-12-16T03:26:20.436308+0000","last_peered":"2023-12-16T03:26:20.436308+0000","last_clean":"2023-12-16T03:26:20.436308+0000","last_became_active":"2023-12-16T03:26:03.469032+0000","last_became_peered":"2023-12-16T03:26:03.469032+0000","last_unstale":"2023-12-16T03:26:20.436308+0000","last_undegraded":"2023-12-16T03:26:20.436308+0000","last_fullsized":"2023-12-16T03:26:20.436308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:02.717527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439328+0000","last_change":"2023-12-16T03:26:20.461274+0000","last_active":"2023-12-16T03:26:21.439328+0000","last_peered":"2023-12-16T03:26:21.439328+0000","last_clean":"2023-12-16T03:26:21.439328+0000","last_became_active":"2023-12-16T03:26:20.460983+0000","last_became_peered":"2023-12-16T03:26:20.460983+0000","last_unstale":"2023-12-16T03:26:21.439328+0000","last_undegraded":"2023-12-16T03:26:21.439328+0000","last_fullsized":"2023-12-16T03:26:21.439328+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:05.145337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453682+0000","last_change":"2023-12-16T03:26:03.480845+0000","last_active":"2023-12-16T03:26:20.453682+0000","last_peered":"2023-12-16T03:26:20.453682+0000","last_clean":"2023-12-16T03:26:20.453682+0000","last_became_active":"2023-12-16T03:26:03.480622+0000","last_became_peered":"2023-12-16T03:26:03.480622+0000","last_unstale":"2023-12-16T03:26:20.453682+0000","last_undegraded":"2023-12-16T03:26:20.453682+0000","last_fullsized":"2023-12-16T03:26:20.453682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:38.877161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439742+0000","last_change":"2023-12-16T03:26:20.452159+0000","last_active":"2023-12-16T03:26:21.439742+0000","last_peered":"2023-12-16T03:26:21.439742+0000","last_clean":"2023-12-16T03:26:21.439742+0000","last_became_active":"2023-12-16T03:26:20.451739+0000","last_became_peered":"2023-12-16T03:26:20.451739+0000","last_unstale":"2023-12-16T03:26:21.439742+0000","last_undegraded":"2023-12-16T03:26:21.439742+0000","last_fullsized":"2023-12-16T03:26:21.439742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:17.970880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436623+0000","last_change":"2023-12-16T03:26:03.480210+0000","last_active":"2023-12-16T03:26:20.436623+0000","last_peered":"2023-12-16T03:26:20.436623+0000","last_clean":"2023-12-16T03:26:20.436623+0000","last_became_active":"2023-12-16T03:26:03.479763+0000","last_became_peered":"2023-12-16T03:26:03.479763+0000","last_unstale":"2023-12-16T03:26:20.436623+0000","last_undegraded":"2023-12-16T03:26:20.436623+0000","last_fullsized":"2023-12-16T03:26:20.436623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:47.050435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418927+0000","last_change":"2023-12-16T03:26:20.469284+0000","last_active":"2023-12-16T03:26:22.418927+0000","last_peered":"2023-12-16T03:26:22.418927+0000","last_clean":"2023-12-16T03:26:22.418927+0000","last_became_active":"2023-12-16T03:26:20.468993+0000","last_became_peered":"2023-12-16T03:26:20.468993+0000","last_unstale":"2023-12-16T03:26:22.418927+0000","last_undegraded":"2023-12-16T03:26:22.418927+0000","last_fullsized":"2023-12-16T03:26:22.418927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:45.953347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449095+0000","last_change":"2023-12-16T03:26:03.466573+0000","last_active":"2023-12-16T03:26:20.449095+0000","last_peered":"2023-12-16T03:26:20.449095+0000","last_clean":"2023-12-16T03:26:20.449095+0000","last_became_active":"2023-12-16T03:26:03.463565+0000","last_became_peered":"2023-12-16T03:26:03.463565+0000","last_unstale":"2023-12-16T03:26:20.449095+0000","last_undegraded":"2023-12-16T03:26:20.449095+0000","last_fullsized":"2023-12-16T03:26:20.449095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:47.050435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418526+0000","last_change":"2023-12-16T03:26:20.469221+0000","last_active":"2023-12-16T03:26:22.418526+0000","last_peered":"2023-12-16T03:26:22.418526+0000","last_clean":"2023-12-16T03:26:22.418526+0000","last_became_active":"2023-12-16T03:26:20.468917+0000","last_became_peered":"2023-12-16T03:26:20.468917+0000","last_unstale":"2023-12-16T03:26:22.418526+0000","last_undegraded":"2023-12-16T03:26:22.418526+0000","last_fullsized":"2023-12-16T03:26:22.418526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:48:18.383266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443788+0000","last_change":"2023-12-16T03:26:03.472522+0000","last_active":"2023-12-16T03:26:20.443788+0000","last_peered":"2023-12-16T03:26:20.443788+0000","last_clean":"2023-12-16T03:26:20.443788+0000","last_became_active":"2023-12-16T03:26:03.472310+0000","last_became_peered":"2023-12-16T03:26:03.472310+0000","last_unstale":"2023-12-16T03:26:20.443788+0000","last_undegraded":"2023-12-16T03:26:20.443788+0000","last_fullsized":"2023-12-16T03:26:20.443788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:02.166310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418638+0000","last_change":"2023-12-16T03:26:20.450772+0000","last_active":"2023-12-16T03:26:22.418638+0000","last_peered":"2023-12-16T03:26:22.418638+0000","last_clean":"2023-12-16T03:26:22.418638+0000","last_became_active":"2023-12-16T03:26:20.450480+0000","last_became_peered":"2023-12-16T03:26:20.450480+0000","last_unstale":"2023-12-16T03:26:22.418638+0000","last_undegraded":"2023-12-16T03:26:22.418638+0000","last_fullsized":"2023-12-16T03:26:22.418638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:23:43.590720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439273+0000","last_change":"2023-12-16T03:26:03.476899+0000","last_active":"2023-12-16T03:26:20.439273+0000","last_peered":"2023-12-16T03:26:20.439273+0000","last_clean":"2023-12-16T03:26:20.439273+0000","last_became_active":"2023-12-16T03:26:03.476444+0000","last_became_peered":"2023-12-16T03:26:03.476444+0000","last_unstale":"2023-12-16T03:26:20.439273+0000","last_undegraded":"2023-12-16T03:26:20.439273+0000","last_fullsized":"2023-12-16T03:26:20.439273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:02.166310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419168+0000","last_change":"2023-12-16T03:26:20.468134+0000","last_active":"2023-12-16T03:26:22.419168+0000","last_peered":"2023-12-16T03:26:22.419168+0000","last_clean":"2023-12-16T03:26:22.419168+0000","last_became_active":"2023-12-16T03:26:20.462895+0000","last_became_peered":"2023-12-16T03:26:20.462895+0000","last_unstale":"2023-12-16T03:26:22.419168+0000","last_undegraded":"2023-12-16T03:26:22.419168+0000","last_fullsized":"2023-12-16T03:26:22.419168+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:53.020651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439258+0000","last_change":"2023-12-16T03:26:03.485028+0000","last_active":"2023-12-16T03:26:20.439258+0000","last_peered":"2023-12-16T03:26:20.439258+0000","last_clean":"2023-12-16T03:26:20.439258+0000","last_became_active":"2023-12-16T03:26:03.484817+0000","last_became_peered":"2023-12-16T03:26:03.484817+0000","last_unstale":"2023-12-16T03:26:20.439258+0000","last_undegraded":"2023-12-16T03:26:20.439258+0000","last_fullsized":"2023-12-16T03:26:20.439258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:34.342031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439596+0000","last_change":"2023-12-16T03:26:20.456777+0000","last_active":"2023-12-16T03:26:21.439596+0000","last_peered":"2023-12-16T03:26:21.439596+0000","last_clean":"2023-12-16T03:26:21.439596+0000","last_became_active":"2023-12-16T03:26:20.456365+0000","last_became_peered":"2023-12-16T03:26:20.456365+0000","last_unstale":"2023-12-16T03:26:21.439596+0000","last_undegraded":"2023-12-16T03:26:21.439596+0000","last_fullsized":"2023-12-16T03:26:21.439596+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:50:56.670673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440450+0000","last_change":"2023-12-16T03:26:03.471216+0000","last_active":"2023-12-16T03:26:20.440450+0000","last_peered":"2023-12-16T03:26:20.440450+0000","last_clean":"2023-12-16T03:26:20.440450+0000","last_became_active":"2023-12-16T03:26:03.470906+0000","last_became_peered":"2023-12-16T03:26:03.470906+0000","last_unstale":"2023-12-16T03:26:20.440450+0000","last_undegraded":"2023-12-16T03:26:20.440450+0000","last_fullsized":"2023-12-16T03:26:20.440450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:23:52.462412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439966+0000","last_change":"2023-12-16T03:26:20.457998+0000","last_active":"2023-12-16T03:26:21.439966+0000","last_peered":"2023-12-16T03:26:21.439966+0000","last_clean":"2023-12-16T03:26:21.439966+0000","last_became_active":"2023-12-16T03:26:20.457697+0000","last_became_peered":"2023-12-16T03:26:20.457697+0000","last_unstale":"2023-12-16T03:26:21.439966+0000","last_undegraded":"2023-12-16T03:26:21.439966+0000","last_fullsized":"2023-12-16T03:26:21.439966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:45.953347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.452953+0000","last_change":"2023-12-16T03:26:03.483084+0000","last_active":"2023-12-16T03:26:20.452953+0000","last_peered":"2023-12-16T03:26:20.452953+0000","last_clean":"2023-12-16T03:26:20.452953+0000","last_became_active":"2023-12-16T03:26:03.479314+0000","last_became_peered":"2023-12-16T03:26:03.479314+0000","last_unstale":"2023-12-16T03:26:20.452953+0000","last_undegraded":"2023-12-16T03:26:20.452953+0000","last_fullsized":"2023-12-16T03:26:20.452953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:54.768138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.437915+0000","last_change":"2023-12-16T03:26:20.448192+0000","last_active":"2023-12-16T03:26:21.437915+0000","last_peered":"2023-12-16T03:26:21.437915+0000","last_clean":"2023-12-16T03:26:21.437915+0000","last_became_active":"2023-12-16T03:26:20.447961+0000","last_became_peered":"2023-12-16T03:26:20.447961+0000","last_unstale":"2023-12-16T03:26:21.437915+0000","last_undegraded":"2023-12-16T03:26:21.437915+0000","last_fullsized":"2023-12-16T03:26:21.437915+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:33:04.200819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.454299+0000","last_change":"2023-12-16T03:26:03.478015+0000","last_active":"2023-12-16T03:26:20.454299+0000","last_peered":"2023-12-16T03:26:20.454299+0000","last_clean":"2023-12-16T03:26:20.454299+0000","last_became_active":"2023-12-16T03:26:03.477762+0000","last_became_peered":"2023-12-16T03:26:03.477762+0000","last_unstale":"2023-12-16T03:26:20.454299+0000","last_undegraded":"2023-12-16T03:26:20.454299+0000","last_fullsized":"2023-12-16T03:26:20.454299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:23:26.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418815+0000","last_change":"2023-12-16T03:26:20.467576+0000","last_active":"2023-12-16T03:26:22.418815+0000","last_peered":"2023-12-16T03:26:22.418815+0000","last_clean":"2023-12-16T03:26:22.418815+0000","last_became_active":"2023-12-16T03:26:20.467063+0000","last_became_peered":"2023-12-16T03:26:20.467063+0000","last_unstale":"2023-12-16T03:26:22.418815+0000","last_undegraded":"2023-12-16T03:26:22.418815+0000","last_fullsized":"2023-12-16T03:26:22.418815+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:01.314003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443857+0000","last_change":"2023-12-16T03:26:03.470602+0000","last_active":"2023-12-16T03:26:20.443857+0000","last_peered":"2023-12-16T03:26:20.443857+0000","last_clean":"2023-12-16T03:26:20.443857+0000","last_became_active":"2023-12-16T03:26:03.465595+0000","last_became_peered":"2023-12-16T03:26:03.465595+0000","last_unstale":"2023-12-16T03:26:20.443857+0000","last_undegraded":"2023-12-16T03:26:20.443857+0000","last_fullsized":"2023-12-16T03:26:20.443857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:02.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418803+0000","last_change":"2023-12-16T03:26:20.444529+0000","last_active":"2023-12-16T03:26:22.418803+0000","last_peered":"2023-12-16T03:26:22.418803+0000","last_clean":"2023-12-16T03:26:22.418803+0000","last_became_active":"2023-12-16T03:26:20.444267+0000","last_became_peered":"2023-12-16T03:26:20.444267+0000","last_unstale":"2023-12-16T03:26:22.418803+0000","last_undegraded":"2023-12-16T03:26:22.418803+0000","last_fullsized":"2023-12-16T03:26:22.418803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:04.033541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.437490+0000","last_change":"2023-12-16T03:26:03.475298+0000","last_active":"2023-12-16T03:26:20.437490+0000","last_peered":"2023-12-16T03:26:20.437490+0000","last_clean":"2023-12-16T03:26:20.437490+0000","last_became_active":"2023-12-16T03:26:03.475023+0000","last_became_peered":"2023-12-16T03:26:03.475023+0000","last_unstale":"2023-12-16T03:26:20.437490+0000","last_undegraded":"2023-12-16T03:26:20.437490+0000","last_fullsized":"2023-12-16T03:26:20.437490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:47:58.231120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.437721+0000","last_change":"2023-12-16T03:26:20.458714+0000","last_active":"2023-12-16T03:26:21.437721+0000","last_peered":"2023-12-16T03:26:21.437721+0000","last_clean":"2023-12-16T03:26:21.437721+0000","last_became_active":"2023-12-16T03:26:20.456810+0000","last_became_peered":"2023-12-16T03:26:20.456810+0000","last_unstale":"2023-12-16T03:26:21.437721+0000","last_undegraded":"2023-12-16T03:26:21.437721+0000","last_fullsized":"2023-12-16T03:26:21.437721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:05.900996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450362+0000","last_change":"2023-12-16T03:26:03.461119+0000","last_active":"2023-12-16T03:26:20.450362+0000","last_peered":"2023-12-16T03:26:20.450362+0000","last_clean":"2023-12-16T03:26:20.450362+0000","last_became_active":"2023-12-16T03:26:03.460789+0000","last_became_peered":"2023-12-16T03:26:03.460789+0000","last_unstale":"2023-12-16T03:26:20.450362+0000","last_undegraded":"2023-12-16T03:26:20.450362+0000","last_fullsized":"2023-12-16T03:26:20.450362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:49:54.036423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418139+0000","last_change":"2023-12-16T03:26:20.461543+0000","last_active":"2023-12-16T03:26:22.418139+0000","last_peered":"2023-12-16T03:26:22.418139+0000","last_clean":"2023-12-16T03:26:22.418139+0000","last_became_active":"2023-12-16T03:26:20.461056+0000","last_became_peered":"2023-12-16T03:26:20.461056+0000","last_unstale":"2023-12-16T03:26:22.418139+0000","last_undegraded":"2023-12-16T03:26:22.418139+0000","last_fullsized":"2023-12-16T03:26:22.418139+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:11.918523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450586+0000","last_change":"2023-12-16T03:26:03.475323+0000","last_active":"2023-12-16T03:26:20.450586+0000","last_peered":"2023-12-16T03:26:20.450586+0000","last_clean":"2023-12-16T03:26:20.450586+0000","last_became_active":"2023-12-16T03:26:03.475008+0000","last_became_peered":"2023-12-16T03:26:03.475008+0000","last_unstale":"2023-12-16T03:26:20.450586+0000","last_undegraded":"2023-12-16T03:26:20.450586+0000","last_fullsized":"2023-12-16T03:26:20.450586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:21.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419386+0000","last_change":"2023-12-16T03:26:20.462766+0000","last_active":"2023-12-16T03:26:22.419386+0000","last_peered":"2023-12-16T03:26:22.419386+0000","last_clean":"2023-12-16T03:26:22.419386+0000","last_became_active":"2023-12-16T03:26:20.462493+0000","last_became_peered":"2023-12-16T03:26:20.462493+0000","last_unstale":"2023-12-16T03:26:22.419386+0000","last_undegraded":"2023-12-16T03:26:22.419386+0000","last_fullsized":"2023-12-16T03:26:22.419386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:02.113387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440357+0000","last_change":"2023-12-16T03:26:03.465388+0000","last_active":"2023-12-16T03:26:20.440357+0000","last_peered":"2023-12-16T03:26:20.440357+0000","last_clean":"2023-12-16T03:26:20.440357+0000","last_became_active":"2023-12-16T03:26:03.464429+0000","last_became_peered":"2023-12-16T03:26:03.464429+0000","last_unstale":"2023-12-16T03:26:20.440357+0000","last_undegraded":"2023-12-16T03:26:20.440357+0000","last_fullsized":"2023-12-16T03:26:20.440357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:58.471344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419765+0000","last_change":"2023-12-16T03:26:20.462164+0000","last_active":"2023-12-16T03:26:22.419765+0000","last_peered":"2023-12-16T03:26:22.419765+0000","last_clean":"2023-12-16T03:26:22.419765+0000","last_became_active":"2023-12-16T03:26:20.461818+0000","last_became_peered":"2023-12-16T03:26:20.461818+0000","last_unstale":"2023-12-16T03:26:22.419765+0000","last_undegraded":"2023-12-16T03:26:22.419765+0000","last_fullsized":"2023-12-16T03:26:22.419765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:05.145337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.451701+0000","last_change":"2023-12-16T03:26:03.479988+0000","last_active":"2023-12-16T03:26:20.451701+0000","last_peered":"2023-12-16T03:26:20.451701+0000","last_clean":"2023-12-16T03:26:20.451701+0000","last_became_active":"2023-12-16T03:26:03.479695+0000","last_became_peered":"2023-12-16T03:26:03.479695+0000","last_unstale":"2023-12-16T03:26:20.451701+0000","last_undegraded":"2023-12-16T03:26:20.451701+0000","last_fullsized":"2023-12-16T03:26:20.451701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:21.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419669+0000","last_change":"2023-12-16T03:26:20.445788+0000","last_active":"2023-12-16T03:26:22.419669+0000","last_peered":"2023-12-16T03:26:22.419669+0000","last_clean":"2023-12-16T03:26:22.419669+0000","last_became_active":"2023-12-16T03:26:20.445578+0000","last_became_peered":"2023-12-16T03:26:20.445578+0000","last_unstale":"2023-12-16T03:26:22.419669+0000","last_undegraded":"2023-12-16T03:26:22.419669+0000","last_fullsized":"2023-12-16T03:26:22.419669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:48.940939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.442663+0000","last_change":"2023-12-16T03:26:03.470445+0000","last_active":"2023-12-16T03:26:20.442663+0000","last_peered":"2023-12-16T03:26:20.442663+0000","last_clean":"2023-12-16T03:26:20.442663+0000","last_became_active":"2023-12-16T03:26:03.470102+0000","last_became_peered":"2023-12-16T03:26:03.470102+0000","last_unstale":"2023-12-16T03:26:20.442663+0000","last_undegraded":"2023-12-16T03:26:20.442663+0000","last_fullsized":"2023-12-16T03:26:20.442663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:26.451963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439192+0000","last_change":"2023-12-16T03:26:20.460794+0000","last_active":"2023-12-16T03:26:21.439192+0000","last_peered":"2023-12-16T03:26:21.439192+0000","last_clean":"2023-12-16T03:26:21.439192+0000","last_became_active":"2023-12-16T03:26:20.460456+0000","last_became_peered":"2023-12-16T03:26:20.460456+0000","last_unstale":"2023-12-16T03:26:21.439192+0000","last_undegraded":"2023-12-16T03:26:21.439192+0000","last_fullsized":"2023-12-16T03:26:21.439192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:48.940939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436328+0000","last_change":"2023-12-16T03:26:03.484306+0000","last_active":"2023-12-16T03:26:20.436328+0000","last_peered":"2023-12-16T03:26:20.436328+0000","last_clean":"2023-12-16T03:26:20.436328+0000","last_became_active":"2023-12-16T03:26:03.484039+0000","last_became_peered":"2023-12-16T03:26:03.484039+0000","last_unstale":"2023-12-16T03:26:20.436328+0000","last_undegraded":"2023-12-16T03:26:20.436328+0000","last_fullsized":"2023-12-16T03:26:20.436328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:24:48.750612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419373+0000","last_change":"2023-12-16T03:26:20.455052+0000","last_active":"2023-12-16T03:26:22.419373+0000","last_peered":"2023-12-16T03:26:22.419373+0000","last_clean":"2023-12-16T03:26:22.419373+0000","last_became_active":"2023-12-16T03:26:20.454689+0000","last_became_peered":"2023-12-16T03:26:20.454689+0000","last_unstale":"2023-12-16T03:26:22.419373+0000","last_undegraded":"2023-12-16T03:26:22.419373+0000","last_fullsized":"2023-12-16T03:26:22.419373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:04.320796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439792+0000","last_change":"2023-12-16T03:26:03.470373+0000","last_active":"2023-12-16T03:26:20.439792+0000","last_peered":"2023-12-16T03:26:20.439792+0000","last_clean":"2023-12-16T03:26:20.439792+0000","last_became_active":"2023-12-16T03:26:03.470054+0000","last_became_peered":"2023-12-16T03:26:03.470054+0000","last_unstale":"2023-12-16T03:26:20.439792+0000","last_undegraded":"2023-12-16T03:26:20.439792+0000","last_fullsized":"2023-12-16T03:26:20.439792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:50.606603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418020+0000","last_change":"2023-12-16T03:26:20.463084+0000","last_active":"2023-12-16T03:26:22.418020+0000","last_peered":"2023-12-16T03:26:22.418020+0000","last_clean":"2023-12-16T03:26:22.418020+0000","last_became_active":"2023-12-16T03:26:20.458441+0000","last_became_peered":"2023-12-16T03:26:20.458441+0000","last_unstale":"2023-12-16T03:26:22.418020+0000","last_undegraded":"2023-12-16T03:26:22.418020+0000","last_fullsized":"2023-12-16T03:26:22.418020+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:32:50.768331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436716+0000","last_change":"2023-12-16T03:26:03.468531+0000","last_active":"2023-12-16T03:26:20.436716+0000","last_peered":"2023-12-16T03:26:20.436716+0000","last_clean":"2023-12-16T03:26:20.436716+0000","last_became_active":"2023-12-16T03:26:03.468087+0000","last_became_peered":"2023-12-16T03:26:03.468087+0000","last_unstale":"2023-12-16T03:26:20.436716+0000","last_undegraded":"2023-12-16T03:26:20.436716+0000","last_fullsized":"2023-12-16T03:26:20.436716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:24:48.750612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438877+0000","last_change":"2023-12-16T03:26:20.460403+0000","last_active":"2023-12-16T03:26:21.438877+0000","last_peered":"2023-12-16T03:26:21.438877+0000","last_clean":"2023-12-16T03:26:21.438877+0000","last_became_active":"2023-12-16T03:26:20.460062+0000","last_became_peered":"2023-12-16T03:26:20.460062+0000","last_unstale":"2023-12-16T03:26:21.438877+0000","last_undegraded":"2023-12-16T03:26:21.438877+0000","last_fullsized":"2023-12-16T03:26:21.438877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:44:05.177453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438531+0000","last_change":"2023-12-16T03:26:03.475485+0000","last_active":"2023-12-16T03:26:20.438531+0000","last_peered":"2023-12-16T03:26:20.438531+0000","last_clean":"2023-12-16T03:26:20.438531+0000","last_became_active":"2023-12-16T03:26:03.474992+0000","last_became_peered":"2023-12-16T03:26:03.474992+0000","last_unstale":"2023-12-16T03:26:20.438531+0000","last_undegraded":"2023-12-16T03:26:20.438531+0000","last_fullsized":"2023-12-16T03:26:20.438531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:26.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417911+0000","last_change":"2023-12-16T03:26:20.468881+0000","last_active":"2023-12-16T03:26:22.417911+0000","last_peered":"2023-12-16T03:26:22.417911+0000","last_clean":"2023-12-16T03:26:22.417911+0000","last_became_active":"2023-12-16T03:26:20.468194+0000","last_became_peered":"2023-12-16T03:26:20.468194+0000","last_unstale":"2023-12-16T03:26:22.417911+0000","last_undegraded":"2023-12-16T03:26:22.417911+0000","last_fullsized":"2023-12-16T03:26:22.417911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:23:57.777036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450504+0000","last_change":"2023-12-16T03:26:03.484378+0000","last_active":"2023-12-16T03:26:20.450504+0000","last_peered":"2023-12-16T03:26:20.450504+0000","last_clean":"2023-12-16T03:26:20.450504+0000","last_became_active":"2023-12-16T03:26:03.484145+0000","last_became_peered":"2023-12-16T03:26:03.484145+0000","last_unstale":"2023-12-16T03:26:20.450504+0000","last_undegraded":"2023-12-16T03:26:20.450504+0000","last_fullsized":"2023-12-16T03:26:20.450504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:47:58.231120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418618+0000","last_change":"2023-12-16T03:26:20.446145+0000","last_active":"2023-12-16T03:26:22.418618+0000","last_peered":"2023-12-16T03:26:22.418618+0000","last_clean":"2023-12-16T03:26:22.418618+0000","last_became_active":"2023-12-16T03:26:20.445868+0000","last_became_peered":"2023-12-16T03:26:20.445868+0000","last_unstale":"2023-12-16T03:26:22.418618+0000","last_undegraded":"2023-12-16T03:26:22.418618+0000","last_fullsized":"2023-12-16T03:26:22.418618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:05.145337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440252+0000","last_change":"2023-12-16T03:26:03.468853+0000","last_active":"2023-12-16T03:26:20.440252+0000","last_peered":"2023-12-16T03:26:20.440252+0000","last_clean":"2023-12-16T03:26:20.440252+0000","last_became_active":"2023-12-16T03:26:03.468601+0000","last_became_peered":"2023-12-16T03:26:03.468601+0000","last_unstale":"2023-12-16T03:26:20.440252+0000","last_undegraded":"2023-12-16T03:26:20.440252+0000","last_fullsized":"2023-12-16T03:26:20.440252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:58.967330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440656+0000","last_change":"2023-12-16T03:26:20.459804+0000","last_active":"2023-12-16T03:26:21.440656+0000","last_peered":"2023-12-16T03:26:21.440656+0000","last_clean":"2023-12-16T03:26:21.440656+0000","last_became_active":"2023-12-16T03:26:20.459402+0000","last_became_peered":"2023-12-16T03:26:20.459402+0000","last_unstale":"2023-12-16T03:26:21.440656+0000","last_undegraded":"2023-12-16T03:26:21.440656+0000","last_fullsized":"2023-12-16T03:26:21.440656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:12.620002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436119+0000","last_change":"2023-12-16T03:26:03.477293+0000","last_active":"2023-12-16T03:26:20.436119+0000","last_peered":"2023-12-16T03:26:20.436119+0000","last_clean":"2023-12-16T03:26:20.436119+0000","last_became_active":"2023-12-16T03:26:03.476572+0000","last_became_peered":"2023-12-16T03:26:03.476572+0000","last_unstale":"2023-12-16T03:26:20.436119+0000","last_undegraded":"2023-12-16T03:26:20.436119+0000","last_fullsized":"2023-12-16T03:26:20.436119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:50.606603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418904+0000","last_change":"2023-12-16T03:26:20.454013+0000","last_active":"2023-12-16T03:26:22.418904+0000","last_peered":"2023-12-16T03:26:22.418904+0000","last_clean":"2023-12-16T03:26:22.418904+0000","last_became_active":"2023-12-16T03:26:20.453674+0000","last_became_peered":"2023-12-16T03:26:20.453674+0000","last_unstale":"2023-12-16T03:26:22.418904+0000","last_undegraded":"2023-12-16T03:26:22.418904+0000","last_fullsized":"2023-12-16T03:26:22.418904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:12.620002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450664+0000","last_change":"2023-12-16T03:26:03.463854+0000","last_active":"2023-12-16T03:26:20.450664+0000","last_peered":"2023-12-16T03:26:20.450664+0000","last_clean":"2023-12-16T03:26:20.450664+0000","last_became_active":"2023-12-16T03:26:03.463146+0000","last_became_peered":"2023-12-16T03:26:03.463146+0000","last_unstale":"2023-12-16T03:26:20.450664+0000","last_undegraded":"2023-12-16T03:26:20.450664+0000","last_fullsized":"2023-12-16T03:26:20.450664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:26.451963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419761+0000","last_change":"2023-12-16T03:26:20.469924+0000","last_active":"2023-12-16T03:26:22.419761+0000","last_peered":"2023-12-16T03:26:22.419761+0000","last_clean":"2023-12-16T03:26:22.419761+0000","last_became_active":"2023-12-16T03:26:20.469598+0000","last_became_peered":"2023-12-16T03:26:20.469598+0000","last_unstale":"2023-12-16T03:26:22.419761+0000","last_undegraded":"2023-12-16T03:26:22.419761+0000","last_fullsized":"2023-12-16T03:26:22.419761+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:08:20.172514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453606+0000","last_change":"2023-12-16T03:26:03.484118+0000","last_active":"2023-12-16T03:26:20.453606+0000","last_peered":"2023-12-16T03:26:20.453606+0000","last_clean":"2023-12-16T03:26:20.453606+0000","last_became_active":"2023-12-16T03:26:03.483621+0000","last_became_peered":"2023-12-16T03:26:03.483621+0000","last_unstale":"2023-12-16T03:26:20.453606+0000","last_undegraded":"2023-12-16T03:26:20.453606+0000","last_fullsized":"2023-12-16T03:26:20.453606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.515046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439636+0000","last_change":"2023-12-16T03:26:20.444051+0000","last_active":"2023-12-16T03:26:21.439636+0000","last_peered":"2023-12-16T03:26:21.439636+0000","last_clean":"2023-12-16T03:26:21.439636+0000","last_became_active":"2023-12-16T03:26:20.443742+0000","last_became_peered":"2023-12-16T03:26:20.443742+0000","last_unstale":"2023-12-16T03:26:21.439636+0000","last_undegraded":"2023-12-16T03:26:21.439636+0000","last_fullsized":"2023-12-16T03:26:21.439636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:23:57.777036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467642+0000","last_change":"2023-12-16T03:26:03.471860+0000","last_active":"2023-12-16T03:26:20.467642+0000","last_peered":"2023-12-16T03:26:20.467642+0000","last_clean":"2023-12-16T03:26:20.467642+0000","last_became_active":"2023-12-16T03:26:03.470857+0000","last_became_peered":"2023-12-16T03:26:03.470857+0000","last_unstale":"2023-12-16T03:26:20.467642+0000","last_undegraded":"2023-12-16T03:26:20.467642+0000","last_fullsized":"2023-12-16T03:26:20.467642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:02.166310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":999424,"data_stored":751391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.55400000000000005}]},{"osd":3,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.748},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.77700000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":162131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.1890000000000001,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.77200000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.6870000000000003,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.2560000000000002,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.73699999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.753}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.67800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":168742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60799999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.79900000000000004}]},{"osd":4,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.495},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.86599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":169716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.194,"5min":4.194,"15min":4.194},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.873},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.98599999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.1689999999999996,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.76700000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.2759999999999998,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.79200000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.93899999999999995}]},{"osd":6,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.83099999999999996}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.90600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":425984,"data_stored":164610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":5.4710000000000001,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":6.1189999999999998,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.7890000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.315},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.434}]},{"osd":2,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.5779999999999998,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.75800000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.6309999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":0.69799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":430080,"data_stored":169704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.41299999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.76400000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.83499999999999996}]},{"osd":4,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.0609999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.97599999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":164042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":4.3479999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.476,"5min":4.476,"15min":4.476},"last":0.64900000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.4269999999999996,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.6319999999999997,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.3849999999999998,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":7.5650000000000004,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.984,"5min":4.984,"15min":4.984},"last":0.77200000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":4.7720000000000002,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.623},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":7.6109999999999998,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":7.681,"5min":7.681,"15min":7.681},"last":0.66300000000000003}]},{"osd":7,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.8609999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.71999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":995328,"data_stored":751245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.1210000000000004,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.47399999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.1719999999999997,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.2350000000000003,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.54100000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.0970000000000004,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.254,"5min":3.254,"15min":3.254},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":0.78500000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.3979999999999997,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:26:24.725 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:26:24.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0ae10ea640 1 Processor -- start 2023-12-16T03:26:24.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0ae10ea640 1 -- start start 2023-12-16T03:26:24.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0ae10ea640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0adc0c5260 0x7f0adc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0ae10ea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0adc0c5640 0x7f0adc0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0ae10ea640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0adc0c60f0 0x7f0adc155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0ae10ea640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0c17f0 con 0x7f0adc0c60f0 2023-12-16T03:26:24.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0ae10ea640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0c2580 con 0x7f0adc0c5260 2023-12-16T03:26:24.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0ae10ea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0c1a00 con 0x7f0adc0c5640 2023-12-16T03:26:24.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0adb59e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0adc0c60f0 0x7f0adc155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0adb59e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0adc0c60f0 0x7f0adc155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51336/0 (socket says 172.21.15.28:51336) 2023-12-16T03:26:24.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0adb59e640 1 -- 172.21.15.28:0/1955582441 learned_addr learned my addr 172.21.15.28:0/1955582441 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:24.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0adad9d640 1 --2- 172.21.15.28:0/1955582441 >> v2:172.21.15.134:3300/0 conn(0x7f0adc0c5260 0x7f0adc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.897+0000 7f0ad3fff640 1 --2- 172.21.15.28:0/1955582441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0adc0c5640 0x7f0adc0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0adb59e640 1 -- 172.21.15.28:0/1955582441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0adc0c5640 msgr2=0x7f0adc0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:24.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0adb59e640 1 --2- 172.21.15.28:0/1955582441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0adc0c5640 0x7f0adc0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0adb59e640 1 -- 172.21.15.28:0/1955582441 >> v2:172.21.15.134:3300/0 conn(0x7f0adc0c5260 msgr2=0x7f0adc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:24.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0adb59e640 1 --2- 172.21.15.28:0/1955582441 >> v2:172.21.15.134:3300/0 conn(0x7f0adc0c5260 0x7f0adc06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0adb59e640 1 -- 172.21.15.28:0/1955582441 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0c1ce0 con 0x7f0adc0c60f0 2023-12-16T03:26:24.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0adad9d640 1 --2- 172.21.15.28:0/1955582441 >> v2:172.21.15.134:3300/0 conn(0x7f0adc0c5260 0x7f0adc06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:24.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ad3fff640 1 --2- 172.21.15.28:0/1955582441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0adc0c5640 0x7f0adc0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:24.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0adb59e640 1 --2- 172.21.15.28:0/1955582441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0adc0c60f0 0x7f0adc155de0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0c6920 tx=0x7f0ad401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137a2de3a6cd03e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:24.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ada59c640 1 -- 172.21.15.28:0/1955582441 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40a5790 con 0x7f0adc0c60f0 2023-12-16T03:26:24.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ada59c640 1 -- 172.21.15.28:0/1955582441 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad40a58f0 con 0x7f0adc0c60f0 2023-12-16T03:26:24.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ada59c640 1 -- 172.21.15.28:0/1955582441 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40a5c80 con 0x7f0adc0c60f0 2023-12-16T03:26:24.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ae10ea640 1 -- 172.21.15.28:0/1955582441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0adc0c60f0 msgr2=0x7f0adc155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ae10ea640 1 --2- 172.21.15.28:0/1955582441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0adc0c60f0 0x7f0adc155de0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0c6920 tx=0x7f0ad401c910 comp rx=0 tx=0).stop 2023-12-16T03:26:24.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ae10ea640 1 -- 172.21.15.28:0/1955582441 shutdown_connections 2023-12-16T03:26:24.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ae10ea640 1 --2- 172.21.15.28:0/1955582441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0adc0c60f0 0x7f0adc155de0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ae10ea640 1 --2- 172.21.15.28:0/1955582441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0adc0c5640 0x7f0adc0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ae10ea640 1 --2- 172.21.15.28:0/1955582441 >> v2:172.21.15.134:3300/0 conn(0x7f0adc0c5260 0x7f0adc06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ae10ea640 1 -- 172.21.15.28:0/1955582441 >> 172.21.15.28:0/1955582441 conn(0x7f0adc06a5b0 msgr2=0x7f0adc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:24.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ae10ea640 1 -- 172.21.15.28:0/1955582441 shutdown_connections 2023-12-16T03:26:24.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.901+0000 7f0ae10ea640 1 -- 172.21.15.28:0/1955582441 wait complete. 2023-12-16T03:26:24.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0ae10ea640 1 Processor -- start 2023-12-16T03:26:24.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0ae10ea640 1 -- start start 2023-12-16T03:26:24.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0ae10ea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0adc0c5260 0x7f0adc1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0ae10ea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0adc0c5640 0x7f0adc1ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0ae10ea640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0adc0c60f0 0x7f0adc1ec640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0ae10ea640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0bfdc0 con 0x7f0adc0c60f0 2023-12-16T03:26:24.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0ae10ea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0bb830 con 0x7f0adc0c5640 2023-12-16T03:26:24.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0ae10ea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0bbb10 con 0x7f0adc0c5260 2023-12-16T03:26:24.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0adb59e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0adc0c60f0 0x7f0adc1ec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0adb59e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0adc0c60f0 0x7f0adc1ec640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51348/0 (socket says 172.21.15.28:51348) 2023-12-16T03:26:24.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0adb59e640 1 -- 172.21.15.28:0/212807080 learned_addr learned my addr 172.21.15.28:0/212807080 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:24.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0adad9d640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0adc0c5260 0x7f0adc1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0ad3fff640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0adc0c5640 0x7f0adc1ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0adb59e640 1 -- 172.21.15.28:0/212807080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0adc0c5260 msgr2=0x7f0adc1549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0adb59e640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0adc0c5260 0x7f0adc1549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0adb59e640 1 -- 172.21.15.28:0/212807080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0adc0c5640 msgr2=0x7f0adc1ec100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:24.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0adb59e640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0adc0c5640 0x7f0adc1ec100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:24.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0adb59e640 1 -- 172.21.15.28:0/212807080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4009b30 con 0x7f0adc0c60f0 2023-12-16T03:26:24.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0adb59e640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0adc0c60f0 0x7f0adc1ec640 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40af040 tx=0x7f0ad40196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:24.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.905+0000 7f0ad37fe640 1 -- 172.21.15.28:0/212807080 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40b8670 con 0x7f0adc0c60f0 2023-12-16T03:26:24.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.909+0000 7f0ad37fe640 1 -- 172.21.15.28:0/212807080 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad40b87d0 con 0x7f0adc0c60f0 2023-12-16T03:26:24.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.909+0000 7f0ad37fe640 1 -- 172.21.15.28:0/212807080 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40b8b80 con 0x7f0adc0c60f0 2023-12-16T03:26:24.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.909+0000 7f0ae10ea640 1 -- 172.21.15.28:0/212807080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc0bbdf0 con 0x7f0adc0c60f0 2023-12-16T03:26:24.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.909+0000 7f0ae10ea640 1 -- 172.21.15.28:0/212807080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc0bc3b0 con 0x7f0adc0c60f0 2023-12-16T03:26:24.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.909+0000 7f0ae10ea640 1 -- 172.21.15.28:0/212807080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc0bbc50 con 0x7f0adc0c60f0 2023-12-16T03:26:24.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.909+0000 7f0ad37fe640 1 -- 172.21.15.28:0/212807080 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0ad40b8ce0 con 0x7f0adc0c60f0 2023-12-16T03:26:24.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.909+0000 7f0ad37fe640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0abc066470 0x7f0abc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:24.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.909+0000 7f0ad37fe640 1 -- 172.21.15.28:0/212807080 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0ad411f860 con 0x7f0adc0c60f0 2023-12-16T03:26:24.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.909+0000 7f0adad9d640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0abc066470 0x7f0abc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:24.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.913+0000 7f0adad9d640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0abc066470 0x7f0abc068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0c0ae0 tx=0x7f0acc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:24.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:24.913+0000 7f0ad37fe640 1 -- 172.21.15.28:0/212807080 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0adc0bbc50 con 0x7f0adc0c60f0 2023-12-16T03:26:25.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.065+0000 7f0ae10ea640 1 -- 172.21.15.28:0/212807080 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0adc06cff0 con 0x7f0abc066470 2023-12-16T03:26:25.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.081+0000 7f0ad37fe640 1 -- 172.21.15.28:0/212807080 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527810 (secure 0 0 0) 0x7f0adc06cff0 con 0x7f0abc066470 2023-12-16T03:26:25.092 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:26:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 -- 172.21.15.28:0/212807080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0abc066470 msgr2=0x7f0abc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0abc066470 0x7f0abc068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0c0ae0 tx=0x7f0acc008040 comp rx=0 tx=0).stop 2023-12-16T03:26:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 -- 172.21.15.28:0/212807080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0adc0c60f0 msgr2=0x7f0adc1ec640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0adc0c60f0 0x7f0adc1ec640 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40af040 tx=0x7f0ad40196b0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 -- 172.21.15.28:0/212807080 shutdown_connections 2023-12-16T03:26:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0abc066470 0x7f0abc068930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0adc0c60f0 0x7f0adc1ec640 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0adc0c5640 0x7f0adc1ec100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 --2- 172.21.15.28:0/212807080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0adc0c5260 0x7f0adc1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 -- 172.21.15.28:0/212807080 >> 172.21.15.28:0/212807080 conn(0x7f0adc06a5b0 msgr2=0x7f0adc06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 -- 172.21.15.28:0/212807080 shutdown_connections 2023-12-16T03:26:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.085+0000 7f0ae10ea640 1 -- 172.21.15.28:0/212807080 wait complete. 2023-12-16T03:26:25.111 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-12-16T03:26:23.811985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":332,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237272,"kb_used_data":4428,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737448,"statfs":{"total":773094113280,"available":772851146752,"internally_reserved":0,"allocated":4534272,"data_stored":2501581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.231232"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.420012+0000","last_change":"2023-12-16T03:26:20.455600+0000","last_active":"2023-12-16T03:26:22.420012+0000","last_peered":"2023-12-16T03:26:22.420012+0000","last_clean":"2023-12-16T03:26:22.420012+0000","last_became_active":"2023-12-16T03:26:20.454435+0000","last_became_peered":"2023-12-16T03:26:20.454435+0000","last_unstale":"2023-12-16T03:26:22.420012+0000","last_undegraded":"2023-12-16T03:26:22.420012+0000","last_fullsized":"2023-12-16T03:26:22.420012+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:29.167009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.437574+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:26:20.437574+0000","last_peered":"2023-12-16T03:26:20.437574+0000","last_clean":"2023-12-16T03:26:20.437574+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:26:20.437574+0000","last_undegraded":"2023-12-16T03:26:20.437574+0000","last_fullsized":"2023-12-16T03:26:20.437574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.465848+0000","last_change":"2023-12-16T03:26:02.467483+0000","last_active":"2023-12-16T03:26:20.465848+0000","last_peered":"2023-12-16T03:26:20.465848+0000","last_clean":"2023-12-16T03:26:20.465848+0000","last_became_active":"2023-12-16T03:26:02.467186+0000","last_became_peered":"2023-12-16T03:26:02.467186+0000","last_unstale":"2023-12-16T03:26:20.465848+0000","last_undegraded":"2023-12-16T03:26:20.465848+0000","last_fullsized":"2023-12-16T03:26:20.465848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.441743+0000","last_change":"2023-12-16T03:26:03.470811+0000","last_active":"2023-12-16T03:26:20.441743+0000","last_peered":"2023-12-16T03:26:20.441743+0000","last_clean":"2023-12-16T03:26:20.441743+0000","last_became_active":"2023-12-16T03:26:03.469335+0000","last_became_peered":"2023-12-16T03:26:03.469335+0000","last_unstale":"2023-12-16T03:26:20.441743+0000","last_undegraded":"2023-12-16T03:26:20.441743+0000","last_fullsized":"2023-12-16T03:26:20.441743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:21.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440873+0000","last_change":"2023-12-16T03:26:19.618339+0000","last_active":"2023-12-16T03:26:21.440873+0000","last_peered":"2023-12-16T03:26:21.440873+0000","last_clean":"2023-12-16T03:26:21.440873+0000","last_became_active":"2023-12-16T03:26:19.618039+0000","last_became_peered":"2023-12-16T03:26:19.618039+0000","last_unstale":"2023-12-16T03:26:21.440873+0000","last_undegraded":"2023-12-16T03:26:21.440873+0000","last_fullsized":"2023-12-16T03:26:21.440873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:44.950332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417801+0000","last_change":"2023-12-16T03:26:20.458383+0000","last_active":"2023-12-16T03:26:22.417801+0000","last_peered":"2023-12-16T03:26:22.417801+0000","last_clean":"2023-12-16T03:26:22.417801+0000","last_became_active":"2023-12-16T03:26:20.457188+0000","last_became_peered":"2023-12-16T03:26:20.457188+0000","last_unstale":"2023-12-16T03:26:22.417801+0000","last_undegraded":"2023-12-16T03:26:22.417801+0000","last_fullsized":"2023-12-16T03:26:22.417801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:00:41.256641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449609+0000","last_change":"2023-12-16T03:26:02.468114+0000","last_active":"2023-12-16T03:26:20.449609+0000","last_peered":"2023-12-16T03:26:20.449609+0000","last_clean":"2023-12-16T03:26:20.449609+0000","last_became_active":"2023-12-16T03:26:02.467813+0000","last_became_peered":"2023-12-16T03:26:02.467813+0000","last_unstale":"2023-12-16T03:26:20.449609+0000","last_undegraded":"2023-12-16T03:26:20.449609+0000","last_fullsized":"2023-12-16T03:26:20.449609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:24:47.746674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438852+0000","last_change":"2023-12-16T03:26:03.461564+0000","last_active":"2023-12-16T03:26:20.438852+0000","last_peered":"2023-12-16T03:26:20.438852+0000","last_clean":"2023-12-16T03:26:20.438852+0000","last_became_active":"2023-12-16T03:26:03.459570+0000","last_became_peered":"2023-12-16T03:26:03.459570+0000","last_unstale":"2023-12-16T03:26:20.438852+0000","last_undegraded":"2023-12-16T03:26:20.438852+0000","last_fullsized":"2023-12-16T03:26:20.438852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:05:14.653208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439431+0000","last_change":"2023-12-16T03:26:19.624241+0000","last_active":"2023-12-16T03:26:21.439431+0000","last_peered":"2023-12-16T03:26:21.439431+0000","last_clean":"2023-12-16T03:26:21.439431+0000","last_became_active":"2023-12-16T03:26:19.623935+0000","last_became_peered":"2023-12-16T03:26:19.623935+0000","last_unstale":"2023-12-16T03:26:21.439431+0000","last_undegraded":"2023-12-16T03:26:21.439431+0000","last_fullsized":"2023-12-16T03:26:21.439431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:00.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418351+0000","last_change":"2023-12-16T03:26:20.462407+0000","last_active":"2023-12-16T03:26:22.418351+0000","last_peered":"2023-12-16T03:26:22.418351+0000","last_clean":"2023-12-16T03:26:22.418351+0000","last_became_active":"2023-12-16T03:26:20.457618+0000","last_became_peered":"2023-12-16T03:26:20.457618+0000","last_unstale":"2023-12-16T03:26:22.418351+0000","last_undegraded":"2023-12-16T03:26:22.418351+0000","last_fullsized":"2023-12-16T03:26:22.418351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:20:24.208327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439045+0000","last_change":"2023-12-16T03:26:02.459691+0000","last_active":"2023-12-16T03:26:20.439045+0000","last_peered":"2023-12-16T03:26:20.439045+0000","last_clean":"2023-12-16T03:26:20.439045+0000","last_became_active":"2023-12-16T03:26:02.458861+0000","last_became_peered":"2023-12-16T03:26:02.458861+0000","last_unstale":"2023-12-16T03:26:20.439045+0000","last_undegraded":"2023-12-16T03:26:20.439045+0000","last_fullsized":"2023-12-16T03:26:20.439045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:31.574264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449531+0000","last_change":"2023-12-16T03:26:03.474528+0000","last_active":"2023-12-16T03:26:20.449531+0000","last_peered":"2023-12-16T03:26:20.449531+0000","last_clean":"2023-12-16T03:26:20.449531+0000","last_became_active":"2023-12-16T03:26:03.472731+0000","last_became_peered":"2023-12-16T03:26:03.472731+0000","last_unstale":"2023-12-16T03:26:20.449531+0000","last_undegraded":"2023-12-16T03:26:20.449531+0000","last_fullsized":"2023-12-16T03:26:20.449531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:58:06.441852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419060+0000","last_change":"2023-12-16T03:26:19.615958+0000","last_active":"2023-12-16T03:26:22.419060+0000","last_peered":"2023-12-16T03:26:22.419060+0000","last_clean":"2023-12-16T03:26:22.419060+0000","last_became_active":"2023-12-16T03:26:19.615619+0000","last_became_peered":"2023-12-16T03:26:19.615619+0000","last_unstale":"2023-12-16T03:26:22.419060+0000","last_undegraded":"2023-12-16T03:26:22.419060+0000","last_fullsized":"2023-12-16T03:26:22.419060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:03.030525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439052+0000","last_change":"2023-12-16T03:26:20.456698+0000","last_active":"2023-12-16T03:26:21.439052+0000","last_peered":"2023-12-16T03:26:21.439052+0000","last_clean":"2023-12-16T03:26:21.439052+0000","last_became_active":"2023-12-16T03:26:20.456218+0000","last_became_peered":"2023-12-16T03:26:20.456218+0000","last_unstale":"2023-12-16T03:26:21.439052+0000","last_undegraded":"2023-12-16T03:26:21.439052+0000","last_fullsized":"2023-12-16T03:26:21.439052+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:05.243547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.434859+0000","last_change":"2023-12-16T03:26:02.462695+0000","last_active":"2023-12-16T03:26:20.434859+0000","last_peered":"2023-12-16T03:26:20.434859+0000","last_clean":"2023-12-16T03:26:20.434859+0000","last_became_active":"2023-12-16T03:26:02.461706+0000","last_became_peered":"2023-12-16T03:26:02.461706+0000","last_unstale":"2023-12-16T03:26:20.434859+0000","last_undegraded":"2023-12-16T03:26:20.434859+0000","last_fullsized":"2023-12-16T03:26:20.434859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:31.574264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.441654+0000","last_change":"2023-12-16T03:26:03.475970+0000","last_active":"2023-12-16T03:26:20.441654+0000","last_peered":"2023-12-16T03:26:20.441654+0000","last_clean":"2023-12-16T03:26:20.441654+0000","last_became_active":"2023-12-16T03:26:03.475704+0000","last_became_peered":"2023-12-16T03:26:03.475704+0000","last_unstale":"2023-12-16T03:26:20.441654+0000","last_undegraded":"2023-12-16T03:26:20.441654+0000","last_fullsized":"2023-12-16T03:26:20.441654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:34.342031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418310+0000","last_change":"2023-12-16T03:26:19.619984+0000","last_active":"2023-12-16T03:26:22.418310+0000","last_peered":"2023-12-16T03:26:22.418310+0000","last_clean":"2023-12-16T03:26:22.418310+0000","last_became_active":"2023-12-16T03:26:19.619636+0000","last_became_peered":"2023-12-16T03:26:19.619636+0000","last_unstale":"2023-12-16T03:26:22.418310+0000","last_undegraded":"2023-12-16T03:26:22.418310+0000","last_fullsized":"2023-12-16T03:26:22.418310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:00.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438342+0000","last_change":"2023-12-16T03:26:20.454806+0000","last_active":"2023-12-16T03:26:21.438342+0000","last_peered":"2023-12-16T03:26:21.438342+0000","last_clean":"2023-12-16T03:26:21.438342+0000","last_became_active":"2023-12-16T03:26:20.454401+0000","last_became_peered":"2023-12-16T03:26:20.454401+0000","last_unstale":"2023-12-16T03:26:21.438342+0000","last_undegraded":"2023-12-16T03:26:21.438342+0000","last_fullsized":"2023-12-16T03:26:21.438342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:13.539226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.441936+0000","last_change":"2023-12-16T03:26:02.456023+0000","last_active":"2023-12-16T03:26:20.441936+0000","last_peered":"2023-12-16T03:26:20.441936+0000","last_clean":"2023-12-16T03:26:20.441936+0000","last_became_active":"2023-12-16T03:26:02.455703+0000","last_became_peered":"2023-12-16T03:26:02.455703+0000","last_unstale":"2023-12-16T03:26:20.441936+0000","last_undegraded":"2023-12-16T03:26:20.441936+0000","last_fullsized":"2023-12-16T03:26:20.441936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:05:13.649270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467180+0000","last_change":"2023-12-16T03:26:03.483286+0000","last_active":"2023-12-16T03:26:20.467180+0000","last_peered":"2023-12-16T03:26:20.467180+0000","last_clean":"2023-12-16T03:26:20.467180+0000","last_became_active":"2023-12-16T03:26:03.483003+0000","last_became_peered":"2023-12-16T03:26:03.483003+0000","last_unstale":"2023-12-16T03:26:20.467180+0000","last_undegraded":"2023-12-16T03:26:20.467180+0000","last_fullsized":"2023-12-16T03:26:20.467180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:34.342031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418468+0000","last_change":"2023-12-16T03:26:19.612166+0000","last_active":"2023-12-16T03:26:22.418468+0000","last_peered":"2023-12-16T03:26:22.418468+0000","last_clean":"2023-12-16T03:26:22.418468+0000","last_became_active":"2023-12-16T03:26:19.611770+0000","last_became_peered":"2023-12-16T03:26:19.611770+0000","last_unstale":"2023-12-16T03:26:22.418468+0000","last_undegraded":"2023-12-16T03:26:22.418468+0000","last_fullsized":"2023-12-16T03:26:22.418468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:57:25.261038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419512+0000","last_change":"2023-12-16T03:26:20.465191+0000","last_active":"2023-12-16T03:26:22.419512+0000","last_peered":"2023-12-16T03:26:22.419512+0000","last_clean":"2023-12-16T03:26:22.419512+0000","last_became_active":"2023-12-16T03:26:20.462358+0000","last_became_peered":"2023-12-16T03:26:20.462358+0000","last_unstale":"2023-12-16T03:26:22.419512+0000","last_undegraded":"2023-12-16T03:26:22.419512+0000","last_fullsized":"2023-12-16T03:26:22.419512+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:05.243547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436207+0000","last_change":"2023-12-16T03:26:02.465084+0000","last_active":"2023-12-16T03:26:20.436207+0000","last_peered":"2023-12-16T03:26:20.436207+0000","last_clean":"2023-12-16T03:26:20.436207+0000","last_became_active":"2023-12-16T03:26:02.464706+0000","last_became_peered":"2023-12-16T03:26:02.464706+0000","last_unstale":"2023-12-16T03:26:20.436207+0000","last_undegraded":"2023-12-16T03:26:20.436207+0000","last_fullsized":"2023-12-16T03:26:20.436207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.442464+0000","last_change":"2023-12-16T03:26:03.471971+0000","last_active":"2023-12-16T03:26:20.442464+0000","last_peered":"2023-12-16T03:26:20.442464+0000","last_clean":"2023-12-16T03:26:20.442464+0000","last_became_active":"2023-12-16T03:26:03.471769+0000","last_became_peered":"2023-12-16T03:26:03.471769+0000","last_unstale":"2023-12-16T03:26:20.442464+0000","last_undegraded":"2023-12-16T03:26:20.442464+0000","last_fullsized":"2023-12-16T03:26:20.442464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:49.203240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417825+0000","last_change":"2023-12-16T03:26:19.625819+0000","last_active":"2023-12-16T03:26:22.417825+0000","last_peered":"2023-12-16T03:26:22.417825+0000","last_clean":"2023-12-16T03:26:22.417825+0000","last_became_active":"2023-12-16T03:26:19.625491+0000","last_became_peered":"2023-12-16T03:26:19.625491+0000","last_unstale":"2023-12-16T03:26:22.417825+0000","last_undegraded":"2023-12-16T03:26:22.417825+0000","last_fullsized":"2023-12-16T03:26:22.417825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:48:59.755641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419431+0000","last_change":"2023-12-16T03:26:20.452924+0000","last_active":"2023-12-16T03:26:22.419431+0000","last_peered":"2023-12-16T03:26:22.419431+0000","last_clean":"2023-12-16T03:26:22.419431+0000","last_became_active":"2023-12-16T03:26:20.452596+0000","last_became_peered":"2023-12-16T03:26:20.452596+0000","last_unstale":"2023-12-16T03:26:22.419431+0000","last_undegraded":"2023-12-16T03:26:22.419431+0000","last_fullsized":"2023-12-16T03:26:22.419431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:20:08.420830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443892+0000","last_change":"2023-12-16T03:26:02.476238+0000","last_active":"2023-12-16T03:26:20.443892+0000","last_peered":"2023-12-16T03:26:20.443892+0000","last_clean":"2023-12-16T03:26:20.443892+0000","last_became_active":"2023-12-16T03:26:02.475844+0000","last_became_peered":"2023-12-16T03:26:02.475844+0000","last_unstale":"2023-12-16T03:26:20.443892+0000","last_undegraded":"2023-12-16T03:26:20.443892+0000","last_fullsized":"2023-12-16T03:26:20.443892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:50.926184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.451342+0000","last_change":"2023-12-16T03:26:03.463996+0000","last_active":"2023-12-16T03:26:20.451342+0000","last_peered":"2023-12-16T03:26:20.451342+0000","last_clean":"2023-12-16T03:26:20.451342+0000","last_became_active":"2023-12-16T03:26:03.463705+0000","last_became_peered":"2023-12-16T03:26:03.463705+0000","last_unstale":"2023-12-16T03:26:20.451342+0000","last_undegraded":"2023-12-16T03:26:20.451342+0000","last_fullsized":"2023-12-16T03:26:20.451342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:47:58.231120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.420155+0000","last_change":"2023-12-16T03:26:19.616119+0000","last_active":"2023-12-16T03:26:22.420155+0000","last_peered":"2023-12-16T03:26:22.420155+0000","last_clean":"2023-12-16T03:26:22.420155+0000","last_became_active":"2023-12-16T03:26:19.615793+0000","last_became_peered":"2023-12-16T03:26:19.615793+0000","last_unstale":"2023-12-16T03:26:22.420155+0000","last_undegraded":"2023-12-16T03:26:22.420155+0000","last_fullsized":"2023-12-16T03:26:22.420155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:23:42.587704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419473+0000","last_change":"2023-12-16T03:26:20.454089+0000","last_active":"2023-12-16T03:26:22.419473+0000","last_peered":"2023-12-16T03:26:22.419473+0000","last_clean":"2023-12-16T03:26:22.419473+0000","last_became_active":"2023-12-16T03:26:20.453737+0000","last_became_peered":"2023-12-16T03:26:20.453737+0000","last_unstale":"2023-12-16T03:26:22.419473+0000","last_undegraded":"2023-12-16T03:26:22.419473+0000","last_fullsized":"2023-12-16T03:26:22.419473+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:44:05.177453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436794+0000","last_change":"2023-12-16T03:26:02.472212+0000","last_active":"2023-12-16T03:26:20.436794+0000","last_peered":"2023-12-16T03:26:20.436794+0000","last_clean":"2023-12-16T03:26:20.436794+0000","last_became_active":"2023-12-16T03:26:02.471791+0000","last_became_peered":"2023-12-16T03:26:02.471791+0000","last_unstale":"2023-12-16T03:26:20.436794+0000","last_undegraded":"2023-12-16T03:26:20.436794+0000","last_fullsized":"2023-12-16T03:26:20.436794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:53.959842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440665+0000","last_change":"2023-12-16T03:26:03.465923+0000","last_active":"2023-12-16T03:26:20.440665+0000","last_peered":"2023-12-16T03:26:20.440665+0000","last_clean":"2023-12-16T03:26:20.440665+0000","last_became_active":"2023-12-16T03:26:03.464781+0000","last_became_peered":"2023-12-16T03:26:03.464781+0000","last_unstale":"2023-12-16T03:26:20.440665+0000","last_undegraded":"2023-12-16T03:26:20.440665+0000","last_fullsized":"2023-12-16T03:26:20.440665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:33:51.446792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419593+0000","last_change":"2023-12-16T03:26:19.626629+0000","last_active":"2023-12-16T03:26:22.419593+0000","last_peered":"2023-12-16T03:26:22.419593+0000","last_clean":"2023-12-16T03:26:22.419593+0000","last_became_active":"2023-12-16T03:26:19.626293+0000","last_became_peered":"2023-12-16T03:26:19.626293+0000","last_unstale":"2023-12-16T03:26:22.419593+0000","last_undegraded":"2023-12-16T03:26:22.419593+0000","last_fullsized":"2023-12-16T03:26:22.419593+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:12.536210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.421285+0000","last_change":"2023-12-16T03:26:20.450919+0000","last_active":"2023-12-16T03:26:22.421285+0000","last_peered":"2023-12-16T03:26:22.421285+0000","last_clean":"2023-12-16T03:26:22.421285+0000","last_became_active":"2023-12-16T03:26:20.450739+0000","last_became_peered":"2023-12-16T03:26:20.450739+0000","last_unstale":"2023-12-16T03:26:22.421285+0000","last_undegraded":"2023-12-16T03:26:22.421285+0000","last_fullsized":"2023-12-16T03:26:22.421285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:31.461913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449118+0000","last_change":"2023-12-16T03:26:02.456879+0000","last_active":"2023-12-16T03:26:20.449118+0000","last_peered":"2023-12-16T03:26:20.449118+0000","last_clean":"2023-12-16T03:26:20.449118+0000","last_became_active":"2023-12-16T03:26:02.456571+0000","last_became_peered":"2023-12-16T03:26:02.456571+0000","last_unstale":"2023-12-16T03:26:20.449118+0000","last_undegraded":"2023-12-16T03:26:20.449118+0000","last_fullsized":"2023-12-16T03:26:20.449118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:20:29.012213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438440+0000","last_change":"2023-12-16T03:26:03.474960+0000","last_active":"2023-12-16T03:26:20.438440+0000","last_peered":"2023-12-16T03:26:20.438440+0000","last_clean":"2023-12-16T03:26:20.438440+0000","last_became_active":"2023-12-16T03:26:03.474646+0000","last_became_peered":"2023-12-16T03:26:03.474646+0000","last_unstale":"2023-12-16T03:26:20.438440+0000","last_undegraded":"2023-12-16T03:26:20.438440+0000","last_fullsized":"2023-12-16T03:26:20.438440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:58:06.441852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438351+0000","last_change":"2023-12-16T03:26:19.609502+0000","last_active":"2023-12-16T03:26:21.438351+0000","last_peered":"2023-12-16T03:26:21.438351+0000","last_clean":"2023-12-16T03:26:21.438351+0000","last_became_active":"2023-12-16T03:26:19.608698+0000","last_became_peered":"2023-12-16T03:26:19.608698+0000","last_unstale":"2023-12-16T03:26:21.438351+0000","last_undegraded":"2023-12-16T03:26:21.438351+0000","last_fullsized":"2023-12-16T03:26:21.438351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:16.967864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418177+0000","last_change":"2023-12-16T03:26:20.463298+0000","last_active":"2023-12-16T03:26:22.418177+0000","last_peered":"2023-12-16T03:26:22.418177+0000","last_clean":"2023-12-16T03:26:22.418177+0000","last_became_active":"2023-12-16T03:26:20.462713+0000","last_became_peered":"2023-12-16T03:26:20.462713+0000","last_unstale":"2023-12-16T03:26:22.418177+0000","last_undegraded":"2023-12-16T03:26:22.418177+0000","last_fullsized":"2023-12-16T03:26:22.418177+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:06.502049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438942+0000","last_change":"2023-12-16T03:26:02.473193+0000","last_active":"2023-12-16T03:26:20.438942+0000","last_peered":"2023-12-16T03:26:20.438942+0000","last_clean":"2023-12-16T03:26:20.438942+0000","last_became_active":"2023-12-16T03:26:02.472836+0000","last_became_peered":"2023-12-16T03:26:02.472836+0000","last_unstale":"2023-12-16T03:26:20.438942+0000","last_undegraded":"2023-12-16T03:26:20.438942+0000","last_fullsized":"2023-12-16T03:26:20.438942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439646+0000","last_change":"2023-12-16T03:26:03.474142+0000","last_active":"2023-12-16T03:26:20.439646+0000","last_peered":"2023-12-16T03:26:20.439646+0000","last_clean":"2023-12-16T03:26:20.439646+0000","last_became_active":"2023-12-16T03:26:03.472456+0000","last_became_peered":"2023-12-16T03:26:03.472456+0000","last_unstale":"2023-12-16T03:26:20.439646+0000","last_undegraded":"2023-12-16T03:26:20.439646+0000","last_fullsized":"2023-12-16T03:26:20.439646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:09:34.845852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418211+0000","last_change":"2023-12-16T03:26:19.618531+0000","last_active":"2023-12-16T03:26:22.418211+0000","last_peered":"2023-12-16T03:26:22.418211+0000","last_clean":"2023-12-16T03:26:22.418211+0000","last_became_active":"2023-12-16T03:26:19.617852+0000","last_became_peered":"2023-12-16T03:26:19.617852+0000","last_unstale":"2023-12-16T03:26:22.418211+0000","last_undegraded":"2023-12-16T03:26:22.418211+0000","last_fullsized":"2023-12-16T03:26:22.418211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:20:07.417814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417751+0000","last_change":"2023-12-16T03:26:20.455224+0000","last_active":"2023-12-16T03:26:22.417751+0000","last_peered":"2023-12-16T03:26:22.417751+0000","last_clean":"2023-12-16T03:26:22.417751+0000","last_became_active":"2023-12-16T03:26:20.454681+0000","last_became_peered":"2023-12-16T03:26:20.454681+0000","last_unstale":"2023-12-16T03:26:22.417751+0000","last_undegraded":"2023-12-16T03:26:22.417751+0000","last_fullsized":"2023-12-16T03:26:22.417751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:50:56.670673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467786+0000","last_change":"2023-12-16T03:26:02.474673+0000","last_active":"2023-12-16T03:26:20.467786+0000","last_peered":"2023-12-16T03:26:20.467786+0000","last_clean":"2023-12-16T03:26:20.467786+0000","last_became_active":"2023-12-16T03:26:02.474398+0000","last_became_peered":"2023-12-16T03:26:02.474398+0000","last_unstale":"2023-12-16T03:26:20.467786+0000","last_undegraded":"2023-12-16T03:26:20.467786+0000","last_fullsized":"2023-12-16T03:26:20.467786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:19.149617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440533+0000","last_change":"2023-12-16T03:26:03.488357+0000","last_active":"2023-12-16T03:26:20.440533+0000","last_peered":"2023-12-16T03:26:20.440533+0000","last_clean":"2023-12-16T03:26:20.440533+0000","last_became_active":"2023-12-16T03:26:03.488037+0000","last_became_peered":"2023-12-16T03:26:03.488037+0000","last_unstale":"2023-12-16T03:26:20.440533+0000","last_undegraded":"2023-12-16T03:26:20.440533+0000","last_fullsized":"2023-12-16T03:26:20.440533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:12:50.117449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418252+0000","last_change":"2023-12-16T03:26:19.619617+0000","last_active":"2023-12-16T03:26:22.418252+0000","last_peered":"2023-12-16T03:26:22.418252+0000","last_clean":"2023-12-16T03:26:22.418252+0000","last_became_active":"2023-12-16T03:26:19.619204+0000","last_became_peered":"2023-12-16T03:26:19.619204+0000","last_unstale":"2023-12-16T03:26:22.418252+0000","last_undegraded":"2023-12-16T03:26:22.418252+0000","last_fullsized":"2023-12-16T03:26:22.418252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:04.240531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.437540+0000","last_change":"2023-12-16T03:26:20.448535+0000","last_active":"2023-12-16T03:26:21.437540+0000","last_peered":"2023-12-16T03:26:21.437540+0000","last_clean":"2023-12-16T03:26:21.437540+0000","last_became_active":"2023-12-16T03:26:20.448268+0000","last_became_peered":"2023-12-16T03:26:20.448268+0000","last_unstale":"2023-12-16T03:26:21.437540+0000","last_undegraded":"2023-12-16T03:26:21.437540+0000","last_fullsized":"2023-12-16T03:26:21.437540+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:19.867911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.441786+0000","last_change":"2023-12-16T03:26:02.462344+0000","last_active":"2023-12-16T03:26:20.441786+0000","last_peered":"2023-12-16T03:26:20.441786+0000","last_clean":"2023-12-16T03:26:20.441786+0000","last_became_active":"2023-12-16T03:26:02.462089+0000","last_became_peered":"2023-12-16T03:26:02.462089+0000","last_unstale":"2023-12-16T03:26:20.441786+0000","last_undegraded":"2023-12-16T03:26:20.441786+0000","last_fullsized":"2023-12-16T03:26:20.441786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440149+0000","last_change":"2023-12-16T03:26:03.465370+0000","last_active":"2023-12-16T03:26:20.440149+0000","last_peered":"2023-12-16T03:26:20.440149+0000","last_clean":"2023-12-16T03:26:20.440149+0000","last_became_active":"2023-12-16T03:26:03.464404+0000","last_became_peered":"2023-12-16T03:26:03.464404+0000","last_unstale":"2023-12-16T03:26:20.440149+0000","last_undegraded":"2023-12-16T03:26:20.440149+0000","last_fullsized":"2023-12-16T03:26:20.440149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:03:34.552057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417865+0000","last_change":"2023-12-16T03:26:19.627153+0000","last_active":"2023-12-16T03:26:22.417865+0000","last_peered":"2023-12-16T03:26:22.417865+0000","last_clean":"2023-12-16T03:26:22.417865+0000","last_became_active":"2023-12-16T03:26:19.626881+0000","last_became_peered":"2023-12-16T03:26:19.626881+0000","last_unstale":"2023-12-16T03:26:22.417865+0000","last_undegraded":"2023-12-16T03:26:22.417865+0000","last_fullsized":"2023-12-16T03:26:22.417865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:30.194895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419840+0000","last_change":"2023-12-16T03:26:20.456281+0000","last_active":"2023-12-16T03:26:22.419840+0000","last_peered":"2023-12-16T03:26:22.419840+0000","last_clean":"2023-12-16T03:26:22.419840+0000","last_became_active":"2023-12-16T03:26:20.455939+0000","last_became_peered":"2023-12-16T03:26:20.455939+0000","last_unstale":"2023-12-16T03:26:22.419840+0000","last_undegraded":"2023-12-16T03:26:22.419840+0000","last_fullsized":"2023-12-16T03:26:22.419840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:12.620002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439880+0000","last_change":"2023-12-16T03:26:02.468837+0000","last_active":"2023-12-16T03:26:20.439880+0000","last_peered":"2023-12-16T03:26:20.439880+0000","last_clean":"2023-12-16T03:26:20.439880+0000","last_became_active":"2023-12-16T03:26:02.468492+0000","last_became_peered":"2023-12-16T03:26:02.468492+0000","last_unstale":"2023-12-16T03:26:20.439880+0000","last_undegraded":"2023-12-16T03:26:20.439880+0000","last_fullsized":"2023-12-16T03:26:20.439880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:51:41.152969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440301+0000","last_change":"2023-12-16T03:26:03.478083+0000","last_active":"2023-12-16T03:26:20.440301+0000","last_peered":"2023-12-16T03:26:20.440301+0000","last_clean":"2023-12-16T03:26:20.440301+0000","last_became_active":"2023-12-16T03:26:03.477716+0000","last_became_peered":"2023-12-16T03:26:03.477716+0000","last_unstale":"2023-12-16T03:26:20.440301+0000","last_undegraded":"2023-12-16T03:26:20.440301+0000","last_fullsized":"2023-12-16T03:26:20.440301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:57.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439872+0000","last_change":"2023-12-16T03:26:19.624459+0000","last_active":"2023-12-16T03:26:21.439872+0000","last_peered":"2023-12-16T03:26:21.439872+0000","last_clean":"2023-12-16T03:26:21.439872+0000","last_became_active":"2023-12-16T03:26:19.624025+0000","last_became_peered":"2023-12-16T03:26:19.624025+0000","last_unstale":"2023-12-16T03:26:21.439872+0000","last_undegraded":"2023-12-16T03:26:21.439872+0000","last_fullsized":"2023-12-16T03:26:21.439872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:52.017636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438213+0000","last_change":"2023-12-16T03:26:20.456022+0000","last_active":"2023-12-16T03:26:21.438213+0000","last_peered":"2023-12-16T03:26:21.438213+0000","last_clean":"2023-12-16T03:26:21.438213+0000","last_became_active":"2023-12-16T03:26:20.455422+0000","last_became_peered":"2023-12-16T03:26:20.455422+0000","last_unstale":"2023-12-16T03:26:21.438213+0000","last_undegraded":"2023-12-16T03:26:21.438213+0000","last_fullsized":"2023-12-16T03:26:21.438213+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:34.575757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439694+0000","last_change":"2023-12-16T03:26:02.462818+0000","last_active":"2023-12-16T03:26:20.439694+0000","last_peered":"2023-12-16T03:26:20.439694+0000","last_clean":"2023-12-16T03:26:20.439694+0000","last_became_active":"2023-12-16T03:26:02.462408+0000","last_became_peered":"2023-12-16T03:26:02.462408+0000","last_unstale":"2023-12-16T03:26:20.439694+0000","last_undegraded":"2023-12-16T03:26:20.439694+0000","last_fullsized":"2023-12-16T03:26:20.439694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:03:40.485273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436207+0000","last_change":"2023-12-16T03:26:03.467717+0000","last_active":"2023-12-16T03:26:20.436207+0000","last_peered":"2023-12-16T03:26:20.436207+0000","last_clean":"2023-12-16T03:26:20.436207+0000","last_became_active":"2023-12-16T03:26:03.467375+0000","last_became_peered":"2023-12-16T03:26:03.467375+0000","last_unstale":"2023-12-16T03:26:20.436207+0000","last_undegraded":"2023-12-16T03:26:20.436207+0000","last_fullsized":"2023-12-16T03:26:20.436207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:03.316544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438153+0000","last_change":"2023-12-16T03:26:19.617998+0000","last_active":"2023-12-16T03:26:21.438153+0000","last_peered":"2023-12-16T03:26:21.438153+0000","last_clean":"2023-12-16T03:26:21.438153+0000","last_became_active":"2023-12-16T03:26:19.617693+0000","last_became_peered":"2023-12-16T03:26:19.617693+0000","last_unstale":"2023-12-16T03:26:21.438153+0000","last_undegraded":"2023-12-16T03:26:21.438153+0000","last_fullsized":"2023-12-16T03:26:21.438153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:19.463912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419040+0000","last_change":"2023-12-16T03:26:20.465562+0000","last_active":"2023-12-16T03:26:22.419040+0000","last_peered":"2023-12-16T03:26:22.419040+0000","last_clean":"2023-12-16T03:26:22.419040+0000","last_became_active":"2023-12-16T03:26:20.464938+0000","last_became_peered":"2023-12-16T03:26:20.464938+0000","last_unstale":"2023-12-16T03:26:22.419040+0000","last_undegraded":"2023-12-16T03:26:22.419040+0000","last_fullsized":"2023-12-16T03:26:22.419040+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:40:35.259144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440602+0000","last_change":"2023-12-16T03:26:02.465496+0000","last_active":"2023-12-16T03:26:20.440602+0000","last_peered":"2023-12-16T03:26:20.440602+0000","last_clean":"2023-12-16T03:26:20.440602+0000","last_became_active":"2023-12-16T03:26:02.465106+0000","last_became_peered":"2023-12-16T03:26:02.465106+0000","last_unstale":"2023-12-16T03:26:20.440602+0000","last_undegraded":"2023-12-16T03:26:20.440602+0000","last_fullsized":"2023-12-16T03:26:20.440602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:47.788469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.451274+0000","last_change":"2023-12-16T03:26:03.468251+0000","last_active":"2023-12-16T03:26:20.451274+0000","last_peered":"2023-12-16T03:26:20.451274+0000","last_clean":"2023-12-16T03:26:20.451274+0000","last_became_active":"2023-12-16T03:26:03.467778+0000","last_became_peered":"2023-12-16T03:26:03.467778+0000","last_unstale":"2023-12-16T03:26:20.451274+0000","last_undegraded":"2023-12-16T03:26:20.451274+0000","last_fullsized":"2023-12-16T03:26:20.451274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:26.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418396+0000","last_change":"2023-12-16T03:26:19.607952+0000","last_active":"2023-12-16T03:26:22.418396+0000","last_peered":"2023-12-16T03:26:22.418396+0000","last_clean":"2023-12-16T03:26:22.418396+0000","last_became_active":"2023-12-16T03:26:19.607665+0000","last_became_peered":"2023-12-16T03:26:19.607665+0000","last_unstale":"2023-12-16T03:26:22.418396+0000","last_undegraded":"2023-12-16T03:26:22.418396+0000","last_fullsized":"2023-12-16T03:26:22.418396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:05:23.233712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418705+0000","last_change":"2023-12-16T03:26:20.465797+0000","last_active":"2023-12-16T03:26:22.418705+0000","last_peered":"2023-12-16T03:26:22.418705+0000","last_clean":"2023-12-16T03:26:22.418705+0000","last_became_active":"2023-12-16T03:26:20.465412+0000","last_became_peered":"2023-12-16T03:26:20.465412+0000","last_unstale":"2023-12-16T03:26:22.418705+0000","last_undegraded":"2023-12-16T03:26:22.418705+0000","last_fullsized":"2023-12-16T03:26:22.418705+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:23:05.990689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436794+0000","last_change":"2023-12-16T03:26:02.473227+0000","last_active":"2023-12-16T03:26:20.436794+0000","last_peered":"2023-12-16T03:26:20.436794+0000","last_clean":"2023-12-16T03:26:20.436794+0000","last_became_active":"2023-12-16T03:26:02.472888+0000","last_became_peered":"2023-12-16T03:26:02.472888+0000","last_unstale":"2023-12-16T03:26:20.436794+0000","last_undegraded":"2023-12-16T03:26:20.436794+0000","last_fullsized":"2023-12-16T03:26:20.436794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:33.338093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440523+0000","last_change":"2023-12-16T03:26:03.463781+0000","last_active":"2023-12-16T03:26:20.440523+0000","last_peered":"2023-12-16T03:26:20.440523+0000","last_clean":"2023-12-16T03:26:20.440523+0000","last_became_active":"2023-12-16T03:26:03.463448+0000","last_became_peered":"2023-12-16T03:26:03.463448+0000","last_unstale":"2023-12-16T03:26:20.440523+0000","last_undegraded":"2023-12-16T03:26:20.440523+0000","last_fullsized":"2023-12-16T03:26:20.440523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:54:09.793159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440509+0000","last_change":"2023-12-16T03:26:19.617206+0000","last_active":"2023-12-16T03:26:21.440509+0000","last_peered":"2023-12-16T03:26:21.440509+0000","last_clean":"2023-12-16T03:26:21.440509+0000","last_became_active":"2023-12-16T03:26:19.616070+0000","last_became_peered":"2023-12-16T03:26:19.616070+0000","last_unstale":"2023-12-16T03:26:21.440509+0000","last_undegraded":"2023-12-16T03:26:21.440509+0000","last_fullsized":"2023-12-16T03:26:21.440509+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:23:56.774020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419471+0000","last_change":"2023-12-16T03:26:20.452010+0000","last_active":"2023-12-16T03:26:22.419471+0000","last_peered":"2023-12-16T03:26:22.419471+0000","last_clean":"2023-12-16T03:26:22.419471+0000","last_became_active":"2023-12-16T03:26:20.451299+0000","last_became_peered":"2023-12-16T03:26:20.451299+0000","last_unstale":"2023-12-16T03:26:22.419471+0000","last_undegraded":"2023-12-16T03:26:22.419471+0000","last_fullsized":"2023-12-16T03:26:22.419471+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:17:13.539226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449567+0000","last_change":"2023-12-16T03:26:02.475063+0000","last_active":"2023-12-16T03:26:20.449567+0000","last_peered":"2023-12-16T03:26:20.449567+0000","last_clean":"2023-12-16T03:26:20.449567+0000","last_became_active":"2023-12-16T03:26:02.474759+0000","last_became_peered":"2023-12-16T03:26:02.474759+0000","last_unstale":"2023-12-16T03:26:20.449567+0000","last_undegraded":"2023-12-16T03:26:20.449567+0000","last_fullsized":"2023-12-16T03:26:20.449567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:20:29.012213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467844+0000","last_change":"2023-12-16T03:26:03.461431+0000","last_active":"2023-12-16T03:26:20.467844+0000","last_peered":"2023-12-16T03:26:20.467844+0000","last_clean":"2023-12-16T03:26:20.467844+0000","last_became_active":"2023-12-16T03:26:03.460669+0000","last_became_peered":"2023-12-16T03:26:03.460669+0000","last_unstale":"2023-12-16T03:26:20.467844+0000","last_undegraded":"2023-12-16T03:26:20.467844+0000","last_fullsized":"2023-12-16T03:26:20.467844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:05:14.653208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418852+0000","last_change":"2023-12-16T03:26:19.616483+0000","last_active":"2023-12-16T03:26:22.418852+0000","last_peered":"2023-12-16T03:26:22.418852+0000","last_clean":"2023-12-16T03:26:22.418852+0000","last_became_active":"2023-12-16T03:26:19.616075+0000","last_became_peered":"2023-12-16T03:26:19.616075+0000","last_unstale":"2023-12-16T03:26:22.418852+0000","last_undegraded":"2023-12-16T03:26:22.418852+0000","last_fullsized":"2023-12-16T03:26:22.418852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:50:55.667657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418416+0000","last_change":"2023-12-16T03:26:20.465602+0000","last_active":"2023-12-16T03:26:22.418416+0000","last_peered":"2023-12-16T03:26:22.418416+0000","last_clean":"2023-12-16T03:26:22.418416+0000","last_became_active":"2023-12-16T03:26:20.465128+0000","last_became_peered":"2023-12-16T03:26:20.465128+0000","last_unstale":"2023-12-16T03:26:22.418416+0000","last_undegraded":"2023-12-16T03:26:22.418416+0000","last_fullsized":"2023-12-16T03:26:22.418416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:09.665430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449402+0000","last_change":"2023-12-16T03:26:02.471444+0000","last_active":"2023-12-16T03:26:20.449402+0000","last_peered":"2023-12-16T03:26:20.449402+0000","last_clean":"2023-12-16T03:26:20.449402+0000","last_became_active":"2023-12-16T03:26:02.468577+0000","last_became_peered":"2023-12-16T03:26:02.468577+0000","last_unstale":"2023-12-16T03:26:20.449402+0000","last_undegraded":"2023-12-16T03:26:20.449402+0000","last_fullsized":"2023-12-16T03:26:20.449402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:01.713589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.437151+0000","last_change":"2023-12-16T03:26:03.470996+0000","last_active":"2023-12-16T03:26:20.437151+0000","last_peered":"2023-12-16T03:26:20.437151+0000","last_clean":"2023-12-16T03:26:20.437151+0000","last_became_active":"2023-12-16T03:26:03.465985+0000","last_became_peered":"2023-12-16T03:26:03.465985+0000","last_unstale":"2023-12-16T03:26:20.437151+0000","last_undegraded":"2023-12-16T03:26:20.437151+0000","last_fullsized":"2023-12-16T03:26:20.437151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:17.425373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418008+0000","last_change":"2023-12-16T03:26:19.623263+0000","last_active":"2023-12-16T03:26:22.418008+0000","last_peered":"2023-12-16T03:26:22.418008+0000","last_clean":"2023-12-16T03:26:22.418008+0000","last_became_active":"2023-12-16T03:26:19.622800+0000","last_became_peered":"2023-12-16T03:26:19.622800+0000","last_unstale":"2023-12-16T03:26:22.418008+0000","last_undegraded":"2023-12-16T03:26:22.418008+0000","last_fullsized":"2023-12-16T03:26:22.418008+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:23.181079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418760+0000","last_change":"2023-12-16T03:26:20.469018+0000","last_active":"2023-12-16T03:26:22.418760+0000","last_peered":"2023-12-16T03:26:22.418760+0000","last_clean":"2023-12-16T03:26:22.418760+0000","last_became_active":"2023-12-16T03:26:20.468716+0000","last_became_peered":"2023-12-16T03:26:20.468716+0000","last_unstale":"2023-12-16T03:26:22.418760+0000","last_undegraded":"2023-12-16T03:26:22.418760+0000","last_fullsized":"2023-12-16T03:26:22.418760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:08:20.172514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.434817+0000","last_change":"2023-12-16T03:26:02.465815+0000","last_active":"2023-12-16T03:26:20.434817+0000","last_peered":"2023-12-16T03:26:20.434817+0000","last_clean":"2023-12-16T03:26:20.434817+0000","last_became_active":"2023-12-16T03:26:02.465505+0000","last_became_peered":"2023-12-16T03:26:02.465505+0000","last_unstale":"2023-12-16T03:26:20.434817+0000","last_undegraded":"2023-12-16T03:26:20.434817+0000","last_fullsized":"2023-12-16T03:26:20.434817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:50.926184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449230+0000","last_change":"2023-12-16T03:26:03.488277+0000","last_active":"2023-12-16T03:26:20.449230+0000","last_peered":"2023-12-16T03:26:20.449230+0000","last_clean":"2023-12-16T03:26:20.449230+0000","last_became_active":"2023-12-16T03:26:03.488021+0000","last_became_peered":"2023-12-16T03:26:03.488021+0000","last_unstale":"2023-12-16T03:26:20.449230+0000","last_undegraded":"2023-12-16T03:26:20.449230+0000","last_fullsized":"2023-12-16T03:26:20.449230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:02.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418222+0000","last_change":"2023-12-16T03:26:19.624536+0000","last_active":"2023-12-16T03:26:22.418222+0000","last_peered":"2023-12-16T03:26:22.418222+0000","last_clean":"2023-12-16T03:26:22.418222+0000","last_became_active":"2023-12-16T03:26:19.624198+0000","last_became_peered":"2023-12-16T03:26:19.624198+0000","last_unstale":"2023-12-16T03:26:22.418222+0000","last_undegraded":"2023-12-16T03:26:22.418222+0000","last_fullsized":"2023-12-16T03:26:22.418222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:55.024529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417501+0000","last_change":"2023-12-16T03:26:20.458063+0000","last_active":"2023-12-16T03:26:22.417501+0000","last_peered":"2023-12-16T03:26:22.417501+0000","last_clean":"2023-12-16T03:26:22.417501+0000","last_became_active":"2023-12-16T03:26:20.457750+0000","last_became_peered":"2023-12-16T03:26:20.457750+0000","last_unstale":"2023-12-16T03:26:22.417501+0000","last_undegraded":"2023-12-16T03:26:22.417501+0000","last_fullsized":"2023-12-16T03:26:22.417501+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:46:24.768721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439563+0000","last_change":"2023-12-16T03:26:02.464973+0000","last_active":"2023-12-16T03:26:20.439563+0000","last_peered":"2023-12-16T03:26:20.439563+0000","last_clean":"2023-12-16T03:26:20.439563+0000","last_became_active":"2023-12-16T03:26:02.464672+0000","last_became_peered":"2023-12-16T03:26:02.464672+0000","last_unstale":"2023-12-16T03:26:20.439563+0000","last_undegraded":"2023-12-16T03:26:20.439563+0000","last_fullsized":"2023-12-16T03:26:20.439563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:57.467406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.434700+0000","last_change":"2023-12-16T03:26:03.478499+0000","last_active":"2023-12-16T03:26:20.434700+0000","last_peered":"2023-12-16T03:26:20.434700+0000","last_clean":"2023-12-16T03:26:20.434700+0000","last_became_active":"2023-12-16T03:26:03.478234+0000","last_became_peered":"2023-12-16T03:26:03.478234+0000","last_unstale":"2023-12-16T03:26:20.434700+0000","last_undegraded":"2023-12-16T03:26:20.434700+0000","last_fullsized":"2023-12-16T03:26:20.434700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:54:09.793159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419618+0000","last_change":"2023-12-16T03:26:19.619836+0000","last_active":"2023-12-16T03:26:22.419618+0000","last_peered":"2023-12-16T03:26:22.419618+0000","last_clean":"2023-12-16T03:26:22.419618+0000","last_became_active":"2023-12-16T03:26:19.619564+0000","last_became_peered":"2023-12-16T03:26:19.619564+0000","last_unstale":"2023-12-16T03:26:22.419618+0000","last_undegraded":"2023-12-16T03:26:22.419618+0000","last_fullsized":"2023-12-16T03:26:22.419618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:47.160233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419306+0000","last_change":"2023-12-16T03:26:20.459542+0000","last_active":"2023-12-16T03:26:22.419306+0000","last_peered":"2023-12-16T03:26:22.419306+0000","last_clean":"2023-12-16T03:26:22.419306+0000","last_became_active":"2023-12-16T03:26:20.459202+0000","last_became_peered":"2023-12-16T03:26:20.459202+0000","last_unstale":"2023-12-16T03:26:22.419306+0000","last_undegraded":"2023-12-16T03:26:22.419306+0000","last_fullsized":"2023-12-16T03:26:22.419306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:40:24.184095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"32'9","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453577+0000","last_change":"2023-12-16T03:26:02.474073+0000","last_active":"2023-12-16T03:26:20.453577+0000","last_peered":"2023-12-16T03:26:20.453577+0000","last_clean":"2023-12-16T03:26:20.453577+0000","last_became_active":"2023-12-16T03:26:02.473771+0000","last_became_peered":"2023-12-16T03:26:02.473771+0000","last_unstale":"2023-12-16T03:26:20.453577+0000","last_undegraded":"2023-12-16T03:26:20.453577+0000","last_fullsized":"2023-12-16T03:26:20.453577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:16.421435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450587+0000","last_change":"2023-12-16T03:26:03.464062+0000","last_active":"2023-12-16T03:26:20.450587+0000","last_peered":"2023-12-16T03:26:20.450587+0000","last_clean":"2023-12-16T03:26:20.450587+0000","last_became_active":"2023-12-16T03:26:03.463527+0000","last_became_peered":"2023-12-16T03:26:03.463527+0000","last_unstale":"2023-12-16T03:26:20.450587+0000","last_undegraded":"2023-12-16T03:26:20.450587+0000","last_fullsized":"2023-12-16T03:26:20.450587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:58:06.441852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419861+0000","last_change":"2023-12-16T03:26:19.624138+0000","last_active":"2023-12-16T03:26:22.419861+0000","last_peered":"2023-12-16T03:26:22.419861+0000","last_clean":"2023-12-16T03:26:22.419861+0000","last_became_active":"2023-12-16T03:26:19.623526+0000","last_became_peered":"2023-12-16T03:26:19.623526+0000","last_unstale":"2023-12-16T03:26:22.419861+0000","last_undegraded":"2023-12-16T03:26:22.419861+0000","last_fullsized":"2023-12-16T03:26:22.419861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:53:04.240531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439837+0000","last_change":"2023-12-16T03:26:20.456569+0000","last_active":"2023-12-16T03:26:21.439837+0000","last_peered":"2023-12-16T03:26:21.439837+0000","last_clean":"2023-12-16T03:26:21.439837+0000","last_became_active":"2023-12-16T03:26:20.455970+0000","last_became_peered":"2023-12-16T03:26:20.455970+0000","last_unstale":"2023-12-16T03:26:21.439837+0000","last_undegraded":"2023-12-16T03:26:21.439837+0000","last_fullsized":"2023-12-16T03:26:21.439837+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:04.033541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450754+0000","last_change":"2023-12-16T03:26:02.461467+0000","last_active":"2023-12-16T03:26:20.450754+0000","last_peered":"2023-12-16T03:26:20.450754+0000","last_clean":"2023-12-16T03:26:20.450754+0000","last_became_active":"2023-12-16T03:26:02.461144+0000","last_became_peered":"2023-12-16T03:26:02.461144+0000","last_unstale":"2023-12-16T03:26:20.450754+0000","last_undegraded":"2023-12-16T03:26:20.450754+0000","last_fullsized":"2023-12-16T03:26:20.450754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:02.312606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453436+0000","last_change":"2023-12-16T03:26:03.477196+0000","last_active":"2023-12-16T03:26:20.453436+0000","last_peered":"2023-12-16T03:26:20.453436+0000","last_clean":"2023-12-16T03:26:20.453436+0000","last_became_active":"2023-12-16T03:26:03.473620+0000","last_became_peered":"2023-12-16T03:26:03.473620+0000","last_unstale":"2023-12-16T03:26:20.453436+0000","last_undegraded":"2023-12-16T03:26:20.453436+0000","last_fullsized":"2023-12-16T03:26:20.453436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:57:09.113670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440019+0000","last_change":"2023-12-16T03:26:19.625092+0000","last_active":"2023-12-16T03:26:21.440019+0000","last_peered":"2023-12-16T03:26:21.440019+0000","last_clean":"2023-12-16T03:26:21.440019+0000","last_became_active":"2023-12-16T03:26:19.624783+0000","last_became_peered":"2023-12-16T03:26:19.624783+0000","last_unstale":"2023-12-16T03:26:21.440019+0000","last_undegraded":"2023-12-16T03:26:21.440019+0000","last_fullsized":"2023-12-16T03:26:21.440019+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:40:34.256128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419269+0000","last_change":"2023-12-16T03:26:20.448413+0000","last_active":"2023-12-16T03:26:22.419269+0000","last_peered":"2023-12-16T03:26:22.419269+0000","last_clean":"2023-12-16T03:26:22.419269+0000","last_became_active":"2023-12-16T03:26:20.447923+0000","last_became_peered":"2023-12-16T03:26:20.447923+0000","last_unstale":"2023-12-16T03:26:22.419269+0000","last_undegraded":"2023-12-16T03:26:22.419269+0000","last_fullsized":"2023-12-16T03:26:22.419269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:29.167009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443814+0000","last_change":"2023-12-16T03:26:02.449876+0000","last_active":"2023-12-16T03:26:20.443814+0000","last_peered":"2023-12-16T03:26:20.443814+0000","last_clean":"2023-12-16T03:26:20.443814+0000","last_became_active":"2023-12-16T03:26:02.449358+0000","last_became_peered":"2023-12-16T03:26:02.449358+0000","last_unstale":"2023-12-16T03:26:20.443814+0000","last_undegraded":"2023-12-16T03:26:20.443814+0000","last_fullsized":"2023-12-16T03:26:20.443814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:12:31.574264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453803+0000","last_change":"2023-12-16T03:26:03.477278+0000","last_active":"2023-12-16T03:26:20.453803+0000","last_peered":"2023-12-16T03:26:20.453803+0000","last_clean":"2023-12-16T03:26:20.453803+0000","last_became_active":"2023-12-16T03:26:03.476986+0000","last_became_peered":"2023-12-16T03:26:03.476986+0000","last_unstale":"2023-12-16T03:26:20.453803+0000","last_undegraded":"2023-12-16T03:26:20.453803+0000","last_fullsized":"2023-12-16T03:26:20.453803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:48.840305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.437914+0000","last_change":"2023-12-16T03:26:19.626506+0000","last_active":"2023-12-16T03:26:21.437914+0000","last_peered":"2023-12-16T03:26:21.437914+0000","last_clean":"2023-12-16T03:26:21.437914+0000","last_became_active":"2023-12-16T03:26:19.626121+0000","last_became_peered":"2023-12-16T03:26:19.626121+0000","last_unstale":"2023-12-16T03:26:21.437914+0000","last_undegraded":"2023-12-16T03:26:21.437914+0000","last_fullsized":"2023-12-16T03:26:21.437914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:06.753971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418305+0000","last_change":"2023-12-16T03:26:20.464292+0000","last_active":"2023-12-16T03:26:22.418305+0000","last_peered":"2023-12-16T03:26:22.418305+0000","last_clean":"2023-12-16T03:26:22.418305+0000","last_became_active":"2023-12-16T03:26:20.464032+0000","last_became_peered":"2023-12-16T03:26:20.464032+0000","last_unstale":"2023-12-16T03:26:22.418305+0000","last_undegraded":"2023-12-16T03:26:22.418305+0000","last_fullsized":"2023-12-16T03:26:22.418305+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:14:56.935089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453885+0000","last_change":"2023-12-16T03:26:02.468514+0000","last_active":"2023-12-16T03:26:20.453885+0000","last_peered":"2023-12-16T03:26:20.453885+0000","last_clean":"2023-12-16T03:26:20.453885+0000","last_became_active":"2023-12-16T03:26:02.467879+0000","last_became_peered":"2023-12-16T03:26:02.467879+0000","last_unstale":"2023-12-16T03:26:20.453885+0000","last_undegraded":"2023-12-16T03:26:20.453885+0000","last_fullsized":"2023-12-16T03:26:20.453885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:49:53.032485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.452784+0000","last_change":"2023-12-16T03:26:03.479982+0000","last_active":"2023-12-16T03:26:20.452784+0000","last_peered":"2023-12-16T03:26:20.452784+0000","last_clean":"2023-12-16T03:26:20.452784+0000","last_became_active":"2023-12-16T03:26:03.479683+0000","last_became_peered":"2023-12-16T03:26:03.479683+0000","last_unstale":"2023-12-16T03:26:20.452784+0000","last_undegraded":"2023-12-16T03:26:20.452784+0000","last_fullsized":"2023-12-16T03:26:20.452784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:02.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419518+0000","last_change":"2023-12-16T03:26:19.624445+0000","last_active":"2023-12-16T03:26:22.419518+0000","last_peered":"2023-12-16T03:26:22.419518+0000","last_clean":"2023-12-16T03:26:22.419518+0000","last_became_active":"2023-12-16T03:26:19.624069+0000","last_became_peered":"2023-12-16T03:26:19.624069+0000","last_unstale":"2023-12-16T03:26:22.419518+0000","last_undegraded":"2023-12-16T03:26:22.419518+0000","last_fullsized":"2023-12-16T03:26:22.419518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:17.854097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419300+0000","last_change":"2023-12-16T03:26:20.448920+0000","last_active":"2023-12-16T03:26:22.419300+0000","last_peered":"2023-12-16T03:26:22.419300+0000","last_clean":"2023-12-16T03:26:22.419300+0000","last_became_active":"2023-12-16T03:26:20.448642+0000","last_became_peered":"2023-12-16T03:26:20.448642+0000","last_unstale":"2023-12-16T03:26:22.419300+0000","last_undegraded":"2023-12-16T03:26:22.419300+0000","last_fullsized":"2023-12-16T03:26:22.419300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:18.857113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438831+0000","last_change":"2023-12-16T03:26:02.465231+0000","last_active":"2023-12-16T03:26:20.438831+0000","last_peered":"2023-12-16T03:26:20.438831+0000","last_clean":"2023-12-16T03:26:20.438831+0000","last_became_active":"2023-12-16T03:26:02.464573+0000","last_became_peered":"2023-12-16T03:26:02.464573+0000","last_unstale":"2023-12-16T03:26:20.438831+0000","last_undegraded":"2023-12-16T03:26:20.438831+0000","last_fullsized":"2023-12-16T03:26:20.438831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:02:56.400903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.434796+0000","last_change":"2023-12-16T03:26:03.471650+0000","last_active":"2023-12-16T03:26:20.434796+0000","last_peered":"2023-12-16T03:26:20.434796+0000","last_clean":"2023-12-16T03:26:20.434796+0000","last_became_active":"2023-12-16T03:26:03.471351+0000","last_became_peered":"2023-12-16T03:26:03.471351+0000","last_unstale":"2023-12-16T03:26:20.434796+0000","last_undegraded":"2023-12-16T03:26:20.434796+0000","last_fullsized":"2023-12-16T03:26:20.434796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:49.203240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439193+0000","last_change":"2023-12-16T03:26:19.626708+0000","last_active":"2023-12-16T03:26:21.439193+0000","last_peered":"2023-12-16T03:26:21.439193+0000","last_clean":"2023-12-16T03:26:21.439193+0000","last_became_active":"2023-12-16T03:26:19.626435+0000","last_became_peered":"2023-12-16T03:26:19.626435+0000","last_unstale":"2023-12-16T03:26:21.439193+0000","last_undegraded":"2023-12-16T03:26:21.439193+0000","last_fullsized":"2023-12-16T03:26:21.439193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:55.024529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439173+0000","last_change":"2023-12-16T03:26:20.468976+0000","last_active":"2023-12-16T03:26:21.439173+0000","last_peered":"2023-12-16T03:26:21.439173+0000","last_clean":"2023-12-16T03:26:21.439173+0000","last_became_active":"2023-12-16T03:26:20.468590+0000","last_became_peered":"2023-12-16T03:26:20.468590+0000","last_unstale":"2023-12-16T03:26:21.439173+0000","last_undegraded":"2023-12-16T03:26:21.439173+0000","last_fullsized":"2023-12-16T03:26:21.439173+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:09:31.197911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449282+0000","last_change":"2023-12-16T03:26:02.467098+0000","last_active":"2023-12-16T03:26:20.449282+0000","last_peered":"2023-12-16T03:26:20.449282+0000","last_clean":"2023-12-16T03:26:20.449282+0000","last_became_active":"2023-12-16T03:26:02.464042+0000","last_became_peered":"2023-12-16T03:26:02.464042+0000","last_unstale":"2023-12-16T03:26:20.449282+0000","last_undegraded":"2023-12-16T03:26:20.449282+0000","last_fullsized":"2023-12-16T03:26:20.449282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:32:02.312606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439139+0000","last_change":"2023-12-16T03:26:03.457030+0000","last_active":"2023-12-16T03:26:20.439139+0000","last_peered":"2023-12-16T03:26:20.439139+0000","last_clean":"2023-12-16T03:26:20.439139+0000","last_became_active":"2023-12-16T03:26:03.456705+0000","last_became_peered":"2023-12-16T03:26:03.456705+0000","last_unstale":"2023-12-16T03:26:20.439139+0000","last_undegraded":"2023-12-16T03:26:20.439139+0000","last_fullsized":"2023-12-16T03:26:20.439139+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:51.930122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417899+0000","last_change":"2023-12-16T03:26:19.618708+0000","last_active":"2023-12-16T03:26:22.417899+0000","last_peered":"2023-12-16T03:26:22.417899+0000","last_clean":"2023-12-16T03:26:22.417899+0000","last_became_active":"2023-12-16T03:26:19.618259+0000","last_became_peered":"2023-12-16T03:26:19.618259+0000","last_unstale":"2023-12-16T03:26:22.417899+0000","last_undegraded":"2023-12-16T03:26:22.417899+0000","last_fullsized":"2023-12-16T03:26:22.417899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:48:28.163993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418730+0000","last_change":"2023-12-16T03:26:20.469361+0000","last_active":"2023-12-16T03:26:22.418730+0000","last_peered":"2023-12-16T03:26:22.418730+0000","last_clean":"2023-12-16T03:26:22.418730+0000","last_became_active":"2023-12-16T03:26:20.468034+0000","last_became_peered":"2023-12-16T03:26:20.468034+0000","last_unstale":"2023-12-16T03:26:22.418730+0000","last_undegraded":"2023-12-16T03:26:22.418730+0000","last_fullsized":"2023-12-16T03:26:22.418730+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:56.027545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439567+0000","last_change":"2023-12-16T03:26:02.472832+0000","last_active":"2023-12-16T03:26:20.439567+0000","last_peered":"2023-12-16T03:26:20.439567+0000","last_clean":"2023-12-16T03:26:20.439567+0000","last_became_active":"2023-12-16T03:26:02.472574+0000","last_became_peered":"2023-12-16T03:26:02.472574+0000","last_unstale":"2023-12-16T03:26:20.439567+0000","last_undegraded":"2023-12-16T03:26:20.439567+0000","last_fullsized":"2023-12-16T03:26:20.439567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:06:19.149617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450780+0000","last_change":"2023-12-16T03:26:03.479561+0000","last_active":"2023-12-16T03:26:20.450780+0000","last_peered":"2023-12-16T03:26:20.450780+0000","last_clean":"2023-12-16T03:26:20.450780+0000","last_became_active":"2023-12-16T03:26:03.478239+0000","last_became_peered":"2023-12-16T03:26:03.478239+0000","last_unstale":"2023-12-16T03:26:20.450780+0000","last_undegraded":"2023-12-16T03:26:20.450780+0000","last_fullsized":"2023-12-16T03:26:20.450780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:54.768138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418132+0000","last_change":"2023-12-16T03:26:19.617290+0000","last_active":"2023-12-16T03:26:22.418132+0000","last_peered":"2023-12-16T03:26:22.418132+0000","last_clean":"2023-12-16T03:26:22.418132+0000","last_became_active":"2023-12-16T03:26:19.616895+0000","last_became_peered":"2023-12-16T03:26:19.616895+0000","last_unstale":"2023-12-16T03:26:22.418132+0000","last_undegraded":"2023-12-16T03:26:22.418132+0000","last_fullsized":"2023-12-16T03:26:22.418132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:23:04.987673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418047+0000","last_change":"2023-12-16T03:26:20.452871+0000","last_active":"2023-12-16T03:26:22.418047+0000","last_peered":"2023-12-16T03:26:22.418047+0000","last_clean":"2023-12-16T03:26:22.418047+0000","last_became_active":"2023-12-16T03:26:20.452589+0000","last_became_peered":"2023-12-16T03:26:20.452589+0000","last_unstale":"2023-12-16T03:26:22.418047+0000","last_undegraded":"2023-12-16T03:26:22.418047+0000","last_fullsized":"2023-12-16T03:26:22.418047+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:17.970880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439462+0000","last_change":"2023-12-16T03:26:02.469331+0000","last_active":"2023-12-16T03:26:20.439462+0000","last_peered":"2023-12-16T03:26:20.439462+0000","last_clean":"2023-12-16T03:26:20.439462+0000","last_became_active":"2023-12-16T03:26:02.469083+0000","last_became_peered":"2023-12-16T03:26:02.469083+0000","last_unstale":"2023-12-16T03:26:20.439462+0000","last_undegraded":"2023-12-16T03:26:20.439462+0000","last_fullsized":"2023-12-16T03:26:20.439462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:03:33.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438140+0000","last_change":"2023-12-16T03:26:03.469292+0000","last_active":"2023-12-16T03:26:20.438140+0000","last_peered":"2023-12-16T03:26:20.438140+0000","last_clean":"2023-12-16T03:26:20.438140+0000","last_became_active":"2023-12-16T03:26:03.468311+0000","last_became_peered":"2023-12-16T03:26:03.468311+0000","last_unstale":"2023-12-16T03:26:20.438140+0000","last_undegraded":"2023-12-16T03:26:20.438140+0000","last_fullsized":"2023-12-16T03:26:20.438140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:49:54.036423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438385+0000","last_change":"2023-12-16T03:26:19.615945+0000","last_active":"2023-12-16T03:26:21.438385+0000","last_peered":"2023-12-16T03:26:21.438385+0000","last_clean":"2023-12-16T03:26:21.438385+0000","last_became_active":"2023-12-16T03:26:19.615613+0000","last_became_peered":"2023-12-16T03:26:19.615613+0000","last_unstale":"2023-12-16T03:26:21.438385+0000","last_undegraded":"2023-12-16T03:26:21.438385+0000","last_fullsized":"2023-12-16T03:26:21.438385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:50:55.667657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419187+0000","last_change":"2023-12-16T03:26:20.465884+0000","last_active":"2023-12-16T03:26:22.419187+0000","last_peered":"2023-12-16T03:26:22.419187+0000","last_clean":"2023-12-16T03:26:22.419187+0000","last_became_active":"2023-12-16T03:26:20.465542+0000","last_became_peered":"2023-12-16T03:26:20.465542+0000","last_unstale":"2023-12-16T03:26:22.419187+0000","last_undegraded":"2023-12-16T03:26:22.419187+0000","last_fullsized":"2023-12-16T03:26:22.419187+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:31.461913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440019+0000","last_change":"2023-12-16T03:26:19.624375+0000","last_active":"2023-12-16T03:26:21.440019+0000","last_peered":"2023-12-16T03:26:21.440019+0000","last_clean":"2023-12-16T03:26:21.440019+0000","last_became_active":"2023-12-16T03:26:19.624022+0000","last_became_peered":"2023-12-16T03:26:19.624022+0000","last_unstale":"2023-12-16T03:26:21.440019+0000","last_undegraded":"2023-12-16T03:26:21.440019+0000","last_fullsized":"2023-12-16T03:26:21.440019+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:30.458897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440563+0000","last_change":"2023-12-16T03:26:02.473812+0000","last_active":"2023-12-16T03:26:20.440563+0000","last_peered":"2023-12-16T03:26:20.440563+0000","last_clean":"2023-12-16T03:26:20.440563+0000","last_became_active":"2023-12-16T03:26:02.473426+0000","last_became_peered":"2023-12-16T03:26:02.473426+0000","last_unstale":"2023-12-16T03:26:20.440563+0000","last_undegraded":"2023-12-16T03:26:20.440563+0000","last_fullsized":"2023-12-16T03:26:20.440563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:03:40.485273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436231+0000","last_change":"2023-12-16T03:26:03.472003+0000","last_active":"2023-12-16T03:26:20.436231+0000","last_peered":"2023-12-16T03:26:20.436231+0000","last_clean":"2023-12-16T03:26:20.436231+0000","last_became_active":"2023-12-16T03:26:03.468759+0000","last_became_peered":"2023-12-16T03:26:03.468759+0000","last_unstale":"2023-12-16T03:26:20.436231+0000","last_undegraded":"2023-12-16T03:26:20.436231+0000","last_fullsized":"2023-12-16T03:26:20.436231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:20:30.016150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.421167+0000","last_change":"2023-12-16T03:26:20.457713+0000","last_active":"2023-12-16T03:26:22.421167+0000","last_peered":"2023-12-16T03:26:22.421167+0000","last_clean":"2023-12-16T03:26:22.421167+0000","last_became_active":"2023-12-16T03:26:20.457476+0000","last_became_peered":"2023-12-16T03:26:20.457476+0000","last_unstale":"2023-12-16T03:26:22.421167+0000","last_undegraded":"2023-12-16T03:26:22.421167+0000","last_fullsized":"2023-12-16T03:26:22.421167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:53.020651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"35'4","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.420349+0000","last_change":"2023-12-16T03:26:19.609573+0000","last_active":"2023-12-16T03:26:22.420349+0000","last_peered":"2023-12-16T03:26:22.420349+0000","last_clean":"2023-12-16T03:26:22.420349+0000","last_became_active":"2023-12-16T03:26:19.609247+0000","last_became_peered":"2023-12-16T03:26:19.609247+0000","last_unstale":"2023-12-16T03:26:22.420349+0000","last_undegraded":"2023-12-16T03:26:22.420349+0000","last_fullsized":"2023-12-16T03:26:22.420349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:03:53.843632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453059+0000","last_change":"2023-12-16T03:26:02.475790+0000","last_active":"2023-12-16T03:26:20.453059+0000","last_peered":"2023-12-16T03:26:20.453059+0000","last_clean":"2023-12-16T03:26:20.453059+0000","last_became_active":"2023-12-16T03:26:02.475486+0000","last_became_peered":"2023-12-16T03:26:02.475486+0000","last_unstale":"2023-12-16T03:26:20.453059+0000","last_undegraded":"2023-12-16T03:26:20.453059+0000","last_fullsized":"2023-12-16T03:26:20.453059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:46.046497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439803+0000","last_change":"2023-12-16T03:26:03.459560+0000","last_active":"2023-12-16T03:26:20.439803+0000","last_peered":"2023-12-16T03:26:20.439803+0000","last_clean":"2023-12-16T03:26:20.439803+0000","last_became_active":"2023-12-16T03:26:03.459280+0000","last_became_peered":"2023-12-16T03:26:03.459280+0000","last_unstale":"2023-12-16T03:26:20.439803+0000","last_undegraded":"2023-12-16T03:26:20.439803+0000","last_fullsized":"2023-12-16T03:26:20.439803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:55:49.203240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.420891+0000","last_change":"2023-12-16T03:26:20.463003+0000","last_active":"2023-12-16T03:26:22.420891+0000","last_peered":"2023-12-16T03:26:22.420891+0000","last_clean":"2023-12-16T03:26:22.420891+0000","last_became_active":"2023-12-16T03:26:20.462747+0000","last_became_peered":"2023-12-16T03:26:20.462747+0000","last_unstale":"2023-12-16T03:26:22.420891+0000","last_undegraded":"2023-12-16T03:26:22.420891+0000","last_fullsized":"2023-12-16T03:26:22.420891+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:40:35.259144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443736+0000","last_change":"2023-12-16T03:26:02.464156+0000","last_active":"2023-12-16T03:26:20.443736+0000","last_peered":"2023-12-16T03:26:20.443736+0000","last_clean":"2023-12-16T03:26:20.443736+0000","last_became_active":"2023-12-16T03:26:02.463875+0000","last_became_peered":"2023-12-16T03:26:02.463875+0000","last_unstale":"2023-12-16T03:26:20.443736+0000","last_undegraded":"2023-12-16T03:26:20.443736+0000","last_fullsized":"2023-12-16T03:26:20.443736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:43:30.694828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467415+0000","last_change":"2023-12-16T03:26:03.470105+0000","last_active":"2023-12-16T03:26:20.467415+0000","last_peered":"2023-12-16T03:26:20.467415+0000","last_clean":"2023-12-16T03:26:20.467415+0000","last_became_active":"2023-12-16T03:26:03.469690+0000","last_became_peered":"2023-12-16T03:26:03.469690+0000","last_unstale":"2023-12-16T03:26:20.467415+0000","last_undegraded":"2023-12-16T03:26:20.467415+0000","last_fullsized":"2023-12-16T03:26:20.467415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:54.963780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419016+0000","last_change":"2023-12-16T03:26:19.620484+0000","last_active":"2023-12-16T03:26:22.419016+0000","last_peered":"2023-12-16T03:26:22.419016+0000","last_clean":"2023-12-16T03:26:22.419016+0000","last_became_active":"2023-12-16T03:26:19.620086+0000","last_became_peered":"2023-12-16T03:26:19.620086+0000","last_unstale":"2023-12-16T03:26:22.419016+0000","last_undegraded":"2023-12-16T03:26:22.419016+0000","last_fullsized":"2023-12-16T03:26:22.419016+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:16.967864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440451+0000","last_change":"2023-12-16T03:26:20.464891+0000","last_active":"2023-12-16T03:26:21.440451+0000","last_peered":"2023-12-16T03:26:21.440451+0000","last_clean":"2023-12-16T03:26:21.440451+0000","last_became_active":"2023-12-16T03:26:20.464534+0000","last_became_peered":"2023-12-16T03:26:20.464534+0000","last_unstale":"2023-12-16T03:26:21.440451+0000","last_undegraded":"2023-12-16T03:26:21.440451+0000","last_fullsized":"2023-12-16T03:26:21.440451+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:08:20.172514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467561+0000","last_change":"2023-12-16T03:26:02.466777+0000","last_active":"2023-12-16T03:26:20.467561+0000","last_peered":"2023-12-16T03:26:20.467561+0000","last_clean":"2023-12-16T03:26:20.467561+0000","last_became_active":"2023-12-16T03:26:02.466486+0000","last_became_peered":"2023-12-16T03:26:02.466486+0000","last_unstale":"2023-12-16T03:26:20.467561+0000","last_undegraded":"2023-12-16T03:26:20.467561+0000","last_fullsized":"2023-12-16T03:26:20.467561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:01.426354+0000","last_clean_scrub_stamp":"2023-12-16T03:26:01.426354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:08:58.419460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443648+0000","last_change":"2023-12-16T03:26:03.480845+0000","last_active":"2023-12-16T03:26:20.443648+0000","last_peered":"2023-12-16T03:26:20.443648+0000","last_clean":"2023-12-16T03:26:20.443648+0000","last_became_active":"2023-12-16T03:26:03.477465+0000","last_became_peered":"2023-12-16T03:26:03.477465+0000","last_unstale":"2023-12-16T03:26:20.443648+0000","last_undegraded":"2023-12-16T03:26:20.443648+0000","last_fullsized":"2023-12-16T03:26:20.443648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:54.963780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.421313+0000","last_change":"2023-12-16T03:26:19.616156+0000","last_active":"2023-12-16T03:26:22.421313+0000","last_peered":"2023-12-16T03:26:22.421313+0000","last_clean":"2023-12-16T03:26:22.421313+0000","last_became_active":"2023-12-16T03:26:19.615909+0000","last_became_peered":"2023-12-16T03:26:19.615909+0000","last_unstale":"2023-12-16T03:26:22.421313+0000","last_undegraded":"2023-12-16T03:26:22.421313+0000","last_fullsized":"2023-12-16T03:26:22.421313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:18.577660+0000","last_clean_scrub_stamp":"2023-12-16T03:26:18.577660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:00.310988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438994+0000","last_change":"2023-12-16T03:26:20.455289+0000","last_active":"2023-12-16T03:26:21.438994+0000","last_peered":"2023-12-16T03:26:21.438994+0000","last_clean":"2023-12-16T03:26:21.438994+0000","last_became_active":"2023-12-16T03:26:20.454862+0000","last_became_peered":"2023-12-16T03:26:20.454862+0000","last_unstale":"2023-12-16T03:26:21.438994+0000","last_undegraded":"2023-12-16T03:26:21.438994+0000","last_fullsized":"2023-12-16T03:26:21.438994+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:41:24.758954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.437068+0000","last_change":"2023-12-16T03:26:03.466192+0000","last_active":"2023-12-16T03:26:20.437068+0000","last_peered":"2023-12-16T03:26:20.437068+0000","last_clean":"2023-12-16T03:26:20.437068+0000","last_became_active":"2023-12-16T03:26:03.465781+0000","last_became_peered":"2023-12-16T03:26:03.465781+0000","last_unstale":"2023-12-16T03:26:20.437068+0000","last_undegraded":"2023-12-16T03:26:20.437068+0000","last_fullsized":"2023-12-16T03:26:20.437068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:54.768138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418395+0000","last_change":"2023-12-16T03:26:20.467127+0000","last_active":"2023-12-16T03:26:22.418395+0000","last_peered":"2023-12-16T03:26:22.418395+0000","last_clean":"2023-12-16T03:26:22.418395+0000","last_became_active":"2023-12-16T03:26:20.462881+0000","last_became_peered":"2023-12-16T03:26:20.462881+0000","last_unstale":"2023-12-16T03:26:22.418395+0000","last_undegraded":"2023-12-16T03:26:22.418395+0000","last_fullsized":"2023-12-16T03:26:22.418395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:57:26.264054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467562+0000","last_change":"2023-12-16T03:26:03.469300+0000","last_active":"2023-12-16T03:26:20.467562+0000","last_peered":"2023-12-16T03:26:20.467562+0000","last_clean":"2023-12-16T03:26:20.467562+0000","last_became_active":"2023-12-16T03:26:03.468972+0000","last_became_peered":"2023-12-16T03:26:03.468972+0000","last_unstale":"2023-12-16T03:26:20.467562+0000","last_undegraded":"2023-12-16T03:26:20.467562+0000","last_fullsized":"2023-12-16T03:26:20.467562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:51.930122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.437592+0000","last_change":"2023-12-16T03:26:20.442113+0000","last_active":"2023-12-16T03:26:21.437592+0000","last_peered":"2023-12-16T03:26:21.437592+0000","last_clean":"2023-12-16T03:26:21.437592+0000","last_became_active":"2023-12-16T03:26:20.441831+0000","last_became_peered":"2023-12-16T03:26:20.441831+0000","last_unstale":"2023-12-16T03:26:21.437592+0000","last_undegraded":"2023-12-16T03:26:21.437592+0000","last_fullsized":"2023-12-16T03:26:21.437592+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:20:47.166534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.437992+0000","last_change":"2023-12-16T03:26:03.469084+0000","last_active":"2023-12-16T03:26:20.437992+0000","last_peered":"2023-12-16T03:26:20.437992+0000","last_clean":"2023-12-16T03:26:20.437992+0000","last_became_active":"2023-12-16T03:26:03.467963+0000","last_became_peered":"2023-12-16T03:26:03.467963+0000","last_unstale":"2023-12-16T03:26:20.437992+0000","last_undegraded":"2023-12-16T03:26:20.437992+0000","last_fullsized":"2023-12-16T03:26:20.437992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:47.050435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419532+0000","last_change":"2023-12-16T03:26:20.462683+0000","last_active":"2023-12-16T03:26:22.419532+0000","last_peered":"2023-12-16T03:26:22.419532+0000","last_clean":"2023-12-16T03:26:22.419532+0000","last_became_active":"2023-12-16T03:26:20.462383+0000","last_became_peered":"2023-12-16T03:26:20.462383+0000","last_unstale":"2023-12-16T03:26:22.419532+0000","last_undegraded":"2023-12-16T03:26:22.419532+0000","last_fullsized":"2023-12-16T03:26:22.419532+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:09.871179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439350+0000","last_change":"2023-12-16T03:26:03.461340+0000","last_active":"2023-12-16T03:26:20.439350+0000","last_peered":"2023-12-16T03:26:20.439350+0000","last_clean":"2023-12-16T03:26:20.439350+0000","last_became_active":"2023-12-16T03:26:03.459869+0000","last_became_peered":"2023-12-16T03:26:03.459869+0000","last_unstale":"2023-12-16T03:26:20.439350+0000","last_undegraded":"2023-12-16T03:26:20.439350+0000","last_fullsized":"2023-12-16T03:26:20.439350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:56:54.963780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438095+0000","last_change":"2023-12-16T03:26:20.456191+0000","last_active":"2023-12-16T03:26:21.438095+0000","last_peered":"2023-12-16T03:26:21.438095+0000","last_clean":"2023-12-16T03:26:21.438095+0000","last_became_active":"2023-12-16T03:26:20.455761+0000","last_became_peered":"2023-12-16T03:26:20.455761+0000","last_unstale":"2023-12-16T03:26:21.438095+0000","last_undegraded":"2023-12-16T03:26:21.438095+0000","last_fullsized":"2023-12-16T03:26:21.438095+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:11.186807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.451783+0000","last_change":"2023-12-16T03:26:03.460615+0000","last_active":"2023-12-16T03:26:20.451783+0000","last_peered":"2023-12-16T03:26:20.451783+0000","last_clean":"2023-12-16T03:26:20.451783+0000","last_became_active":"2023-12-16T03:26:03.460298+0000","last_became_peered":"2023-12-16T03:26:03.460298+0000","last_unstale":"2023-12-16T03:26:20.451783+0000","last_undegraded":"2023-12-16T03:26:20.451783+0000","last_fullsized":"2023-12-16T03:26:20.451783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:50:17.425373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419416+0000","last_change":"2023-12-16T03:26:20.465570+0000","last_active":"2023-12-16T03:26:22.419416+0000","last_peered":"2023-12-16T03:26:22.419416+0000","last_clean":"2023-12-16T03:26:22.419416+0000","last_became_active":"2023-12-16T03:26:20.465184+0000","last_became_peered":"2023-12-16T03:26:20.465184+0000","last_unstale":"2023-12-16T03:26:22.419416+0000","last_undegraded":"2023-12-16T03:26:22.419416+0000","last_fullsized":"2023-12-16T03:26:22.419416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:41:24.758954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436308+0000","last_change":"2023-12-16T03:26:03.470354+0000","last_active":"2023-12-16T03:26:20.436308+0000","last_peered":"2023-12-16T03:26:20.436308+0000","last_clean":"2023-12-16T03:26:20.436308+0000","last_became_active":"2023-12-16T03:26:03.469032+0000","last_became_peered":"2023-12-16T03:26:03.469032+0000","last_unstale":"2023-12-16T03:26:20.436308+0000","last_undegraded":"2023-12-16T03:26:20.436308+0000","last_fullsized":"2023-12-16T03:26:20.436308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:14:02.717527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439328+0000","last_change":"2023-12-16T03:26:20.461274+0000","last_active":"2023-12-16T03:26:21.439328+0000","last_peered":"2023-12-16T03:26:21.439328+0000","last_clean":"2023-12-16T03:26:21.439328+0000","last_became_active":"2023-12-16T03:26:20.460983+0000","last_became_peered":"2023-12-16T03:26:20.460983+0000","last_unstale":"2023-12-16T03:26:21.439328+0000","last_undegraded":"2023-12-16T03:26:21.439328+0000","last_fullsized":"2023-12-16T03:26:21.439328+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:05.145337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453682+0000","last_change":"2023-12-16T03:26:03.480845+0000","last_active":"2023-12-16T03:26:20.453682+0000","last_peered":"2023-12-16T03:26:20.453682+0000","last_clean":"2023-12-16T03:26:20.453682+0000","last_became_active":"2023-12-16T03:26:03.480622+0000","last_became_peered":"2023-12-16T03:26:03.480622+0000","last_unstale":"2023-12-16T03:26:20.453682+0000","last_undegraded":"2023-12-16T03:26:20.453682+0000","last_fullsized":"2023-12-16T03:26:20.453682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:30:38.877161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439742+0000","last_change":"2023-12-16T03:26:20.452159+0000","last_active":"2023-12-16T03:26:21.439742+0000","last_peered":"2023-12-16T03:26:21.439742+0000","last_clean":"2023-12-16T03:26:21.439742+0000","last_became_active":"2023-12-16T03:26:20.451739+0000","last_became_peered":"2023-12-16T03:26:20.451739+0000","last_unstale":"2023-12-16T03:26:21.439742+0000","last_undegraded":"2023-12-16T03:26:21.439742+0000","last_fullsized":"2023-12-16T03:26:21.439742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:17.970880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436623+0000","last_change":"2023-12-16T03:26:03.480210+0000","last_active":"2023-12-16T03:26:20.436623+0000","last_peered":"2023-12-16T03:26:20.436623+0000","last_clean":"2023-12-16T03:26:20.436623+0000","last_became_active":"2023-12-16T03:26:03.479763+0000","last_became_peered":"2023-12-16T03:26:03.479763+0000","last_unstale":"2023-12-16T03:26:20.436623+0000","last_undegraded":"2023-12-16T03:26:20.436623+0000","last_fullsized":"2023-12-16T03:26:20.436623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:47.050435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418927+0000","last_change":"2023-12-16T03:26:20.469284+0000","last_active":"2023-12-16T03:26:22.418927+0000","last_peered":"2023-12-16T03:26:22.418927+0000","last_clean":"2023-12-16T03:26:22.418927+0000","last_became_active":"2023-12-16T03:26:20.468993+0000","last_became_peered":"2023-12-16T03:26:20.468993+0000","last_unstale":"2023-12-16T03:26:22.418927+0000","last_undegraded":"2023-12-16T03:26:22.418927+0000","last_fullsized":"2023-12-16T03:26:22.418927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:45.953347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.449095+0000","last_change":"2023-12-16T03:26:03.466573+0000","last_active":"2023-12-16T03:26:20.449095+0000","last_peered":"2023-12-16T03:26:20.449095+0000","last_clean":"2023-12-16T03:26:20.449095+0000","last_became_active":"2023-12-16T03:26:03.463565+0000","last_became_peered":"2023-12-16T03:26:03.463565+0000","last_unstale":"2023-12-16T03:26:20.449095+0000","last_undegraded":"2023-12-16T03:26:20.449095+0000","last_fullsized":"2023-12-16T03:26:20.449095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:32:47.050435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418526+0000","last_change":"2023-12-16T03:26:20.469221+0000","last_active":"2023-12-16T03:26:22.418526+0000","last_peered":"2023-12-16T03:26:22.418526+0000","last_clean":"2023-12-16T03:26:22.418526+0000","last_became_active":"2023-12-16T03:26:20.468917+0000","last_became_peered":"2023-12-16T03:26:20.468917+0000","last_unstale":"2023-12-16T03:26:22.418526+0000","last_undegraded":"2023-12-16T03:26:22.418526+0000","last_fullsized":"2023-12-16T03:26:22.418526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:48:18.383266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443788+0000","last_change":"2023-12-16T03:26:03.472522+0000","last_active":"2023-12-16T03:26:20.443788+0000","last_peered":"2023-12-16T03:26:20.443788+0000","last_clean":"2023-12-16T03:26:20.443788+0000","last_became_active":"2023-12-16T03:26:03.472310+0000","last_became_peered":"2023-12-16T03:26:03.472310+0000","last_unstale":"2023-12-16T03:26:20.443788+0000","last_undegraded":"2023-12-16T03:26:20.443788+0000","last_fullsized":"2023-12-16T03:26:20.443788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:02.166310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418638+0000","last_change":"2023-12-16T03:26:20.450772+0000","last_active":"2023-12-16T03:26:22.418638+0000","last_peered":"2023-12-16T03:26:22.418638+0000","last_clean":"2023-12-16T03:26:22.418638+0000","last_became_active":"2023-12-16T03:26:20.450480+0000","last_became_peered":"2023-12-16T03:26:20.450480+0000","last_unstale":"2023-12-16T03:26:22.418638+0000","last_undegraded":"2023-12-16T03:26:22.418638+0000","last_fullsized":"2023-12-16T03:26:22.418638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:23:43.590720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439273+0000","last_change":"2023-12-16T03:26:03.476899+0000","last_active":"2023-12-16T03:26:20.439273+0000","last_peered":"2023-12-16T03:26:20.439273+0000","last_clean":"2023-12-16T03:26:20.439273+0000","last_became_active":"2023-12-16T03:26:03.476444+0000","last_became_peered":"2023-12-16T03:26:03.476444+0000","last_unstale":"2023-12-16T03:26:20.439273+0000","last_undegraded":"2023-12-16T03:26:20.439273+0000","last_fullsized":"2023-12-16T03:26:20.439273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:02.166310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419168+0000","last_change":"2023-12-16T03:26:20.468134+0000","last_active":"2023-12-16T03:26:22.419168+0000","last_peered":"2023-12-16T03:26:22.419168+0000","last_clean":"2023-12-16T03:26:22.419168+0000","last_became_active":"2023-12-16T03:26:20.462895+0000","last_became_peered":"2023-12-16T03:26:20.462895+0000","last_unstale":"2023-12-16T03:26:22.419168+0000","last_undegraded":"2023-12-16T03:26:22.419168+0000","last_fullsized":"2023-12-16T03:26:22.419168+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:13:53.020651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439258+0000","last_change":"2023-12-16T03:26:03.485028+0000","last_active":"2023-12-16T03:26:20.439258+0000","last_peered":"2023-12-16T03:26:20.439258+0000","last_clean":"2023-12-16T03:26:20.439258+0000","last_became_active":"2023-12-16T03:26:03.484817+0000","last_became_peered":"2023-12-16T03:26:03.484817+0000","last_unstale":"2023-12-16T03:26:20.439258+0000","last_undegraded":"2023-12-16T03:26:20.439258+0000","last_fullsized":"2023-12-16T03:26:20.439258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:35:34.342031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439596+0000","last_change":"2023-12-16T03:26:20.456777+0000","last_active":"2023-12-16T03:26:21.439596+0000","last_peered":"2023-12-16T03:26:21.439596+0000","last_clean":"2023-12-16T03:26:21.439596+0000","last_became_active":"2023-12-16T03:26:20.456365+0000","last_became_peered":"2023-12-16T03:26:20.456365+0000","last_unstale":"2023-12-16T03:26:21.439596+0000","last_undegraded":"2023-12-16T03:26:21.439596+0000","last_fullsized":"2023-12-16T03:26:21.439596+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:50:56.670673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440450+0000","last_change":"2023-12-16T03:26:03.471216+0000","last_active":"2023-12-16T03:26:20.440450+0000","last_peered":"2023-12-16T03:26:20.440450+0000","last_clean":"2023-12-16T03:26:20.440450+0000","last_became_active":"2023-12-16T03:26:03.470906+0000","last_became_peered":"2023-12-16T03:26:03.470906+0000","last_unstale":"2023-12-16T03:26:20.440450+0000","last_undegraded":"2023-12-16T03:26:20.440450+0000","last_fullsized":"2023-12-16T03:26:20.440450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:23:52.462412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439966+0000","last_change":"2023-12-16T03:26:20.457998+0000","last_active":"2023-12-16T03:26:21.439966+0000","last_peered":"2023-12-16T03:26:21.439966+0000","last_clean":"2023-12-16T03:26:21.439966+0000","last_became_active":"2023-12-16T03:26:20.457697+0000","last_became_peered":"2023-12-16T03:26:20.457697+0000","last_unstale":"2023-12-16T03:26:21.439966+0000","last_undegraded":"2023-12-16T03:26:21.439966+0000","last_fullsized":"2023-12-16T03:26:21.439966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:22:45.953347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.452953+0000","last_change":"2023-12-16T03:26:03.483084+0000","last_active":"2023-12-16T03:26:20.452953+0000","last_peered":"2023-12-16T03:26:20.452953+0000","last_clean":"2023-12-16T03:26:20.452953+0000","last_became_active":"2023-12-16T03:26:03.479314+0000","last_became_peered":"2023-12-16T03:26:03.479314+0000","last_unstale":"2023-12-16T03:26:20.452953+0000","last_undegraded":"2023-12-16T03:26:20.452953+0000","last_fullsized":"2023-12-16T03:26:20.452953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:54:54.768138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.437915+0000","last_change":"2023-12-16T03:26:20.448192+0000","last_active":"2023-12-16T03:26:21.437915+0000","last_peered":"2023-12-16T03:26:21.437915+0000","last_clean":"2023-12-16T03:26:21.437915+0000","last_became_active":"2023-12-16T03:26:20.447961+0000","last_became_peered":"2023-12-16T03:26:20.447961+0000","last_unstale":"2023-12-16T03:26:21.437915+0000","last_undegraded":"2023-12-16T03:26:21.437915+0000","last_fullsized":"2023-12-16T03:26:21.437915+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:33:04.200819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.454299+0000","last_change":"2023-12-16T03:26:03.478015+0000","last_active":"2023-12-16T03:26:20.454299+0000","last_peered":"2023-12-16T03:26:20.454299+0000","last_clean":"2023-12-16T03:26:20.454299+0000","last_became_active":"2023-12-16T03:26:03.477762+0000","last_became_peered":"2023-12-16T03:26:03.477762+0000","last_unstale":"2023-12-16T03:26:20.454299+0000","last_undegraded":"2023-12-16T03:26:20.454299+0000","last_fullsized":"2023-12-16T03:26:20.454299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:23:26.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418815+0000","last_change":"2023-12-16T03:26:20.467576+0000","last_active":"2023-12-16T03:26:22.418815+0000","last_peered":"2023-12-16T03:26:22.418815+0000","last_clean":"2023-12-16T03:26:22.418815+0000","last_became_active":"2023-12-16T03:26:20.467063+0000","last_became_peered":"2023-12-16T03:26:20.467063+0000","last_unstale":"2023-12-16T03:26:22.418815+0000","last_undegraded":"2023-12-16T03:26:22.418815+0000","last_fullsized":"2023-12-16T03:26:22.418815+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:01.314003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.443857+0000","last_change":"2023-12-16T03:26:03.470602+0000","last_active":"2023-12-16T03:26:20.443857+0000","last_peered":"2023-12-16T03:26:20.443857+0000","last_clean":"2023-12-16T03:26:20.443857+0000","last_became_active":"2023-12-16T03:26:03.465595+0000","last_became_peered":"2023-12-16T03:26:03.465595+0000","last_unstale":"2023-12-16T03:26:20.443857+0000","last_undegraded":"2023-12-16T03:26:20.443857+0000","last_fullsized":"2023-12-16T03:26:20.443857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:51:02.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418803+0000","last_change":"2023-12-16T03:26:20.444529+0000","last_active":"2023-12-16T03:26:22.418803+0000","last_peered":"2023-12-16T03:26:22.418803+0000","last_clean":"2023-12-16T03:26:22.418803+0000","last_became_active":"2023-12-16T03:26:20.444267+0000","last_became_peered":"2023-12-16T03:26:20.444267+0000","last_unstale":"2023-12-16T03:26:22.418803+0000","last_undegraded":"2023-12-16T03:26:22.418803+0000","last_fullsized":"2023-12-16T03:26:22.418803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:04.033541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.437490+0000","last_change":"2023-12-16T03:26:03.475298+0000","last_active":"2023-12-16T03:26:20.437490+0000","last_peered":"2023-12-16T03:26:20.437490+0000","last_clean":"2023-12-16T03:26:20.437490+0000","last_became_active":"2023-12-16T03:26:03.475023+0000","last_became_peered":"2023-12-16T03:26:03.475023+0000","last_unstale":"2023-12-16T03:26:20.437490+0000","last_undegraded":"2023-12-16T03:26:20.437490+0000","last_fullsized":"2023-12-16T03:26:20.437490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:47:58.231120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.437721+0000","last_change":"2023-12-16T03:26:20.458714+0000","last_active":"2023-12-16T03:26:21.437721+0000","last_peered":"2023-12-16T03:26:21.437721+0000","last_clean":"2023-12-16T03:26:21.437721+0000","last_became_active":"2023-12-16T03:26:20.456810+0000","last_became_peered":"2023-12-16T03:26:20.456810+0000","last_unstale":"2023-12-16T03:26:21.437721+0000","last_undegraded":"2023-12-16T03:26:21.437721+0000","last_fullsized":"2023-12-16T03:26:21.437721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:25:05.900996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450362+0000","last_change":"2023-12-16T03:26:03.461119+0000","last_active":"2023-12-16T03:26:20.450362+0000","last_peered":"2023-12-16T03:26:20.450362+0000","last_clean":"2023-12-16T03:26:20.450362+0000","last_became_active":"2023-12-16T03:26:03.460789+0000","last_became_peered":"2023-12-16T03:26:03.460789+0000","last_unstale":"2023-12-16T03:26:20.450362+0000","last_undegraded":"2023-12-16T03:26:20.450362+0000","last_fullsized":"2023-12-16T03:26:20.450362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:49:54.036423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418139+0000","last_change":"2023-12-16T03:26:20.461543+0000","last_active":"2023-12-16T03:26:22.418139+0000","last_peered":"2023-12-16T03:26:22.418139+0000","last_clean":"2023-12-16T03:26:22.418139+0000","last_became_active":"2023-12-16T03:26:20.461056+0000","last_became_peered":"2023-12-16T03:26:20.461056+0000","last_unstale":"2023-12-16T03:26:22.418139+0000","last_undegraded":"2023-12-16T03:26:22.418139+0000","last_fullsized":"2023-12-16T03:26:22.418139+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:55:11.918523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450586+0000","last_change":"2023-12-16T03:26:03.475323+0000","last_active":"2023-12-16T03:26:20.450586+0000","last_peered":"2023-12-16T03:26:20.450586+0000","last_clean":"2023-12-16T03:26:20.450586+0000","last_became_active":"2023-12-16T03:26:03.475008+0000","last_became_peered":"2023-12-16T03:26:03.475008+0000","last_unstale":"2023-12-16T03:26:20.450586+0000","last_undegraded":"2023-12-16T03:26:20.450586+0000","last_fullsized":"2023-12-16T03:26:20.450586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:21.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419386+0000","last_change":"2023-12-16T03:26:20.462766+0000","last_active":"2023-12-16T03:26:22.419386+0000","last_peered":"2023-12-16T03:26:22.419386+0000","last_clean":"2023-12-16T03:26:22.419386+0000","last_became_active":"2023-12-16T03:26:20.462493+0000","last_became_peered":"2023-12-16T03:26:20.462493+0000","last_unstale":"2023-12-16T03:26:22.419386+0000","last_undegraded":"2023-12-16T03:26:22.419386+0000","last_fullsized":"2023-12-16T03:26:22.419386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:02.113387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440357+0000","last_change":"2023-12-16T03:26:03.465388+0000","last_active":"2023-12-16T03:26:20.440357+0000","last_peered":"2023-12-16T03:26:20.440357+0000","last_clean":"2023-12-16T03:26:20.440357+0000","last_became_active":"2023-12-16T03:26:03.464429+0000","last_became_peered":"2023-12-16T03:26:03.464429+0000","last_unstale":"2023-12-16T03:26:20.440357+0000","last_undegraded":"2023-12-16T03:26:20.440357+0000","last_fullsized":"2023-12-16T03:26:20.440357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:18:58.471344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419765+0000","last_change":"2023-12-16T03:26:20.462164+0000","last_active":"2023-12-16T03:26:22.419765+0000","last_peered":"2023-12-16T03:26:22.419765+0000","last_clean":"2023-12-16T03:26:22.419765+0000","last_became_active":"2023-12-16T03:26:20.461818+0000","last_became_peered":"2023-12-16T03:26:20.461818+0000","last_unstale":"2023-12-16T03:26:22.419765+0000","last_undegraded":"2023-12-16T03:26:22.419765+0000","last_fullsized":"2023-12-16T03:26:22.419765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:05.145337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.451701+0000","last_change":"2023-12-16T03:26:03.479988+0000","last_active":"2023-12-16T03:26:20.451701+0000","last_peered":"2023-12-16T03:26:20.451701+0000","last_clean":"2023-12-16T03:26:20.451701+0000","last_became_active":"2023-12-16T03:26:03.479695+0000","last_became_peered":"2023-12-16T03:26:03.479695+0000","last_unstale":"2023-12-16T03:26:20.451701+0000","last_undegraded":"2023-12-16T03:26:20.451701+0000","last_fullsized":"2023-12-16T03:26:20.451701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:10:21.426532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419669+0000","last_change":"2023-12-16T03:26:20.445788+0000","last_active":"2023-12-16T03:26:22.419669+0000","last_peered":"2023-12-16T03:26:22.419669+0000","last_clean":"2023-12-16T03:26:22.419669+0000","last_became_active":"2023-12-16T03:26:20.445578+0000","last_became_peered":"2023-12-16T03:26:20.445578+0000","last_unstale":"2023-12-16T03:26:22.419669+0000","last_undegraded":"2023-12-16T03:26:22.419669+0000","last_fullsized":"2023-12-16T03:26:22.419669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:48.940939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.442663+0000","last_change":"2023-12-16T03:26:03.470445+0000","last_active":"2023-12-16T03:26:20.442663+0000","last_peered":"2023-12-16T03:26:20.442663+0000","last_clean":"2023-12-16T03:26:20.442663+0000","last_became_active":"2023-12-16T03:26:03.470102+0000","last_became_peered":"2023-12-16T03:26:03.470102+0000","last_unstale":"2023-12-16T03:26:20.442663+0000","last_undegraded":"2023-12-16T03:26:20.442663+0000","last_fullsized":"2023-12-16T03:26:20.442663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:26.451963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439192+0000","last_change":"2023-12-16T03:26:20.460794+0000","last_active":"2023-12-16T03:26:21.439192+0000","last_peered":"2023-12-16T03:26:21.439192+0000","last_clean":"2023-12-16T03:26:21.439192+0000","last_became_active":"2023-12-16T03:26:20.460456+0000","last_became_peered":"2023-12-16T03:26:20.460456+0000","last_unstale":"2023-12-16T03:26:21.439192+0000","last_undegraded":"2023-12-16T03:26:21.439192+0000","last_fullsized":"2023-12-16T03:26:21.439192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:13:48.940939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436328+0000","last_change":"2023-12-16T03:26:03.484306+0000","last_active":"2023-12-16T03:26:20.436328+0000","last_peered":"2023-12-16T03:26:20.436328+0000","last_clean":"2023-12-16T03:26:20.436328+0000","last_became_active":"2023-12-16T03:26:03.484039+0000","last_became_peered":"2023-12-16T03:26:03.484039+0000","last_unstale":"2023-12-16T03:26:20.436328+0000","last_undegraded":"2023-12-16T03:26:20.436328+0000","last_fullsized":"2023-12-16T03:26:20.436328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:24:48.750612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419373+0000","last_change":"2023-12-16T03:26:20.455052+0000","last_active":"2023-12-16T03:26:22.419373+0000","last_peered":"2023-12-16T03:26:22.419373+0000","last_clean":"2023-12-16T03:26:22.419373+0000","last_became_active":"2023-12-16T03:26:20.454689+0000","last_became_peered":"2023-12-16T03:26:20.454689+0000","last_unstale":"2023-12-16T03:26:22.419373+0000","last_undegraded":"2023-12-16T03:26:22.419373+0000","last_fullsized":"2023-12-16T03:26:22.419373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:07:04.320796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.439792+0000","last_change":"2023-12-16T03:26:03.470373+0000","last_active":"2023-12-16T03:26:20.439792+0000","last_peered":"2023-12-16T03:26:20.439792+0000","last_clean":"2023-12-16T03:26:20.439792+0000","last_became_active":"2023-12-16T03:26:03.470054+0000","last_became_peered":"2023-12-16T03:26:03.470054+0000","last_unstale":"2023-12-16T03:26:20.439792+0000","last_undegraded":"2023-12-16T03:26:20.439792+0000","last_fullsized":"2023-12-16T03:26:20.439792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:50.606603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418020+0000","last_change":"2023-12-16T03:26:20.463084+0000","last_active":"2023-12-16T03:26:22.418020+0000","last_peered":"2023-12-16T03:26:22.418020+0000","last_clean":"2023-12-16T03:26:22.418020+0000","last_became_active":"2023-12-16T03:26:20.458441+0000","last_became_peered":"2023-12-16T03:26:20.458441+0000","last_unstale":"2023-12-16T03:26:22.418020+0000","last_undegraded":"2023-12-16T03:26:22.418020+0000","last_fullsized":"2023-12-16T03:26:22.418020+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:32:50.768331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436716+0000","last_change":"2023-12-16T03:26:03.468531+0000","last_active":"2023-12-16T03:26:20.436716+0000","last_peered":"2023-12-16T03:26:20.436716+0000","last_clean":"2023-12-16T03:26:20.436716+0000","last_became_active":"2023-12-16T03:26:03.468087+0000","last_became_peered":"2023-12-16T03:26:03.468087+0000","last_unstale":"2023-12-16T03:26:20.436716+0000","last_undegraded":"2023-12-16T03:26:20.436716+0000","last_fullsized":"2023-12-16T03:26:20.436716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:24:48.750612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.438877+0000","last_change":"2023-12-16T03:26:20.460403+0000","last_active":"2023-12-16T03:26:21.438877+0000","last_peered":"2023-12-16T03:26:21.438877+0000","last_clean":"2023-12-16T03:26:21.438877+0000","last_became_active":"2023-12-16T03:26:20.460062+0000","last_became_peered":"2023-12-16T03:26:20.460062+0000","last_unstale":"2023-12-16T03:26:21.438877+0000","last_undegraded":"2023-12-16T03:26:21.438877+0000","last_fullsized":"2023-12-16T03:26:21.438877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:44:05.177453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.438531+0000","last_change":"2023-12-16T03:26:03.475485+0000","last_active":"2023-12-16T03:26:20.438531+0000","last_peered":"2023-12-16T03:26:20.438531+0000","last_clean":"2023-12-16T03:26:20.438531+0000","last_became_active":"2023-12-16T03:26:03.474992+0000","last_became_peered":"2023-12-16T03:26:03.474992+0000","last_unstale":"2023-12-16T03:26:20.438531+0000","last_undegraded":"2023-12-16T03:26:20.438531+0000","last_fullsized":"2023-12-16T03:26:20.438531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:10:26.109374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.417911+0000","last_change":"2023-12-16T03:26:20.468881+0000","last_active":"2023-12-16T03:26:22.417911+0000","last_peered":"2023-12-16T03:26:22.417911+0000","last_clean":"2023-12-16T03:26:22.417911+0000","last_became_active":"2023-12-16T03:26:20.468194+0000","last_became_peered":"2023-12-16T03:26:20.468194+0000","last_unstale":"2023-12-16T03:26:22.417911+0000","last_undegraded":"2023-12-16T03:26:22.417911+0000","last_fullsized":"2023-12-16T03:26:22.417911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:23:57.777036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450504+0000","last_change":"2023-12-16T03:26:03.484378+0000","last_active":"2023-12-16T03:26:20.450504+0000","last_peered":"2023-12-16T03:26:20.450504+0000","last_clean":"2023-12-16T03:26:20.450504+0000","last_became_active":"2023-12-16T03:26:03.484145+0000","last_became_peered":"2023-12-16T03:26:03.484145+0000","last_unstale":"2023-12-16T03:26:20.450504+0000","last_undegraded":"2023-12-16T03:26:20.450504+0000","last_fullsized":"2023-12-16T03:26:20.450504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:47:58.231120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418618+0000","last_change":"2023-12-16T03:26:20.446145+0000","last_active":"2023-12-16T03:26:22.418618+0000","last_peered":"2023-12-16T03:26:22.418618+0000","last_clean":"2023-12-16T03:26:22.418618+0000","last_became_active":"2023-12-16T03:26:20.445868+0000","last_became_peered":"2023-12-16T03:26:20.445868+0000","last_unstale":"2023-12-16T03:26:22.418618+0000","last_undegraded":"2023-12-16T03:26:22.418618+0000","last_fullsized":"2023-12-16T03:26:22.418618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:41:05.145337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.440252+0000","last_change":"2023-12-16T03:26:03.468853+0000","last_active":"2023-12-16T03:26:20.440252+0000","last_peered":"2023-12-16T03:26:20.440252+0000","last_clean":"2023-12-16T03:26:20.440252+0000","last_became_active":"2023-12-16T03:26:03.468601+0000","last_became_peered":"2023-12-16T03:26:03.468601+0000","last_unstale":"2023-12-16T03:26:20.440252+0000","last_undegraded":"2023-12-16T03:26:20.440252+0000","last_fullsized":"2023-12-16T03:26:20.440252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:32:58.967330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.440656+0000","last_change":"2023-12-16T03:26:20.459804+0000","last_active":"2023-12-16T03:26:21.440656+0000","last_peered":"2023-12-16T03:26:21.440656+0000","last_clean":"2023-12-16T03:26:21.440656+0000","last_became_active":"2023-12-16T03:26:20.459402+0000","last_became_peered":"2023-12-16T03:26:20.459402+0000","last_unstale":"2023-12-16T03:26:21.440656+0000","last_undegraded":"2023-12-16T03:26:21.440656+0000","last_fullsized":"2023-12-16T03:26:21.440656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:12.620002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.436119+0000","last_change":"2023-12-16T03:26:03.477293+0000","last_active":"2023-12-16T03:26:20.436119+0000","last_peered":"2023-12-16T03:26:20.436119+0000","last_clean":"2023-12-16T03:26:20.436119+0000","last_became_active":"2023-12-16T03:26:03.476572+0000","last_became_peered":"2023-12-16T03:26:03.476572+0000","last_unstale":"2023-12-16T03:26:20.436119+0000","last_undegraded":"2023-12-16T03:26:20.436119+0000","last_fullsized":"2023-12-16T03:26:20.436119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:24:50.606603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.418904+0000","last_change":"2023-12-16T03:26:20.454013+0000","last_active":"2023-12-16T03:26:22.418904+0000","last_peered":"2023-12-16T03:26:22.418904+0000","last_clean":"2023-12-16T03:26:22.418904+0000","last_became_active":"2023-12-16T03:26:20.453674+0000","last_became_peered":"2023-12-16T03:26:20.453674+0000","last_unstale":"2023-12-16T03:26:22.418904+0000","last_undegraded":"2023-12-16T03:26:22.418904+0000","last_fullsized":"2023-12-16T03:26:22.418904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:58:12.620002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.450664+0000","last_change":"2023-12-16T03:26:03.463854+0000","last_active":"2023-12-16T03:26:20.450664+0000","last_peered":"2023-12-16T03:26:20.450664+0000","last_clean":"2023-12-16T03:26:20.450664+0000","last_became_active":"2023-12-16T03:26:03.463146+0000","last_became_peered":"2023-12-16T03:26:03.463146+0000","last_unstale":"2023-12-16T03:26:20.450664+0000","last_undegraded":"2023-12-16T03:26:20.450664+0000","last_fullsized":"2023-12-16T03:26:20.450664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:33:26.451963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:22.419761+0000","last_change":"2023-12-16T03:26:20.469924+0000","last_active":"2023-12-16T03:26:22.419761+0000","last_peered":"2023-12-16T03:26:22.419761+0000","last_clean":"2023-12-16T03:26:22.419761+0000","last_became_active":"2023-12-16T03:26:20.469598+0000","last_became_peered":"2023-12-16T03:26:20.469598+0000","last_unstale":"2023-12-16T03:26:22.419761+0000","last_undegraded":"2023-12-16T03:26:22.419761+0000","last_fullsized":"2023-12-16T03:26:22.419761+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:08:20.172514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.453606+0000","last_change":"2023-12-16T03:26:03.484118+0000","last_active":"2023-12-16T03:26:20.453606+0000","last_peered":"2023-12-16T03:26:20.453606+0000","last_clean":"2023-12-16T03:26:20.453606+0000","last_became_active":"2023-12-16T03:26:03.483621+0000","last_became_peered":"2023-12-16T03:26:03.483621+0000","last_unstale":"2023-12-16T03:26:20.453606+0000","last_undegraded":"2023-12-16T03:26:20.453606+0000","last_fullsized":"2023-12-16T03:26:20.453606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:52.515046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-16T03:26:21.439636+0000","last_change":"2023-12-16T03:26:20.444051+0000","last_active":"2023-12-16T03:26:21.439636+0000","last_peered":"2023-12-16T03:26:21.439636+0000","last_clean":"2023-12-16T03:26:21.439636+0000","last_became_active":"2023-12-16T03:26:20.443742+0000","last_became_peered":"2023-12-16T03:26:20.443742+0000","last_unstale":"2023-12-16T03:26:21.439636+0000","last_undegraded":"2023-12-16T03:26:21.439636+0000","last_fullsized":"2023-12-16T03:26:21.439636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:19.580676+0000","last_clean_scrub_stamp":"2023-12-16T03:26:19.580676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:23:57.777036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-16T03:26:20.467642+0000","last_change":"2023-12-16T03:26:03.471860+0000","last_active":"2023-12-16T03:26:20.467642+0000","last_peered":"2023-12-16T03:26:20.467642+0000","last_clean":"2023-12-16T03:26:20.467642+0000","last_became_active":"2023-12-16T03:26:03.470857+0000","last_became_peered":"2023-12-16T03:26:03.470857+0000","last_unstale":"2023-12-16T03:26:20.467642+0000","last_undegraded":"2023-12-16T03:26:20.467642+0000","last_fullsized":"2023-12-16T03:26:20.467642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:02.430292+0000","last_clean_scrub_stamp":"2023-12-16T03:26:02.430292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:02.166310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":999424,"data_stored":751391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.55400000000000005}]},{"osd":3,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.748},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.77700000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":162131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.1890000000000001,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.77200000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.6870000000000003,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.2560000000000002,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.73699999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.753}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.67800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":168742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60799999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.79900000000000004}]},{"osd":4,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.495},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.86599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":169716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.194,"5min":4.194,"15min":4.194},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.873},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.98599999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.1689999999999996,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.76700000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.2759999999999998,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.79200000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.93899999999999995}]},{"osd":6,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.83099999999999996}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.90600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":425984,"data_stored":164610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":5.4710000000000001,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":6.1189999999999998,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.7890000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.315},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.434}]},{"osd":2,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.5779999999999998,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.75800000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.6309999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":0.69799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":430080,"data_stored":169704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.41299999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.76400000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.83499999999999996}]},{"osd":4,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.0609999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.97599999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":164042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":4.3479999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.476,"5min":4.476,"15min":4.476},"last":0.64900000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.4269999999999996,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.6319999999999997,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.3849999999999998,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":7.5650000000000004,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.984,"5min":4.984,"15min":4.984},"last":0.77200000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":4.7720000000000002,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.623},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":7.6109999999999998,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":7.681,"5min":7.681,"15min":7.681},"last":0.66300000000000003}]},{"osd":7,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.8609999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.71999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":995328,"data_stored":751245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.1210000000000004,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.47399999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.1719999999999997,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.2350000000000003,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.54100000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.0970000000000004,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.254,"5min":3.254,"15min":3.254},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":0.78500000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.3979999999999997,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:26:25.120 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-16T03:26:25.121 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-16T03:26:25.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1cdd9d640 1 Processor -- start 2023-12-16T03:26:25.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1cdd9d640 1 -- start start 2023-12-16T03:26:25.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1cdd9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1c8151e90 0x7fe1c80c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1cdd9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c80c7ea0 0x7fe1c806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1cdd9d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c806c860 con 0x7fe1c80c4e60 2023-12-16T03:26:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1cdd9d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c80c8750 con 0x7fe1c8151e90 2023-12-16T03:26:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1cdd9d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c81552d0 con 0x7fe1c80c7ea0 2023-12-16T03:26:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1c77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1c8151e90 0x7fe1c80c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1c77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1c8151e90 0x7fe1c80c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51354/0 (socket says 172.21.15.28:51354) 2023-12-16T03:26:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1c77fe640 1 -- 172.21.15.28:0/24039218 learned_addr learned my addr 172.21.15.28:0/24039218 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1c7fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe1c80c4e60 0x7fe1c806b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58476/0 (socket says 172.21.15.28:58476) 2023-12-16T03:26:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1c6ffd640 1 --2- 172.21.15.28:0/24039218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c80c7ea0 0x7fe1c806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1c77fe640 1 -- 172.21.15.28:0/24039218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c80c7ea0 msgr2=0x7fe1c806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:25.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1c77fe640 1 --2- 172.21.15.28:0/24039218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c80c7ea0 0x7fe1c806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1c77fe640 1 -- 172.21.15.28:0/24039218 >> v1:172.21.15.28:6789/0 conn(0x7fe1c80c4e60 legacy=0x7fe1c806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1c77fe640 1 -- 172.21.15.28:0/24039218 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c8154930 con 0x7fe1c8151e90 2023-12-16T03:26:25.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1c6ffd640 1 --2- 172.21.15.28:0/24039218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c80c7ea0 0x7fe1c806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:25.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.301+0000 7fe1c67fc640 1 -- 172.21.15.28:0/24039218 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298967003 0 0) 0x7fe1c806c860 con 0x7fe1c80c4e60 2023-12-16T03:26:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1c77fe640 1 --2- 172.21.15.28:0/24039218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1c8151e90 0x7fe1c80c4920 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009870 tx=0x7fe1b801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c48dde2d6d6546 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1c67fc640 1 -- 172.21.15.28:0/24039218 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80ab600 con 0x7fe1c8151e90 2023-12-16T03:26:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1c67fc640 1 -- 172.21.15.28:0/24039218 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b80a7050 con 0x7fe1c8151e90 2023-12-16T03:26:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1c67fc640 1 -- 172.21.15.28:0/24039218 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80ab980 con 0x7fe1c8151e90 2023-12-16T03:26:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/24039218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1c8151e90 msgr2=0x7fe1c80c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1cdd9d640 1 --2- 172.21.15.28:0/24039218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1c8151e90 0x7fe1c80c4920 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009870 tx=0x7fe1b801c420 comp rx=0 tx=0).stop 2023-12-16T03:26:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/24039218 shutdown_connections 2023-12-16T03:26:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1cdd9d640 1 --2- 172.21.15.28:0/24039218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c80c7ea0 0x7fe1c806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1cdd9d640 1 --2- 172.21.15.28:0/24039218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1c8151e90 0x7fe1c80c4920 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/24039218 >> 172.21.15.28:0/24039218 conn(0x7fe1c80ca170 msgr2=0x7fe1c80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/24039218 shutdown_connections 2023-12-16T03:26:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.305+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/24039218 wait complete. 2023-12-16T03:26:25.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1cdd9d640 1 Processor -- start 2023-12-16T03:26:25.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1cdd9d640 1 -- start start 2023-12-16T03:26:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1cdd9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c80c4e60 0x7fe1c81ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1cdd9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c80c7ea0 0x7fe1c8143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1cdd9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1c8151e90 0x7fe1c814b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1cdd9d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c80c27e0 con 0x7fe1c8151e90 2023-12-16T03:26:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1cdd9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c80c2ac0 con 0x7fe1c80c7ea0 2023-12-16T03:26:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1cdd9d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c80c2da0 con 0x7fe1c80c4e60 2023-12-16T03:26:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1c8151e90 0x7fe1c814b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1c8151e90 0x7fe1c814b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51370/0 (socket says 172.21.15.28:51370) 2023-12-16T03:26:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c7fff640 1 -- 172.21.15.28:0/658421326 learned_addr learned my addr 172.21.15.28:0/658421326 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:25.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c77fe640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c80c4e60 0x7fe1c81ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c6ffd640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c80c7ea0 0x7fe1c8143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c7fff640 1 -- 172.21.15.28:0/658421326 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c80c4e60 msgr2=0x7fe1c81ecd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c7fff640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c80c4e60 0x7fe1c81ecd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c7fff640 1 -- 172.21.15.28:0/658421326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c80c7ea0 msgr2=0x7fe1c8143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c7fff640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c80c7ea0 0x7fe1c8143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c7fff640 1 -- 172.21.15.28:0/658421326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b80094d0 con 0x7fe1c8151e90 2023-12-16T03:26:25.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c6ffd640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c80c7ea0 0x7fe1c8143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:25.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1c7fff640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1c8151e90 0x7fe1c814b4d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000c780 tx=0x7fe1c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:25.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1affff640 1 -- 172.21.15.28:0/658421326 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c000ce90 con 0x7fe1c8151e90 2023-12-16T03:26:25.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1affff640 1 -- 172.21.15.28:0/658421326 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c000a640 con 0x7fe1c8151e90 2023-12-16T03:26:25.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1affff640 1 -- 172.21.15.28:0/658421326 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c000a9d0 con 0x7fe1c8151e90 2023-12-16T03:26:25.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/658421326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c80c3080 con 0x7fe1c8151e90 2023-12-16T03:26:25.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.309+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/658421326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c80c3e80 con 0x7fe1c8151e90 2023-12-16T03:26:25.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.313+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/658421326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c80c3530 con 0x7fe1c8151e90 2023-12-16T03:26:25.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.313+0000 7fe1affff640 1 -- 172.21.15.28:0/658421326 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe1c000ab30 con 0x7fe1c8151e90 2023-12-16T03:26:25.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.313+0000 7fe1affff640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b40664a0 0x7fe1b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.313+0000 7fe1affff640 1 -- 172.21.15.28:0/658421326 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe1c0083580 con 0x7fe1c8151e90 2023-12-16T03:26:25.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.313+0000 7fe1c77fe640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b40664a0 0x7fe1b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.313+0000 7fe1c77fe640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b40664a0 0x7fe1b4068960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80ad000 tx=0x7fe1b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:25.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.317+0000 7fe1affff640 1 -- 172.21.15.28:0/658421326 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe1c80c3530 con 0x7fe1c8151e90 2023-12-16T03:26:25.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.529+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/658421326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7fe1c80c3530 con 0x7fe1c8151e90 2023-12-16T03:26:25.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1affff640 1 -- 172.21.15.28:0/658421326 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v12) v1 ==== 185+0+142 (secure 0 0 0) 0x7fe1c80c3530 con 0x7fe1c8151e90 2023-12-16T03:26:25.538 INFO:teuthology.orchestra.run.smithi028.stdout:[client.1] 2023-12-16T03:26:25.539 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1lgMMbKBAACWizLH1wqYLfSHVjCwyqHQ== 2023-12-16T03:26:25.539 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2023-12-16T03:26:25.539 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2023-12-16T03:26:25.539 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-16T03:26:25.539 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.1 2023-12-16T03:26:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/658421326 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b40664a0 msgr2=0x7fe1b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b40664a0 0x7fe1b4068960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80ad000 tx=0x7fe1b8008040 comp rx=0 tx=0).stop 2023-12-16T03:26:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/658421326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1c8151e90 msgr2=0x7fe1c814b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1c8151e90 0x7fe1c814b4d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000c780 tx=0x7fe1c000cc40 comp rx=0 tx=0).stop 2023-12-16T03:26:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/658421326 shutdown_connections 2023-12-16T03:26:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b40664a0 0x7fe1b4068960 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1c8151e90 0x7fe1c814b4d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1c80c7ea0 0x7fe1c8143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 --2- 172.21.15.28:0/658421326 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1c80c4e60 0x7fe1c81ecd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/658421326 >> 172.21.15.28:0/658421326 conn(0x7fe1c80ca170 msgr2=0x7fe1c815e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:25.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/658421326 shutdown_connections 2023-12-16T03:26:25.542 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.533+0000 7fe1cdd9d640 1 -- 172.21.15.28:0/658421326 wait complete. 2023-12-16T03:26:25.560 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:26:25.561 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:25.570 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:26:25.571 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:25.621 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.757+0000 7f8cf61d1640 1 Processor -- start 2023-12-16T03:26:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.757+0000 7f8cf61d1640 1 -- start start 2023-12-16T03:26:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8cf61d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c63c0 0x7f8cf00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8cf61d1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8cf00c2bb0 0x7f8cf00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8cf61d1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf00c31c0 con 0x7f8cf00c4100 2023-12-16T03:26:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8cf61d1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00c34a0 con 0x7f8cf00c2bb0 2023-12-16T03:26:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8cf61d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf00c1030 con 0x7f8cf00c63c0 2023-12-16T03:26:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8ceffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8cf00c2bb0 0x7f8cf00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8cef7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c63c0 0x7f8cf00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8ceffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8cf00c2bb0 0x7f8cf00a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:34728/0 (socket says 172.21.15.28:34728) 2023-12-16T03:26:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8ceffff640 1 -- 172.21.15.28:0/4033209653 learned_addr learned my addr 172.21.15.28:0/4033209653 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8cef7fe640 1 -- 172.21.15.28:0/4033209653 >> v2:172.21.15.134:3300/0 conn(0x7f8cf00c2bb0 msgr2=0x7f8cf00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8cef7fe640 1 --2- 172.21.15.28:0/4033209653 >> v2:172.21.15.134:3300/0 conn(0x7f8cf00c2bb0 0x7f8cf00a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8cef7fe640 1 -- 172.21.15.28:0/4033209653 >> v1:172.21.15.134:6789/0 conn(0x7f8cf00c4100 legacy=0x7f8cf00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8cee7fc640 1 -- 172.21.15.28:0/4033209653 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195099661 0 0) 0x7f8cf00c31c0 con 0x7f8cf00c4100 2023-12-16T03:26:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8cef7fe640 1 -- 172.21.15.28:0/4033209653 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00c1310 con 0x7f8cf00c63c0 2023-12-16T03:26:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.761+0000 7f8ceffff640 1 --2- 172.21.15.28:0/4033209653 >> v2:172.21.15.134:3300/0 conn(0x7f8cf00c2bb0 0x7f8cf00a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cef7fe640 1 --2- 172.21.15.28:0/4033209653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c63c0 0x7f8cf00c06d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00097c0 tx=0x7f8ce001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=787a8af7088a5439 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cee7fc640 1 -- 172.21.15.28:0/4033209653 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf00aa3d0 con 0x7f8cf00c63c0 2023-12-16T03:26:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cee7fc640 1 -- 172.21.15.28:0/4033209653 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce00a7050 con 0x7f8cf00c63c0 2023-12-16T03:26:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cee7fc640 1 -- 172.21.15.28:0/4033209653 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00ab820 con 0x7f8cf00c63c0 2023-12-16T03:26:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cf61d1640 1 -- 172.21.15.28:0/4033209653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c63c0 msgr2=0x7f8cf00c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cf61d1640 1 --2- 172.21.15.28:0/4033209653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c63c0 0x7f8cf00c06d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00097c0 tx=0x7f8ce001c330 comp rx=0 tx=0).stop 2023-12-16T03:26:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cf61d1640 1 -- 172.21.15.28:0/4033209653 shutdown_connections 2023-12-16T03:26:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cf61d1640 1 --2- 172.21.15.28:0/4033209653 >> v2:172.21.15.134:3300/0 conn(0x7f8cf00c2bb0 0x7f8cf00a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cf61d1640 1 --2- 172.21.15.28:0/4033209653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c63c0 0x7f8cf00c06d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cf61d1640 1 -- 172.21.15.28:0/4033209653 >> 172.21.15.28:0/4033209653 conn(0x7f8cf006a5b0 msgr2=0x7f8cf006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cf61d1640 1 -- 172.21.15.28:0/4033209653 shutdown_connections 2023-12-16T03:26:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cf61d1640 1 -- 172.21.15.28:0/4033209653 wait complete. 2023-12-16T03:26:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.765+0000 7f8cf61d1640 1 Processor -- start 2023-12-16T03:26:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cf61d1640 1 -- start start 2023-12-16T03:26:25.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cf61d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cf00c2bb0 0x7f8cf00c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cf61d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c4100 0x7f8cf01ecba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cf61d1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cf00c63c0 0x7f8cf01ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cf61d1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0150640 con 0x7f8cf00c63c0 2023-12-16T03:26:25.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cf61d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0149f70 con 0x7f8cf00c2bb0 2023-12-16T03:26:25.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cf61d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0149c90 con 0x7f8cf00c4100 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8ceffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cf00c63c0 0x7f8cf01ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8ceffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cf00c63c0 0x7f8cf01ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51382/0 (socket says 172.21.15.28:51382) 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8ceffff640 1 -- 172.21.15.28:0/2819134655 learned_addr learned my addr 172.21.15.28:0/2819134655 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8ceeffd640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c4100 0x7f8cf01ecba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cef7fe640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cf00c2bb0 0x7f8cf00c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8ceffff640 1 -- 172.21.15.28:0/2819134655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c4100 msgr2=0x7f8cf01ecba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8ceffff640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c4100 0x7f8cf01ecba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8ceffff640 1 -- 172.21.15.28:0/2819134655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cf00c2bb0 msgr2=0x7f8cf00c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8ceffff640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cf00c2bb0 0x7f8cf00c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8ceffff640 1 -- 172.21.15.28:0/2819134655 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8009b30 con 0x7f8cf00c63c0 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8ceeffd640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c4100 0x7f8cf01ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8ceffff640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cf00c63c0 0x7f8cf01ed0e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800efc0 tx=0x7f8ce800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cd7fff640 1 -- 172.21.15.28:0/2819134655 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8018070 con 0x7f8cf00c63c0 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cd7fff640 1 -- 172.21.15.28:0/2819134655 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce800f040 con 0x7f8cf00c63c0 2023-12-16T03:26:25.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cd7fff640 1 -- 172.21.15.28:0/2819134655 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800ce00 con 0x7f8cf00c63c0 2023-12-16T03:26:25.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cf61d1640 1 -- 172.21.15.28:0/2819134655 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce0009420 con 0x7f8cf00c63c0 2023-12-16T03:26:25.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cf61d1640 1 -- 172.21.15.28:0/2819134655 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf0150360 con 0x7f8cf00c63c0 2023-12-16T03:26:25.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.769+0000 7f8cf61d1640 1 -- 172.21.15.28:0/2819134655 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf01501c0 con 0x7f8cf00c63c0 2023-12-16T03:26:25.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.773+0000 7f8cd7fff640 1 -- 172.21.15.28:0/2819134655 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8ce8014480 con 0x7f8cf00c63c0 2023-12-16T03:26:25.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.773+0000 7f8cd7fff640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8cdc066470 0x7f8cdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:25.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.773+0000 7f8cd7fff640 1 -- 172.21.15.28:0/2819134655 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8ce80844c0 con 0x7f8cf00c63c0 2023-12-16T03:26:25.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.773+0000 7f8cef7fe640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8cdc066470 0x7f8cdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:25.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.773+0000 7f8cef7fe640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8cdc066470 0x7f8cdc068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00ad000 tx=0x7f8ce00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:25.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.777+0000 7f8cd7fff640 1 -- 172.21.15.28:0/2819134655 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8cf01501c0 con 0x7f8cf00c63c0 2023-12-16T03:26:25.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.933+0000 7f8cf61d1640 1 -- 172.21.15.28:0/2819134655 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cf01501c0 con 0x7f8cf00c63c0 2023-12-16T03:26:25.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cd7fff640 1 -- 172.21.15.28:0/2819134655 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20229 (secure 0 0 0) 0x7f8cf01501c0 con 0x7f8cf00c63c0 2023-12-16T03:26:25.942 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:25.942 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:21.432053+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 -- 172.21.15.28:0/2819134655 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8cdc066470 msgr2=0x7f8cdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8cdc066470 0x7f8cdc068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00ad000 tx=0x7f8ce00a6000 comp rx=0 tx=0).stop 2023-12-16T03:26:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 -- 172.21.15.28:0/2819134655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cf00c63c0 msgr2=0x7f8cf01ed0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cf00c63c0 0x7f8cf01ed0e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800efc0 tx=0x7f8ce800c490 comp rx=0 tx=0).stop 2023-12-16T03:26:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 -- 172.21.15.28:0/2819134655 shutdown_connections 2023-12-16T03:26:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8cdc066470 0x7f8cdc068930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cf00c63c0 0x7f8cf01ed0e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8cf00c4100 0x7f8cf01ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 --2- 172.21.15.28:0/2819134655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cf00c2bb0 0x7f8cf00c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 -- 172.21.15.28:0/2819134655 >> 172.21.15.28:0/2819134655 conn(0x7f8cf006a5b0 msgr2=0x7f8cf015b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 -- 172.21.15.28:0/2819134655 shutdown_connections 2023-12-16T03:26:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:25.937+0000 7f8cf61d1640 1 -- 172.21.15.28:0/2819134655 wait complete. 2023-12-16T03:26:25.964 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:26:00.659571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:26:01.837383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:26:18.527469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:26:18.979011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:26:25.964 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:26:26.004 INFO:tasks.ceph.mds.c.smithi028.stderr:2023-12-16T03:26:25.997+0000 7ff611c3d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:26:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bf92fe640 1 Processor -- start 2023-12-16T03:26:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bf92fe640 1 -- start start 2023-12-16T03:26:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bf92fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6bf40c4100 0x7f6bf40c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bf92fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6bf40c06d0 0x7f6bf40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bf92fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf40c31c0 con 0x7f6bf40c63c0 2023-12-16T03:26:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bf92fe640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf40c34a0 con 0x7f6bf40c4100 2023-12-16T03:26:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bf92fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf40c1030 con 0x7f6bf40c06d0 2023-12-16T03:26:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bebfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6bf40c4100 0x7f6bf40c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bebfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6bf40c4100 0x7f6bf40c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51384/0 (socket says 172.21.15.28:51384) 2023-12-16T03:26:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bebfff640 1 -- 172.21.15.28:0/3964963680 learned_addr learned my addr 172.21.15.28:0/3964963680 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bf37fe640 1 --2- 172.21.15.28:0/3964963680 >> v2:172.21.15.134:3300/0 conn(0x7f6bf40c06d0 0x7f6bf40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bebfff640 1 -- 172.21.15.28:0/3964963680 >> v2:172.21.15.134:3300/0 conn(0x7f6bf40c06d0 msgr2=0x7f6bf40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bebfff640 1 --2- 172.21.15.28:0/3964963680 >> v2:172.21.15.134:3300/0 conn(0x7f6bf40c06d0 0x7f6bf40a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bebfff640 1 -- 172.21.15.28:0/3964963680 >> v1:172.21.15.134:6789/0 conn(0x7f6bf40c63c0 legacy=0x7f6bf40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.105+0000 7f6bebfff640 1 -- 172.21.15.28:0/3964963680 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf40c1310 con 0x7f6bf40c4100 2023-12-16T03:26:26.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bebfff640 1 --2- 172.21.15.28:0/3964963680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bf40c4100 0x7f6bf40c2bb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40c0ee0 tx=0x7f6bdc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d12a93a1422f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:26.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bf27fc640 1 -- 172.21.15.28:0/3964963680 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf40aa3d0 con 0x7f6bf40c4100 2023-12-16T03:26:26.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bf27fc640 1 -- 172.21.15.28:0/3964963680 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc0a7050 con 0x7f6bf40c4100 2023-12-16T03:26:26.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bf27fc640 1 -- 172.21.15.28:0/3964963680 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc0ab820 con 0x7f6bf40c4100 2023-12-16T03:26:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bf92fe640 1 -- 172.21.15.28:0/3964963680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bf40c4100 msgr2=0x7f6bf40c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bf92fe640 1 --2- 172.21.15.28:0/3964963680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bf40c4100 0x7f6bf40c2bb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40c0ee0 tx=0x7f6bdc01c3e0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bf92fe640 1 -- 172.21.15.28:0/3964963680 shutdown_connections 2023-12-16T03:26:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bf92fe640 1 --2- 172.21.15.28:0/3964963680 >> v2:172.21.15.134:3300/0 conn(0x7f6bf40c06d0 0x7f6bf40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bf92fe640 1 --2- 172.21.15.28:0/3964963680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bf40c4100 0x7f6bf40c2bb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bf92fe640 1 -- 172.21.15.28:0/3964963680 >> 172.21.15.28:0/3964963680 conn(0x7f6bf406a5b0 msgr2=0x7f6bf406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bf92fe640 1 -- 172.21.15.28:0/3964963680 shutdown_connections 2023-12-16T03:26:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.109+0000 7f6bf92fe640 1 -- 172.21.15.28:0/3964963680 wait complete. 2023-12-16T03:26:26.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf92fe640 1 Processor -- start 2023-12-16T03:26:26.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf92fe640 1 -- start start 2023-12-16T03:26:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf92fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bf40c06d0 0x7f6bf414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf92fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bf40c4100 0x7f6bf41487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf92fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bf40c63c0 0x7f6bf4148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf92fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf414f810 con 0x7f6bf40c4100 2023-12-16T03:26:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf92fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf414d450 con 0x7f6bf40c06d0 2023-12-16T03:26:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf92fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf41ed840 con 0x7f6bf40c63c0 2023-12-16T03:26:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bebfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bf40c4100 0x7f6bf41487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bebfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bf40c4100 0x7f6bf41487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51394/0 (socket says 172.21.15.28:51394) 2023-12-16T03:26:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bebfff640 1 -- 172.21.15.28:0/4022584865 learned_addr learned my addr 172.21.15.28:0/4022584865 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf2ffd640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bf40c06d0 0x7f6bf414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf37fe640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bf40c63c0 0x7f6bf4148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bebfff640 1 -- 172.21.15.28:0/4022584865 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bf40c63c0 msgr2=0x7f6bf4148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bebfff640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bf40c63c0 0x7f6bf4148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bebfff640 1 -- 172.21.15.28:0/4022584865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bf40c06d0 msgr2=0x7f6bf414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bebfff640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bf40c06d0 0x7f6bf414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bebfff640 1 -- 172.21.15.28:0/4022584865 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0094d0 con 0x7f6bf40c4100 2023-12-16T03:26:26.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bebfff640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bf40c4100 0x7f6bf41487b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0ae040 tx=0x7f6bdc019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:26.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6beb7fe640 1 -- 172.21.15.28:0/4022584865 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc0b4420 con 0x7f6bf40c4100 2023-12-16T03:26:26.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6beb7fe640 1 -- 172.21.15.28:0/4022584865 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc0b4580 con 0x7f6bf40c4100 2023-12-16T03:26:26.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6beb7fe640 1 -- 172.21.15.28:0/4022584865 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc0b4910 con 0x7f6bf40c4100 2023-12-16T03:26:26.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf92fe640 1 -- 172.21.15.28:0/4022584865 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf41532a0 con 0x7f6bf40c4100 2023-12-16T03:26:26.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf92fe640 1 -- 172.21.15.28:0/4022584865 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf4153860 con 0x7f6bf40c4100 2023-12-16T03:26:26.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.113+0000 7f6bf92fe640 1 -- 172.21.15.28:0/4022584865 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf414d5e0 con 0x7f6bf40c4100 2023-12-16T03:26:26.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.117+0000 7f6beb7fe640 1 -- 172.21.15.28:0/4022584865 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6bdc0b2070 con 0x7f6bf40c4100 2023-12-16T03:26:26.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.117+0000 7f6beb7fe640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bd40664f0 0x7f6bd40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.117+0000 7f6beb7fe640 1 -- 172.21.15.28:0/4022584865 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6bdc11dbd0 con 0x7f6bf40c4100 2023-12-16T03:26:26.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.117+0000 7f6bf2ffd640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bd40664f0 0x7f6bd40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.117+0000 7f6bf2ffd640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bd40664f0 0x7f6bd40689b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6be4007fd0 tx=0x7f6be4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:26.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.121+0000 7f6beb7fe640 1 -- 172.21.15.28:0/4022584865 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6bdc0eae10 con 0x7f6bf40c4100 2023-12-16T03:26:26.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.277+0000 7f6bf92fe640 1 -- 172.21.15.28:0/4022584865 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6bf4068400 con 0x7f6bf40c4100 2023-12-16T03:26:26.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.277+0000 7f6beb7fe640 1 -- 172.21.15.28:0/4022584865 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6bdc0ee430 con 0x7f6bf40c4100 2023-12-16T03:26:26.284 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:26:26.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 -- 172.21.15.28:0/4022584865 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bd40664f0 msgr2=0x7f6bd40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bd40664f0 0x7f6bd40689b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6be4007fd0 tx=0x7f6be4009040 comp rx=0 tx=0).stop 2023-12-16T03:26:26.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 -- 172.21.15.28:0/4022584865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bf40c4100 msgr2=0x7f6bf41487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bf40c4100 0x7f6bf41487b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0ae040 tx=0x7f6bdc019180 comp rx=0 tx=0).stop 2023-12-16T03:26:26.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 -- 172.21.15.28:0/4022584865 shutdown_connections 2023-12-16T03:26:26.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6bf40c63c0 0x7f6bf4148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6bd40664f0 0x7f6bd40689b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bf40c4100 0x7f6bf41487b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 --2- 172.21.15.28:0/4022584865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bf40c06d0 0x7f6bf414fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 -- 172.21.15.28:0/4022584865 >> 172.21.15.28:0/4022584865 conn(0x7f6bf406a5b0 msgr2=0x7f6bf406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:26.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 -- 172.21.15.28:0/4022584865 shutdown_connections 2023-12-16T03:26:26.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.281+0000 7f6bf92fe640 1 -- 172.21.15.28:0/4022584865 wait complete. 2023-12-16T03:26:26.305 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:26:26.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.489+0000 7f21716bb640 1 Processor -- start 2023-12-16T03:26:26.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.489+0000 7f21716bb640 1 -- start start 2023-12-16T03:26:26.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f21716bb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f216c0c7c50 0x7f216c1544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f21716bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f216c154a10 0x7f216c15ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f21716bb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0c8160 con 0x7f216c151cd0 2023-12-16T03:26:26.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f21716bb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c157b40 con 0x7f216c0c7c50 2023-12-16T03:26:26.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f21716bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c157e20 con 0x7f216c154a10 2023-12-16T03:26:26.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f216b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f216c0c7c50 0x7f216c1544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f216b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f216c0c7c50 0x7f216c1544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51404/0 (socket says 172.21.15.28:51404) 2023-12-16T03:26:26.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f216b7fe640 1 -- 172.21.15.28:0/4160565334 learned_addr learned my addr 172.21.15.28:0/4160565334 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:26.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f216bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f216c151cd0 0x7f216c0ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58486/0 (socket says 172.21.15.28:58486) 2023-12-16T03:26:26.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f2170eba640 1 --2- 172.21.15.28:0/4160565334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f216c154a10 0x7f216c15ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f216b7fe640 1 -- 172.21.15.28:0/4160565334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f216c154a10 msgr2=0x7f216c15ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:26.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f216b7fe640 1 --2- 172.21.15.28:0/4160565334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f216c154a10 0x7f216c15ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f216b7fe640 1 -- 172.21.15.28:0/4160565334 >> v1:172.21.15.28:6789/0 conn(0x7f216c151cd0 legacy=0x7f216c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f216b7fe640 1 -- 172.21.15.28:0/4160565334 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c158100 con 0x7f216c0c7c50 2023-12-16T03:26:26.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.493+0000 7f216affd640 1 -- 172.21.15.28:0/4160565334 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699450462 0 0) 0x7f216c0c8160 con 0x7f216c151cd0 2023-12-16T03:26:26.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f216b7fe640 1 --2- 172.21.15.28:0/4160565334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f216c0c7c50 0x7f216c1544d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2160009870 tx=0x7f216001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584c121ff344fe6b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:26.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f216affd640 1 -- 172.21.15.28:0/4160565334 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21600a95f0 con 0x7f216c0c7c50 2023-12-16T03:26:26.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f216affd640 1 -- 172.21.15.28:0/4160565334 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21600a9750 con 0x7f216c0c7c50 2023-12-16T03:26:26.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f216affd640 1 -- 172.21.15.28:0/4160565334 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21600a9ae0 con 0x7f216c0c7c50 2023-12-16T03:26:26.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 -- 172.21.15.28:0/4160565334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f216c0c7c50 msgr2=0x7f216c1544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 --2- 172.21.15.28:0/4160565334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f216c0c7c50 0x7f216c1544d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2160009870 tx=0x7f216001c510 comp rx=0 tx=0).stop 2023-12-16T03:26:26.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 -- 172.21.15.28:0/4160565334 shutdown_connections 2023-12-16T03:26:26.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 --2- 172.21.15.28:0/4160565334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f216c154a10 0x7f216c15ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 --2- 172.21.15.28:0/4160565334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f216c0c7c50 0x7f216c1544d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 -- 172.21.15.28:0/4160565334 >> 172.21.15.28:0/4160565334 conn(0x7f216c0abee0 msgr2=0x7f216c0c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:26.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 -- 172.21.15.28:0/4160565334 shutdown_connections 2023-12-16T03:26:26.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 -- 172.21.15.28:0/4160565334 wait complete. 2023-12-16T03:26:26.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 Processor -- start 2023-12-16T03:26:26.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 -- start start 2023-12-16T03:26:26.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216c0c7c50 0x7f216c145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f216c151cd0 0x7f216c14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f216c154a10 0x7f216c1efe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c14a8c0 con 0x7f216c154a10 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c149b70 con 0x7f216c0c7c50 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f21716bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0aaa20 con 0x7f216c151cd0 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f2170eba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f216c154a10 0x7f216c1efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.497+0000 7f2170eba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f216c154a10 0x7f216c1efe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51418/0 (socket says 172.21.15.28:51418) 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2170eba640 1 -- 172.21.15.28:0/1429608762 learned_addr learned my addr 172.21.15.28:0/1429608762 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f216bfff640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216c0c7c50 0x7f216c145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f216b7fe640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f216c151cd0 0x7f216c14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2170eba640 1 -- 172.21.15.28:0/1429608762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f216c151cd0 msgr2=0x7f216c14b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2170eba640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f216c151cd0 0x7f216c14b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2170eba640 1 -- 172.21.15.28:0/1429608762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216c0c7c50 msgr2=0x7f216c145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2170eba640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216c0c7c50 0x7f216c145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2170eba640 1 -- 172.21.15.28:0/1429608762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21600094d0 con 0x7f216c154a10 2023-12-16T03:26:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2170eba640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f216c154a10 0x7f216c1efe00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2164007e90 tx=0x7f216400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:26.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2168ff9640 1 -- 172.21.15.28:0/1429608762 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164014420 con 0x7f216c154a10 2023-12-16T03:26:26.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2168ff9640 1 -- 172.21.15.28:0/1429608762 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164014580 con 0x7f216c154a10 2023-12-16T03:26:26.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f21716bb640 1 -- 172.21.15.28:0/1429608762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c149de0 con 0x7f216c154a10 2023-12-16T03:26:26.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2168ff9640 1 -- 172.21.15.28:0/1429608762 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164014930 con 0x7f216c154a10 2023-12-16T03:26:26.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f21716bb640 1 -- 172.21.15.28:0/1429608762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c14a3a0 con 0x7f216c154a10 2023-12-16T03:26:26.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f21716bb640 1 -- 172.21.15.28:0/1429608762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c04e850 con 0x7f216c154a10 2023-12-16T03:26:26.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2168ff9640 1 -- 172.21.15.28:0/1429608762 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2164014a90 con 0x7f216c154a10 2023-12-16T03:26:26.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2168ff9640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f21580664a0 0x7f2158068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.501+0000 7f2168ff9640 1 -- 172.21.15.28:0/1429608762 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2164084990 con 0x7f216c154a10 2023-12-16T03:26:26.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.505+0000 7f216bfff640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f21580664a0 0x7f2158068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.505+0000 7f216bfff640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f21580664a0 0x7f2158068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f215c007fd0 tx=0x7f215c007d60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:26.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.505+0000 7f2168ff9640 1 -- 172.21.15.28:0/1429608762 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2164051ac0 con 0x7f216c154a10 2023-12-16T03:26:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.665+0000 7f21716bb640 1 -- 172.21.15.28:0/1429608762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f216c06d180 con 0x7f216c154a10 2023-12-16T03:26:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.665+0000 7f2168ff9640 1 -- 172.21.15.28:0/1429608762 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21640550e0 con 0x7f216c154a10 2023-12-16T03:26:26.673 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:26:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 -- 172.21.15.28:0/1429608762 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f21580664a0 msgr2=0x7f2158068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f21580664a0 0x7f2158068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f215c007fd0 tx=0x7f215c007d60 comp rx=0 tx=0).stop 2023-12-16T03:26:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 -- 172.21.15.28:0/1429608762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f216c154a10 msgr2=0x7f216c1efe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f216c154a10 0x7f216c1efe00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2164007e90 tx=0x7f216400e4b0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 -- 172.21.15.28:0/1429608762 shutdown_connections 2023-12-16T03:26:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f21580664a0 0x7f2158068960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f216c154a10 0x7f216c1efe00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f216c151cd0 0x7f216c14b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 --2- 172.21.15.28:0/1429608762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f216c0c7c50 0x7f216c145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 -- 172.21.15.28:0/1429608762 >> 172.21.15.28:0/1429608762 conn(0x7f216c0abee0 msgr2=0x7f216c1506a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 -- 172.21.15.28:0/1429608762 shutdown_connections 2023-12-16T03:26:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.669+0000 7f21716bb640 1 -- 172.21.15.28:0/1429608762 wait complete. 2023-12-16T03:26:26.694 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:26:26.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.833+0000 7f85e4972640 1 Processor -- start 2023-12-16T03:26:26.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.833+0000 7f85e4972640 1 -- start start 2023-12-16T03:26:26.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85e4972640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f85e00c5640 0x7f85e00c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85e4972640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f85e00c60f0 0x7f85e0155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85e4972640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e00c2580 con 0x7f85e00c5260 2023-12-16T03:26:26.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85e4972640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e0153510 con 0x7f85e00c60f0 2023-12-16T03:26:26.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85e4972640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e00c17f0 con 0x7f85e00c5640 2023-12-16T03:26:26.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85ded9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f85e00c60f0 0x7f85e0155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85ded9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f85e00c60f0 0x7f85e0155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51424/0 (socket says 172.21.15.28:51424) 2023-12-16T03:26:26.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85ded9d640 1 -- 172.21.15.28:0/1956243623 learned_addr learned my addr 172.21.15.28:0/1956243623 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:26.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85ddd9b640 1 --2- 172.21.15.28:0/1956243623 >> v2:172.21.15.134:3300/0 conn(0x7f85e00c5640 0x7f85e00c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85ded9d640 1 -- 172.21.15.28:0/1956243623 >> v2:172.21.15.134:3300/0 conn(0x7f85e00c5640 msgr2=0x7f85e00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:26.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85ded9d640 1 --2- 172.21.15.28:0/1956243623 >> v2:172.21.15.134:3300/0 conn(0x7f85e00c5640 0x7f85e00c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85ded9d640 1 -- 172.21.15.28:0/1956243623 >> v1:172.21.15.28:6789/0 conn(0x7f85e00c5260 legacy=0x7f85e006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85ded9d640 1 -- 172.21.15.28:0/1956243623 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e00c1a00 con 0x7f85e00c60f0 2023-12-16T03:26:26.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85dd59a640 1 -- 172.21.15.28:0/1956243623 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112107208 0 0) 0x7f85e00c2580 con 0x7f85e00c5260 2023-12-16T03:26:26.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.837+0000 7f85ddd9b640 1 --2- 172.21.15.28:0/1956243623 >> v2:172.21.15.134:3300/0 conn(0x7f85e00c5640 0x7f85e00c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:26.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85ded9d640 1 --2- 172.21.15.28:0/1956243623 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85e00c60f0 0x7f85e0155de0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f85e006b390 tx=0x7f85d801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431350e0c5f98dcb server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:26.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85dd59a640 1 -- 172.21.15.28:0/1956243623 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80a57d0 con 0x7f85e00c60f0 2023-12-16T03:26:26.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85dd59a640 1 -- 172.21.15.28:0/1956243623 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d80a5930 con 0x7f85e00c60f0 2023-12-16T03:26:26.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85dd59a640 1 -- 172.21.15.28:0/1956243623 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80a5cc0 con 0x7f85e00c60f0 2023-12-16T03:26:26.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85e4972640 1 -- 172.21.15.28:0/1956243623 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85e00c60f0 msgr2=0x7f85e0155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85e4972640 1 --2- 172.21.15.28:0/1956243623 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85e00c60f0 0x7f85e0155de0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f85e006b390 tx=0x7f85d801c910 comp rx=0 tx=0).stop 2023-12-16T03:26:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85e4972640 1 -- 172.21.15.28:0/1956243623 shutdown_connections 2023-12-16T03:26:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85e4972640 1 --2- 172.21.15.28:0/1956243623 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85e00c60f0 0x7f85e0155de0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85e4972640 1 --2- 172.21.15.28:0/1956243623 >> v2:172.21.15.134:3300/0 conn(0x7f85e00c5640 0x7f85e00c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85e4972640 1 -- 172.21.15.28:0/1956243623 >> 172.21.15.28:0/1956243623 conn(0x7f85e006a5b0 msgr2=0x7f85e006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85e4972640 1 -- 172.21.15.28:0/1956243623 shutdown_connections 2023-12-16T03:26:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85e4972640 1 -- 172.21.15.28:0/1956243623 wait complete. 2023-12-16T03:26:26.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85e4972640 1 Processor -- start 2023-12-16T03:26:26.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.841+0000 7f85e4972640 1 -- start start 2023-12-16T03:26:26.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85e4972640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85e00c5260 0x7f85e00a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85e4972640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85e00c5640 0x7f85e00a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85e4972640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85e00c60f0 0x7f85e01f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85e4972640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e014f460 con 0x7f85e00c5260 2023-12-16T03:26:26.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85e4972640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e01eff70 con 0x7f85e00c60f0 2023-12-16T03:26:26.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85e4972640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00aa9f0 con 0x7f85e00c5640 2023-12-16T03:26:26.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85de59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85e00c5260 0x7f85e00a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85de59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85e00c5260 0x7f85e00a8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51432/0 (socket says 172.21.15.28:51432) 2023-12-16T03:26:26.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85de59c640 1 -- 172.21.15.28:0/1154666462 learned_addr learned my addr 172.21.15.28:0/1154666462 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85ded9d640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85e00c60f0 0x7f85e01f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85ddd9b640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85e00c5640 0x7f85e00a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85de59c640 1 -- 172.21.15.28:0/1154666462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85e00c5640 msgr2=0x7f85e00a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85de59c640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85e00c5640 0x7f85e00a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85de59c640 1 -- 172.21.15.28:0/1154666462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85e00c60f0 msgr2=0x7f85e01f06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85de59c640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85e00c60f0 0x7f85e01f06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85de59c640 1 -- 172.21.15.28:0/1154666462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d8009b30 con 0x7f85e00c5260 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85de59c640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85e00c5260 0x7f85e00a8e80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f85d0001ec0 tx=0x7f85d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85ceffd640 1 -- 172.21.15.28:0/1154666462 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00054e0 con 0x7f85e00c5260 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85ceffd640 1 -- 172.21.15.28:0/1154666462 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d0003600 con 0x7f85e00c5260 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85e4972640 1 -- 172.21.15.28:0/1154666462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e00aacd0 con 0x7f85e00c5260 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85ceffd640 1 -- 172.21.15.28:0/1154666462 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00039b0 con 0x7f85e00c5260 2023-12-16T03:26:26.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85e4972640 1 -- 172.21.15.28:0/1154666462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e00a82b0 con 0x7f85e00c5260 2023-12-16T03:26:26.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85e4972640 1 -- 172.21.15.28:0/1154666462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e0068400 con 0x7f85e00c5260 2023-12-16T03:26:26.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.845+0000 7f85ceffd640 1 -- 172.21.15.28:0/1154666462 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f85d0003b10 con 0x7f85e00c5260 2023-12-16T03:26:26.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.849+0000 7f85ceffd640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85c00664a0 0x7f85c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:26.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.849+0000 7f85ceffd640 1 -- 172.21.15.28:0/1154666462 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f85d0083790 con 0x7f85e00c5260 2023-12-16T03:26:26.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.849+0000 7f85ddd9b640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85c00664a0 0x7f85c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:26.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.849+0000 7f85ddd9b640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85c00664a0 0x7f85c0068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f85e00c01a0 tx=0x7f85d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:26.853+0000 7f85ceffd640 1 -- 172.21.15.28:0/1154666462 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f85d00508a0 con 0x7f85e00c5260 2023-12-16T03:26:27.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.009+0000 7f85e4972640 1 -- 172.21.15.28:0/1154666462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85e006d390 con 0x7f85e00c5260 2023-12-16T03:26:27.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85ceffd640 1 -- 172.21.15.28:0/1154666462 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85d00170a0 con 0x7f85e00c5260 2023-12-16T03:26:27.018 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:26:27.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 -- 172.21.15.28:0/1154666462 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85c00664a0 msgr2=0x7f85c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85c00664a0 0x7f85c0068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f85e00c01a0 tx=0x7f85d4008040 comp rx=0 tx=0).stop 2023-12-16T03:26:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 -- 172.21.15.28:0/1154666462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85e00c5260 msgr2=0x7f85e00a8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85e00c5260 0x7f85e00a8e80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f85d0001ec0 tx=0x7f85d000c8e0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 -- 172.21.15.28:0/1154666462 shutdown_connections 2023-12-16T03:26:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85e00c60f0 0x7f85e01f06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85e00c5640 0x7f85e00a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85c00664a0 0x7f85c0068960 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 --2- 172.21.15.28:0/1154666462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85e00c5260 0x7f85e00a8e80 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 -- 172.21.15.28:0/1154666462 >> 172.21.15.28:0/1154666462 conn(0x7f85e006a5b0 msgr2=0x7f85e00c2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 -- 172.21.15.28:0/1154666462 shutdown_connections 2023-12-16T03:26:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.013+0000 7f85e4972640 1 -- 172.21.15.28:0/1154666462 wait complete. 2023-12-16T03:26:27.039 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:26:27.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa0e165640 1 Processor -- start 2023-12-16T03:26:27.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa0e165640 1 -- start start 2023-12-16T03:26:27.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa0e165640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffa080c63c0 0x7ffa080c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa0e165640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa080c4100 0x7ffa080c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa0e165640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa080c31c0 con 0x7ffa080c29e0 2023-12-16T03:26:27.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa0e165640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa080c34a0 con 0x7ffa080c4100 2023-12-16T03:26:27.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa0e165640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa080c1030 con 0x7ffa080c63c0 2023-12-16T03:26:27.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa06ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa080c4100 0x7ffa080c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa07fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ffa080c29e0 0x7ffa080a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58490/0 (socket says 172.21.15.28:58490) 2023-12-16T03:26:27.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa07fff640 1 -- 172.21.15.28:0/1201244992 learned_addr learned my addr 172.21.15.28:0/1201244992 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:27.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa077fe640 1 --2- 172.21.15.28:0/1201244992 >> v2:172.21.15.134:3300/0 conn(0x7ffa080c63c0 0x7ffa080c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa06ffd640 1 -- 172.21.15.28:0/1201244992 >> v2:172.21.15.134:3300/0 conn(0x7ffa080c63c0 msgr2=0x7ffa080c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:27.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa06ffd640 1 --2- 172.21.15.28:0/1201244992 >> v2:172.21.15.134:3300/0 conn(0x7ffa080c63c0 0x7ffa080c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa06ffd640 1 -- 172.21.15.28:0/1201244992 >> v1:172.21.15.28:6789/0 conn(0x7ffa080c29e0 legacy=0x7ffa080a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa067fc640 1 -- 172.21.15.28:0/1201244992 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687356588 0 0) 0x7ffa080c31c0 con 0x7ffa080c29e0 2023-12-16T03:26:27.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.181+0000 7ffa06ffd640 1 -- 172.21.15.28:0/1201244992 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa080c1310 con 0x7ffa080c4100 2023-12-16T03:26:27.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa06ffd640 1 --2- 172.21.15.28:0/1201244992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa080c4100 0x7ffa080c24a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffa0806e000 tx=0x7ff9fc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3b89566a8069ec server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:27.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa067fc640 1 -- 172.21.15.28:0/1201244992 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc0ab600 con 0x7ffa080c4100 2023-12-16T03:26:27.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa067fc640 1 -- 172.21.15.28:0/1201244992 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc0a7050 con 0x7ffa080c4100 2023-12-16T03:26:27.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa067fc640 1 -- 172.21.15.28:0/1201244992 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc0ab980 con 0x7ffa080c4100 2023-12-16T03:26:27.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa0e165640 1 -- 172.21.15.28:0/1201244992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa080c4100 msgr2=0x7ffa080c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa0e165640 1 --2- 172.21.15.28:0/1201244992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa080c4100 0x7ffa080c24a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffa0806e000 tx=0x7ff9fc01c310 comp rx=0 tx=0).stop 2023-12-16T03:26:27.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa0e165640 1 -- 172.21.15.28:0/1201244992 shutdown_connections 2023-12-16T03:26:27.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa0e165640 1 --2- 172.21.15.28:0/1201244992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa080c4100 0x7ffa080c24a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa0e165640 1 --2- 172.21.15.28:0/1201244992 >> v2:172.21.15.134:3300/0 conn(0x7ffa080c63c0 0x7ffa080c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa0e165640 1 -- 172.21.15.28:0/1201244992 >> 172.21.15.28:0/1201244992 conn(0x7ffa0806a5b0 msgr2=0x7ffa0806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:27.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa0e165640 1 -- 172.21.15.28:0/1201244992 shutdown_connections 2023-12-16T03:26:27.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa0e165640 1 -- 172.21.15.28:0/1201244992 wait complete. 2023-12-16T03:26:27.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.185+0000 7ffa0e165640 1 Processor -- start 2023-12-16T03:26:27.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa0e165640 1 -- start start 2023-12-16T03:26:27.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa0e165640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa080c29e0 0x7ffa081ebd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa0e165640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa080c4100 0x7ffa08156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa0e165640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa080c63c0 0x7ffa081567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa0e165640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa081eca20 con 0x7ffa080c29e0 2023-12-16T03:26:27.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa0e165640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa081ec740 con 0x7ffa080c4100 2023-12-16T03:26:27.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa0e165640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa08159f20 con 0x7ffa080c63c0 2023-12-16T03:26:27.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa077fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa080c29e0 0x7ffa081ebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa077fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa080c29e0 0x7ffa081ebd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51448/0 (socket says 172.21.15.28:51448) 2023-12-16T03:26:27.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa077fe640 1 -- 172.21.15.28:0/1415786341 learned_addr learned my addr 172.21.15.28:0/1415786341 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:27.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa077fe640 1 -- 172.21.15.28:0/1415786341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa080c63c0 msgr2=0x7ffa081567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa07fff640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa080c63c0 0x7ffa081567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa06ffd640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa080c4100 0x7ffa08156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa077fe640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa080c63c0 0x7ffa081567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa077fe640 1 -- 172.21.15.28:0/1415786341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa080c4100 msgr2=0x7ffa08156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa077fe640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa080c4100 0x7ffa08156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa077fe640 1 -- 172.21.15.28:0/1415786341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc009420 con 0x7ffa080c29e0 2023-12-16T03:26:27.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa06ffd640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa080c4100 0x7ffa08156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:27.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa07fff640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa080c63c0 0x7ffa081567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:27.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa077fe640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa080c29e0 0x7ffa081ebd40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800e870 tx=0x7ff9f800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:27.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ff9effff640 1 -- 172.21.15.28:0/1415786341 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8009510 con 0x7ffa080c29e0 2023-12-16T03:26:27.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ff9effff640 1 -- 172.21.15.28:0/1415786341 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f800eec0 con 0x7ffa080c29e0 2023-12-16T03:26:27.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa0e165640 1 -- 172.21.15.28:0/1415786341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0815a200 con 0x7ffa080c29e0 2023-12-16T03:26:27.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ff9effff640 1 -- 172.21.15.28:0/1415786341 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f800cb40 con 0x7ffa080c29e0 2023-12-16T03:26:27.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa0e165640 1 -- 172.21.15.28:0/1415786341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa080a8ee0 con 0x7ffa080c29e0 2023-12-16T03:26:27.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.189+0000 7ffa0e165640 1 -- 172.21.15.28:0/1415786341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa08068400 con 0x7ffa080c29e0 2023-12-16T03:26:27.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.193+0000 7ff9effff640 1 -- 172.21.15.28:0/1415786341 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff9f800cca0 con 0x7ffa080c29e0 2023-12-16T03:26:27.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.193+0000 7ff9effff640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9f4066470 0x7ff9f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.193+0000 7ff9effff640 1 -- 172.21.15.28:0/1415786341 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff9f80842d0 con 0x7ffa080c29e0 2023-12-16T03:26:27.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.193+0000 7ffa06ffd640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9f4066470 0x7ff9f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.193+0000 7ffa06ffd640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9f4066470 0x7ff9f4068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0ad000 tx=0x7ff9fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:27.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.197+0000 7ff9effff640 1 -- 172.21.15.28:0/1415786341 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff9f8051480 con 0x7ffa080c29e0 2023-12-16T03:26:27.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.353+0000 7ffa0e165640 1 -- 172.21.15.28:0/1415786341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa080c3e50 con 0x7ffa080c29e0 2023-12-16T03:26:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.353+0000 7ff9effff640 1 -- 172.21.15.28:0/1415786341 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7ff9f8054aa0 con 0x7ffa080c29e0 2023-12-16T03:26:27.360 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:26:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 -- 172.21.15.28:0/1415786341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9f4066470 msgr2=0x7ff9f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9f4066470 0x7ff9f4068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0ad000 tx=0x7ff9fc008040 comp rx=0 tx=0).stop 2023-12-16T03:26:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 -- 172.21.15.28:0/1415786341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa080c29e0 msgr2=0x7ffa081ebd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa080c29e0 0x7ffa081ebd40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800e870 tx=0x7ff9f800ec70 comp rx=0 tx=0).stop 2023-12-16T03:26:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 -- 172.21.15.28:0/1415786341 shutdown_connections 2023-12-16T03:26:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa080c63c0 0x7ffa081567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa080c4100 0x7ffa08156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9f4066470 0x7ff9f4068930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 --2- 172.21.15.28:0/1415786341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa080c29e0 0x7ffa081ebd40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 -- 172.21.15.28:0/1415786341 >> 172.21.15.28:0/1415786341 conn(0x7ffa0806a5b0 msgr2=0x7ffa08151f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 -- 172.21.15.28:0/1415786341 shutdown_connections 2023-12-16T03:26:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.357+0000 7ffa0e165640 1 -- 172.21.15.28:0/1415786341 wait complete. 2023-12-16T03:26:27.381 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:26:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6f31d640 1 Processor -- start 2023-12-16T03:26:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6f31d640 1 -- start start 2023-12-16T03:26:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6f31d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fea680bffc0 0x7fea6815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6f31d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6815c600 con 0x7fea681560e0 2023-12-16T03:26:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6f31d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6815a5c0 con 0x7fea6806d520 2023-12-16T03:26:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6f31d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea681594e0 con 0x7fea680bffc0 2023-12-16T03:26:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6d0b9640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fea681560e0 0x7fea68159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58498/0 (socket says 172.21.15.28:58498) 2023-12-16T03:26:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6d0b9640 1 -- 172.21.15.28:0/2078662681 learned_addr learned my addr 172.21.15.28:0/2078662681 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6d8ba640 1 --2- 172.21.15.28:0/2078662681 >> v2:172.21.15.28:3300/0 conn(0x7fea680bffc0 0x7fea6815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea5ffff640 1 -- 172.21.15.28:0/2078662681 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155195242 0 0) 0x7fea6815c600 con 0x7fea681560e0 2023-12-16T03:26:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea5ffff640 1 -- 172.21.15.28:0/2078662681 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea54003530 con 0x7fea681560e0 2023-12-16T03:26:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6d8ba640 1 -- 172.21.15.28:0/2078662681 >> v1:172.21.15.134:6789/0 conn(0x7fea6806d520 legacy=0x7fea680c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6d8ba640 1 -- 172.21.15.28:0/2078662681 >> v1:172.21.15.28:6789/0 conn(0x7fea681560e0 legacy=0x7fea68159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.525+0000 7fea6d8ba640 1 -- 172.21.15.28:0/2078662681 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea681597c0 con 0x7fea680bffc0 2023-12-16T03:26:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.529+0000 7fea6d8ba640 1 --2- 172.21.15.28:0/2078662681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea680bffc0 0x7fea6815ca90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fea60009d90 tx=0x7fea6001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2575c08a95913142 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.529+0000 7fea5ffff640 1 -- 172.21.15.28:0/2078662681 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600a59e0 con 0x7fea680bffc0 2023-12-16T03:26:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.529+0000 7fea5ffff640 1 -- 172.21.15.28:0/2078662681 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea600a5b40 con 0x7fea680bffc0 2023-12-16T03:26:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.529+0000 7fea5ffff640 1 -- 172.21.15.28:0/2078662681 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600ad440 con 0x7fea680bffc0 2023-12-16T03:26:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.529+0000 7fea6f31d640 1 -- 172.21.15.28:0/2078662681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea680bffc0 msgr2=0x7fea6815ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.529+0000 7fea6f31d640 1 --2- 172.21.15.28:0/2078662681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea680bffc0 0x7fea6815ca90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fea60009d90 tx=0x7fea6001c920 comp rx=0 tx=0).stop 2023-12-16T03:26:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.529+0000 7fea6f31d640 1 -- 172.21.15.28:0/2078662681 shutdown_connections 2023-12-16T03:26:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.529+0000 7fea6f31d640 1 --2- 172.21.15.28:0/2078662681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea680bffc0 0x7fea6815ca90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.529+0000 7fea6f31d640 1 -- 172.21.15.28:0/2078662681 >> 172.21.15.28:0/2078662681 conn(0x7fea6806a5b0 msgr2=0x7fea6806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.529+0000 7fea6f31d640 1 -- 172.21.15.28:0/2078662681 shutdown_connections 2023-12-16T03:26:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.529+0000 7fea6f31d640 1 -- 172.21.15.28:0/2078662681 wait complete. 2023-12-16T03:26:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6f31d640 1 Processor -- start 2023-12-16T03:26:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6f31d640 1 -- start start 2023-12-16T03:26:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6f31d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea6806d520 0x7fea681f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6f31d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea680bffc0 0x7fea6814e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6f31d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea681560e0 0x7fea68156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6f31d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea681f1a00 con 0x7fea680bffc0 2023-12-16T03:26:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6f31d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea681513d0 con 0x7fea681560e0 2023-12-16T03:26:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6f31d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea681510a0 con 0x7fea6806d520 2023-12-16T03:26:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6c8b8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea680bffc0 0x7fea6814e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6c8b8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea680bffc0 0x7fea6814e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51466/0 (socket says 172.21.15.28:51466) 2023-12-16T03:26:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6c8b8640 1 -- 172.21.15.28:0/3221521897 learned_addr learned my addr 172.21.15.28:0/3221521897 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6d0b9640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea6806d520 0x7fea681f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6d8ba640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea681560e0 0x7fea68156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6c8b8640 1 -- 172.21.15.28:0/3221521897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea6806d520 msgr2=0x7fea681f14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6c8b8640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea6806d520 0x7fea681f14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6c8b8640 1 -- 172.21.15.28:0/3221521897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea681560e0 msgr2=0x7fea68156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6c8b8640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea681560e0 0x7fea68156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6c8b8640 1 -- 172.21.15.28:0/3221521897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea60009a70 con 0x7fea680bffc0 2023-12-16T03:26:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6c8b8640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea680bffc0 0x7fea6814e2d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fea5800c390 tx=0x7fea5800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea5dffb640 1 -- 172.21.15.28:0/3221521897 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea580052d0 con 0x7fea680bffc0 2023-12-16T03:26:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea5dffb640 1 -- 172.21.15.28:0/3221521897 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58005430 con 0x7fea680bffc0 2023-12-16T03:26:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea5dffb640 1 -- 172.21.15.28:0/3221521897 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58003820 con 0x7fea680bffc0 2023-12-16T03:26:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6f31d640 1 -- 172.21.15.28:0/3221521897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea681f55c0 con 0x7fea680bffc0 2023-12-16T03:26:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6f31d640 1 -- 172.21.15.28:0/3221521897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea681f58a0 con 0x7fea680bffc0 2023-12-16T03:26:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.533+0000 7fea6f31d640 1 -- 172.21.15.28:0/3221521897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6806fe30 con 0x7fea680bffc0 2023-12-16T03:26:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.537+0000 7fea5dffb640 1 -- 172.21.15.28:0/3221521897 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fea58003980 con 0x7fea680bffc0 2023-12-16T03:26:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.537+0000 7fea5dffb640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea4c066470 0x7fea4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.537+0000 7fea5dffb640 1 -- 172.21.15.28:0/3221521897 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fea58083780 con 0x7fea680bffc0 2023-12-16T03:26:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.537+0000 7fea6d0b9640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea4c066470 0x7fea4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.537+0000 7fea6d0b9640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea4c066470 0x7fea4c068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fea640011f0 tx=0x7fea64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:27.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.541+0000 7fea5dffb640 1 -- 172.21.15.28:0/3221521897 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fea58050800 con 0x7fea680bffc0 2023-12-16T03:26:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 -- 172.21.15.28:0/3221521897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fea68151510 con 0x7fea680bffc0 2023-12-16T03:26:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea5dffb640 1 -- 172.21.15.28:0/3221521897 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7fea58053e20 con 0x7fea680bffc0 2023-12-16T03:26:27.710 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 -- 172.21.15.28:0/3221521897 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea4c066470 msgr2=0x7fea4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea4c066470 0x7fea4c068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fea640011f0 tx=0x7fea64009040 comp rx=0 tx=0).stop 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 -- 172.21.15.28:0/3221521897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea680bffc0 msgr2=0x7fea6814e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea680bffc0 0x7fea6814e2d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fea5800c390 tx=0x7fea5800c850 comp rx=0 tx=0).stop 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 -- 172.21.15.28:0/3221521897 shutdown_connections 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea681560e0 0x7fea68156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fea4c066470 0x7fea4c068930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fea680bffc0 0x7fea6814e2d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 --2- 172.21.15.28:0/3221521897 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea6806d520 0x7fea681f14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 -- 172.21.15.28:0/3221521897 >> 172.21.15.28:0/3221521897 conn(0x7fea6806a5b0 msgr2=0x7fea6806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 -- 172.21.15.28:0/3221521897 shutdown_connections 2023-12-16T03:26:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.705+0000 7fea6f31d640 1 -- 172.21.15.28:0/3221521897 wait complete. 2023-12-16T03:26:27.731 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:26:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f4b11d640 1 Processor -- start 2023-12-16T03:26:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f4b11d640 1 -- start start 2023-12-16T03:26:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f4b11d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f440c63c0 0x7f9f440c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f4b11d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f440c31c0 con 0x7f9f440c2bb0 2023-12-16T03:26:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f4b11d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f440c34a0 con 0x7f9f440c4100 2023-12-16T03:26:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f4b11d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440c1030 con 0x7f9f440c63c0 2023-12-16T03:26:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f496ba640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9f440c2bb0 0x7f9f440a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58508/0 (socket says 172.21.15.28:58508) 2023-12-16T03:26:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f496ba640 1 -- 172.21.15.28:0/3270316626 learned_addr learned my addr 172.21.15.28:0/3270316626 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f48eb9640 1 --2- 172.21.15.28:0/3270316626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f440c63c0 0x7f9f440c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f437fe640 1 -- 172.21.15.28:0/3270316626 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576481609 0 0) 0x7f9f440c31c0 con 0x7f9f440c2bb0 2023-12-16T03:26:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f437fe640 1 -- 172.21.15.28:0/3270316626 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f34003530 con 0x7f9f440c2bb0 2023-12-16T03:26:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f437fe640 1 -- 172.21.15.28:0/3270316626 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110436852 0 0) 0x7f9f440c34a0 con 0x7f9f440c4100 2023-12-16T03:26:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f437fe640 1 -- 172.21.15.28:0/3270316626 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f440c31c0 con 0x7f9f440c4100 2023-12-16T03:26:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f48eb9640 1 -- 172.21.15.28:0/3270316626 >> v1:172.21.15.134:6789/0 conn(0x7f9f440c4100 legacy=0x7f9f440c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f48eb9640 1 -- 172.21.15.28:0/3270316626 >> v1:172.21.15.28:6789/0 conn(0x7f9f440c2bb0 legacy=0x7f9f440a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.869+0000 7f9f48eb9640 1 -- 172.21.15.28:0/3270316626 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f440c1310 con 0x7f9f440c63c0 2023-12-16T03:26:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.873+0000 7f9f48eb9640 1 --2- 172.21.15.28:0/3270316626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f440c63c0 0x7f9f440c06d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f380097f0 tx=0x7f9f3801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=275f7007b7eae45a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:27.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.873+0000 7f9f437fe640 1 -- 172.21.15.28:0/3270316626 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380ab600 con 0x7f9f440c63c0 2023-12-16T03:26:27.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.873+0000 7f9f437fe640 1 -- 172.21.15.28:0/3270316626 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f380a7050 con 0x7f9f440c63c0 2023-12-16T03:26:27.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.873+0000 7f9f437fe640 1 -- 172.21.15.28:0/3270316626 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380ab960 con 0x7f9f440c63c0 2023-12-16T03:26:27.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.873+0000 7f9f4b11d640 1 -- 172.21.15.28:0/3270316626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f440c63c0 msgr2=0x7f9f440c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.873+0000 7f9f4b11d640 1 --2- 172.21.15.28:0/3270316626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f440c63c0 0x7f9f440c06d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f380097f0 tx=0x7f9f3801c370 comp rx=0 tx=0).stop 2023-12-16T03:26:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.873+0000 7f9f4b11d640 1 -- 172.21.15.28:0/3270316626 shutdown_connections 2023-12-16T03:26:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.873+0000 7f9f4b11d640 1 --2- 172.21.15.28:0/3270316626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f440c63c0 0x7f9f440c06d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.873+0000 7f9f4b11d640 1 -- 172.21.15.28:0/3270316626 >> 172.21.15.28:0/3270316626 conn(0x7f9f4406a5b0 msgr2=0x7f9f4406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.873+0000 7f9f4b11d640 1 -- 172.21.15.28:0/3270316626 shutdown_connections 2023-12-16T03:26:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.873+0000 7f9f4b11d640 1 -- 172.21.15.28:0/3270316626 wait complete. 2023-12-16T03:26:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f4b11d640 1 Processor -- start 2023-12-16T03:26:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f4b11d640 1 -- start start 2023-12-16T03:26:27.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f4b11d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f440c2bb0 0x7f9f440a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f4b11d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f440c4100 0x7f9f4414e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f4b11d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f440c63c0 0x7f9f441f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f4b11d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44151480 con 0x7f9f440c2bb0 2023-12-16T03:26:27.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f4b11d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f441511a0 con 0x7f9f440c63c0 2023-12-16T03:26:27.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f4b11d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4414da30 con 0x7f9f440c4100 2023-12-16T03:26:27.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f48eb9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f440c2bb0 0x7f9f440a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f48eb9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f440c2bb0 0x7f9f440a6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51480/0 (socket says 172.21.15.28:51480) 2023-12-16T03:26:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f48eb9640 1 -- 172.21.15.28:0/1195816476 learned_addr learned my addr 172.21.15.28:0/1195816476 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f43fff640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f440c4100 0x7f9f4414e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f496ba640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f440c63c0 0x7f9f441f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f48eb9640 1 -- 172.21.15.28:0/1195816476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f440c4100 msgr2=0x7f9f4414e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f48eb9640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f440c4100 0x7f9f4414e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f48eb9640 1 -- 172.21.15.28:0/1195816476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f440c63c0 msgr2=0x7f9f441f01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f48eb9640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f440c63c0 0x7f9f441f01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:27.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f48eb9640 1 -- 172.21.15.28:0/1195816476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f38009420 con 0x7f9f440c2bb0 2023-12-16T03:26:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f48eb9640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f440c2bb0 0x7f9f440a6710 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9f38000c10 tx=0x7f9f38019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f417fa640 1 -- 172.21.15.28:0/1195816476 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38006e20 con 0x7f9f440c2bb0 2023-12-16T03:26:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f417fa640 1 -- 172.21.15.28:0/1195816476 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f380b6480 con 0x7f9f440c2bb0 2023-12-16T03:26:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f4b11d640 1 -- 172.21.15.28:0/1195816476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f440c69b0 con 0x7f9f440c2bb0 2023-12-16T03:26:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.877+0000 7f9f417fa640 1 -- 172.21.15.28:0/1195816476 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380b67f0 con 0x7f9f440c2bb0 2023-12-16T03:26:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.881+0000 7f9f4b11d640 1 -- 172.21.15.28:0/1195816476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4414dff0 con 0x7f9f440c2bb0 2023-12-16T03:26:27.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.881+0000 7f9f4b11d640 1 -- 172.21.15.28:0/1195816476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4414d870 con 0x7f9f440c2bb0 2023-12-16T03:26:27.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.881+0000 7f9f417fa640 1 -- 172.21.15.28:0/1195816476 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9f380b2040 con 0x7f9f440c2bb0 2023-12-16T03:26:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.881+0000 7f9f417fa640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f28066470 0x7f9f28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.881+0000 7f9f417fa640 1 -- 172.21.15.28:0/1195816476 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9f3811e880 con 0x7f9f440c2bb0 2023-12-16T03:26:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.881+0000 7f9f43fff640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f28066470 0x7f9f28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:27.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.881+0000 7f9f43fff640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f28066470 0x7f9f28068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f4415cd30 tx=0x7f9f30009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:27.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:27.885+0000 7f9f417fa640 1 -- 172.21.15.28:0/1195816476 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9f380eba50 con 0x7f9f440c2bb0 2023-12-16T03:26:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 -- 172.21.15.28:0/1195816476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f44068400 con 0x7f9f440c2bb0 2023-12-16T03:26:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f417fa640 1 -- 172.21.15.28:0/1195816476 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9f380b0080 con 0x7f9f440c2bb0 2023-12-16T03:26:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:26:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 -- 172.21.15.28:0/1195816476 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f28066470 msgr2=0x7f9f28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f28066470 0x7f9f28068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f4415cd30 tx=0x7f9f30009040 comp rx=0 tx=0).stop 2023-12-16T03:26:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 -- 172.21.15.28:0/1195816476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f440c2bb0 msgr2=0x7f9f440a6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f440c2bb0 0x7f9f440a6710 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9f38000c10 tx=0x7f9f38019110 comp rx=0 tx=0).stop 2023-12-16T03:26:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 -- 172.21.15.28:0/1195816476 shutdown_connections 2023-12-16T03:26:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f440c63c0 0x7f9f441f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f440c4100 0x7f9f4414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f28066470 0x7f9f28068930 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 --2- 172.21.15.28:0/1195816476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f440c2bb0 0x7f9f440a6710 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 -- 172.21.15.28:0/1195816476 >> 172.21.15.28:0/1195816476 conn(0x7f9f4406a5b0 msgr2=0x7f9f4415c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:28.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 -- 172.21.15.28:0/1195816476 shutdown_connections 2023-12-16T03:26:28.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.057+0000 7f9f4b11d640 1 -- 172.21.15.28:0/1195816476 wait complete. 2023-12-16T03:26:28.084 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-16T03:26:28.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:28.085 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-16T03:26:28.116 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:26:28.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:28.116 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T03:26:28.166 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:26:28.166 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:28.222 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-16T03:26:28.222 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:26:28.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f67d0640 1 Processor -- start 2023-12-16T03:26:28.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f67d0640 1 -- start start 2023-12-16T03:26:28.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f67d0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f55f00af5c0 0x7f55f00c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:28.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f67d0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f55f00c4bc0 0x7f55f0154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f67d0640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f006c660 con 0x7f55f00c4750 2023-12-16T03:26:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f67d0640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f00c5010 con 0x7f55f00af5c0 2023-12-16T03:26:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f67d0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f006ba50 con 0x7f55f00c4bc0 2023-12-16T03:26:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f57ce640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f55f00af5c0 0x7f55f00c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f57ce640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f55f00af5c0 0x7f55f00c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51494/0 (socket says 172.21.15.28:51494) 2023-12-16T03:26:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f57ce640 1 -- 172.21.15.28:0/3318636575 learned_addr learned my addr 172.21.15.28:0/3318636575 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f5fcf640 1 --2- 172.21.15.28:0/3318636575 >> v2:172.21.15.134:3300/0 conn(0x7f55f00c4bc0 0x7f55f0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f57ce640 1 -- 172.21.15.28:0/3318636575 >> v2:172.21.15.134:3300/0 conn(0x7f55f00c4bc0 msgr2=0x7f55f0154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f57ce640 1 --2- 172.21.15.28:0/3318636575 >> v2:172.21.15.134:3300/0 conn(0x7f55f00c4bc0 0x7f55f0154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f57ce640 1 -- 172.21.15.28:0/3318636575 >> v1:172.21.15.28:6789/0 conn(0x7f55f00c4750 legacy=0x7f55f01544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:28.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.361+0000 7f55f57ce640 1 -- 172.21.15.28:0/3318636575 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f006bd30 con 0x7f55f00af5c0 2023-12-16T03:26:28.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55f57ce640 1 --2- 172.21.15.28:0/3318636575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55f00af5c0 0x7f55f00c7d80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f55f008bfa0 tx=0x7f55ec01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd825dc6fdd88cd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:28.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55e7fff640 1 -- 172.21.15.28:0/3318636575 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0ab5f0 con 0x7f55f00af5c0 2023-12-16T03:26:28.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55e7fff640 1 -- 172.21.15.28:0/3318636575 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0ab750 con 0x7f55f00af5c0 2023-12-16T03:26:28.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55e7fff640 1 -- 172.21.15.28:0/3318636575 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0abae0 con 0x7f55f00af5c0 2023-12-16T03:26:28.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55f67d0640 1 -- 172.21.15.28:0/3318636575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55f00af5c0 msgr2=0x7f55f00c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:28.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55f67d0640 1 --2- 172.21.15.28:0/3318636575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55f00af5c0 0x7f55f00c7d80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f55f008bfa0 tx=0x7f55ec01c500 comp rx=0 tx=0).stop 2023-12-16T03:26:28.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55f67d0640 1 -- 172.21.15.28:0/3318636575 shutdown_connections 2023-12-16T03:26:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55f67d0640 1 --2- 172.21.15.28:0/3318636575 >> v2:172.21.15.134:3300/0 conn(0x7f55f00c4bc0 0x7f55f0154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55f67d0640 1 --2- 172.21.15.28:0/3318636575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55f00af5c0 0x7f55f00c7d80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55f67d0640 1 -- 172.21.15.28:0/3318636575 >> 172.21.15.28:0/3318636575 conn(0x7f55f00ab960 msgr2=0x7f55f00abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55f67d0640 1 -- 172.21.15.28:0/3318636575 shutdown_connections 2023-12-16T03:26:28.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55f67d0640 1 -- 172.21.15.28:0/3318636575 wait complete. 2023-12-16T03:26:28.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55f67d0640 1 Processor -- start 2023-12-16T03:26:28.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.365+0000 7f55f67d0640 1 -- start start 2023-12-16T03:26:28.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f67d0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55f00af5c0 0x7f55f01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:28.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f67d0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55f00c4750 0x7f55f01ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:28.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f67d0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55f00c4bc0 0x7f55f01505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:28.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f67d0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0156ef0 con 0x7f55f00c4bc0 2023-12-16T03:26:28.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f67d0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00bd190 con 0x7f55f00c4750 2023-12-16T03:26:28.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f67d0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f01ecdf0 con 0x7f55f00af5c0 2023-12-16T03:26:28.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f5fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55f00c4bc0 0x7f55f01505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:28.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f5fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55f00c4bc0 0x7f55f01505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51498/0 (socket says 172.21.15.28:51498) 2023-12-16T03:26:28.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f5fcf640 1 -- 172.21.15.28:0/358665672 learned_addr learned my addr 172.21.15.28:0/358665672 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:28.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f4fcd640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55f00c4750 0x7f55f01ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:28.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f57ce640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55f00af5c0 0x7f55f01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f5fcf640 1 -- 172.21.15.28:0/358665672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55f00af5c0 msgr2=0x7f55f01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f5fcf640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55f00af5c0 0x7f55f01569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f5fcf640 1 -- 172.21.15.28:0/358665672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55f00c4750 msgr2=0x7f55f01ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f5fcf640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55f00c4750 0x7f55f01ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f5fcf640 1 -- 172.21.15.28:0/358665672 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec0094d0 con 0x7f55f00c4bc0 2023-12-16T03:26:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f5fcf640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55f00c4bc0 0x7f55f01505e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f55e8007e40 tx=0x7f55e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55e5ffb640 1 -- 172.21.15.28:0/358665672 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e8014620 con 0x7f55f00c4bc0 2023-12-16T03:26:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55e5ffb640 1 -- 172.21.15.28:0/358665672 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e800ee90 con 0x7f55f00c4bc0 2023-12-16T03:26:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f67d0640 1 -- 172.21.15.28:0/358665672 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f014e9c0 con 0x7f55f00c4bc0 2023-12-16T03:26:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55e5ffb640 1 -- 172.21.15.28:0/358665672 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e80149e0 con 0x7f55f00c4bc0 2023-12-16T03:26:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f67d0640 1 -- 172.21.15.28:0/358665672 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f01ed090 con 0x7f55f00c4bc0 2023-12-16T03:26:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.369+0000 7f55f67d0640 1 -- 172.21.15.28:0/358665672 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f01ed2b0 con 0x7f55f00c4bc0 2023-12-16T03:26:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.373+0000 7f55e5ffb640 1 -- 172.21.15.28:0/358665672 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f55e8014b40 con 0x7f55f00c4bc0 2023-12-16T03:26:28.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.373+0000 7f55e5ffb640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55d4066470 0x7f55d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:28.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.373+0000 7f55e5ffb640 1 -- 172.21.15.28:0/358665672 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f55e8084a60 con 0x7f55f00c4bc0 2023-12-16T03:26:28.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.373+0000 7f55f57ce640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55d4066470 0x7f55d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:28.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.373+0000 7f55f57ce640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55d4066470 0x7f55d4068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0af000 tx=0x7f55ec0b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:28.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.377+0000 7f55e5ffb640 1 -- 172.21.15.28:0/358665672 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f55e8051c20 con 0x7f55f00c4bc0 2023-12-16T03:26:28.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 -- 172.21.15.28:0/358665672 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f55f004e850 con 0x7f55f00c4bc0 2023-12-16T03:26:28.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55e5ffb640 1 -- 172.21.15.28:0/358665672 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+149 (secure 0 0 0) 0x7f55e8055240 con 0x7f55f00c4bc0 2023-12-16T03:26:28.582 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:26:28.582 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-16T03:26:28.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 -- 172.21.15.28:0/358665672 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55d4066470 msgr2=0x7f55d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:28.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55d4066470 0x7f55d4068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0af000 tx=0x7f55ec0b6040 comp rx=0 tx=0).stop 2023-12-16T03:26:28.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 -- 172.21.15.28:0/358665672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55f00c4bc0 msgr2=0x7f55f01505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:28.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55f00c4bc0 0x7f55f01505e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f55e8007e40 tx=0x7f55e800e4b0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 -- 172.21.15.28:0/358665672 shutdown_connections 2023-12-16T03:26:28.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55d4066470 0x7f55d4068930 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55f00c4bc0 0x7f55f01505e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55f00c4750 0x7f55f01ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 --2- 172.21.15.28:0/358665672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55f00af5c0 0x7f55f01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:28.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 -- 172.21.15.28:0/358665672 >> 172.21.15.28:0/358665672 conn(0x7f55f00ab960 msgr2=0x7f55f00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:28.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 -- 172.21.15.28:0/358665672 shutdown_connections 2023-12-16T03:26:28.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:28.577+0000 7f55f67d0640 1 -- 172.21.15.28:0/358665672 wait complete. 2023-12-16T03:26:28.604 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-16T03:26:28.604 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:26:28.604 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-12-16T03:26:28.604 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-16T03:26:28.604 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:26:28.604 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-16T03:26:28.604 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:26:28.604 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:26:28.604 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:26:28.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:28.604 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-12-16T03:26:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:26:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:26:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:26:28.614 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-16T03:26:28.615 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42351sec preferred_lft 42351sec 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 02:42:8f:0f:48:af brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T03:26:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:26:28.617 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:28.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:28.618 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:26:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-12-16T03:26:28.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:28.686 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-12-16T03:26:28.739 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-12-16T03:26:28.739 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:26:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-16T03:26:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T03:26:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:26:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T03:26:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:26:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:26:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:26:28.740 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:26:28.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:28.740 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:26:28.741 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:26:28.741 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T03:26:28.741 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T03:26:28.741 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T03:26:28.741 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:26:28.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:28.833 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-16T03:26:28.842 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T03:26:28.843 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:26:28.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:28.843 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-12-16T03:26:28.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:26:28.906 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T03:26:28.961 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:26:28.961 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:26:28.961 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:26:29.012 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-16T03:26:29.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:29.012 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:29.102 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:29.102 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:26:29.116 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:29.116 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:26:29.116 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:26:29.116 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: 1@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs2=/ 2023-12-16T03:26:29.116 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:26:29.119 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:26:29.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:29.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:26:29.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:29.141 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:26:29.208 INFO:teuthology.orchestra.run.smithi134.stdout:client5000 2023-12-16T03:26:29.209 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:26:29.209 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:29.261 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-12-16T03:26:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.413+0000 7f333cad6640 1 Processor -- start 2023-12-16T03:26:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.413+0000 7f333cad6640 1 -- start start 2023-12-16T03:26:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.413+0000 7f333cad6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f33380c0370 0x7f33380c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.413+0000 7f333cad6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f33380c12b0 0x7f33380c1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.413+0000 7f333cad6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3338073b70 con 0x7f3338151e00 2023-12-16T03:26:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.413+0000 7f333cad6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33380735b0 con 0x7f33380c12b0 2023-12-16T03:26:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.413+0000 7f333cad6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3338073890 con 0x7f33380c0370 2023-12-16T03:26:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.413+0000 7f333659c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3338151e00 0x7f3338158580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58526/0 (socket says 172.21.15.28:58526) 2023-12-16T03:26:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.413+0000 7f333659c640 1 -- 172.21.15.28:0/4100738865 learned_addr learned my addr 172.21.15.28:0/4100738865 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.413+0000 7f3336d9d640 1 --2- 172.21.15.28:0/4100738865 >> v2:172.21.15.28:3300/0 conn(0x7f33380c12b0 0x7f33380c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.413+0000 7f332ffff640 1 --2- 172.21.15.28:0/4100738865 >> v2:172.21.15.134:3300/0 conn(0x7f33380c0370 0x7f33380c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:29.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f3336d9d640 1 -- 172.21.15.28:0/4100738865 >> v2:172.21.15.134:3300/0 conn(0x7f33380c0370 msgr2=0x7f33380c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:29.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f3336d9d640 1 --2- 172.21.15.28:0/4100738865 >> v2:172.21.15.134:3300/0 conn(0x7f33380c0370 0x7f33380c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:29.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f3336d9d640 1 -- 172.21.15.28:0/4100738865 >> v1:172.21.15.28:6789/0 conn(0x7f3338151e00 legacy=0x7f3338158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:29.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f3336d9d640 1 -- 172.21.15.28:0/4100738865 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33380bfb70 con 0x7f33380c12b0 2023-12-16T03:26:29.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f3335d9b640 1 -- 172.21.15.28:0/4100738865 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491160976 0 0) 0x7f3338073b70 con 0x7f3338151e00 2023-12-16T03:26:29.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f3336d9d640 1 --2- 172.21.15.28:0/4100738865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33380c12b0 0x7f33380c1740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3338070750 tx=0x7f333001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3325b2af93562cfe server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:29.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f3335d9b640 1 -- 172.21.15.28:0/4100738865 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33300a66c0 con 0x7f33380c12b0 2023-12-16T03:26:29.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f3335d9b640 1 -- 172.21.15.28:0/4100738865 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33300a6820 con 0x7f33380c12b0 2023-12-16T03:26:29.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f3335d9b640 1 -- 172.21.15.28:0/4100738865 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33300a6bb0 con 0x7f33380c12b0 2023-12-16T03:26:29.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f333cad6640 1 -- 172.21.15.28:0/4100738865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33380c12b0 msgr2=0x7f33380c1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:29.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f333cad6640 1 --2- 172.21.15.28:0/4100738865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33380c12b0 0x7f33380c1740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3338070750 tx=0x7f333001c7f0 comp rx=0 tx=0).stop 2023-12-16T03:26:29.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f333cad6640 1 -- 172.21.15.28:0/4100738865 shutdown_connections 2023-12-16T03:26:29.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f333cad6640 1 --2- 172.21.15.28:0/4100738865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33380c12b0 0x7f33380c1740 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:29.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f333cad6640 1 --2- 172.21.15.28:0/4100738865 >> v2:172.21.15.134:3300/0 conn(0x7f33380c0370 0x7f33380c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:29.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.417+0000 7f333cad6640 1 -- 172.21.15.28:0/4100738865 >> 172.21.15.28:0/4100738865 conn(0x7f33380c31a0 msgr2=0x7f33380c35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:29.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333cad6640 1 -- 172.21.15.28:0/4100738865 shutdown_connections 2023-12-16T03:26:29.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333cad6640 1 -- 172.21.15.28:0/4100738865 wait complete. 2023-12-16T03:26:29.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333cad6640 1 Processor -- start 2023-12-16T03:26:29.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333cad6640 1 -- start start 2023-12-16T03:26:29.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333cad6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33380c0370 0x7f3338156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:29.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333cad6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33380c12b0 0x7f333814bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333cad6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3338151e00 0x7f333814c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333cad6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333815eb00 con 0x7f33380c0370 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333cad6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3338154aa0 con 0x7f3338151e00 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333cad6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33381554b0 con 0x7f33380c12b0 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33380c0370 0x7f3338156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33380c0370 0x7f3338156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51520/0 (socket says 172.21.15.28:51520) 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333659c640 1 -- 172.21.15.28:0/859564470 learned_addr learned my addr 172.21.15.28:0/859564470 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f3336d9d640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3338151e00 0x7f333814c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f332ffff640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33380c12b0 0x7f333814bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333659c640 1 -- 172.21.15.28:0/859564470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33380c12b0 msgr2=0x7f333814bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333659c640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33380c12b0 0x7f333814bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:29.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333659c640 1 -- 172.21.15.28:0/859564470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3338151e00 msgr2=0x7f333814c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:29.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333659c640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3338151e00 0x7f333814c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:29.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333659c640 1 -- 172.21.15.28:0/859564470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330009a70 con 0x7f33380c0370 2023-12-16T03:26:29.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f333659c640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33380c0370 0x7f3338156c70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f332800c4b0 tx=0x7f332800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:29.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.421+0000 7f332effd640 1 -- 172.21.15.28:0/859564470 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280074e0 con 0x7f33380c0370 2023-12-16T03:26:29.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.425+0000 7f332effd640 1 -- 172.21.15.28:0/859564470 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3328007660 con 0x7f33380c0370 2023-12-16T03:26:29.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.425+0000 7f332effd640 1 -- 172.21.15.28:0/859564470 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328004a30 con 0x7f33380c0370 2023-12-16T03:26:29.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.425+0000 7f333cad6640 1 -- 172.21.15.28:0/859564470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333806a7c0 con 0x7f33380c0370 2023-12-16T03:26:29.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.425+0000 7f333cad6640 1 -- 172.21.15.28:0/859564470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333815e820 con 0x7f33380c0370 2023-12-16T03:26:29.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.425+0000 7f333cad6640 1 -- 172.21.15.28:0/859564470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3338068400 con 0x7f33380c0370 2023-12-16T03:26:29.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.425+0000 7f332effd640 1 -- 172.21.15.28:0/859564470 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3328004b90 con 0x7f33380c0370 2023-12-16T03:26:29.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.425+0000 7f332effd640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33180664a0 0x7f3318068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:29.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.425+0000 7f332effd640 1 -- 172.21.15.28:0/859564470 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f33280832e0 con 0x7f33380c0370 2023-12-16T03:26:29.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.425+0000 7f332ffff640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33180664a0 0x7f3318068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:29.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.425+0000 7f332ffff640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33180664a0 0x7f3318068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3338158a00 tx=0x7f3320009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:29.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.429+0000 7f332effd640 1 -- 172.21.15.28:0/859564470 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3328050410 con 0x7f33380c0370 2023-12-16T03:26:29.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.617+0000 7f333cad6640 1 -- 172.21.15.28:0/859564470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f3338072170 con 0x7f33380c0370 2023-12-16T03:26:29.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.621+0000 7f332effd640 1 -- 172.21.15.28:0/859564470 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v13) v1 ==== 134+0+185 (secure 0 0 0) 0x7f3328053a30 con 0x7f33380c0370 2023-12-16T03:26:29.627 INFO:teuthology.orchestra.run.smithi028.stdout:[client.testuser] 2023-12-16T03:26:29.627 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDlGH1l/sM4JRAAhBvUn0krm8eJTjfzpHCvgA== 2023-12-16T03:26:29.628 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-16T03:26:29.628 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r fsname=cephfs" 2023-12-16T03:26:29.628 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-16T03:26:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.621+0000 7f333cad6640 1 -- 172.21.15.28:0/859564470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33180664a0 msgr2=0x7f3318068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.625+0000 7f333cad6640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33180664a0 0x7f3318068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3338158a00 tx=0x7f3320009190 comp rx=0 tx=0).stop 2023-12-16T03:26:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.625+0000 7f333cad6640 1 -- 172.21.15.28:0/859564470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33380c0370 msgr2=0x7f3338156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.625+0000 7f333cad6640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33380c0370 0x7f3338156c70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f332800c4b0 tx=0x7f332800c970 comp rx=0 tx=0).stop 2023-12-16T03:26:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.625+0000 7f333cad6640 1 -- 172.21.15.28:0/859564470 shutdown_connections 2023-12-16T03:26:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.625+0000 7f333cad6640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3338151e00 0x7f333814c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.625+0000 7f333cad6640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33380c12b0 0x7f333814bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.625+0000 7f333cad6640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33180664a0 0x7f3318068960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.625+0000 7f333cad6640 1 --2- 172.21.15.28:0/859564470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33380c0370 0x7f3338156c70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.625+0000 7f333cad6640 1 -- 172.21.15.28:0/859564470 >> 172.21.15.28:0/859564470 conn(0x7f33380c31a0 msgr2=0x7f3338151130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.625+0000 7f333cad6640 1 -- 172.21.15.28:0/859564470 shutdown_connections 2023-12-16T03:26:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.625+0000 7f333cad6640 1 -- 172.21.15.28:0/859564470 wait complete. 2023-12-16T03:26:29.649 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2023-12-16T03:26:29.657 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.XCh8itscPB 2023-12-16T03:26:29.658 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:26:29.658 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/tmp/tmp.XCh8itscPB 2023-12-16T03:26:29.709 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:26:29.709 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:29.765 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:26:29.766 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:29.818 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:30.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e8a965640 1 Processor -- start 2023-12-16T03:26:30.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e8a965640 1 -- start start 2023-12-16T03:26:30.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e8a965640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e84151e90 0x7f0e840c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e8a965640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e840c7ea0 0x7f0e8406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e8a965640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8406c860 con 0x7f0e840c4e60 2023-12-16T03:26:30.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e8a965640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e840c8750 con 0x7f0e840c7ea0 2023-12-16T03:26:30.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e8a965640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e841552d0 con 0x7f0e84151e90 2023-12-16T03:26:30.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e83fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e84151e90 0x7f0e840c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e837fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0e840c7ea0 0x7f0e8406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e88f02640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0e840c4e60 0x7f0e8406b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:36348/0 (socket says 172.21.15.28:36348) 2023-12-16T03:26:30.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e88f02640 1 -- 172.21.15.28:0/3372295933 learned_addr learned my addr 172.21.15.28:0/3372295933 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:30.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e83fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e84151e90 0x7f0e840c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:34492/0 (socket says 172.21.15.28:34492) 2023-12-16T03:26:30.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e83fff640 1 -- 172.21.15.28:0/3372295933 >> v2:172.21.15.134:3300/0 conn(0x7f0e840c7ea0 msgr2=0x7f0e8406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:30.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e83fff640 1 --2- 172.21.15.28:0/3372295933 >> v2:172.21.15.134:3300/0 conn(0x7f0e840c7ea0 0x7f0e8406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e83fff640 1 -- 172.21.15.28:0/3372295933 >> v1:172.21.15.134:6789/0 conn(0x7f0e840c4e60 legacy=0x7f0e8406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:29.997+0000 7f0e83fff640 1 -- 172.21.15.28:0/3372295933 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e84154930 con 0x7f0e84151e90 2023-12-16T03:26:30.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e83fff640 1 --2- 172.21.15.28:0/3372295933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e84151e90 0x7f0e840c4920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e740097c0 tx=0x7f0e7401c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b92bdc8cf897782 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:30.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e82ffd640 1 -- 172.21.15.28:0/3372295933 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e740ab600 con 0x7f0e84151e90 2023-12-16T03:26:30.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e82ffd640 1 -- 172.21.15.28:0/3372295933 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e740a7050 con 0x7f0e84151e90 2023-12-16T03:26:30.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e82ffd640 1 -- 172.21.15.28:0/3372295933 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e740ab980 con 0x7f0e84151e90 2023-12-16T03:26:30.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e8a965640 1 -- 172.21.15.28:0/3372295933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e84151e90 msgr2=0x7f0e840c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e8a965640 1 --2- 172.21.15.28:0/3372295933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e84151e90 0x7f0e840c4920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e740097c0 tx=0x7f0e7401c360 comp rx=0 tx=0).stop 2023-12-16T03:26:30.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e8a965640 1 -- 172.21.15.28:0/3372295933 shutdown_connections 2023-12-16T03:26:30.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e8a965640 1 --2- 172.21.15.28:0/3372295933 >> v2:172.21.15.134:3300/0 conn(0x7f0e840c7ea0 0x7f0e8406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e8a965640 1 --2- 172.21.15.28:0/3372295933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e84151e90 0x7f0e840c4920 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e8a965640 1 -- 172.21.15.28:0/3372295933 >> 172.21.15.28:0/3372295933 conn(0x7f0e840ca170 msgr2=0x7f0e840ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:30.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e8a965640 1 -- 172.21.15.28:0/3372295933 shutdown_connections 2023-12-16T03:26:30.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.001+0000 7f0e8a965640 1 -- 172.21.15.28:0/3372295933 wait complete. 2023-12-16T03:26:30.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e8a965640 1 Processor -- start 2023-12-16T03:26:30.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e8a965640 1 -- start start 2023-12-16T03:26:30.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e8a965640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e840c4e60 0x7f0e840ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e8a965640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e840c7ea0 0x7f0e841ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e8a965640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e84151e90 0x7f0e84143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e8a965640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e841ed3d0 con 0x7f0e840c4e60 2023-12-16T03:26:30.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e8a965640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840aeca0 con 0x7f0e84151e90 2023-12-16T03:26:30.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e8a965640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840ae9c0 con 0x7f0e840c7ea0 2023-12-16T03:26:30.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e83fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e840c4e60 0x7f0e840ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e83fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e840c4e60 0x7f0e840ae3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48852/0 (socket says 172.21.15.28:48852) 2023-12-16T03:26:30.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e83fff640 1 -- 172.21.15.28:0/935040080 learned_addr learned my addr 172.21.15.28:0/935040080 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:30.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e88f02640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e84151e90 0x7f0e84143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e837fe640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e840c7ea0 0x7f0e841ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e83fff640 1 -- 172.21.15.28:0/935040080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e840c7ea0 msgr2=0x7f0e841ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e83fff640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e840c7ea0 0x7f0e841ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e83fff640 1 -- 172.21.15.28:0/935040080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e84151e90 msgr2=0x7f0e84143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e83fff640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e84151e90 0x7f0e84143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e83fff640 1 -- 172.21.15.28:0/935040080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e74009420 con 0x7f0e840c4e60 2023-12-16T03:26:30.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e83fff640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e840c4e60 0x7f0e840ae3e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0e74019f90 tx=0x7f0e74019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:30.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e80ff9640 1 -- 172.21.15.28:0/935040080 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e740abdb0 con 0x7f0e840c4e60 2023-12-16T03:26:30.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e80ff9640 1 -- 172.21.15.28:0/935040080 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e740b5470 con 0x7f0e840c4e60 2023-12-16T03:26:30.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e80ff9640 1 -- 172.21.15.28:0/935040080 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e740b5820 con 0x7f0e840c4e60 2023-12-16T03:26:30.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.005+0000 7f0e8a965640 1 -- 172.21.15.28:0/935040080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e841ecd80 con 0x7f0e840c4e60 2023-12-16T03:26:30.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.009+0000 7f0e8a965640 1 -- 172.21.15.28:0/935040080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e84144240 con 0x7f0e840c4e60 2023-12-16T03:26:30.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.009+0000 7f0e8a965640 1 -- 172.21.15.28:0/935040080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e84068400 con 0x7f0e840c4e60 2023-12-16T03:26:30.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.009+0000 7f0e80ff9640 1 -- 172.21.15.28:0/935040080 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0e740b2040 con 0x7f0e840c4e60 2023-12-16T03:26:30.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.009+0000 7f0e80ff9640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e70066470 0x7f0e70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.009+0000 7f0e80ff9640 1 -- 172.21.15.28:0/935040080 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0e7411e2a0 con 0x7f0e840c4e60 2023-12-16T03:26:30.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.009+0000 7f0e837fe640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e70066470 0x7f0e70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.009+0000 7f0e837fe640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e70066470 0x7f0e70068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0e841f0140 tx=0x7f0e78009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:30.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.013+0000 7f0e80ff9640 1 -- 172.21.15.28:0/935040080 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0e740eb500 con 0x7f0e840c4e60 2023-12-16T03:26:30.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 -- 172.21.15.28:0/935040080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e84158c40 con 0x7f0e840c4e60 2023-12-16T03:26:30.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e80ff9640 1 -- 172.21.15.28:0/935040080 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20229 (secure 0 0 0) 0x7f0e740eeb20 con 0x7f0e840c4e60 2023-12-16T03:26:30.179 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:30.179 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:21.432053+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:30.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 -- 172.21.15.28:0/935040080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e70066470 msgr2=0x7f0e70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e70066470 0x7f0e70068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0e841f0140 tx=0x7f0e78009190 comp rx=0 tx=0).stop 2023-12-16T03:26:30.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 -- 172.21.15.28:0/935040080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e840c4e60 msgr2=0x7f0e840ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e840c4e60 0x7f0e840ae3e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0e74019f90 tx=0x7f0e74019100 comp rx=0 tx=0).stop 2023-12-16T03:26:30.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 -- 172.21.15.28:0/935040080 shutdown_connections 2023-12-16T03:26:30.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e84151e90 0x7f0e84143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0e840c7ea0 0x7f0e841ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0e70066470 0x7f0e70068930 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 --2- 172.21.15.28:0/935040080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e840c4e60 0x7f0e840ae3e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 -- 172.21.15.28:0/935040080 >> 172.21.15.28:0/935040080 conn(0x7f0e840ca170 msgr2=0x7f0e84153f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:30.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 -- 172.21.15.28:0/935040080 shutdown_connections 2023-12-16T03:26:30.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.173+0000 7f0e8a965640 1 -- 172.21.15.28:0/935040080 wait complete. 2023-12-16T03:26:30.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:26:00.659571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:26:01.837383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:26:18.527469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:26:18.979011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:26:30.201 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:26:30.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.341+0000 7fe15d3a7640 1 Processor -- start 2023-12-16T03:26:30.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.341+0000 7fe15d3a7640 1 -- start start 2023-12-16T03:26:30.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe15d3a7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe15814f7e0 0x7fe158155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe15d3a7640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe15806e360 0x7fe158156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe15d3a7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe158071260 0x7fe158071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe15d3a7640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe158155880 con 0x7fe15806e360 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe15d3a7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe158072450 con 0x7fe158071260 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe15d3a7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe158156790 con 0x7fe15814f7e0 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe1577fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe15806e360 0x7fe158156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe1577fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe15806e360 0x7fe158156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48868/0 (socket says 172.21.15.28:48868) 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe1577fe640 1 -- 172.21.15.28:0/9621089 learned_addr learned my addr 172.21.15.28:0/9621089 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe157fff640 1 --2- 172.21.15.28:0/9621089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe15814f7e0 0x7fe158155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe15cba6640 1 --2- 172.21.15.28:0/9621089 >> v2:172.21.15.134:3300/0 conn(0x7fe158071260 0x7fe158071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe1577fe640 1 -- 172.21.15.28:0/9621089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe15814f7e0 msgr2=0x7fe158155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:30.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe1577fe640 1 --2- 172.21.15.28:0/9621089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe15814f7e0 0x7fe158155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe1577fe640 1 -- 172.21.15.28:0/9621089 >> v2:172.21.15.134:3300/0 conn(0x7fe158071260 msgr2=0x7fe158071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:30.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe1577fe640 1 --2- 172.21.15.28:0/9621089 >> v2:172.21.15.134:3300/0 conn(0x7fe158071260 0x7fe158071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe1577fe640 1 -- 172.21.15.28:0/9621089 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15806a5b0 con 0x7fe15806e360 2023-12-16T03:26:30.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.345+0000 7fe15cba6640 1 --2- 172.21.15.28:0/9621089 >> v2:172.21.15.134:3300/0 conn(0x7fe158071260 0x7fe158071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:30.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe1577fe640 1 --2- 172.21.15.28:0/9621089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe15806e360 0x7fe158156250 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe1580aba90 tx=0x7fe14c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f53d334f367677 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:30.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe156ffd640 1 -- 172.21.15.28:0/9621089 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0ac630 con 0x7fe15806e360 2023-12-16T03:26:30.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe156ffd640 1 -- 172.21.15.28:0/9621089 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c0ac790 con 0x7fe15806e360 2023-12-16T03:26:30.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe156ffd640 1 -- 172.21.15.28:0/9621089 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0acb20 con 0x7fe15806e360 2023-12-16T03:26:30.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe15d3a7640 1 -- 172.21.15.28:0/9621089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe15806e360 msgr2=0x7fe158156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe15d3a7640 1 --2- 172.21.15.28:0/9621089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe15806e360 0x7fe158156250 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe1580aba90 tx=0x7fe14c01c500 comp rx=0 tx=0).stop 2023-12-16T03:26:30.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe15d3a7640 1 -- 172.21.15.28:0/9621089 shutdown_connections 2023-12-16T03:26:30.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe15d3a7640 1 --2- 172.21.15.28:0/9621089 >> v2:172.21.15.134:3300/0 conn(0x7fe158071260 0x7fe158071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe15d3a7640 1 --2- 172.21.15.28:0/9621089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe15806e360 0x7fe158156250 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe15d3a7640 1 --2- 172.21.15.28:0/9621089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe15814f7e0 0x7fe158155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe15d3a7640 1 -- 172.21.15.28:0/9621089 >> 172.21.15.28:0/9621089 conn(0x7fe1580c63b0 msgr2=0x7fe1580c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:30.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe15d3a7640 1 -- 172.21.15.28:0/9621089 shutdown_connections 2023-12-16T03:26:30.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe15d3a7640 1 -- 172.21.15.28:0/9621089 wait complete. 2023-12-16T03:26:30.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe15d3a7640 1 Processor -- start 2023-12-16T03:26:30.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.349+0000 7fe15d3a7640 1 -- start start 2023-12-16T03:26:30.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15d3a7640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe15806e360 0x7fe15814d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15d3a7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158071260 0x7fe1580c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15d3a7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe15814f7e0 0x7fe158145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15d3a7640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580c45b0 con 0x7fe15814f7e0 2023-12-16T03:26:30.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15d3a7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580aaec0 con 0x7fe158071260 2023-12-16T03:26:30.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15d3a7640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1581ee200 con 0x7fe15806e360 2023-12-16T03:26:30.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15cba6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe15814f7e0 0x7fe158145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15cba6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe15814f7e0 0x7fe158145ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48882/0 (socket says 172.21.15.28:48882) 2023-12-16T03:26:30.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15cba6640 1 -- 172.21.15.28:0/1068714283 learned_addr learned my addr 172.21.15.28:0/1068714283 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:30.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe157fff640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe15806e360 0x7fe15814d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe1577fe640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158071260 0x7fe1580c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15cba6640 1 -- 172.21.15.28:0/1068714283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe15806e360 msgr2=0x7fe15814d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15cba6640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe15806e360 0x7fe15814d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15cba6640 1 -- 172.21.15.28:0/1068714283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158071260 msgr2=0x7fe1580c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15cba6640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158071260 0x7fe1580c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15cba6640 1 -- 172.21.15.28:0/1068714283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0094d0 con 0x7fe15814f7e0 2023-12-16T03:26:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15cba6640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe15814f7e0 0x7fe158145ce0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe150007e70 tx=0x7fe15000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe154ff9640 1 -- 172.21.15.28:0/1068714283 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150003ba0 con 0x7fe15814f7e0 2023-12-16T03:26:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe154ff9640 1 -- 172.21.15.28:0/1068714283 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15000f040 con 0x7fe15814f7e0 2023-12-16T03:26:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15d3a7640 1 -- 172.21.15.28:0/1068714283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1581ee4e0 con 0x7fe15814f7e0 2023-12-16T03:26:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe154ff9640 1 -- 172.21.15.28:0/1068714283 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15000de80 con 0x7fe15814f7e0 2023-12-16T03:26:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15d3a7640 1 -- 172.21.15.28:0/1068714283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe158149520 con 0x7fe15814f7e0 2023-12-16T03:26:30.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe15d3a7640 1 -- 172.21.15.28:0/1068714283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1580c4720 con 0x7fe15814f7e0 2023-12-16T03:26:30.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.353+0000 7fe154ff9640 1 -- 172.21.15.28:0/1068714283 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe150004030 con 0x7fe15814f7e0 2023-12-16T03:26:30.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.357+0000 7fe154ff9640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1440664a0 0x7fe144068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.357+0000 7fe154ff9640 1 -- 172.21.15.28:0/1068714283 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe1500844d0 con 0x7fe15814f7e0 2023-12-16T03:26:30.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.357+0000 7fe157fff640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1440664a0 0x7fe144068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.357+0000 7fe157fff640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1440664a0 0x7fe144068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe1480099d0 tx=0x7fe148008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:30.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.361+0000 7fe154ff9640 1 -- 172.21.15.28:0/1068714283 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe1500515e0 con 0x7fe15814f7e0 2023-12-16T03:26:30.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.521+0000 7fe15d3a7640 1 -- 172.21.15.28:0/1068714283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1581ee6d0 con 0x7fe15814f7e0 2023-12-16T03:26:30.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.521+0000 7fe154ff9640 1 -- 172.21.15.28:0/1068714283 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe15001a020 con 0x7fe15814f7e0 2023-12-16T03:26:30.529 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:26:30.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 -- 172.21.15.28:0/1068714283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1440664a0 msgr2=0x7fe144068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1440664a0 0x7fe144068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe1480099d0 tx=0x7fe148008040 comp rx=0 tx=0).stop 2023-12-16T03:26:30.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 -- 172.21.15.28:0/1068714283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe15814f7e0 msgr2=0x7fe158145ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe15814f7e0 0x7fe158145ce0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe150007e70 tx=0x7fe15000d4a0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 -- 172.21.15.28:0/1068714283 shutdown_connections 2023-12-16T03:26:30.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1440664a0 0x7fe144068960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe15814f7e0 0x7fe158145ce0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe158071260 0x7fe1580c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 --2- 172.21.15.28:0/1068714283 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe15806e360 0x7fe15814d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 -- 172.21.15.28:0/1068714283 >> 172.21.15.28:0/1068714283 conn(0x7fe1580c63b0 msgr2=0x7fe15806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:30.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 -- 172.21.15.28:0/1068714283 shutdown_connections 2023-12-16T03:26:30.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.525+0000 7fe15d3a7640 1 -- 172.21.15.28:0/1068714283 wait complete. 2023-12-16T03:26:30.550 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:26:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.689+0000 7f42177c1640 1 Processor -- start 2023-12-16T03:26:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.689+0000 7f42177c1640 1 -- start start 2023-12-16T03:26:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.689+0000 7f42177c1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4210072090 0x7f4210150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f42177c1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42100c2760 con 0x7f42100a5370 2023-12-16T03:26:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f42177c1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42100a5750 con 0x7f42100725c0 2023-12-16T03:26:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f42177c1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42100c3070 con 0x7f4210072090 2023-12-16T03:26:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f421555d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f42100a5370 0x7f42100c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45572/0 (socket says 172.21.15.28:45572) 2023-12-16T03:26:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f421555d640 1 -- 172.21.15.28:0/1579601014 learned_addr learned my addr 172.21.15.28:0/1579601014 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4214d5c640 1 --2- 172.21.15.28:0/1579601014 >> v2:172.21.15.134:3300/0 conn(0x7f4210072090 0x7f4210150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772326176 0 0) 0x7f42100c2760 con 0x7f42100a5370 2023-12-16T03:26:30.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41fc003530 con 0x7f42100a5370 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137812719 0 0) 0x7f42100a5750 con 0x7f42100725c0 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42100c2760 con 0x7f42100725c0 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2215774632 0 0) 0x7f41fc003530 con 0x7f42100a5370 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 >> v2:172.21.15.134:3300/0 conn(0x7f4210072090 msgr2=0x7f4210150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 --2- 172.21.15.28:0/1579601014 >> v2:172.21.15.134:3300/0 conn(0x7f4210072090 0x7f4210150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 >> v1:172.21.15.134:6789/0 conn(0x7f42100725c0 legacy=0x7f42101514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100aad20 con 0x7f42100a5370 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f420c001600 con 0x7f42100a5370 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 >> v1:172.21.15.28:6789/0 conn(0x7f42100a5370 legacy=0x7f42100c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41fc003b60 0x7f41fc003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41fc0047d0 0x7f41fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 0x7f41fc00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100c3070 con 0x7f41fc005250 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc00e3a0 con 0x7f41fc0047d0 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc00e560 con 0x7f41fc003b60 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4214d5c640 1 --2- 172.21.15.28:0/1579601014 >> v2:172.21.15.134:3300/0 conn(0x7f4210072090 0x7f4210150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4215d5e640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 0x7f41fc00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f421555d640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41fc003b60 0x7f41fc003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4214d5c640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41fc0047d0 0x7f41fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4215d5e640 1 -- 172.21.15.28:0/1579601014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41fc003b60 msgr2=0x7f41fc003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4215d5e640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41fc003b60 0x7f41fc003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4215d5e640 1 -- 172.21.15.28:0/1579601014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41fc0047d0 msgr2=0x7f41fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4215d5e640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41fc0047d0 0x7f41fc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f4215d5e640 1 -- 172.21.15.28:0/1579601014 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc003530 con 0x7f41fc005250 2023-12-16T03:26:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.693+0000 7f421555d640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41fc003b60 0x7f41fc003f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f4215d5e640 1 -- 172.21.15.28:0/1579601014 reap_dead start 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f4215d5e640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 0x7f41fc00dba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4208001fd0 tx=0x7f420801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a835ce4a2820391f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208003b80 con 0x7f41fc005250 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4208003ce0 con 0x7f41fc005250 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f4207fff640 1 -- 172.21.15.28:0/1579601014 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208005310 con 0x7f41fc005250 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f42177c1640 1 -- 172.21.15.28:0/1579601014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 msgr2=0x7f41fc00dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f42177c1640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 0x7f41fc00dba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4208001fd0 tx=0x7f420801c8e0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f42177c1640 1 -- 172.21.15.28:0/1579601014 shutdown_connections 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f42177c1640 1 --2- 172.21.15.28:0/1579601014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 0x7f41fc00dba0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f42177c1640 1 -- 172.21.15.28:0/1579601014 >> 172.21.15.28:0/1579601014 conn(0x7f421006a5b0 msgr2=0x7f421006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f42177c1640 1 -- 172.21.15.28:0/1579601014 shutdown_connections 2023-12-16T03:26:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f42177c1640 1 -- 172.21.15.28:0/1579601014 wait complete. 2023-12-16T03:26:30.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f42177c1640 1 Processor -- start 2023-12-16T03:26:30.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.697+0000 7f42177c1640 1 -- start start 2023-12-16T03:26:30.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f42177c1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 0x7f42100a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f42177c1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42101507b0 0x7f42101f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f42177c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42101ed790 0x7f42101f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f42177c1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42101edd50 con 0x7f41fc005250 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f42177c1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421014f800 con 0x7f42101ed790 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f42177c1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421014fae0 con 0x7f42101507b0 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f421555d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 0x7f42100a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f421555d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 0x7f42100a6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48892/0 (socket says 172.21.15.28:48892) 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f421555d640 1 -- 172.21.15.28:0/808971626 learned_addr learned my addr 172.21.15.28:0/808971626 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f4214d5c640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42101507b0 0x7f42101f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f4215d5e640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42101ed790 0x7f42101f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f421555d640 1 -- 172.21.15.28:0/808971626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42101507b0 msgr2=0x7f42101f08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f421555d640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42101507b0 0x7f42101f08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f421555d640 1 -- 172.21.15.28:0/808971626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42101ed790 msgr2=0x7f42101f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f421555d640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42101ed790 0x7f42101f0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f421555d640 1 -- 172.21.15.28:0/808971626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421014fdc0 con 0x7f41fc005250 2023-12-16T03:26:30.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f4215d5e640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42101ed790 0x7f42101f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:30.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f421555d640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 0x7f42100a6a00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f420c000fe0 tx=0x7f420c00e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:30.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f4205ffb640 1 -- 172.21.15.28:0/808971626 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c012590 con 0x7f41fc005250 2023-12-16T03:26:30.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f4205ffb640 1 -- 172.21.15.28:0/808971626 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c0126f0 con 0x7f41fc005250 2023-12-16T03:26:30.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f42177c1640 1 -- 172.21.15.28:0/808971626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42101f0380 con 0x7f41fc005250 2023-12-16T03:26:30.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f4205ffb640 1 -- 172.21.15.28:0/808971626 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c012a80 con 0x7f41fc005250 2023-12-16T03:26:30.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f42177c1640 1 -- 172.21.15.28:0/808971626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42100a6f40 con 0x7f41fc005250 2023-12-16T03:26:30.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f42177c1640 1 -- 172.21.15.28:0/808971626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4210068400 con 0x7f41fc005250 2023-12-16T03:26:30.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.701+0000 7f4205ffb640 1 -- 172.21.15.28:0/808971626 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f420c012be0 con 0x7f41fc005250 2023-12-16T03:26:30.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.705+0000 7f4205ffb640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41f4066470 0x7f41f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:30.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.705+0000 7f4205ffb640 1 -- 172.21.15.28:0/808971626 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f420c083ec0 con 0x7f41fc005250 2023-12-16T03:26:30.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.705+0000 7f4214d5c640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41f4066470 0x7f41f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.705+0000 7f4214d5c640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41f4066470 0x7f41f4068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f42100bfd10 tx=0x7f4200008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:30.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.709+0000 7f4205ffb640 1 -- 172.21.15.28:0/808971626 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f420c050fd0 con 0x7f41fc005250 2023-12-16T03:26:30.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.861+0000 7f42177c1640 1 -- 172.21.15.28:0/808971626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4210071e70 con 0x7f41fc005250 2023-12-16T03:26:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.861+0000 7f4205ffb640 1 -- 172.21.15.28:0/808971626 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f420c0545f0 con 0x7f41fc005250 2023-12-16T03:26:30.869 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:26:30.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 -- 172.21.15.28:0/808971626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41f4066470 msgr2=0x7f41f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41f4066470 0x7f41f4068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f42100bfd10 tx=0x7f4200008040 comp rx=0 tx=0).stop 2023-12-16T03:26:30.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 -- 172.21.15.28:0/808971626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 msgr2=0x7f42100a6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:30.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 0x7f42100a6a00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f420c000fe0 tx=0x7f420c00e9e0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 -- 172.21.15.28:0/808971626 shutdown_connections 2023-12-16T03:26:30.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42101ed790 0x7f42101f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42101507b0 0x7f42101f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41f4066470 0x7f41f4068930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 --2- 172.21.15.28:0/808971626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41fc005250 0x7f42100a6a00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 -- 172.21.15.28:0/808971626 >> 172.21.15.28:0/808971626 conn(0x7f421006a5b0 msgr2=0x7f421006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 -- 172.21.15.28:0/808971626 shutdown_connections 2023-12-16T03:26:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:30.865+0000 7f42177c1640 1 -- 172.21.15.28:0/808971626 wait complete. 2023-12-16T03:26:30.891 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:26:31.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb8a6c17640 1 Processor -- start 2023-12-16T03:26:31.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb8a6c17640 1 -- start start 2023-12-16T03:26:31.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb8a6c17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8a00c2bb0 0x7fb8a00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb8a6c17640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a00c31c0 con 0x7fb8a00c4100 2023-12-16T03:26:31.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb8a6c17640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a00c34a0 con 0x7fb8a00c63c0 2023-12-16T03:26:31.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb8a6c17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00c1030 con 0x7fb8a00c2bb0 2023-12-16T03:26:31.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89ffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb8a00c4100 0x7fb8a00a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45574/0 (socket says 172.21.15.28:45574) 2023-12-16T03:26:31.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89ffff640 1 -- 172.21.15.28:0/326889203 learned_addr learned my addr 172.21.15.28:0/326889203 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:31.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb8a51b4640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8a00c2bb0 0x7fb8a00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381596342 0 0) 0x7fb8a00c31c0 con 0x7fb8a00c4100 2023-12-16T03:26:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb890005740 con 0x7fb8a00c4100 2023-12-16T03:26:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746544281 0 0) 0x7fb8a00c34a0 con 0x7fb8a00c63c0 2023-12-16T03:26:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a00c31c0 con 0x7fb8a00c63c0 2023-12-16T03:26:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3504353549 0 0) 0x7fb890005740 con 0x7fb8a00c4100 2023-12-16T03:26:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8a00c2bb0 msgr2=0x7fb8a00c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8a00c2bb0 0x7fb8a00c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 >> v1:172.21.15.134:6789/0 conn(0x7fb8a00c63c0 legacy=0x7fb8a00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a00c1310 con 0x7fb8a00c4100 2023-12-16T03:26:31.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fb88c001680 con 0x7fb8a00c4100 2023-12-16T03:26:31.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 >> v1:172.21.15.28:6789/0 conn(0x7fb8a00c4100 legacy=0x7fb8a00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb890005d50 0x7fb890006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8900069e0 0x7fb890006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8900073f0 0x7fb89000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00c1030 con 0x7fb8900069e0 2023-12-16T03:26:31.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89000e2d0 con 0x7fb890005d50 2023-12-16T03:26:31.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900035b0 con 0x7fb8900073f0 2023-12-16T03:26:31.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb8a51b4640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8a00c2bb0 0x7fb8a00c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:31.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89ffff640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8900069e0 0x7fb890006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb8a49b3640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb890005d50 0x7fb890006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb8a51b4640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8900073f0 0x7fb89000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89ffff640 1 -- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8900073f0 msgr2=0x7fb89000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:31.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89ffff640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8900073f0 0x7fb89000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89ffff640 1 -- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb890005d50 msgr2=0x7fb890006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:31.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89ffff640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb890005d50 0x7fb890006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.033+0000 7fb89ffff640 1 -- 172.21.15.28:0/326889203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb890005740 con 0x7fb8900069e0 2023-12-16T03:26:31.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.037+0000 7fb89ffff640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8900069e0 0x7fb890006e60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00c160 tx=0x7fb88c01cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122217fb3020b3ce server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:31.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.037+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0058e0 con 0x7fb8900069e0 2023-12-16T03:26:31.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.037+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c005a60 con 0x7fb8900069e0 2023-12-16T03:26:31.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.037+0000 7fb89f7fe640 1 -- 172.21.15.28:0/326889203 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c005e10 con 0x7fb8900069e0 2023-12-16T03:26:31.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.037+0000 7fb8a6c17640 1 -- 172.21.15.28:0/326889203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8900069e0 msgr2=0x7fb890006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.037+0000 7fb8a6c17640 1 --2- 172.21.15.28:0/326889203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8900069e0 0x7fb890006e60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00c160 tx=0x7fb88c01cb70 comp rx=0 tx=0).stop 2023-12-16T03:26:31.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.037+0000 7fb8a51b4640 1 -- 172.21.15.28:0/326889203 reap_dead start 2023-12-16T03:26:31.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.037+0000 7fb8a6c17640 1 -- 172.21.15.28:0/326889203 shutdown_connections 2023-12-16T03:26:31.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.037+0000 7fb8a6c17640 1 -- 172.21.15.28:0/326889203 >> 172.21.15.28:0/326889203 conn(0x7fb8a006a5b0 msgr2=0x7fb8a006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:31.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.037+0000 7fb8a6c17640 1 -- 172.21.15.28:0/326889203 shutdown_connections 2023-12-16T03:26:31.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.037+0000 7fb8a6c17640 1 -- 172.21.15.28:0/326889203 wait complete. 2023-12-16T03:26:31.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a6c17640 1 Processor -- start 2023-12-16T03:26:31.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a6c17640 1 -- start start 2023-12-16T03:26:31.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a6c17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8900069e0 0x7fb8a01e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a6c17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8a00bfbc0 0x7fb8a00bd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a6c17640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8a00bdd50 0x7fb8a0152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a6c17640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00bbfd0 con 0x7fb8a00bdd50 2023-12-16T03:26:31.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a6c17640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a01ea320 con 0x7fb8900069e0 2023-12-16T03:26:31.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a6c17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00bb730 con 0x7fb8a00bfbc0 2023-12-16T03:26:31.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a51b4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8a00bdd50 0x7fb8a0152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a51b4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8a00bdd50 0x7fb8a0152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48906/0 (socket says 172.21.15.28:48906) 2023-12-16T03:26:31.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a51b4640 1 -- 172.21.15.28:0/1572008364 learned_addr learned my addr 172.21.15.28:0/1572008364 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:31.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a49b3640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8900069e0 0x7fb8a01e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb89ffff640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8a00bfbc0 0x7fb8a00bd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a51b4640 1 -- 172.21.15.28:0/1572008364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8a00bfbc0 msgr2=0x7fb8a00bd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a51b4640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8a00bfbc0 0x7fb8a00bd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a51b4640 1 -- 172.21.15.28:0/1572008364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8900069e0 msgr2=0x7fb8a01e9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a51b4640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8900069e0 0x7fb8a01e9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a51b4640 1 -- 172.21.15.28:0/1572008364 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a00c69b0 con 0x7fb8a00bdd50 2023-12-16T03:26:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a49b3640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8900069e0 0x7fb8a01e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb89ffff640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8a00bfbc0 0x7fb8a00bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a51b4640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8a00bdd50 0x7fb8a0152bd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00ab3d0 tx=0x7fb898011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb89d7fa640 1 -- 172.21.15.28:0/1572008364 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89800e070 con 0x7fb8a00bdd50 2023-12-16T03:26:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb89d7fa640 1 -- 172.21.15.28:0/1572008364 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8980039a0 con 0x7fb8a00bdd50 2023-12-16T03:26:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb89d7fa640 1 -- 172.21.15.28:0/1572008364 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898003b50 con 0x7fb8a00bdd50 2023-12-16T03:26:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a6c17640 1 -- 172.21.15.28:0/1572008364 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a00bba10 con 0x7fb8a00bdd50 2023-12-16T03:26:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.041+0000 7fb8a6c17640 1 -- 172.21.15.28:0/1572008364 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a01526b0 con 0x7fb8a00bdd50 2023-12-16T03:26:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.045+0000 7fb8a6c17640 1 -- 172.21.15.28:0/1572008364 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a00a8b60 con 0x7fb8a00bdd50 2023-12-16T03:26:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.045+0000 7fb89d7fa640 1 -- 172.21.15.28:0/1572008364 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb898003cb0 con 0x7fb8a00bdd50 2023-12-16T03:26:31.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.045+0000 7fb89d7fa640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8840664a0 0x7fb884068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.045+0000 7fb89d7fa640 1 -- 172.21.15.28:0/1572008364 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb898084a50 con 0x7fb8a00bdd50 2023-12-16T03:26:31.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.045+0000 7fb8a49b3640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8840664a0 0x7fb884068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.045+0000 7fb8a49b3640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8840664a0 0x7fb884068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb8940010f0 tx=0x7fb894009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:31.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.049+0000 7fb89d7fa640 1 -- 172.21.15.28:0/1572008364 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb898051b60 con 0x7fb8a00bdd50 2023-12-16T03:26:31.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 -- 172.21.15.28:0/1572008364 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8a0068400 con 0x7fb8a00bdd50 2023-12-16T03:26:31.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb89d7fa640 1 -- 172.21.15.28:0/1572008364 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb898055180 con 0x7fb8a00bdd50 2023-12-16T03:26:31.214 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:26:31.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 -- 172.21.15.28:0/1572008364 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8840664a0 msgr2=0x7fb884068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8840664a0 0x7fb884068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb8940010f0 tx=0x7fb894009040 comp rx=0 tx=0).stop 2023-12-16T03:26:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 -- 172.21.15.28:0/1572008364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8a00bdd50 msgr2=0x7fb8a0152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8a00bdd50 0x7fb8a0152bd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00ab3d0 tx=0x7fb898011890 comp rx=0 tx=0).stop 2023-12-16T03:26:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 -- 172.21.15.28:0/1572008364 shutdown_connections 2023-12-16T03:26:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8840664a0 0x7fb884068960 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8a00bdd50 0x7fb8a0152bd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8a00bfbc0 0x7fb8a00bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 --2- 172.21.15.28:0/1572008364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8900069e0 0x7fb8a01e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 -- 172.21.15.28:0/1572008364 >> 172.21.15.28:0/1572008364 conn(0x7fb8a006a5b0 msgr2=0x7fb8a0154ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 -- 172.21.15.28:0/1572008364 shutdown_connections 2023-12-16T03:26:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.209+0000 7fb8a6c17640 1 -- 172.21.15.28:0/1572008364 wait complete. 2023-12-16T03:26:31.236 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:26:31.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6abcebb640 1 Processor -- start 2023-12-16T03:26:31.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6abcebb640 1 -- start start 2023-12-16T03:26:31.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6abcebb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ab80c63c0 0x7f6ab80c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6abcebb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ab80c4100 0x7f6ab80c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6abcebb640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab80c31c0 con 0x7f6ab80c29e0 2023-12-16T03:26:31.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6abcebb640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab80c34a0 con 0x7f6ab80c4100 2023-12-16T03:26:31.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6abcebb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab80c1030 con 0x7f6ab80c63c0 2023-12-16T03:26:31.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6ab659c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ab80c63c0 0x7f6ab80c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6ab5d9b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ab80c4100 0x7f6ab80c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6ab6d9d640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f6ab80c29e0 0x7f6ab80a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:36396/0 (socket says 172.21.15.28:36396) 2023-12-16T03:26:31.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6ab6d9d640 1 -- 172.21.15.28:0/1720244971 learned_addr learned my addr 172.21.15.28:0/1720244971 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:31.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6ab5d9b640 1 -- 172.21.15.28:0/1720244971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ab80c63c0 msgr2=0x7f6ab80c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:31.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6ab5d9b640 1 --2- 172.21.15.28:0/1720244971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ab80c63c0 0x7f6ab80c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6ab5d9b640 1 -- 172.21.15.28:0/1720244971 >> v1:172.21.15.134:6789/0 conn(0x7f6ab80c29e0 legacy=0x7f6ab80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.377+0000 7f6ab5d9b640 1 -- 172.21.15.28:0/1720244971 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab80c1310 con 0x7f6ab80c4100 2023-12-16T03:26:31.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6ab5d9b640 1 --2- 172.21.15.28:0/1720244971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab80c4100 0x7f6ab80c24a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0097c0 tx=0x7f6aac01e540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68bb50ca207e6c10 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:31.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6ab559a640 1 -- 172.21.15.28:0/1720244971 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0ad670 con 0x7f6ab80c4100 2023-12-16T03:26:31.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6ab559a640 1 -- 172.21.15.28:0/1720244971 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac0ad7d0 con 0x7f6ab80c4100 2023-12-16T03:26:31.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6ab559a640 1 -- 172.21.15.28:0/1720244971 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0adb60 con 0x7f6ab80c4100 2023-12-16T03:26:31.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6abcebb640 1 -- 172.21.15.28:0/1720244971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab80c4100 msgr2=0x7f6ab80c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6abcebb640 1 --2- 172.21.15.28:0/1720244971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab80c4100 0x7f6ab80c24a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0097c0 tx=0x7f6aac01e540 comp rx=0 tx=0).stop 2023-12-16T03:26:31.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6abcebb640 1 -- 172.21.15.28:0/1720244971 shutdown_connections 2023-12-16T03:26:31.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6abcebb640 1 --2- 172.21.15.28:0/1720244971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab80c4100 0x7f6ab80c24a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6abcebb640 1 --2- 172.21.15.28:0/1720244971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ab80c63c0 0x7f6ab80c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6abcebb640 1 -- 172.21.15.28:0/1720244971 >> 172.21.15.28:0/1720244971 conn(0x7f6ab806a5b0 msgr2=0x7f6ab806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:31.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6abcebb640 1 -- 172.21.15.28:0/1720244971 shutdown_connections 2023-12-16T03:26:31.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.381+0000 7f6abcebb640 1 -- 172.21.15.28:0/1720244971 wait complete. 2023-12-16T03:26:31.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6abcebb640 1 Processor -- start 2023-12-16T03:26:31.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6abcebb640 1 -- start start 2023-12-16T03:26:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6abcebb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ab80c29e0 0x7f6ab8071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6abcebb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ab80c4100 0x7f6ab814feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6abcebb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab80c63c0 0x7f6ab81503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6abcebb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab81573e0 con 0x7f6ab80c4100 2023-12-16T03:26:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6abcebb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8156860 con 0x7f6ab80c63c0 2023-12-16T03:26:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6abcebb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8156b40 con 0x7f6ab80c29e0 2023-12-16T03:26:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6ab5d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ab80c4100 0x7f6ab814feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6ab5d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ab80c4100 0x7f6ab814feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48922/0 (socket says 172.21.15.28:48922) 2023-12-16T03:26:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6ab5d9b640 1 -- 172.21.15.28:0/1693965123 learned_addr learned my addr 172.21.15.28:0/1693965123 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6ab6d9d640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab80c63c0 0x7f6ab81503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6ab659c640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ab80c29e0 0x7f6ab8071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6ab5d9b640 1 -- 172.21.15.28:0/1693965123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ab80c29e0 msgr2=0x7f6ab8071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6ab5d9b640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ab80c29e0 0x7f6ab8071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6ab5d9b640 1 -- 172.21.15.28:0/1693965123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab80c63c0 msgr2=0x7f6ab81503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6ab5d9b640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab80c63c0 0x7f6ab81503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6ab5d9b640 1 -- 172.21.15.28:0/1693965123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac009420 con 0x7f6ab80c4100 2023-12-16T03:26:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6ab5d9b640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ab80c4100 0x7f6ab814feb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0af040 tx=0x7f6aac01cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6aa6ffd640 1 -- 172.21.15.28:0/1693965123 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0b6620 con 0x7f6ab80c4100 2023-12-16T03:26:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6aa6ffd640 1 -- 172.21.15.28:0/1693965123 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac0b67c0 con 0x7f6ab80c4100 2023-12-16T03:26:31.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6aa6ffd640 1 -- 172.21.15.28:0/1693965123 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0b6b70 con 0x7f6ab80c4100 2023-12-16T03:26:31.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6abcebb640 1 -- 172.21.15.28:0/1693965123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab8156e20 con 0x7f6ab80c4100 2023-12-16T03:26:31.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.385+0000 7f6abcebb640 1 -- 172.21.15.28:0/1693965123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab8071640 con 0x7f6ab80c4100 2023-12-16T03:26:31.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.389+0000 7f6abcebb640 1 -- 172.21.15.28:0/1693965123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab8068400 con 0x7f6ab80c4100 2023-12-16T03:26:31.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.389+0000 7f6aa6ffd640 1 -- 172.21.15.28:0/1693965123 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6aac0b6cd0 con 0x7f6ab80c4100 2023-12-16T03:26:31.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.389+0000 7f6aa6ffd640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6a98066470 0x7f6a98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.389+0000 7f6aa6ffd640 1 -- 172.21.15.28:0/1693965123 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6aac11ea50 con 0x7f6ab80c4100 2023-12-16T03:26:31.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.389+0000 7f6ab659c640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6a98066470 0x7f6a98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.389+0000 7f6ab659c640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6a98066470 0x7f6a98068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009ac0 tx=0x7f6aa8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:31.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.393+0000 7f6aa6ffd640 1 -- 172.21.15.28:0/1693965123 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6aac0ebaf0 con 0x7f6ab80c4100 2023-12-16T03:26:31.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.549+0000 7f6abcebb640 1 -- 172.21.15.28:0/1693965123 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ab815bbc0 con 0x7f6ab80c4100 2023-12-16T03:26:31.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6aa6ffd640 1 -- 172.21.15.28:0/1693965123 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7f6aac0c60b0 con 0x7f6ab80c4100 2023-12-16T03:26:31.557 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:26:31.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 -- 172.21.15.28:0/1693965123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6a98066470 msgr2=0x7f6a98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6a98066470 0x7f6a98068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009ac0 tx=0x7f6aa8009190 comp rx=0 tx=0).stop 2023-12-16T03:26:31.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 -- 172.21.15.28:0/1693965123 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ab80c4100 msgr2=0x7f6ab814feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ab80c4100 0x7f6ab814feb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0af040 tx=0x7f6aac01cd80 comp rx=0 tx=0).stop 2023-12-16T03:26:31.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 -- 172.21.15.28:0/1693965123 shutdown_connections 2023-12-16T03:26:31.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ab80c63c0 0x7f6ab81503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6a98066470 0x7f6a98068930 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ab80c4100 0x7f6ab814feb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 --2- 172.21.15.28:0/1693965123 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ab80c29e0 0x7f6ab8071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 -- 172.21.15.28:0/1693965123 >> 172.21.15.28:0/1693965123 conn(0x7f6ab806a5b0 msgr2=0x7f6ab81552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:31.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 -- 172.21.15.28:0/1693965123 shutdown_connections 2023-12-16T03:26:31.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.553+0000 7f6abcebb640 1 -- 172.21.15.28:0/1693965123 wait complete. 2023-12-16T03:26:31.578 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:26:31.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b8854640 1 Processor -- start 2023-12-16T03:26:31.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b8854640 1 -- start start 2023-12-16T03:26:31.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b8854640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f56b40c4100 0x7f56b40c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b8854640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56b40c06d0 0x7f56b40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b8854640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b40c31c0 con 0x7f56b40c63c0 2023-12-16T03:26:31.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b8854640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b40c34a0 con 0x7f56b40c4100 2023-12-16T03:26:31.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b8854640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b40c1030 con 0x7f56b40c06d0 2023-12-16T03:26:31.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b259c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f56b40c63c0 0x7f56b40c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45576/0 (socket says 172.21.15.28:45576) 2023-12-16T03:26:31.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b259c640 1 -- 172.21.15.28:0/3121934672 learned_addr learned my addr 172.21.15.28:0/3121934672 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:31.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56abfff640 1 --2- 172.21.15.28:0/3121934672 >> v2:172.21.15.134:3300/0 conn(0x7f56b40c4100 0x7f56b40c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b2d9d640 1 --2- 172.21.15.28:0/3121934672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56b40c06d0 0x7f56b40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b1d9b640 1 -- 172.21.15.28:0/3121934672 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434507042 0 0) 0x7f56b40c31c0 con 0x7f56b40c63c0 2023-12-16T03:26:31.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56b1d9b640 1 -- 172.21.15.28:0/3121934672 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a0003530 con 0x7f56b40c63c0 2023-12-16T03:26:31.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56abfff640 1 -- 172.21.15.28:0/3121934672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56b40c06d0 msgr2=0x7f56b40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:31.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56abfff640 1 --2- 172.21.15.28:0/3121934672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56b40c06d0 0x7f56b40a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56abfff640 1 -- 172.21.15.28:0/3121934672 >> v1:172.21.15.28:6789/0 conn(0x7f56b40c63c0 legacy=0x7f56b40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.721+0000 7f56abfff640 1 -- 172.21.15.28:0/3121934672 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b40c1310 con 0x7f56b40c4100 2023-12-16T03:26:31.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56abfff640 1 --2- 172.21.15.28:0/3121934672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b40c4100 0x7f56b40c2bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f569c0097c0 tx=0x7f569c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cf4ec2053a1944f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:31.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56b1d9b640 1 -- 172.21.15.28:0/3121934672 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b40aa3d0 con 0x7f56b40c4100 2023-12-16T03:26:31.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56b1d9b640 1 -- 172.21.15.28:0/3121934672 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c0a7050 con 0x7f56b40c4100 2023-12-16T03:26:31.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56b1d9b640 1 -- 172.21.15.28:0/3121934672 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0ab820 con 0x7f56b40c4100 2023-12-16T03:26:31.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56b8854640 1 -- 172.21.15.28:0/3121934672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b40c4100 msgr2=0x7f56b40c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56b8854640 1 --2- 172.21.15.28:0/3121934672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b40c4100 0x7f56b40c2bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f569c0097c0 tx=0x7f569c01c360 comp rx=0 tx=0).stop 2023-12-16T03:26:31.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56b8854640 1 -- 172.21.15.28:0/3121934672 shutdown_connections 2023-12-16T03:26:31.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56b8854640 1 --2- 172.21.15.28:0/3121934672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56b40c06d0 0x7f56b40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56b8854640 1 --2- 172.21.15.28:0/3121934672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b40c4100 0x7f56b40c2bb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56b8854640 1 -- 172.21.15.28:0/3121934672 >> 172.21.15.28:0/3121934672 conn(0x7f56b406a5b0 msgr2=0x7f56b406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:31.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56b8854640 1 -- 172.21.15.28:0/3121934672 shutdown_connections 2023-12-16T03:26:31.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.725+0000 7f56b8854640 1 -- 172.21.15.28:0/3121934672 wait complete. 2023-12-16T03:26:31.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b8854640 1 Processor -- start 2023-12-16T03:26:31.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b8854640 1 -- start start 2023-12-16T03:26:31.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b8854640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b40c06d0 0x7f56b40a2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b8854640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56b40c4100 0x7f56b4070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b8854640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b40c63c0 0x7f56b4154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b8854640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b40a4d10 con 0x7f56b40c63c0 2023-12-16T03:26:31.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b8854640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b41f1010 con 0x7f56b40c06d0 2023-12-16T03:26:31.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b8854640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b41536c0 con 0x7f56b40c4100 2023-12-16T03:26:31.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b2d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b40c63c0 0x7f56b4154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b40c06d0 0x7f56b40a2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b2d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b40c63c0 0x7f56b4154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48928/0 (socket says 172.21.15.28:48928) 2023-12-16T03:26:31.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b2d9d640 1 -- 172.21.15.28:0/900156692 learned_addr learned my addr 172.21.15.28:0/900156692 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:31.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56abfff640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56b40c4100 0x7f56b4070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b2d9d640 1 -- 172.21.15.28:0/900156692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56b40c4100 msgr2=0x7f56b4070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b2d9d640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56b40c4100 0x7f56b4070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b2d9d640 1 -- 172.21.15.28:0/900156692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b40c06d0 msgr2=0x7f56b40a2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b2d9d640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b40c06d0 0x7f56b40a2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b2d9d640 1 -- 172.21.15.28:0/900156692 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c009420 con 0x7f56b40c63c0 2023-12-16T03:26:31.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b2d9d640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b40c63c0 0x7f56b4154480 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00efc0 tx=0x7f56ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:31.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56aaffd640 1 -- 172.21.15.28:0/900156692 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac014480 con 0x7f56b40c63c0 2023-12-16T03:26:31.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56aaffd640 1 -- 172.21.15.28:0/900156692 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac00f040 con 0x7f56b40c63c0 2023-12-16T03:26:31.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b8854640 1 -- 172.21.15.28:0/900156692 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b41539a0 con 0x7f56b40c63c0 2023-12-16T03:26:31.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56aaffd640 1 -- 172.21.15.28:0/900156692 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac014820 con 0x7f56b40c63c0 2023-12-16T03:26:31.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b8854640 1 -- 172.21.15.28:0/900156692 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b4153f60 con 0x7f56b40c63c0 2023-12-16T03:26:31.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.729+0000 7f56b8854640 1 -- 172.21.15.28:0/900156692 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b4154150 con 0x7f56b40c63c0 2023-12-16T03:26:31.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.733+0000 7f56aaffd640 1 -- 172.21.15.28:0/900156692 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f56ac014980 con 0x7f56b40c63c0 2023-12-16T03:26:31.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.733+0000 7f56aaffd640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5694066470 0x7f5694068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:31.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.733+0000 7f56aaffd640 1 -- 172.21.15.28:0/900156692 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f56ac084c80 con 0x7f56b40c63c0 2023-12-16T03:26:31.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.733+0000 7f56b259c640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5694066470 0x7f5694068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:31.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.733+0000 7f56b259c640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5694066470 0x7f5694068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f56a40011f0 tx=0x7f56a4007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:31.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.737+0000 7f56aaffd640 1 -- 172.21.15.28:0/900156692 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f56ac051e40 con 0x7f56b40c63c0 2023-12-16T03:26:31.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.893+0000 7f56b8854640 1 -- 172.21.15.28:0/900156692 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f56b4068400 con 0x7f56b40c63c0 2023-12-16T03:26:31.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.893+0000 7f56aaffd640 1 -- 172.21.15.28:0/900156692 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7f56ac0180a0 con 0x7f56b40c63c0 2023-12-16T03:26:31.901 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:26:31.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 -- 172.21.15.28:0/900156692 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5694066470 msgr2=0x7f5694068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5694066470 0x7f5694068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f56a40011f0 tx=0x7f56a4007d40 comp rx=0 tx=0).stop 2023-12-16T03:26:31.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 -- 172.21.15.28:0/900156692 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b40c63c0 msgr2=0x7f56b4154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:31.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b40c63c0 0x7f56b4154480 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00efc0 tx=0x7f56ac00c490 comp rx=0 tx=0).stop 2023-12-16T03:26:31.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 -- 172.21.15.28:0/900156692 shutdown_connections 2023-12-16T03:26:31.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5694066470 0x7f5694068930 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b40c63c0 0x7f56b4154480 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56b40c4100 0x7f56b4070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 --2- 172.21.15.28:0/900156692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b40c06d0 0x7f56b40a2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:31.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 -- 172.21.15.28:0/900156692 >> 172.21.15.28:0/900156692 conn(0x7f56b406a5b0 msgr2=0x7f56b406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:31.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 -- 172.21.15.28:0/900156692 shutdown_connections 2023-12-16T03:26:31.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:31.897+0000 7f56b8854640 1 -- 172.21.15.28:0/900156692 wait complete. 2023-12-16T03:26:31.921 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:26:32.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.057+0000 7f73fb7c1640 1 Processor -- start 2023-12-16T03:26:32.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.057+0000 7f73fb7c1640 1 -- start start 2023-12-16T03:26:32.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73fb7c1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73f406a5b0 0x7f73f406aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73fb7c1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73f4154030 0x7f73f41544c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73fb7c1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f40c2870 con 0x7f73f40c1390 2023-12-16T03:26:32.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73fb7c1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f406be70 con 0x7f73f4154030 2023-12-16T03:26:32.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73fb7c1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f406af50 con 0x7f73f406a5b0 2023-12-16T03:26:32.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73f955d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f73f40c1390 0x7f73f4073510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45578/0 (socket says 172.21.15.28:45578) 2023-12-16T03:26:32.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73f955d640 1 -- 172.21.15.28:0/2395295613 learned_addr learned my addr 172.21.15.28:0/2395295613 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:32.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73f9d5e640 1 --2- 172.21.15.28:0/2395295613 >> v2:172.21.15.134:3300/0 conn(0x7f73f4154030 0x7f73f41544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73f8d5c640 1 --2- 172.21.15.28:0/2395295613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73f406a5b0 0x7f73f406aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73ebfff640 1 -- 172.21.15.28:0/2395295613 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167249284 0 0) 0x7f73f40c2870 con 0x7f73f40c1390 2023-12-16T03:26:32.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73ebfff640 1 -- 172.21.15.28:0/2395295613 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e0003530 con 0x7f73f40c1390 2023-12-16T03:26:32.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73f9d5e640 1 -- 172.21.15.28:0/2395295613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73f406a5b0 msgr2=0x7f73f406aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:32.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73f9d5e640 1 --2- 172.21.15.28:0/2395295613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73f406a5b0 0x7f73f406aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73f9d5e640 1 -- 172.21.15.28:0/2395295613 >> v1:172.21.15.28:6789/0 conn(0x7f73f40c1390 legacy=0x7f73f4073510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.061+0000 7f73f9d5e640 1 -- 172.21.15.28:0/2395295613 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f414ae80 con 0x7f73f4154030 2023-12-16T03:26:32.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73f9d5e640 1 --2- 172.21.15.28:0/2395295613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f4154030 0x7f73f41544c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009d90 tx=0x7f73ec01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f592992b045cef server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:32.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73ebfff640 1 -- 172.21.15.28:0/2395295613 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0a5870 con 0x7f73f4154030 2023-12-16T03:26:32.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73ebfff640 1 -- 172.21.15.28:0/2395295613 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec0a59d0 con 0x7f73f4154030 2023-12-16T03:26:32.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73ebfff640 1 -- 172.21.15.28:0/2395295613 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0a5d60 con 0x7f73f4154030 2023-12-16T03:26:32.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2395295613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f4154030 msgr2=0x7f73f41544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73fb7c1640 1 --2- 172.21.15.28:0/2395295613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f4154030 0x7f73f41544c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009d90 tx=0x7f73ec01c8c0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2395295613 shutdown_connections 2023-12-16T03:26:32.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73fb7c1640 1 --2- 172.21.15.28:0/2395295613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f4154030 0x7f73f41544c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73fb7c1640 1 --2- 172.21.15.28:0/2395295613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73f406a5b0 0x7f73f406aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2395295613 >> 172.21.15.28:0/2395295613 conn(0x7f73f40c30c0 msgr2=0x7f73f40c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:32.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2395295613 shutdown_connections 2023-12-16T03:26:32.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2395295613 wait complete. 2023-12-16T03:26:32.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.065+0000 7f73fb7c1640 1 Processor -- start 2023-12-16T03:26:32.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73fb7c1640 1 -- start start 2023-12-16T03:26:32.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73fb7c1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73f406a5b0 0x7f73f41458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73fb7c1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73f40c1390 0x7f73f41ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73fb7c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f4154030 0x7f73f41ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73fb7c1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f41f12c0 con 0x7f73f406a5b0 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73fb7c1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f41f03f0 con 0x7f73f4154030 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73fb7c1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f414bab0 con 0x7f73f40c1390 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73f955d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73f406a5b0 0x7f73f41458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73f955d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73f406a5b0 0x7f73f41458a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48938/0 (socket says 172.21.15.28:48938) 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73f955d640 1 -- 172.21.15.28:0/2849485288 learned_addr learned my addr 172.21.15.28:0/2849485288 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73f8d5c640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73f40c1390 0x7f73f41ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73f9d5e640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f4154030 0x7f73f41ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73f955d640 1 -- 172.21.15.28:0/2849485288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73f40c1390 msgr2=0x7f73f41ed0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73f955d640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73f40c1390 0x7f73f41ed0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73f955d640 1 -- 172.21.15.28:0/2849485288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f4154030 msgr2=0x7f73f41ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73f955d640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f4154030 0x7f73f41ed630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73f955d640 1 -- 172.21.15.28:0/2849485288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec009a70 con 0x7f73f406a5b0 2023-12-16T03:26:32.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73f955d640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73f406a5b0 0x7f73f41458a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c4b0 tx=0x7f73f000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:32.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73e9ffb640 1 -- 172.21.15.28:0/2849485288 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0005cf0 con 0x7f73f406a5b0 2023-12-16T03:26:32.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73e9ffb640 1 -- 172.21.15.28:0/2849485288 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f0005e50 con 0x7f73f406a5b0 2023-12-16T03:26:32.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73e9ffb640 1 -- 172.21.15.28:0/2849485288 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0007290 con 0x7f73f406a5b0 2023-12-16T03:26:32.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2849485288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f41f0640 con 0x7f73f406a5b0 2023-12-16T03:26:32.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2849485288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f41f0c00 con 0x7f73f406a5b0 2023-12-16T03:26:32.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.069+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2849485288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f41ecef0 con 0x7f73f406a5b0 2023-12-16T03:26:32.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.073+0000 7f73e9ffb640 1 -- 172.21.15.28:0/2849485288 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f73f00073f0 con 0x7f73f406a5b0 2023-12-16T03:26:32.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.073+0000 7f73e9ffb640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73d8066470 0x7f73d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.073+0000 7f73e9ffb640 1 -- 172.21.15.28:0/2849485288 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f73f0083760 con 0x7f73f406a5b0 2023-12-16T03:26:32.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.073+0000 7f73f8d5c640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73d8066470 0x7f73d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.073+0000 7f73f8d5c640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73d8066470 0x7f73d8068930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f73f4146090 tx=0x7f73e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:32.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.077+0000 7f73e9ffb640 1 -- 172.21.15.28:0/2849485288 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f73f0050870 con 0x7f73f406a5b0 2023-12-16T03:26:32.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.245+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2849485288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73f4068400 con 0x7f73f406a5b0 2023-12-16T03:26:32.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.245+0000 7f73e9ffb640 1 -- 172.21.15.28:0/2849485288 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73f0017080 con 0x7f73f406a5b0 2023-12-16T03:26:32.252 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:26:32.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2849485288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73d8066470 msgr2=0x7f73d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73d8066470 0x7f73d8068930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f73f4146090 tx=0x7f73e4008040 comp rx=0 tx=0).stop 2023-12-16T03:26:32.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2849485288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73f406a5b0 msgr2=0x7f73f41458a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73f406a5b0 0x7f73f41458a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c4b0 tx=0x7f73f000c970 comp rx=0 tx=0).stop 2023-12-16T03:26:32.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2849485288 shutdown_connections 2023-12-16T03:26:32.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f4154030 0x7f73f41ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73f40c1390 0x7f73f41ed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73d8066470 0x7f73d8068930 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 --2- 172.21.15.28:0/2849485288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73f406a5b0 0x7f73f41458a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2849485288 >> 172.21.15.28:0/2849485288 conn(0x7f73f40c30c0 msgr2=0x7f73f41528d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:32.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2849485288 shutdown_connections 2023-12-16T03:26:32.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.249+0000 7f73fb7c1640 1 -- 172.21.15.28:0/2849485288 wait complete. 2023-12-16T03:26:32.273 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-16T03:26:32.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:32.274 DEBUG:teuthology.orchestra.run.smithi028:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-16T03:26:32.302 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:26:32.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:32.302 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-16T03:26:32.358 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:26:32.358 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:32.413 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7208 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-16T03:26:32.414 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:26:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610ef2b640 1 Processor -- start 2023-12-16T03:26:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610ef2b640 1 -- start start 2023-12-16T03:26:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610ef2b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6108151cd0 0x7f61080ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610ef2b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6108154be0 0x7f610815ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610ef2b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61080c8160 con 0x7f61080c7c50 2023-12-16T03:26:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610ef2b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6108157b40 con 0x7f6108154be0 2023-12-16T03:26:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610ef2b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6108157e20 con 0x7f6108151cd0 2023-12-16T03:26:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610df29640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6108151cd0 0x7f61080ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610e72a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6108154be0 0x7f610815ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610d728640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f61080c7c50 0x7f61081544d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:36398/0 (socket says 172.21.15.28:36398) 2023-12-16T03:26:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610d728640 1 -- 172.21.15.28:0/2842818688 learned_addr learned my addr 172.21.15.28:0/2842818688 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610cf27640 1 -- 172.21.15.28:0/2842818688 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154233856 0 0) 0x7f61080c8160 con 0x7f61080c7c50 2023-12-16T03:26:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610df29640 1 -- 172.21.15.28:0/2842818688 >> v2:172.21.15.134:3300/0 conn(0x7f6108154be0 msgr2=0x7f610815ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610df29640 1 --2- 172.21.15.28:0/2842818688 >> v2:172.21.15.134:3300/0 conn(0x7f6108154be0 0x7f610815ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610df29640 1 -- 172.21.15.28:0/2842818688 >> v1:172.21.15.134:6789/0 conn(0x7f61080c7c50 legacy=0x7f61081544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.597+0000 7f610df29640 1 -- 172.21.15.28:0/2842818688 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6108158100 con 0x7f6108151cd0 2023-12-16T03:26:32.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610df29640 1 --2- 172.21.15.28:0/2842818688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6108151cd0 0x7f61080ca460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61040097c0 tx=0x7f610401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74fbdaeb31d58ad1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:32.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610cf27640 1 -- 172.21.15.28:0/2842818688 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61040ab670 con 0x7f6108151cd0 2023-12-16T03:26:32.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610cf27640 1 -- 172.21.15.28:0/2842818688 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61040ab7d0 con 0x7f6108151cd0 2023-12-16T03:26:32.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610cf27640 1 -- 172.21.15.28:0/2842818688 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61040abb60 con 0x7f6108151cd0 2023-12-16T03:26:32.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610ef2b640 1 -- 172.21.15.28:0/2842818688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6108151cd0 msgr2=0x7f61080ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610ef2b640 1 --2- 172.21.15.28:0/2842818688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6108151cd0 0x7f61080ca460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61040097c0 tx=0x7f610401c450 comp rx=0 tx=0).stop 2023-12-16T03:26:32.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610ef2b640 1 -- 172.21.15.28:0/2842818688 shutdown_connections 2023-12-16T03:26:32.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610ef2b640 1 --2- 172.21.15.28:0/2842818688 >> v2:172.21.15.134:3300/0 conn(0x7f6108154be0 0x7f610815ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610ef2b640 1 --2- 172.21.15.28:0/2842818688 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6108151cd0 0x7f61080ca460 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610ef2b640 1 -- 172.21.15.28:0/2842818688 >> 172.21.15.28:0/2842818688 conn(0x7f61080abee0 msgr2=0x7f61080c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:32.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610ef2b640 1 -- 172.21.15.28:0/2842818688 shutdown_connections 2023-12-16T03:26:32.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.601+0000 7f610ef2b640 1 -- 172.21.15.28:0/2842818688 wait complete. 2023-12-16T03:26:32.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610ef2b640 1 Processor -- start 2023-12-16T03:26:32.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610ef2b640 1 -- start start 2023-12-16T03:26:32.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610ef2b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61080c7c50 0x7f61081480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610ef2b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6108151cd0 0x7f61081f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610ef2b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6108154be0 0x7f61081f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610ef2b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6108152690 con 0x7f6108154be0 2023-12-16T03:26:32.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610ef2b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6108154740 con 0x7f6108151cd0 2023-12-16T03:26:32.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610ef2b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61081eddf0 con 0x7f61080c7c50 2023-12-16T03:26:32.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610e72a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6108154be0 0x7f61081f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610e72a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6108154be0 0x7f61081f0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48940/0 (socket says 172.21.15.28:48940) 2023-12-16T03:26:32.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610e72a640 1 -- 172.21.15.28:0/1429967166 learned_addr learned my addr 172.21.15.28:0/1429967166 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:32.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610df29640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61080c7c50 0x7f61081480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610d728640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6108151cd0 0x7f61081f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610e72a640 1 -- 172.21.15.28:0/1429967166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61080c7c50 msgr2=0x7f61081480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610e72a640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61080c7c50 0x7f61081480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610e72a640 1 -- 172.21.15.28:0/1429967166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6108151cd0 msgr2=0x7f61081f0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610e72a640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6108151cd0 0x7f61081f0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610e72a640 1 -- 172.21.15.28:0/1429967166 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104009420 con 0x7f6108154be0 2023-12-16T03:26:32.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610e72a640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6108154be0 0x7f61081f0c60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f610000efc0 tx=0x7f610000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:32.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f60fe7fc640 1 -- 172.21.15.28:0/1429967166 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100014480 con 0x7f6108154be0 2023-12-16T03:26:32.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f60fe7fc640 1 -- 172.21.15.28:0/1429967166 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610000f040 con 0x7f6108154be0 2023-12-16T03:26:32.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f60fe7fc640 1 -- 172.21.15.28:0/1429967166 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100014820 con 0x7f6108154be0 2023-12-16T03:26:32.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610ef2b640 1 -- 172.21.15.28:0/1429967166 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6108154460 con 0x7f6108154be0 2023-12-16T03:26:32.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.605+0000 7f610ef2b640 1 -- 172.21.15.28:0/1429967166 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6108148610 con 0x7f6108154be0 2023-12-16T03:26:32.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.609+0000 7f610ef2b640 1 -- 172.21.15.28:0/1429967166 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61080c4e20 con 0x7f6108154be0 2023-12-16T03:26:32.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.609+0000 7f60fe7fc640 1 -- 172.21.15.28:0/1429967166 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6100014980 con 0x7f6108154be0 2023-12-16T03:26:32.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.609+0000 7f60fe7fc640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ec066470 0x7f60ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:32.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.609+0000 7f60fe7fc640 1 -- 172.21.15.28:0/1429967166 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6100084bf0 con 0x7f6108154be0 2023-12-16T03:26:32.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.609+0000 7f610df29640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ec066470 0x7f60ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:32.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.609+0000 7f610df29640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ec066470 0x7f60ec068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f61040af000 tx=0x7f61040a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:32.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.613+0000 7f60fe7fc640 1 -- 172.21.15.28:0/1429967166 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6100051db0 con 0x7f6108154be0 2023-12-16T03:26:32.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.809+0000 7f610ef2b640 1 -- 172.21.15.28:0/1429967166 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f61081ed8c0 con 0x7f6108154be0 2023-12-16T03:26:32.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.809+0000 7f60fe7fc640 1 -- 172.21.15.28:0/1429967166 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+149 (secure 0 0 0) 0x7f6100018070 con 0x7f6108154be0 2023-12-16T03:26:32.816 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:26:32.816 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-16T03:26:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 -- 172.21.15.28:0/1429967166 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ec066470 msgr2=0x7f60ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ec066470 0x7f60ec068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f61040af000 tx=0x7f61040a7000 comp rx=0 tx=0).stop 2023-12-16T03:26:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 -- 172.21.15.28:0/1429967166 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6108154be0 msgr2=0x7f61081f0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6108154be0 0x7f61081f0c60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f610000efc0 tx=0x7f610000c490 comp rx=0 tx=0).stop 2023-12-16T03:26:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 -- 172.21.15.28:0/1429967166 shutdown_connections 2023-12-16T03:26:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ec066470 0x7f60ec068930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6108154be0 0x7f61081f0c60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6108151cd0 0x7f61081f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 --2- 172.21.15.28:0/1429967166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61080c7c50 0x7f61081480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:32.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 -- 172.21.15.28:0/1429967166 >> 172.21.15.28:0/1429967166 conn(0x7f61080abee0 msgr2=0x7f610814faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:32.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 -- 172.21.15.28:0/1429967166 shutdown_connections 2023-12-16T03:26:32.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:32.813+0000 7f610ef2b640 1 -- 172.21.15.28:0/1429967166 wait complete. 2023-12-16T03:26:32.837 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-16T03:26:32.838 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:26:32.838 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2023-12-16T03:26:32.838 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-16T03:26:32.838 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T03:26:32.838 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-16T03:26:32.838 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:26:32.838 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.XCh8itscPB 2023-12-16T03:26:32.838 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2023-12-16T03:26:32.847 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.gkxhMTqxuy 2023-12-16T03:26:32.847 DEBUG:teuthology.orchestra.run.smithi028:> sudo cp /tmp/tmp.XCh8itscPB /tmp/tmp.gkxhMTqxuy 2023-12-16T03:26:32.909 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.gkxhMTqxuy 2023-12-16T03:26:33.030 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.gkxhMTqxuy is 185B 2023-12-16T03:26:33.046 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.gkxhMTqxuy 2023-12-16T03:26:33.055 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDlGH1l/sM4JRAAhBvUn0krm8eJTjfzpHCvgA== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-12-16T03:26:33.055 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:26:33.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:33.055 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2023-12-16T03:26:33.110 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42313sec preferred_lft 42313sec 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:9f:0c:41:28 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:26:33.111 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:26:33.112 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:26:33.112 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:33.112 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:26:33.112 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:33.112 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:26:33.112 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T03:26:33.112 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:26:33.112 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:26:33.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:33.113 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:26:33.176 INFO:teuthology.orchestra.run.smithi028.stdout:1 2023-12-16T03:26:33.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:33.178 DEBUG:teuthology.orchestra.run.smithi028:> route 2023-12-16T03:26:33.234 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2023-12-16T03:26:33.235 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:26:33.235 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-16T03:26:33.235 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:26:33.235 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-16T03:26:33.235 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:26:33.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:33.235 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec bash -c ' 2023-12-16T03:26:33.235 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2023-12-16T03:26:33.235 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-16T03:26:33.235 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-16T03:26:33.236 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-16T03:26:33.236 DEBUG:teuthology.orchestra.run.smithi028:> ') 2023-12-16T03:26:33.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:33.329 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2023-12-16T03:26:33.339 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T03:26:33.339 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:26:33.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:33.339 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2023-12-16T03:26:33.407 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:26:33.407 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T03:26:33.457 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:26:33.458 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:26:33.458 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:26:33.509 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:26:33.509 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/tmp/tmp.XCh8itscPB of=/dev/stdout 2023-12-16T03:26:33.565 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-16T03:26:33.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:33.565 DEBUG:teuthology.orchestra.run.smithi028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDlGH1l/sM4JRAAhBvUn0krm8eJTjfzpHCvgA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:33.661 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,secret=AQDlGH1l/sM4JRAAhBvUn0krm8eJTjfzpHCvgA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:33.662 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:26:33.662 INFO:teuthology.orchestra.run.smithi028.stdout:keyring.get_secret failed 2023-12-16T03:26:33.673 INFO:teuthology.orchestra.run.smithi028.stderr:mount.ceph: kernel BUG! 2023-12-16T03:26:33.673 INFO:teuthology.orchestra.run.smithi028.stderr:mount error: no mds server is up or the cluster is laggy 2023-12-16T03:26:33.674 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,secret=AQDlGH1l/sM4JRAAhBvUn0krm8eJTjfzpHCvgA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:26:33.674 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:26:33.675 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:26:33.675 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: trying mount with new device syntax: testuser@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs2=/ 2023-12-16T03:26:33.675 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:26:33.678 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-16T03:26:33.678 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-16T03:26:33.678 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-16T03:26:33.679 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:26:33.788 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:26:33.844 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-16T03:26:33.845 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:26:33.845 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:33.854 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7208 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-16T03:26:33.855 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:26:33.855 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:33.864 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:26:33.864 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:33.914 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:34.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.049+0000 7f6f9e879640 1 Processor -- start 2023-12-16T03:26:34.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.049+0000 7f6f9e879640 1 -- start start 2023-12-16T03:26:34.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f9e879640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6f980a5370 0x7f6f980c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f9e879640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6f980c4110 0x7f6f98150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f9e879640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f980c2760 con 0x7f6f98072090 2023-12-16T03:26:34.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f9e879640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f980c3070 con 0x7f6f980a5370 2023-12-16T03:26:34.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f9e879640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98151bf0 con 0x7f6f980c4110 2023-12-16T03:26:34.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f9ce16640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6f98072090 0x7f6f981514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45582/0 (socket says 172.21.15.28:45582) 2023-12-16T03:26:34.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f9ce16640 1 -- 172.21.15.28:0/742714828 learned_addr learned my addr 172.21.15.28:0/742714828 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:34.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f977fe640 1 --2- 172.21.15.28:0/742714828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6f980c4110 0x7f6f98150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f97fff640 1 --2- 172.21.15.28:0/742714828 >> v2:172.21.15.134:3300/0 conn(0x7f6f980a5370 0x7f6f980c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f96ffd640 1 -- 172.21.15.28:0/742714828 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831079164 0 0) 0x7f6f980c2760 con 0x7f6f98072090 2023-12-16T03:26:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f96ffd640 1 -- 172.21.15.28:0/742714828 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f80003530 con 0x7f6f98072090 2023-12-16T03:26:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f977fe640 1 -- 172.21.15.28:0/742714828 >> v2:172.21.15.134:3300/0 conn(0x7f6f980a5370 msgr2=0x7f6f980c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f977fe640 1 --2- 172.21.15.28:0/742714828 >> v2:172.21.15.134:3300/0 conn(0x7f6f980a5370 0x7f6f980c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f96ffd640 1 -- 172.21.15.28:0/742714828 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2138644120 0 0) 0x7f6f80003530 con 0x7f6f98072090 2023-12-16T03:26:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f977fe640 1 -- 172.21.15.28:0/742714828 >> v1:172.21.15.28:6789/0 conn(0x7f6f98072090 legacy=0x7f6f981514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.053+0000 7f6f977fe640 1 -- 172.21.15.28:0/742714828 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f980a5750 con 0x7f6f980c4110 2023-12-16T03:26:34.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f977fe640 1 --2- 172.21.15.28:0/742714828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6f980c4110 0x7f6f98150fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0097c0 tx=0x7f6f8c01c250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5cfac61b341768c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:34.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f96ffd640 1 -- 172.21.15.28:0/742714828 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90001a00 con 0x7f6f980c4110 2023-12-16T03:26:34.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f96ffd640 1 -- 172.21.15.28:0/742714828 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c0a7050 con 0x7f6f980c4110 2023-12-16T03:26:34.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f96ffd640 1 -- 172.21.15.28:0/742714828 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0ab620 con 0x7f6f980c4110 2023-12-16T03:26:34.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f9e879640 1 -- 172.21.15.28:0/742714828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6f980c4110 msgr2=0x7f6f98150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f9e879640 1 --2- 172.21.15.28:0/742714828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6f980c4110 0x7f6f98150fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0097c0 tx=0x7f6f8c01c250 comp rx=0 tx=0).stop 2023-12-16T03:26:34.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f9e879640 1 -- 172.21.15.28:0/742714828 shutdown_connections 2023-12-16T03:26:34.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f9e879640 1 --2- 172.21.15.28:0/742714828 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6f980c4110 0x7f6f98150fa0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f9e879640 1 --2- 172.21.15.28:0/742714828 >> v2:172.21.15.134:3300/0 conn(0x7f6f980a5370 0x7f6f980c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f9e879640 1 -- 172.21.15.28:0/742714828 >> 172.21.15.28:0/742714828 conn(0x7f6f9806a5b0 msgr2=0x7f6f9806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:34.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f9e879640 1 -- 172.21.15.28:0/742714828 shutdown_connections 2023-12-16T03:26:34.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f9e879640 1 -- 172.21.15.28:0/742714828 wait complete. 2023-12-16T03:26:34.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f9e879640 1 Processor -- start 2023-12-16T03:26:34.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.057+0000 7f6f9e879640 1 -- start start 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f9e879640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f98072090 0x7f6f980716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f9e879640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f980a5370 0x7f6f9814d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f9e879640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6f980c4110 0x7f6f9815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f9e879640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9814a7e0 con 0x7f6f98072090 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f9e879640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9815ef30 con 0x7f6f980a5370 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f9e879640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9815da30 con 0x7f6f980c4110 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f97fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f98072090 0x7f6f980716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f97fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f98072090 0x7f6f980716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48956/0 (socket says 172.21.15.28:48956) 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f97fff640 1 -- 172.21.15.28:0/2430827110 learned_addr learned my addr 172.21.15.28:0/2430827110 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f977fe640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f980a5370 0x7f6f9814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f9ce16640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6f980c4110 0x7f6f9815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f97fff640 1 -- 172.21.15.28:0/2430827110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6f980c4110 msgr2=0x7f6f9815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f97fff640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6f980c4110 0x7f6f9815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f97fff640 1 -- 172.21.15.28:0/2430827110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f980a5370 msgr2=0x7f6f9814d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f97fff640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f980a5370 0x7f6f9814d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f97fff640 1 -- 172.21.15.28:0/2430827110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c009420 con 0x7f6f98072090 2023-12-16T03:26:34.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f977fe640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f980a5370 0x7f6f9814d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:34.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f97fff640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f98072090 0x7f6f980716f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800e960 tx=0x7f6f8800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:34.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f94ff9640 1 -- 172.21.15.28:0/2430827110 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88009690 con 0x7f6f98072090 2023-12-16T03:26:34.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f94ff9640 1 -- 172.21.15.28:0/2430827110 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8800ca00 con 0x7f6f98072090 2023-12-16T03:26:34.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f94ff9640 1 -- 172.21.15.28:0/2430827110 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800cd70 con 0x7f6f98072090 2023-12-16T03:26:34.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f9e879640 1 -- 172.21.15.28:0/2430827110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9815f180 con 0x7f6f98072090 2023-12-16T03:26:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f9e879640 1 -- 172.21.15.28:0/2430827110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9815dc80 con 0x7f6f98072090 2023-12-16T03:26:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.061+0000 7f6f9e879640 1 -- 172.21.15.28:0/2430827110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f98068400 con 0x7f6f98072090 2023-12-16T03:26:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.065+0000 7f6f94ff9640 1 -- 172.21.15.28:0/2430827110 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6f88013470 con 0x7f6f98072090 2023-12-16T03:26:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.065+0000 7f6f94ff9640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6f84066470 0x7f6f84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.065+0000 7f6f94ff9640 1 -- 172.21.15.28:0/2430827110 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6f88084490 con 0x7f6f98072090 2023-12-16T03:26:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.065+0000 7f6f977fe640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6f84066470 0x7f6f84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.065+0000 7f6f977fe640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6f84066470 0x7f6f84068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0097c0 tx=0x7f6f8c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:34.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.069+0000 7f6f94ff9640 1 -- 172.21.15.28:0/2430827110 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6f880515a0 con 0x7f6f98072090 2023-12-16T03:26:34.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.225+0000 7f6f9e879640 1 -- 172.21.15.28:0/2430827110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f9815b2d0 con 0x7f6f98072090 2023-12-16T03:26:34.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f94ff9640 1 -- 172.21.15.28:0/2430827110 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20229 (secure 0 0 0) 0x7f6f88054bc0 con 0x7f6f98072090 2023-12-16T03:26:34.234 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:34.234 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:21.432053+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:34.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 -- 172.21.15.28:0/2430827110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6f84066470 msgr2=0x7f6f84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6f84066470 0x7f6f84068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0097c0 tx=0x7f6f8c0a6000 comp rx=0 tx=0).stop 2023-12-16T03:26:34.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 -- 172.21.15.28:0/2430827110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f98072090 msgr2=0x7f6f980716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f98072090 0x7f6f980716f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800e960 tx=0x7f6f8800ee20 comp rx=0 tx=0).stop 2023-12-16T03:26:34.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 -- 172.21.15.28:0/2430827110 shutdown_connections 2023-12-16T03:26:34.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6f980c4110 0x7f6f9815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f980a5370 0x7f6f9814d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6f84066470 0x7f6f84068930 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 --2- 172.21.15.28:0/2430827110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6f98072090 0x7f6f980716f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 -- 172.21.15.28:0/2430827110 >> 172.21.15.28:0/2430827110 conn(0x7f6f9806a5b0 msgr2=0x7f6f980bf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:34.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 -- 172.21.15.28:0/2430827110 shutdown_connections 2023-12-16T03:26:34.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.229+0000 7f6f9e879640 1 -- 172.21.15.28:0/2430827110 wait complete. 2023-12-16T03:26:34.256 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:26:00.659571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:26:01.837383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:26:18.527469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:26:18.979011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:26:34.256 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:26:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f085b0ea640 1 Processor -- start 2023-12-16T03:26:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f085b0ea640 1 -- start start 2023-12-16T03:26:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f085b0ea640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f08540c63c0 0x7f08540c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f085b0ea640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08540c31c0 con 0x7f08540c2bb0 2023-12-16T03:26:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f085b0ea640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08540c34a0 con 0x7f08540c4100 2023-12-16T03:26:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f085b0ea640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08540c1030 con 0x7f08540c63c0 2023-12-16T03:26:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f0858e86640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f08540c63c0 0x7f08540c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f0858e86640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f08540c63c0 0x7f08540c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48958/0 (socket says 172.21.15.28:48958) 2023-12-16T03:26:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f0859687640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f08540c2bb0 0x7f08540a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45598/0 (socket says 172.21.15.28:45598) 2023-12-16T03:26:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f0858e86640 1 -- 172.21.15.28:0/851948487 learned_addr learned my addr 172.21.15.28:0/851948487 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f0858e86640 1 -- 172.21.15.28:0/851948487 >> v1:172.21.15.134:6789/0 conn(0x7f08540c4100 legacy=0x7f08540c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f0858e86640 1 -- 172.21.15.28:0/851948487 >> v1:172.21.15.28:6789/0 conn(0x7f08540c2bb0 legacy=0x7f08540a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.397+0000 7f0858e86640 1 -- 172.21.15.28:0/851948487 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08540c1310 con 0x7f08540c63c0 2023-12-16T03:26:34.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.401+0000 7f0858e86640 1 --2- 172.21.15.28:0/851948487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08540c63c0 0x7f08540c06d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0848009870 tx=0x7f084801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27963fa8d4024c1c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:34.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.401+0000 7f08537fe640 1 -- 172.21.15.28:0/851948487 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480ab600 con 0x7f08540c63c0 2023-12-16T03:26:34.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.401+0000 7f08537fe640 1 -- 172.21.15.28:0/851948487 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480ab760 con 0x7f08540c63c0 2023-12-16T03:26:34.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.401+0000 7f08537fe640 1 -- 172.21.15.28:0/851948487 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480abaf0 con 0x7f08540c63c0 2023-12-16T03:26:34.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.401+0000 7f085b0ea640 1 -- 172.21.15.28:0/851948487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08540c63c0 msgr2=0x7f08540c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.401+0000 7f085b0ea640 1 --2- 172.21.15.28:0/851948487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08540c63c0 0x7f08540c06d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0848009870 tx=0x7f084801c3e0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.401+0000 7f085b0ea640 1 -- 172.21.15.28:0/851948487 shutdown_connections 2023-12-16T03:26:34.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.401+0000 7f085b0ea640 1 --2- 172.21.15.28:0/851948487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08540c63c0 0x7f08540c06d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.401+0000 7f085b0ea640 1 -- 172.21.15.28:0/851948487 >> 172.21.15.28:0/851948487 conn(0x7f085406a5b0 msgr2=0x7f085406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:34.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.401+0000 7f085b0ea640 1 -- 172.21.15.28:0/851948487 shutdown_connections 2023-12-16T03:26:34.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.401+0000 7f085b0ea640 1 -- 172.21.15.28:0/851948487 wait complete. 2023-12-16T03:26:34.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f085b0ea640 1 Processor -- start 2023-12-16T03:26:34.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f085b0ea640 1 -- start start 2023-12-16T03:26:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f085b0ea640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08540c2bb0 0x7f08541530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f085b0ea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08540c4100 0x7f08541542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f085b0ea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08540c63c0 0x7f0854154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f085b0ea640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08540bbe90 con 0x7f08540c2bb0 2023-12-16T03:26:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f085b0ea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085414d040 con 0x7f08540c4100 2023-12-16T03:26:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f085b0ea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08540bf690 con 0x7f08540c63c0 2023-12-16T03:26:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0858e86640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08540c2bb0 0x7f08541530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0858e86640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08540c2bb0 0x7f08541530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48968/0 (socket says 172.21.15.28:48968) 2023-12-16T03:26:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0858e86640 1 -- 172.21.15.28:0/3129211934 learned_addr learned my addr 172.21.15.28:0/3129211934 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0859687640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08540c63c0 0x7f0854154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0853fff640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08540c4100 0x7f08541542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0858e86640 1 -- 172.21.15.28:0/3129211934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08540c63c0 msgr2=0x7f0854154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0858e86640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08540c63c0 0x7f0854154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0858e86640 1 -- 172.21.15.28:0/3129211934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08540c4100 msgr2=0x7f08541542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0858e86640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08540c4100 0x7f08541542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0858e86640 1 -- 172.21.15.28:0/3129211934 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480094d0 con 0x7f08540c2bb0 2023-12-16T03:26:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0853fff640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08540c4100 0x7f08541542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f0858e86640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08540c2bb0 0x7f08541530c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f08480ad040 tx=0x7f084801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:34.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f08517fa640 1 -- 172.21.15.28:0/3129211934 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480b4800 con 0x7f08540c2bb0 2023-12-16T03:26:34.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f08517fa640 1 -- 172.21.15.28:0/3129211934 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480b4980 con 0x7f08540c2bb0 2023-12-16T03:26:34.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f08517fa640 1 -- 172.21.15.28:0/3129211934 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480b4d30 con 0x7f08540c2bb0 2023-12-16T03:26:34.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f085b0ea640 1 -- 172.21.15.28:0/3129211934 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08540bf970 con 0x7f08540c2bb0 2023-12-16T03:26:34.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f085b0ea640 1 -- 172.21.15.28:0/3129211934 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0854153600 con 0x7f08540c2bb0 2023-12-16T03:26:34.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.405+0000 7f085b0ea640 1 -- 172.21.15.28:0/3129211934 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0854068400 con 0x7f08540c2bb0 2023-12-16T03:26:34.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.409+0000 7f08517fa640 1 -- 172.21.15.28:0/3129211934 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f08480c7440 con 0x7f08540c2bb0 2023-12-16T03:26:34.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.409+0000 7f08517fa640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0838066470 0x7f0838068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.409+0000 7f08517fa640 1 -- 172.21.15.28:0/3129211934 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f084811eb40 con 0x7f08540c2bb0 2023-12-16T03:26:34.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.409+0000 7f0853fff640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0838066470 0x7f0838068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.409+0000 7f0853fff640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0838066470 0x7f0838068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0840003ec0 tx=0x7f0840009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:34.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.413+0000 7f08517fa640 1 -- 172.21.15.28:0/3129211934 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f08480ebe20 con 0x7f08540c2bb0 2023-12-16T03:26:34.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.573+0000 7f085b0ea640 1 -- 172.21.15.28:0/3129211934 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08540bfe20 con 0x7f08540c2bb0 2023-12-16T03:26:34.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.573+0000 7f08517fa640 1 -- 172.21.15.28:0/3129211934 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08480ef440 con 0x7f08540c2bb0 2023-12-16T03:26:34.581 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:26:34.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 -- 172.21.15.28:0/3129211934 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0838066470 msgr2=0x7f0838068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0838066470 0x7f0838068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0840003ec0 tx=0x7f0840009040 comp rx=0 tx=0).stop 2023-12-16T03:26:34.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 -- 172.21.15.28:0/3129211934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08540c2bb0 msgr2=0x7f08541530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08540c2bb0 0x7f08541530c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f08480ad040 tx=0x7f084801ac20 comp rx=0 tx=0).stop 2023-12-16T03:26:34.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 -- 172.21.15.28:0/3129211934 shutdown_connections 2023-12-16T03:26:34.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08540c63c0 0x7f0854154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08540c4100 0x7f08541542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0838066470 0x7f0838068930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 --2- 172.21.15.28:0/3129211934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08540c2bb0 0x7f08541530c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 -- 172.21.15.28:0/3129211934 >> 172.21.15.28:0/3129211934 conn(0x7f085406a5b0 msgr2=0x7f08540c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:34.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 -- 172.21.15.28:0/3129211934 shutdown_connections 2023-12-16T03:26:34.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.577+0000 7f085b0ea640 1 -- 172.21.15.28:0/3129211934 wait complete. 2023-12-16T03:26:34.602 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:26:34.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.741+0000 7f0356efe640 1 Processor -- start 2023-12-16T03:26:34.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.741+0000 7f0356efe640 1 -- start start 2023-12-16T03:26:34.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f0356efe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f035014b010 0x7f03500bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f0356efe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0350157c20 0x7f0350158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f0356efe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035006a5b0 con 0x7f0350073a70 2023-12-16T03:26:34.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f0356efe640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035006b710 con 0x7f0350157c20 2023-12-16T03:26:34.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f0356efe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03500c1d60 con 0x7f035014b010 2023-12-16T03:26:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f035549b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0350157c20 0x7f0350158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f035549b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0350157c20 0x7f0350158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48976/0 (socket says 172.21.15.28:48976) 2023-12-16T03:26:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f035549b640 1 -- 172.21.15.28:0/2280275209 learned_addr learned my addr 172.21.15.28:0/2280275209 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:34.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f0354c9a640 1 --2- 172.21.15.28:0/2280275209 >> v2:172.21.15.134:3300/0 conn(0x7f035014b010 0x7f03500bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f035549b640 1 -- 172.21.15.28:0/2280275209 >> v2:172.21.15.134:3300/0 conn(0x7f035014b010 msgr2=0x7f03500bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:34.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f035549b640 1 --2- 172.21.15.28:0/2280275209 >> v2:172.21.15.134:3300/0 conn(0x7f035014b010 0x7f03500bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f035549b640 1 -- 172.21.15.28:0/2280275209 >> v1:172.21.15.134:6789/0 conn(0x7f0350073a70 legacy=0x7f035006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f035549b640 1 -- 172.21.15.28:0/2280275209 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500c2040 con 0x7f0350157c20 2023-12-16T03:26:34.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.745+0000 7f0354c9a640 1 --2- 172.21.15.28:0/2280275209 >> v2:172.21.15.134:3300/0 conn(0x7f035014b010 0x7f03500bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:34.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f035549b640 1 --2- 172.21.15.28:0/2280275209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0350157c20 0x7f0350158070 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0350070140 tx=0x7f034801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b23e3ea7601a13f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:34.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f034f7fe640 1 -- 172.21.15.28:0/2280275209 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480af400 con 0x7f0350157c20 2023-12-16T03:26:34.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f034f7fe640 1 -- 172.21.15.28:0/2280275209 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03480ab050 con 0x7f0350157c20 2023-12-16T03:26:34.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f034f7fe640 1 -- 172.21.15.28:0/2280275209 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480af780 con 0x7f0350157c20 2023-12-16T03:26:34.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f0356efe640 1 -- 172.21.15.28:0/2280275209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0350157c20 msgr2=0x7f0350158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f0356efe640 1 --2- 172.21.15.28:0/2280275209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0350157c20 0x7f0350158070 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0350070140 tx=0x7f034801f1c0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f0356efe640 1 -- 172.21.15.28:0/2280275209 shutdown_connections 2023-12-16T03:26:34.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f0356efe640 1 --2- 172.21.15.28:0/2280275209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0350157c20 0x7f0350158070 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f0356efe640 1 --2- 172.21.15.28:0/2280275209 >> v2:172.21.15.134:3300/0 conn(0x7f035014b010 0x7f03500bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f0356efe640 1 -- 172.21.15.28:0/2280275209 >> 172.21.15.28:0/2280275209 conn(0x7f03500c30c0 msgr2=0x7f03500c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:34.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f0356efe640 1 -- 172.21.15.28:0/2280275209 shutdown_connections 2023-12-16T03:26:34.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f0356efe640 1 -- 172.21.15.28:0/2280275209 wait complete. 2023-12-16T03:26:34.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f0356efe640 1 Processor -- start 2023-12-16T03:26:34.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.749+0000 7f0356efe640 1 -- start start 2023-12-16T03:26:34.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0356efe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0350073a70 0x7f03501ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0356efe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035014b010 0x7f0350146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0356efe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0350157c20 0x7f0350147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0356efe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0350153690 con 0x7f0350073a70 2023-12-16T03:26:34.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0356efe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035014be40 con 0x7f035014b010 2023-12-16T03:26:34.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0356efe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03501ede50 con 0x7f0350157c20 2023-12-16T03:26:34.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0354c9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0350073a70 0x7f03501ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0354c9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0350073a70 0x7f03501ed500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48990/0 (socket says 172.21.15.28:48990) 2023-12-16T03:26:34.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0354c9a640 1 -- 172.21.15.28:0/3700062281 learned_addr learned my addr 172.21.15.28:0/3700062281 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:34.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f034ffff640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035014b010 0x7f0350146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f035549b640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0350157c20 0x7f0350147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0354c9a640 1 -- 172.21.15.28:0/3700062281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0350157c20 msgr2=0x7f0350147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0354c9a640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0350157c20 0x7f0350147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0354c9a640 1 -- 172.21.15.28:0/3700062281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035014b010 msgr2=0x7f0350146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0354c9a640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035014b010 0x7f0350146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0354c9a640 1 -- 172.21.15.28:0/3700062281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0348009b30 con 0x7f0350073a70 2023-12-16T03:26:34.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f034ffff640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035014b010 0x7f0350146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:34.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0354c9a640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0350073a70 0x7f03501ed500 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f034400e810 tx=0x7f034400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:34.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f034d7fa640 1 -- 172.21.15.28:0/3700062281 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400c8d0 con 0x7f0350073a70 2023-12-16T03:26:34.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f034d7fa640 1 -- 172.21.15.28:0/3700062281 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034400ca30 con 0x7f0350073a70 2023-12-16T03:26:34.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f034d7fa640 1 -- 172.21.15.28:0/3700062281 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400cdc0 con 0x7f0350073a70 2023-12-16T03:26:34.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0356efe640 1 -- 172.21.15.28:0/3700062281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03501ee130 con 0x7f0350073a70 2023-12-16T03:26:34.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0356efe640 1 -- 172.21.15.28:0/3700062281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0350147660 con 0x7f0350073a70 2023-12-16T03:26:34.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f0356efe640 1 -- 172.21.15.28:0/3700062281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0350068400 con 0x7f0350073a70 2023-12-16T03:26:34.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.753+0000 7f034d7fa640 1 -- 172.21.15.28:0/3700062281 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0344013410 con 0x7f0350073a70 2023-12-16T03:26:34.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.757+0000 7f034d7fa640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0334066470 0x7f0334068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:34.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.757+0000 7f034d7fa640 1 -- 172.21.15.28:0/3700062281 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f03440840c0 con 0x7f0350073a70 2023-12-16T03:26:34.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.757+0000 7f034ffff640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0334066470 0x7f0334068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:34.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.757+0000 7f034ffff640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0334066470 0x7f0334068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0350151900 tx=0x7f033c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:34.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.761+0000 7f034d7fa640 1 -- 172.21.15.28:0/3700062281 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0344051140 con 0x7f0350073a70 2023-12-16T03:26:34.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.917+0000 7f0356efe640 1 -- 172.21.15.28:0/3700062281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0350073850 con 0x7f0350073a70 2023-12-16T03:26:34.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.917+0000 7f034d7fa640 1 -- 172.21.15.28:0/3700062281 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0344009480 con 0x7f0350073a70 2023-12-16T03:26:34.926 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:26:34.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 -- 172.21.15.28:0/3700062281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0334066470 msgr2=0x7f0334068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0334066470 0x7f0334068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0350151900 tx=0x7f033c009040 comp rx=0 tx=0).stop 2023-12-16T03:26:34.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 -- 172.21.15.28:0/3700062281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0350073a70 msgr2=0x7f03501ed500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:34.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0350073a70 0x7f03501ed500 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f034400e810 tx=0x7f034400ecd0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 -- 172.21.15.28:0/3700062281 shutdown_connections 2023-12-16T03:26:34.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0350157c20 0x7f0350147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035014b010 0x7f0350146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0334066470 0x7f0334068930 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 --2- 172.21.15.28:0/3700062281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0350073a70 0x7f03501ed500 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:34.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 -- 172.21.15.28:0/3700062281 >> 172.21.15.28:0/3700062281 conn(0x7f03500c30c0 msgr2=0x7f03501573d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:34.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 -- 172.21.15.28:0/3700062281 shutdown_connections 2023-12-16T03:26:34.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:34.921+0000 7f0356efe640 1 -- 172.21.15.28:0/3700062281 wait complete. 2023-12-16T03:26:34.947 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:26:35.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.085+0000 7fd5ca454640 1 Processor -- start 2023-12-16T03:26:35.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.085+0000 7fd5ca454640 1 -- start start 2023-12-16T03:26:35.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5ca454640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd5c40c7980 0x7fd5c40c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5ca454640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd5c4155e60 0x7fd5c40a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5ca454640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c40c67a0 con 0x7fd5c40c7d60 2023-12-16T03:26:35.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5ca454640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c40c85a0 con 0x7fd5c4155e60 2023-12-16T03:26:35.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5ca454640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c40c5e70 con 0x7fd5c40c7980 2023-12-16T03:26:35.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5c89f1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd5c4155e60 0x7fd5c40a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5c37fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd5c40c7d60 0x7fd5c40c6c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45614/0 (socket says 172.21.15.28:45614) 2023-12-16T03:26:35.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5c37fe640 1 -- 172.21.15.28:0/629943410 learned_addr learned my addr 172.21.15.28:0/629943410 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:35.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5c3fff640 1 --2- 172.21.15.28:0/629943410 >> v2:172.21.15.134:3300/0 conn(0x7fd5c40c7980 0x7fd5c40c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5c89f1640 1 -- 172.21.15.28:0/629943410 >> v2:172.21.15.134:3300/0 conn(0x7fd5c40c7980 msgr2=0x7fd5c40c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:35.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5c89f1640 1 --2- 172.21.15.28:0/629943410 >> v2:172.21.15.134:3300/0 conn(0x7fd5c40c7980 0x7fd5c40c1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5c89f1640 1 -- 172.21.15.28:0/629943410 >> v1:172.21.15.28:6789/0 conn(0x7fd5c40c7d60 legacy=0x7fd5c40c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5c89f1640 1 -- 172.21.15.28:0/629943410 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c40c6150 con 0x7fd5c4155e60 2023-12-16T03:26:35.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.089+0000 7fd5c2ffd640 1 -- 172.21.15.28:0/629943410 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290844590 0 0) 0x7fd5c40c67a0 con 0x7fd5c40c7d60 2023-12-16T03:26:35.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5c89f1640 1 --2- 172.21.15.28:0/629943410 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5c4155e60 0x7fd5c40a6d70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40ae100 tx=0x7fd5bc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0721b50c4fa942 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:35.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5c2ffd640 1 -- 172.21.15.28:0/629943410 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0a58b0 con 0x7fd5c4155e60 2023-12-16T03:26:35.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5c2ffd640 1 -- 172.21.15.28:0/629943410 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc0a5a10 con 0x7fd5c4155e60 2023-12-16T03:26:35.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5c2ffd640 1 -- 172.21.15.28:0/629943410 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0a5da0 con 0x7fd5c4155e60 2023-12-16T03:26:35.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5ca454640 1 -- 172.21.15.28:0/629943410 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5c4155e60 msgr2=0x7fd5c40a6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5ca454640 1 --2- 172.21.15.28:0/629943410 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5c4155e60 0x7fd5c40a6d70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40ae100 tx=0x7fd5bc01c910 comp rx=0 tx=0).stop 2023-12-16T03:26:35.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5ca454640 1 -- 172.21.15.28:0/629943410 shutdown_connections 2023-12-16T03:26:35.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5ca454640 1 --2- 172.21.15.28:0/629943410 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5c4155e60 0x7fd5c40a6d70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5ca454640 1 --2- 172.21.15.28:0/629943410 >> v2:172.21.15.134:3300/0 conn(0x7fd5c40c7980 0x7fd5c40c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5ca454640 1 -- 172.21.15.28:0/629943410 >> 172.21.15.28:0/629943410 conn(0x7fd5c40a9b80 msgr2=0x7fd5c40a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:35.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5ca454640 1 -- 172.21.15.28:0/629943410 shutdown_connections 2023-12-16T03:26:35.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5ca454640 1 -- 172.21.15.28:0/629943410 wait complete. 2023-12-16T03:26:35.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5ca454640 1 Processor -- start 2023-12-16T03:26:35.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.093+0000 7fd5ca454640 1 -- start start 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5ca454640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5c40c7980 0x7fd5c40ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5ca454640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5c40c7d60 0x7fd5c406ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5ca454640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5c4155e60 0x7fd5c41f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5ca454640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c41f0fa0 con 0x7fd5c40c7980 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5ca454640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c41f4550 con 0x7fd5c4155e60 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5ca454640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40c0500 con 0x7fd5c40c7d60 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5c40c7980 0x7fd5c40ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5c40c7980 0x7fd5c40ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49014/0 (socket says 172.21.15.28:49014) 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c3fff640 1 -- 172.21.15.28:0/3649033011 learned_addr learned my addr 172.21.15.28:0/3649033011 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c3fff640 1 -- 172.21.15.28:0/3649033011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5c40c7d60 msgr2=0x7fd5c406ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c3fff640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5c40c7d60 0x7fd5c406ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c3fff640 1 -- 172.21.15.28:0/3649033011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5c4155e60 msgr2=0x7fd5c41f4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c3fff640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5c4155e60 0x7fd5c41f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c3fff640 1 -- 172.21.15.28:0/3649033011 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc009a70 con 0x7fd5c40c7980 2023-12-16T03:26:35.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c3fff640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5c40c7980 0x7fd5c40ac800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400d800 tx=0x7fd5b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:35.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c0ff9640 1 -- 172.21.15.28:0/3649033011 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400b6c0 con 0x7fd5c40c7980 2023-12-16T03:26:35.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c0ff9640 1 -- 172.21.15.28:0/3649033011 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b400b820 con 0x7fd5c40c7980 2023-12-16T03:26:35.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c0ff9640 1 -- 172.21.15.28:0/3649033011 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400bb90 con 0x7fd5c40c7980 2023-12-16T03:26:35.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5ca454640 1 -- 172.21.15.28:0/3649033011 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c40c07e0 con 0x7fd5c40c7980 2023-12-16T03:26:35.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5ca454640 1 -- 172.21.15.28:0/3649033011 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c40c0da0 con 0x7fd5c40c7980 2023-12-16T03:26:35.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5ca454640 1 -- 172.21.15.28:0/3649033011 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c4068400 con 0x7fd5c40c7980 2023-12-16T03:26:35.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.097+0000 7fd5c0ff9640 1 -- 172.21.15.28:0/3649033011 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd5b400bcf0 con 0x7fd5c40c7980 2023-12-16T03:26:35.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.101+0000 7fd5c0ff9640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd5b00664a0 0x7fd5b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.101+0000 7fd5c0ff9640 1 -- 172.21.15.28:0/3649033011 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd5b40846e0 con 0x7fd5c40c7980 2023-12-16T03:26:35.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.101+0000 7fd5c37fe640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd5b00664a0 0x7fd5b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.101+0000 7fd5c37fe640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd5b00664a0 0x7fd5b0068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80011f0 tx=0x7fd5b8007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:35.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.105+0000 7fd5c0ff9640 1 -- 172.21.15.28:0/3649033011 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd5b4051890 con 0x7fd5c40c7980 2023-12-16T03:26:35.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 -- 172.21.15.28:0/3649033011 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5c4070400 con 0x7fd5c40c7980 2023-12-16T03:26:35.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5c0ff9640 1 -- 172.21.15.28:0/3649033011 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5b4054eb0 con 0x7fd5c40c7980 2023-12-16T03:26:35.267 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:26:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 -- 172.21.15.28:0/3649033011 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd5b00664a0 msgr2=0x7fd5b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd5b00664a0 0x7fd5b0068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80011f0 tx=0x7fd5b8007930 comp rx=0 tx=0).stop 2023-12-16T03:26:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 -- 172.21.15.28:0/3649033011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5c40c7980 msgr2=0x7fd5c40ac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5c40c7980 0x7fd5c40ac800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400d800 tx=0x7fd5b400dcc0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 -- 172.21.15.28:0/3649033011 shutdown_connections 2023-12-16T03:26:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5c4155e60 0x7fd5c41f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5c40c7d60 0x7fd5c406ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd5b00664a0 0x7fd5b0068960 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 --2- 172.21.15.28:0/3649033011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5c40c7980 0x7fd5c40ac800 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 -- 172.21.15.28:0/3649033011 >> 172.21.15.28:0/3649033011 conn(0x7fd5c40a9b80 msgr2=0x7fd5c40a9340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 -- 172.21.15.28:0/3649033011 shutdown_connections 2023-12-16T03:26:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.261+0000 7fd5ca454640 1 -- 172.21.15.28:0/3649033011 wait complete. 2023-12-16T03:26:35.288 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:26:35.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d787f5640 1 Processor -- start 2023-12-16T03:26:35.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d787f5640 1 -- start start 2023-12-16T03:26:35.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d787f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d700c2bb0 0x7f1d700c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d787f5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d700c31c0 con 0x7f1d700c63c0 2023-12-16T03:26:35.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d787f5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d700c34a0 con 0x7f1d700c4100 2023-12-16T03:26:35.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d787f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700c1030 con 0x7f1d700c2bb0 2023-12-16T03:26:35.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d76591640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1d700c63c0 0x7f1d700c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45628/0 (socket says 172.21.15.28:45628) 2023-12-16T03:26:35.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d76591640 1 -- 172.21.15.28:0/1396435842 learned_addr learned my addr 172.21.15.28:0/1396435842 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:35.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d76d92640 1 --2- 172.21.15.28:0/1396435842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d700c2bb0 0x7f1d700c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d76d92640 1 -- 172.21.15.28:0/1396435842 >> v1:172.21.15.134:6789/0 conn(0x7f1d700c4100 legacy=0x7f1d700a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d76d92640 1 -- 172.21.15.28:0/1396435842 >> v1:172.21.15.28:6789/0 conn(0x7f1d700c63c0 legacy=0x7f1d700c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.429+0000 7f1d76d92640 1 -- 172.21.15.28:0/1396435842 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d700c1310 con 0x7f1d700c2bb0 2023-12-16T03:26:35.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.433+0000 7f1d76d92640 1 --2- 172.21.15.28:0/1396435842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d700c2bb0 0x7f1d700c06d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009dc0 tx=0x7f1d6801c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2d5012ed1307b47 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:35.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.433+0000 7f1d7558f640 1 -- 172.21.15.28:0/1396435842 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680a5900 con 0x7f1d700c2bb0 2023-12-16T03:26:35.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.433+0000 7f1d7558f640 1 -- 172.21.15.28:0/1396435842 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d680a5a60 con 0x7f1d700c2bb0 2023-12-16T03:26:35.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.433+0000 7f1d7558f640 1 -- 172.21.15.28:0/1396435842 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680a5df0 con 0x7f1d700c2bb0 2023-12-16T03:26:35.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 -- 172.21.15.28:0/1396435842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d700c2bb0 msgr2=0x7f1d700c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 --2- 172.21.15.28:0/1396435842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d700c2bb0 0x7f1d700c06d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009dc0 tx=0x7f1d6801c820 comp rx=0 tx=0).stop 2023-12-16T03:26:35.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 -- 172.21.15.28:0/1396435842 shutdown_connections 2023-12-16T03:26:35.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 --2- 172.21.15.28:0/1396435842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d700c2bb0 0x7f1d700c06d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 -- 172.21.15.28:0/1396435842 >> 172.21.15.28:0/1396435842 conn(0x7f1d7006a5b0 msgr2=0x7f1d7006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:35.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 -- 172.21.15.28:0/1396435842 shutdown_connections 2023-12-16T03:26:35.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 -- 172.21.15.28:0/1396435842 wait complete. 2023-12-16T03:26:35.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 Processor -- start 2023-12-16T03:26:35.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 -- start start 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d700c2bb0 0x7f1d7014c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d700c4100 0x7f1d70152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d700c63c0 0x7f1d7014b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d701ed4e0 con 0x7f1d700c2bb0 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d701ed7c0 con 0x7f1d700c63c0 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d787f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d701edaa0 con 0x7f1d700c4100 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d76591640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d700c2bb0 0x7f1d7014c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d76591640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d700c2bb0 0x7f1d7014c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49018/0 (socket says 172.21.15.28:49018) 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d76591640 1 -- 172.21.15.28:0/1222074981 learned_addr learned my addr 172.21.15.28:0/1222074981 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d76d92640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d700c63c0 0x7f1d7014b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.437+0000 7f1d75d90640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d700c4100 0x7f1d70152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d76591640 1 -- 172.21.15.28:0/1222074981 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d700c4100 msgr2=0x7f1d70152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d76591640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d700c4100 0x7f1d70152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d76591640 1 -- 172.21.15.28:0/1222074981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d700c63c0 msgr2=0x7f1d7014b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d76591640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d700c63c0 0x7f1d7014b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d76591640 1 -- 172.21.15.28:0/1222074981 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d68009a70 con 0x7f1d700c2bb0 2023-12-16T03:26:35.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d76591640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d700c2bb0 0x7f1d7014c1f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00c400 tx=0x7f1d6c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:35.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d66ffd640 1 -- 172.21.15.28:0/1222074981 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c005cf0 con 0x7f1d700c2bb0 2023-12-16T03:26:35.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d66ffd640 1 -- 172.21.15.28:0/1222074981 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c005e50 con 0x7f1d700c2bb0 2023-12-16T03:26:35.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d66ffd640 1 -- 172.21.15.28:0/1222074981 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c0072d0 con 0x7f1d700c2bb0 2023-12-16T03:26:35.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d787f5640 1 -- 172.21.15.28:0/1222074981 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d701edd80 con 0x7f1d700c2bb0 2023-12-16T03:26:35.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d787f5640 1 -- 172.21.15.28:0/1222074981 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7014c730 con 0x7f1d700c2bb0 2023-12-16T03:26:35.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d787f5640 1 -- 172.21.15.28:0/1222074981 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d700a72e0 con 0x7f1d700c2bb0 2023-12-16T03:26:35.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d66ffd640 1 -- 172.21.15.28:0/1222074981 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1d6c007430 con 0x7f1d700c2bb0 2023-12-16T03:26:35.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d66ffd640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d54066470 0x7f1d54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.441+0000 7f1d66ffd640 1 -- 172.21.15.28:0/1222074981 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1d6c083680 con 0x7f1d700c2bb0 2023-12-16T03:26:35.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.445+0000 7f1d75d90640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d54066470 0x7f1d54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.445+0000 7f1d75d90640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d54066470 0x7f1d54068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1d701eb210 tx=0x7f1d60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:35.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.449+0000 7f1d66ffd640 1 -- 172.21.15.28:0/1222074981 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1d6c050840 con 0x7f1d700c2bb0 2023-12-16T03:26:35.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.605+0000 7f1d787f5640 1 -- 172.21.15.28:0/1222074981 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d70068400 con 0x7f1d700c2bb0 2023-12-16T03:26:35.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.605+0000 7f1d66ffd640 1 -- 172.21.15.28:0/1222074981 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7f1d6c053e60 con 0x7f1d700c2bb0 2023-12-16T03:26:35.613 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 -- 172.21.15.28:0/1222074981 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d54066470 msgr2=0x7f1d54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d54066470 0x7f1d54068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1d701eb210 tx=0x7f1d60009040 comp rx=0 tx=0).stop 2023-12-16T03:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 -- 172.21.15.28:0/1222074981 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d700c2bb0 msgr2=0x7f1d7014c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d700c2bb0 0x7f1d7014c1f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00c400 tx=0x7f1d6c00c8c0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 -- 172.21.15.28:0/1222074981 shutdown_connections 2023-12-16T03:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d700c63c0 0x7f1d7014b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d700c4100 0x7f1d70152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d54066470 0x7f1d54068930 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 --2- 172.21.15.28:0/1222074981 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d700c2bb0 0x7f1d7014c1f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 -- 172.21.15.28:0/1222074981 >> 172.21.15.28:0/1222074981 conn(0x7f1d7006a5b0 msgr2=0x7f1d7006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 -- 172.21.15.28:0/1222074981 shutdown_connections 2023-12-16T03:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.609+0000 7f1d787f5640 1 -- 172.21.15.28:0/1222074981 wait complete. 2023-12-16T03:26:35.635 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:26:35.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d9dd1d640 1 Processor -- start 2023-12-16T03:26:35.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d9dd1d640 1 -- start start 2023-12-16T03:26:35.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d9dd1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d981555c0 0x7f4d980a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d9dd1d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4d980c61e0 0x7f4d980c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d9dd1d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d980c28e0 con 0x7f4d980c6c70 2023-12-16T03:26:35.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d9dd1d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d980c3680 con 0x7f4d980c61e0 2023-12-16T03:26:35.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d9dd1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980c2b80 con 0x7f4d981555c0 2023-12-16T03:26:35.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d96ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4d980c61e0 0x7f4d980c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d96ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4d980c61e0 0x7f4d980c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49020/0 (socket says 172.21.15.28:49020) 2023-12-16T03:26:35.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d96ffd640 1 -- 172.21.15.28:0/3087082064 learned_addr learned my addr 172.21.15.28:0/3087082064 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:35.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d977fe640 1 --2- 172.21.15.28:0/3087082064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d981555c0 0x7f4d980a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d96ffd640 1 -- 172.21.15.28:0/3087082064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d981555c0 msgr2=0x7f4d980a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:35.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d96ffd640 1 --2- 172.21.15.28:0/3087082064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d981555c0 0x7f4d980a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d96ffd640 1 -- 172.21.15.28:0/3087082064 >> v1:172.21.15.134:6789/0 conn(0x7f4d980c6c70 legacy=0x7f4d980c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.777+0000 7f4d96ffd640 1 -- 172.21.15.28:0/3087082064 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980c32a0 con 0x7f4d980c61e0 2023-12-16T03:26:35.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d96ffd640 1 --2- 172.21.15.28:0/3087082064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d980c61e0 0x7f4d980c6730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009870 tx=0x7f4d8c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170f7d50979ac413 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:35.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d967fc640 1 -- 172.21.15.28:0/3087082064 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0ab650 con 0x7f4d980c61e0 2023-12-16T03:26:35.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d967fc640 1 -- 172.21.15.28:0/3087082064 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8c0ab7b0 con 0x7f4d980c61e0 2023-12-16T03:26:35.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d967fc640 1 -- 172.21.15.28:0/3087082064 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0abb40 con 0x7f4d980c61e0 2023-12-16T03:26:35.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/3087082064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d980c61e0 msgr2=0x7f4d980c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d9dd1d640 1 --2- 172.21.15.28:0/3087082064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d980c61e0 0x7f4d980c6730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009870 tx=0x7f4d8c01c540 comp rx=0 tx=0).stop 2023-12-16T03:26:35.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/3087082064 shutdown_connections 2023-12-16T03:26:35.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d9dd1d640 1 --2- 172.21.15.28:0/3087082064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d980c61e0 0x7f4d980c6730 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d9dd1d640 1 --2- 172.21.15.28:0/3087082064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d981555c0 0x7f4d980a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/3087082064 >> 172.21.15.28:0/3087082064 conn(0x7f4d980c7e40 msgr2=0x7f4d980c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:35.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/3087082064 shutdown_connections 2023-12-16T03:26:35.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/3087082064 wait complete. 2023-12-16T03:26:35.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.781+0000 7f4d9dd1d640 1 Processor -- start 2023-12-16T03:26:35.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d9dd1d640 1 -- start start 2023-12-16T03:26:35.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d9dd1d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d980c61e0 0x7f4d9815e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d9dd1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d980c6c70 0x7f4d98151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d9dd1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d981555c0 0x7f4d98151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d9dd1d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98156f10 con 0x7f4d980c61e0 2023-12-16T03:26:35.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d9dd1d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d981571f0 con 0x7f4d981555c0 2023-12-16T03:26:35.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d9dd1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d981524c0 con 0x7f4d980c6c70 2023-12-16T03:26:35.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d977fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d980c61e0 0x7f4d9815e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d977fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d980c61e0 0x7f4d9815e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49030/0 (socket says 172.21.15.28:49030) 2023-12-16T03:26:35.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d977fe640 1 -- 172.21.15.28:0/370584198 learned_addr learned my addr 172.21.15.28:0/370584198 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:35.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d96ffd640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d980c6c70 0x7f4d98151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d97fff640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d981555c0 0x7f4d98151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d977fe640 1 -- 172.21.15.28:0/370584198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d980c6c70 msgr2=0x7f4d98151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d977fe640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d980c6c70 0x7f4d98151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d977fe640 1 -- 172.21.15.28:0/370584198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d981555c0 msgr2=0x7f4d98151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d977fe640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d981555c0 0x7f4d98151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d977fe640 1 -- 172.21.15.28:0/370584198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c0094d0 con 0x7f4d980c61e0 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d97fff640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d981555c0 0x7f4d98151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d977fe640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d980c61e0 0x7f4d9815e9e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800e8a0 tx=0x7f4d8800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d7ffff640 1 -- 172.21.15.28:0/370584198 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88009510 con 0x7f4d980c61e0 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d7ffff640 1 -- 172.21.15.28:0/370584198 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8800c940 con 0x7f4d980c61e0 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d7ffff640 1 -- 172.21.15.28:0/370584198 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8800ccb0 con 0x7f4d980c61e0 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/370584198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d98157680 con 0x7f4d980c61e0 2023-12-16T03:26:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/370584198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d981f1630 con 0x7f4d980c61e0 2023-12-16T03:26:35.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.785+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/370584198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d98068400 con 0x7f4d980c61e0 2023-12-16T03:26:35.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.789+0000 7f4d7ffff640 1 -- 172.21.15.28:0/370584198 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4d88013470 con 0x7f4d980c61e0 2023-12-16T03:26:35.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.789+0000 7f4d7ffff640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d840664a0 0x7f4d84068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:35.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.789+0000 7f4d7ffff640 1 -- 172.21.15.28:0/370584198 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4d880842e0 con 0x7f4d980c61e0 2023-12-16T03:26:35.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.789+0000 7f4d96ffd640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d840664a0 0x7f4d84068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:35.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.789+0000 7f4d96ffd640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d840664a0 0x7f4d84068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0af000 tx=0x7f4d8c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:35.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.793+0000 7f4d7ffff640 1 -- 172.21.15.28:0/370584198 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4d880513f0 con 0x7f4d980c61e0 2023-12-16T03:26:35.897 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:26:35.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:26:35.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.949+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/370584198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f4d980c5fc0 con 0x7f4d980c61e0 2023-12-16T03:26:35.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.949+0000 7f4d7ffff640 1 -- 172.21.15.28:0/370584198 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7f4d88054a10 con 0x7f4d980c61e0 2023-12-16T03:26:35.956 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:26:35.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/370584198 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d840664a0 msgr2=0x7f4d84068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d840664a0 0x7f4d84068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0af000 tx=0x7f4d8c0a7000 comp rx=0 tx=0).stop 2023-12-16T03:26:35.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/370584198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d980c61e0 msgr2=0x7f4d9815e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:35.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d980c61e0 0x7f4d9815e9e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800e8a0 tx=0x7f4d8800eca0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/370584198 shutdown_connections 2023-12-16T03:26:35.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d981555c0 0x7f4d98151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d980c6c70 0x7f4d98151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d840664a0 0x7f4d84068960 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 --2- 172.21.15.28:0/370584198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d980c61e0 0x7f4d9815e9e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:35.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/370584198 >> 172.21.15.28:0/370584198 conn(0x7f4d980c7e40 msgr2=0x7f4d980c1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:35.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/370584198 shutdown_connections 2023-12-16T03:26:35.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:35.953+0000 7f4d9dd1d640 1 -- 172.21.15.28:0/370584198 wait complete. 2023-12-16T03:26:35.978 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:26:36.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.157+0000 7f60d07f5640 1 Processor -- start 2023-12-16T03:26:36.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.157+0000 7f60d07f5640 1 -- start start 2023-12-16T03:26:36.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.157+0000 7f60d07f5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f60c8073a70 0x7f60c80bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60d07f5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c806a5b0 con 0x7f60c8157c20 2023-12-16T03:26:36.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60d07f5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c806b710 con 0x7f60c814b010 2023-12-16T03:26:36.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60d07f5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c80c1d60 con 0x7f60c8073a70 2023-12-16T03:26:36.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60ced92640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f60c8157c20 0x7f60c8158070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45642/0 (socket says 172.21.15.28:45642) 2023-12-16T03:26:36.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60ced92640 1 -- 172.21.15.28:0/3015783372 learned_addr learned my addr 172.21.15.28:0/3015783372 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:36.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60cdd90640 1 --2- 172.21.15.28:0/3015783372 >> v2:172.21.15.134:3300/0 conn(0x7f60c8073a70 0x7f60c80bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60cd58f640 1 -- 172.21.15.28:0/3015783372 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260393323 0 0) 0x7f60c806a5b0 con 0x7f60c8157c20 2023-12-16T03:26:36.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60cd58f640 1 -- 172.21.15.28:0/3015783372 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b4003530 con 0x7f60c8157c20 2023-12-16T03:26:36.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60cdd90640 1 -- 172.21.15.28:0/3015783372 >> v1:172.21.15.134:6789/0 conn(0x7f60c814b010 legacy=0x7f60c806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60cdd90640 1 -- 172.21.15.28:0/3015783372 >> v1:172.21.15.28:6789/0 conn(0x7f60c8157c20 legacy=0x7f60c8158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60cdd90640 1 -- 172.21.15.28:0/3015783372 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c80c2040 con 0x7f60c8073a70 2023-12-16T03:26:36.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.161+0000 7f60cdd90640 1 --2- 172.21.15.28:0/3015783372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8073a70 0x7f60c80bf9f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f60b80097c0 tx=0x7f60b801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d60316ef71bdfef server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:36.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60cd58f640 1 -- 172.21.15.28:0/3015783372 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b80a8970 con 0x7f60c8073a70 2023-12-16T03:26:36.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60cd58f640 1 -- 172.21.15.28:0/3015783372 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b80a8ad0 con 0x7f60c8073a70 2023-12-16T03:26:36.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60cd58f640 1 -- 172.21.15.28:0/3015783372 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b80a8e60 con 0x7f60c8073a70 2023-12-16T03:26:36.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 -- 172.21.15.28:0/3015783372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8073a70 msgr2=0x7f60c80bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 --2- 172.21.15.28:0/3015783372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8073a70 0x7f60c80bf9f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f60b80097c0 tx=0x7f60b801ec70 comp rx=0 tx=0).stop 2023-12-16T03:26:36.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 -- 172.21.15.28:0/3015783372 shutdown_connections 2023-12-16T03:26:36.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 --2- 172.21.15.28:0/3015783372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8073a70 0x7f60c80bf9f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 -- 172.21.15.28:0/3015783372 >> 172.21.15.28:0/3015783372 conn(0x7f60c80c30c0 msgr2=0x7f60c80c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:36.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 -- 172.21.15.28:0/3015783372 shutdown_connections 2023-12-16T03:26:36.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 -- 172.21.15.28:0/3015783372 wait complete. 2023-12-16T03:26:36.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 Processor -- start 2023-12-16T03:26:36.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 -- start start 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60c8073a70 0x7f60c8071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60c814b010 0x7f60c81451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8157c20 0x7f60c8153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8154ae0 con 0x7f60c814b010 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8072b80 con 0x7f60c8157c20 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60d07f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c81ee040 con 0x7f60c8073a70 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60cdd90640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60c814b010 0x7f60c81451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60cdd90640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60c814b010 0x7f60c81451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49040/0 (socket says 172.21.15.28:49040) 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60cdd90640 1 -- 172.21.15.28:0/2440408829 learned_addr learned my addr 172.21.15.28:0/2440408829 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.165+0000 7f60ce591640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60c8073a70 0x7f60c8071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60ced92640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8157c20 0x7f60c8153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60cdd90640 1 -- 172.21.15.28:0/2440408829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60c8073a70 msgr2=0x7f60c8071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60cdd90640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60c8073a70 0x7f60c8071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60cdd90640 1 -- 172.21.15.28:0/2440408829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8157c20 msgr2=0x7f60c8153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60cdd90640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8157c20 0x7f60c8153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60cdd90640 1 -- 172.21.15.28:0/2440408829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8009420 con 0x7f60c814b010 2023-12-16T03:26:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60cdd90640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60c814b010 0x7f60c81451b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f60b80b3040 tx=0x7f60b801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60beffd640 1 -- 172.21.15.28:0/2440408829 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b80b9630 con 0x7f60c814b010 2023-12-16T03:26:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60beffd640 1 -- 172.21.15.28:0/2440408829 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b80b97b0 con 0x7f60c814b010 2023-12-16T03:26:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60d07f5640 1 -- 172.21.15.28:0/2440408829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c81ed150 con 0x7f60c814b010 2023-12-16T03:26:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60beffd640 1 -- 172.21.15.28:0/2440408829 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b80b9b60 con 0x7f60c814b010 2023-12-16T03:26:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60d07f5640 1 -- 172.21.15.28:0/2440408829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c81ed710 con 0x7f60c814b010 2023-12-16T03:26:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60d07f5640 1 -- 172.21.15.28:0/2440408829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c8143f60 con 0x7f60c814b010 2023-12-16T03:26:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.169+0000 7f60beffd640 1 -- 172.21.15.28:0/2440408829 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f60b80b7040 con 0x7f60c814b010 2023-12-16T03:26:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.173+0000 7f60beffd640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ac066470 0x7f60ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.173+0000 7f60beffd640 1 -- 172.21.15.28:0/2440408829 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f60b81220e0 con 0x7f60c814b010 2023-12-16T03:26:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.173+0000 7f60ce591640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ac066470 0x7f60ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.173+0000 7f60ce591640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ac066470 0x7f60ac068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f60c4007fd0 tx=0x7f60c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:36.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.177+0000 7f60beffd640 1 -- 172.21.15.28:0/2440408829 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f60b80ef1f0 con 0x7f60c814b010 2023-12-16T03:26:36.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.341+0000 7f60d07f5640 1 -- 172.21.15.28:0/2440408829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f60c8068400 con 0x7f60c814b010 2023-12-16T03:26:36.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60beffd640 1 -- 172.21.15.28:0/2440408829 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f60b80f2810 con 0x7f60c814b010 2023-12-16T03:26:36.349 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:26:36.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 -- 172.21.15.28:0/2440408829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ac066470 msgr2=0x7f60ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ac066470 0x7f60ac068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f60c4007fd0 tx=0x7f60c4009040 comp rx=0 tx=0).stop 2023-12-16T03:26:36.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 -- 172.21.15.28:0/2440408829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60c814b010 msgr2=0x7f60c81451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60c814b010 0x7f60c81451b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f60b80b3040 tx=0x7f60b801ba10 comp rx=0 tx=0).stop 2023-12-16T03:26:36.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 -- 172.21.15.28:0/2440408829 shutdown_connections 2023-12-16T03:26:36.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8157c20 0x7f60c8153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f60ac066470 0x7f60ac068930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60c814b010 0x7f60c81451b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 --2- 172.21.15.28:0/2440408829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60c8073a70 0x7f60c8071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 -- 172.21.15.28:0/2440408829 >> 172.21.15.28:0/2440408829 conn(0x7f60c80c30c0 msgr2=0x7f60c80c0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:36.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 -- 172.21.15.28:0/2440408829 shutdown_connections 2023-12-16T03:26:36.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.345+0000 7f60d07f5640 1 -- 172.21.15.28:0/2440408829 wait complete. 2023-12-16T03:26:36.370 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-16T03:26:36.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:36.371 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-16T03:26:36.401 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:26:36.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:26:36.401 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T03:26:36.459 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:26:36.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.597+0000 7f7984de6640 1 Processor -- start 2023-12-16T03:26:36.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.597+0000 7f7984de6640 1 -- start start 2023-12-16T03:26:36.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.597+0000 7f7984de6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79801578f0 0x7f79800c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.597+0000 7f7984de6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79800c2840 0x7f79800c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.597+0000 7f7984de6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7980157cd0 con 0x7f79800a6c60 2023-12-16T03:26:36.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.597+0000 7f7984de6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79800c2e00 con 0x7f79800c2840 2023-12-16T03:26:36.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.597+0000 7f7984de6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7980158850 con 0x7f79801578f0 2023-12-16T03:26:36.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.597+0000 7f797ed9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79800c2840 0x7f79800c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.597+0000 7f797e59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79801578f0 0x7f79800c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.601+0000 7f797dd9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f79800a6c60 0x7f79800c1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:36470/0 (socket says 172.21.15.28:36470) 2023-12-16T03:26:36.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.601+0000 7f797dd9b640 1 -- 172.21.15.28:0/3573300297 learned_addr learned my addr 172.21.15.28:0/3573300297 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:36.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.601+0000 7f797ed9d640 1 -- 172.21.15.28:0/3573300297 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79801578f0 msgr2=0x7f79800c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:36.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.601+0000 7f797ed9d640 1 --2- 172.21.15.28:0/3573300297 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79801578f0 0x7f79800c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.601+0000 7f797ed9d640 1 -- 172.21.15.28:0/3573300297 >> v1:172.21.15.134:6789/0 conn(0x7f79800a6c60 legacy=0x7f79800c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.601+0000 7f797ed9d640 1 -- 172.21.15.28:0/3573300297 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7980157f20 con 0x7f79800c2840 2023-12-16T03:26:36.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.601+0000 7f797ed9d640 1 --2- 172.21.15.28:0/3573300297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800c2840 0x7f79800c3620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7978009d90 tx=0x7f797801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92de8dd3d6eadd7a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:36.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.601+0000 7f797d59a640 1 -- 172.21.15.28:0/3573300297 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79780a5890 con 0x7f79800c2840 2023-12-16T03:26:36.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.601+0000 7f797d59a640 1 -- 172.21.15.28:0/3573300297 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79780a59f0 con 0x7f79800c2840 2023-12-16T03:26:36.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.601+0000 7f797d59a640 1 -- 172.21.15.28:0/3573300297 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79780a5d80 con 0x7f79800c2840 2023-12-16T03:26:36.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 -- 172.21.15.28:0/3573300297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800c2840 msgr2=0x7f79800c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 --2- 172.21.15.28:0/3573300297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800c2840 0x7f79800c3620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7978009d90 tx=0x7f797801c8c0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 -- 172.21.15.28:0/3573300297 shutdown_connections 2023-12-16T03:26:36.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 --2- 172.21.15.28:0/3573300297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800c2840 0x7f79800c3620 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 --2- 172.21.15.28:0/3573300297 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79801578f0 0x7f79800c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 -- 172.21.15.28:0/3573300297 >> 172.21.15.28:0/3573300297 conn(0x7f79800c7e40 msgr2=0x7f79800c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:36.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 -- 172.21.15.28:0/3573300297 shutdown_connections 2023-12-16T03:26:36.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 -- 172.21.15.28:0/3573300297 wait complete. 2023-12-16T03:26:36.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 Processor -- start 2023-12-16T03:26:36.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 -- start start 2023-12-16T03:26:36.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800a6c60 0x7f79801496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79800c2840 0x7f7980149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79801578f0 0x7f798014b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798014a170 con 0x7f79801578f0 2023-12-16T03:26:36.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798014d850 con 0x7f79800a6c60 2023-12-16T03:26:36.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f7984de6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798014a600 con 0x7f79800c2840 2023-12-16T03:26:36.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f797e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800a6c60 0x7f79801496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f797dd9b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79800c2840 0x7f7980149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f797ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79801578f0 0x7f798014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f797e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800a6c60 0x7f79801496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:36946/0 (socket says 172.21.15.28:36946) 2023-12-16T03:26:36.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.605+0000 7f797e59c640 1 -- 172.21.15.28:0/2034532722 learned_addr learned my addr 172.21.15.28:0/2034532722 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:36.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f797ed9d640 1 -- 172.21.15.28:0/2034532722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79800c2840 msgr2=0x7f7980149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f797ed9d640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79800c2840 0x7f7980149c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f797ed9d640 1 -- 172.21.15.28:0/2034532722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800a6c60 msgr2=0x7f79801496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f797ed9d640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800a6c60 0x7f79801496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f797ed9d640 1 -- 172.21.15.28:0/2034532722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978009a70 con 0x7f79801578f0 2023-12-16T03:26:36.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f797ed9d640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79801578f0 0x7f798014b640 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f79780ac000 tx=0x7f7978019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:36.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f796effd640 1 -- 172.21.15.28:0/2034532722 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79780b9650 con 0x7f79801578f0 2023-12-16T03:26:36.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f796effd640 1 -- 172.21.15.28:0/2034532722 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79780b97b0 con 0x7f79801578f0 2023-12-16T03:26:36.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f7984de6640 1 -- 172.21.15.28:0/2034532722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798014ffd0 con 0x7f79801578f0 2023-12-16T03:26:36.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f796effd640 1 -- 172.21.15.28:0/2034532722 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79780b9b40 con 0x7f79801578f0 2023-12-16T03:26:36.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f7984de6640 1 -- 172.21.15.28:0/2034532722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7980150590 con 0x7f79801578f0 2023-12-16T03:26:36.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f7984de6640 1 -- 172.21.15.28:0/2034532722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79800c7c10 con 0x7f79801578f0 2023-12-16T03:26:36.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f796effd640 1 -- 172.21.15.28:0/2034532722 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f79780b9ca0 con 0x7f79801578f0 2023-12-16T03:26:36.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f796effd640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7960066470 0x7f7960068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.609+0000 7f796effd640 1 -- 172.21.15.28:0/2034532722 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f797811f3f0 con 0x7f79801578f0 2023-12-16T03:26:36.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.613+0000 7f797e59c640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7960066470 0x7f7960068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.613+0000 7f797e59c640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7960066470 0x7f7960068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7970009b80 tx=0x7f7970009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:36.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.613+0000 7f796effd640 1 -- 172.21.15.28:0/2034532722 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f79780ec530 con 0x7f79801578f0 2023-12-16T03:26:36.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 -- 172.21.15.28:0/2034532722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7980068400 con 0x7f79801578f0 2023-12-16T03:26:36.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f796effd640 1 -- 172.21.15.28:0/2034532722 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6183 (secure 0 0 0) 0x7f79780efb50 con 0x7f79801578f0 2023-12-16T03:26:36.811 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:36.811 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3378969769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3378969769},{"type":"v1","addr":"172.21.15.134:6835","nonce":3378969769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2794220220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2794220220},{"type":"v1","addr":"172.21.15.134:6834","nonce":2794220220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:02.836620+0000","modified":"2023-12-16T03:26:05.858917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.28:6837/1004873879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1004873879},{"type":"v1","addr":"172.21.15.28:6837","nonce":1004873879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:19.999425+0000","modified":"2023-12-16T03:26:22.999486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5010":{"gid":5010,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.28:6836/664267694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":664267694},{"type":"v1","addr":"172.21.15.28:6836","nonce":664267694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-16T03:26:36.811 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 21 2023-12-16T03:26:36.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 -- 172.21.15.28:0/2034532722 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7960066470 msgr2=0x7f7960068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7960066470 0x7f7960068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7970009b80 tx=0x7f7970009190 comp rx=0 tx=0).stop 2023-12-16T03:26:36.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 -- 172.21.15.28:0/2034532722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79801578f0 msgr2=0x7f798014b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79801578f0 0x7f798014b640 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f79780ac000 tx=0x7f7978019660 comp rx=0 tx=0).stop 2023-12-16T03:26:36.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 -- 172.21.15.28:0/2034532722 shutdown_connections 2023-12-16T03:26:36.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7960066470 0x7f7960068930 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79801578f0 0x7f798014b640 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79800c2840 0x7f7980149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 --2- 172.21.15.28:0/2034532722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800a6c60 0x7f79801496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 -- 172.21.15.28:0/2034532722 >> 172.21.15.28:0/2034532722 conn(0x7f79800c7e40 msgr2=0x7f7980156790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:36.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 -- 172.21.15.28:0/2034532722 shutdown_connections 2023-12-16T03:26:36.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.805+0000 7f7984de6640 1 -- 172.21.15.28:0/2034532722 wait complete. 2023-12-16T03:26:36.832 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:36.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef1131d640 1 Processor -- start 2023-12-16T03:26:36.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef1131d640 1 -- start start 2023-12-16T03:26:36.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef1131d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fef0c1578f0 0x7fef0c0c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef1131d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fef0c0a6c60 0x7fef0c0c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef1131d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef0c0c2840 0x7fef0c0c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef1131d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0c0c2e00 con 0x7fef0c0a6c60 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef1131d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0c157cd0 con 0x7fef0c1578f0 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef1131d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c158850 con 0x7fef0c0c2840 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef0a7fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fef0c0a6c60 0x7fef0c0c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef0a7fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fef0c0a6c60 0x7fef0c0c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49066/0 (socket says 172.21.15.28:49066) 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef0a7fc640 1 -- 172.21.15.28:0/1164240161 learned_addr learned my addr 172.21.15.28:0/1164240161 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef0b7fe640 1 --2- 172.21.15.28:0/1164240161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef0c0c2840 0x7fef0c0c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef0affd640 1 --2- 172.21.15.28:0/1164240161 >> v2:172.21.15.134:3300/0 conn(0x7fef0c1578f0 0x7fef0c0c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef0a7fc640 1 -- 172.21.15.28:0/1164240161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef0c0c2840 msgr2=0x7fef0c0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef0a7fc640 1 --2- 172.21.15.28:0/1164240161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef0c0c2840 0x7fef0c0c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef0a7fc640 1 -- 172.21.15.28:0/1164240161 >> v2:172.21.15.134:3300/0 conn(0x7fef0c1578f0 msgr2=0x7fef0c0c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef0a7fc640 1 --2- 172.21.15.28:0/1164240161 >> v2:172.21.15.134:3300/0 conn(0x7fef0c1578f0 0x7fef0c0c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.969+0000 7fef0a7fc640 1 -- 172.21.15.28:0/1164240161 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c157f20 con 0x7fef0c0a6c60 2023-12-16T03:26:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef0a7fc640 1 --2- 172.21.15.28:0/1164240161 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef0c0a6c60 0x7fef0c0c3620 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0c7be0 tx=0x7fef0001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5347146af20003f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef09ffb640 1 -- 172.21.15.28:0/1164240161 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef000ab600 con 0x7fef0c0a6c60 2023-12-16T03:26:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef09ffb640 1 -- 172.21.15.28:0/1164240161 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef000a7050 con 0x7fef0c0a6c60 2023-12-16T03:26:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef09ffb640 1 -- 172.21.15.28:0/1164240161 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef000ab980 con 0x7fef0c0a6c60 2023-12-16T03:26:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef1131d640 1 -- 172.21.15.28:0/1164240161 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef0c0a6c60 msgr2=0x7fef0c0c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef1131d640 1 --2- 172.21.15.28:0/1164240161 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef0c0a6c60 0x7fef0c0c3620 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0c7be0 tx=0x7fef0001c470 comp rx=0 tx=0).stop 2023-12-16T03:26:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef1131d640 1 -- 172.21.15.28:0/1164240161 shutdown_connections 2023-12-16T03:26:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef1131d640 1 --2- 172.21.15.28:0/1164240161 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef0c0c2840 0x7fef0c0c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef1131d640 1 --2- 172.21.15.28:0/1164240161 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef0c0a6c60 0x7fef0c0c3620 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef1131d640 1 --2- 172.21.15.28:0/1164240161 >> v2:172.21.15.134:3300/0 conn(0x7fef0c1578f0 0x7fef0c0c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef1131d640 1 -- 172.21.15.28:0/1164240161 >> 172.21.15.28:0/1164240161 conn(0x7fef0c0c7e40 msgr2=0x7fef0c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef1131d640 1 -- 172.21.15.28:0/1164240161 shutdown_connections 2023-12-16T03:26:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.973+0000 7fef1131d640 1 -- 172.21.15.28:0/1164240161 wait complete. 2023-12-16T03:26:36.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef1131d640 1 Processor -- start 2023-12-16T03:26:36.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef1131d640 1 -- start start 2023-12-16T03:26:36.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef1131d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef0c0a6c60 0x7fef0c0ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef1131d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef0c0c2840 0x7fef0c0ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef1131d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef0c1578f0 0x7fef0c1ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef1131d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c14c4d0 con 0x7fef0c0c2840 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef1131d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c14bfc0 con 0x7fef0c0a6c60 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef1131d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0ab7e0 con 0x7fef0c1578f0 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0a7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef0c0c2840 0x7fef0c0ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0a7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef0c0c2840 0x7fef0c0ab2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49068/0 (socket says 172.21.15.28:49068) 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0a7fc640 1 -- 172.21.15.28:0/2977116395 learned_addr learned my addr 172.21.15.28:0/2977116395 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0affd640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef0c0a6c60 0x7fef0c0ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0b7fe640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef0c1578f0 0x7fef0c1ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0a7fc640 1 -- 172.21.15.28:0/2977116395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef0c1578f0 msgr2=0x7fef0c1ed150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0a7fc640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef0c1578f0 0x7fef0c1ed150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0a7fc640 1 -- 172.21.15.28:0/2977116395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef0c0a6c60 msgr2=0x7fef0c0ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0a7fc640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef0c0a6c60 0x7fef0c0ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0a7fc640 1 -- 172.21.15.28:0/2977116395 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000094d0 con 0x7fef0c0c2840 2023-12-16T03:26:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0affd640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef0c0a6c60 0x7fef0c0ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:36.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef0a7fc640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef0c0c2840 0x7fef0c0ab2a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fef0001cd10 tx=0x7fef00019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:36.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7feef37fe640 1 -- 172.21.15.28:0/2977116395 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef000b37d0 con 0x7fef0c0c2840 2023-12-16T03:26:36.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7feef37fe640 1 -- 172.21.15.28:0/2977116395 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef000b3930 con 0x7fef0c0c2840 2023-12-16T03:26:36.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7feef37fe640 1 -- 172.21.15.28:0/2977116395 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef000b3cc0 con 0x7fef0c0c2840 2023-12-16T03:26:36.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef1131d640 1 -- 172.21.15.28:0/2977116395 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0c06ea10 con 0x7fef0c0c2840 2023-12-16T03:26:36.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.977+0000 7fef1131d640 1 -- 172.21.15.28:0/2977116395 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c06efd0 con 0x7fef0c0c2840 2023-12-16T03:26:36.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.981+0000 7fef1131d640 1 -- 172.21.15.28:0/2977116395 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0c0c7c10 con 0x7fef0c0c2840 2023-12-16T03:26:36.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.981+0000 7feef37fe640 1 -- 172.21.15.28:0/2977116395 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fef000b2070 con 0x7fef0c0c2840 2023-12-16T03:26:36.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.981+0000 7feef37fe640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feef80664a0 0x7feef8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:36.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.981+0000 7feef37fe640 1 -- 172.21.15.28:0/2977116395 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fef0011e5c0 con 0x7fef0c0c2840 2023-12-16T03:26:36.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.981+0000 7fef0affd640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feef80664a0 0x7feef8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:36.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.981+0000 7fef0affd640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feef80664a0 0x7feef8068960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feefc00b9f0 tx=0x7feefc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:36.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:36.985+0000 7feef37fe640 1 -- 172.21.15.28:0/2977116395 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fef000eb640 con 0x7fef0c0c2840 2023-12-16T03:26:37.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.145+0000 7fef1131d640 1 -- 172.21.15.28:0/2977116395 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef0c068400 con 0x7fef0c0c2840 2023-12-16T03:26:37.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.145+0000 7feef37fe640 1 -- 172.21.15.28:0/2977116395 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20229 (secure 0 0 0) 0x7fef000eec60 con 0x7fef0c0c2840 2023-12-16T03:26:37.151 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:37.152 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:21.432053+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:37.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 -- 172.21.15.28:0/2977116395 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feef80664a0 msgr2=0x7feef8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feef80664a0 0x7feef8068960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feefc00b9f0 tx=0x7feefc008040 comp rx=0 tx=0).stop 2023-12-16T03:26:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 -- 172.21.15.28:0/2977116395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef0c0c2840 msgr2=0x7fef0c0ab2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef0c0c2840 0x7fef0c0ab2a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fef0001cd10 tx=0x7fef00019210 comp rx=0 tx=0).stop 2023-12-16T03:26:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 -- 172.21.15.28:0/2977116395 shutdown_connections 2023-12-16T03:26:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef0c1578f0 0x7fef0c1ed150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feef80664a0 0x7feef8068960 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef0c0c2840 0x7fef0c0ab2a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 --2- 172.21.15.28:0/2977116395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef0c0a6c60 0x7fef0c0ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 -- 172.21.15.28:0/2977116395 >> 172.21.15.28:0/2977116395 conn(0x7fef0c0c7e40 msgr2=0x7fef0c0c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 -- 172.21.15.28:0/2977116395 shutdown_connections 2023-12-16T03:26:37.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.149+0000 7fef1131d640 1 -- 172.21.15.28:0/2977116395 wait complete. 2023-12-16T03:26:37.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:26:00.659571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:26:01.837383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:26:18.527469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:26:18.979011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:26:37.174 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:26:37.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.313+0000 7f9547daa640 1 Processor -- start 2023-12-16T03:26:37.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.313+0000 7f9547daa640 1 -- start start 2023-12-16T03:26:37.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.313+0000 7f9547daa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f95400c4100 0x7f95400c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9547daa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95400c06d0 0x7f95400a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9547daa640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95400c31c0 con 0x7f95400c63c0 2023-12-16T03:26:37.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9547daa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95400c34a0 con 0x7f95400c4100 2023-12-16T03:26:37.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9547daa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95400c1030 con 0x7f95400c06d0 2023-12-16T03:26:37.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9545b46640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f95400c63c0 0x7f95400c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45648/0 (socket says 172.21.15.28:45648) 2023-12-16T03:26:37.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9545b46640 1 -- 172.21.15.28:0/207869546 learned_addr learned my addr 172.21.15.28:0/207869546 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:37.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9545345640 1 --2- 172.21.15.28:0/207869546 >> v2:172.21.15.28:3300/0 conn(0x7f95400c4100 0x7f95400c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9546347640 1 --2- 172.21.15.28:0/207869546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95400c06d0 0x7f95400a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9544b44640 1 -- 172.21.15.28:0/207869546 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005330675 0 0) 0x7f95400c31c0 con 0x7f95400c63c0 2023-12-16T03:26:37.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9544b44640 1 -- 172.21.15.28:0/207869546 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f952c003530 con 0x7f95400c63c0 2023-12-16T03:26:37.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9545345640 1 -- 172.21.15.28:0/207869546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95400c06d0 msgr2=0x7f95400a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:37.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9545345640 1 --2- 172.21.15.28:0/207869546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95400c06d0 0x7f95400a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9545345640 1 -- 172.21.15.28:0/207869546 >> v1:172.21.15.28:6789/0 conn(0x7f95400c63c0 legacy=0x7f95400c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9545345640 1 -- 172.21.15.28:0/207869546 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95400c1310 con 0x7f95400c4100 2023-12-16T03:26:37.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9545345640 1 --2- 172.21.15.28:0/207869546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95400c4100 0x7f95400c2bb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f95300097c0 tx=0x7f953001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefb092eca471963 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:37.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9544b44640 1 -- 172.21.15.28:0/207869546 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400aa3d0 con 0x7f95400c4100 2023-12-16T03:26:37.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9544b44640 1 -- 172.21.15.28:0/207869546 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95300a7050 con 0x7f95400c4100 2023-12-16T03:26:37.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.317+0000 7f9544b44640 1 -- 172.21.15.28:0/207869546 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95300ab800 con 0x7f95400c4100 2023-12-16T03:26:37.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 -- 172.21.15.28:0/207869546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95400c4100 msgr2=0x7f95400c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 --2- 172.21.15.28:0/207869546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95400c4100 0x7f95400c2bb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f95300097c0 tx=0x7f953001c360 comp rx=0 tx=0).stop 2023-12-16T03:26:37.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 -- 172.21.15.28:0/207869546 shutdown_connections 2023-12-16T03:26:37.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 --2- 172.21.15.28:0/207869546 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95400c06d0 0x7f95400a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 --2- 172.21.15.28:0/207869546 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95400c4100 0x7f95400c2bb0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 -- 172.21.15.28:0/207869546 >> 172.21.15.28:0/207869546 conn(0x7f954006a5b0 msgr2=0x7f954006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:37.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 -- 172.21.15.28:0/207869546 shutdown_connections 2023-12-16T03:26:37.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 -- 172.21.15.28:0/207869546 wait complete. 2023-12-16T03:26:37.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 Processor -- start 2023-12-16T03:26:37.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 -- start start 2023-12-16T03:26:37.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95400c06d0 0x7f954009c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95400c4100 0x7f9540155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95400c63c0 0x7f95401efd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9540155970 con 0x7f95400c06d0 2023-12-16T03:26:37.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95401f0650 con 0x7f95400c4100 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9547daa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95401ee4c0 con 0x7f95400c63c0 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9545b46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95400c06d0 0x7f954009c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9545b46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95400c06d0 0x7f954009c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49098/0 (socket says 172.21.15.28:49098) 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9545b46640 1 -- 172.21.15.28:0/497732155 learned_addr learned my addr 172.21.15.28:0/497732155 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9546347640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95400c63c0 0x7f95401efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.321+0000 7f9545345640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95400c4100 0x7f9540155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f9545b46640 1 -- 172.21.15.28:0/497732155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95400c63c0 msgr2=0x7f95401efd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f9545b46640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95400c63c0 0x7f95401efd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f9545b46640 1 -- 172.21.15.28:0/497732155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95400c4100 msgr2=0x7f9540155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f9545b46640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95400c4100 0x7f9540155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f9545b46640 1 -- 172.21.15.28:0/497732155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530009420 con 0x7f95400c06d0 2023-12-16T03:26:37.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f9545b46640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95400c06d0 0x7f954009c780 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f953c00c3c0 tx=0x7f953c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:37.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f95367fc640 1 -- 172.21.15.28:0/497732155 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c005cf0 con 0x7f95400c06d0 2023-12-16T03:26:37.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f95367fc640 1 -- 172.21.15.28:0/497732155 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c005e50 con 0x7f95400c06d0 2023-12-16T03:26:37.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f95367fc640 1 -- 172.21.15.28:0/497732155 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c0072f0 con 0x7f95400c06d0 2023-12-16T03:26:37.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f9547daa640 1 -- 172.21.15.28:0/497732155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95401ee7a0 con 0x7f95400c06d0 2023-12-16T03:26:37.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f9547daa640 1 -- 172.21.15.28:0/497732155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95401550c0 con 0x7f95400c06d0 2023-12-16T03:26:37.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f9547daa640 1 -- 172.21.15.28:0/497732155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9540068400 con 0x7f95400c06d0 2023-12-16T03:26:37.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f95367fc640 1 -- 172.21.15.28:0/497732155 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f953c007450 con 0x7f95400c06d0 2023-12-16T03:26:37.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f95367fc640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9524066470 0x7f9524068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f95367fc640 1 -- 172.21.15.28:0/497732155 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f953c0837d0 con 0x7f95400c06d0 2023-12-16T03:26:37.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.325+0000 7f9545345640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9524066470 0x7f9524068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.329+0000 7f9545345640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9524066470 0x7f9524068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f95300ad000 tx=0x7f9530008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:37.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.329+0000 7f95367fc640 1 -- 172.21.15.28:0/497732155 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f953c0508e0 con 0x7f95400c06d0 2023-12-16T03:26:37.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.489+0000 7f9547daa640 1 -- 172.21.15.28:0/497732155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95400c3e50 con 0x7f95400c06d0 2023-12-16T03:26:37.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.489+0000 7f95367fc640 1 -- 172.21.15.28:0/497732155 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f953c0170a0 con 0x7f95400c06d0 2023-12-16T03:26:37.497 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 -- 172.21.15.28:0/497732155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9524066470 msgr2=0x7f9524068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9524066470 0x7f9524068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f95300ad000 tx=0x7f9530008040 comp rx=0 tx=0).stop 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 -- 172.21.15.28:0/497732155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95400c06d0 msgr2=0x7f954009c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95400c06d0 0x7f954009c780 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f953c00c3c0 tx=0x7f953c00c880 comp rx=0 tx=0).stop 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 -- 172.21.15.28:0/497732155 shutdown_connections 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95400c63c0 0x7f95401efd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95400c4100 0x7f9540155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9524066470 0x7f9524068930 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 --2- 172.21.15.28:0/497732155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95400c06d0 0x7f954009c780 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 -- 172.21.15.28:0/497732155 >> 172.21.15.28:0/497732155 conn(0x7f954006a5b0 msgr2=0x7f9540071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 -- 172.21.15.28:0/497732155 shutdown_connections 2023-12-16T03:26:37.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.493+0000 7f9547daa640 1 -- 172.21.15.28:0/497732155 wait complete. 2023-12-16T03:26:37.518 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:26:37.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.657+0000 7fcffde17640 1 Processor -- start 2023-12-16T03:26:37.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.657+0000 7fcffde17640 1 -- start start 2023-12-16T03:26:37.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffde17640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcff806d990 0x7fcff80c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffde17640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcff8154b20 0x7fcff806c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffde17640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff80c1e30 con 0x7fcff81546c0 2023-12-16T03:26:37.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffde17640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff8154f50 con 0x7fcff806d990 2023-12-16T03:26:37.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffde17640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff806dd70 con 0x7fcff8154b20 2023-12-16T03:26:37.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffce15640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcff806d990 0x7fcff80c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcff7fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcff81546c0 0x7fcff806c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45664/0 (socket says 172.21.15.28:45664) 2023-12-16T03:26:37.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffce15640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcff806d990 0x7fcff80c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49108/0 (socket says 172.21.15.28:49108) 2023-12-16T03:26:37.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcff7fff640 1 -- 172.21.15.28:0/430312826 learned_addr learned my addr 172.21.15.28:0/430312826 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:37.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffd616640 1 --2- 172.21.15.28:0/430312826 >> v2:172.21.15.134:3300/0 conn(0x7fcff8154b20 0x7fcff806c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffce15640 1 -- 172.21.15.28:0/430312826 >> v2:172.21.15.134:3300/0 conn(0x7fcff8154b20 msgr2=0x7fcff806c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:37.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffce15640 1 --2- 172.21.15.28:0/430312826 >> v2:172.21.15.134:3300/0 conn(0x7fcff8154b20 0x7fcff806c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffce15640 1 -- 172.21.15.28:0/430312826 >> v1:172.21.15.28:6789/0 conn(0x7fcff81546c0 legacy=0x7fcff806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffce15640 1 -- 172.21.15.28:0/430312826 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff80c1220 con 0x7fcff806d990 2023-12-16T03:26:37.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcffd616640 1 --2- 172.21.15.28:0/430312826 >> v2:172.21.15.134:3300/0 conn(0x7fcff8154b20 0x7fcff806c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:37.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.661+0000 7fcff77fe640 1 -- 172.21.15.28:0/430312826 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851693365 0 0) 0x7fcff80c1e30 con 0x7fcff81546c0 2023-12-16T03:26:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffce15640 1 --2- 172.21.15.28:0/430312826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcff806d990 0x7fcff80c5360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcff806b5e0 tx=0x7fcfec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803ee375c0952f8e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcff77fe640 1 -- 172.21.15.28:0/430312826 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec004230 con 0x7fcff806d990 2023-12-16T03:26:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcff77fe640 1 -- 172.21.15.28:0/430312826 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec0a7050 con 0x7fcff806d990 2023-12-16T03:26:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcff77fe640 1 -- 172.21.15.28:0/430312826 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec003620 con 0x7fcff806d990 2023-12-16T03:26:37.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 -- 172.21.15.28:0/430312826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcff806d990 msgr2=0x7fcff80c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 --2- 172.21.15.28:0/430312826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcff806d990 0x7fcff80c5360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcff806b5e0 tx=0x7fcfec01c460 comp rx=0 tx=0).stop 2023-12-16T03:26:37.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 -- 172.21.15.28:0/430312826 shutdown_connections 2023-12-16T03:26:37.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 --2- 172.21.15.28:0/430312826 >> v2:172.21.15.134:3300/0 conn(0x7fcff8154b20 0x7fcff806c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 --2- 172.21.15.28:0/430312826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcff806d990 0x7fcff80c5360 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 -- 172.21.15.28:0/430312826 >> 172.21.15.28:0/430312826 conn(0x7fcff80a7800 msgr2=0x7fcff80a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:37.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 -- 172.21.15.28:0/430312826 shutdown_connections 2023-12-16T03:26:37.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 -- 172.21.15.28:0/430312826 wait complete. 2023-12-16T03:26:37.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 Processor -- start 2023-12-16T03:26:37.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 -- start start 2023-12-16T03:26:37.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcff806d990 0x7fcff80bdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcff81546c0 0x7fcff814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcff8154b20 0x7fcff8149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff81ec4b0 con 0x7fcff81546c0 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff806ca50 con 0x7fcff806d990 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.665+0000 7fcffde17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80be360 con 0x7fcff8154b20 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcff81546c0 0x7fcff814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcff81546c0 0x7fcff814f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49122/0 (socket says 172.21.15.28:49122) 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff7fff640 1 -- 172.21.15.28:0/4150531322 learned_addr learned my addr 172.21.15.28:0/4150531322 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcffce15640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcff806d990 0x7fcff80bdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcffd616640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcff8154b20 0x7fcff8149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff7fff640 1 -- 172.21.15.28:0/4150531322 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcff8154b20 msgr2=0x7fcff8149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff7fff640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcff8154b20 0x7fcff8149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff7fff640 1 -- 172.21.15.28:0/4150531322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcff806d990 msgr2=0x7fcff80bdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff7fff640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcff806d990 0x7fcff80bdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff7fff640 1 -- 172.21.15.28:0/4150531322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec009420 con 0x7fcff81546c0 2023-12-16T03:26:37.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcffd616640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcff8154b20 0x7fcff8149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:37.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff7fff640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcff81546c0 0x7fcff814f680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40011f0 tx=0x7fcfe400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:37.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff57fa640 1 -- 172.21.15.28:0/4150531322 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40074e0 con 0x7fcff81546c0 2023-12-16T03:26:37.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff57fa640 1 -- 172.21.15.28:0/4150531322 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe4007640 con 0x7fcff81546c0 2023-12-16T03:26:37.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcffde17640 1 -- 172.21.15.28:0/4150531322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff81ec6c0 con 0x7fcff81546c0 2023-12-16T03:26:37.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff57fa640 1 -- 172.21.15.28:0/4150531322 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4004a10 con 0x7fcff81546c0 2023-12-16T03:26:37.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcffde17640 1 -- 172.21.15.28:0/4150531322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff81ecc80 con 0x7fcff81546c0 2023-12-16T03:26:37.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcffde17640 1 -- 172.21.15.28:0/4150531322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff804e850 con 0x7fcff81546c0 2023-12-16T03:26:37.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.669+0000 7fcff57fa640 1 -- 172.21.15.28:0/4150531322 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcfe4004b70 con 0x7fcff81546c0 2023-12-16T03:26:37.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.673+0000 7fcff57fa640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcfdc066470 0x7fcfdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:37.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.673+0000 7fcff57fa640 1 -- 172.21.15.28:0/4150531322 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcfe40836d0 con 0x7fcff81546c0 2023-12-16T03:26:37.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.673+0000 7fcffce15640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcfdc066470 0x7fcfdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:37.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.673+0000 7fcffce15640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcfdc066470 0x7fcfdc068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ad000 tx=0x7fcfec0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:37.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.673+0000 7fcff57fa640 1 -- 172.21.15.28:0/4150531322 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcfe4050890 con 0x7fcff81546c0 2023-12-16T03:26:37.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.833+0000 7fcffde17640 1 -- 172.21.15.28:0/4150531322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcff80c21b0 con 0x7fcff81546c0 2023-12-16T03:26:37.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.833+0000 7fcff57fa640 1 -- 172.21.15.28:0/4150531322 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcfe4053eb0 con 0x7fcff81546c0 2023-12-16T03:26:37.840 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:26:37.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 -- 172.21.15.28:0/4150531322 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcfdc066470 msgr2=0x7fcfdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcfdc066470 0x7fcfdc068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ad000 tx=0x7fcfec0a6000 comp rx=0 tx=0).stop 2023-12-16T03:26:37.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 -- 172.21.15.28:0/4150531322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcff81546c0 msgr2=0x7fcff814f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:37.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcff81546c0 0x7fcff814f680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40011f0 tx=0x7fcfe400c9b0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 -- 172.21.15.28:0/4150531322 shutdown_connections 2023-12-16T03:26:37.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcff8154b20 0x7fcff8149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcfdc066470 0x7fcfdc068930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcff81546c0 0x7fcff814f680 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 --2- 172.21.15.28:0/4150531322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcff806d990 0x7fcff80bdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:37.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 -- 172.21.15.28:0/4150531322 >> 172.21.15.28:0/4150531322 conn(0x7fcff80a7800 msgr2=0x7fcff80ab670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:37.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 -- 172.21.15.28:0/4150531322 shutdown_connections 2023-12-16T03:26:37.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:37.837+0000 7fcffde17640 1 -- 172.21.15.28:0/4150531322 wait complete. 2023-12-16T03:26:37.862 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:26:38.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef0b5f5640 1 Processor -- start 2023-12-16T03:26:38.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef0b5f5640 1 -- start start 2023-12-16T03:26:38.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef0b5f5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fef040c6050 0x7fef040c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef0b5f5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fef04155730 0x7fef040c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef0b5f5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef040c6bc0 con 0x7fef040c31c0 2023-12-16T03:26:38.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef0b5f5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef040c8d90 con 0x7fef040c6050 2023-12-16T03:26:38.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef0b5f5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef040c3c80 con 0x7fef04155730 2023-12-16T03:26:38.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef09391640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fef040c6050 0x7fef040c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef09391640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fef040c6050 0x7fef040c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49132/0 (socket says 172.21.15.28:49132) 2023-12-16T03:26:38.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef09391640 1 -- 172.21.15.28:0/2375935554 learned_addr learned my addr 172.21.15.28:0/2375935554 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:38.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef09b92640 1 --2- 172.21.15.28:0/2375935554 >> v2:172.21.15.134:3300/0 conn(0x7fef04155730 0x7fef040c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef09391640 1 -- 172.21.15.28:0/2375935554 >> v2:172.21.15.134:3300/0 conn(0x7fef04155730 msgr2=0x7fef040c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:38.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef09391640 1 --2- 172.21.15.28:0/2375935554 >> v2:172.21.15.134:3300/0 conn(0x7fef04155730 0x7fef040c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.001+0000 7fef09391640 1 -- 172.21.15.28:0/2375935554 >> v1:172.21.15.134:6789/0 conn(0x7fef040c31c0 legacy=0x7fef04155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:38.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7fef09391640 1 -- 172.21.15.28:0/2375935554 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef040c6970 con 0x7fef040c6050 2023-12-16T03:26:38.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7fef09b92640 1 --2- 172.21.15.28:0/2375935554 >> v2:172.21.15.134:3300/0 conn(0x7fef04155730 0x7fef040c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:38.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7fef09391640 1 --2- 172.21.15.28:0/2375935554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef040c6050 0x7fef040c6430 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fef040ad520 tx=0x7fef0001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16209dd916340413 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:38.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7feefbfff640 1 -- 172.21.15.28:0/2375935554 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef040c8390 con 0x7fef040c6050 2023-12-16T03:26:38.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7feefbfff640 1 -- 172.21.15.28:0/2375935554 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef000a7050 con 0x7fef040c6050 2023-12-16T03:26:38.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7feefbfff640 1 -- 172.21.15.28:0/2375935554 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef000ab820 con 0x7fef040c6050 2023-12-16T03:26:38.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7fef0b5f5640 1 -- 172.21.15.28:0/2375935554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef040c6050 msgr2=0x7fef040c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7fef0b5f5640 1 --2- 172.21.15.28:0/2375935554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef040c6050 0x7fef040c6430 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fef040ad520 tx=0x7fef0001c370 comp rx=0 tx=0).stop 2023-12-16T03:26:38.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7fef0b5f5640 1 -- 172.21.15.28:0/2375935554 shutdown_connections 2023-12-16T03:26:38.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7fef0b5f5640 1 --2- 172.21.15.28:0/2375935554 >> v2:172.21.15.134:3300/0 conn(0x7fef04155730 0x7fef040c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7fef0b5f5640 1 --2- 172.21.15.28:0/2375935554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef040c6050 0x7fef040c6430 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7fef0b5f5640 1 -- 172.21.15.28:0/2375935554 >> 172.21.15.28:0/2375935554 conn(0x7fef040a9b80 msgr2=0x7fef040a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:38.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7fef0b5f5640 1 -- 172.21.15.28:0/2375935554 shutdown_connections 2023-12-16T03:26:38.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.005+0000 7fef0b5f5640 1 -- 172.21.15.28:0/2375935554 wait complete. 2023-12-16T03:26:38.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef0b5f5640 1 Processor -- start 2023-12-16T03:26:38.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef0b5f5640 1 -- start start 2023-12-16T03:26:38.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef0b5f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef040c31c0 0x7fef0414cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef0b5f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef040c6050 0x7fef04153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef0b5f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef04155730 0x7fef0415e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef0b5f5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0414c420 con 0x7fef040c31c0 2023-12-16T03:26:38.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef0b5f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0414d310 con 0x7fef040c6050 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef0b5f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef040aae80 con 0x7fef04155730 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef09391640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef040c31c0 0x7fef0414cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef09391640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef040c31c0 0x7fef0414cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49138/0 (socket says 172.21.15.28:49138) 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef09391640 1 -- 172.21.15.28:0/662278222 learned_addr learned my addr 172.21.15.28:0/662278222 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef08b90640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef040c6050 0x7fef04153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef09b92640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef04155730 0x7fef0415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef09391640 1 -- 172.21.15.28:0/662278222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef04155730 msgr2=0x7fef0415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef09391640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef04155730 0x7fef0415e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef09391640 1 -- 172.21.15.28:0/662278222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef040c6050 msgr2=0x7fef04153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef09391640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef040c6050 0x7fef04153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef09391640 1 -- 172.21.15.28:0/662278222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000094d0 con 0x7fef040c31c0 2023-12-16T03:26:38.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef09391640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef040c31c0 0x7fef0414cdd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef000ae040 tx=0x7fef0001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:38.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7feef9ffb640 1 -- 172.21.15.28:0/662278222 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef000b6620 con 0x7fef040c31c0 2023-12-16T03:26:38.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7feef9ffb640 1 -- 172.21.15.28:0/662278222 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef000b67a0 con 0x7fef040c31c0 2023-12-16T03:26:38.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.009+0000 7fef0b5f5640 1 -- 172.21.15.28:0/662278222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef040ab160 con 0x7fef040c31c0 2023-12-16T03:26:38.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.013+0000 7feef9ffb640 1 -- 172.21.15.28:0/662278222 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef000b6b50 con 0x7fef040c31c0 2023-12-16T03:26:38.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.013+0000 7fef0b5f5640 1 -- 172.21.15.28:0/662278222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef040ab720 con 0x7fef040c31c0 2023-12-16T03:26:38.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.013+0000 7fef0b5f5640 1 -- 172.21.15.28:0/662278222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef04068400 con 0x7fef040c31c0 2023-12-16T03:26:38.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.013+0000 7feef9ffb640 1 -- 172.21.15.28:0/662278222 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fef000b2040 con 0x7fef040c31c0 2023-12-16T03:26:38.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.013+0000 7feef9ffb640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feee80664c0 0x7feee8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.013+0000 7feef9ffb640 1 -- 172.21.15.28:0/662278222 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fef0011e5d0 con 0x7fef040c31c0 2023-12-16T03:26:38.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.013+0000 7fef08b90640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feee80664c0 0x7feee8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.013+0000 7fef08b90640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feee80664c0 0x7feee8068980 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fef04153200 tx=0x7feef4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:38.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.017+0000 7feef9ffb640 1 -- 172.21.15.28:0/662278222 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fef000eb760 con 0x7fef040c31c0 2023-12-16T03:26:38.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.173+0000 7fef0b5f5640 1 -- 172.21.15.28:0/662278222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef040ad380 con 0x7fef040c31c0 2023-12-16T03:26:38.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7feef9ffb640 1 -- 172.21.15.28:0/662278222 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef000eed80 con 0x7fef040c31c0 2023-12-16T03:26:38.181 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 -- 172.21.15.28:0/662278222 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feee80664c0 msgr2=0x7feee8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feee80664c0 0x7feee8068980 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fef04153200 tx=0x7feef4008040 comp rx=0 tx=0).stop 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 -- 172.21.15.28:0/662278222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef040c31c0 msgr2=0x7fef0414cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef040c31c0 0x7fef0414cdd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef000ae040 tx=0x7fef0001abb0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 -- 172.21.15.28:0/662278222 shutdown_connections 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef04155730 0x7fef0415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef040c6050 0x7fef04153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feee80664c0 0x7feee8068980 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 --2- 172.21.15.28:0/662278222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef040c31c0 0x7fef0414cdd0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 -- 172.21.15.28:0/662278222 >> 172.21.15.28:0/662278222 conn(0x7fef040a9b80 msgr2=0x7fef040c8390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 -- 172.21.15.28:0/662278222 shutdown_connections 2023-12-16T03:26:38.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.177+0000 7fef0b5f5640 1 -- 172.21.15.28:0/662278222 wait complete. 2023-12-16T03:26:38.203 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:26:38.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.341+0000 7fa462165640 1 Processor -- start 2023-12-16T03:26:38.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa462165640 1 -- start start 2023-12-16T03:26:38.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa462165640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa45c0bf9f0 0x7fa45c158330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa462165640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45c06a5b0 con 0x7fa45c073a70 2023-12-16T03:26:38.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa462165640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45c06b710 con 0x7fa45c14b010 2023-12-16T03:26:38.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa462165640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45c0bfe10 con 0x7fa45c0bf9f0 2023-12-16T03:26:38.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45affd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa45c073a70 0x7fa45c157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:45666/0 (socket says 172.21.15.28:45666) 2023-12-16T03:26:38.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45affd640 1 -- 172.21.15.28:0/2979844898 learned_addr learned my addr 172.21.15.28:0/2979844898 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:38.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45bfff640 1 --2- 172.21.15.28:0/2979844898 >> v2:172.21.15.134:3300/0 conn(0x7fa45c0bf9f0 0x7fa45c158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620998920 0 0) 0x7fa45c06a5b0 con 0x7fa45c073a70 2023-12-16T03:26:38.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa444003530 con 0x7fa45c073a70 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4227747342 0 0) 0x7fa444003530 con 0x7fa45c073a70 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 >> v2:172.21.15.134:3300/0 conn(0x7fa45c0bf9f0 msgr2=0x7fa45c158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 --2- 172.21.15.28:0/2979844898 >> v2:172.21.15.134:3300/0 conn(0x7fa45c0bf9f0 0x7fa45c158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 >> v1:172.21.15.134:6789/0 conn(0x7fa45c14b010 legacy=0x7fa45c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c0c1d60 con 0x7fa45c073a70 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fa450001680 con 0x7fa45c073a70 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 >> v1:172.21.15.28:6789/0 conn(0x7fa45c073a70 legacy=0x7fa45c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa444003980 0x7fa444003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4440047d0 0x7fa444004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa444005190 0x7fa44400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c0bfe10 con 0x7fa444005190 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44400c040 con 0x7fa4440047d0 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44400c200 con 0x7fa444003980 2023-12-16T03:26:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45bfff640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa444005190 0x7fa44400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45affd640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4440047d0 0x7fa444004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45b7fe640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa444003980 0x7fa444003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45bfff640 1 -- 172.21.15.28:0/2979844898 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa444003980 msgr2=0x7fa444003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45bfff640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa444003980 0x7fa444003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45bfff640 1 -- 172.21.15.28:0/2979844898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4440047d0 msgr2=0x7fa444004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45bfff640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4440047d0 0x7fa444004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45bfff640 1 -- 172.21.15.28:0/2979844898 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa444003530 con 0x7fa444005190 2023-12-16T03:26:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.345+0000 7fa45affd640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4440047d0 0x7fa444004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa45bfff640 1 -- 172.21.15.28:0/2979844898 reap_dead start 2023-12-16T03:26:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa45bfff640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa444005190 0x7fa44400b990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa454009fc0 tx=0x7fa45401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f52b57f00c9278d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4540a5cb0 con 0x7fa444005190 2023-12-16T03:26:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45400f040 con 0x7fa444005190 2023-12-16T03:26:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa45a7fc640 1 -- 172.21.15.28:0/2979844898 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454003be0 con 0x7fa444005190 2023-12-16T03:26:38.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa462165640 1 -- 172.21.15.28:0/2979844898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa444005190 msgr2=0x7fa44400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa462165640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa444005190 0x7fa44400b990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa454009fc0 tx=0x7fa45401cca0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa462165640 1 -- 172.21.15.28:0/2979844898 shutdown_connections 2023-12-16T03:26:38.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa462165640 1 --2- 172.21.15.28:0/2979844898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa444005190 0x7fa44400b990 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa462165640 1 -- 172.21.15.28:0/2979844898 >> 172.21.15.28:0/2979844898 conn(0x7fa45c0c30c0 msgr2=0x7fa45c0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:38.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa462165640 1 -- 172.21.15.28:0/2979844898 shutdown_connections 2023-12-16T03:26:38.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.349+0000 7fa462165640 1 -- 172.21.15.28:0/2979844898 wait complete. 2023-12-16T03:26:38.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa462165640 1 Processor -- start 2023-12-16T03:26:38.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa462165640 1 -- start start 2023-12-16T03:26:38.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa462165640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa444005190 0x7fa45c0c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa462165640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa45c143870 0x7fa45c1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa462165640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa45c142a00 0x7fa45c152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa462165640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c143d00 con 0x7fa45c143870 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa462165640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c1456d0 con 0x7fa444005190 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa462165640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c1459b0 con 0x7fa45c142a00 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa45affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa45c143870 0x7fa45c1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa45affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa45c143870 0x7fa45c1524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49154/0 (socket says 172.21.15.28:49154) 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa45affd640 1 -- 172.21.15.28:0/1925293838 learned_addr learned my addr 172.21.15.28:0/1925293838 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa45b7fe640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa444005190 0x7fa45c0c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa45bfff640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa45c142a00 0x7fa45c152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa45affd640 1 -- 172.21.15.28:0/1925293838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa45c142a00 msgr2=0x7fa45c152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa45affd640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa45c142a00 0x7fa45c152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa45affd640 1 -- 172.21.15.28:0/1925293838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa444005190 msgr2=0x7fa45c0c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa45affd640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa444005190 0x7fa45c0c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa45affd640 1 -- 172.21.15.28:0/1925293838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c145c90 con 0x7fa45c143870 2023-12-16T03:26:38.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa45affd640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa45c143870 0x7fa45c1524d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa45000e780 tx=0x7fa45000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:38.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa443fff640 1 -- 172.21.15.28:0/1925293838 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000c6c0 con 0x7fa45c143870 2023-12-16T03:26:38.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa443fff640 1 -- 172.21.15.28:0/1925293838 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45000c820 con 0x7fa45c143870 2023-12-16T03:26:38.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa443fff640 1 -- 172.21.15.28:0/1925293838 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000cb90 con 0x7fa45c143870 2023-12-16T03:26:38.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa462165640 1 -- 172.21.15.28:0/1925293838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45c0c1660 con 0x7fa45c143870 2023-12-16T03:26:38.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.353+0000 7fa462165640 1 -- 172.21.15.28:0/1925293838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45c1580e0 con 0x7fa45c143870 2023-12-16T03:26:38.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.357+0000 7fa462165640 1 -- 172.21.15.28:0/1925293838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45c143e40 con 0x7fa45c143870 2023-12-16T03:26:38.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.357+0000 7fa443fff640 1 -- 172.21.15.28:0/1925293838 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa45000ccf0 con 0x7fa45c143870 2023-12-16T03:26:38.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.357+0000 7fa443fff640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa448066470 0x7fa448068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.357+0000 7fa443fff640 1 -- 172.21.15.28:0/1925293838 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa450083f80 con 0x7fa45c143870 2023-12-16T03:26:38.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.357+0000 7fa45b7fe640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa448066470 0x7fa448068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.357+0000 7fa45b7fe640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa448066470 0x7fa448068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa44c000c10 tx=0x7fa44c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:38.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.361+0000 7fa443fff640 1 -- 172.21.15.28:0/1925293838 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa450054bd0 con 0x7fa45c143870 2023-12-16T03:26:38.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.517+0000 7fa462165640 1 -- 172.21.15.28:0/1925293838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa45c068400 con 0x7fa45c143870 2023-12-16T03:26:38.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.517+0000 7fa443fff640 1 -- 172.21.15.28:0/1925293838 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa450001440 con 0x7fa45c143870 2023-12-16T03:26:38.524 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:26:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 -- 172.21.15.28:0/1925293838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa448066470 msgr2=0x7fa448068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa448066470 0x7fa448068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa44c000c10 tx=0x7fa44c009040 comp rx=0 tx=0).stop 2023-12-16T03:26:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 -- 172.21.15.28:0/1925293838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa45c143870 msgr2=0x7fa45c1524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa45c143870 0x7fa45c1524d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa45000e780 tx=0x7fa45000eb80 comp rx=0 tx=0).stop 2023-12-16T03:26:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 -- 172.21.15.28:0/1925293838 shutdown_connections 2023-12-16T03:26:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa45c142a00 0x7fa45c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa448066470 0x7fa448068930 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa45c143870 0x7fa45c1524d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 --2- 172.21.15.28:0/1925293838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa444005190 0x7fa45c0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 -- 172.21.15.28:0/1925293838 >> 172.21.15.28:0/1925293838 conn(0x7fa45c0c30c0 msgr2=0x7fa45c0bff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:38.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 -- 172.21.15.28:0/1925293838 shutdown_connections 2023-12-16T03:26:38.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.521+0000 7fa462165640 1 -- 172.21.15.28:0/1925293838 wait complete. 2023-12-16T03:26:38.545 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:26:38.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.685+0000 7f9a2771d640 1 Processor -- start 2023-12-16T03:26:38.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.685+0000 7f9a2771d640 1 -- start start 2023-12-16T03:26:38.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a2771d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9a200c4100 0x7f9a200c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a2771d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 0x7f9a200a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a2771d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200c31c0 con 0x7f9a200c63c0 2023-12-16T03:26:38.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a2771d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a200c34a0 con 0x7f9a200c4100 2023-12-16T03:26:38.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a2771d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200c1030 con 0x7f9a200c06d0 2023-12-16T03:26:38.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a25cba640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 0x7f9a200a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a24cb8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9a200c4100 0x7f9a200c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a25cba640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 0x7f9a200a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:34820/0 (socket says 172.21.15.28:34820) 2023-12-16T03:26:38.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a25cba640 1 -- 172.21.15.28:0/2237270039 learned_addr learned my addr 172.21.15.28:0/2237270039 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:38.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a25cba640 1 -- 172.21.15.28:0/2237270039 >> v2:172.21.15.134:3300/0 conn(0x7f9a200c4100 msgr2=0x7f9a200c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:38.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a25cba640 1 --2- 172.21.15.28:0/2237270039 >> v2:172.21.15.134:3300/0 conn(0x7f9a200c4100 0x7f9a200c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a25cba640 1 -- 172.21.15.28:0/2237270039 >> v1:172.21.15.134:6789/0 conn(0x7f9a200c63c0 legacy=0x7f9a200c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.689+0000 7f9a25cba640 1 -- 172.21.15.28:0/2237270039 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a200c1310 con 0x7f9a200c06d0 2023-12-16T03:26:38.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a25cba640 1 --2- 172.21.15.28:0/2237270039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 0x7f9a200a9680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009e50 tx=0x7f9a1801c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39f18e375b9e1a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:38.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a17fff640 1 -- 172.21.15.28:0/2237270039 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200aa3d0 con 0x7f9a200c06d0 2023-12-16T03:26:38.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a17fff640 1 -- 172.21.15.28:0/2237270039 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a180a56c0 con 0x7f9a200c06d0 2023-12-16T03:26:38.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a17fff640 1 -- 172.21.15.28:0/2237270039 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180a5a50 con 0x7f9a200c06d0 2023-12-16T03:26:38.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a2771d640 1 -- 172.21.15.28:0/2237270039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 msgr2=0x7f9a200a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a2771d640 1 --2- 172.21.15.28:0/2237270039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 0x7f9a200a9680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009e50 tx=0x7f9a1801c8f0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a2771d640 1 -- 172.21.15.28:0/2237270039 shutdown_connections 2023-12-16T03:26:38.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a2771d640 1 --2- 172.21.15.28:0/2237270039 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 0x7f9a200a9680 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a2771d640 1 --2- 172.21.15.28:0/2237270039 >> v2:172.21.15.134:3300/0 conn(0x7f9a200c4100 0x7f9a200c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a2771d640 1 -- 172.21.15.28:0/2237270039 >> 172.21.15.28:0/2237270039 conn(0x7f9a2006a5b0 msgr2=0x7f9a2006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:38.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a2771d640 1 -- 172.21.15.28:0/2237270039 shutdown_connections 2023-12-16T03:26:38.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a2771d640 1 -- 172.21.15.28:0/2237270039 wait complete. 2023-12-16T03:26:38.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a2771d640 1 Processor -- start 2023-12-16T03:26:38.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.693+0000 7f9a2771d640 1 -- start start 2023-12-16T03:26:38.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a2771d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 0x7f9a200a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a2771d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a200c4100 0x7f9a2015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a2771d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a200c63c0 0x7f9a2014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a2771d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a201f1020 con 0x7f9a200c63c0 2023-12-16T03:26:38.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a2771d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a201f0260 con 0x7f9a200c4100 2023-12-16T03:26:38.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a2771d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a201f0540 con 0x7f9a200c06d0 2023-12-16T03:26:38.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a25cba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a200c63c0 0x7f9a2014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a25cba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a200c63c0 0x7f9a2014c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49168/0 (socket says 172.21.15.28:49168) 2023-12-16T03:26:38.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a25cba640 1 -- 172.21.15.28:0/262546246 learned_addr learned my addr 172.21.15.28:0/262546246 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:38.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a254b9640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 0x7f9a200a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a24cb8640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a200c4100 0x7f9a2015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a25cba640 1 -- 172.21.15.28:0/262546246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 msgr2=0x7f9a200a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a25cba640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 0x7f9a200a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a25cba640 1 -- 172.21.15.28:0/262546246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a200c4100 msgr2=0x7f9a2015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a25cba640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a200c4100 0x7f9a2015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a25cba640 1 -- 172.21.15.28:0/262546246 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a18009b30 con 0x7f9a200c63c0 2023-12-16T03:26:38.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a24cb8640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a200c4100 0x7f9a2015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:38.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a25cba640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a200c63c0 0x7f9a2014c1a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9a1801a520 tx=0x7f9a18019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:38.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a15ffb640 1 -- 172.21.15.28:0/262546246 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180b8670 con 0x7f9a200c63c0 2023-12-16T03:26:38.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a15ffb640 1 -- 172.21.15.28:0/262546246 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a180b87d0 con 0x7f9a200c63c0 2023-12-16T03:26:38.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a15ffb640 1 -- 172.21.15.28:0/262546246 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180b8b80 con 0x7f9a200c63c0 2023-12-16T03:26:38.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a2771d640 1 -- 172.21.15.28:0/262546246 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a201f0820 con 0x7f9a200c63c0 2023-12-16T03:26:38.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a2771d640 1 -- 172.21.15.28:0/262546246 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a200a74a0 con 0x7f9a200c63c0 2023-12-16T03:26:38.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a2771d640 1 -- 172.21.15.28:0/262546246 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a20068400 con 0x7f9a200c63c0 2023-12-16T03:26:38.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.697+0000 7f9a15ffb640 1 -- 172.21.15.28:0/262546246 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9a180b8ce0 con 0x7f9a200c63c0 2023-12-16T03:26:38.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.701+0000 7f9a15ffb640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a04066470 0x7f9a04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:38.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.701+0000 7f9a15ffb640 1 -- 172.21.15.28:0/262546246 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9a1811f5e0 con 0x7f9a200c63c0 2023-12-16T03:26:38.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.701+0000 7f9a254b9640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a04066470 0x7f9a04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:38.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.701+0000 7f9a254b9640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a04066470 0x7f9a04068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c007fd0 tx=0x7f9a1c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:38.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.705+0000 7f9a15ffb640 1 -- 172.21.15.28:0/262546246 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9a180ec7b0 con 0x7f9a200c63c0 2023-12-16T03:26:38.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.861+0000 7f9a2771d640 1 -- 172.21.15.28:0/262546246 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9a201f0cd0 con 0x7f9a200c63c0 2023-12-16T03:26:38.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.861+0000 7f9a15ffb640 1 -- 172.21.15.28:0/262546246 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9a18009510 con 0x7f9a200c63c0 2023-12-16T03:26:38.868 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:26:38.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 -- 172.21.15.28:0/262546246 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a04066470 msgr2=0x7f9a04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a04066470 0x7f9a04068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c007fd0 tx=0x7f9a1c009040 comp rx=0 tx=0).stop 2023-12-16T03:26:38.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 -- 172.21.15.28:0/262546246 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a200c63c0 msgr2=0x7f9a2014c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:38.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a200c63c0 0x7f9a2014c1a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9a1801a520 tx=0x7f9a18019690 comp rx=0 tx=0).stop 2023-12-16T03:26:38.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 -- 172.21.15.28:0/262546246 shutdown_connections 2023-12-16T03:26:38.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a04066470 0x7f9a04068930 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a200c63c0 0x7f9a2014c1a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a200c4100 0x7f9a2015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 --2- 172.21.15.28:0/262546246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a200c06d0 0x7f9a200a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:38.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 -- 172.21.15.28:0/262546246 >> 172.21.15.28:0/262546246 conn(0x7f9a2006a5b0 msgr2=0x7f9a2006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:38.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 -- 172.21.15.28:0/262546246 shutdown_connections 2023-12-16T03:26:38.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:38.865+0000 7f9a2771d640 1 -- 172.21.15.28:0/262546246 wait complete. 2023-12-16T03:26:38.890 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:26:39.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.025+0000 7f36bdff8640 1 Processor -- start 2023-12-16T03:26:39.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.025+0000 7f36bdff8640 1 -- start start 2023-12-16T03:26:39.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36bdff8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36b80c63c0 0x7f36b80c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36bdff8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f36b80c4100 0x7f36b80c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36bdff8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b80c31c0 con 0x7f36b80c29e0 2023-12-16T03:26:39.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36bdff8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b80c34a0 con 0x7f36b80c4100 2023-12-16T03:26:39.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36bdff8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b80c1030 con 0x7f36b80c63c0 2023-12-16T03:26:39.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36b6ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f36b80c4100 0x7f36b80c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36b6ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f36b80c4100 0x7f36b80c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49178/0 (socket says 172.21.15.28:49178) 2023-12-16T03:26:39.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36b6ffd640 1 -- 172.21.15.28:0/845823456 learned_addr learned my addr 172.21.15.28:0/845823456 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:39.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36b77fe640 1 --2- 172.21.15.28:0/845823456 >> v2:172.21.15.134:3300/0 conn(0x7f36b80c63c0 0x7f36b80c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36b6ffd640 1 -- 172.21.15.28:0/845823456 >> v2:172.21.15.134:3300/0 conn(0x7f36b80c63c0 msgr2=0x7f36b80c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:39.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36b6ffd640 1 --2- 172.21.15.28:0/845823456 >> v2:172.21.15.134:3300/0 conn(0x7f36b80c63c0 0x7f36b80c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36b6ffd640 1 -- 172.21.15.28:0/845823456 >> v1:172.21.15.134:6789/0 conn(0x7f36b80c29e0 legacy=0x7f36b80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.029+0000 7f36b6ffd640 1 -- 172.21.15.28:0/845823456 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b80c1310 con 0x7f36b80c4100 2023-12-16T03:26:39.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36b6ffd640 1 --2- 172.21.15.28:0/845823456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36b80c4100 0x7f36b80c24a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f36b806e000 tx=0x7f36ac01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56901840c211a52e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:39.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36b67fc640 1 -- 172.21.15.28:0/845823456 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0ac630 con 0x7f36b80c4100 2023-12-16T03:26:39.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36b67fc640 1 -- 172.21.15.28:0/845823456 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac0ac790 con 0x7f36b80c4100 2023-12-16T03:26:39.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36b67fc640 1 -- 172.21.15.28:0/845823456 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0acb20 con 0x7f36b80c4100 2023-12-16T03:26:39.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36bdff8640 1 -- 172.21.15.28:0/845823456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36b80c4100 msgr2=0x7f36b80c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36bdff8640 1 --2- 172.21.15.28:0/845823456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36b80c4100 0x7f36b80c24a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f36b806e000 tx=0x7f36ac01c3b0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36bdff8640 1 -- 172.21.15.28:0/845823456 shutdown_connections 2023-12-16T03:26:39.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36bdff8640 1 --2- 172.21.15.28:0/845823456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36b80c4100 0x7f36b80c24a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36bdff8640 1 --2- 172.21.15.28:0/845823456 >> v2:172.21.15.134:3300/0 conn(0x7f36b80c63c0 0x7f36b80c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36bdff8640 1 -- 172.21.15.28:0/845823456 >> 172.21.15.28:0/845823456 conn(0x7f36b806a5b0 msgr2=0x7f36b806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:39.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36bdff8640 1 -- 172.21.15.28:0/845823456 shutdown_connections 2023-12-16T03:26:39.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36bdff8640 1 -- 172.21.15.28:0/845823456 wait complete. 2023-12-16T03:26:39.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36bdff8640 1 Processor -- start 2023-12-16T03:26:39.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.033+0000 7f36bdff8640 1 -- start start 2023-12-16T03:26:39.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36bdff8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36b80c29e0 0x7f36b8153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36bdff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36b80c4100 0x7f36b8157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36bdff8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b80c63c0 0x7f36b8157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36bdff8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b81edbb0 con 0x7f36b80c29e0 2023-12-16T03:26:39.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36bdff8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b8159170 con 0x7f36b80c63c0 2023-12-16T03:26:39.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36bdff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b81ecfc0 con 0x7f36b80c4100 2023-12-16T03:26:39.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36b77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36b80c29e0 0x7f36b8153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36b77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36b80c29e0 0x7f36b8153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49194/0 (socket says 172.21.15.28:49194) 2023-12-16T03:26:39.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36b77fe640 1 -- 172.21.15.28:0/3033367909 learned_addr learned my addr 172.21.15.28:0/3033367909 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:39.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36b77fe640 1 -- 172.21.15.28:0/3033367909 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36b80c4100 msgr2=0x7f36b8157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36b77fe640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36b80c4100 0x7f36b8157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36b77fe640 1 -- 172.21.15.28:0/3033367909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b80c63c0 msgr2=0x7f36b8157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36b77fe640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b80c63c0 0x7f36b8157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36b77fe640 1 -- 172.21.15.28:0/3033367909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0094d0 con 0x7f36b80c29e0 2023-12-16T03:26:39.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36b77fe640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36b80c29e0 0x7f36b8153360 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f36a800d620 tx=0x7f36a800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:39.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f369ffff640 1 -- 172.21.15.28:0/3033367909 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a800b620 con 0x7f36b80c29e0 2023-12-16T03:26:39.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f369ffff640 1 -- 172.21.15.28:0/3033367909 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a800b780 con 0x7f36b80c29e0 2023-12-16T03:26:39.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36bdff8640 1 -- 172.21.15.28:0/3033367909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b81ed280 con 0x7f36b80c29e0 2023-12-16T03:26:39.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f369ffff640 1 -- 172.21.15.28:0/3033367909 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a800bb10 con 0x7f36b80c29e0 2023-12-16T03:26:39.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36bdff8640 1 -- 172.21.15.28:0/3033367909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b81ed840 con 0x7f36b80c29e0 2023-12-16T03:26:39.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f36bdff8640 1 -- 172.21.15.28:0/3033367909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b8068400 con 0x7f36b80c29e0 2023-12-16T03:26:39.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.037+0000 7f369ffff640 1 -- 172.21.15.28:0/3033367909 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f36a800bc70 con 0x7f36b80c29e0 2023-12-16T03:26:39.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.041+0000 7f369ffff640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36a4066470 0x7f36a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.041+0000 7f369ffff640 1 -- 172.21.15.28:0/3033367909 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f36a8084710 con 0x7f36b80c29e0 2023-12-16T03:26:39.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.041+0000 7f36b6ffd640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36a4066470 0x7f36a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.041+0000 7f36b6ffd640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36a4066470 0x7f36a4068930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0ae000 tx=0x7f36ac004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:39.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.045+0000 7f369ffff640 1 -- 172.21.15.28:0/3033367909 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f36a8051820 con 0x7f36b80c29e0 2023-12-16T03:26:39.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f36bdff8640 1 -- 172.21.15.28:0/3033367909 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36b80c3e70 con 0x7f36b80c29e0 2023-12-16T03:26:39.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f369ffff640 1 -- 172.21.15.28:0/3033367909 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6183 (secure 0 0 0) 0x7f36a8007380 con 0x7f36b80c29e0 2023-12-16T03:26:39.243 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:39.243 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3378969769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3378969769},{"type":"v1","addr":"172.21.15.134:6835","nonce":3378969769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2794220220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2794220220},{"type":"v1","addr":"172.21.15.134:6834","nonce":2794220220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:02.836620+0000","modified":"2023-12-16T03:26:05.858917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.28:6837/1004873879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1004873879},{"type":"v1","addr":"172.21.15.28:6837","nonce":1004873879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:19.999425+0000","modified":"2023-12-16T03:26:22.999486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5010":{"gid":5010,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.28:6836/664267694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":664267694},{"type":"v1","addr":"172.21.15.28:6836","nonce":664267694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-16T03:26:39.244 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 21 2023-12-16T03:26:39.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f36bdff8640 1 -- 172.21.15.28:0/3033367909 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36a4066470 msgr2=0x7f36a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f36bdff8640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36a4066470 0x7f36a4068930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0ae000 tx=0x7f36ac004740 comp rx=0 tx=0).stop 2023-12-16T03:26:39.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f36bdff8640 1 -- 172.21.15.28:0/3033367909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36b80c29e0 msgr2=0x7f36b8153360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f36bdff8640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36b80c29e0 0x7f36b8153360 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f36a800d620 tx=0x7f36a800dae0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f36bdff8640 1 -- 172.21.15.28:0/3033367909 shutdown_connections 2023-12-16T03:26:39.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f36bdff8640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b80c63c0 0x7f36b8157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f36bdff8640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36b80c4100 0x7f36b8157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f36bdff8640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36a4066470 0x7f36a4068930 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f36bdff8640 1 --2- 172.21.15.28:0/3033367909 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36b80c29e0 0x7f36b8153360 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.237+0000 7f36bdff8640 1 -- 172.21.15.28:0/3033367909 >> 172.21.15.28:0/3033367909 conn(0x7f36b806a5b0 msgr2=0x7f36b8071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:39.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.241+0000 7f36bdff8640 1 -- 172.21.15.28:0/3033367909 shutdown_connections 2023-12-16T03:26:39.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.241+0000 7f36bdff8640 1 -- 172.21.15.28:0/3033367909 wait complete. 2023-12-16T03:26:39.264 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:39.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f8329a640 1 Processor -- start 2023-12-16T03:26:39.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f8329a640 1 -- start start 2023-12-16T03:26:39.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f8329a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7f7c1578f0 0x7f7f7c0c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f8329a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7f7c0a6c60 0x7f7f7c0c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f8329a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7c0c2840 0x7f7f7c0c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f8329a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7c0c2e00 con 0x7f7f7c0a6c60 2023-12-16T03:26:39.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f8329a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7c157cd0 con 0x7f7f7c1578f0 2023-12-16T03:26:39.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f8329a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c158850 con 0x7f7f7c0c2840 2023-12-16T03:26:39.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f80835640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7f7c0a6c60 0x7f7f7c0c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f80835640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7f7c0a6c60 0x7f7f7c0c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49196/0 (socket says 172.21.15.28:49196) 2023-12-16T03:26:39.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f80835640 1 -- 172.21.15.28:0/4014492642 learned_addr learned my addr 172.21.15.28:0/4014492642 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:39.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f80835640 1 -- 172.21.15.28:0/4014492642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7c0c2840 msgr2=0x7f7f7c0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:39.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f80835640 1 --2- 172.21.15.28:0/4014492642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7c0c2840 0x7f7f7c0c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f80835640 1 -- 172.21.15.28:0/4014492642 >> v2:172.21.15.134:3300/0 conn(0x7f7f7c1578f0 msgr2=0x7f7f7c0c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:39.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f80835640 1 --2- 172.21.15.28:0/4014492642 >> v2:172.21.15.134:3300/0 conn(0x7f7f7c1578f0 0x7f7f7c0c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.401+0000 7f7f80835640 1 -- 172.21.15.28:0/4014492642 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c157f20 con 0x7f7f7c0a6c60 2023-12-16T03:26:39.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f80835640 1 --2- 172.21.15.28:0/4014492642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f7c0a6c60 0x7f7f7c0c3620 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0c7be0 tx=0x7f7f6c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7064f56ca6c73265 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:39.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f73fff640 1 -- 172.21.15.28:0/4014492642 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0ab600 con 0x7f7f7c0a6c60 2023-12-16T03:26:39.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f73fff640 1 -- 172.21.15.28:0/4014492642 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c0a7050 con 0x7f7f7c0a6c60 2023-12-16T03:26:39.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f73fff640 1 -- 172.21.15.28:0/4014492642 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0ab980 con 0x7f7f7c0a6c60 2023-12-16T03:26:39.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f8329a640 1 -- 172.21.15.28:0/4014492642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f7c0a6c60 msgr2=0x7f7f7c0c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f8329a640 1 --2- 172.21.15.28:0/4014492642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f7c0a6c60 0x7f7f7c0c3620 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0c7be0 tx=0x7f7f6c01c470 comp rx=0 tx=0).stop 2023-12-16T03:26:39.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f8329a640 1 -- 172.21.15.28:0/4014492642 shutdown_connections 2023-12-16T03:26:39.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f8329a640 1 --2- 172.21.15.28:0/4014492642 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7c0c2840 0x7f7f7c0c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f8329a640 1 --2- 172.21.15.28:0/4014492642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f7c0a6c60 0x7f7f7c0c3620 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f8329a640 1 --2- 172.21.15.28:0/4014492642 >> v2:172.21.15.134:3300/0 conn(0x7f7f7c1578f0 0x7f7f7c0c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f8329a640 1 -- 172.21.15.28:0/4014492642 >> 172.21.15.28:0/4014492642 conn(0x7f7f7c0c7e40 msgr2=0x7f7f7c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:39.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f8329a640 1 -- 172.21.15.28:0/4014492642 shutdown_connections 2023-12-16T03:26:39.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.405+0000 7f7f8329a640 1 -- 172.21.15.28:0/4014492642 wait complete. 2023-12-16T03:26:39.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f8329a640 1 Processor -- start 2023-12-16T03:26:39.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f8329a640 1 -- start start 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f8329a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7c0a6c60 0x7f7f7c0aace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f8329a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7c0c2840 0x7f7f7c14cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f8329a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f7c1578f0 0x7f7f7c06f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f8329a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0addc0 con 0x7f7f7c1578f0 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f8329a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c14d440 con 0x7f7f7c0a6c60 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f8329a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c14ba30 con 0x7f7f7c0c2840 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f81837640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f7c1578f0 0x7f7f7c06f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f81837640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f7c1578f0 0x7f7f7c06f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49212/0 (socket says 172.21.15.28:49212) 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f81837640 1 -- 172.21.15.28:0/3547529093 learned_addr learned my addr 172.21.15.28:0/3547529093 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f80835640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7c0c2840 0x7f7f7c14cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f81036640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7c0a6c60 0x7f7f7c0aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f81837640 1 -- 172.21.15.28:0/3547529093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7c0c2840 msgr2=0x7f7f7c14cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f81837640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7c0c2840 0x7f7f7c14cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f81837640 1 -- 172.21.15.28:0/3547529093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7c0a6c60 msgr2=0x7f7f7c0aace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f81837640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7c0a6c60 0x7f7f7c0aace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f81837640 1 -- 172.21.15.28:0/3547529093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0094d0 con 0x7f7f7c1578f0 2023-12-16T03:26:39.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f80835640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7c0c2840 0x7f7f7c14cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f81837640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f7c1578f0 0x7f7f7c06f050 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400b970 tx=0x7f7f7400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f71ffb640 1 -- 172.21.15.28:0/3547529093 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400cb40 con 0x7f7f7c1578f0 2023-12-16T03:26:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f71ffb640 1 -- 172.21.15.28:0/3547529093 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400ccc0 con 0x7f7f7c1578f0 2023-12-16T03:26:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f71ffb640 1 -- 172.21.15.28:0/3547529093 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74014680 con 0x7f7f7c1578f0 2023-12-16T03:26:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f8329a640 1 -- 172.21.15.28:0/3547529093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c14bd10 con 0x7f7f7c1578f0 2023-12-16T03:26:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.409+0000 7f7f8329a640 1 -- 172.21.15.28:0/3547529093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c06f590 con 0x7f7f7c1578f0 2023-12-16T03:26:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.413+0000 7f7f8329a640 1 -- 172.21.15.28:0/3547529093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7c0c7c10 con 0x7f7f7c1578f0 2023-12-16T03:26:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.413+0000 7f7f71ffb640 1 -- 172.21.15.28:0/3547529093 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7f7401d3b0 con 0x7f7f7c1578f0 2023-12-16T03:26:39.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.413+0000 7f7f71ffb640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f60066470 0x7f7f60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.413+0000 7f7f71ffb640 1 -- 172.21.15.28:0/3547529093 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7f74084150 con 0x7f7f7c1578f0 2023-12-16T03:26:39.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.413+0000 7f7f81036640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f60066470 0x7f7f60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.413+0000 7f7f81036640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f60066470 0x7f7f60068930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7f78006fd0 tx=0x7f7f78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:39.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.417+0000 7f7f71ffb640 1 -- 172.21.15.28:0/3547529093 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7f74051260 con 0x7f7f7c1578f0 2023-12-16T03:26:39.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.577+0000 7f7f8329a640 1 -- 172.21.15.28:0/3547529093 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f7c068400 con 0x7f7f7c1578f0 2023-12-16T03:26:39.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.577+0000 7f7f71ffb640 1 -- 172.21.15.28:0/3547529093 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20229 (secure 0 0 0) 0x7f7f74054880 con 0x7f7f7c1578f0 2023-12-16T03:26:39.584 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:39.584 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:21.432053+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:39.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 -- 172.21.15.28:0/3547529093 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f60066470 msgr2=0x7f7f60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f60066470 0x7f7f60068930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7f78006fd0 tx=0x7f7f78008040 comp rx=0 tx=0).stop 2023-12-16T03:26:39.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 -- 172.21.15.28:0/3547529093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f7c1578f0 msgr2=0x7f7f7c06f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f7c1578f0 0x7f7f7c06f050 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400b970 tx=0x7f7f7400be30 comp rx=0 tx=0).stop 2023-12-16T03:26:39.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 -- 172.21.15.28:0/3547529093 shutdown_connections 2023-12-16T03:26:39.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f60066470 0x7f7f60068930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f7c1578f0 0x7f7f7c06f050 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7c0c2840 0x7f7f7c14cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 --2- 172.21.15.28:0/3547529093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7c0a6c60 0x7f7f7c0aace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 -- 172.21.15.28:0/3547529093 >> 172.21.15.28:0/3547529093 conn(0x7f7f7c0c7e40 msgr2=0x7f7f7c154bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 -- 172.21.15.28:0/3547529093 shutdown_connections 2023-12-16T03:26:39.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.581+0000 7f7f8329a640 1 -- 172.21.15.28:0/3547529093 wait complete. 2023-12-16T03:26:39.606 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-16T03:26:39.606 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:26:39.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dc69c640 1 Processor -- start 2023-12-16T03:26:39.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dc69c640 1 -- start start 2023-12-16T03:26:39.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dc69c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f33d40c63c0 0x7f33d40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dc69c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f33d40c2bb0 0x7f33d40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dc69c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d40c31c0 con 0x7f33d40c4100 2023-12-16T03:26:39.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dc69c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d40c34a0 con 0x7f33d40c2bb0 2023-12-16T03:26:39.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dc69c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d40c1030 con 0x7f33d40c63c0 2023-12-16T03:26:39.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dac39640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f33d40c2bb0 0x7f33d40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dac39640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f33d40c2bb0 0x7f33d40a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49072/0 (socket says 172.21.15.28:49072) 2023-12-16T03:26:39.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dac39640 1 -- 172.21.15.28:0/4087115306 learned_addr learned my addr 172.21.15.28:0/4087115306 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:39.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33da438640 1 --2- 172.21.15.28:0/4087115306 >> v2:172.21.15.134:3300/0 conn(0x7f33d40c63c0 0x7f33d40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dac39640 1 -- 172.21.15.28:0/4087115306 >> v2:172.21.15.134:3300/0 conn(0x7f33d40c63c0 msgr2=0x7f33d40c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:39.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dac39640 1 --2- 172.21.15.28:0/4087115306 >> v2:172.21.15.134:3300/0 conn(0x7f33d40c63c0 0x7f33d40c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dac39640 1 -- 172.21.15.28:0/4087115306 >> v1:172.21.15.134:6789/0 conn(0x7f33d40c4100 legacy=0x7f33d40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.745+0000 7f33dac39640 1 -- 172.21.15.28:0/4087115306 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d40c1310 con 0x7f33d40c2bb0 2023-12-16T03:26:39.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33dac39640 1 --2- 172.21.15.28:0/4087115306 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33d40c2bb0 0x7f33d40a9680 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f33d406e000 tx=0x7f33cc01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172066ebc408dd98 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:39.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33d9436640 1 -- 172.21.15.28:0/4087115306 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d40aa3d0 con 0x7f33d40c2bb0 2023-12-16T03:26:39.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33d9436640 1 -- 172.21.15.28:0/4087115306 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc0a5790 con 0x7f33d40c2bb0 2023-12-16T03:26:39.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33d9436640 1 -- 172.21.15.28:0/4087115306 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0a5b20 con 0x7f33d40c2bb0 2023-12-16T03:26:39.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33dc69c640 1 -- 172.21.15.28:0/4087115306 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33d40c2bb0 msgr2=0x7f33d40a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33dc69c640 1 --2- 172.21.15.28:0/4087115306 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33d40c2bb0 0x7f33d40a9680 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f33d406e000 tx=0x7f33cc01c8b0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33dc69c640 1 -- 172.21.15.28:0/4087115306 shutdown_connections 2023-12-16T03:26:39.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33dc69c640 1 --2- 172.21.15.28:0/4087115306 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33d40c2bb0 0x7f33d40a9680 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33dc69c640 1 --2- 172.21.15.28:0/4087115306 >> v2:172.21.15.134:3300/0 conn(0x7f33d40c63c0 0x7f33d40c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33dc69c640 1 -- 172.21.15.28:0/4087115306 >> 172.21.15.28:0/4087115306 conn(0x7f33d406a5b0 msgr2=0x7f33d406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:39.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33dc69c640 1 -- 172.21.15.28:0/4087115306 shutdown_connections 2023-12-16T03:26:39.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.749+0000 7f33dc69c640 1 -- 172.21.15.28:0/4087115306 wait complete. 2023-12-16T03:26:39.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dc69c640 1 Processor -- start 2023-12-16T03:26:39.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dc69c640 1 -- start start 2023-12-16T03:26:39.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dc69c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33d40c2bb0 0x7f33d41ee770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dc69c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d40c4100 0x7f33d40bf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dc69c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33d40c63c0 0x7f33d40bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dc69c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d41538f0 con 0x7f33d40c2bb0 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dc69c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d4158e10 con 0x7f33d40c4100 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dc69c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d4153ae0 con 0x7f33d40c63c0 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33da438640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33d40c2bb0 0x7f33d41ee770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33da438640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33d40c2bb0 0x7f33d41ee770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49086/0 (socket says 172.21.15.28:49086) 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33da438640 1 -- 172.21.15.28:0/2324282971 learned_addr learned my addr 172.21.15.28:0/2324282971 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dac39640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33d40c63c0 0x7f33d40bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33d9c37640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d40c4100 0x7f33d40bf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33da438640 1 -- 172.21.15.28:0/2324282971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33d40c63c0 msgr2=0x7f33d40bd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33da438640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33d40c63c0 0x7f33d40bd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33da438640 1 -- 172.21.15.28:0/2324282971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d40c4100 msgr2=0x7f33d40bf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33da438640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d40c4100 0x7f33d40bf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33da438640 1 -- 172.21.15.28:0/2324282971 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc009b30 con 0x7f33d40c2bb0 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33da438640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33d40c2bb0 0x7f33d41ee770 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f33d000e870 tx=0x7f33d000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:39.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33caffd640 1 -- 172.21.15.28:0/2324282971 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0009510 con 0x7f33d40c2bb0 2023-12-16T03:26:39.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33caffd640 1 -- 172.21.15.28:0/2324282971 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d000eec0 con 0x7f33d40c2bb0 2023-12-16T03:26:39.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33caffd640 1 -- 172.21.15.28:0/2324282971 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d000cb40 con 0x7f33d40c2bb0 2023-12-16T03:26:39.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dc69c640 1 -- 172.21.15.28:0/2324282971 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d41eecb0 con 0x7f33d40c2bb0 2023-12-16T03:26:39.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dc69c640 1 -- 172.21.15.28:0/2324282971 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d40bb440 con 0x7f33d40c2bb0 2023-12-16T03:26:39.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.753+0000 7f33dc69c640 1 -- 172.21.15.28:0/2324282971 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d4068400 con 0x7f33d40c2bb0 2023-12-16T03:26:39.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.757+0000 7f33caffd640 1 -- 172.21.15.28:0/2324282971 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f33d000ccc0 con 0x7f33d40c2bb0 2023-12-16T03:26:39.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.757+0000 7f33caffd640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33b8066470 0x7f33b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:39.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.757+0000 7f33caffd640 1 -- 172.21.15.28:0/2324282971 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f33d0084220 con 0x7f33d40c2bb0 2023-12-16T03:26:39.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.757+0000 7f33d9c37640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33b8066470 0x7f33b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:39.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.757+0000 7f33d9c37640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33b8066470 0x7f33b8068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f33d40708b0 tx=0x7f33c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:39.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.761+0000 7f33caffd640 1 -- 172.21.15.28:0/2324282971 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f33d00513e0 con 0x7f33d40c2bb0 2023-12-16T03:26:39.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.953+0000 7f33dc69c640 1 -- 172.21.15.28:0/2324282971 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33d40c3e70 con 0x7f33d40c2bb0 2023-12-16T03:26:39.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.953+0000 7f33caffd640 1 -- 172.21.15.28:0/2324282971 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6183 (secure 0 0 0) 0x7f33d0054a00 con 0x7f33d40c2bb0 2023-12-16T03:26:39.960 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:39.960 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3378969769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3378969769},{"type":"v1","addr":"172.21.15.134:6835","nonce":3378969769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2794220220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2794220220},{"type":"v1","addr":"172.21.15.134:6834","nonce":2794220220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:02.836620+0000","modified":"2023-12-16T03:26:05.858917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.28:6837/1004873879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1004873879},{"type":"v1","addr":"172.21.15.28:6837","nonce":1004873879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:19.999425+0000","modified":"2023-12-16T03:26:22.999486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5010":{"gid":5010,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.28:6836/664267694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":664267694},{"type":"v1","addr":"172.21.15.28:6836","nonce":664267694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-16T03:26:39.960 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 21 2023-12-16T03:26:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 -- 172.21.15.28:0/2324282971 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33b8066470 msgr2=0x7f33b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33b8066470 0x7f33b8068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f33d40708b0 tx=0x7f33c4009040 comp rx=0 tx=0).stop 2023-12-16T03:26:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 -- 172.21.15.28:0/2324282971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33d40c2bb0 msgr2=0x7f33d41ee770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33d40c2bb0 0x7f33d41ee770 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f33d000e870 tx=0x7f33d000ec70 comp rx=0 tx=0).stop 2023-12-16T03:26:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 -- 172.21.15.28:0/2324282971 shutdown_connections 2023-12-16T03:26:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f33d40c63c0 0x7f33d40bd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d40c4100 0x7f33d40bf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f33b8066470 0x7f33b8068930 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 --2- 172.21.15.28:0/2324282971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33d40c2bb0 0x7f33d41ee770 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:39.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 -- 172.21.15.28:0/2324282971 >> 172.21.15.28:0/2324282971 conn(0x7f33d406a5b0 msgr2=0x7f33d406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:39.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 -- 172.21.15.28:0/2324282971 shutdown_connections 2023-12-16T03:26:39.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:39.957+0000 7f33dc69c640 1 -- 172.21.15.28:0/2324282971 wait complete. 2023-12-16T03:26:39.981 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:26:40.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.117+0000 7f051bead640 1 Processor -- start 2023-12-16T03:26:40.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.117+0000 7f051bead640 1 -- start start 2023-12-16T03:26:40.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051bead640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f05140c5260 0x7f051406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051bead640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0514155de0 0x7f0514156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051bead640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05140c2580 con 0x7f05140c5640 2023-12-16T03:26:40.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051bead640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0514153510 con 0x7f0514155de0 2023-12-16T03:26:40.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051bead640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05140c17f0 con 0x7f05140c5260 2023-12-16T03:26:40.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051a44a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0514155de0 0x7f0514156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051a44a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0514155de0 0x7f0514156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49102/0 (socket says 172.21.15.28:49102) 2023-12-16T03:26:40.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051a44a640 1 -- 172.21.15.28:0/648727249 learned_addr learned my addr 172.21.15.28:0/648727249 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:40.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f0519c49640 1 --2- 172.21.15.28:0/648727249 >> v2:172.21.15.134:3300/0 conn(0x7f05140c5260 0x7f051406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051a44a640 1 -- 172.21.15.28:0/648727249 >> v2:172.21.15.134:3300/0 conn(0x7f05140c5260 msgr2=0x7f051406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:40.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051a44a640 1 --2- 172.21.15.28:0/648727249 >> v2:172.21.15.134:3300/0 conn(0x7f05140c5260 0x7f051406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051a44a640 1 -- 172.21.15.28:0/648727249 >> v1:172.21.15.134:6789/0 conn(0x7f05140c5640 legacy=0x7f05140c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.121+0000 7f051a44a640 1 -- 172.21.15.28:0/648727249 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05140c1a00 con 0x7f0514155de0 2023-12-16T03:26:40.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f051a44a640 1 --2- 172.21.15.28:0/648727249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0514155de0 0x7f0514156230 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f05140c6920 tx=0x7f050c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d000d5b30d9bc497 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:40.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f0518c47640 1 -- 172.21.15.28:0/648727249 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c0a57d0 con 0x7f0514155de0 2023-12-16T03:26:40.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f0518c47640 1 -- 172.21.15.28:0/648727249 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c0a5930 con 0x7f0514155de0 2023-12-16T03:26:40.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f0518c47640 1 -- 172.21.15.28:0/648727249 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c0a5cc0 con 0x7f0514155de0 2023-12-16T03:26:40.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f051bead640 1 -- 172.21.15.28:0/648727249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0514155de0 msgr2=0x7f0514156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f051bead640 1 --2- 172.21.15.28:0/648727249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0514155de0 0x7f0514156230 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f05140c6920 tx=0x7f050c01c910 comp rx=0 tx=0).stop 2023-12-16T03:26:40.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f051bead640 1 -- 172.21.15.28:0/648727249 shutdown_connections 2023-12-16T03:26:40.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f051bead640 1 --2- 172.21.15.28:0/648727249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0514155de0 0x7f0514156230 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f051bead640 1 --2- 172.21.15.28:0/648727249 >> v2:172.21.15.134:3300/0 conn(0x7f05140c5260 0x7f051406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f051bead640 1 -- 172.21.15.28:0/648727249 >> 172.21.15.28:0/648727249 conn(0x7f051406a5b0 msgr2=0x7f051406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:40.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f051bead640 1 -- 172.21.15.28:0/648727249 shutdown_connections 2023-12-16T03:26:40.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f051bead640 1 -- 172.21.15.28:0/648727249 wait complete. 2023-12-16T03:26:40.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f051bead640 1 Processor -- start 2023-12-16T03:26:40.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.125+0000 7f051bead640 1 -- start start 2023-12-16T03:26:40.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f051bead640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05140c5260 0x7f051414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f051bead640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05140c5640 0x7f0514148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f051bead640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0514155de0 0x7f05140a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f051bead640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05141f0c20 con 0x7f05140c5640 2023-12-16T03:26:40.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f051bead640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051414d9d0 con 0x7f05140c5260 2023-12-16T03:26:40.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f051bead640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05141f08e0 con 0x7f0514155de0 2023-12-16T03:26:40.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f0519448640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05140c5640 0x7f0514148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f0519448640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05140c5640 0x7f0514148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49116/0 (socket says 172.21.15.28:49116) 2023-12-16T03:26:40.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f0519448640 1 -- 172.21.15.28:0/3143294613 learned_addr learned my addr 172.21.15.28:0/3143294613 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:40.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f0519c49640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05140c5260 0x7f051414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f0519448640 1 -- 172.21.15.28:0/3143294613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0514155de0 msgr2=0x7f05140a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f0519448640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0514155de0 0x7f05140a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f0519448640 1 -- 172.21.15.28:0/3143294613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05140c5260 msgr2=0x7f051414cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f0519448640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05140c5260 0x7f051414cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f0519448640 1 -- 172.21.15.28:0/3143294613 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c009b30 con 0x7f05140c5640 2023-12-16T03:26:40.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f0519c49640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05140c5260 0x7f051414cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:40.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f0519448640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05140c5640 0x7f0514148590 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f050400c3c0 tx=0x7f050400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:40.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f050a7fc640 1 -- 172.21.15.28:0/3143294613 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040052d0 con 0x7f05140c5640 2023-12-16T03:26:40.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f050a7fc640 1 -- 172.21.15.28:0/3143294613 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0504005430 con 0x7f05140c5640 2023-12-16T03:26:40.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f050a7fc640 1 -- 172.21.15.28:0/3143294613 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504003820 con 0x7f05140c5640 2023-12-16T03:26:40.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f051bead640 1 -- 172.21.15.28:0/3143294613 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051414d730 con 0x7f05140c5640 2023-12-16T03:26:40.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f051bead640 1 -- 172.21.15.28:0/3143294613 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051414e530 con 0x7f05140c5640 2023-12-16T03:26:40.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f051bead640 1 -- 172.21.15.28:0/3143294613 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05141f0d60 con 0x7f05140c5640 2023-12-16T03:26:40.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.129+0000 7f050a7fc640 1 -- 172.21.15.28:0/3143294613 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0504003980 con 0x7f05140c5640 2023-12-16T03:26:40.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.133+0000 7f050a7fc640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04f8066470 0x7f04f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.133+0000 7f050a7fc640 1 -- 172.21.15.28:0/3143294613 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f05040836f0 con 0x7f05140c5640 2023-12-16T03:26:40.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.133+0000 7f0519c49640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04f8066470 0x7f04f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.133+0000 7f0519c49640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04f8066470 0x7f04f8068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f051414cc20 tx=0x7f0510008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:40.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.137+0000 7f050a7fc640 1 -- 172.21.15.28:0/3143294613 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f05141f0d60 con 0x7f05140c5640 2023-12-16T03:26:40.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.329+0000 7f051bead640 1 -- 172.21.15.28:0/3143294613 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05141f0d60 con 0x7f05140c5640 2023-12-16T03:26:40.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.329+0000 7f050a7fc640 1 -- 172.21.15.28:0/3143294613 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6183 (secure 0 0 0) 0x7f05141f0d60 con 0x7f05140c5640 2023-12-16T03:26:40.337 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:40.337 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3378969769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3378969769},{"type":"v1","addr":"172.21.15.134:6835","nonce":3378969769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2794220220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2794220220},{"type":"v1","addr":"172.21.15.134:6834","nonce":2794220220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:02.836620+0000","modified":"2023-12-16T03:26:05.858917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5013},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5013":{"gid":5013,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.28:6837/1004873879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1004873879},{"type":"v1","addr":"172.21.15.28:6837","nonce":1004873879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:19.999425+0000","modified":"2023-12-16T03:26:22.999486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5010":{"gid":5010,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.28:6836/664267694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":664267694},{"type":"v1","addr":"172.21.15.28:6836","nonce":664267694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-16T03:26:40.337 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 21 2023-12-16T03:26:40.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 -- 172.21.15.28:0/3143294613 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04f8066470 msgr2=0x7f04f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04f8066470 0x7f04f8068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f051414cc20 tx=0x7f0510008040 comp rx=0 tx=0).stop 2023-12-16T03:26:40.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 -- 172.21.15.28:0/3143294613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05140c5640 msgr2=0x7f0514148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05140c5640 0x7f0514148590 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f050400c3c0 tx=0x7f050400c880 comp rx=0 tx=0).stop 2023-12-16T03:26:40.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 -- 172.21.15.28:0/3143294613 shutdown_connections 2023-12-16T03:26:40.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0514155de0 0x7f05140a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04f8066470 0x7f04f8068930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05140c5640 0x7f0514148590 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 --2- 172.21.15.28:0/3143294613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05140c5260 0x7f051414cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 -- 172.21.15.28:0/3143294613 >> 172.21.15.28:0/3143294613 conn(0x7f051406a5b0 msgr2=0x7f05141561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:40.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 -- 172.21.15.28:0/3143294613 shutdown_connections 2023-12-16T03:26:40.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.333+0000 7f051bead640 1 -- 172.21.15.28:0/3143294613 wait complete. 2023-12-16T03:26:40.358 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:40.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.493+0000 7f0283c17640 1 Processor -- start 2023-12-16T03:26:40.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.493+0000 7f0283c17640 1 -- start start 2023-12-16T03:26:40.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f0283c17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f027c0c5260 0x7f027c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f0283c17640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f027c0c5640 0x7f027c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f0283c17640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f027c0c60f0 0x7f027c155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f0283c17640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027c0c17f0 con 0x7f027c0c5640 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f0283c17640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027c0c2580 con 0x7f027c0c60f0 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f0283c17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0c1a00 con 0x7f027c0c5260 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f02811b2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f027c0c5640 0x7f027c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f02811b2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f027c0c5640 0x7f027c0c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49124/0 (socket says 172.21.15.28:49124) 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f02811b2640 1 -- 172.21.15.28:0/86821786 learned_addr learned my addr 172.21.15.28:0/86821786 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f02819b3640 1 --2- 172.21.15.28:0/86821786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f027c0c5260 0x7f027c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f02821b4640 1 --2- 172.21.15.28:0/86821786 >> v2:172.21.15.134:3300/0 conn(0x7f027c0c60f0 0x7f027c155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f02811b2640 1 -- 172.21.15.28:0/86821786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f027c0c5260 msgr2=0x7f027c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f02811b2640 1 --2- 172.21.15.28:0/86821786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f027c0c5260 0x7f027c06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f02811b2640 1 -- 172.21.15.28:0/86821786 >> v2:172.21.15.134:3300/0 conn(0x7f027c0c60f0 msgr2=0x7f027c155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:40.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f02811b2640 1 --2- 172.21.15.28:0/86821786 >> v2:172.21.15.134:3300/0 conn(0x7f027c0c60f0 0x7f027c155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.497+0000 7f02811b2640 1 -- 172.21.15.28:0/86821786 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0c1ce0 con 0x7f027c0c5640 2023-12-16T03:26:40.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f02811b2640 1 --2- 172.21.15.28:0/86821786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f027c0c5640 0x7f027c0c5bb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f027c06d340 tx=0x7f026c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41611bf5978e5c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:40.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f02809b1640 1 -- 172.21.15.28:0/86821786 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c0ac640 con 0x7f027c0c5640 2023-12-16T03:26:40.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f02809b1640 1 -- 172.21.15.28:0/86821786 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c0ac7a0 con 0x7f027c0c5640 2023-12-16T03:26:40.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f02809b1640 1 -- 172.21.15.28:0/86821786 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c0acb30 con 0x7f027c0c5640 2023-12-16T03:26:40.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f0283c17640 1 -- 172.21.15.28:0/86821786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f027c0c5640 msgr2=0x7f027c0c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f0283c17640 1 --2- 172.21.15.28:0/86821786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f027c0c5640 0x7f027c0c5bb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f027c06d340 tx=0x7f026c01c440 comp rx=0 tx=0).stop 2023-12-16T03:26:40.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f0283c17640 1 -- 172.21.15.28:0/86821786 shutdown_connections 2023-12-16T03:26:40.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f0283c17640 1 --2- 172.21.15.28:0/86821786 >> v2:172.21.15.134:3300/0 conn(0x7f027c0c60f0 0x7f027c155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f0283c17640 1 --2- 172.21.15.28:0/86821786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f027c0c5640 0x7f027c0c5bb0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f0283c17640 1 --2- 172.21.15.28:0/86821786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f027c0c5260 0x7f027c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f0283c17640 1 -- 172.21.15.28:0/86821786 >> 172.21.15.28:0/86821786 conn(0x7f027c06a5b0 msgr2=0x7f027c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:40.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f0283c17640 1 -- 172.21.15.28:0/86821786 shutdown_connections 2023-12-16T03:26:40.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f0283c17640 1 -- 172.21.15.28:0/86821786 wait complete. 2023-12-16T03:26:40.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f0283c17640 1 Processor -- start 2023-12-16T03:26:40.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.501+0000 7f0283c17640 1 -- start start 2023-12-16T03:26:40.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f0283c17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f027c0c5260 0x7f027c1ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f0283c17640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f027c0c5640 0x7f027c151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f0283c17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f027c0c60f0 0x7f027c0aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f0283c17640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c1515d0 con 0x7f027c0c5640 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f0283c17640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c1525b0 con 0x7f027c0c60f0 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f0283c17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c1f0bd0 con 0x7f027c0c5260 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02811b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f027c0c5640 0x7f027c151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02811b2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f027c0c5640 0x7f027c151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49126/0 (socket says 172.21.15.28:49126) 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02811b2640 1 -- 172.21.15.28:0/3878466315 learned_addr learned my addr 172.21.15.28:0/3878466315 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02819b3640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f027c0c5260 0x7f027c1ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02821b4640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f027c0c60f0 0x7f027c0aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02811b2640 1 -- 172.21.15.28:0/3878466315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f027c0c5260 msgr2=0x7f027c1ecc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02811b2640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f027c0c5260 0x7f027c1ecc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02811b2640 1 -- 172.21.15.28:0/3878466315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f027c0c60f0 msgr2=0x7f027c0aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02811b2640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f027c0c60f0 0x7f027c0aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02811b2640 1 -- 172.21.15.28:0/3878466315 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c0094d0 con 0x7f027c0c5640 2023-12-16T03:26:40.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02811b2640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f027c0c5640 0x7f027c151dd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f026c01aaf0 tx=0x7f026c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:40.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02727fc640 1 -- 172.21.15.28:0/3878466315 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c0b5640 con 0x7f027c0c5640 2023-12-16T03:26:40.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02727fc640 1 -- 172.21.15.28:0/3878466315 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c0b57a0 con 0x7f027c0c5640 2023-12-16T03:26:40.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02727fc640 1 -- 172.21.15.28:0/3878466315 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c0b5b30 con 0x7f027c0c5640 2023-12-16T03:26:40.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f0283c17640 1 -- 172.21.15.28:0/3878466315 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c14eeb0 con 0x7f027c0c5640 2023-12-16T03:26:40.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f0283c17640 1 -- 172.21.15.28:0/3878466315 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c1517e0 con 0x7f027c0c5640 2023-12-16T03:26:40.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f0283c17640 1 -- 172.21.15.28:0/3878466315 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c068400 con 0x7f027c0c5640 2023-12-16T03:26:40.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.505+0000 7f02727fc640 1 -- 172.21.15.28:0/3878466315 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f026c0b3070 con 0x7f027c0c5640 2023-12-16T03:26:40.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.509+0000 7f02727fc640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f02600664c0 0x7f0260068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.509+0000 7f02727fc640 1 -- 172.21.15.28:0/3878466315 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f026c11e100 con 0x7f027c0c5640 2023-12-16T03:26:40.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.509+0000 7f02819b3640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f02600664c0 0x7f0260068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.509+0000 7f02819b3640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f02600664c0 0x7f0260068980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f027c14d7a0 tx=0x7f0278009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:40.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.513+0000 7f02727fc640 1 -- 172.21.15.28:0/3878466315 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f026c0eb340 con 0x7f027c0c5640 2023-12-16T03:26:40.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.669+0000 7f0283c17640 1 -- 172.21.15.28:0/3878466315 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f027c1f0d10 con 0x7f027c0c5640 2023-12-16T03:26:40.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.669+0000 7f02727fc640 1 -- 172.21.15.28:0/3878466315 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20229 (secure 0 0 0) 0x7f026c0ee960 con 0x7f027c0c5640 2023-12-16T03:26:40.676 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:40.677 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:21.432053+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:00.659571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:01.837383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 -- 172.21.15.28:0/3878466315 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f02600664c0 msgr2=0x7f0260068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f02600664c0 0x7f0260068980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f027c14d7a0 tx=0x7f0278009190 comp rx=0 tx=0).stop 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 -- 172.21.15.28:0/3878466315 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f027c0c5640 msgr2=0x7f027c151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f027c0c5640 0x7f027c151dd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f026c01aaf0 tx=0x7f026c0191e0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 -- 172.21.15.28:0/3878466315 shutdown_connections 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f027c0c60f0 0x7f027c0aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f02600664c0 0x7f0260068980 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f027c0c5640 0x7f027c151dd0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 --2- 172.21.15.28:0/3878466315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f027c0c5260 0x7f027c1ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 -- 172.21.15.28:0/3878466315 >> 172.21.15.28:0/3878466315 conn(0x7f027c06a5b0 msgr2=0x7f027c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 -- 172.21.15.28:0/3878466315 shutdown_connections 2023-12-16T03:26:40.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.673+0000 7f0283c17640 1 -- 172.21.15.28:0/3878466315 wait complete. 2023-12-16T03:26:40.700 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-16T03:26:40.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.837+0000 7fdb4bd9d640 1 Processor -- start 2023-12-16T03:26:40.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.837+0000 7fdb4bd9d640 1 -- start start 2023-12-16T03:26:40.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb4bd9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdb4414b010 0x7fdb440bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb4bd9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdb44073a70 0x7fdb4406b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb4bd9d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4406a5b0 con 0x7fdb4406b540 2023-12-16T03:26:40.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb4bd9d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb440c1d60 con 0x7fdb44073a70 2023-12-16T03:26:40.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb4bd9d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb440c2040 con 0x7fdb4414b010 2023-12-16T03:26:40.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb49338640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdb44073a70 0x7fdb4406b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb4a33a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdb4406b540 0x7fdb44157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40192/0 (socket says 172.21.15.28:40192) 2023-12-16T03:26:40.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb4a33a640 1 -- 172.21.15.28:0/2124835188 learned_addr learned my addr 172.21.15.28:0/2124835188 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:40.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb49b39640 1 --2- 172.21.15.28:0/2124835188 >> v2:172.21.15.134:3300/0 conn(0x7fdb4414b010 0x7fdb440bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb49338640 1 -- 172.21.15.28:0/2124835188 >> v2:172.21.15.134:3300/0 conn(0x7fdb4414b010 msgr2=0x7fdb440bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:40.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb49338640 1 --2- 172.21.15.28:0/2124835188 >> v2:172.21.15.134:3300/0 conn(0x7fdb4414b010 0x7fdb440bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb49338640 1 -- 172.21.15.28:0/2124835188 >> v1:172.21.15.28:6789/0 conn(0x7fdb4406b540 legacy=0x7fdb44157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb49338640 1 -- 172.21.15.28:0/2124835188 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4406a800 con 0x7fdb44073a70 2023-12-16T03:26:40.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb48b37640 1 -- 172.21.15.28:0/2124835188 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806097355 0 0) 0x7fdb4406a5b0 con 0x7fdb4406b540 2023-12-16T03:26:40.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.841+0000 7fdb49338640 1 --2- 172.21.15.28:0/2124835188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb44073a70 0x7fdb4406b000 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdb44070140 tx=0x7fdb3401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1690af028f63c79 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:40.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb48b37640 1 -- 172.21.15.28:0/2124835188 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340a8950 con 0x7fdb44073a70 2023-12-16T03:26:40.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb48b37640 1 -- 172.21.15.28:0/2124835188 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb340a8ab0 con 0x7fdb44073a70 2023-12-16T03:26:40.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb48b37640 1 -- 172.21.15.28:0/2124835188 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340a8e40 con 0x7fdb44073a70 2023-12-16T03:26:40.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/2124835188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb44073a70 msgr2=0x7fdb4406b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 --2- 172.21.15.28:0/2124835188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb44073a70 0x7fdb4406b000 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdb44070140 tx=0x7fdb3401ec50 comp rx=0 tx=0).stop 2023-12-16T03:26:40.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/2124835188 shutdown_connections 2023-12-16T03:26:40.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 --2- 172.21.15.28:0/2124835188 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb44073a70 0x7fdb4406b000 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 --2- 172.21.15.28:0/2124835188 >> v2:172.21.15.134:3300/0 conn(0x7fdb4414b010 0x7fdb440bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/2124835188 >> 172.21.15.28:0/2124835188 conn(0x7fdb440c30c0 msgr2=0x7fdb440c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:40.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/2124835188 shutdown_connections 2023-12-16T03:26:40.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/2124835188 wait complete. 2023-12-16T03:26:40.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 Processor -- start 2023-12-16T03:26:40.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 -- start start 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb44073a70 0x7fdb440c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb4414b010 0x7fdb44142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb44149890 0x7fdb441434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb44143a00 con 0x7fdb44073a70 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb44149010 con 0x7fdb44149890 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb4bd9d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb441edad0 con 0x7fdb4414b010 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb49b39640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb44073a70 0x7fdb440c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb49b39640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb44073a70 0x7fdb440c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49142/0 (socket says 172.21.15.28:49142) 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.845+0000 7fdb49b39640 1 -- 172.21.15.28:0/609951464 learned_addr learned my addr 172.21.15.28:0/609951464 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb49338640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb4414b010 0x7fdb44142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb4a33a640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb44149890 0x7fdb441434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb49b39640 1 -- 172.21.15.28:0/609951464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb4414b010 msgr2=0x7fdb44142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb49b39640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb4414b010 0x7fdb44142f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb49b39640 1 -- 172.21.15.28:0/609951464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb44149890 msgr2=0x7fdb441434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:40.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb49b39640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb44149890 0x7fdb441434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:40.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb49b39640 1 -- 172.21.15.28:0/609951464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb34009420 con 0x7fdb44073a70 2023-12-16T03:26:40.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb4a33a640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb44149890 0x7fdb441434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:40.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb49b39640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb44073a70 0x7fdb440c5be0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000d620 tx=0x7fdb4000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:40.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb3a7fc640 1 -- 172.21.15.28:0/609951464 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400125f0 con 0x7fdb44073a70 2023-12-16T03:26:40.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb3a7fc640 1 -- 172.21.15.28:0/609951464 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb40012750 con 0x7fdb44073a70 2023-12-16T03:26:40.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb3a7fc640 1 -- 172.21.15.28:0/609951464 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40012ae0 con 0x7fdb44073a70 2023-12-16T03:26:40.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/609951464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb441edf60 con 0x7fdb44073a70 2023-12-16T03:26:40.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/609951464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb441ed480 con 0x7fdb44073a70 2023-12-16T03:26:40.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/609951464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb44068400 con 0x7fdb44073a70 2023-12-16T03:26:40.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb3a7fc640 1 -- 172.21.15.28:0/609951464 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdb40012c40 con 0x7fdb44073a70 2023-12-16T03:26:40.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb3a7fc640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb28066470 0x7fdb28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:40.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb3a7fc640 1 -- 172.21.15.28:0/609951464 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdb40084560 con 0x7fdb44073a70 2023-12-16T03:26:40.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.849+0000 7fdb49338640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb28066470 0x7fdb28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:40.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.853+0000 7fdb49338640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb28066470 0x7fdb28068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdb340b2000 tx=0x7fdb34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:40.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:40.853+0000 7fdb3a7fc640 1 -- 172.21.15.28:0/609951464 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdb40051710 con 0x7fdb44073a70 2023-12-16T03:26:41.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.045+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/609951464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdb44073850 con 0x7fdb44073a70 2023-12-16T03:26:41.052 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-12-16T03:26:41.045+0000 7f6a9e376640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T03:26:41.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.049+0000 7fdb3a7fc640 1 -- 172.21.15.28:0/609951464 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdb40007380 con 0x7fdb44073a70 2023-12-16T03:26:41.055 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-16T03:26:41.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.049+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/609951464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb28066470 msgr2=0x7fdb28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:41.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.049+0000 7fdb4bd9d640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb28066470 0x7fdb28068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdb340b2000 tx=0x7fdb34008040 comp rx=0 tx=0).stop 2023-12-16T03:26:41.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.049+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/609951464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb44073a70 msgr2=0x7fdb440c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:41.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.049+0000 7fdb4bd9d640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb44073a70 0x7fdb440c5be0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000d620 tx=0x7fdb4000dae0 comp rx=0 tx=0).stop 2023-12-16T03:26:41.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.049+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/609951464 shutdown_connections 2023-12-16T03:26:41.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.049+0000 7fdb4bd9d640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb44149890 0x7fdb441434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:41.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.049+0000 7fdb4bd9d640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb4414b010 0x7fdb44142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:41.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.049+0000 7fdb4bd9d640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb28066470 0x7fdb28068930 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:41.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.049+0000 7fdb4bd9d640 1 --2- 172.21.15.28:0/609951464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb44073a70 0x7fdb440c5be0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:41.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.049+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/609951464 >> 172.21.15.28:0/609951464 conn(0x7fdb440c30c0 msgr2=0x7fdb44154f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:41.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.053+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/609951464 shutdown_connections 2023-12-16T03:26:41.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.053+0000 7fdb4bd9d640 1 -- 172.21.15.28:0/609951464 wait complete. 2023-12-16T03:26:41.064 INFO:tasks.ceph.mds.a.smithi028.stderr: -2824> 2023-12-16T03:26:05.998+0000 7ff6985ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:26:41.079 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-16T03:26:41.111 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-12-16T03:26:41.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.221+0000 7f09ed357640 1 Processor -- start 2023-12-16T03:26:41.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.221+0000 7f09ed357640 1 -- start start 2023-12-16T03:26:41.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.221+0000 7f09ed357640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f09e81578f0 0x7f09e80c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:41.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.221+0000 7f09ed357640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e8157cd0 con 0x7f09e80c2840 2023-12-16T03:26:41.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.221+0000 7f09ed357640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e8158850 con 0x7f09e80a6c60 2023-12-16T03:26:41.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.221+0000 7f09ed357640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e80c2e00 con 0x7f09e81578f0 2023-12-16T03:26:41.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.221+0000 7f09e6ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f09e81578f0 0x7f09e80c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:41.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.221+0000 7f09e77fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f09e80c2840 0x7f09e815f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40208/0 (socket says 172.21.15.28:40208) 2023-12-16T03:26:41.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.221+0000 7f09e77fe640 1 -- 172.21.15.28:0/1501003693 learned_addr learned my addr 172.21.15.28:0/1501003693 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:41.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.221+0000 7f09e6ffd640 1 -- 172.21.15.28:0/1501003693 >> v1:172.21.15.134:6789/0 conn(0x7f09e80a6c60 legacy=0x7f09e80c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:41.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.221+0000 7f09e6ffd640 1 -- 172.21.15.28:0/1501003693 >> v1:172.21.15.28:6789/0 conn(0x7f09e80c2840 legacy=0x7f09e815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:41.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09e6ffd640 1 -- 172.21.15.28:0/1501003693 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8157f20 con 0x7f09e81578f0 2023-12-16T03:26:41.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09e6ffd640 1 --2- 172.21.15.28:0/1501003693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e81578f0 0x7f09e80c30e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f09d80097c0 tx=0x7f09d801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c805e2abd4b4a5bc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:41.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09e67fc640 1 -- 172.21.15.28:0/1501003693 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d80ab600 con 0x7f09e81578f0 2023-12-16T03:26:41.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09e67fc640 1 -- 172.21.15.28:0/1501003693 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d80a7050 con 0x7f09e81578f0 2023-12-16T03:26:41.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09e67fc640 1 -- 172.21.15.28:0/1501003693 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d80ab980 con 0x7f09e81578f0 2023-12-16T03:26:41.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09ed357640 1 -- 172.21.15.28:0/1501003693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e81578f0 msgr2=0x7f09e80c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:41.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09ed357640 1 --2- 172.21.15.28:0/1501003693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e81578f0 0x7f09e80c30e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f09d80097c0 tx=0x7f09d801c3f0 comp rx=0 tx=0).stop 2023-12-16T03:26:41.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09ed357640 1 -- 172.21.15.28:0/1501003693 shutdown_connections 2023-12-16T03:26:41.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09ed357640 1 --2- 172.21.15.28:0/1501003693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e81578f0 0x7f09e80c30e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:41.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09ed357640 1 -- 172.21.15.28:0/1501003693 >> 172.21.15.28:0/1501003693 conn(0x7f09e80c7e40 msgr2=0x7f09e80c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:41.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09ed357640 1 -- 172.21.15.28:0/1501003693 shutdown_connections 2023-12-16T03:26:41.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.225+0000 7f09ed357640 1 -- 172.21.15.28:0/1501003693 wait complete. 2023-12-16T03:26:41.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09ed357640 1 Processor -- start 2023-12-16T03:26:41.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09ed357640 1 -- start start 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09ed357640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09e80a6c60 0x7f09e81f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09ed357640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e80c2840 0x7f09e806bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09ed357640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e81578f0 0x7f09e81eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09ed357640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e81ee2b0 con 0x7f09e80c2840 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09ed357640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e81f0ca0 con 0x7f09e80a6c60 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09ed357640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e81f0f80 con 0x7f09e81578f0 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09dffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e80c2840 0x7f09e806bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09dffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e80c2840 0x7f09e806bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49170/0 (socket says 172.21.15.28:49170) 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09dffff640 1 -- 172.21.15.28:0/616699600 learned_addr learned my addr 172.21.15.28:0/616699600 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09e6ffd640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09e80a6c60 0x7f09e81f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09e77fe640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e81578f0 0x7f09e81eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09dffff640 1 -- 172.21.15.28:0/616699600 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e81578f0 msgr2=0x7f09e81eeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09dffff640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e81578f0 0x7f09e81eeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09dffff640 1 -- 172.21.15.28:0/616699600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09e80a6c60 msgr2=0x7f09e81f1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09dffff640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09e80a6c60 0x7f09e81f1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09dffff640 1 -- 172.21.15.28:0/616699600 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d8009420 con 0x7f09e80c2840 2023-12-16T03:26:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09e77fe640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e81578f0 0x7f09e81eeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09dffff640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e80c2840 0x7f09e806bf70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f09d000c390 tx=0x7f09d000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09df7fe640 1 -- 172.21.15.28:0/616699600 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d00052d0 con 0x7f09e80c2840 2023-12-16T03:26:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09df7fe640 1 -- 172.21.15.28:0/616699600 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d0005430 con 0x7f09e80c2840 2023-12-16T03:26:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09df7fe640 1 -- 172.21.15.28:0/616699600 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0003820 con 0x7f09e80c2840 2023-12-16T03:26:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09ed357640 1 -- 172.21.15.28:0/616699600 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e81f1260 con 0x7f09e80c2840 2023-12-16T03:26:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.229+0000 7f09ed357640 1 -- 172.21.15.28:0/616699600 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e81ee550 con 0x7f09e80c2840 2023-12-16T03:26:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.233+0000 7f09ed357640 1 -- 172.21.15.28:0/616699600 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e81f14a0 con 0x7f09e80c2840 2023-12-16T03:26:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.233+0000 7f09df7fe640 1 -- 172.21.15.28:0/616699600 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f09d0003980 con 0x7f09e80c2840 2023-12-16T03:26:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.233+0000 7f09df7fe640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f09c80664a0 0x7f09c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.233+0000 7f09df7fe640 1 -- 172.21.15.28:0/616699600 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f09d00836b0 con 0x7f09e80c2840 2023-12-16T03:26:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.233+0000 7f09e6ffd640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f09c80664a0 0x7f09c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.233+0000 7f09e6ffd640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f09c80664a0 0x7f09c8068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f09d80ad000 tx=0x7f09d80a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.237+0000 7f09df7fe640 1 -- 172.21.15.28:0/616699600 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f09e81f14a0 con 0x7f09e80c2840 2023-12-16T03:26:41.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:41.429+0000 7f09ed357640 1 -- 172.21.15.28:0/616699600 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f09e80c7c10 con 0x7f09e80c2840 2023-12-16T03:26:42.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.049+0000 7f09df7fe640 1 -- 172.21.15.28:0/616699600 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09d0050820 con 0x7f09e80c2840 2023-12-16T03:26:42.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 -- 172.21.15.28:0/616699600 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f09c80664a0 msgr2=0x7f09c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:42.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f09c80664a0 0x7f09c8068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f09d80ad000 tx=0x7f09d80a6000 comp rx=0 tx=0).stop 2023-12-16T03:26:42.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 -- 172.21.15.28:0/616699600 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e80c2840 msgr2=0x7f09e806bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:42.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e80c2840 0x7f09e806bf70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f09d000c390 tx=0x7f09d000c850 comp rx=0 tx=0).stop 2023-12-16T03:26:42.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 -- 172.21.15.28:0/616699600 shutdown_connections 2023-12-16T03:26:42.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e81578f0 0x7f09e81eeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:42.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f09c80664a0 0x7f09c8068960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:42.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e80c2840 0x7f09e806bf70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:42.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 --2- 172.21.15.28:0/616699600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09e80a6c60 0x7f09e81f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:42.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 -- 172.21.15.28:0/616699600 >> 172.21.15.28:0/616699600 conn(0x7f09e80c7e40 msgr2=0x7f09e814b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:42.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 -- 172.21.15.28:0/616699600 shutdown_connections 2023-12-16T03:26:42.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.053+0000 7f09ed357640 1 -- 172.21.15.28:0/616699600 wait complete. 2023-12-16T03:26:42.082 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-16T03:26:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.269+0000 7f689310f640 1 Processor -- start 2023-12-16T03:26:42.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.269+0000 7f689310f640 1 -- start start 2023-12-16T03:26:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f689310f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f688c0c32a0 0x7f688c0c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f689310f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c0aa750 con 0x7f688c0c4fb0 2023-12-16T03:26:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f689310f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c0a8f90 con 0x7f688c06e2a0 2023-12-16T03:26:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f689310f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c0a9270 con 0x7f688c0c32a0 2023-12-16T03:26:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f6890eab640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f688c0c4fb0 0x7f688c06db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40220/0 (socket says 172.21.15.28:40220) 2023-12-16T03:26:42.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f6890eab640 1 -- 172.21.15.28:0/3275685379 learned_addr learned my addr 172.21.15.28:0/3275685379 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f68916ac640 1 --2- 172.21.15.28:0/3275685379 >> v2:172.21.15.134:3300/0 conn(0x7f688c0c32a0 0x7f688c0c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894871208 0 0) 0x7f688c0aa750 con 0x7f688c0c4fb0 2023-12-16T03:26:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f687c005740 con 0x7f688c0c4fb0 2023-12-16T03:26:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1532530436 0 0) 0x7f687c005740 con 0x7f688c0c4fb0 2023-12-16T03:26:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 >> v2:172.21.15.134:3300/0 conn(0x7f688c0c32a0 msgr2=0x7f688c0c1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:42.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 --2- 172.21.15.28:0/3275685379 >> v2:172.21.15.134:3300/0 conn(0x7f688c0c32a0 0x7f688c0c1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 >> v1:172.21.15.134:6789/0 conn(0x7f688c06e2a0 legacy=0x7f688c06c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0a9550 con 0x7f688c0c4fb0 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f6880001680 con 0x7f688c0c4fb0 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 >> v1:172.21.15.28:6789/0 conn(0x7f688c0c4fb0 legacy=0x7f688c06db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 --2- 172.21.15.28:0/3275685379 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f687c005b90 0x7f687c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 --2- 172.21.15.28:0/3275685379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687c0069e0 0x7f687c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 --2- 172.21.15.28:0/3275685379 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f687c0074c0 0x7f687c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0a9270 con 0x7f687c0074c0 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c00e390 con 0x7f687c0069e0 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c00e550 con 0x7f687c005b90 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f68916ac640 1 --2- 172.21.15.28:0/3275685379 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f687c0074c0 0x7f687c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f688bfff640 1 --2- 172.21.15.28:0/3275685379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687c0069e0 0x7f687c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f6890eab640 1 --2- 172.21.15.28:0/3275685379 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f687c005b90 0x7f687c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f68916ac640 1 -- 172.21.15.28:0/3275685379 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f687c005b90 msgr2=0x7f687c005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f68916ac640 1 --2- 172.21.15.28:0/3275685379 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f687c005b90 0x7f687c005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f68916ac640 1 -- 172.21.15.28:0/3275685379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687c0069e0 msgr2=0x7f687c006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f68916ac640 1 --2- 172.21.15.28:0/3275685379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687c0069e0 0x7f687c006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.273+0000 7f68916ac640 1 -- 172.21.15.28:0/3275685379 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c005740 con 0x7f687c0074c0 2023-12-16T03:26:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f68916ac640 1 -- 172.21.15.28:0/3275685379 reap_dead start 2023-12-16T03:26:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f68916ac640 1 --2- 172.21.15.28:0/3275685379 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f687c0074c0 0x7f687c00dba0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6884009f90 tx=0x7f688401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01cf8849b8e553a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:42.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6884003ba0 con 0x7f687c0074c0 2023-12-16T03:26:42.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688400f040 con 0x7f687c0074c0 2023-12-16T03:26:42.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f688b7fe640 1 -- 172.21.15.28:0/3275685379 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840a5970 con 0x7f687c0074c0 2023-12-16T03:26:42.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f689310f640 1 -- 172.21.15.28:0/3275685379 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f687c0074c0 msgr2=0x7f687c00dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:42.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f689310f640 1 --2- 172.21.15.28:0/3275685379 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f687c0074c0 0x7f687c00dba0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6884009f90 tx=0x7f688401cc60 comp rx=0 tx=0).stop 2023-12-16T03:26:42.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f689310f640 1 -- 172.21.15.28:0/3275685379 shutdown_connections 2023-12-16T03:26:42.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f689310f640 1 --2- 172.21.15.28:0/3275685379 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f687c0074c0 0x7f687c00dba0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:42.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f689310f640 1 -- 172.21.15.28:0/3275685379 >> 172.21.15.28:0/3275685379 conn(0x7f688c0c5d40 msgr2=0x7f688c0c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:42.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f689310f640 1 -- 172.21.15.28:0/3275685379 shutdown_connections 2023-12-16T03:26:42.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.277+0000 7f689310f640 1 -- 172.21.15.28:0/3275685379 wait complete. 2023-12-16T03:26:42.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f689310f640 1 Processor -- start 2023-12-16T03:26:42.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f689310f640 1 -- start start 2023-12-16T03:26:42.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f689310f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687c0074c0 0x7f688c0bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:42.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f689310f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f688c14bec0 0x7f688c1ece80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f689310f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f688c0a7fe0 0x7f688c1ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f689310f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c155420 con 0x7f688c14bec0 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f689310f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c154af0 con 0x7f687c0074c0 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f689310f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c154dd0 con 0x7f688c0a7fe0 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f688bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f688c14bec0 0x7f688c1ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f688bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f688c14bec0 0x7f688c1ece80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49192/0 (socket says 172.21.15.28:49192) 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f688bfff640 1 -- 172.21.15.28:0/657731439 learned_addr learned my addr 172.21.15.28:0/657731439 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f6890eab640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687c0074c0 0x7f688c0bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f68916ac640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f688c0a7fe0 0x7f688c1ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f688bfff640 1 -- 172.21.15.28:0/657731439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f688c0a7fe0 msgr2=0x7f688c1ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f688bfff640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f688c0a7fe0 0x7f688c1ed3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f688bfff640 1 -- 172.21.15.28:0/657731439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687c0074c0 msgr2=0x7f688c0bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f688bfff640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687c0074c0 0x7f688c0bf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f688bfff640 1 -- 172.21.15.28:0/657731439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c1550b0 con 0x7f688c14bec0 2023-12-16T03:26:42.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f688bfff640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f688c14bec0 0x7f688c1ece80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f687800e440 tx=0x7f687800e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:42.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f68897fa640 1 -- 172.21.15.28:0/657731439 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780052e0 con 0x7f688c14bec0 2023-12-16T03:26:42.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f68897fa640 1 -- 172.21.15.28:0/657731439 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878005440 con 0x7f688c14bec0 2023-12-16T03:26:42.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f68897fa640 1 -- 172.21.15.28:0/657731439 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878003820 con 0x7f688c14bec0 2023-12-16T03:26:42.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f689310f640 1 -- 172.21.15.28:0/657731439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c0bf910 con 0x7f688c14bec0 2023-12-16T03:26:42.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f689310f640 1 -- 172.21.15.28:0/657731439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c1ed900 con 0x7f688c14bec0 2023-12-16T03:26:42.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.281+0000 7f689310f640 1 -- 172.21.15.28:0/657731439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688c155240 con 0x7f688c14bec0 2023-12-16T03:26:42.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.285+0000 7f68897fa640 1 -- 172.21.15.28:0/657731439 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6878003980 con 0x7f688c14bec0 2023-12-16T03:26:42.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.285+0000 7f68897fa640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6870066470 0x7f6870068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:42.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.285+0000 7f68897fa640 1 -- 172.21.15.28:0/657731439 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f6878083930 con 0x7f688c14bec0 2023-12-16T03:26:42.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.285+0000 7f6890eab640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6870066470 0x7f6870068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:42.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.285+0000 7f6890eab640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6870066470 0x7f6870068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f68800010f0 tx=0x7f6880007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:42.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.289+0000 7f68897fa640 1 -- 172.21.15.28:0/657731439 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6878050aa0 con 0x7f688c14bec0 2023-12-16T03:26:42.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:42.449+0000 7f689310f640 1 -- 172.21.15.28:0/657731439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f688c1edb20 con 0x7f688c14bec0 2023-12-16T03:26:43.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.053+0000 7f68897fa640 1 -- 172.21.15.28:0/657731439 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f68780190d0 con 0x7f688c14bec0 2023-12-16T03:26:43.059 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2023-12-16T03:26:43.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 -- 172.21.15.28:0/657731439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6870066470 msgr2=0x7f6870068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:43.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6870066470 0x7f6870068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f68800010f0 tx=0x7f6880007040 comp rx=0 tx=0).stop 2023-12-16T03:26:43.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 -- 172.21.15.28:0/657731439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f688c14bec0 msgr2=0x7f688c1ece80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:43.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f688c14bec0 0x7f688c1ece80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f687800e440 tx=0x7f687800e840 comp rx=0 tx=0).stop 2023-12-16T03:26:43.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 -- 172.21.15.28:0/657731439 shutdown_connections 2023-12-16T03:26:43.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f688c0a7fe0 0x7f688c1ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:43.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6870066470 0x7f6870068930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:43.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f688c14bec0 0x7f688c1ece80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:43.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 --2- 172.21.15.28:0/657731439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687c0074c0 0x7f688c0bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:43.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 -- 172.21.15.28:0/657731439 >> 172.21.15.28:0/657731439 conn(0x7f688c0c5d40 msgr2=0x7f688c15c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:43.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 -- 172.21.15.28:0/657731439 shutdown_connections 2023-12-16T03:26:43.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.057+0000 7f689310f640 1 -- 172.21.15.28:0/657731439 wait complete. 2023-12-16T03:26:43.086 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-16T03:26:43.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.229+0000 7f5c03365640 1 Processor -- start 2023-12-16T03:26:43.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.229+0000 7f5c03365640 1 -- start start 2023-12-16T03:26:43.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c03365640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5bfc1560c0 0x7f5bfc0c0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:43.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c03365640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bfc0c4cb0 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c03365640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bfc1564a0 con 0x7f5bfc15cb50 2023-12-16T03:26:43.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c03365640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bfc0c0410 con 0x7f5bfc1560c0 2023-12-16T03:26:43.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c01101640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5bfc1560c0 0x7f5bfc0c0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:43.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c01101640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5bfc1560c0 0x7f5bfc0c0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49200/0 (socket says 172.21.15.28:49200) 2023-12-16T03:26:43.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c01101640 1 -- 172.21.15.28:0/524484329 learned_addr learned my addr 172.21.15.28:0/524484329 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:43.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c00900640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5bfc15bfe0 0x7f5bfc15c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40222/0 (socket says 172.21.15.28:40222) 2023-12-16T03:26:43.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c01101640 1 -- 172.21.15.28:0/524484329 >> v1:172.21.15.134:6789/0 conn(0x7f5bfc15cb50 legacy=0x7f5bfc163350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:43.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c01101640 1 -- 172.21.15.28:0/524484329 >> v1:172.21.15.28:6789/0 conn(0x7f5bfc15bfe0 legacy=0x7f5bfc15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:43.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5bf3fff640 1 -- 172.21.15.28:0/524484329 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833745194 0 0) 0x7f5bfc0c4cb0 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c01101640 1 -- 172.21.15.28:0/524484329 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc0c46f0 con 0x7f5bfc1560c0 2023-12-16T03:26:43.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.233+0000 7f5c01101640 1 --2- 172.21.15.28:0/524484329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc1560c0 0x7f5bfc0c0740 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009870 tx=0x7f5bf801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b5e8cfaab82fbe server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:43.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5bf3fff640 1 -- 172.21.15.28:0/524484329 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf80aa430 con 0x7f5bfc1560c0 2023-12-16T03:26:43.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5bf3fff640 1 -- 172.21.15.28:0/524484329 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf80aa590 con 0x7f5bfc1560c0 2023-12-16T03:26:43.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5bf3fff640 1 -- 172.21.15.28:0/524484329 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf80aa920 con 0x7f5bfc1560c0 2023-12-16T03:26:43.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 -- 172.21.15.28:0/524484329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc1560c0 msgr2=0x7f5bfc0c0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:43.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 --2- 172.21.15.28:0/524484329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc1560c0 0x7f5bfc0c0740 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009870 tx=0x7f5bf801c4d0 comp rx=0 tx=0).stop 2023-12-16T03:26:43.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 -- 172.21.15.28:0/524484329 shutdown_connections 2023-12-16T03:26:43.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 --2- 172.21.15.28:0/524484329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc1560c0 0x7f5bfc0c0740 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:43.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 -- 172.21.15.28:0/524484329 >> 172.21.15.28:0/524484329 conn(0x7f5bfc0c5d40 msgr2=0x7f5bfc0c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:43.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 -- 172.21.15.28:0/524484329 shutdown_connections 2023-12-16T03:26:43.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 -- 172.21.15.28:0/524484329 wait complete. 2023-12-16T03:26:43.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 Processor -- start 2023-12-16T03:26:43.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 -- start start 2023-12-16T03:26:43.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bfc1560c0 0x7f5bfc1f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:43.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc15bfe0 0x7f5bfc0a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:43.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bfc15cb50 0x7f5bfc0a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:43.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc1f58b0 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc0c22a0 con 0x7f5bfc15cb50 2023-12-16T03:26:43.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c03365640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc0a74d0 con 0x7f5bfc1560c0 2023-12-16T03:26:43.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c00900640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc15bfe0 0x7f5bfc0a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:43.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c00900640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc15bfe0 0x7f5bfc0a6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49214/0 (socket says 172.21.15.28:49214) 2023-12-16T03:26:43.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.237+0000 7f5c00900640 1 -- 172.21.15.28:0/1240003489 learned_addr learned my addr 172.21.15.28:0/1240003489 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:43.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c01902640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bfc15cb50 0x7f5bfc0a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:43.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c01101640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bfc1560c0 0x7f5bfc1f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:43.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c00900640 1 -- 172.21.15.28:0/1240003489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bfc1560c0 msgr2=0x7f5bfc1f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:43.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c00900640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bfc1560c0 0x7f5bfc1f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:43.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c00900640 1 -- 172.21.15.28:0/1240003489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bfc15cb50 msgr2=0x7f5bfc0a6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:43.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c00900640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bfc15cb50 0x7f5bfc0a6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:43.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c00900640 1 -- 172.21.15.28:0/1240003489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf80094d0 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c01101640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bfc1560c0 0x7f5bfc1f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:43.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c00900640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc15bfe0 0x7f5bfc0a6a50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c520 tx=0x7f5bec00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:43.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5bf1ffb640 1 -- 172.21.15.28:0/1240003489 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0074e0 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5bf1ffb640 1 -- 172.21.15.28:0/1240003489 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec007640 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5bf1ffb640 1 -- 172.21.15.28:0/1240003489 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0049f0 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c03365640 1 -- 172.21.15.28:0/1240003489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bfc1f55d0 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c03365640 1 -- 172.21.15.28:0/1240003489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bfc0c1f30 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5c03365640 1 -- 172.21.15.28:0/1240003489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bfc068400 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5bf1ffb640 1 -- 172.21.15.28:0/1240003489 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5bec004b50 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.241+0000 7f5bf1ffb640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5be0066470 0x7f5be0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:43.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.245+0000 7f5bf1ffb640 1 -- 172.21.15.28:0/1240003489 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f5bec083260 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.245+0000 7f5c01101640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5be0066470 0x7f5be0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:43.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.245+0000 7f5c01101640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5be0066470 0x7f5be0068930 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80ae000 tx=0x7f5bf80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:43.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.245+0000 7f5bf1ffb640 1 -- 172.21.15.28:0/1240003489 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5bec050580 con 0x7f5bfc15bfe0 2023-12-16T03:26:43.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:43.405+0000 7f5c03365640 1 -- 172.21.15.28:0/1240003489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5bfc0c5580 con 0x7f5bfc15bfe0 2023-12-16T03:26:44.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.061+0000 7f5bf1ffb640 1 -- 172.21.15.28:0/1240003489 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5bec053ba0 con 0x7f5bfc15bfe0 2023-12-16T03:26:44.067 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2023-12-16T03:26:44.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 -- 172.21.15.28:0/1240003489 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5be0066470 msgr2=0x7f5be0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5be0066470 0x7f5be0068930 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80ae000 tx=0x7f5bf80a7000 comp rx=0 tx=0).stop 2023-12-16T03:26:44.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 -- 172.21.15.28:0/1240003489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc15bfe0 msgr2=0x7f5bfc0a6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc15bfe0 0x7f5bfc0a6a50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c520 tx=0x7f5bec00c9e0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 -- 172.21.15.28:0/1240003489 shutdown_connections 2023-12-16T03:26:44.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bfc15cb50 0x7f5bfc0a6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5be0066470 0x7f5be0068930 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc15bfe0 0x7f5bfc0a6a50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 --2- 172.21.15.28:0/1240003489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bfc1560c0 0x7f5bfc1f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 -- 172.21.15.28:0/1240003489 >> 172.21.15.28:0/1240003489 conn(0x7f5bfc0c5d40 msgr2=0x7f5bfc0c3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:44.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 -- 172.21.15.28:0/1240003489 shutdown_connections 2023-12-16T03:26:44.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.065+0000 7f5c03365640 1 -- 172.21.15.28:0/1240003489 wait complete. 2023-12-16T03:26:44.095 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:44.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.229+0000 7f3f7032a640 1 Processor -- start 2023-12-16T03:26:44.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.229+0000 7f3f7032a640 1 -- start start 2023-12-16T03:26:44.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f7032a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3f680c63c0 0x7f3f680c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f7032a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3f680c2bb0 0x7f3f680a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f7032a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f680c31c0 con 0x7f3f680c4100 2023-12-16T03:26:44.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f7032a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680c34a0 con 0x7f3f680c63c0 2023-12-16T03:26:44.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f7032a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680c1030 con 0x7f3f680c2bb0 2023-12-16T03:26:44.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f6e0c6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3f680c63c0 0x7f3f680c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f6e0c6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3f680c63c0 0x7f3f680c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49226/0 (socket says 172.21.15.28:49226) 2023-12-16T03:26:44.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f6e0c6640 1 -- 172.21.15.28:0/3770750144 learned_addr learned my addr 172.21.15.28:0/3770750144 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:44.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f6e8c7640 1 --2- 172.21.15.28:0/3770750144 >> v2:172.21.15.134:3300/0 conn(0x7f3f680c2bb0 0x7f3f680a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f6e0c6640 1 -- 172.21.15.28:0/3770750144 >> v2:172.21.15.134:3300/0 conn(0x7f3f680c2bb0 msgr2=0x7f3f680a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:44.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f6e0c6640 1 --2- 172.21.15.28:0/3770750144 >> v2:172.21.15.134:3300/0 conn(0x7f3f680c2bb0 0x7f3f680a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f6e0c6640 1 -- 172.21.15.28:0/3770750144 >> v1:172.21.15.134:6789/0 conn(0x7f3f680c4100 legacy=0x7f3f680c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:44.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.233+0000 7f3f6e0c6640 1 -- 172.21.15.28:0/3770750144 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680c1310 con 0x7f3f680c63c0 2023-12-16T03:26:44.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f6e0c6640 1 --2- 172.21.15.28:0/3770750144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f680c63c0 0x7f3f680c06d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3f680c4550 tx=0x7f3f6401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5835ec0c1761c08c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:44.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f6d0c4640 1 -- 172.21.15.28:0/3770750144 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680aa3d0 con 0x7f3f680c63c0 2023-12-16T03:26:44.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f6d0c4640 1 -- 172.21.15.28:0/3770750144 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f640ac620 con 0x7f3f680c63c0 2023-12-16T03:26:44.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f6d0c4640 1 -- 172.21.15.28:0/3770750144 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f640ac9b0 con 0x7f3f680c63c0 2023-12-16T03:26:44.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f7032a640 1 -- 172.21.15.28:0/3770750144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f680c63c0 msgr2=0x7f3f680c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f7032a640 1 --2- 172.21.15.28:0/3770750144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f680c63c0 0x7f3f680c06d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3f680c4550 tx=0x7f3f6401c3a0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f7032a640 1 -- 172.21.15.28:0/3770750144 shutdown_connections 2023-12-16T03:26:44.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f7032a640 1 --2- 172.21.15.28:0/3770750144 >> v2:172.21.15.134:3300/0 conn(0x7f3f680c2bb0 0x7f3f680a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f7032a640 1 --2- 172.21.15.28:0/3770750144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f680c63c0 0x7f3f680c06d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f7032a640 1 -- 172.21.15.28:0/3770750144 >> 172.21.15.28:0/3770750144 conn(0x7f3f6806a5b0 msgr2=0x7f3f6806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:44.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f7032a640 1 -- 172.21.15.28:0/3770750144 shutdown_connections 2023-12-16T03:26:44.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f7032a640 1 -- 172.21.15.28:0/3770750144 wait complete. 2023-12-16T03:26:44.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f7032a640 1 Processor -- start 2023-12-16T03:26:44.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.237+0000 7f3f7032a640 1 -- start start 2023-12-16T03:26:44.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f7032a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f680c2bb0 0x7f3f6815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f7032a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f680c4100 0x7f3f6814b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f7032a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f680c63c0 0x7f3f6814bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f7032a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f68155440 con 0x7f3f680c4100 2023-12-16T03:26:44.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f7032a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f681f19c0 con 0x7f3f680c2bb0 2023-12-16T03:26:44.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f7032a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f681ee430 con 0x7f3f680c63c0 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6d8c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f680c4100 0x7f3f6814b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6d8c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f680c4100 0x7f3f6814b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49236/0 (socket says 172.21.15.28:49236) 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6d8c5640 1 -- 172.21.15.28:0/921797393 learned_addr learned my addr 172.21.15.28:0/921797393 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6e0c6640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f680c2bb0 0x7f3f6815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6e8c7640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f680c63c0 0x7f3f6814bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6d8c5640 1 -- 172.21.15.28:0/921797393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f680c63c0 msgr2=0x7f3f6814bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6d8c5640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f680c63c0 0x7f3f6814bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6d8c5640 1 -- 172.21.15.28:0/921797393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f680c2bb0 msgr2=0x7f3f6815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6d8c5640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f680c2bb0 0x7f3f6815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6d8c5640 1 -- 172.21.15.28:0/921797393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f640094d0 con 0x7f3f680c4100 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6e8c7640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f680c63c0 0x7f3f6814bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f6d8c5640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f680c4100 0x7f3f6814b800 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800c450 tx=0x7f3f5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f5effd640 1 -- 172.21.15.28:0/921797393 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58012830 con 0x7f3f680c4100 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f5effd640 1 -- 172.21.15.28:0/921797393 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f580129b0 con 0x7f3f680c4100 2023-12-16T03:26:44.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f7032a640 1 -- 172.21.15.28:0/921797393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6814c280 con 0x7f3f680c4100 2023-12-16T03:26:44.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f5effd640 1 -- 172.21.15.28:0/921797393 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58012d60 con 0x7f3f680c4100 2023-12-16T03:26:44.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f7032a640 1 -- 172.21.15.28:0/921797393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f681ed960 con 0x7f3f680c4100 2023-12-16T03:26:44.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f7032a640 1 -- 172.21.15.28:0/921797393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f68153ad0 con 0x7f3f680c4100 2023-12-16T03:26:44.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.241+0000 7f3f5effd640 1 -- 172.21.15.28:0/921797393 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3f5801c460 con 0x7f3f680c4100 2023-12-16T03:26:44.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.245+0000 7f3f5effd640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f4c066470 0x7f3f4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.245+0000 7f3f5effd640 1 -- 172.21.15.28:0/921797393 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f3f58083d10 con 0x7f3f680c4100 2023-12-16T03:26:44.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.245+0000 7f3f6e0c6640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f4c066470 0x7f3f4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.245+0000 7f3f6e0c6640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f4c066470 0x7f3f4c068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3f640ae000 tx=0x7f3f64008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:44.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.249+0000 7f3f5effd640 1 -- 172.21.15.28:0/921797393 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3f68153ad0 con 0x7f3f680c4100 2023-12-16T03:26:44.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.405+0000 7f3f7032a640 1 -- 172.21.15.28:0/921797393 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f68153ad0 con 0x7f3f680c4100 2023-12-16T03:26:44.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.405+0000 7f3f5effd640 1 -- 172.21.15.28:0/921797393 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16646 (secure 0 0 0) 0x7f3f68153ad0 con 0x7f3f680c4100 2023-12-16T03:26:44.412 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:44.412 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":39,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:44.059179+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6837/1004873879":"2023-12-17T03:26:41.051540+0000","172.21.15.28:6835/1004873879":"2023-12-17T03:26:41.051540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 -- 172.21.15.28:0/921797393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f4c066470 msgr2=0x7f3f4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f4c066470 0x7f3f4c068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3f640ae000 tx=0x7f3f64008040 comp rx=0 tx=0).stop 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 -- 172.21.15.28:0/921797393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f680c4100 msgr2=0x7f3f6814b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f680c4100 0x7f3f6814b800 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800c450 tx=0x7f3f5800c910 comp rx=0 tx=0).stop 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 -- 172.21.15.28:0/921797393 shutdown_connections 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f680c63c0 0x7f3f6814bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3f4c066470 0x7f3f4c068930 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f680c4100 0x7f3f6814b800 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 --2- 172.21.15.28:0/921797393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f680c2bb0 0x7f3f6815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 -- 172.21.15.28:0/921797393 >> 172.21.15.28:0/921797393 conn(0x7f3f6806a5b0 msgr2=0x7f3f6806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 -- 172.21.15.28:0/921797393 shutdown_connections 2023-12-16T03:26:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.409+0000 7f3f7032a640 1 -- 172.21.15.28:0/921797393 wait complete. 2023-12-16T03:26:44.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:26:18.527469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:26:18.979011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:26:44.433 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:26:44.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.577+0000 7f70f32e3640 1 Processor -- start 2023-12-16T03:26:44.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.577+0000 7f70f32e3640 1 -- start start 2023-12-16T03:26:44.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.577+0000 7f70f32e3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f70ec1560e0 0x7f70ec15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.577+0000 7f70f32e3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f70ec06d520 0x7f70ec159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.577+0000 7f70f32e3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec15c600 con 0x7f70ec0bffc0 2023-12-16T03:26:44.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.577+0000 7f70f32e3640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec1594e0 con 0x7f70ec06d520 2023-12-16T03:26:44.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.577+0000 7f70f32e3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec1597c0 con 0x7f70ec1560e0 2023-12-16T03:26:44.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.577+0000 7f70f087e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f70ec06d520 0x7f70ec159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.577+0000 7f70f1880640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f70ec0bffc0 0x7f70ec0c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40230/0 (socket says 172.21.15.28:40230) 2023-12-16T03:26:44.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.577+0000 7f70f1880640 1 -- 172.21.15.28:0/3780034266 learned_addr learned my addr 172.21.15.28:0/3780034266 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:44.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.577+0000 7f70f107f640 1 --2- 172.21.15.28:0/3780034266 >> v2:172.21.15.134:3300/0 conn(0x7f70ec1560e0 0x7f70ec15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f087e640 1 -- 172.21.15.28:0/3780034266 >> v2:172.21.15.134:3300/0 conn(0x7f70ec1560e0 msgr2=0x7f70ec15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:44.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f087e640 1 --2- 172.21.15.28:0/3780034266 >> v2:172.21.15.134:3300/0 conn(0x7f70ec1560e0 0x7f70ec15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f087e640 1 -- 172.21.15.28:0/3780034266 >> v1:172.21.15.28:6789/0 conn(0x7f70ec0bffc0 legacy=0x7f70ec0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f087e640 1 -- 172.21.15.28:0/3780034266 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec15bfb0 con 0x7f70ec06d520 2023-12-16T03:26:44.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70e3fff640 1 -- 172.21.15.28:0/3780034266 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157233449 0 0) 0x7f70ec15c600 con 0x7f70ec0bffc0 2023-12-16T03:26:44.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f087e640 1 --2- 172.21.15.28:0/3780034266 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70ec06d520 0x7f70ec159eb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f70ec06b390 tx=0x7f70dc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ffe7dbb7a16593 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:44.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70e3fff640 1 -- 172.21.15.28:0/3780034266 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec1566d0 con 0x7f70ec06d520 2023-12-16T03:26:44.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70e3fff640 1 -- 172.21.15.28:0/3780034266 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc0ab650 con 0x7f70ec06d520 2023-12-16T03:26:44.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70e3fff640 1 -- 172.21.15.28:0/3780034266 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0ab9e0 con 0x7f70ec06d520 2023-12-16T03:26:44.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f32e3640 1 -- 172.21.15.28:0/3780034266 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70ec06d520 msgr2=0x7f70ec159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f32e3640 1 --2- 172.21.15.28:0/3780034266 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70ec06d520 0x7f70ec159eb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f70ec06b390 tx=0x7f70dc01c430 comp rx=0 tx=0).stop 2023-12-16T03:26:44.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f32e3640 1 -- 172.21.15.28:0/3780034266 shutdown_connections 2023-12-16T03:26:44.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f32e3640 1 --2- 172.21.15.28:0/3780034266 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70ec06d520 0x7f70ec159eb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f32e3640 1 --2- 172.21.15.28:0/3780034266 >> v2:172.21.15.134:3300/0 conn(0x7f70ec1560e0 0x7f70ec15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f32e3640 1 -- 172.21.15.28:0/3780034266 >> 172.21.15.28:0/3780034266 conn(0x7f70ec06a5b0 msgr2=0x7f70ec06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:44.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f32e3640 1 -- 172.21.15.28:0/3780034266 shutdown_connections 2023-12-16T03:26:44.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.581+0000 7f70f32e3640 1 -- 172.21.15.28:0/3780034266 wait complete. 2023-12-16T03:26:44.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f32e3640 1 Processor -- start 2023-12-16T03:26:44.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f32e3640 1 -- start start 2023-12-16T03:26:44.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f32e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70ec06d520 0x7f70ec1f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f32e3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70ec0bffc0 0x7f70ec14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f32e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ec1560e0 0x7f70ec0a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f32e3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0c3f10 con 0x7f70ec06d520 2023-12-16T03:26:44.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f32e3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0c5880 con 0x7f70ec1560e0 2023-12-16T03:26:44.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f32e3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec0c4160 con 0x7f70ec0bffc0 2023-12-16T03:26:44.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f107f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70ec06d520 0x7f70ec1f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f107f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70ec06d520 0x7f70ec1f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49248/0 (socket says 172.21.15.28:49248) 2023-12-16T03:26:44.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f107f640 1 -- 172.21.15.28:0/863142553 learned_addr learned my addr 172.21.15.28:0/863142553 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:44.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f1880640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ec1560e0 0x7f70ec0a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f087e640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70ec0bffc0 0x7f70ec14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f107f640 1 -- 172.21.15.28:0/863142553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70ec0bffc0 msgr2=0x7f70ec14f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f107f640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70ec0bffc0 0x7f70ec14f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f107f640 1 -- 172.21.15.28:0/863142553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ec1560e0 msgr2=0x7f70ec0a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f107f640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ec1560e0 0x7f70ec0a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f107f640 1 -- 172.21.15.28:0/863142553 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc009420 con 0x7f70ec06d520 2023-12-16T03:26:44.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f107f640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70ec06d520 0x7f70ec1f46b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f70e800d5f0 tx=0x7f70e800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:44.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70e1ffb640 1 -- 172.21.15.28:0/863142553 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80125f0 con 0x7f70ec06d520 2023-12-16T03:26:44.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70e1ffb640 1 -- 172.21.15.28:0/863142553 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8012750 con 0x7f70ec06d520 2023-12-16T03:26:44.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70e1ffb640 1 -- 172.21.15.28:0/863142553 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8012ae0 con 0x7f70ec06d520 2023-12-16T03:26:44.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.585+0000 7f70f32e3640 1 -- 172.21.15.28:0/863142553 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ec0c4440 con 0x7f70ec06d520 2023-12-16T03:26:44.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.589+0000 7f70f32e3640 1 -- 172.21.15.28:0/863142553 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec0a8f20 con 0x7f70ec06d520 2023-12-16T03:26:44.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.589+0000 7f70f32e3640 1 -- 172.21.15.28:0/863142553 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ec0a8d80 con 0x7f70ec06d520 2023-12-16T03:26:44.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.589+0000 7f70e1ffb640 1 -- 172.21.15.28:0/863142553 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f70e8012c40 con 0x7f70ec06d520 2023-12-16T03:26:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.589+0000 7f70e1ffb640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70d00664a0 0x7f70d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.589+0000 7f70e1ffb640 1 -- 172.21.15.28:0/863142553 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f70e8084260 con 0x7f70ec06d520 2023-12-16T03:26:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.589+0000 7f70f087e640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70d00664a0 0x7f70d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.589+0000 7f70f087e640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70d00664a0 0x7f70d0068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0af000 tx=0x7f70dc0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:44.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.593+0000 7f70e1ffb640 1 -- 172.21.15.28:0/863142553 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f70ec0a8d80 con 0x7f70ec06d520 2023-12-16T03:26:44.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.749+0000 7f70f32e3640 1 -- 172.21.15.28:0/863142553 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70ec0a8d80 con 0x7f70ec06d520 2023-12-16T03:26:44.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70e1ffb640 1 -- 172.21.15.28:0/863142553 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70ec0a8d80 con 0x7f70ec06d520 2023-12-16T03:26:44.757 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:26:44.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 -- 172.21.15.28:0/863142553 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70d00664a0 msgr2=0x7f70d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70d00664a0 0x7f70d0068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0af000 tx=0x7f70dc0a7000 comp rx=0 tx=0).stop 2023-12-16T03:26:44.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 -- 172.21.15.28:0/863142553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70ec06d520 msgr2=0x7f70ec1f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70ec06d520 0x7f70ec1f46b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f70e800d5f0 tx=0x7f70e800dab0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 -- 172.21.15.28:0/863142553 shutdown_connections 2023-12-16T03:26:44.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70ec1560e0 0x7f70ec0a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f70ec0bffc0 0x7f70ec14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f70d00664a0 0x7f70d0068960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 --2- 172.21.15.28:0/863142553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70ec06d520 0x7f70ec1f46b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 -- 172.21.15.28:0/863142553 >> 172.21.15.28:0/863142553 conn(0x7f70ec06a5b0 msgr2=0x7f70ec0a7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:44.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 -- 172.21.15.28:0/863142553 shutdown_connections 2023-12-16T03:26:44.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.753+0000 7f70f32e3640 1 -- 172.21.15.28:0/863142553 wait complete. 2023-12-16T03:26:44.779 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:26:44.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.917+0000 7fe1688f5640 1 Processor -- start 2023-12-16T03:26:44.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.917+0000 7fe1688f5640 1 -- start start 2023-12-16T03:26:44.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe1688f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1640c7c50 0x7fe1641544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe1688f5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe164154a10 0x7fe16415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe1688f5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1640c8160 con 0x7fe164151cd0 2023-12-16T03:26:44.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe1688f5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe164154ea0 con 0x7fe164154a10 2023-12-16T03:26:44.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe1688f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe164157b40 con 0x7fe1640c7c50 2023-12-16T03:26:44.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe163fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe164154a10 0x7fe16415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe162ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1640c7c50 0x7fe1641544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe163fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe164154a10 0x7fe16415ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:44332/0 (socket says 172.21.15.28:44332) 2023-12-16T03:26:44.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe162ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1640c7c50 0x7fe1641544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:39658/0 (socket says 172.21.15.28:39658) 2023-12-16T03:26:44.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe1637fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe164151cd0 0x7fe1640ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:41392/0 (socket says 172.21.15.28:41392) 2023-12-16T03:26:44.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe163fff640 1 -- 172.21.15.28:0/2796107552 learned_addr learned my addr 172.21.15.28:0/2796107552 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:44.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe162ffd640 1 -- 172.21.15.28:0/2796107552 >> v2:172.21.15.134:3300/0 conn(0x7fe164154a10 msgr2=0x7fe16415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:44.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe162ffd640 1 --2- 172.21.15.28:0/2796107552 >> v2:172.21.15.134:3300/0 conn(0x7fe164154a10 0x7fe16415ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe162ffd640 1 -- 172.21.15.28:0/2796107552 >> v1:172.21.15.134:6789/0 conn(0x7fe164151cd0 legacy=0x7fe1640ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe162ffd640 1 -- 172.21.15.28:0/2796107552 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164157e20 con 0x7fe1640c7c50 2023-12-16T03:26:44.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.921+0000 7fe163fff640 1 --2- 172.21.15.28:0/2796107552 >> v2:172.21.15.134:3300/0 conn(0x7fe164154a10 0x7fe16415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:44.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe162ffd640 1 --2- 172.21.15.28:0/2796107552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1640c7c50 0x7fe1641544d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1580097c0 tx=0x7fe15801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=306f9d751dd717cd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:44.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1627fc640 1 -- 172.21.15.28:0/2796107552 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1580ab650 con 0x7fe1640c7c50 2023-12-16T03:26:44.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1627fc640 1 -- 172.21.15.28:0/2796107552 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1580ab7b0 con 0x7fe1640c7c50 2023-12-16T03:26:44.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1627fc640 1 -- 172.21.15.28:0/2796107552 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1580abb40 con 0x7fe1640c7c50 2023-12-16T03:26:44.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1688f5640 1 -- 172.21.15.28:0/2796107552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1640c7c50 msgr2=0x7fe1641544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1688f5640 1 --2- 172.21.15.28:0/2796107552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1640c7c50 0x7fe1641544d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1580097c0 tx=0x7fe15801c450 comp rx=0 tx=0).stop 2023-12-16T03:26:44.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1688f5640 1 -- 172.21.15.28:0/2796107552 shutdown_connections 2023-12-16T03:26:44.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1688f5640 1 --2- 172.21.15.28:0/2796107552 >> v2:172.21.15.134:3300/0 conn(0x7fe164154a10 0x7fe16415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1688f5640 1 --2- 172.21.15.28:0/2796107552 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1640c7c50 0x7fe1641544d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1688f5640 1 -- 172.21.15.28:0/2796107552 >> 172.21.15.28:0/2796107552 conn(0x7fe1640abee0 msgr2=0x7fe1640c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:44.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1688f5640 1 -- 172.21.15.28:0/2796107552 shutdown_connections 2023-12-16T03:26:44.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1688f5640 1 -- 172.21.15.28:0/2796107552 wait complete. 2023-12-16T03:26:44.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1688f5640 1 Processor -- start 2023-12-16T03:26:44.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.925+0000 7fe1688f5640 1 -- start start 2023-12-16T03:26:44.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1688f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1640c7c50 0x7fe164156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1688f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe164151cd0 0x7fe1640aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1688f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe164154a10 0x7fe1641f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1688f5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1641f1c10 con 0x7fe1640c7c50 2023-12-16T03:26:44.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1688f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe164145930 con 0x7fe164151cd0 2023-12-16T03:26:44.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1688f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1641570e0 con 0x7fe164154a10 2023-12-16T03:26:44.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1637fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1640c7c50 0x7fe164156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1637fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1640c7c50 0x7fe164156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49252/0 (socket says 172.21.15.28:49252) 2023-12-16T03:26:44.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1637fe640 1 -- 172.21.15.28:0/927043712 learned_addr learned my addr 172.21.15.28:0/927043712 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:44.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe162ffd640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe164151cd0 0x7fe1640aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe163fff640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe164154a10 0x7fe1641f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1637fe640 1 -- 172.21.15.28:0/927043712 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe164154a10 msgr2=0x7fe1641f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1637fe640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe164154a10 0x7fe1641f16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1637fe640 1 -- 172.21.15.28:0/927043712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe164151cd0 msgr2=0x7fe1640aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:44.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1637fe640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe164151cd0 0x7fe1640aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:44.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1637fe640 1 -- 172.21.15.28:0/927043712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c009b30 con 0x7fe1640c7c50 2023-12-16T03:26:44.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1637fe640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1640c7c50 0x7fe164156a70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe15400c490 tx=0x7fe15400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:44.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe14bfff640 1 -- 172.21.15.28:0/927043712 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154007480 con 0x7fe1640c7c50 2023-12-16T03:26:44.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe14bfff640 1 -- 172.21.15.28:0/927043712 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1540075e0 con 0x7fe1640c7c50 2023-12-16T03:26:44.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe14bfff640 1 -- 172.21.15.28:0/927043712 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154004a10 con 0x7fe1640c7c50 2023-12-16T03:26:44.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1688f5640 1 -- 172.21.15.28:0/927043712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe158009420 con 0x7fe1640c7c50 2023-12-16T03:26:44.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1688f5640 1 -- 172.21.15.28:0/927043712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1641455c0 con 0x7fe1640c7c50 2023-12-16T03:26:44.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe1688f5640 1 -- 172.21.15.28:0/927043712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1640c6120 con 0x7fe1640c7c50 2023-12-16T03:26:44.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.929+0000 7fe14bfff640 1 -- 172.21.15.28:0/927043712 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe154004b70 con 0x7fe1640c7c50 2023-12-16T03:26:44.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.933+0000 7fe14bfff640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe150066470 0x7fe150068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:44.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.933+0000 7fe14bfff640 1 -- 172.21.15.28:0/927043712 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fe154083040 con 0x7fe1640c7c50 2023-12-16T03:26:44.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.933+0000 7fe162ffd640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe150066470 0x7fe150068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:44.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.933+0000 7fe162ffd640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe150066470 0x7fe150068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe1580af000 tx=0x7fe1580a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:44.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:44.937+0000 7fe14bfff640 1 -- 172.21.15.28:0/927043712 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe1540b4290 con 0x7fe1640c7c50 2023-12-16T03:26:45.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 -- 172.21.15.28:0/927043712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe16404e850 con 0x7fe1640c7c50 2023-12-16T03:26:45.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe14bfff640 1 -- 172.21.15.28:0/927043712 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v39) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe1540180b0 con 0x7fe1640c7c50 2023-12-16T03:26:45.115 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:26:45.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 -- 172.21.15.28:0/927043712 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe150066470 msgr2=0x7fe150068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe150066470 0x7fe150068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe1580af000 tx=0x7fe1580a7000 comp rx=0 tx=0).stop 2023-12-16T03:26:45.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 -- 172.21.15.28:0/927043712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1640c7c50 msgr2=0x7fe164156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1640c7c50 0x7fe164156a70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe15400c490 tx=0x7fe15400c950 comp rx=0 tx=0).stop 2023-12-16T03:26:45.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 -- 172.21.15.28:0/927043712 shutdown_connections 2023-12-16T03:26:45.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe164154a10 0x7fe1641f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe164151cd0 0x7fe1640aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe150066470 0x7fe150068930 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 --2- 172.21.15.28:0/927043712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1640c7c50 0x7fe164156a70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 -- 172.21.15.28:0/927043712 >> 172.21.15.28:0/927043712 conn(0x7fe1640abee0 msgr2=0x7fe16414fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:45.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 -- 172.21.15.28:0/927043712 shutdown_connections 2023-12-16T03:26:45.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.109+0000 7fe1688f5640 1 -- 172.21.15.28:0/927043712 wait complete. 2023-12-16T03:26:45.136 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:26:45.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.273+0000 7f9f8fb57640 1 Processor -- start 2023-12-16T03:26:45.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.273+0000 7f9f8fb57640 1 -- start start 2023-12-16T03:26:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8fb57640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9f8806d520 0x7f9f8815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8fb57640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f880bffc0 0x7f9f880c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8fb57640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8815c600 con 0x7f9f881560e0 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8fb57640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8815a5c0 con 0x7f9f880bffc0 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8fb57640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f881594e0 con 0x7f9f8806d520 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8e0f4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f880bffc0 0x7f9f880c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8e0f4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f880bffc0 0x7f9f880c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49264/0 (socket says 172.21.15.28:49264) 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8e0f4640 1 -- 172.21.15.28:0/2069608417 learned_addr learned my addr 172.21.15.28:0/2069608417 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8d0f2640 1 --2- 172.21.15.28:0/2069608417 >> v2:172.21.15.134:3300/0 conn(0x7f9f8806d520 0x7f9f8815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8e0f4640 1 -- 172.21.15.28:0/2069608417 >> v2:172.21.15.134:3300/0 conn(0x7f9f8806d520 msgr2=0x7f9f8815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8e0f4640 1 --2- 172.21.15.28:0/2069608417 >> v2:172.21.15.134:3300/0 conn(0x7f9f8806d520 0x7f9f8815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8e0f4640 1 -- 172.21.15.28:0/2069608417 >> v1:172.21.15.134:6789/0 conn(0x7f9f881560e0 legacy=0x7f9f88159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.277+0000 7f9f8e0f4640 1 -- 172.21.15.28:0/2069608417 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f881597c0 con 0x7f9f880bffc0 2023-12-16T03:26:45.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8e0f4640 1 --2- 172.21.15.28:0/2069608417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f880bffc0 0x7f9f880c1bf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9f880c1330 tx=0x7f9f8001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fe2ef9c5876d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:45.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8c8f1640 1 -- 172.21.15.28:0/2069608417 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800a5770 con 0x7f9f880bffc0 2023-12-16T03:26:45.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8c8f1640 1 -- 172.21.15.28:0/2069608417 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f800a58d0 con 0x7f9f880bffc0 2023-12-16T03:26:45.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8c8f1640 1 -- 172.21.15.28:0/2069608417 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800a5c60 con 0x7f9f880bffc0 2023-12-16T03:26:45.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2069608417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f880bffc0 msgr2=0x7f9f880c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8fb57640 1 --2- 172.21.15.28:0/2069608417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f880bffc0 0x7f9f880c1bf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9f880c1330 tx=0x7f9f8001c9a0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2069608417 shutdown_connections 2023-12-16T03:26:45.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8fb57640 1 --2- 172.21.15.28:0/2069608417 >> v2:172.21.15.134:3300/0 conn(0x7f9f8806d520 0x7f9f8815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8fb57640 1 --2- 172.21.15.28:0/2069608417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f880bffc0 0x7f9f880c1bf0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2069608417 >> 172.21.15.28:0/2069608417 conn(0x7f9f8806a5b0 msgr2=0x7f9f8806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:45.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2069608417 shutdown_connections 2023-12-16T03:26:45.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2069608417 wait complete. 2023-12-16T03:26:45.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8fb57640 1 Processor -- start 2023-12-16T03:26:45.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.281+0000 7f9f8fb57640 1 -- start start 2023-12-16T03:26:45.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8fb57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8806d520 0x7f9f880c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8fb57640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f880bffc0 0x7f9f88155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8fb57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f881560e0 0x7f9f8814cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8fb57640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880a76f0 con 0x7f9f880bffc0 2023-12-16T03:26:45.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8fb57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880c62f0 con 0x7f9f881560e0 2023-12-16T03:26:45.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8fb57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f881f46e0 con 0x7f9f8806d520 2023-12-16T03:26:45.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8d0f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f880bffc0 0x7f9f88155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8d0f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f880bffc0 0x7f9f88155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49276/0 (socket says 172.21.15.28:49276) 2023-12-16T03:26:45.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8d0f2640 1 -- 172.21.15.28:0/2124360327 learned_addr learned my addr 172.21.15.28:0/2124360327 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:45.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8d8f3640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8806d520 0x7f9f880c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8e0f4640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f881560e0 0x7f9f8814cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8d0f2640 1 -- 172.21.15.28:0/2124360327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8806d520 msgr2=0x7f9f880c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8d0f2640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8806d520 0x7f9f880c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8d0f2640 1 -- 172.21.15.28:0/2124360327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f881560e0 msgr2=0x7f9f8814cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8d0f2640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f881560e0 0x7f9f8814cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8d0f2640 1 -- 172.21.15.28:0/2124360327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80009b30 con 0x7f9f880bffc0 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8d0f2640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f880bffc0 0x7f9f88155260 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800d800 tx=0x7f9f7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f7e7fc640 1 -- 172.21.15.28:0/2124360327 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7800b6c0 con 0x7f9f880bffc0 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f7e7fc640 1 -- 172.21.15.28:0/2124360327 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7800b840 con 0x7f9f880bffc0 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f7e7fc640 1 -- 172.21.15.28:0/2124360327 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7800bbf0 con 0x7f9f880bffc0 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2124360327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f881f49c0 con 0x7f9f880bffc0 2023-12-16T03:26:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2124360327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f881f4f80 con 0x7f9f880bffc0 2023-12-16T03:26:45.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2124360327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f88068400 con 0x7f9f880bffc0 2023-12-16T03:26:45.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.285+0000 7f9f7e7fc640 1 -- 172.21.15.28:0/2124360327 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9f7800bd50 con 0x7f9f880bffc0 2023-12-16T03:26:45.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.289+0000 7f9f7e7fc640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f6c0664c0 0x7f9f6c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.289+0000 7f9f7e7fc640 1 -- 172.21.15.28:0/2124360327 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9f78084350 con 0x7f9f880bffc0 2023-12-16T03:26:45.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.289+0000 7f9f8d8f3640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f6c0664c0 0x7f9f6c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.289+0000 7f9f8d8f3640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f6c0664c0 0x7f9f6c068980 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9f880c20c0 tx=0x7f9f84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:45.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.293+0000 7f9f7e7fc640 1 -- 172.21.15.28:0/2124360327 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9f78051800 con 0x7f9f880bffc0 2023-12-16T03:26:45.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.445+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2124360327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9f880c3cf0 con 0x7f9f880bffc0 2023-12-16T03:26:45.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.445+0000 7f9f7e7fc640 1 -- 172.21.15.28:0/2124360327 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v39) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9f78054e20 con 0x7f9f880bffc0 2023-12-16T03:26:45.453 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:26:45.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2124360327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f6c0664c0 msgr2=0x7f9f6c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f6c0664c0 0x7f9f6c068980 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9f880c20c0 tx=0x7f9f84009040 comp rx=0 tx=0).stop 2023-12-16T03:26:45.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2124360327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f880bffc0 msgr2=0x7f9f88155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f880bffc0 0x7f9f88155260 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800d800 tx=0x7f9f7800dcc0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2124360327 shutdown_connections 2023-12-16T03:26:45.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f881560e0 0x7f9f8814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f6c0664c0 0x7f9f6c068980 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f880bffc0 0x7f9f88155260 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 --2- 172.21.15.28:0/2124360327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f8806d520 0x7f9f880c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2124360327 >> 172.21.15.28:0/2124360327 conn(0x7f9f8806a5b0 msgr2=0x7f9f8806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:45.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2124360327 shutdown_connections 2023-12-16T03:26:45.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.449+0000 7f9f8fb57640 1 -- 172.21.15.28:0/2124360327 wait complete. 2023-12-16T03:26:45.474 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:26:45.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1662f5640 1 Processor -- start 2023-12-16T03:26:45.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1662f5640 1 -- start start 2023-12-16T03:26:45.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1662f5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff160151cd0 0x7ff1600ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1662f5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff1600c7c50 0x7ff1601544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1662f5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1600c8160 con 0x7ff1600ca9a0 2023-12-16T03:26:45.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1662f5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff160157b40 con 0x7ff160151cd0 2023-12-16T03:26:45.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1662f5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff160157e20 con 0x7ff1600c7c50 2023-12-16T03:26:45.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1652f3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff160151cd0 0x7ff1600ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff165af4640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff1600ca9a0 0x7ff16006b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40246/0 (socket says 172.21.15.28:40246) 2023-12-16T03:26:45.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff165af4640 1 -- 172.21.15.28:0/1757761924 learned_addr learned my addr 172.21.15.28:0/1757761924 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:45.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff164af2640 1 --2- 172.21.15.28:0/1757761924 >> v2:172.21.15.134:3300/0 conn(0x7ff1600c7c50 0x7ff1601544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1652f3640 1 -- 172.21.15.28:0/1757761924 >> v2:172.21.15.134:3300/0 conn(0x7ff1600c7c50 msgr2=0x7ff1601544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:45.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1652f3640 1 --2- 172.21.15.28:0/1757761924 >> v2:172.21.15.134:3300/0 conn(0x7ff1600c7c50 0x7ff1601544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1652f3640 1 -- 172.21.15.28:0/1757761924 >> v1:172.21.15.28:6789/0 conn(0x7ff1600ca9a0 legacy=0x7ff16006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.613+0000 7ff1652f3640 1 -- 172.21.15.28:0/1757761924 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff160158100 con 0x7ff160151cd0 2023-12-16T03:26:45.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff1652f3640 1 --2- 172.21.15.28:0/1757761924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff160151cd0 0x7ff1600ca460 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff1600ac7a0 tx=0x7ff15c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aaea8bef6d7d76a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:45.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff157fff640 1 -- 172.21.15.28:0/1757761924 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0ab650 con 0x7ff160151cd0 2023-12-16T03:26:45.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff157fff640 1 -- 172.21.15.28:0/1757761924 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c0ab7b0 con 0x7ff160151cd0 2023-12-16T03:26:45.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff157fff640 1 -- 172.21.15.28:0/1757761924 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0abb40 con 0x7ff160151cd0 2023-12-16T03:26:45.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff1662f5640 1 -- 172.21.15.28:0/1757761924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff160151cd0 msgr2=0x7ff1600ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff1662f5640 1 --2- 172.21.15.28:0/1757761924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff160151cd0 0x7ff1600ca460 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff1600ac7a0 tx=0x7ff15c01c430 comp rx=0 tx=0).stop 2023-12-16T03:26:45.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff1662f5640 1 -- 172.21.15.28:0/1757761924 shutdown_connections 2023-12-16T03:26:45.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff1662f5640 1 --2- 172.21.15.28:0/1757761924 >> v2:172.21.15.134:3300/0 conn(0x7ff1600c7c50 0x7ff1601544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff1662f5640 1 --2- 172.21.15.28:0/1757761924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff160151cd0 0x7ff1600ca460 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff1662f5640 1 -- 172.21.15.28:0/1757761924 >> 172.21.15.28:0/1757761924 conn(0x7ff1600abee0 msgr2=0x7ff1600c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:45.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff1662f5640 1 -- 172.21.15.28:0/1757761924 shutdown_connections 2023-12-16T03:26:45.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff1662f5640 1 -- 172.21.15.28:0/1757761924 wait complete. 2023-12-16T03:26:45.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.617+0000 7ff1662f5640 1 Processor -- start 2023-12-16T03:26:45.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1662f5640 1 -- start start 2023-12-16T03:26:45.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1662f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1600c7c50 0x7ff160156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1662f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1600ca9a0 0x7ff160156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1662f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff160151cd0 0x7ff1600aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1662f5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600aa5c0 con 0x7ff1600c7c50 2023-12-16T03:26:45.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1662f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff160154710 con 0x7ff1600ca9a0 2023-12-16T03:26:45.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1662f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1601edb60 con 0x7ff160151cd0 2023-12-16T03:26:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1652f3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1600c7c50 0x7ff160156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1652f3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1600c7c50 0x7ff160156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49288/0 (socket says 172.21.15.28:49288) 2023-12-16T03:26:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1652f3640 1 -- 172.21.15.28:0/3467161671 learned_addr learned my addr 172.21.15.28:0/3467161671 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff165af4640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff160151cd0 0x7ff1600aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff164af2640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1600ca9a0 0x7ff160156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1652f3640 1 -- 172.21.15.28:0/3467161671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff160151cd0 msgr2=0x7ff1600aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1652f3640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff160151cd0 0x7ff1600aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1652f3640 1 -- 172.21.15.28:0/3467161671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1600ca9a0 msgr2=0x7ff160156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1652f3640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1600ca9a0 0x7ff160156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1652f3640 1 -- 172.21.15.28:0/3467161671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c009420 con 0x7ff1600c7c50 2023-12-16T03:26:45.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff165af4640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff160151cd0 0x7ff1600aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:45.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1652f3640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1600c7c50 0x7ff160156a40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0ad040 tx=0x7ff15c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:45.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff155ffb640 1 -- 172.21.15.28:0/3467161671 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0bf610 con 0x7ff1600c7c50 2023-12-16T03:26:45.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff155ffb640 1 -- 172.21.15.28:0/3467161671 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c0bf790 con 0x7ff1600c7c50 2023-12-16T03:26:45.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff155ffb640 1 -- 172.21.15.28:0/3467161671 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0bfb40 con 0x7ff1600c7c50 2023-12-16T03:26:45.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1662f5640 1 -- 172.21.15.28:0/3467161671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1601ede00 con 0x7ff1600c7c50 2023-12-16T03:26:45.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1662f5640 1 -- 172.21.15.28:0/3467161671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff160154280 con 0x7ff1600c7c50 2023-12-16T03:26:45.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.621+0000 7ff1662f5640 1 -- 172.21.15.28:0/3467161671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1600c6140 con 0x7ff1600c7c50 2023-12-16T03:26:45.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.625+0000 7ff155ffb640 1 -- 172.21.15.28:0/3467161671 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff15c0bfca0 con 0x7ff1600c7c50 2023-12-16T03:26:45.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.625+0000 7ff155ffb640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff144066470 0x7ff144068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:45.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.625+0000 7ff155ffb640 1 -- 172.21.15.28:0/3467161671 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff15c11ee60 con 0x7ff1600c7c50 2023-12-16T03:26:45.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.625+0000 7ff164af2640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff144066470 0x7ff144068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:45.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.625+0000 7ff164af2640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff144066470 0x7ff144068930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff1600c4e80 tx=0x7ff150008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:45.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.629+0000 7ff155ffb640 1 -- 172.21.15.28:0/3467161671 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff15c0ec270 con 0x7ff1600c7c50 2023-12-16T03:26:45.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.825+0000 7ff1662f5640 1 -- 172.21.15.28:0/3467161671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff160154880 con 0x7ff1600c7c50 2023-12-16T03:26:45.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.825+0000 7ff155ffb640 1 -- 172.21.15.28:0/3467161671 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4943 (secure 0 0 0) 0x7ff15c0c4090 con 0x7ff1600c7c50 2023-12-16T03:26:45.992 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:45.992 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3378969769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3378969769},{"type":"v1","addr":"172.21.15.134:6835","nonce":3378969769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2794220220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2794220220},{"type":"v1","addr":"172.21.15.134:6834","nonce":2794220220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2011650959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":2011650959},{"type":"v1","addr":"172.21.15.28:6837","nonce":2011650959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:19.999425+0000","modified":"2023-12-16T03:26:22.999486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5010":{"gid":5010,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.28:6836/664267694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":664267694},{"type":"v1","addr":"172.21.15.28:6836","nonce":664267694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-16T03:26:45.994 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 23 2023-12-16T03:26:45.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 -- 172.21.15.28:0/3467161671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff144066470 msgr2=0x7ff144068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff144066470 0x7ff144068930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff1600c4e80 tx=0x7ff150008040 comp rx=0 tx=0).stop 2023-12-16T03:26:45.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 -- 172.21.15.28:0/3467161671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1600c7c50 msgr2=0x7ff160156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:45.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1600c7c50 0x7ff160156a40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0ad040 tx=0x7ff15c01ac70 comp rx=0 tx=0).stop 2023-12-16T03:26:45.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 -- 172.21.15.28:0/3467161671 shutdown_connections 2023-12-16T03:26:45.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff160151cd0 0x7ff1600aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1600ca9a0 0x7ff160156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff144066470 0x7ff144068930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 --2- 172.21.15.28:0/3467161671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1600c7c50 0x7ff160156a40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:45.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 -- 172.21.15.28:0/3467161671 >> 172.21.15.28:0/3467161671 conn(0x7ff1600abee0 msgr2=0x7ff16014fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:45.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 -- 172.21.15.28:0/3467161671 shutdown_connections 2023-12-16T03:26:45.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:45.829+0000 7ff1662f5640 1 -- 172.21.15.28:0/3467161671 wait complete. 2023-12-16T03:26:45.995 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:46.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.133+0000 7feb066e3640 1 Processor -- start 2023-12-16T03:26:46.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.133+0000 7feb066e3640 1 -- start start 2023-12-16T03:26:46.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.133+0000 7feb066e3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb000c5260 0x7feb0006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.133+0000 7feb066e3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feb00155de0 0x7feb00156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.133+0000 7feb066e3640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb000c2580 con 0x7feb000c5640 2023-12-16T03:26:46.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.133+0000 7feb066e3640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb00153510 con 0x7feb00155de0 2023-12-16T03:26:46.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.133+0000 7feb066e3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb000c17f0 con 0x7feb000c5260 2023-12-16T03:26:46.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.133+0000 7feb04c80640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feb00155de0 0x7feb00156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.133+0000 7feb04c80640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feb00155de0 0x7feb00156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49296/0 (socket says 172.21.15.28:49296) 2023-12-16T03:26:46.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.133+0000 7feb04c80640 1 -- 172.21.15.28:0/866519651 learned_addr learned my addr 172.21.15.28:0/866519651 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:46.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.133+0000 7feafffff640 1 --2- 172.21.15.28:0/866519651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb000c5260 0x7feb0006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feb04c80640 1 -- 172.21.15.28:0/866519651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb000c5260 msgr2=0x7feb0006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:46.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feb04c80640 1 --2- 172.21.15.28:0/866519651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb000c5260 0x7feb0006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feb04c80640 1 -- 172.21.15.28:0/866519651 >> v1:172.21.15.134:6789/0 conn(0x7feb000c5640 legacy=0x7feb000c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feb04c80640 1 -- 172.21.15.28:0/866519651 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb000c1a00 con 0x7feb00155de0 2023-12-16T03:26:46.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feb04c80640 1 --2- 172.21.15.28:0/866519651 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb00155de0 0x7feb00156250 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7feb000c1930 tx=0x7feaf801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90104e7e7ce3cb62 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:46.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feafeffd640 1 -- 172.21.15.28:0/866519651 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80a57f0 con 0x7feb00155de0 2023-12-16T03:26:46.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feafeffd640 1 -- 172.21.15.28:0/866519651 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf80a5950 con 0x7feb00155de0 2023-12-16T03:26:46.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feafeffd640 1 -- 172.21.15.28:0/866519651 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80a5ce0 con 0x7feb00155de0 2023-12-16T03:26:46.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feb066e3640 1 -- 172.21.15.28:0/866519651 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb00155de0 msgr2=0x7feb00156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feb066e3640 1 --2- 172.21.15.28:0/866519651 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb00155de0 0x7feb00156250 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7feb000c1930 tx=0x7feaf801c930 comp rx=0 tx=0).stop 2023-12-16T03:26:46.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feb066e3640 1 -- 172.21.15.28:0/866519651 shutdown_connections 2023-12-16T03:26:46.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feb066e3640 1 --2- 172.21.15.28:0/866519651 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb00155de0 0x7feb00156250 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feb066e3640 1 --2- 172.21.15.28:0/866519651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb000c5260 0x7feb0006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.137+0000 7feb066e3640 1 -- 172.21.15.28:0/866519651 >> 172.21.15.28:0/866519651 conn(0x7feb0006a5b0 msgr2=0x7feb0006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:46.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feb066e3640 1 -- 172.21.15.28:0/866519651 shutdown_connections 2023-12-16T03:26:46.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feb066e3640 1 -- 172.21.15.28:0/866519651 wait complete. 2023-12-16T03:26:46.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feb066e3640 1 Processor -- start 2023-12-16T03:26:46.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feb066e3640 1 -- start start 2023-12-16T03:26:46.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feb066e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb000c5260 0x7feb000a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feb066e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb000c5640 0x7feb000a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feb066e3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb00155de0 0x7feb000a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feb066e3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb00156d70 con 0x7feb000c5640 2023-12-16T03:26:46.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feb066e3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb00157050 con 0x7feb000c5260 2023-12-16T03:26:46.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feb066e3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb001f0a50 con 0x7feb00155de0 2023-12-16T03:26:46.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feaff7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb000c5640 0x7feb000a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feaff7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb000c5640 0x7feb000a8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49304/0 (socket says 172.21.15.28:49304) 2023-12-16T03:26:46.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feaff7fe640 1 -- 172.21.15.28:0/556871629 learned_addr learned my addr 172.21.15.28:0/556871629 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:46.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feb04c80640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb00155de0 0x7feb000a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feafffff640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb000c5260 0x7feb000a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feaff7fe640 1 -- 172.21.15.28:0/556871629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb00155de0 msgr2=0x7feb000a90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feaff7fe640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb00155de0 0x7feb000a90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feaff7fe640 1 -- 172.21.15.28:0/556871629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb000c5260 msgr2=0x7feb000a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feaff7fe640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb000c5260 0x7feb000a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feaff7fe640 1 -- 172.21.15.28:0/556871629 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8009b30 con 0x7feb000c5640 2023-12-16T03:26:46.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feafffff640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb000c5260 0x7feb000a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:46.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feaff7fe640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb000c5640 0x7feb000a8b70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7feaf400c4d0 tx=0x7feaf400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:46.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.141+0000 7feafcff9640 1 -- 172.21.15.28:0/556871629 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf40052d0 con 0x7feb000c5640 2023-12-16T03:26:46.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.145+0000 7feafcff9640 1 -- 172.21.15.28:0/556871629 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf4005430 con 0x7feb000c5640 2023-12-16T03:26:46.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.145+0000 7feafcff9640 1 -- 172.21.15.28:0/556871629 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4012830 con 0x7feb000c5640 2023-12-16T03:26:46.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.145+0000 7feb066e3640 1 -- 172.21.15.28:0/556871629 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb00071b00 con 0x7feb000c5640 2023-12-16T03:26:46.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.145+0000 7feb066e3640 1 -- 172.21.15.28:0/556871629 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb000a6360 con 0x7feb000c5640 2023-12-16T03:26:46.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.145+0000 7feb066e3640 1 -- 172.21.15.28:0/556871629 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb00071d20 con 0x7feb000c5640 2023-12-16T03:26:46.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.145+0000 7feafcff9640 1 -- 172.21.15.28:0/556871629 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7feaf4012990 con 0x7feb000c5640 2023-12-16T03:26:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.145+0000 7feafcff9640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feaec066470 0x7feaec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.145+0000 7feafcff9640 1 -- 172.21.15.28:0/556871629 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7feaf4083960 con 0x7feb000c5640 2023-12-16T03:26:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.145+0000 7feafffff640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feaec066470 0x7feaec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.145+0000 7feafffff640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feaec066470 0x7feaec068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feb000a6730 tx=0x7feaf0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:46.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.149+0000 7feafcff9640 1 -- 172.21.15.28:0/556871629 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7feaf4050d70 con 0x7feb000c5640 2023-12-16T03:26:46.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.305+0000 7feb066e3640 1 -- 172.21.15.28:0/556871629 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb00068400 con 0x7feb000c5640 2023-12-16T03:26:46.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feafcff9640 1 -- 172.21.15.28:0/556871629 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16646 (secure 0 0 0) 0x7feaf4054390 con 0x7feb000c5640 2023-12-16T03:26:46.314 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:46.314 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":39,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:44.059179+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6837/1004873879":"2023-12-17T03:26:41.051540+0000","172.21.15.28:6835/1004873879":"2023-12-17T03:26:41.051540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:46.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 -- 172.21.15.28:0/556871629 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feaec066470 msgr2=0x7feaec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feaec066470 0x7feaec068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feb000a6730 tx=0x7feaf0008040 comp rx=0 tx=0).stop 2023-12-16T03:26:46.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 -- 172.21.15.28:0/556871629 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb000c5640 msgr2=0x7feb000a8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb000c5640 0x7feb000a8b70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7feaf400c4d0 tx=0x7feaf400c990 comp rx=0 tx=0).stop 2023-12-16T03:26:46.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 -- 172.21.15.28:0/556871629 shutdown_connections 2023-12-16T03:26:46.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb00155de0 0x7feb000a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feaec066470 0x7feaec068930 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feb000c5640 0x7feb000a8b70 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 --2- 172.21.15.28:0/556871629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb000c5260 0x7feb000a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 -- 172.21.15.28:0/556871629 >> 172.21.15.28:0/556871629 conn(0x7feb0006a5b0 msgr2=0x7feb0006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:46.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 -- 172.21.15.28:0/556871629 shutdown_connections 2023-12-16T03:26:46.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.309+0000 7feb066e3640 1 -- 172.21.15.28:0/556871629 wait complete. 2023-12-16T03:26:46.336 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-16T03:26:46.336 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:26:46.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.473+0000 7fcb2fc9c640 1 Processor -- start 2023-12-16T03:26:46.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.473+0000 7fcb2fc9c640 1 -- start start 2023-12-16T03:26:46.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.473+0000 7fcb2fc9c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb280bffc0 0x7fcb2815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.473+0000 7fcb2fc9c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2815c600 con 0x7fcb2806d520 2023-12-16T03:26:46.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.473+0000 7fcb2fc9c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2815a5c0 con 0x7fcb281560e0 2023-12-16T03:26:46.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.473+0000 7fcb2fc9c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281594e0 con 0x7fcb280bffc0 2023-12-16T03:26:46.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.473+0000 7fcb2d237640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcb2806d520 0x7fcb280c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40256/0 (socket says 172.21.15.28:40256) 2023-12-16T03:26:46.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.473+0000 7fcb2d237640 1 -- 172.21.15.28:0/1609214152 learned_addr learned my addr 172.21.15.28:0/1609214152 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:46.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.473+0000 7fcb2e239640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb280bffc0 0x7fcb2815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197128073 0 0) 0x7fcb2815c600 con 0x7fcb2806d520 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb14003530 con 0x7fcb2806d520 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821954440 0 0) 0x7fcb2815a5c0 con 0x7fcb281560e0 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb2815c600 con 0x7fcb281560e0 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167732355 0 0) 0x7fcb14003530 con 0x7fcb2806d520 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb280bffc0 msgr2=0x7fcb2815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb280bffc0 0x7fcb2815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 >> v1:172.21.15.134:6789/0 conn(0x7fcb281560e0 legacy=0x7fcb28159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb281597c0 con 0x7fcb2806d520 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fcb18001680 con 0x7fcb2806d520 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 >> v1:172.21.15.28:6789/0 conn(0x7fcb2806d520 legacy=0x7fcb280c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb14003b40 0x7fcb14003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb140047d0 0x7fcb14004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb14005190 0x7fcb1400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281594e0 con 0x7fcb14003b40 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1400bf80 con 0x7fcb140047d0 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1400c140 con 0x7fcb14005190 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2e239640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb280bffc0 0x7fcb2815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2da38640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb14003b40 0x7fcb14003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2d237640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb140047d0 0x7fcb14004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2e239640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb14005190 0x7fcb1400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2da38640 1 -- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb14005190 msgr2=0x7fcb1400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2da38640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb14005190 0x7fcb1400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2da38640 1 -- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb140047d0 msgr2=0x7fcb14004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2da38640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb140047d0 0x7fcb14004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.477+0000 7fcb2da38640 1 -- 172.21.15.28:0/1609214152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14003530 con 0x7fcb14003b40 2023-12-16T03:26:46.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2da38640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb14003b40 0x7fcb14003f40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcb240018d0 tx=0x7fcb2401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffd4bfc5d1da2bc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240052d0 con 0x7fcb14003b40 2023-12-16T03:26:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb24005450 con 0x7fcb14003b40 2023-12-16T03:26:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2ca36640 1 -- 172.21.15.28:0/1609214152 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24003840 con 0x7fcb14003b40 2023-12-16T03:26:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1609214152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb14003b40 msgr2=0x7fcb14003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 --2- 172.21.15.28:0/1609214152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb14003b40 0x7fcb14003f40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcb240018d0 tx=0x7fcb2401c530 comp rx=0 tx=0).stop 2023-12-16T03:26:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2e239640 1 -- 172.21.15.28:0/1609214152 reap_dead start 2023-12-16T03:26:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1609214152 shutdown_connections 2023-12-16T03:26:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1609214152 >> 172.21.15.28:0/1609214152 conn(0x7fcb2806a5b0 msgr2=0x7fcb2806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:46.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1609214152 shutdown_connections 2023-12-16T03:26:46.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1609214152 wait complete. 2023-12-16T03:26:46.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 Processor -- start 2023-12-16T03:26:46.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 -- start start 2023-12-16T03:26:46.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb14003b40 0x7fcb281f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb280aa2f0 0x7fcb280c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb281f5410 0x7fcb28149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280a7d40 con 0x7fcb280aa2f0 2023-12-16T03:26:46.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281f2670 con 0x7fcb281f5410 2023-12-16T03:26:46.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.481+0000 7fcb2fc9c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281f4ca0 con 0x7fcb14003b40 2023-12-16T03:26:46.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2d237640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb280aa2f0 0x7fcb280c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2d237640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb280aa2f0 0x7fcb280c51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49312/0 (socket says 172.21.15.28:49312) 2023-12-16T03:26:46.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2d237640 1 -- 172.21.15.28:0/1286843676 learned_addr learned my addr 172.21.15.28:0/1286843676 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:46.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2da38640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb14003b40 0x7fcb281f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2e239640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb281f5410 0x7fcb28149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2d237640 1 -- 172.21.15.28:0/1286843676 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb14003b40 msgr2=0x7fcb281f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2d237640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb14003b40 0x7fcb281f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2d237640 1 -- 172.21.15.28:0/1286843676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb281f5410 msgr2=0x7fcb28149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2d237640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb281f5410 0x7fcb28149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2d237640 1 -- 172.21.15.28:0/1286843676 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb281f4f80 con 0x7fcb280aa2f0 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2da38640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb14003b40 0x7fcb281f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2e239640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb281f5410 0x7fcb28149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2d237640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb280aa2f0 0x7fcb280c51c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcb18007340 tx=0x7fcb18007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb1e7fc640 1 -- 172.21.15.28:0/1286843676 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800f960 con 0x7fcb280aa2f0 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb1e7fc640 1 -- 172.21.15.28:0/1286843676 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800fac0 con 0x7fcb280aa2f0 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb1e7fc640 1 -- 172.21.15.28:0/1286843676 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800fe70 con 0x7fcb280aa2f0 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1286843676 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb280a6ea0 con 0x7fcb280aa2f0 2023-12-16T03:26:46.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1286843676 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb280a7460 con 0x7fcb280aa2f0 2023-12-16T03:26:46.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1286843676 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb281f5110 con 0x7fcb280aa2f0 2023-12-16T03:26:46.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb1e7fc640 1 -- 172.21.15.28:0/1286843676 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcb1801d460 con 0x7fcb280aa2f0 2023-12-16T03:26:46.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.485+0000 7fcb1e7fc640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcb0c066470 0x7fcb0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.489+0000 7fcb1e7fc640 1 -- 172.21.15.28:0/1286843676 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fcb18083fc0 con 0x7fcb280aa2f0 2023-12-16T03:26:46.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.489+0000 7fcb2da38640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcb0c066470 0x7fcb0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.489+0000 7fcb2da38640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcb0c066470 0x7fcb0c068930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ad000 tx=0x7fcb240a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:46.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.489+0000 7fcb1e7fc640 1 -- 172.21.15.28:0/1286843676 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcb180513d0 con 0x7fcb280aa2f0 2023-12-16T03:26:46.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.677+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1286843676 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb280c6bf0 con 0x7fcb280aa2f0 2023-12-16T03:26:46.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb1e7fc640 1 -- 172.21.15.28:0/1286843676 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fcb180549f0 con 0x7fcb280aa2f0 2023-12-16T03:26:46.686 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:46.686 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3378969769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3378969769},{"type":"v1","addr":"172.21.15.134:6835","nonce":3378969769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2794220220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2794220220},{"type":"v1","addr":"172.21.15.134:6834","nonce":2794220220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2011650959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":2011650959},{"type":"v1","addr":"172.21.15.28:6837","nonce":2011650959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:19.999425+0000","modified":"2023-12-16T03:26:22.999486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5010":{"gid":5010,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.28:6836/664267694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":664267694},{"type":"v1","addr":"172.21.15.28:6836","nonce":664267694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-16T03:26:46.686 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 23 2023-12-16T03:26:46.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1286843676 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcb0c066470 msgr2=0x7fcb0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcb0c066470 0x7fcb0c068930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ad000 tx=0x7fcb240a7000 comp rx=0 tx=0).stop 2023-12-16T03:26:46.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1286843676 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb280aa2f0 msgr2=0x7fcb280c51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb280aa2f0 0x7fcb280c51c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcb18007340 tx=0x7fcb18007800 comp rx=0 tx=0).stop 2023-12-16T03:26:46.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1286843676 shutdown_connections 2023-12-16T03:26:46.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb281f5410 0x7fcb28149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcb0c066470 0x7fcb0c068930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb280aa2f0 0x7fcb280c51c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 --2- 172.21.15.28:0/1286843676 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb14003b40 0x7fcb281f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1286843676 >> 172.21.15.28:0/1286843676 conn(0x7fcb2806a5b0 msgr2=0x7fcb28159ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:46.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1286843676 shutdown_connections 2023-12-16T03:26:46.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.681+0000 7fcb2fc9c640 1 -- 172.21.15.28:0/1286843676 wait complete. 2023-12-16T03:26:46.707 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:26:46.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f88186ea640 1 Processor -- start 2023-12-16T03:26:46.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f88186ea640 1 -- start start 2023-12-16T03:26:46.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f88186ea640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8810151e90 0x7f88100c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f88186ea640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881006c860 con 0x7f88100c7ea0 2023-12-16T03:26:46.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f88186ea640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8810154930 con 0x7f88100c4e60 2023-12-16T03:26:46.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f88186ea640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88100c8750 con 0x7f8810151e90 2023-12-16T03:26:46.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f8815c85640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f88100c7ea0 0x7f881006b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40260/0 (socket says 172.21.15.28:40260) 2023-12-16T03:26:46.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f8815c85640 1 -- 172.21.15.28:0/894006041 learned_addr learned my addr 172.21.15.28:0/894006041 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:46.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f8816486640 1 --2- 172.21.15.28:0/894006041 >> v2:172.21.15.134:3300/0 conn(0x7f8810151e90 0x7f88100c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f8815484640 1 -- 172.21.15.28:0/894006041 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030625344 0 0) 0x7f881006c860 con 0x7f88100c7ea0 2023-12-16T03:26:46.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f8815484640 1 -- 172.21.15.28:0/894006041 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87fc003530 con 0x7f88100c7ea0 2023-12-16T03:26:46.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f8815484640 1 -- 172.21.15.28:0/894006041 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313499209 0 0) 0x7f8810154930 con 0x7f88100c4e60 2023-12-16T03:26:46.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f8815484640 1 -- 172.21.15.28:0/894006041 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f881006c860 con 0x7f88100c4e60 2023-12-16T03:26:46.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f8816486640 1 -- 172.21.15.28:0/894006041 >> v1:172.21.15.134:6789/0 conn(0x7f88100c4e60 legacy=0x7f881015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f8816486640 1 -- 172.21.15.28:0/894006041 >> v1:172.21.15.28:6789/0 conn(0x7f88100c7ea0 legacy=0x7f881006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.845+0000 7f8816486640 1 -- 172.21.15.28:0/894006041 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8810154c10 con 0x7f8810151e90 2023-12-16T03:26:46.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.849+0000 7f8816486640 1 --2- 172.21.15.28:0/894006041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810151e90 0x7f88100c4920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f880c0097c0 tx=0x7f880c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f7e12eb9e22ab5d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:46.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.849+0000 7f8815484640 1 -- 172.21.15.28:0/894006041 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0ab600 con 0x7f8810151e90 2023-12-16T03:26:46.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.849+0000 7f8815484640 1 -- 172.21.15.28:0/894006041 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c0a7050 con 0x7f8810151e90 2023-12-16T03:26:46.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.849+0000 7f8815484640 1 -- 172.21.15.28:0/894006041 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0ab980 con 0x7f8810151e90 2023-12-16T03:26:46.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.849+0000 7f88186ea640 1 -- 172.21.15.28:0/894006041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810151e90 msgr2=0x7f88100c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.849+0000 7f88186ea640 1 --2- 172.21.15.28:0/894006041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810151e90 0x7f88100c4920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f880c0097c0 tx=0x7f880c01c360 comp rx=0 tx=0).stop 2023-12-16T03:26:46.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.849+0000 7f88186ea640 1 -- 172.21.15.28:0/894006041 shutdown_connections 2023-12-16T03:26:46.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.849+0000 7f88186ea640 1 --2- 172.21.15.28:0/894006041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810151e90 0x7f88100c4920 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.849+0000 7f88186ea640 1 -- 172.21.15.28:0/894006041 >> 172.21.15.28:0/894006041 conn(0x7f88100ca170 msgr2=0x7f88100ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:46.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.849+0000 7f88186ea640 1 -- 172.21.15.28:0/894006041 shutdown_connections 2023-12-16T03:26:46.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.849+0000 7f88186ea640 1 -- 172.21.15.28:0/894006041 wait complete. 2023-12-16T03:26:46.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f88186ea640 1 Processor -- start 2023-12-16T03:26:46.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f88186ea640 1 -- start start 2023-12-16T03:26:46.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f88186ea640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88100c4e60 0x7f88101ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f88186ea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88100c7ea0 0x7f88101edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f88186ea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810151e90 0x7f8810149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f88186ea640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88101552d0 con 0x7f88100c4e60 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f88186ea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88101ee5d0 con 0x7f8810151e90 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f88186ea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88101ee080 con 0x7f88100c7ea0 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8816486640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88100c4e60 0x7f88101ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8816486640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88100c4e60 0x7f88101ed600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49318/0 (socket says 172.21.15.28:49318) 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8816486640 1 -- 172.21.15.28:0/1929526440 learned_addr learned my addr 172.21.15.28:0/1929526440 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8816486640 1 -- 172.21.15.28:0/1929526440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88100c7ea0 msgr2=0x7f88101edb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8815c85640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88100c7ea0 0x7f88101edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8816c87640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810151e90 0x7f8810149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8816486640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88100c7ea0 0x7f88101edb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8816486640 1 -- 172.21.15.28:0/1929526440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810151e90 msgr2=0x7f8810149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8816486640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810151e90 0x7f8810149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8816486640 1 -- 172.21.15.28:0/1929526440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c009420 con 0x7f88100c4e60 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8815c85640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88100c7ea0 0x7f88101edb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:46.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8816c87640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810151e90 0x7f8810149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:46.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8816486640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88100c4e60 0x7f88101ed600 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f880c018f70 tx=0x7f880c01aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:46.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8806ffd640 1 -- 172.21.15.28:0/1929526440 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0abd20 con 0x7f88100c4e60 2023-12-16T03:26:46.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8806ffd640 1 -- 172.21.15.28:0/1929526440 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c0b7450 con 0x7f88100c4e60 2023-12-16T03:26:46.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f88186ea640 1 -- 172.21.15.28:0/1929526440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88101ee2f0 con 0x7f88100c4e60 2023-12-16T03:26:46.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f8806ffd640 1 -- 172.21.15.28:0/1929526440 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0abea0 con 0x7f88100c4e60 2023-12-16T03:26:46.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.853+0000 7f88186ea640 1 -- 172.21.15.28:0/1929526440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88100bdf10 con 0x7f88100c4e60 2023-12-16T03:26:46.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.857+0000 7f88186ea640 1 -- 172.21.15.28:0/1929526440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881014a840 con 0x7f88100c4e60 2023-12-16T03:26:46.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.857+0000 7f8806ffd640 1 -- 172.21.15.28:0/1929526440 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f880c0b7800 con 0x7f88100c4e60 2023-12-16T03:26:46.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.857+0000 7f8806ffd640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f87f4066470 0x7f87f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:46.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.857+0000 7f8806ffd640 1 -- 172.21.15.28:0/1929526440 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f880c11e550 con 0x7f88100c4e60 2023-12-16T03:26:46.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.857+0000 7f8815c85640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f87f4066470 0x7f87f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:46.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.857+0000 7f8815c85640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f87f4066470 0x7f87f4068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f881014f2d0 tx=0x7f8800009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:46.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:46.861+0000 7f8806ffd640 1 -- 172.21.15.28:0/1929526440 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f880c0eb970 con 0x7f88100c4e60 2023-12-16T03:26:47.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.053+0000 7f88186ea640 1 -- 172.21.15.28:0/1929526440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8810068400 con 0x7f88100c4e60 2023-12-16T03:26:47.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f8806ffd640 1 -- 172.21.15.28:0/1929526440 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f880c0eef90 con 0x7f88100c4e60 2023-12-16T03:26:47.061 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:47.061 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3378969769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3378969769},{"type":"v1","addr":"172.21.15.134:6835","nonce":3378969769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2794220220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2794220220},{"type":"v1","addr":"172.21.15.134:6834","nonce":2794220220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2011650959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":2011650959},{"type":"v1","addr":"172.21.15.28:6837","nonce":2011650959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:26:19.999425+0000","modified":"2023-12-16T03:26:22.999486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5010":{"gid":5010,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.28:6836/664267694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":664267694},{"type":"v1","addr":"172.21.15.28:6836","nonce":664267694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-16T03:26:47.061 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 23 2023-12-16T03:26:47.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 -- 172.21.15.28:0/1929526440 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f87f4066470 msgr2=0x7f87f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f87f4066470 0x7f87f4068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f881014f2d0 tx=0x7f8800009040 comp rx=0 tx=0).stop 2023-12-16T03:26:47.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 -- 172.21.15.28:0/1929526440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88100c4e60 msgr2=0x7f88101ed600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88100c4e60 0x7f88101ed600 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f880c018f70 tx=0x7f880c01aba0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 -- 172.21.15.28:0/1929526440 shutdown_connections 2023-12-16T03:26:47.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8810151e90 0x7f8810149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88100c7ea0 0x7f88101edb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f87f4066470 0x7f87f4068930 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 --2- 172.21.15.28:0/1929526440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88100c4e60 0x7f88101ed600 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 -- 172.21.15.28:0/1929526440 >> 172.21.15.28:0/1929526440 conn(0x7f88100ca170 msgr2=0x7f8810148420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:47.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 -- 172.21.15.28:0/1929526440 shutdown_connections 2023-12-16T03:26:47.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.057+0000 7f88186ea640 1 -- 172.21.15.28:0/1929526440 wait complete. 2023-12-16T03:26:47.084 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:47.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.221+0000 7f7cb01f8640 1 Processor -- start 2023-12-16T03:26:47.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.221+0000 7f7cb01f8640 1 -- start start 2023-12-16T03:26:47.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.221+0000 7f7cb01f8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7ca80c63c0 0x7f7ca80c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.221+0000 7f7cb01f8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca80c31c0 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.221+0000 7f7cb01f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca80c34a0 con 0x7f7ca80c4100 2023-12-16T03:26:47.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.221+0000 7f7cb01f8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca80c1030 con 0x7f7ca80c63c0 2023-12-16T03:26:47.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.221+0000 7f7cadf94640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7ca80c63c0 0x7f7ca80c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.221+0000 7f7cae795640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7ca80c2bb0 0x7f7ca80a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40262/0 (socket says 172.21.15.28:40262) 2023-12-16T03:26:47.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.221+0000 7f7cadf94640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7ca80c63c0 0x7f7ca80c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49328/0 (socket says 172.21.15.28:49328) 2023-12-16T03:26:47.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.221+0000 7f7cae795640 1 -- 172.21.15.28:0/404503371 learned_addr learned my addr 172.21.15.28:0/404503371 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:47.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.225+0000 7f7cadf94640 1 -- 172.21.15.28:0/404503371 >> v1:172.21.15.134:6789/0 conn(0x7f7ca80c4100 legacy=0x7f7ca80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.225+0000 7f7cadf94640 1 -- 172.21.15.28:0/404503371 >> v1:172.21.15.28:6789/0 conn(0x7f7ca80c2bb0 legacy=0x7f7ca80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.225+0000 7f7cacf92640 1 -- 172.21.15.28:0/404503371 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594448715 0 0) 0x7f7ca80c31c0 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.225+0000 7f7cadf94640 1 -- 172.21.15.28:0/404503371 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca80c1310 con 0x7f7ca80c63c0 2023-12-16T03:26:47.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.225+0000 7f7cadf94640 1 --2- 172.21.15.28:0/404503371 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80c63c0 0x7f7ca80c06d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40097c0 tx=0x7f7ca401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4d741510cc5677 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:47.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.225+0000 7f7cacf92640 1 -- 172.21.15.28:0/404503371 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40ad680 con 0x7f7ca80c63c0 2023-12-16T03:26:47.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.225+0000 7f7cacf92640 1 -- 172.21.15.28:0/404503371 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca40ad7e0 con 0x7f7ca80c63c0 2023-12-16T03:26:47.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.225+0000 7f7cacf92640 1 -- 172.21.15.28:0/404503371 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40adb70 con 0x7f7ca80c63c0 2023-12-16T03:26:47.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.225+0000 7f7cb01f8640 1 -- 172.21.15.28:0/404503371 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80c63c0 msgr2=0x7f7ca80c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.225+0000 7f7cb01f8640 1 --2- 172.21.15.28:0/404503371 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80c63c0 0x7f7ca80c06d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40097c0 tx=0x7f7ca401c360 comp rx=0 tx=0).stop 2023-12-16T03:26:47.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 -- 172.21.15.28:0/404503371 shutdown_connections 2023-12-16T03:26:47.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 --2- 172.21.15.28:0/404503371 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80c63c0 0x7f7ca80c06d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 -- 172.21.15.28:0/404503371 >> 172.21.15.28:0/404503371 conn(0x7f7ca806a5b0 msgr2=0x7f7ca806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:47.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 -- 172.21.15.28:0/404503371 shutdown_connections 2023-12-16T03:26:47.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 -- 172.21.15.28:0/404503371 wait complete. 2023-12-16T03:26:47.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 Processor -- start 2023-12-16T03:26:47.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 -- start start 2023-12-16T03:26:47.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80c2bb0 0x7f7ca80c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ca80c4100 0x7f7ca81ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca80c63c0 0x7f7ca81edd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca81449f0 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca815b930 con 0x7f7ca80c4100 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cb01f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca815c120 con 0x7f7ca80c63c0 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cadf94640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80c2bb0 0x7f7ca80c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cadf94640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80c2bb0 0x7f7ca80c0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49334/0 (socket says 172.21.15.28:49334) 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cadf94640 1 -- 172.21.15.28:0/70520031 learned_addr learned my addr 172.21.15.28:0/70520031 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cad793640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ca80c4100 0x7f7ca81ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cae795640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca80c63c0 0x7f7ca81edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cadf94640 1 -- 172.21.15.28:0/70520031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca80c63c0 msgr2=0x7f7ca81edd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cadf94640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca80c63c0 0x7f7ca81edd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cadf94640 1 -- 172.21.15.28:0/70520031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ca80c4100 msgr2=0x7f7ca81ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cadf94640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ca80c4100 0x7f7ca81ed810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cadf94640 1 -- 172.21.15.28:0/70520031 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca4009420 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.229+0000 7f7cae795640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca80c63c0 0x7f7ca81edd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:47.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.233+0000 7f7cadf94640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80c2bb0 0x7f7ca80c0170 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4019f90 tx=0x7f7ca401aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:47.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.233+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/70520031 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40adea0 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.233+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/70520031 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca40b8420 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.233+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/70520031 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40b87b0 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.233+0000 7f7cb01f8640 1 -- 172.21.15.28:0/70520031 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca80c69b0 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.233+0000 7f7cb01f8640 1 -- 172.21.15.28:0/70520031 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca81ed380 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.233+0000 7f7cb01f8640 1 -- 172.21.15.28:0/70520031 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca8068400 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.233+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/70520031 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7ca40b4040 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.233+0000 7f7c9e7fc640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c066470 0x7f7c8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.233+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/70520031 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f7ca411e320 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.233+0000 7f7cad793640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c066470 0x7f7c8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.237+0000 7f7cad793640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c066470 0x7f7c8c068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7ca806ffb0 tx=0x7f7c98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:47.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.237+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/70520031 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7ca40eb7e0 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.401+0000 7f7cb01f8640 1 -- 172.21.15.28:0/70520031 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ca81ed150 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.401+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/70520031 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16646 (secure 0 0 0) 0x7f7ca40eee00 con 0x7f7ca80c2bb0 2023-12-16T03:26:47.407 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:47.407 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":39,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:44.059179+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:26:18.527469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:26:18.979011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6837/1004873879":"2023-12-17T03:26:41.051540+0000","172.21.15.28:6835/1004873879":"2023-12-17T03:26:41.051540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:47.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 -- 172.21.15.28:0/70520031 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c066470 msgr2=0x7f7c8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c066470 0x7f7c8c068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7ca806ffb0 tx=0x7f7c98009040 comp rx=0 tx=0).stop 2023-12-16T03:26:47.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 -- 172.21.15.28:0/70520031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80c2bb0 msgr2=0x7f7ca80c0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80c2bb0 0x7f7ca80c0170 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4019f90 tx=0x7f7ca401aba0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 -- 172.21.15.28:0/70520031 shutdown_connections 2023-12-16T03:26:47.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca80c63c0 0x7f7ca81edd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ca80c4100 0x7f7ca81ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c066470 0x7f7c8c068930 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 --2- 172.21.15.28:0/70520031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80c2bb0 0x7f7ca80c0170 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 -- 172.21.15.28:0/70520031 >> 172.21.15.28:0/70520031 conn(0x7f7ca806a5b0 msgr2=0x7f7ca8070bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:47.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 -- 172.21.15.28:0/70520031 shutdown_connections 2023-12-16T03:26:47.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.405+0000 7f7cb01f8640 1 -- 172.21.15.28:0/70520031 wait complete. 2023-12-16T03:26:47.429 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-16T03:26:47.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.565+0000 7fe44351d640 1 Processor -- start 2023-12-16T03:26:47.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.565+0000 7fe44351d640 1 -- start start 2023-12-16T03:26:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe44351d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe43c06dfe0 0x7fe43c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe44351d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe43c06b1e0 0x7fe43c0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe44351d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43c072500 con 0x7fe43c06a5b0 2023-12-16T03:26:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe44351d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43c06ef50 con 0x7fe43c06dfe0 2023-12-16T03:26:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe44351d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0720b0 con 0x7fe43c06b1e0 2023-12-16T03:26:47.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe440ab8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe43c06dfe0 0x7fe43c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe440ab8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe43c06dfe0 0x7fe43c06a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49338/0 (socket says 172.21.15.28:49338) 2023-12-16T03:26:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe440ab8640 1 -- 172.21.15.28:0/1638833807 learned_addr learned my addr 172.21.15.28:0/1638833807 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe441aba640 1 --2- 172.21.15.28:0/1638833807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe43c06b1e0 0x7fe43c0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe440ab8640 1 -- 172.21.15.28:0/1638833807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe43c06b1e0 msgr2=0x7fe43c0c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:47.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe440ab8640 1 --2- 172.21.15.28:0/1638833807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe43c06b1e0 0x7fe43c0c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe440ab8640 1 -- 172.21.15.28:0/1638833807 >> v1:172.21.15.134:6789/0 conn(0x7fe43c06a5b0 legacy=0x7fe43c0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe440ab8640 1 -- 172.21.15.28:0/1638833807 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c070f60 con 0x7fe43c06dfe0 2023-12-16T03:26:47.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe441aba640 1 --2- 172.21.15.28:0/1638833807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe43c06b1e0 0x7fe43c0c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:47.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe440ab8640 1 --2- 172.21.15.28:0/1638833807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c06dfe0 0x7fe43c06a990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009870 tx=0x7fe42c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5672594380fa849 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:47.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.569+0000 7fe433fff640 1 -- 172.21.15.28:0/1638833807 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0ab600 con 0x7fe43c06dfe0 2023-12-16T03:26:47.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe433fff640 1 -- 172.21.15.28:0/1638833807 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c0a7050 con 0x7fe43c06dfe0 2023-12-16T03:26:47.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe433fff640 1 -- 172.21.15.28:0/1638833807 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0ab980 con 0x7fe43c06dfe0 2023-12-16T03:26:47.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 -- 172.21.15.28:0/1638833807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c06dfe0 msgr2=0x7fe43c06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 --2- 172.21.15.28:0/1638833807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c06dfe0 0x7fe43c06a990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009870 tx=0x7fe42c01c470 comp rx=0 tx=0).stop 2023-12-16T03:26:47.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 -- 172.21.15.28:0/1638833807 shutdown_connections 2023-12-16T03:26:47.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 --2- 172.21.15.28:0/1638833807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe43c06b1e0 0x7fe43c0c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 --2- 172.21.15.28:0/1638833807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c06dfe0 0x7fe43c06a990 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 -- 172.21.15.28:0/1638833807 >> 172.21.15.28:0/1638833807 conn(0x7fe43c0c6ef0 msgr2=0x7fe43c0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:47.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 -- 172.21.15.28:0/1638833807 shutdown_connections 2023-12-16T03:26:47.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 -- 172.21.15.28:0/1638833807 wait complete. 2023-12-16T03:26:47.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 Processor -- start 2023-12-16T03:26:47.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 -- start start 2023-12-16T03:26:47.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe43c06a5b0 0x7fe43c13e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe43c06b1e0 0x7fe43c142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c06dfe0 0x7fe43c140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c143780 con 0x7fe43c06dfe0 2023-12-16T03:26:47.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c141790 con 0x7fe43c06a5b0 2023-12-16T03:26:47.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe44351d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c144ca0 con 0x7fe43c06b1e0 2023-12-16T03:26:47.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe441aba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c06dfe0 0x7fe43c140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe441aba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c06dfe0 0x7fe43c140c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49342/0 (socket says 172.21.15.28:49342) 2023-12-16T03:26:47.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe4412b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe43c06a5b0 0x7fe43c13e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe441aba640 1 -- 172.21.15.28:0/2584899129 learned_addr learned my addr 172.21.15.28:0/2584899129 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:47.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.573+0000 7fe440ab8640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe43c06b1e0 0x7fe43c142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe441aba640 1 -- 172.21.15.28:0/2584899129 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe43c06b1e0 msgr2=0x7fe43c142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe441aba640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe43c06b1e0 0x7fe43c142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe441aba640 1 -- 172.21.15.28:0/2584899129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe43c06a5b0 msgr2=0x7fe43c13e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe441aba640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe43c06a5b0 0x7fe43c13e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe441aba640 1 -- 172.21.15.28:0/2584899129 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0094d0 con 0x7fe43c06dfe0 2023-12-16T03:26:47.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe441aba640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c06dfe0 0x7fe43c140c90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe43400cd80 tx=0x7fe43400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:47.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe431ffb640 1 -- 172.21.15.28:0/2584899129 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43400f680 con 0x7fe43c06dfe0 2023-12-16T03:26:47.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe431ffb640 1 -- 172.21.15.28:0/2584899129 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43400f800 con 0x7fe43c06dfe0 2023-12-16T03:26:47.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe44351d640 1 -- 172.21.15.28:0/2584899129 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c143270 con 0x7fe43c06dfe0 2023-12-16T03:26:47.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe431ffb640 1 -- 172.21.15.28:0/2584899129 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43400fbb0 con 0x7fe43c06dfe0 2023-12-16T03:26:47.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe44351d640 1 -- 172.21.15.28:0/2584899129 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c1434a0 con 0x7fe43c06dfe0 2023-12-16T03:26:47.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe44351d640 1 -- 172.21.15.28:0/2584899129 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c068400 con 0x7fe43c06dfe0 2023-12-16T03:26:47.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe431ffb640 1 -- 172.21.15.28:0/2584899129 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe43400b040 con 0x7fe43c06dfe0 2023-12-16T03:26:47.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe431ffb640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe4200664a0 0x7fe420068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe431ffb640 1 -- 172.21.15.28:0/2584899129 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fe434084820 con 0x7fe43c06dfe0 2023-12-16T03:26:47.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.577+0000 7fe4412b9640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe4200664a0 0x7fe420068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.581+0000 7fe4412b9640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe4200664a0 0x7fe420068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe43c141930 tx=0x7fe438009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:47.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.581+0000 7fe431ffb640 1 -- 172.21.15.28:0/2584899129 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe434051c50 con 0x7fe43c06dfe0 2023-12-16T03:26:47.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.773+0000 7fe44351d640 1 -- 172.21.15.28:0/2584899129 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fe43c0c7cb0 con 0x7fe43c06dfe0 2023-12-16T03:26:47.780 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-12-16T03:26:47.773+0000 7f6a9e376640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T03:26:47.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.777+0000 7fe431ffb640 1 -- 172.21.15.28:0/2584899129 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 163+0+0 (secure 0 0 0) 0x7fe43401d090 con 0x7fe43c06dfe0 2023-12-16T03:26:47.782 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-16T03:26:47.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 -- 172.21.15.28:0/2584899129 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe4200664a0 msgr2=0x7fe420068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe4200664a0 0x7fe420068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe43c141930 tx=0x7fe438009060 comp rx=0 tx=0).stop 2023-12-16T03:26:47.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 -- 172.21.15.28:0/2584899129 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c06dfe0 msgr2=0x7fe43c140c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c06dfe0 0x7fe43c140c90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe43400cd80 tx=0x7fe43400a650 comp rx=0 tx=0).stop 2023-12-16T03:26:47.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 -- 172.21.15.28:0/2584899129 shutdown_connections 2023-12-16T03:26:47.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe4200664a0 0x7fe420068960 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c06dfe0 0x7fe43c140c90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe43c06b1e0 0x7fe43c142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 --2- 172.21.15.28:0/2584899129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe43c06a5b0 0x7fe43c13e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 -- 172.21.15.28:0/2584899129 >> 172.21.15.28:0/2584899129 conn(0x7fe43c0c6ef0 msgr2=0x7fe43c1488a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:47.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 -- 172.21.15.28:0/2584899129 shutdown_connections 2023-12-16T03:26:47.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.781+0000 7fe44351d640 1 -- 172.21.15.28:0/2584899129 wait complete. 2023-12-16T03:26:47.791 INFO:tasks.ceph.mds.c.smithi028.stderr: -1950> 2023-12-16T03:26:25.997+0000 7ff611c3d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:26:47.806 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-16T03:26:47.840 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2023-12-16T03:26:47.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa30279640 1 Processor -- start 2023-12-16T03:26:47.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa30279640 1 -- start start 2023-12-16T03:26:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa30279640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa2806d520 0x7ffa2815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa30279640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa280bffc0 0x7ffa280c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa30279640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2815c600 con 0x7ffa281560e0 2023-12-16T03:26:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa30279640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2815a5c0 con 0x7ffa2806d520 2023-12-16T03:26:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa30279640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa281594e0 con 0x7ffa280bffc0 2023-12-16T03:26:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa2d814640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa2806d520 0x7ffa2815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa2d814640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa2806d520 0x7ffa2815ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49378/0 (socket says 172.21.15.28:49378) 2023-12-16T03:26:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa2d814640 1 -- 172.21.15.28:0/2437415305 learned_addr learned my addr 172.21.15.28:0/2437415305 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa2e816640 1 --2- 172.21.15.28:0/2437415305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa280bffc0 0x7ffa280c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa2d814640 1 -- 172.21.15.28:0/2437415305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa280bffc0 msgr2=0x7ffa280c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:47.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa2d814640 1 --2- 172.21.15.28:0/2437415305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa280bffc0 0x7ffa280c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa2d814640 1 -- 172.21.15.28:0/2437415305 >> v1:172.21.15.134:6789/0 conn(0x7ffa281560e0 legacy=0x7ffa28159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.949+0000 7ffa2d814640 1 -- 172.21.15.28:0/2437415305 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa281597c0 con 0x7ffa2806d520 2023-12-16T03:26:47.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa2d814640 1 --2- 172.21.15.28:0/2437415305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806d520 0x7ffa2815ca90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009870 tx=0x7ffa1801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a9851f6e21fc9d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:47.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa2d013640 1 -- 172.21.15.28:0/2437415305 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180ab620 con 0x7ffa2806d520 2023-12-16T03:26:47.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa2d013640 1 -- 172.21.15.28:0/2437415305 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa180ab780 con 0x7ffa2806d520 2023-12-16T03:26:47.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa2d013640 1 -- 172.21.15.28:0/2437415305 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180abb10 con 0x7ffa2806d520 2023-12-16T03:26:47.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa30279640 1 -- 172.21.15.28:0/2437415305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806d520 msgr2=0x7ffa2815ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa30279640 1 --2- 172.21.15.28:0/2437415305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806d520 0x7ffa2815ca90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009870 tx=0x7ffa1801c510 comp rx=0 tx=0).stop 2023-12-16T03:26:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa30279640 1 -- 172.21.15.28:0/2437415305 shutdown_connections 2023-12-16T03:26:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa30279640 1 --2- 172.21.15.28:0/2437415305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa280bffc0 0x7ffa280c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa30279640 1 --2- 172.21.15.28:0/2437415305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806d520 0x7ffa2815ca90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa30279640 1 -- 172.21.15.28:0/2437415305 >> 172.21.15.28:0/2437415305 conn(0x7ffa2806a5b0 msgr2=0x7ffa2806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa30279640 1 -- 172.21.15.28:0/2437415305 shutdown_connections 2023-12-16T03:26:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.953+0000 7ffa30279640 1 -- 172.21.15.28:0/2437415305 wait complete. 2023-12-16T03:26:47.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa30279640 1 Processor -- start 2023-12-16T03:26:47.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa30279640 1 -- start start 2023-12-16T03:26:47.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa30279640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa2806d520 0x7ffa28153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa30279640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa280bffc0 0x7ffa281f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa30279640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa281560e0 0x7ffa281f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa30279640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28070bb0 con 0x7ffa281560e0 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa30279640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280a39b0 con 0x7ffa280bffc0 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa30279640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28070e00 con 0x7ffa2806d520 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa2e816640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa281560e0 0x7ffa281f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa2e816640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa281560e0 0x7ffa281f54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49388/0 (socket says 172.21.15.28:49388) 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa2e816640 1 -- 172.21.15.28:0/3271799477 learned_addr learned my addr 172.21.15.28:0/3271799477 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa2e015640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa2806d520 0x7ffa28153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa2d814640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa280bffc0 0x7ffa281f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa2e816640 1 -- 172.21.15.28:0/3271799477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa2806d520 msgr2=0x7ffa28153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa2e816640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa2806d520 0x7ffa28153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa2e816640 1 -- 172.21.15.28:0/3271799477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa280bffc0 msgr2=0x7ffa281f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa2e816640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa280bffc0 0x7ffa281f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa2e816640 1 -- 172.21.15.28:0/3271799477 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa180094d0 con 0x7ffa281560e0 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa2e816640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa281560e0 0x7ffa281f54b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007e40 tx=0x7ffa2000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa1effd640 1 -- 172.21.15.28:0/3271799477 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20014620 con 0x7ffa281560e0 2023-12-16T03:26:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa1effd640 1 -- 172.21.15.28:0/3271799477 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2000ee90 con 0x7ffa281560e0 2023-12-16T03:26:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa30279640 1 -- 172.21.15.28:0/3271799477 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa280a3c50 con 0x7ffa281560e0 2023-12-16T03:26:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa1effd640 1 -- 172.21.15.28:0/3271799477 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa200149e0 con 0x7ffa281560e0 2023-12-16T03:26:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.957+0000 7ffa30279640 1 -- 172.21.15.28:0/3271799477 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa280a4210 con 0x7ffa281560e0 2023-12-16T03:26:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.961+0000 7ffa30279640 1 -- 172.21.15.28:0/3271799477 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa280a4400 con 0x7ffa281560e0 2023-12-16T03:26:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.961+0000 7ffa1effd640 1 -- 172.21.15.28:0/3271799477 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ffa20014b40 con 0x7ffa281560e0 2023-12-16T03:26:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.961+0000 7ffa1effd640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa0c066470 0x7ffa0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.961+0000 7ffa1effd640 1 -- 172.21.15.28:0/3271799477 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5885+0+0 (secure 0 0 0) 0x7ffa200847b0 con 0x7ffa281560e0 2023-12-16T03:26:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.961+0000 7ffa2e015640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa0c066470 0x7ffa0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:47.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.961+0000 7ffa2e015640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa0c066470 0x7ffa0c068930 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffa24007fd0 tx=0x7ffa24009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:47.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:47.965+0000 7ffa1effd640 1 -- 172.21.15.28:0/3271799477 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ffa20051c20 con 0x7ffa281560e0 2023-12-16T03:26:48.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.161+0000 7ffa30279640 1 -- 172.21.15.28:0/3271799477 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffa28068400 con 0x7ffa281560e0 2023-12-16T03:26:48.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa1effd640 1 -- 172.21.15.28:0/3271799477 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 105+0+0 (secure 0 0 0) 0x7ffa20055240 con 0x7ffa281560e0 2023-12-16T03:26:48.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 -- 172.21.15.28:0/3271799477 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa0c066470 msgr2=0x7ffa0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:48.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa0c066470 0x7ffa0c068930 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffa24007fd0 tx=0x7ffa24009040 comp rx=0 tx=0).stop 2023-12-16T03:26:48.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 -- 172.21.15.28:0/3271799477 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa281560e0 msgr2=0x7ffa281f54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:48.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa281560e0 0x7ffa281f54b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007e40 tx=0x7ffa2000e4b0 comp rx=0 tx=0).stop 2023-12-16T03:26:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 -- 172.21.15.28:0/3271799477 shutdown_connections 2023-12-16T03:26:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa0c066470 0x7ffa0c068930 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa281560e0 0x7ffa281f54b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa280bffc0 0x7ffa281f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 --2- 172.21.15.28:0/3271799477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa2806d520 0x7ffa28153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 -- 172.21.15.28:0/3271799477 >> 172.21.15.28:0/3271799477 conn(0x7ffa2806a5b0 msgr2=0x7ffa28154fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 -- 172.21.15.28:0/3271799477 shutdown_connections 2023-12-16T03:26:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:48.781+0000 7ffa30279640 1 -- 172.21.15.28:0/3271799477 wait complete. 2023-12-16T03:26:48.811 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-16T03:26:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a3aafe640 1 Processor -- start 2023-12-16T03:26:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a3aafe640 1 -- start start 2023-12-16T03:26:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a3aafe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4a340c4fb0 0x7f4a340c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a3aafe640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a340aa750 con 0x7f4a3406db90 2023-12-16T03:26:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a3aafe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a340a8f90 con 0x7f4a340c32a0 2023-12-16T03:26:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a3aafe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a340a9270 con 0x7f4a340c4fb0 2023-12-16T03:26:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a33fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4a3406db90 0x7f4a3406c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40268/0 (socket says 172.21.15.28:40268) 2023-12-16T03:26:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a33fff640 1 -- 172.21.15.28:0/3263863109 learned_addr learned my addr 172.21.15.28:0/3263863109 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a3889a640 1 --2- 172.21.15.28:0/3263863109 >> v2:172.21.15.134:3300/0 conn(0x7f4a340c4fb0 0x7f4a340c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a337fe640 1 -- 172.21.15.28:0/3263863109 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248155502 0 0) 0x7f4a340aa750 con 0x7f4a3406db90 2023-12-16T03:26:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a337fe640 1 -- 172.21.15.28:0/3263863109 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a24003530 con 0x7f4a3406db90 2023-12-16T03:26:49.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a337fe640 1 -- 172.21.15.28:0/3263863109 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516878230 0 0) 0x7f4a340a8f90 con 0x7f4a340c32a0 2023-12-16T03:26:49.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a337fe640 1 -- 172.21.15.28:0/3263863109 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a340aa750 con 0x7f4a340c32a0 2023-12-16T03:26:49.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a337fe640 1 -- 172.21.15.28:0/3263863109 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2781496603 0 0) 0x7f4a24003530 con 0x7f4a3406db90 2023-12-16T03:26:49.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a3889a640 1 -- 172.21.15.28:0/3263863109 >> v1:172.21.15.134:6789/0 conn(0x7f4a340c32a0 legacy=0x7f4a3406cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:49.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a3889a640 1 -- 172.21.15.28:0/3263863109 >> v1:172.21.15.28:6789/0 conn(0x7f4a3406db90 legacy=0x7f4a3406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:49.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.001+0000 7f4a3889a640 1 -- 172.21.15.28:0/3263863109 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a340a9550 con 0x7f4a340c4fb0 2023-12-16T03:26:49.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.005+0000 7f4a3889a640 1 --2- 172.21.15.28:0/3263863109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a340c4fb0 0x7f4a340c1320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4a280097c0 tx=0x7f4a2801c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af1b5312996b3ba7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:49.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.005+0000 7f4a337fe640 1 -- 172.21.15.28:0/3263863109 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20001680 con 0x7f4a340c4fb0 2023-12-16T03:26:49.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.005+0000 7f4a337fe640 1 -- 172.21.15.28:0/3263863109 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a280a7050 con 0x7f4a340c4fb0 2023-12-16T03:26:49.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.005+0000 7f4a337fe640 1 -- 172.21.15.28:0/3263863109 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280ab600 con 0x7f4a340c4fb0 2023-12-16T03:26:49.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.005+0000 7f4a3aafe640 1 -- 172.21.15.28:0/3263863109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a340c4fb0 msgr2=0x7f4a340c1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:49.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.005+0000 7f4a3aafe640 1 --2- 172.21.15.28:0/3263863109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a340c4fb0 0x7f4a340c1320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4a280097c0 tx=0x7f4a2801c280 comp rx=0 tx=0).stop 2023-12-16T03:26:49.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.005+0000 7f4a3aafe640 1 -- 172.21.15.28:0/3263863109 shutdown_connections 2023-12-16T03:26:49.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.005+0000 7f4a3aafe640 1 --2- 172.21.15.28:0/3263863109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a340c4fb0 0x7f4a340c1320 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:49.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.005+0000 7f4a3aafe640 1 -- 172.21.15.28:0/3263863109 >> 172.21.15.28:0/3263863109 conn(0x7f4a340c5d40 msgr2=0x7f4a340c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:49.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.005+0000 7f4a3aafe640 1 -- 172.21.15.28:0/3263863109 shutdown_connections 2023-12-16T03:26:49.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.005+0000 7f4a3aafe640 1 -- 172.21.15.28:0/3263863109 wait complete. 2023-12-16T03:26:49.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3aafe640 1 Processor -- start 2023-12-16T03:26:49.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3aafe640 1 -- start start 2023-12-16T03:26:49.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3aafe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a3406db90 0x7f4a3414ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:49.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3aafe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a340c32a0 0x7f4a34070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:49.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3aafe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a340c4fb0 0x7f4a341eab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:49.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3aafe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a340bb0e0 con 0x7f4a3406db90 2023-12-16T03:26:49.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3aafe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a340bb700 con 0x7f4a340c32a0 2023-12-16T03:26:49.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3aafe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a340bae00 con 0x7f4a340c4fb0 2023-12-16T03:26:49.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3889a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a3406db90 0x7f4a3414ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3889a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a3406db90 0x7f4a3414ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49398/0 (socket says 172.21.15.28:49398) 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3889a640 1 -- 172.21.15.28:0/1690478943 learned_addr learned my addr 172.21.15.28:0/1690478943 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a33fff640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a340c32a0 0x7f4a34070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3909b640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a340c4fb0 0x7f4a341eab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3889a640 1 -- 172.21.15.28:0/1690478943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a340c4fb0 msgr2=0x7f4a341eab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3889a640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a340c4fb0 0x7f4a341eab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3889a640 1 -- 172.21.15.28:0/1690478943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a340c32a0 msgr2=0x7f4a34070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3889a640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a340c32a0 0x7f4a34070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3889a640 1 -- 172.21.15.28:0/1690478943 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a28009420 con 0x7f4a3406db90 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3909b640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a340c4fb0 0x7f4a341eab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3889a640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a3406db90 0x7f4a3414ff70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4a28018e90 tx=0x7f4a28019020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a317fa640 1 -- 172.21.15.28:0/1690478943 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280b4400 con 0x7f4a3406db90 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a317fa640 1 -- 172.21.15.28:0/1690478943 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a280b4580 con 0x7f4a3406db90 2023-12-16T03:26:49.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a317fa640 1 -- 172.21.15.28:0/1690478943 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280b4930 con 0x7f4a3406db90 2023-12-16T03:26:49.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3aafe640 1 -- 172.21.15.28:0/1690478943 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a341eeba0 con 0x7f4a3406db90 2023-12-16T03:26:49.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.009+0000 7f4a3aafe640 1 -- 172.21.15.28:0/1690478943 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a340bbb90 con 0x7f4a3406db90 2023-12-16T03:26:49.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.013+0000 7f4a3aafe640 1 -- 172.21.15.28:0/1690478943 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a34068400 con 0x7f4a3406db90 2023-12-16T03:26:49.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.013+0000 7f4a317fa640 1 -- 172.21.15.28:0/1690478943 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4a280b2040 con 0x7f4a3406db90 2023-12-16T03:26:49.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.013+0000 7f4a317fa640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a18066470 0x7f4a18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:49.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.013+0000 7f4a317fa640 1 -- 172.21.15.28:0/1690478943 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f4a2811dcf0 con 0x7f4a3406db90 2023-12-16T03:26:49.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.013+0000 7f4a33fff640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a18066470 0x7f4a18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:49.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.013+0000 7f4a33fff640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a18066470 0x7f4a18068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4a340bd0f0 tx=0x7f4a20009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:49.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.017+0000 7f4a317fa640 1 -- 172.21.15.28:0/1690478943 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4a280eb0a0 con 0x7f4a3406db90 2023-12-16T03:26:49.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:49.181+0000 7f4a3aafe640 1 -- 172.21.15.28:0/1690478943 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4a340c1100 con 0x7f4a3406db90 2023-12-16T03:26:50.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.077+0000 7f4a317fa640 1 -- 172.21.15.28:0/1690478943 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4a280ee6c0 con 0x7f4a3406db90 2023-12-16T03:26:50.085 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_metadata' removed 2023-12-16T03:26:50.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.081+0000 7f4a3aafe640 1 -- 172.21.15.28:0/1690478943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a18066470 msgr2=0x7f4a18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:50.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.081+0000 7f4a3aafe640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a18066470 0x7f4a18068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4a340bd0f0 tx=0x7f4a20009040 comp rx=0 tx=0).stop 2023-12-16T03:26:50.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.081+0000 7f4a3aafe640 1 -- 172.21.15.28:0/1690478943 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a3406db90 msgr2=0x7f4a3414ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:50.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.081+0000 7f4a3aafe640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a3406db90 0x7f4a3414ff70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4a28018e90 tx=0x7f4a28019020 comp rx=0 tx=0).stop 2023-12-16T03:26:50.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.081+0000 7f4a3aafe640 1 -- 172.21.15.28:0/1690478943 shutdown_connections 2023-12-16T03:26:50.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.081+0000 7f4a3aafe640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a340c4fb0 0x7f4a341eab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:50.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.081+0000 7f4a3aafe640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a340c32a0 0x7f4a34070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:50.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.081+0000 7f4a3aafe640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a18066470 0x7f4a18068930 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:50.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.081+0000 7f4a3aafe640 1 --2- 172.21.15.28:0/1690478943 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a3406db90 0x7f4a3414ff70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:50.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.081+0000 7f4a3aafe640 1 -- 172.21.15.28:0/1690478943 >> 172.21.15.28:0/1690478943 conn(0x7f4a340c5d40 msgr2=0x7f4a340a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:50.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.081+0000 7f4a3aafe640 1 -- 172.21.15.28:0/1690478943 shutdown_connections 2023-12-16T03:26:50.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.085+0000 7f4a3aafe640 1 -- 172.21.15.28:0/1690478943 wait complete. 2023-12-16T03:26:50.116 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-16T03:26:50.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 Processor -- start 2023-12-16T03:26:50.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 -- start start 2023-12-16T03:26:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80bc151ca0 0x7f80bc0c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f80bc0c4930 0x7f80bc0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80bc154a90 con 0x7f80bc06b750 2023-12-16T03:26:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc06cec0 con 0x7f80bc151ca0 2023-12-16T03:26:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc154d70 con 0x7f80bc0c4930 2023-12-16T03:26:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c1194640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80bc151ca0 0x7f80bc0c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c1194640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80bc151ca0 0x7f80bc0c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44130/0 (socket says 172.21.15.28:44130) 2023-12-16T03:26:50.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c1194640 1 -- 172.21.15.28:0/1560011281 learned_addr learned my addr 172.21.15.28:0/1560011281 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:50.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c0993640 1 --2- 172.21.15.28:0/1560011281 >> v2:172.21.15.134:3300/0 conn(0x7f80bc0c4930 0x7f80bc0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:50.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c1194640 1 -- 172.21.15.28:0/1560011281 >> v2:172.21.15.134:3300/0 conn(0x7f80bc0c4930 msgr2=0x7f80bc0c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:50.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c1194640 1 --2- 172.21.15.28:0/1560011281 >> v2:172.21.15.134:3300/0 conn(0x7f80bc0c4930 0x7f80bc0c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:50.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c1194640 1 -- 172.21.15.28:0/1560011281 >> v1:172.21.15.134:6789/0 conn(0x7f80bc06b750 legacy=0x7f80bc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:50.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c1194640 1 -- 172.21.15.28:0/1560011281 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc155050 con 0x7f80bc151ca0 2023-12-16T03:26:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c1194640 1 --2- 172.21.15.28:0/1560011281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80bc151ca0 0x7f80bc0c7eb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f80bc08b940 tx=0x7f80b801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766efe74084cab42 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80b3fff640 1 -- 172.21.15.28:0/1560011281 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80ab640 con 0x7f80bc151ca0 2023-12-16T03:26:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80b3fff640 1 -- 172.21.15.28:0/1560011281 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b80a7070 con 0x7f80bc151ca0 2023-12-16T03:26:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80b3fff640 1 -- 172.21.15.28:0/1560011281 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80ab9c0 con 0x7f80bc151ca0 2023-12-16T03:26:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 -- 172.21.15.28:0/1560011281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80bc151ca0 msgr2=0x7f80bc0c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 --2- 172.21.15.28:0/1560011281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80bc151ca0 0x7f80bc0c7eb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f80bc08b940 tx=0x7f80b801c440 comp rx=0 tx=0).stop 2023-12-16T03:26:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 -- 172.21.15.28:0/1560011281 shutdown_connections 2023-12-16T03:26:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 --2- 172.21.15.28:0/1560011281 >> v2:172.21.15.134:3300/0 conn(0x7f80bc0c4930 0x7f80bc0c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 --2- 172.21.15.28:0/1560011281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80bc151ca0 0x7f80bc0c7eb0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:50.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 -- 172.21.15.28:0/1560011281 >> 172.21.15.28:0/1560011281 conn(0x7f80bc0ca180 msgr2=0x7f80bc0ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:50.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 -- 172.21.15.28:0/1560011281 shutdown_connections 2023-12-16T03:26:50.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.265+0000 7f80c33f8640 1 -- 172.21.15.28:0/1560011281 wait complete. 2023-12-16T03:26:50.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c33f8640 1 Processor -- start 2023-12-16T03:26:50.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c33f8640 1 -- start start 2023-12-16T03:26:50.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c33f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc06b750 0x7f80bc14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:50.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c33f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80bc0c4930 0x7f80bc158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:50.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c33f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc151ca0 0x7f80bc158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:50.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c33f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc1e73f0 con 0x7f80bc0c4930 2023-12-16T03:26:50.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c33f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc1e6770 con 0x7f80bc151ca0 2023-12-16T03:26:50.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c33f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc1e6a50 con 0x7f80bc06b750 2023-12-16T03:26:50.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c0993640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80bc0c4930 0x7f80bc158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:50.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c0993640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80bc0c4930 0x7f80bc158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44142/0 (socket says 172.21.15.28:44142) 2023-12-16T03:26:50.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c0993640 1 -- 172.21.15.28:0/2210656200 learned_addr learned my addr 172.21.15.28:0/2210656200 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:50.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c1194640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc06b750 0x7f80bc14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:50.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c1995640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc151ca0 0x7f80bc158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:50.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c0993640 1 -- 172.21.15.28:0/2210656200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc06b750 msgr2=0x7f80bc14a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:50.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c0993640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc06b750 0x7f80bc14a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:50.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c0993640 1 -- 172.21.15.28:0/2210656200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc151ca0 msgr2=0x7f80bc158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:50.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c0993640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc151ca0 0x7f80bc158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:50.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c0993640 1 -- 172.21.15.28:0/2210656200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80094d0 con 0x7f80bc0c4930 2023-12-16T03:26:50.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c0993640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80bc0c4930 0x7f80bc158320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00e930 tx=0x7f80ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:50.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80b1ffb640 1 -- 172.21.15.28:0/2210656200 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac009690 con 0x7f80bc0c4930 2023-12-16T03:26:50.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80b1ffb640 1 -- 172.21.15.28:0/2210656200 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac00ca00 con 0x7f80bc0c4930 2023-12-16T03:26:50.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80b1ffb640 1 -- 172.21.15.28:0/2210656200 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00cd70 con 0x7f80bc0c4930 2023-12-16T03:26:50.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.269+0000 7f80c33f8640 1 -- 172.21.15.28:0/2210656200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc1e6d30 con 0x7f80bc0c4930 2023-12-16T03:26:50.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.273+0000 7f80c33f8640 1 -- 172.21.15.28:0/2210656200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc0ac840 con 0x7f80bc0c4930 2023-12-16T03:26:50.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.273+0000 7f80c33f8640 1 -- 172.21.15.28:0/2210656200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc14f340 con 0x7f80bc0c4930 2023-12-16T03:26:50.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.273+0000 7f80b1ffb640 1 -- 172.21.15.28:0/2210656200 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f80ac013470 con 0x7f80bc0c4930 2023-12-16T03:26:50.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.273+0000 7f80b1ffb640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80a0066470 0x7f80a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:50.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.273+0000 7f80b1ffb640 1 -- 172.21.15.28:0/2210656200 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f80ac083fb0 con 0x7f80bc0c4930 2023-12-16T03:26:50.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.273+0000 7f80c1194640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80a0066470 0x7f80a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:50.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.273+0000 7f80c1194640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80a0066470 0x7f80a0068930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f80b80af000 tx=0x7f80b80b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:50.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.277+0000 7f80b1ffb640 1 -- 172.21.15.28:0/2210656200 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f80ac051690 con 0x7f80bc0c4930 2023-12-16T03:26:50.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:50.445+0000 7f80c33f8640 1 -- 172.21.15.28:0/2210656200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f80bc068400 con 0x7f80bc0c4930 2023-12-16T03:26:51.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.436+0000 7f80b1ffb640 1 -- 172.21.15.28:0/2210656200 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v42) v1 ==== 172+0+0 (secure 0 0 0) 0x7f80ac0170d0 con 0x7f80bc0c4930 2023-12-16T03:26:51.441 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_data' removed 2023-12-16T03:26:51.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 -- 172.21.15.28:0/2210656200 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80a0066470 msgr2=0x7f80a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80a0066470 0x7f80a0068930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f80b80af000 tx=0x7f80b80b6040 comp rx=0 tx=0).stop 2023-12-16T03:26:51.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 -- 172.21.15.28:0/2210656200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80bc0c4930 msgr2=0x7f80bc158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80bc0c4930 0x7f80bc158320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00e930 tx=0x7f80ac00edf0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 -- 172.21.15.28:0/2210656200 shutdown_connections 2023-12-16T03:26:51.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80bc151ca0 0x7f80bc158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f80a0066470 0x7f80a0068930 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80bc0c4930 0x7f80bc158320 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 --2- 172.21.15.28:0/2210656200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f80bc06b750 0x7f80bc14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 -- 172.21.15.28:0/2210656200 >> 172.21.15.28:0/2210656200 conn(0x7f80bc0ca180 msgr2=0x7f80bc0ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:51.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 -- 172.21.15.28:0/2210656200 shutdown_connections 2023-12-16T03:26:51.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.444+0000 7f80c33f8640 1 -- 172.21.15.28:0/2210656200 wait complete. 2023-12-16T03:26:51.472 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-16T03:26:51.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f240b4fe640 1 Processor -- start 2023-12-16T03:26:51.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f240b4fe640 1 -- start start 2023-12-16T03:26:51.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f240b4fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f24040c4100 0x7f24040c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:51.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f240b4fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c06d0 0x7f24040a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:51.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f240b4fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24040c31c0 con 0x7f24040c63c0 2023-12-16T03:26:51.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f240b4fe640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24040c34a0 con 0x7f24040c4100 2023-12-16T03:26:51.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f240b4fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24040c1030 con 0x7f24040c06d0 2023-12-16T03:26:51.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f2408a99640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f24040c4100 0x7f24040c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:51.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f2408a99640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f24040c4100 0x7f24040c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44146/0 (socket says 172.21.15.28:44146) 2023-12-16T03:26:51.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f2408a99640 1 -- 172.21.15.28:0/2813175657 learned_addr learned my addr 172.21.15.28:0/2813175657 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:51.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f2409a9b640 1 --2- 172.21.15.28:0/2813175657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c06d0 0x7f24040a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:51.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f2408a99640 1 -- 172.21.15.28:0/2813175657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c06d0 msgr2=0x7f24040a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:51.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f2408a99640 1 --2- 172.21.15.28:0/2813175657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c06d0 0x7f24040a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f2408a99640 1 -- 172.21.15.28:0/2813175657 >> v1:172.21.15.134:6789/0 conn(0x7f24040c63c0 legacy=0x7f24040c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f2408a99640 1 -- 172.21.15.28:0/2813175657 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24040c1310 con 0x7f24040c4100 2023-12-16T03:26:51.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.620+0000 7f2409a9b640 1 --2- 172.21.15.28:0/2813175657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c06d0 0x7f24040a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:51.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f2408a99640 1 --2- 172.21.15.28:0/2813175657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24040c4100 0x7f24040c2bb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009870 tx=0x7f23f401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73ebbc5323b72cf server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:51.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f23fbfff640 1 -- 172.21.15.28:0/2813175657 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24040aa3d0 con 0x7f24040c4100 2023-12-16T03:26:51.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f23fbfff640 1 -- 172.21.15.28:0/2813175657 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f40a7050 con 0x7f24040c4100 2023-12-16T03:26:51.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f23fbfff640 1 -- 172.21.15.28:0/2813175657 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f40ab820 con 0x7f24040c4100 2023-12-16T03:26:51.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f240b4fe640 1 -- 172.21.15.28:0/2813175657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24040c4100 msgr2=0x7f24040c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f240b4fe640 1 --2- 172.21.15.28:0/2813175657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24040c4100 0x7f24040c2bb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009870 tx=0x7f23f401c420 comp rx=0 tx=0).stop 2023-12-16T03:26:51.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f240b4fe640 1 -- 172.21.15.28:0/2813175657 shutdown_connections 2023-12-16T03:26:51.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f240b4fe640 1 --2- 172.21.15.28:0/2813175657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c06d0 0x7f24040a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f240b4fe640 1 --2- 172.21.15.28:0/2813175657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24040c4100 0x7f24040c2bb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f240b4fe640 1 -- 172.21.15.28:0/2813175657 >> 172.21.15.28:0/2813175657 conn(0x7f240406a5b0 msgr2=0x7f240406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:51.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f240b4fe640 1 -- 172.21.15.28:0/2813175657 shutdown_connections 2023-12-16T03:26:51.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.624+0000 7f240b4fe640 1 -- 172.21.15.28:0/2813175657 wait complete. 2023-12-16T03:26:51.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f240b4fe640 1 Processor -- start 2023-12-16T03:26:51.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f240b4fe640 1 -- start start 2023-12-16T03:26:51.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f240b4fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040c06d0 0x7f2404154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:51.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f240b4fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c4100 0x7f2404156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:51.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f240b4fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24040c63c0 0x7f2404158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f240b4fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2404155db0 con 0x7f24040c63c0 2023-12-16T03:26:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f240b4fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2404156d40 con 0x7f24040c06d0 2023-12-16T03:26:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f240b4fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24040a4890 con 0x7f24040c4100 2023-12-16T03:26:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f2409a9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24040c63c0 0x7f2404158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f2409a9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24040c63c0 0x7f2404158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44158/0 (socket says 172.21.15.28:44158) 2023-12-16T03:26:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f2409a9b640 1 -- 172.21.15.28:0/306351568 learned_addr learned my addr 172.21.15.28:0/306351568 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:51.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f240929a640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040c06d0 0x7f2404154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:51.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f2408a99640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c4100 0x7f2404156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:51.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f2409a9b640 1 -- 172.21.15.28:0/306351568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c4100 msgr2=0x7f2404156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f2409a9b640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c4100 0x7f2404156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f2409a9b640 1 -- 172.21.15.28:0/306351568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040c06d0 msgr2=0x7f2404154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f2409a9b640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040c06d0 0x7f2404154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f2409a9b640 1 -- 172.21.15.28:0/306351568 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f40094d0 con 0x7f24040c63c0 2023-12-16T03:26:51.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f240929a640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040c06d0 0x7f2404154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:51.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f2408a99640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c4100 0x7f2404156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:51.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.628+0000 7f2409a9b640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24040c63c0 0x7f2404158730 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f23fc007ef0 tx=0x7f23fc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:51.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.632+0000 7f23f9ffb640 1 -- 172.21.15.28:0/306351568 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc003ba0 con 0x7f24040c63c0 2023-12-16T03:26:51.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.632+0000 7f23f9ffb640 1 -- 172.21.15.28:0/306351568 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc00f040 con 0x7f24040c63c0 2023-12-16T03:26:51.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.632+0000 7f23f9ffb640 1 -- 172.21.15.28:0/306351568 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc00de80 con 0x7f24040c63c0 2023-12-16T03:26:51.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.632+0000 7f240b4fe640 1 -- 172.21.15.28:0/306351568 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24040a4b70 con 0x7f24040c63c0 2023-12-16T03:26:51.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.632+0000 7f240b4fe640 1 -- 172.21.15.28:0/306351568 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24041562e0 con 0x7f24040c63c0 2023-12-16T03:26:51.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.632+0000 7f240b4fe640 1 -- 172.21.15.28:0/306351568 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2404068400 con 0x7f24040c63c0 2023-12-16T03:26:51.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.632+0000 7f23f9ffb640 1 -- 172.21.15.28:0/306351568 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f23fc004030 con 0x7f24040c63c0 2023-12-16T03:26:51.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.636+0000 7f23f9ffb640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23e80664c0 0x7f23e8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:51.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.636+0000 7f23f9ffb640 1 -- 172.21.15.28:0/306351568 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f23fc083e10 con 0x7f24040c63c0 2023-12-16T03:26:51.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.636+0000 7f240929a640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23e80664c0 0x7f23e8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:51.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.636+0000 7f240929a640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23e80664c0 0x7f23e8068980 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f24040679c0 tx=0x7f2400009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:51.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.640+0000 7f23f9ffb640 1 -- 172.21.15.28:0/306351568 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f23fc087030 con 0x7f24040c63c0 2023-12-16T03:26:51.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.800+0000 7f240b4fe640 1 -- 172.21.15.28:0/306351568 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f24040c3e70 con 0x7f24040c63c0 2023-12-16T03:26:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.804+0000 7f23f9ffb640 1 -- 172.21.15.28:0/306351568 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f23fc051650 con 0x7f24040c63c0 2023-12-16T03:26:51.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.804+0000 7f240b4fe640 1 -- 172.21.15.28:0/306351568 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23e80664c0 msgr2=0x7f23e8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.804+0000 7f240b4fe640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23e80664c0 0x7f23e8068980 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f24040679c0 tx=0x7f2400009040 comp rx=0 tx=0).stop 2023-12-16T03:26:51.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.804+0000 7f240b4fe640 1 -- 172.21.15.28:0/306351568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24040c63c0 msgr2=0x7f2404158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.804+0000 7f240b4fe640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24040c63c0 0x7f2404158730 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f23fc007ef0 tx=0x7f23fc00d4a0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.808+0000 7f240b4fe640 1 -- 172.21.15.28:0/306351568 shutdown_connections 2023-12-16T03:26:51.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.808+0000 7f240b4fe640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f23e80664c0 0x7f23e8068980 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.808+0000 7f240b4fe640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24040c63c0 0x7f2404158730 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.808+0000 7f240b4fe640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24040c4100 0x7f2404156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.808+0000 7f240b4fe640 1 --2- 172.21.15.28:0/306351568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24040c06d0 0x7f2404154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.808+0000 7f240b4fe640 1 -- 172.21.15.28:0/306351568 >> 172.21.15.28:0/306351568 conn(0x7f240406a5b0 msgr2=0x7f24040c48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:51.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.808+0000 7f240b4fe640 1 -- 172.21.15.28:0/306351568 shutdown_connections 2023-12-16T03:26:51.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.808+0000 7f240b4fe640 1 -- 172.21.15.28:0/306351568 wait complete. 2023-12-16T03:26:51.829 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-16T03:26:51.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc3a4c68640 1 Processor -- start 2023-12-16T03:26:51.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc3a4c68640 1 -- start start 2023-12-16T03:26:51.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc3a4c68640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc3a00725c0 0x7fc3a01516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:51.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc3a4c68640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a00c2760 con 0x7fc3a0072090 2023-12-16T03:26:51.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc3a4c68640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a00a5750 con 0x7fc3a00a5370 2023-12-16T03:26:51.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc3a4c68640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a00c3070 con 0x7fc3a00725c0 2023-12-16T03:26:51.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc397fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc3a0072090 0x7fc3a0150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40864/0 (socket says 172.21.15.28:40864) 2023-12-16T03:26:51.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc397fff640 1 -- 172.21.15.28:0/1615044462 learned_addr learned my addr 172.21.15.28:0/1615044462 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:51.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc39ed9d640 1 --2- 172.21.15.28:0/1615044462 >> v2:172.21.15.134:3300/0 conn(0x7fc3a00725c0 0x7fc3a01516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:51.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc39dd9b640 1 -- 172.21.15.28:0/1615044462 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723433312 0 0) 0x7fc3a00c2760 con 0x7fc3a0072090 2023-12-16T03:26:51.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc39dd9b640 1 -- 172.21.15.28:0/1615044462 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc38c003530 con 0x7fc3a0072090 2023-12-16T03:26:51.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc39ed9d640 1 -- 172.21.15.28:0/1615044462 >> v1:172.21.15.134:6789/0 conn(0x7fc3a00a5370 legacy=0x7fc3a00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc39ed9d640 1 -- 172.21.15.28:0/1615044462 >> v1:172.21.15.28:6789/0 conn(0x7fc3a0072090 legacy=0x7fc3a0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.980+0000 7fc39ed9d640 1 -- 172.21.15.28:0/1615044462 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a00aad20 con 0x7fc3a00725c0 2023-12-16T03:26:51.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.984+0000 7fc39ed9d640 1 --2- 172.21.15.28:0/1615044462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00725c0 0x7fc3a01516b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc398009d90 tx=0x7fc39801d940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40d18095f15cf4cc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:51.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.984+0000 7fc39dd9b640 1 -- 172.21.15.28:0/1615044462 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980a6870 con 0x7fc3a00725c0 2023-12-16T03:26:51.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.984+0000 7fc39dd9b640 1 -- 172.21.15.28:0/1615044462 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3980a69d0 con 0x7fc3a00725c0 2023-12-16T03:26:51.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.984+0000 7fc39dd9b640 1 -- 172.21.15.28:0/1615044462 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980a6d60 con 0x7fc3a00725c0 2023-12-16T03:26:51.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.984+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1615044462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00725c0 msgr2=0x7fc3a01516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.984+0000 7fc3a4c68640 1 --2- 172.21.15.28:0/1615044462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00725c0 0x7fc3a01516b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc398009d90 tx=0x7fc39801d940 comp rx=0 tx=0).stop 2023-12-16T03:26:51.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.984+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1615044462 shutdown_connections 2023-12-16T03:26:51.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.984+0000 7fc3a4c68640 1 --2- 172.21.15.28:0/1615044462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a00725c0 0x7fc3a01516b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.984+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1615044462 >> 172.21.15.28:0/1615044462 conn(0x7fc3a006a5b0 msgr2=0x7fc3a006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:51.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.984+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1615044462 shutdown_connections 2023-12-16T03:26:51.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.984+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1615044462 wait complete. 2023-12-16T03:26:51.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc3a4c68640 1 Processor -- start 2023-12-16T03:26:51.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc3a4c68640 1 -- start start 2023-12-16T03:26:51.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc3a4c68640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a0072090 0x7fc3a0152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:51.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc3a4c68640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3a00725c0 0x7fc3a00bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:51.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc3a4c68640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a00a5370 0x7fc3a014ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:51.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc3a4c68640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0070410 con 0x7fc3a00a5370 2023-12-16T03:26:51.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc3a4c68640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a01528f0 con 0x7fc3a0072090 2023-12-16T03:26:51.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc3a4c68640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a006fe50 con 0x7fc3a00725c0 2023-12-16T03:26:51.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc39ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a00a5370 0x7fc3a014ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:51.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc39ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a00a5370 0x7fc3a014ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44174/0 (socket says 172.21.15.28:44174) 2023-12-16T03:26:51.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc39ed9d640 1 -- 172.21.15.28:0/1674128525 learned_addr learned my addr 172.21.15.28:0/1674128525 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:51.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc397fff640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3a00725c0 0x7fc3a00bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc39ed9d640 1 -- 172.21.15.28:0/1674128525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3a00725c0 msgr2=0x7fc3a00bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc39e59c640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a0072090 0x7fc3a0152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc39ed9d640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3a00725c0 0x7fc3a00bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc39ed9d640 1 -- 172.21.15.28:0/1674128525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a0072090 msgr2=0x7fc3a0152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc39ed9d640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a0072090 0x7fc3a0152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc39ed9d640 1 -- 172.21.15.28:0/1674128525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc398009a70 con 0x7fc3a00a5370 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc397fff640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3a00725c0 0x7fc3a00bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc39e59c640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a0072090 0x7fc3a0152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc39ed9d640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a00a5370 0x7fc3a014ea80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc39801b570 tx=0x7fc39801c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc396ffd640 1 -- 172.21.15.28:0/1674128525 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980b9650 con 0x7fc3a00a5370 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc396ffd640 1 -- 172.21.15.28:0/1674128525 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3980b97b0 con 0x7fc3a00a5370 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc396ffd640 1 -- 172.21.15.28:0/1674128525 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980b9b20 con 0x7fc3a00a5370 2023-12-16T03:26:51.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1674128525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a01ed520 con 0x7fc3a00a5370 2023-12-16T03:26:51.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1674128525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a00700a0 con 0x7fc3a00a5370 2023-12-16T03:26:51.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.988+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1674128525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a0151d50 con 0x7fc3a00a5370 2023-12-16T03:26:51.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.992+0000 7fc396ffd640 1 -- 172.21.15.28:0/1674128525 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc3980b5070 con 0x7fc3a00a5370 2023-12-16T03:26:51.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.992+0000 7fc396ffd640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc380066470 0x7fc380068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:51.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.992+0000 7fc396ffd640 1 -- 172.21.15.28:0/1674128525 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc39811ec60 con 0x7fc3a00a5370 2023-12-16T03:26:51.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.992+0000 7fc39e59c640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc380066470 0x7fc380068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:51.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.992+0000 7fc39e59c640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc380066470 0x7fc380068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00a9a10 tx=0x7fc390009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:51.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:51.996+0000 7fc396ffd640 1 -- 172.21.15.28:0/1674128525 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc3980ec370 con 0x7fc3a00a5370 2023-12-16T03:26:52.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.208+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1674128525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7fc3a0068400 con 0x7fc3a00a5370 2023-12-16T03:26:52.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.440+0000 7fc396ffd640 1 -- 172.21.15.28:0/1674128525 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v116) v1 ==== 159+0+0 (secure 0 0 0) 0x7fc3980b30e0 con 0x7fc3a00a5370 2023-12-16T03:26:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.440+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1674128525 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc380066470 msgr2=0x7fc380068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.440+0000 7fc3a4c68640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc380066470 0x7fc380068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00a9a10 tx=0x7fc390009040 comp rx=0 tx=0).stop 2023-12-16T03:26:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.440+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1674128525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a00a5370 msgr2=0x7fc3a014ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.440+0000 7fc3a4c68640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a00a5370 0x7fc3a014ea80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc39801b570 tx=0x7fc39801c180 comp rx=0 tx=0).stop 2023-12-16T03:26:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.440+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1674128525 shutdown_connections 2023-12-16T03:26:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.440+0000 7fc3a4c68640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc380066470 0x7fc380068930 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.440+0000 7fc3a4c68640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc3a00a5370 0x7fc3a014ea80 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.440+0000 7fc3a4c68640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc3a00725c0 0x7fc3a00bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.440+0000 7fc3a4c68640 1 --2- 172.21.15.28:0/1674128525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3a0072090 0x7fc3a0152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.440+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1674128525 >> 172.21.15.28:0/1674128525 conn(0x7fc3a006a5b0 msgr2=0x7fc3a00c5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.444+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1674128525 shutdown_connections 2023-12-16T03:26:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.444+0000 7fc3a4c68640 1 -- 172.21.15.28:0/1674128525 wait complete. 2023-12-16T03:26:52.466 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-16T03:26:52.466 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-16T03:26:52.467 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:52.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6edd29c640 1 Processor -- start 2023-12-16T03:26:52.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6edd29c640 1 -- start start 2023-12-16T03:26:52.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6edd29c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ed80a5370 0x7f6ed80c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6edd29c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6ed80c4110 0x7f6ed8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6edd29c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6ed8072090 0x7f6ed81514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6edd29c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed80c3070 con 0x7f6ed8072090 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6edd29c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed80c2760 con 0x7f6ed80c4110 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6edd29c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80a5750 con 0x7f6ed80a5370 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6ed77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6ed8072090 0x7f6ed81514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6ed77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6ed8072090 0x7f6ed81514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44178/0 (socket says 172.21.15.28:44178) 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6ed77fe640 1 -- 172.21.15.28:0/2824187002 learned_addr learned my addr 172.21.15.28:0/2824187002 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6ed77fe640 1 -- 172.21.15.28:0/2824187002 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ed80a5370 msgr2=0x7f6ed80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6ed77fe640 1 --2- 172.21.15.28:0/2824187002 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ed80a5370 0x7f6ed80c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6ed77fe640 1 -- 172.21.15.28:0/2824187002 >> v2:172.21.15.134:3300/0 conn(0x7f6ed80c4110 msgr2=0x7f6ed8150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6ed77fe640 1 --2- 172.21.15.28:0/2824187002 >> v2:172.21.15.134:3300/0 conn(0x7f6ed80c4110 0x7f6ed8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.608+0000 7f6ed77fe640 1 -- 172.21.15.28:0/2824187002 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed80aad20 con 0x7f6ed8072090 2023-12-16T03:26:52.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6ed77fe640 1 --2- 172.21.15.28:0/2824187002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ed8072090 0x7f6ed81514e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6ed806b480 tx=0x7f6ed001eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e8f1f573273cad server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:52.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6ed67fc640 1 -- 172.21.15.28:0/2824187002 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed00a78b0 con 0x7f6ed8072090 2023-12-16T03:26:52.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6ed67fc640 1 -- 172.21.15.28:0/2824187002 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed00a7a10 con 0x7f6ed8072090 2023-12-16T03:26:52.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6ed67fc640 1 -- 172.21.15.28:0/2824187002 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed00a7da0 con 0x7f6ed8072090 2023-12-16T03:26:52.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6edd29c640 1 -- 172.21.15.28:0/2824187002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ed8072090 msgr2=0x7f6ed81514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:52.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6edd29c640 1 --2- 172.21.15.28:0/2824187002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ed8072090 0x7f6ed81514e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6ed806b480 tx=0x7f6ed001eaa0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6edd29c640 1 -- 172.21.15.28:0/2824187002 shutdown_connections 2023-12-16T03:26:52.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6edd29c640 1 --2- 172.21.15.28:0/2824187002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ed8072090 0x7f6ed81514e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6edd29c640 1 --2- 172.21.15.28:0/2824187002 >> v2:172.21.15.134:3300/0 conn(0x7f6ed80c4110 0x7f6ed8150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6edd29c640 1 --2- 172.21.15.28:0/2824187002 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ed80a5370 0x7f6ed80c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6edd29c640 1 -- 172.21.15.28:0/2824187002 >> 172.21.15.28:0/2824187002 conn(0x7f6ed806a5b0 msgr2=0x7f6ed806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:52.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6edd29c640 1 -- 172.21.15.28:0/2824187002 shutdown_connections 2023-12-16T03:26:52.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.612+0000 7f6edd29c640 1 -- 172.21.15.28:0/2824187002 wait complete. 2023-12-16T03:26:52.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6edd29c640 1 Processor -- start 2023-12-16T03:26:52.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6edd29c640 1 -- start start 2023-12-16T03:26:52.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6edd29c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ed8072090 0x7f6ed81e9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6edd29c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ed80a5370 0x7f6ed81e9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6edd29c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ed80c4110 0x7f6ed814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6edd29c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed81e9980 con 0x7f6ed8072090 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6edd29c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed814e190 con 0x7f6ed80c4110 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6edd29c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed814d2a0 con 0x7f6ed80a5370 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ed6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ed8072090 0x7f6ed81e9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ed6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ed8072090 0x7f6ed81e9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44186/0 (socket says 172.21.15.28:44186) 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ed6ffd640 1 -- 172.21.15.28:0/539351510 learned_addr learned my addr 172.21.15.28:0/539351510 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ed77fe640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ed80c4110 0x7f6ed814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ecffff640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ed80a5370 0x7f6ed81e9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ed6ffd640 1 -- 172.21.15.28:0/539351510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ed80a5370 msgr2=0x7f6ed81e9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ed6ffd640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ed80a5370 0x7f6ed81e9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ed6ffd640 1 -- 172.21.15.28:0/539351510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ed80c4110 msgr2=0x7f6ed814c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:52.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ed6ffd640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ed80c4110 0x7f6ed814c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ed6ffd640 1 -- 172.21.15.28:0/539351510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0009b30 con 0x7f6ed8072090 2023-12-16T03:26:52.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ecffff640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ed80a5370 0x7f6ed81e9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:52.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ed6ffd640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ed8072090 0x7f6ed81e9e30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800b550 tx=0x7f6ec800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:52.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ecf7fe640 1 -- 172.21.15.28:0/539351510 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8010870 con 0x7f6ed8072090 2023-12-16T03:26:52.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ecf7fe640 1 -- 172.21.15.28:0/539351510 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec80109f0 con 0x7f6ed8072090 2023-12-16T03:26:52.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6edd29c640 1 -- 172.21.15.28:0/539351510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed814d580 con 0x7f6ed8072090 2023-12-16T03:26:52.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6ecf7fe640 1 -- 172.21.15.28:0/539351510 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8010da0 con 0x7f6ed8072090 2023-12-16T03:26:52.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.616+0000 7f6edd29c640 1 -- 172.21.15.28:0/539351510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed814bfd0 con 0x7f6ed8072090 2023-12-16T03:26:52.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.620+0000 7f6edd29c640 1 -- 172.21.15.28:0/539351510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed8068400 con 0x7f6ed8072090 2023-12-16T03:26:52.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.620+0000 7f6ecf7fe640 1 -- 172.21.15.28:0/539351510 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6ec800f3c0 con 0x7f6ed8072090 2023-12-16T03:26:52.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.620+0000 7f6ecf7fe640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6eb8066470 0x7f6eb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.620+0000 7f6ecf7fe640 1 -- 172.21.15.28:0/539351510 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6ec8083a90 con 0x7f6ed8072090 2023-12-16T03:26:52.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.620+0000 7f6ecffff640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6eb8066470 0x7f6eb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:52.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.620+0000 7f6ecffff640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6eb8066470 0x7f6eb8068930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0006fd0 tx=0x7f6ec0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:52.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.624+0000 7f6ecf7fe640 1 -- 172.21.15.28:0/539351510 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6ec80512f0 con 0x7f6ed8072090 2023-12-16T03:26:52.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 -- 172.21.15.28:0/539351510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ed815ac90 con 0x7f6ed8072090 2023-12-16T03:26:52.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6ecf7fe640 1 -- 172.21.15.28:0/539351510 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+13114 (secure 0 0 0) 0x7f6ec8054910 con 0x7f6ed8072090 2023-12-16T03:26:52.786 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:52.786 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":42,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:51.437966+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6836/664267694":"2023-12-17T03:26:47.779558+0000","172.21.15.28:6834/664267694":"2023-12-17T03:26:47.779558+0000","172.21.15.28:6837/1004873879":"2023-12-17T03:26:41.051540+0000","172.21.15.28:6835/1004873879":"2023-12-17T03:26:41.051540+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:52.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 -- 172.21.15.28:0/539351510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6eb8066470 msgr2=0x7f6eb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:52.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6eb8066470 0x7f6eb8068930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0006fd0 tx=0x7f6ec0008040 comp rx=0 tx=0).stop 2023-12-16T03:26:52.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 -- 172.21.15.28:0/539351510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ed8072090 msgr2=0x7f6ed81e9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:52.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ed8072090 0x7f6ed81e9e30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800b550 tx=0x7f6ec800ba10 comp rx=0 tx=0).stop 2023-12-16T03:26:52.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 -- 172.21.15.28:0/539351510 shutdown_connections 2023-12-16T03:26:52.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ed80c4110 0x7f6ed814c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ed80a5370 0x7f6ed81e9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6eb8066470 0x7f6eb8068930 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 --2- 172.21.15.28:0/539351510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ed8072090 0x7f6ed81e9e30 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 -- 172.21.15.28:0/539351510 >> 172.21.15.28:0/539351510 conn(0x7f6ed806a5b0 msgr2=0x7f6ed814b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:52.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 -- 172.21.15.28:0/539351510 shutdown_connections 2023-12-16T03:26:52.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.784+0000 7f6edd29c640 1 -- 172.21.15.28:0/539351510 wait complete. 2023-12-16T03:26:52.808 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:26:52.808 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:26:52.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f5762155640 1 Processor -- start 2023-12-16T03:26:52.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f5762155640 1 -- start start 2023-12-16T03:26:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f5762155640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f575c06dfe0 0x7f575c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f5762155640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f575c06b1e0 0x7f575c0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f5762155640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c072500 con 0x7f575c06a5b0 2023-12-16T03:26:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f5762155640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575c06ef50 con 0x7f575c06b1e0 2023-12-16T03:26:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f5762155640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0720b0 con 0x7f575c06dfe0 2023-12-16T03:26:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f575b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f575c06a5b0 0x7f575c0c2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40876/0 (socket says 172.21.15.28:40876) 2023-12-16T03:26:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f575b7fe640 1 -- 172.21.15.28:0/3575888541 learned_addr learned my addr 172.21.15.28:0/3575888541 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f575bfff640 1 --2- 172.21.15.28:0/3575888541 >> v2:172.21.15.28:3300/0 conn(0x7f575c06b1e0 0x7f575c0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f575affd640 1 --2- 172.21.15.28:0/3575888541 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f575c06dfe0 0x7f575c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f575a7fc640 1 -- 172.21.15.28:0/3575888541 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067734284 0 0) 0x7f575c072500 con 0x7f575c06a5b0 2023-12-16T03:26:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f575a7fc640 1 -- 172.21.15.28:0/3575888541 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5744003530 con 0x7f575c06a5b0 2023-12-16T03:26:52.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f575bfff640 1 -- 172.21.15.28:0/3575888541 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f575c06dfe0 msgr2=0x7f575c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:52.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f575bfff640 1 --2- 172.21.15.28:0/3575888541 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f575c06dfe0 0x7f575c06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f575bfff640 1 -- 172.21.15.28:0/3575888541 >> v1:172.21.15.28:6789/0 conn(0x7f575c06a5b0 legacy=0x7f575c0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:52.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.952+0000 7f575bfff640 1 -- 172.21.15.28:0/3575888541 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c070f60 con 0x7f575c06b1e0 2023-12-16T03:26:52.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f575bfff640 1 --2- 172.21.15.28:0/3575888541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f575c06b1e0 0x7f575c0c27a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5754009d90 tx=0x7f575401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5796e9058b152bb server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f575a7fc640 1 -- 172.21.15.28:0/3575888541 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540a5780 con 0x7f575c06b1e0 2023-12-16T03:26:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f575a7fc640 1 -- 172.21.15.28:0/3575888541 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57540a58e0 con 0x7f575c06b1e0 2023-12-16T03:26:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f575a7fc640 1 -- 172.21.15.28:0/3575888541 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540a5c70 con 0x7f575c06b1e0 2023-12-16T03:26:52.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f5762155640 1 -- 172.21.15.28:0/3575888541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f575c06b1e0 msgr2=0x7f575c0c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:52.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f5762155640 1 --2- 172.21.15.28:0/3575888541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f575c06b1e0 0x7f575c0c27a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5754009d90 tx=0x7f575401c8c0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f5762155640 1 -- 172.21.15.28:0/3575888541 shutdown_connections 2023-12-16T03:26:52.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f5762155640 1 --2- 172.21.15.28:0/3575888541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f575c06b1e0 0x7f575c0c27a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f5762155640 1 --2- 172.21.15.28:0/3575888541 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f575c06dfe0 0x7f575c06a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f5762155640 1 -- 172.21.15.28:0/3575888541 >> 172.21.15.28:0/3575888541 conn(0x7f575c0c6ef0 msgr2=0x7f575c0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:52.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f5762155640 1 -- 172.21.15.28:0/3575888541 shutdown_connections 2023-12-16T03:26:52.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.956+0000 7f5762155640 1 -- 172.21.15.28:0/3575888541 wait complete. 2023-12-16T03:26:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5762155640 1 Processor -- start 2023-12-16T03:26:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5762155640 1 -- start start 2023-12-16T03:26:52.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5762155640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f575c06a5b0 0x7f575c144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5762155640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f575c06b1e0 0x7f575c1451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5762155640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c06dfe0 0x7f575c145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5762155640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c142ed0 con 0x7f575c06a5b0 2023-12-16T03:26:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5762155640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0c69a0 con 0x7f575c06dfe0 2023-12-16T03:26:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5762155640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c151ee0 con 0x7f575c06b1e0 2023-12-16T03:26:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f575b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f575c06a5b0 0x7f575c144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f575b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f575c06a5b0 0x7f575c144900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44196/0 (socket says 172.21.15.28:44196) 2023-12-16T03:26:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f575b7fe640 1 -- 172.21.15.28:0/1384314432 learned_addr learned my addr 172.21.15.28:0/1384314432 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f575bfff640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c06dfe0 0x7f575c145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f575affd640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f575c06b1e0 0x7f575c1451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f575b7fe640 1 -- 172.21.15.28:0/1384314432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f575c06b1e0 msgr2=0x7f575c1451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f575b7fe640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f575c06b1e0 0x7f575c1451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f575b7fe640 1 -- 172.21.15.28:0/1384314432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c06dfe0 msgr2=0x7f575c145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f575b7fe640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c06dfe0 0x7f575c145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f575b7fe640 1 -- 172.21.15.28:0/1384314432 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5754009a70 con 0x7f575c06a5b0 2023-12-16T03:26:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f575b7fe640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f575c06a5b0 0x7f575c144900 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f574c00c420 tx=0x7f574c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5743fff640 1 -- 172.21.15.28:0/1384314432 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c005cf0 con 0x7f575c06a5b0 2023-12-16T03:26:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5743fff640 1 -- 172.21.15.28:0/1384314432 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c005e50 con 0x7f575c06a5b0 2023-12-16T03:26:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5743fff640 1 -- 172.21.15.28:0/1384314432 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c0072d0 con 0x7f575c06a5b0 2023-12-16T03:26:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5762155640 1 -- 172.21.15.28:0/1384314432 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575c0c6070 con 0x7f575c06a5b0 2023-12-16T03:26:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5762155640 1 -- 172.21.15.28:0/1384314432 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c0c6630 con 0x7f575c06a5b0 2023-12-16T03:26:52.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.960+0000 7f5762155640 1 -- 172.21.15.28:0/1384314432 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575c0c6c80 con 0x7f575c06a5b0 2023-12-16T03:26:52.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.964+0000 7f5743fff640 1 -- 172.21.15.28:0/1384314432 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f574c007430 con 0x7f575c06a5b0 2023-12-16T03:26:52.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.964+0000 7f5743fff640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5748066470 0x7f5748068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:52.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.964+0000 7f5743fff640 1 -- 172.21.15.28:0/1384314432 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f574c083200 con 0x7f575c06a5b0 2023-12-16T03:26:52.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.964+0000 7f575affd640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5748066470 0x7f5748068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:52.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.964+0000 7f575affd640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5748066470 0x7f5748068930 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f575c0c5ad0 tx=0x7f5750008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:52.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:52.968+0000 7f5743fff640 1 -- 172.21.15.28:0/1384314432 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f574c050930 con 0x7f575c06a5b0 2023-12-16T03:26:53.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.124+0000 7f5762155640 1 -- 172.21.15.28:0/1384314432 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f575c068400 con 0x7f575c06a5b0 2023-12-16T03:26:53.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.124+0000 7f5743fff640 1 -- 172.21.15.28:0/1384314432 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f574c053f50 con 0x7f575c06a5b0 2023-12-16T03:26:53.128 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:26:53.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 -- 172.21.15.28:0/1384314432 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5748066470 msgr2=0x7f5748068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:53.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5748066470 0x7f5748068930 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f575c0c5ad0 tx=0x7f5750008040 comp rx=0 tx=0).stop 2023-12-16T03:26:53.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 -- 172.21.15.28:0/1384314432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f575c06a5b0 msgr2=0x7f575c144900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:53.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f575c06a5b0 0x7f575c144900 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f574c00c420 tx=0x7f574c00c8e0 comp rx=0 tx=0).stop 2023-12-16T03:26:53.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 -- 172.21.15.28:0/1384314432 shutdown_connections 2023-12-16T03:26:53.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c06dfe0 0x7f575c145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:53.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f575c06b1e0 0x7f575c1451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:53.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5748066470 0x7f5748068930 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:53.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 --2- 172.21.15.28:0/1384314432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f575c06a5b0 0x7f575c144900 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:53.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 -- 172.21.15.28:0/1384314432 >> 172.21.15.28:0/1384314432 conn(0x7f575c0c6ef0 msgr2=0x7f575c06e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:53.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 -- 172.21.15.28:0/1384314432 shutdown_connections 2023-12-16T03:26:53.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.128+0000 7f5762155640 1 -- 172.21.15.28:0/1384314432 wait complete. 2023-12-16T03:26:53.149 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-16T03:26:53.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.288+0000 7fbaec6ea640 1 Processor -- start 2023-12-16T03:26:53.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.288+0000 7fbaec6ea640 1 -- start start 2023-12-16T03:26:53.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.292+0000 7fbaec6ea640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbae40c5260 0x7fbae406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:53.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.292+0000 7fbaec6ea640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae40c2580 con 0x7fbae4155de0 2023-12-16T03:26:53.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.292+0000 7fbaec6ea640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae4156940 con 0x7fbae40c5640 2023-12-16T03:26:53.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.292+0000 7fbaec6ea640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae4153510 con 0x7fbae40c5260 2023-12-16T03:26:53.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.292+0000 7fbaea486640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbae40c5260 0x7fbae406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:53.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.292+0000 7fbaea486640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbae40c5260 0x7fbae406d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44204/0 (socket says 172.21.15.28:44204) 2023-12-16T03:26:53.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.292+0000 7fbaea486640 1 -- 172.21.15.28:0/1913235049 learned_addr learned my addr 172.21.15.28:0/1913235049 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:53.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.292+0000 7fbaea486640 1 -- 172.21.15.28:0/1913235049 >> v1:172.21.15.134:6789/0 conn(0x7fbae40c5640 legacy=0x7fbae40c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:53.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.292+0000 7fbaea486640 1 -- 172.21.15.28:0/1913235049 >> v1:172.21.15.28:6789/0 conn(0x7fbae4155de0 legacy=0x7fbae4156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:53.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.292+0000 7fbaea486640 1 -- 172.21.15.28:0/1913235049 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae40c1a00 con 0x7fbae40c5260 2023-12-16T03:26:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.292+0000 7fbaea486640 1 --2- 172.21.15.28:0/1913235049 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbae40c5260 0x7fbae406d5b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009870 tx=0x7fbae001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3874d16b18ef0723 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:53.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbae9484640 1 -- 172.21.15.28:0/1913235049 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae00ac600 con 0x7fbae40c5260 2023-12-16T03:26:53.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbae9484640 1 -- 172.21.15.28:0/1913235049 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae00a8050 con 0x7fbae40c5260 2023-12-16T03:26:53.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbae9484640 1 -- 172.21.15.28:0/1913235049 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae00ac980 con 0x7fbae40c5260 2023-12-16T03:26:53.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 -- 172.21.15.28:0/1913235049 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbae40c5260 msgr2=0x7fbae406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:53.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 --2- 172.21.15.28:0/1913235049 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbae40c5260 0x7fbae406d5b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009870 tx=0x7fbae001c4b0 comp rx=0 tx=0).stop 2023-12-16T03:26:53.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 -- 172.21.15.28:0/1913235049 shutdown_connections 2023-12-16T03:26:53.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 --2- 172.21.15.28:0/1913235049 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbae40c5260 0x7fbae406d5b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:53.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 -- 172.21.15.28:0/1913235049 >> 172.21.15.28:0/1913235049 conn(0x7fbae406a5b0 msgr2=0x7fbae406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:53.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 -- 172.21.15.28:0/1913235049 shutdown_connections 2023-12-16T03:26:53.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 -- 172.21.15.28:0/1913235049 wait complete. 2023-12-16T03:26:53.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 Processor -- start 2023-12-16T03:26:53.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 -- start start 2023-12-16T03:26:53.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae40c5260 0x7fbae4150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:53.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbae40c5640 0x7fbae415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:53.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae4155de0 0x7fbae41eea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:53.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae4071200 con 0x7fbae40c5640 2023-12-16T03:26:53.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae4071be0 con 0x7fbae40c5260 2023-12-16T03:26:53.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbaec6ea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41f1230 con 0x7fbae4155de0 2023-12-16T03:26:53.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbae9c85640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbae40c5640 0x7fbae415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbae9c85640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbae40c5640 0x7fbae415d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44210/0 (socket says 172.21.15.28:44210) 2023-12-16T03:26:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.296+0000 7fbae9c85640 1 -- 172.21.15.28:0/216559234 learned_addr learned my addr 172.21.15.28:0/216559234 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbaea486640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae40c5260 0x7fbae4150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbaeac87640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae4155de0 0x7fbae41eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbae9c85640 1 -- 172.21.15.28:0/216559234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae4155de0 msgr2=0x7fbae41eea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbae9c85640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae4155de0 0x7fbae41eea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbae9c85640 1 -- 172.21.15.28:0/216559234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae40c5260 msgr2=0x7fbae4150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbae9c85640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae40c5260 0x7fbae4150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbae9c85640 1 -- 172.21.15.28:0/216559234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae00094d0 con 0x7fbae40c5640 2023-12-16T03:26:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbaea486640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae40c5260 0x7fbae4150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbae9c85640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbae40c5640 0x7fbae415d4d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbad400c390 tx=0x7fbad400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbadaffd640 1 -- 172.21.15.28:0/216559234 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad40052d0 con 0x7fbae40c5640 2023-12-16T03:26:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbadaffd640 1 -- 172.21.15.28:0/216559234 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad4005430 con 0x7fbae40c5640 2023-12-16T03:26:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbadaffd640 1 -- 172.21.15.28:0/216559234 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4003820 con 0x7fbae40c5640 2023-12-16T03:26:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbaec6ea640 1 -- 172.21.15.28:0/216559234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae41f1510 con 0x7fbae40c5640 2023-12-16T03:26:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbaec6ea640 1 -- 172.21.15.28:0/216559234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae4071ec0 con 0x7fbae40c5640 2023-12-16T03:26:53.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbaec6ea640 1 -- 172.21.15.28:0/216559234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae41561f0 con 0x7fbae40c5640 2023-12-16T03:26:53.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.300+0000 7fbadaffd640 1 -- 172.21.15.28:0/216559234 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbad4003980 con 0x7fbae40c5640 2023-12-16T03:26:53.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.304+0000 7fbadaffd640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbac80664c0 0x7fbac8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:53.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.304+0000 7fbadaffd640 1 -- 172.21.15.28:0/216559234 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbad4083020 con 0x7fbae40c5640 2023-12-16T03:26:53.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.304+0000 7fbaea486640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbac80664c0 0x7fbac8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.304+0000 7fbaea486640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbac80664c0 0x7fbac8068980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbae00ae000 tx=0x7fbae00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:53.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.308+0000 7fbadaffd640 1 -- 172.21.15.28:0/216559234 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fbad40508b0 con 0x7fbae40c5640 2023-12-16T03:26:53.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:53.520+0000 7fbaec6ea640 1 -- 172.21.15.28:0/216559234 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fbae4068400 con 0x7fbae40c5640 2023-12-16T03:26:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.448+0000 7fbadaffd640 1 -- 172.21.15.28:0/216559234 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v118) v1 ==== 187+0+0 (secure 0 0 0) 0x7fbad4053ed0 con 0x7fbae40c5640 2023-12-16T03:26:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 -- 172.21.15.28:0/216559234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbac80664c0 msgr2=0x7fbac8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbac80664c0 0x7fbac8068980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbae00ae000 tx=0x7fbae00a7000 comp rx=0 tx=0).stop 2023-12-16T03:26:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 -- 172.21.15.28:0/216559234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbae40c5640 msgr2=0x7fbae415d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbae40c5640 0x7fbae415d4d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbad400c390 tx=0x7fbad400c850 comp rx=0 tx=0).stop 2023-12-16T03:26:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 -- 172.21.15.28:0/216559234 shutdown_connections 2023-12-16T03:26:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbae4155de0 0x7fbae41eea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbac80664c0 0x7fbac8068980 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbae40c5640 0x7fbae415d4d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 --2- 172.21.15.28:0/216559234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbae40c5260 0x7fbae4150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 -- 172.21.15.28:0/216559234 >> 172.21.15.28:0/216559234 conn(0x7fbae406a5b0 msgr2=0x7fbae40bfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 -- 172.21.15.28:0/216559234 shutdown_connections 2023-12-16T03:26:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.452+0000 7fbaec6ea640 1 -- 172.21.15.28:0/216559234 wait complete. 2023-12-16T03:26:54.475 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-16T03:26:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa25529a640 1 Processor -- start 2023-12-16T03:26:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa25529a640 1 -- start start 2023-12-16T03:26:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa25529a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2500c31c0 0x7fa2500c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa25529a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa250155730 0x7fa2500c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa25529a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2500c6bc0 con 0x7fa2500c6050 2023-12-16T03:26:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa25529a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2500c8d90 con 0x7fa2500c31c0 2023-12-16T03:26:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa25529a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500c3c80 con 0x7fa250155730 2023-12-16T03:26:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24effd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa2500c6050 0x7fa250155020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40892/0 (socket says 172.21.15.28:40892) 2023-12-16T03:26:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24effd640 1 -- 172.21.15.28:0/1449994798 learned_addr learned my addr 172.21.15.28:0/1449994798 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24f7fe640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa250155730 0x7fa2500c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa247fff640 1 --2- 172.21.15.28:0/1449994798 >> v2:172.21.15.134:3300/0 conn(0x7fa2500c31c0 0x7fa2500c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369684542 0 0) 0x7fa2500c6bc0 con 0x7fa2500c6050 2023-12-16T03:26:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa23c003530 con 0x7fa2500c6050 2023-12-16T03:26:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1327897303 0 0) 0x7fa23c003530 con 0x7fa2500c6050 2023-12-16T03:26:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa250155730 msgr2=0x7fa2500c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa250155730 0x7fa2500c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 >> v2:172.21.15.134:3300/0 conn(0x7fa2500c31c0 msgr2=0x7fa2500c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 --2- 172.21.15.28:0/1449994798 >> v2:172.21.15.134:3300/0 conn(0x7fa2500c31c0 0x7fa2500c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500c6970 con 0x7fa2500c6050 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fa240001680 con 0x7fa2500c6050 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 >> v1:172.21.15.28:6789/0 conn(0x7fa2500c6050 legacy=0x7fa250155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa250155730 0x7fa23c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa23c003f50 0x7fa23c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 0x7fa23c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500c8d90 con 0x7fa23c004d10 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500c3c80 con 0x7fa23c003f50 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.624+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c00bac0 con 0x7fa250155730 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa24f7fe640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 0x7fa23c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa24effd640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa250155730 0x7fa23c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa247fff640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa23c003f50 0x7fa23c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa24f7fe640 1 -- 172.21.15.28:0/1449994798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa250155730 msgr2=0x7fa23c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa24f7fe640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa250155730 0x7fa23c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa24f7fe640 1 -- 172.21.15.28:0/1449994798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa23c003f50 msgr2=0x7fa23c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa24f7fe640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa23c003f50 0x7fa23c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa24f7fe640 1 -- 172.21.15.28:0/1449994798 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c003530 con 0x7fa23c004d10 2023-12-16T03:26:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa24f7fe640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 0x7fa23c005190 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa248009fc0 tx=0x7fa24801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fb7a13982caafd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480a5c20 con 0x7fa23c004d10 2023-12-16T03:26:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24800f040 con 0x7fa23c004d10 2023-12-16T03:26:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.628+0000 7fa24e7fc640 1 -- 172.21.15.28:0/1449994798 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480ad440 con 0x7fa23c004d10 2023-12-16T03:26:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 -- 172.21.15.28:0/1449994798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 msgr2=0x7fa23c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 --2- 172.21.15.28:0/1449994798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 0x7fa23c005190 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa248009fc0 tx=0x7fa24801cc30 comp rx=0 tx=0).stop 2023-12-16T03:26:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa24f7fe640 1 -- 172.21.15.28:0/1449994798 reap_dead start 2023-12-16T03:26:54.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 -- 172.21.15.28:0/1449994798 shutdown_connections 2023-12-16T03:26:54.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 -- 172.21.15.28:0/1449994798 >> 172.21.15.28:0/1449994798 conn(0x7fa2500a9b80 msgr2=0x7fa2500a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:54.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 -- 172.21.15.28:0/1449994798 shutdown_connections 2023-12-16T03:26:54.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 -- 172.21.15.28:0/1449994798 wait complete. 2023-12-16T03:26:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 Processor -- start 2023-12-16T03:26:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 -- start start 2023-12-16T03:26:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 0x7fa2501543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa250158ad0 0x7fa25015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa25015b840 0x7fa2501510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa250158640 con 0x7fa23c004d10 2023-12-16T03:26:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa250159a60 con 0x7fa250158ad0 2023-12-16T03:26:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa25529a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa250159d00 con 0x7fa25015b840 2023-12-16T03:26:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa24effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 0x7fa2501543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa24effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 0x7fa2501543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44218/0 (socket says 172.21.15.28:44218) 2023-12-16T03:26:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa24effd640 1 -- 172.21.15.28:0/2030311821 learned_addr learned my addr 172.21.15.28:0/2030311821 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa24f7fe640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa25015b840 0x7fa2501510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa247fff640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa250158ad0 0x7fa25015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa24effd640 1 -- 172.21.15.28:0/2030311821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa25015b840 msgr2=0x7fa2501510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa24effd640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa25015b840 0x7fa2501510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa24effd640 1 -- 172.21.15.28:0/2030311821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa250158ad0 msgr2=0x7fa25015b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa24effd640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa250158ad0 0x7fa25015b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa24effd640 1 -- 172.21.15.28:0/2030311821 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2501ed080 con 0x7fa23c004d10 2023-12-16T03:26:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.632+0000 7fa24effd640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 0x7fa2501543c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa240007340 tx=0x7fa240007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:54.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.636+0000 7fa2477fe640 1 -- 172.21.15.28:0/2030311821 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24000f9c0 con 0x7fa23c004d10 2023-12-16T03:26:54.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.636+0000 7fa2477fe640 1 -- 172.21.15.28:0/2030311821 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24000fb20 con 0x7fa23c004d10 2023-12-16T03:26:54.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.636+0000 7fa2477fe640 1 -- 172.21.15.28:0/2030311821 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24000feb0 con 0x7fa23c004d10 2023-12-16T03:26:54.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.636+0000 7fa25529a640 1 -- 172.21.15.28:0/2030311821 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2501ed360 con 0x7fa23c004d10 2023-12-16T03:26:54.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.636+0000 7fa25529a640 1 -- 172.21.15.28:0/2030311821 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25015ccc0 con 0x7fa23c004d10 2023-12-16T03:26:54.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.636+0000 7fa25529a640 1 -- 172.21.15.28:0/2030311821 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa250068400 con 0x7fa23c004d10 2023-12-16T03:26:54.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.636+0000 7fa2477fe640 1 -- 172.21.15.28:0/2030311821 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa24001d460 con 0x7fa23c004d10 2023-12-16T03:26:54.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.636+0000 7fa2477fe640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa230066470 0x7fa230068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:54.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.636+0000 7fa2477fe640 1 -- 172.21.15.28:0/2030311821 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa240083d60 con 0x7fa23c004d10 2023-12-16T03:26:54.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.636+0000 7fa247fff640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa230066470 0x7fa230068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:54.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.636+0000 7fa247fff640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa230066470 0x7fa230068930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa2500a7010 tx=0x7fa238008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:54.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.640+0000 7fa2477fe640 1 -- 172.21.15.28:0/2030311821 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa240051470 con 0x7fa23c004d10 2023-12-16T03:26:54.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.800+0000 7fa25529a640 1 -- 172.21.15.28:0/2030311821 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa25015d060 con 0x7fa23c004d10 2023-12-16T03:26:54.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa2477fe640 1 -- 172.21.15.28:0/2030311821 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa240054a90 con 0x7fa23c004d10 2023-12-16T03:26:54.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 -- 172.21.15.28:0/2030311821 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa230066470 msgr2=0x7fa230068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:54.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa230066470 0x7fa230068930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa2500a7010 tx=0x7fa238008040 comp rx=0 tx=0).stop 2023-12-16T03:26:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 -- 172.21.15.28:0/2030311821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 msgr2=0x7fa2501543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 0x7fa2501543c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa240007340 tx=0x7fa240007800 comp rx=0 tx=0).stop 2023-12-16T03:26:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 -- 172.21.15.28:0/2030311821 shutdown_connections 2023-12-16T03:26:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa25015b840 0x7fa2501510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa250158ad0 0x7fa25015b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa230066470 0x7fa230068930 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 --2- 172.21.15.28:0/2030311821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa23c004d10 0x7fa2501543c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 -- 172.21.15.28:0/2030311821 >> 172.21.15.28:0/2030311821 conn(0x7fa2500a9b80 msgr2=0x7fa25006c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 -- 172.21.15.28:0/2030311821 shutdown_connections 2023-12-16T03:26:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:54.804+0000 7fa25529a640 1 -- 172.21.15.28:0/2030311821 wait complete. 2023-12-16T03:26:54.828 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-16T03:26:54.828 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:26:54.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:26:55.003 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-16T03:26:55.004 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:26:55.004 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:55.013 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7208 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-16T03:26:55.013 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:26:55.013 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:26:55.023 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-16T03:26:55.023 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-16T03:26:55.023 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:26:55.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f67131f5640 1 Processor -- start 2023-12-16T03:26:55.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f67131f5640 1 -- start start 2023-12-16T03:26:55.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f67131f5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f670c06bbb0 0x7f670c1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f67131f5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c06c860 con 0x7f670c0c7ea0 2023-12-16T03:26:55.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f67131f5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c06c000 con 0x7f670c151e90 2023-12-16T03:26:55.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f67131f5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670c0c8750 con 0x7f670c06bbb0 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f670c0c7ea0 0x7f670c06b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40902/0 (socket says 172.21.15.28:40902) 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670bfff640 1 -- 172.21.15.28:0/2778470844 learned_addr learned my addr 172.21.15.28:0/2778470844 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f6711792640 1 --2- 172.21.15.28:0/2778470844 >> v2:172.21.15.134:3300/0 conn(0x7f670c06bbb0 0x7f670c1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839579916 0 0) 0x7f670c06c860 con 0x7f670c0c7ea0 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66fc003530 con 0x7f670c0c7ea0 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3002856065 0 0) 0x7f66fc003530 con 0x7f670c0c7ea0 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 >> v2:172.21.15.134:3300/0 conn(0x7f670c06bbb0 msgr2=0x7f670c1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670b7fe640 1 --2- 172.21.15.28:0/2778470844 >> v2:172.21.15.134:3300/0 conn(0x7f670c06bbb0 0x7f670c1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 >> v1:172.21.15.134:6789/0 conn(0x7f670c151e90 legacy=0x7f670c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c154930 con 0x7f670c0c7ea0 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f66f8001680 con 0x7f670c0c7ea0 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 >> v1:172.21.15.28:6789/0 conn(0x7f670c0c7ea0 legacy=0x7f670c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.196+0000 7f670b7fe640 1 --2- 172.21.15.28:0/2778470844 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 0x7f66fc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f670b7fe640 1 --2- 172.21.15.28:0/2778470844 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f66fc0047d0 0x7f66fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f670b7fe640 1 --2- 172.21.15.28:0/2778470844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66fc005190 0x7f66fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c0c8750 con 0x7f66fc003980 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc00c0e0 con 0x7f66fc005190 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc00c2a0 con 0x7f66fc0047d0 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f6710f91640 1 --2- 172.21.15.28:0/2778470844 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 0x7f66fc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f6711792640 1 --2- 172.21.15.28:0/2778470844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66fc005190 0x7f66fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f670bfff640 1 --2- 172.21.15.28:0/2778470844 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f66fc0047d0 0x7f66fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f6710f91640 1 -- 172.21.15.28:0/2778470844 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f66fc0047d0 msgr2=0x7f66fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f6710f91640 1 --2- 172.21.15.28:0/2778470844 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f66fc0047d0 0x7f66fc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f6710f91640 1 -- 172.21.15.28:0/2778470844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66fc005190 msgr2=0x7f66fc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f6710f91640 1 --2- 172.21.15.28:0/2778470844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66fc005190 0x7f66fc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f6710f91640 1 -- 172.21.15.28:0/2778470844 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc003530 con 0x7f66fc003980 2023-12-16T03:26:55.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f6711792640 1 -- 172.21.15.28:0/2778470844 reap_dead start 2023-12-16T03:26:55.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f6710f91640 1 --2- 172.21.15.28:0/2778470844 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 0x7f66fc003d60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6700001860 tx=0x7f670001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1881c8977f29dd15 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:55.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000ab400 con 0x7f66fc003980 2023-12-16T03:26:55.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67000a7050 con 0x7f66fc003980 2023-12-16T03:26:55.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.200+0000 7f670b7fe640 1 -- 172.21.15.28:0/2778470844 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000ab7e0 con 0x7f66fc003980 2023-12-16T03:26:55.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 -- 172.21.15.28:0/2778470844 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 msgr2=0x7f66fc003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 --2- 172.21.15.28:0/2778470844 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 0x7f66fc003d60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6700001860 tx=0x7f670001c4e0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 -- 172.21.15.28:0/2778470844 shutdown_connections 2023-12-16T03:26:55.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 --2- 172.21.15.28:0/2778470844 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 0x7f66fc003d60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 -- 172.21.15.28:0/2778470844 >> 172.21.15.28:0/2778470844 conn(0x7f670c0ca170 msgr2=0x7f670c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:55.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 -- 172.21.15.28:0/2778470844 shutdown_connections 2023-12-16T03:26:55.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 -- 172.21.15.28:0/2778470844 wait complete. 2023-12-16T03:26:55.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 Processor -- start 2023-12-16T03:26:55.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 -- start start 2023-12-16T03:26:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 0x7f670c14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f670c0aec10 0x7f670c152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f670c14c500 0x7f670c14c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c1552d0 con 0x7f66fc003980 2023-12-16T03:26:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c14eca0 con 0x7f670c14c500 2023-12-16T03:26:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f67131f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670c14db60 con 0x7f670c0aec10 2023-12-16T03:26:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f6710f91640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 0x7f670c14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f6710f91640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 0x7f670c14e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44234/0 (socket says 172.21.15.28:44234) 2023-12-16T03:26:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f6710f91640 1 -- 172.21.15.28:0/2197541357 learned_addr learned my addr 172.21.15.28:0/2197541357 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f6711792640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f670c14c500 0x7f670c14c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f670bfff640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f670c0aec10 0x7f670c152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f6710f91640 1 -- 172.21.15.28:0/2197541357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f670c0aec10 msgr2=0x7f670c152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f6710f91640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f670c0aec10 0x7f670c152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f6710f91640 1 -- 172.21.15.28:0/2197541357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f670c14c500 msgr2=0x7f670c14c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.204+0000 7f6710f91640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f670c14c500 0x7f670c14c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f6710f91640 1 -- 172.21.15.28:0/2197541357 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c14de40 con 0x7f66fc003980 2023-12-16T03:26:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f6710f91640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 0x7f670c14e760 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f67000ae040 tx=0x7f66fc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:55.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f67097fa640 1 -- 172.21.15.28:0/2197541357 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700007240 con 0x7f66fc003980 2023-12-16T03:26:55.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f67097fa640 1 -- 172.21.15.28:0/2197541357 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67000a4e90 con 0x7f66fc003980 2023-12-16T03:26:55.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f67097fa640 1 -- 172.21.15.28:0/2197541357 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000075e0 con 0x7f66fc003980 2023-12-16T03:26:55.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f67131f5640 1 -- 172.21.15.28:0/2197541357 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670c14e120 con 0x7f66fc003980 2023-12-16T03:26:55.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f67131f5640 1 -- 172.21.15.28:0/2197541357 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670c0c3b70 con 0x7f66fc003980 2023-12-16T03:26:55.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f67131f5640 1 -- 172.21.15.28:0/2197541357 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670c14c140 con 0x7f66fc003980 2023-12-16T03:26:55.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f67097fa640 1 -- 172.21.15.28:0/2197541357 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f67000b2040 con 0x7f66fc003980 2023-12-16T03:26:55.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f67097fa640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f66f0066470 0x7f66f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f67097fa640 1 -- 172.21.15.28:0/2197541357 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f670011d3c0 con 0x7f66fc003980 2023-12-16T03:26:55.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.208+0000 7f670bfff640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f66f0066470 0x7f66f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.212+0000 7f670bfff640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f66f0066470 0x7f66f0068930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f670c0af010 tx=0x7f66f8007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:55.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.212+0000 7f67097fa640 1 -- 172.21.15.28:0/2197541357 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f67000eab80 con 0x7f66fc003980 2023-12-16T03:26:55.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.404+0000 7f67131f5640 1 -- 172.21.15.28:0/2197541357 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f670c14e310 con 0x7f66fc003980 2023-12-16T03:26:55.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67097fa640 1 -- 172.21.15.28:0/2197541357 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f67000ee1a0 con 0x7f66fc003980 2023-12-16T03:26:55.410 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:55.410 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4754,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/3378969769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":3378969769},{"type":"v1","addr":"172.21.15.134:6835","nonce":3378969769}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2794220220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2794220220},{"type":"v1","addr":"172.21.15.134:6834","nonce":2794220220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/2011650959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":2011650959},{"type":"v1","addr":"172.21.15.28:6837","nonce":2011650959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/1832475902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":1832475902},{"type":"v1","addr":"172.21.15.28:6836","nonce":1832475902}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[]} 2023-12-16T03:26:55.410 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 25 2023-12-16T03:26:55.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 -- 172.21.15.28:0/2197541357 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f66f0066470 msgr2=0x7f66f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f66f0066470 0x7f66f0068930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f670c0af010 tx=0x7f66f8007040 comp rx=0 tx=0).stop 2023-12-16T03:26:55.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 -- 172.21.15.28:0/2197541357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 msgr2=0x7f670c14e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 0x7f670c14e760 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f67000ae040 tx=0x7f66fc005800 comp rx=0 tx=0).stop 2023-12-16T03:26:55.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 -- 172.21.15.28:0/2197541357 shutdown_connections 2023-12-16T03:26:55.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f670c14c500 0x7f670c14c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f670c0aec10 0x7f670c152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f66f0066470 0x7f66f0068930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 --2- 172.21.15.28:0/2197541357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66fc003980 0x7f670c14e760 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 -- 172.21.15.28:0/2197541357 >> 172.21.15.28:0/2197541357 conn(0x7f670c0ca170 msgr2=0x7f670c0c1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:55.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 -- 172.21.15.28:0/2197541357 shutdown_connections 2023-12-16T03:26:55.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.408+0000 7f67131f5640 1 -- 172.21.15.28:0/2197541357 wait complete. 2023-12-16T03:26:55.431 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-16T03:26:55.432 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-16T03:26:55.432 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-16T03:26:55.432 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:26:55.432 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-16T03:26:55.432 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-16T03:26:55.432 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-16T03:26:55.432 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:26:55.433 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-16T03:26:55.433 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-16T03:26:55.433 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-16T03:26:55.433 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:26:55.433 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-16T03:26:55.433 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-16T03:26:55.433 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-16T03:26:55.434 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:26:55.444 INFO:tasks.ceph.mds.a:Stopped 2023-12-16T03:26:55.444 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-16T03:26:55.446 INFO:tasks.ceph.mds.c:Stopped 2023-12-16T03:26:55.446 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-16T03:26:55.449 INFO:tasks.ceph.mds.b:Stopped 2023-12-16T03:26:55.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-16T03:26:55.451 INFO:tasks.ceph.mds.d:Stopped 2023-12-16T03:26:55.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-16T03:26:55.491 INFO:tasks.ceph.mds.a:Started 2023-12-16T03:26:55.492 DEBUG:teuthology.parallel:result is None 2023-12-16T03:26:55.494 INFO:tasks.ceph.mds.c:Started 2023-12-16T03:26:55.494 DEBUG:teuthology.parallel:result is None 2023-12-16T03:26:55.495 INFO:tasks.ceph.mds.b:Started 2023-12-16T03:26:55.495 DEBUG:teuthology.parallel:result is None 2023-12-16T03:26:55.497 INFO:tasks.ceph.mds.d:Started 2023-12-16T03:26:55.498 DEBUG:teuthology.parallel:result is None 2023-12-16T03:26:55.498 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-16T03:26:55.581 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2023-12-16T03:26:55.581 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-12-16T03:26:55.584 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-12-16T03:26:55.586 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2023-12-16T03:26:55.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb17e901640 1 Processor -- start 2023-12-16T03:26:55.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb17e901640 1 -- start start 2023-12-16T03:26:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb17e901640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb1780c5640 0x7fb1780c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb17e901640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780c2580 con 0x7fb1780c60f0 2023-12-16T03:26:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb17e901640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780c1a00 con 0x7fb1780c5260 2023-12-16T03:26:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb17e901640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb178153510 con 0x7fb1780c5640 2023-12-16T03:26:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb17ce9e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb1780c60f0 0x7fb178155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40912/0 (socket says 172.21.15.28:40912) 2023-12-16T03:26:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb17ce9e640 1 -- 172.21.15.28:0/1626823973 learned_addr learned my addr 172.21.15.28:0/1626823973 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb1777fe640 1 --2- 172.21.15.28:0/1626823973 >> v2:172.21.15.134:3300/0 conn(0x7fb1780c5640 0x7fb1780c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb176ffd640 1 -- 172.21.15.28:0/1626823973 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497330861 0 0) 0x7fb1780c2580 con 0x7fb1780c60f0 2023-12-16T03:26:55.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb176ffd640 1 -- 172.21.15.28:0/1626823973 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb160003530 con 0x7fb1780c60f0 2023-12-16T03:26:55.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb176ffd640 1 -- 172.21.15.28:0/1626823973 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471917311 0 0) 0x7fb1780c1a00 con 0x7fb1780c5260 2023-12-16T03:26:55.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb176ffd640 1 -- 172.21.15.28:0/1626823973 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1780c2580 con 0x7fb1780c5260 2023-12-16T03:26:55.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb1777fe640 1 -- 172.21.15.28:0/1626823973 >> v1:172.21.15.134:6789/0 conn(0x7fb1780c5260 legacy=0x7fb17806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb1777fe640 1 -- 172.21.15.28:0/1626823973 >> v1:172.21.15.28:6789/0 conn(0x7fb1780c60f0 legacy=0x7fb178155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.644+0000 7fb1777fe640 1 -- 172.21.15.28:0/1626823973 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780c1ce0 con 0x7fb1780c5640 2023-12-16T03:26:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb1777fe640 1 --2- 172.21.15.28:0/1626823973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1780c5640 0x7fb1780c5bb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0097c0 tx=0x7fb16c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8674ac0f11c7becc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb176ffd640 1 -- 172.21.15.28:0/1626823973 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c0ab600 con 0x7fb1780c5640 2023-12-16T03:26:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb176ffd640 1 -- 172.21.15.28:0/1626823973 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c0a7050 con 0x7fb1780c5640 2023-12-16T03:26:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb176ffd640 1 -- 172.21.15.28:0/1626823973 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c0ab980 con 0x7fb1780c5640 2023-12-16T03:26:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb17e901640 1 -- 172.21.15.28:0/1626823973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1780c5640 msgr2=0x7fb1780c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb17e901640 1 --2- 172.21.15.28:0/1626823973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1780c5640 0x7fb1780c5bb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0097c0 tx=0x7fb16c01c3f0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb17e901640 1 -- 172.21.15.28:0/1626823973 shutdown_connections 2023-12-16T03:26:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb17e901640 1 --2- 172.21.15.28:0/1626823973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1780c5640 0x7fb1780c5bb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb17e901640 1 -- 172.21.15.28:0/1626823973 >> 172.21.15.28:0/1626823973 conn(0x7fb17806a5b0 msgr2=0x7fb17806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb17e901640 1 -- 172.21.15.28:0/1626823973 shutdown_connections 2023-12-16T03:26:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb17e901640 1 -- 172.21.15.28:0/1626823973 wait complete. 2023-12-16T03:26:55.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.648+0000 7fb17e901640 1 Processor -- start 2023-12-16T03:26:55.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17e901640 1 -- start start 2023-12-16T03:26:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17e901640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1780c5260 0x7fb1780a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17e901640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1780c5640 0x7fb1780aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17e901640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1780c60f0 0x7fb1781512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17e901640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780a9d60 con 0x7fb1780c5260 2023-12-16T03:26:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17e901640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb178150e60 con 0x7fb1780c60f0 2023-12-16T03:26:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17e901640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780a87c0 con 0x7fb1780c5640 2023-12-16T03:26:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb177fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1780c5260 0x7fb1780a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb177fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1780c5260 0x7fb1780a8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44282/0 (socket says 172.21.15.28:44282) 2023-12-16T03:26:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb177fff640 1 -- 172.21.15.28:0/1636507935 learned_addr learned my addr 172.21.15.28:0/1636507935 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17ce9e640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1780c60f0 0x7fb1781512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb1777fe640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1780c5640 0x7fb1780aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb177fff640 1 -- 172.21.15.28:0/1636507935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1780c5640 msgr2=0x7fb1780aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb177fff640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1780c5640 0x7fb1780aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb177fff640 1 -- 172.21.15.28:0/1636507935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1780c60f0 msgr2=0x7fb1781512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb177fff640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1780c60f0 0x7fb1781512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb177fff640 1 -- 172.21.15.28:0/1636507935 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c009420 con 0x7fb1780c5260 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17ce9e640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1780c60f0 0x7fb1781512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb177fff640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1780c5260 0x7fb1780a8b70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb16800c430 tx=0x7fb16800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb174ff9640 1 -- 172.21.15.28:0/1636507935 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1680052d0 con 0x7fb1780c5260 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb174ff9640 1 -- 172.21.15.28:0/1636507935 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb168005450 con 0x7fb1780c5260 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb174ff9640 1 -- 172.21.15.28:0/1636507935 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168003840 con 0x7fb1780c5260 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17e901640 1 -- 172.21.15.28:0/1636507935 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1780a91e0 con 0x7fb1780c5260 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17e901640 1 -- 172.21.15.28:0/1636507935 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1780a97a0 con 0x7fb1780c5260 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.652+0000 7fb17e901640 1 -- 172.21.15.28:0/1636507935 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb178150fd0 con 0x7fb1780c5260 2023-12-16T03:26:55.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.656+0000 7fb174ff9640 1 -- 172.21.15.28:0/1636507935 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb1680039a0 con 0x7fb1780c5260 2023-12-16T03:26:55.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.656+0000 7fb174ff9640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb164066470 0x7fb164068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:55.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.656+0000 7fb174ff9640 1 -- 172.21.15.28:0/1636507935 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb168083230 con 0x7fb1780c5260 2023-12-16T03:26:55.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.656+0000 7fb1777fe640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb164066470 0x7fb164068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:55.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.656+0000 7fb1777fe640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb164066470 0x7fb164068930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0ad000 tx=0x7fb16c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:55.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.660+0000 7fb174ff9640 1 -- 172.21.15.28:0/1636507935 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb168050940 con 0x7fb1780c5260 2023-12-16T03:26:55.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:55.828+0000 7fb17e901640 1 -- 172.21.15.28:0/1636507935 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb178068400 con 0x7fb1780c5260 2023-12-16T03:26:56.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb174ff9640 1 -- 172.21.15.28:0/1636507935 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb168053f60 con 0x7fb1780c5260 2023-12-16T03:26:56.474 INFO:teuthology.orchestra.run.smithi028.stderr: removed all blocklist entries 2023-12-16T03:26:56.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 -- 172.21.15.28:0/1636507935 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb164066470 msgr2=0x7fb164068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:56.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb164066470 0x7fb164068930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0ad000 tx=0x7fb16c008040 comp rx=0 tx=0).stop 2023-12-16T03:26:56.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 -- 172.21.15.28:0/1636507935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1780c5260 msgr2=0x7fb1780a8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:56.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1780c5260 0x7fb1780a8b70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb16800c430 tx=0x7fb16800c8f0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 -- 172.21.15.28:0/1636507935 shutdown_connections 2023-12-16T03:26:56.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1780c60f0 0x7fb1781512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1780c5640 0x7fb1780aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb164066470 0x7fb164068930 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 --2- 172.21.15.28:0/1636507935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1780c5260 0x7fb1780a8b70 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 -- 172.21.15.28:0/1636507935 >> 172.21.15.28:0/1636507935 conn(0x7fb17806a5b0 msgr2=0x7fb1780c47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:56.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 -- 172.21.15.28:0/1636507935 shutdown_connections 2023-12-16T03:26:56.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.472+0000 7fb17e901640 1 -- 172.21.15.28:0/1636507935 wait complete. 2023-12-16T03:26:56.500 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-16T03:26:56.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c49017640 1 Processor -- start 2023-12-16T03:26:56.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c49017640 1 -- start start 2023-12-16T03:26:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c49017640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c4406bbb0 0x7f6c441600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c49017640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4406c860 con 0x7f6c44151e90 2023-12-16T03:26:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c49017640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4406c040 con 0x7f6c440c7ea0 2023-12-16T03:26:56.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c49017640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c440c8750 con 0x7f6c4406bbb0 2023-12-16T03:26:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c42d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6c44151e90 0x7f6c440c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40916/0 (socket says 172.21.15.28:40916) 2023-12-16T03:26:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c42d9d640 1 -- 172.21.15.28:0/3340113275 learned_addr learned my addr 172.21.15.28:0/3340113275 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c4359e640 1 --2- 172.21.15.28:0/3340113275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c4406bbb0 0x7f6c441600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c4259c640 1 -- 172.21.15.28:0/3340113275 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229402026 0 0) 0x7f6c4406c860 con 0x7f6c44151e90 2023-12-16T03:26:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c4259c640 1 -- 172.21.15.28:0/3340113275 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c30003530 con 0x7f6c44151e90 2023-12-16T03:26:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c4259c640 1 -- 172.21.15.28:0/3340113275 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262049805 0 0) 0x7f6c4406c040 con 0x7f6c440c7ea0 2023-12-16T03:26:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c4259c640 1 -- 172.21.15.28:0/3340113275 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c4406c860 con 0x7f6c440c7ea0 2023-12-16T03:26:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c4359e640 1 -- 172.21.15.28:0/3340113275 >> v1:172.21.15.134:6789/0 conn(0x7f6c440c7ea0 legacy=0x7f6c4406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c4359e640 1 -- 172.21.15.28:0/3340113275 >> v1:172.21.15.28:6789/0 conn(0x7f6c44151e90 legacy=0x7f6c440c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:56.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.644+0000 7f6c4359e640 1 -- 172.21.15.28:0/3340113275 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c44154930 con 0x7f6c4406bbb0 2023-12-16T03:26:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.648+0000 7f6c4359e640 1 --2- 172.21.15.28:0/3340113275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c4406bbb0 0x7f6c441600b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0097f0 tx=0x7f6c3c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e2e934d4ed7fffc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.648+0000 7f6c4259c640 1 -- 172.21.15.28:0/3340113275 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0ab600 con 0x7f6c4406bbb0 2023-12-16T03:26:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.648+0000 7f6c4259c640 1 -- 172.21.15.28:0/3340113275 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0a7050 con 0x7f6c4406bbb0 2023-12-16T03:26:56.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.648+0000 7f6c4259c640 1 -- 172.21.15.28:0/3340113275 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0ab960 con 0x7f6c4406bbb0 2023-12-16T03:26:56.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.648+0000 7f6c49017640 1 -- 172.21.15.28:0/3340113275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c4406bbb0 msgr2=0x7f6c441600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:56.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.648+0000 7f6c49017640 1 --2- 172.21.15.28:0/3340113275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c4406bbb0 0x7f6c441600b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0097f0 tx=0x7f6c3c01c3a0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.648+0000 7f6c49017640 1 -- 172.21.15.28:0/3340113275 shutdown_connections 2023-12-16T03:26:56.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.648+0000 7f6c49017640 1 --2- 172.21.15.28:0/3340113275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c4406bbb0 0x7f6c441600b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.648+0000 7f6c49017640 1 -- 172.21.15.28:0/3340113275 >> 172.21.15.28:0/3340113275 conn(0x7f6c440ca170 msgr2=0x7f6c440ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:56.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.648+0000 7f6c49017640 1 -- 172.21.15.28:0/3340113275 shutdown_connections 2023-12-16T03:26:56.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.648+0000 7f6c49017640 1 -- 172.21.15.28:0/3340113275 wait complete. 2023-12-16T03:26:56.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c49017640 1 Processor -- start 2023-12-16T03:26:56.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c49017640 1 -- start start 2023-12-16T03:26:56.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c49017640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4406bbb0 0x7f6c44146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:56.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c49017640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c440c7ea0 0x7f6c4413f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:56.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c49017640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c44151e90 0x7f6c4413fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:56.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c49017640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441552d0 con 0x7f6c440c7ea0 2023-12-16T03:26:56.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c49017640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441443f0 con 0x7f6c4406bbb0 2023-12-16T03:26:56.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c49017640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44140d00 con 0x7f6c44151e90 2023-12-16T03:26:56.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c440c7ea0 0x7f6c4413f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:56.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c440c7ea0 0x7f6c4413f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44286/0 (socket says 172.21.15.28:44286) 2023-12-16T03:26:56.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3a59c640 1 -- 172.21.15.28:0/2270892354 learned_addr learned my addr 172.21.15.28:0/2270892354 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:56.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c42d9d640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4406bbb0 0x7f6c44146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:56.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c4359e640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c44151e90 0x7f6c4413fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:56.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3a59c640 1 -- 172.21.15.28:0/2270892354 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c44151e90 msgr2=0x7f6c4413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:56.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3a59c640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c44151e90 0x7f6c4413fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3a59c640 1 -- 172.21.15.28:0/2270892354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4406bbb0 msgr2=0x7f6c44146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:56.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3a59c640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4406bbb0 0x7f6c44146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3a59c640 1 -- 172.21.15.28:0/2270892354 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c009420 con 0x7f6c440c7ea0 2023-12-16T03:26:56.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3a59c640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c440c7ea0 0x7f6c4413f640 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00c770 tx=0x7f6c2c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:56.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3bfff640 1 -- 172.21.15.28:0/2270892354 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c003b80 con 0x7f6c440c7ea0 2023-12-16T03:26:56.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3bfff640 1 -- 172.21.15.28:0/2270892354 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c003ce0 con 0x7f6c440c7ea0 2023-12-16T03:26:56.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c3bfff640 1 -- 172.21.15.28:0/2270892354 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c00aa90 con 0x7f6c440c7ea0 2023-12-16T03:26:56.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c49017640 1 -- 172.21.15.28:0/2270892354 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c44146b70 con 0x7f6c440c7ea0 2023-12-16T03:26:56.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.652+0000 7f6c49017640 1 -- 172.21.15.28:0/2270892354 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c441ed700 con 0x7f6c440c7ea0 2023-12-16T03:26:56.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.656+0000 7f6c49017640 1 -- 172.21.15.28:0/2270892354 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c44068400 con 0x7f6c440c7ea0 2023-12-16T03:26:56.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.656+0000 7f6c3bfff640 1 -- 172.21.15.28:0/2270892354 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6c2c00abf0 con 0x7f6c440c7ea0 2023-12-16T03:26:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.656+0000 7f6c3bfff640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c24066470 0x7f6c24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.656+0000 7f6c3bfff640 1 -- 172.21.15.28:0/2270892354 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6c2c083920 con 0x7f6c440c7ea0 2023-12-16T03:26:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.656+0000 7f6c42d9d640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c24066470 0x7f6c24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.656+0000 7f6c42d9d640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c24066470 0x7f6c24068930 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6c340011f0 tx=0x7f6c34007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:56.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.660+0000 7f6c3bfff640 1 -- 172.21.15.28:0/2270892354 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6c2c051190 con 0x7f6c440c7ea0 2023-12-16T03:26:56.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 -- 172.21.15.28:0/2270892354 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6c4406ca50 con 0x7f6c440c7ea0 2023-12-16T03:26:56.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c3bfff640 1 -- 172.21.15.28:0/2270892354 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5021 (secure 0 0 0) 0x7f6c2c0547b0 con 0x7f6c440c7ea0 2023-12-16T03:26:56.874 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: "auth_dump": [ 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.a", 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lGdUuDBAA9e6veUuYLf2+kocAK6lSbA==", 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.875 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.b", 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lVwi5GBAAaUcDHi9WGhRuJZxdAF2qFA==", 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.c", 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lhw+xExAA3bRuBx2ItsL1Rc8see+tCQ==", 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:26:56.876 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.d", 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1ljr1CIBAAkEkWnhykut5uG4ARAKJvRA==", 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.0", 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBZGH1l80qNNRAA0+mdmZ1tm0i6Jc4XYM4aCw==", 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.1", 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBdGH1lJW/FABAAm5ylV9HO9EWb+06Y2OwfVw==", 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.878 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.2", 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBgGH1l9x5DBxAAYGKOx8uO5Nf5KROP8dcugA==", 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.879 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.3", 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBjGH1lEwhVDhAAA66C1s8baoujas3ncXfeiA==", 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.4", 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBpGH1lUKgjGRAACZa14hbBnIoe+pU4Z38i0w==", 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:26:56.880 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.5", 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBsGH1lzxWVIRAApu48WaE3/juZiozOmmbZnA==", 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.881 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.6", 2023-12-16T03:26:56.882 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBvGH1laENmJxAAmYE1mukqTgUzVp+h5pRYVw==", 2023-12-16T03:26:56.882 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.882 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:26:56.882 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:26:56.882 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.882 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.7", 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQByGH1lyEIXLhAAIfj8iGtpH2wLL/lvBoPkaA==", 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.0", 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lvVeHJBAAIUmgW3XLan0rUG31Cw+zwQ==", 2023-12-16T03:26:56.885 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow r", 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.1", 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lgMMbKBAACWizLH1wqYLfSHVjCwyqHQ==", 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow r", 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.886 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.admin", 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBXGH1lPy/qKhAAAG+o0iL3cZoTmFmA7XqJdw==", 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.testuser", 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDlGH1l/sM4JRAAhBvUn0krm8eJTjfzpHCvgA==", 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow rw fsname=cephfs", 2023-12-16T03:26:56.887 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow r fsname=cephfs", 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.x", 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1l0bdlBxAA/aAGpB8vk/Ggs6Mi6E57sw==", 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.y", 2023-12-16T03:26:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1l2CKLAxAA1E6EQPvBVrOt77Tw/cAi3A==", 2023-12-16T03:26:56.889 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:26:56.889 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-12-16T03:26:56.889 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2023-12-16T03:26:56.889 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:26:56.889 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.889 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:56.889 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2023-12-16T03:26:56.889 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:26:56.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 -- 172.21.15.28:0/2270892354 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c24066470 msgr2=0x7f6c24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:56.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c24066470 0x7f6c24068930 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6c340011f0 tx=0x7f6c34007d40 comp rx=0 tx=0).stop 2023-12-16T03:26:56.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 -- 172.21.15.28:0/2270892354 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c440c7ea0 msgr2=0x7f6c4413f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:56.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c440c7ea0 0x7f6c4413f640 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00c770 tx=0x7f6c2c00cc30 comp rx=0 tx=0).stop 2023-12-16T03:26:56.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 -- 172.21.15.28:0/2270892354 shutdown_connections 2023-12-16T03:26:56.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6c44151e90 0x7f6c4413fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c24066470 0x7f6c24068930 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c440c7ea0 0x7f6c4413f640 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 --2- 172.21.15.28:0/2270892354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c4406bbb0 0x7f6c44146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:56.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 -- 172.21.15.28:0/2270892354 >> 172.21.15.28:0/2270892354 conn(0x7f6c440ca170 msgr2=0x7f6c4406b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:56.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 -- 172.21.15.28:0/2270892354 shutdown_connections 2023-12-16T03:26:56.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:56.872+0000 7f6c49017640 1 -- 172.21.15.28:0/2270892354 wait complete. 2023-12-16T03:26:56.896 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-16T03:26:57.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.036+0000 7fe70149a640 1 Processor -- start 2023-12-16T03:26:57.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.036+0000 7fe70149a640 1 -- start start 2023-12-16T03:26:57.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe70149a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe6fc0c60a0 0x7fe6fc1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe70149a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0a6d60 0x7fe6fc1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe70149a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6fc0c2f30 con 0x7fe6fc0c6850 2023-12-16T03:26:57.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe70149a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0c3fa0 con 0x7fe6fc0c60a0 2023-12-16T03:26:57.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe70149a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc06bbf0 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe6faffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe6fc0c6850 0x7fe6fc155260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:39946/0 (socket says 172.21.15.28:39946) 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe6faffd640 1 -- 172.21.15.28:0/594029690 learned_addr learned my addr 172.21.15.28:0/594029690 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe6fa7fc640 1 --2- 172.21.15.28:0/594029690 >> v2:172.21.15.134:3300/0 conn(0x7fe6fc0c60a0 0x7fe6fc1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe6fb7fe640 1 --2- 172.21.15.28:0/594029690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0a6d60 0x7fe6fc1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe6f9ffb640 1 -- 172.21.15.28:0/594029690 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016834694 0 0) 0x7fe6fc0c2f30 con 0x7fe6fc0c6850 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe6f9ffb640 1 -- 172.21.15.28:0/594029690 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6e4003530 con 0x7fe6fc0c6850 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe6fb7fe640 1 -- 172.21.15.28:0/594029690 >> v2:172.21.15.134:3300/0 conn(0x7fe6fc0c60a0 msgr2=0x7fe6fc1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe6fb7fe640 1 --2- 172.21.15.28:0/594029690 >> v2:172.21.15.134:3300/0 conn(0x7fe6fc0c60a0 0x7fe6fc1581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe6fb7fe640 1 -- 172.21.15.28:0/594029690 >> v1:172.21.15.134:6789/0 conn(0x7fe6fc0c6850 legacy=0x7fe6fc155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.040+0000 7fe6fb7fe640 1 -- 172.21.15.28:0/594029690 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc0c3590 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe6fb7fe640 1 --2- 172.21.15.28:0/594029690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0a6d60 0x7fe6fc1586f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009d90 tx=0x7fe6f401c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ee93d6c49dbaed1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe6f9ffb640 1 -- 172.21.15.28:0/594029690 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40a5950 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe6f9ffb640 1 -- 172.21.15.28:0/594029690 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f40a5ab0 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe6f9ffb640 1 -- 172.21.15.28:0/594029690 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40a5e40 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 -- 172.21.15.28:0/594029690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0a6d60 msgr2=0x7fe6fc1586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 --2- 172.21.15.28:0/594029690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0a6d60 0x7fe6fc1586f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009d90 tx=0x7fe6f401c890 comp rx=0 tx=0).stop 2023-12-16T03:26:57.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 -- 172.21.15.28:0/594029690 shutdown_connections 2023-12-16T03:26:57.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 --2- 172.21.15.28:0/594029690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0a6d60 0x7fe6fc1586f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 --2- 172.21.15.28:0/594029690 >> v2:172.21.15.134:3300/0 conn(0x7fe6fc0c60a0 0x7fe6fc1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 -- 172.21.15.28:0/594029690 >> 172.21.15.28:0/594029690 conn(0x7fe6fc0c7e40 msgr2=0x7fe6fc0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:57.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 -- 172.21.15.28:0/594029690 shutdown_connections 2023-12-16T03:26:57.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 -- 172.21.15.28:0/594029690 wait complete. 2023-12-16T03:26:57.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 Processor -- start 2023-12-16T03:26:57.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 -- start start 2023-12-16T03:26:57.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6fc0a6d60 0x7fe6fc0a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0c60a0 0x7fe6fc0a81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc0c6850 0x7fe6fc1f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc0a9300 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc1f0390 con 0x7fe6fc0c6850 2023-12-16T03:26:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.044+0000 7fe70149a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc154520 con 0x7fe6fc0c60a0 2023-12-16T03:26:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6faffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6fc0a6d60 0x7fe6fc0a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6faffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6fc0a6d60 0x7fe6fc0a7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44296/0 (socket says 172.21.15.28:44296) 2023-12-16T03:26:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6fa7fc640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0c60a0 0x7fe6fc0a81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6faffd640 1 -- 172.21.15.28:0/4234377928 learned_addr learned my addr 172.21.15.28:0/4234377928 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6fb7fe640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc0c6850 0x7fe6fc1f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6faffd640 1 -- 172.21.15.28:0/4234377928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0c60a0 msgr2=0x7fe6fc0a81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6faffd640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0c60a0 0x7fe6fc0a81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6faffd640 1 -- 172.21.15.28:0/4234377928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc0c6850 msgr2=0x7fe6fc1f0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6faffd640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc0c6850 0x7fe6fc1f0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6faffd640 1 -- 172.21.15.28:0/4234377928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f4009a70 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6fa7fc640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0c60a0 0x7fe6fc0a81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:26:57.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6faffd640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6fc0a6d60 0x7fe6fc0a7c70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00c420 tx=0x7fe6ec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:57.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6e37fe640 1 -- 172.21.15.28:0/4234377928 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec005cf0 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6e37fe640 1 -- 172.21.15.28:0/4234377928 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec005e50 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe70149a640 1 -- 172.21.15.28:0/4234377928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc155af0 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6e37fe640 1 -- 172.21.15.28:0/4234377928 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0072d0 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe70149a640 1 -- 172.21.15.28:0/4234377928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc06ffb0 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe70149a640 1 -- 172.21.15.28:0/4234377928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6fc070290 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6e37fe640 1 -- 172.21.15.28:0/4234377928 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe6ec007430 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.048+0000 7fe6e37fe640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6e8066470 0x7fe6e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.052+0000 7fe6e37fe640 1 -- 172.21.15.28:0/4234377928 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe6ec0830e0 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.052+0000 7fe6fa7fc640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6e8066470 0x7fe6e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.052+0000 7fe6fa7fc640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6e8066470 0x7fe6e8068930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc14e610 tx=0x7fe6f0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:57.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.052+0000 7fe6e37fe640 1 -- 172.21.15.28:0/4234377928 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe6ec0508c0 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.264+0000 7fe70149a640 1 -- 172.21.15.28:0/4234377928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7fe6fc066df0 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.268+0000 7fe6e37fe640 1 -- 172.21.15.28:0/4234377928 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v14) v1 ==== 85+0+0 (secure 0 0 0) 0x7fe6ec053ee0 con 0x7fe6fc0a6d60 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 -- 172.21.15.28:0/4234377928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6e8066470 msgr2=0x7fe6e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6e8066470 0x7fe6e8068930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc14e610 tx=0x7fe6f0009190 comp rx=0 tx=0).stop 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 -- 172.21.15.28:0/4234377928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6fc0a6d60 msgr2=0x7fe6fc0a7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6fc0a6d60 0x7fe6fc0a7c70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00c420 tx=0x7fe6ec00c8e0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 -- 172.21.15.28:0/4234377928 shutdown_connections 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc0c6850 0x7fe6fc1f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6fc0c60a0 0x7fe6fc0a81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe6e8066470 0x7fe6e8068930 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 --2- 172.21.15.28:0/4234377928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6fc0a6d60 0x7fe6fc0a7c70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 -- 172.21.15.28:0/4234377928 >> 172.21.15.28:0/4234377928 conn(0x7fe6fc0c7e40 msgr2=0x7fe6fc156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 -- 172.21.15.28:0/4234377928 shutdown_connections 2023-12-16T03:26:57.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.272+0000 7fe70149a640 1 -- 172.21.15.28:0/4234377928 wait complete. 2023-12-16T03:26:57.294 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:26:57.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.432+0000 7fedcff80640 1 Processor -- start 2023-12-16T03:26:57.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedcff80640 1 -- start start 2023-12-16T03:26:57.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedcff80640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fedc80c4100 0x7fedc80c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedcff80640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fedc80c06d0 0x7fedc80a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedcff80640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc80c31c0 con 0x7fedc80c63c0 2023-12-16T03:26:57.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedcff80640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc80c34a0 con 0x7fedc80c06d0 2023-12-16T03:26:57.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedcff80640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc80c1030 con 0x7fedc80c4100 2023-12-16T03:26:57.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedcdd1c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fedc80c63c0 0x7fedc80c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40932/0 (socket says 172.21.15.28:40932) 2023-12-16T03:26:57.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedcdd1c640 1 -- 172.21.15.28:0/4252694670 learned_addr learned my addr 172.21.15.28:0/4252694670 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:57.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedce51d640 1 --2- 172.21.15.28:0/4252694670 >> v2:172.21.15.28:3300/0 conn(0x7fedc80c06d0 0x7fedc80a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedcd51b640 1 --2- 172.21.15.28:0/4252694670 >> v2:172.21.15.134:3300/0 conn(0x7fedc80c4100 0x7fedc80c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedccd1a640 1 -- 172.21.15.28:0/4252694670 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204504046 0 0) 0x7fedc80c31c0 con 0x7fedc80c63c0 2023-12-16T03:26:57.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedccd1a640 1 -- 172.21.15.28:0/4252694670 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb4005740 con 0x7fedc80c63c0 2023-12-16T03:26:57.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedce51d640 1 -- 172.21.15.28:0/4252694670 >> v2:172.21.15.134:3300/0 conn(0x7fedc80c4100 msgr2=0x7fedc80c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:57.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedce51d640 1 --2- 172.21.15.28:0/4252694670 >> v2:172.21.15.134:3300/0 conn(0x7fedc80c4100 0x7fedc80c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedce51d640 1 -- 172.21.15.28:0/4252694670 >> v1:172.21.15.28:6789/0 conn(0x7fedc80c63c0 legacy=0x7fedc80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.436+0000 7fedce51d640 1 -- 172.21.15.28:0/4252694670 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc80c1310 con 0x7fedc80c06d0 2023-12-16T03:26:57.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedce51d640 1 --2- 172.21.15.28:0/4252694670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedc80c06d0 0x7fedc80a9680 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fedc80a8b40 tx=0x7fedc001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd27a4ea76f9332 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:57.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedccd1a640 1 -- 172.21.15.28:0/4252694670 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc80aa3d0 con 0x7fedc80c06d0 2023-12-16T03:26:57.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedccd1a640 1 -- 172.21.15.28:0/4252694670 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc00a57c0 con 0x7fedc80c06d0 2023-12-16T03:26:57.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedccd1a640 1 -- 172.21.15.28:0/4252694670 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc00a5b50 con 0x7fedc80c06d0 2023-12-16T03:26:57.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedcff80640 1 -- 172.21.15.28:0/4252694670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedc80c06d0 msgr2=0x7fedc80a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedcff80640 1 --2- 172.21.15.28:0/4252694670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedc80c06d0 0x7fedc80a9680 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fedc80a8b40 tx=0x7fedc001c7f0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedcff80640 1 -- 172.21.15.28:0/4252694670 shutdown_connections 2023-12-16T03:26:57.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedcff80640 1 --2- 172.21.15.28:0/4252694670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedc80c06d0 0x7fedc80a9680 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedcff80640 1 --2- 172.21.15.28:0/4252694670 >> v2:172.21.15.134:3300/0 conn(0x7fedc80c4100 0x7fedc80c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedcff80640 1 -- 172.21.15.28:0/4252694670 >> 172.21.15.28:0/4252694670 conn(0x7fedc806a5b0 msgr2=0x7fedc806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:57.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedcff80640 1 -- 172.21.15.28:0/4252694670 shutdown_connections 2023-12-16T03:26:57.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedcff80640 1 -- 172.21.15.28:0/4252694670 wait complete. 2023-12-16T03:26:57.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedcff80640 1 Processor -- start 2023-12-16T03:26:57.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.440+0000 7fedcff80640 1 -- start start 2023-12-16T03:26:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcff80640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedc80c06d0 0x7fedc81e8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcff80640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedc80c4100 0x7fedc81e96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcff80640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedc80c63c0 0x7fedc80a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcff80640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8155db0 con 0x7fedc80c06d0 2023-12-16T03:26:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcff80640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8156000 con 0x7fedc80c63c0 2023-12-16T03:26:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcff80640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc81eb860 con 0x7fedc80c4100 2023-12-16T03:26:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcdd1c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedc80c06d0 0x7fedc81e8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcdd1c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedc80c06d0 0x7fedc81e8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44314/0 (socket says 172.21.15.28:44314) 2023-12-16T03:26:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcdd1c640 1 -- 172.21.15.28:0/499859793 learned_addr learned my addr 172.21.15.28:0/499859793 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcd51b640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedc80c4100 0x7fedc81e96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcdd1c640 1 -- 172.21.15.28:0/499859793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedc80c4100 msgr2=0x7fedc81e96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcdd1c640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedc80c4100 0x7fedc81e96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedce51d640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedc80c63c0 0x7fedc80a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcdd1c640 1 -- 172.21.15.28:0/499859793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedc80c63c0 msgr2=0x7fedc80a63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcdd1c640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedc80c63c0 0x7fedc80a63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcdd1c640 1 -- 172.21.15.28:0/499859793 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0009a70 con 0x7fedc80c06d0 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcd51b640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedc80c4100 0x7fedc81e96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedce51d640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedc80c63c0 0x7fedc80a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcdd1c640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedc80c06d0 0x7fedc81e8cb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fedc400c420 tx=0x7fedc400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedbe7fc640 1 -- 172.21.15.28:0/499859793 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4005cf0 con 0x7fedc80c06d0 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedbe7fc640 1 -- 172.21.15.28:0/499859793 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4005e50 con 0x7fedc80c06d0 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedbe7fc640 1 -- 172.21.15.28:0/499859793 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40072d0 con 0x7fedc80c06d0 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcff80640 1 -- 172.21.15.28:0/499859793 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc81ebb40 con 0x7fedc80c06d0 2023-12-16T03:26:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcff80640 1 -- 172.21.15.28:0/499859793 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc8152fc0 con 0x7fedc80c06d0 2023-12-16T03:26:57.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedcff80640 1 -- 172.21.15.28:0/499859793 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc81ebd80 con 0x7fedc80c06d0 2023-12-16T03:26:57.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.444+0000 7fedbe7fc640 1 -- 172.21.15.28:0/499859793 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fedc4007450 con 0x7fedc80c06d0 2023-12-16T03:26:57.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.448+0000 7fedbe7fc640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fedac066470 0x7fedac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.448+0000 7fedbe7fc640 1 -- 172.21.15.28:0/499859793 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fedc4082c80 con 0x7fedc80c06d0 2023-12-16T03:26:57.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.448+0000 7fedcd51b640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fedac066470 0x7fedac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.448+0000 7fedcd51b640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fedac066470 0x7fedac068930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fedc80a5cc0 tx=0x7fedb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:57.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.452+0000 7fedbe7fc640 1 -- 172.21.15.28:0/499859793 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fedc81ebd80 con 0x7fedc80c06d0 2023-12-16T03:26:57.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.612+0000 7fedcff80640 1 -- 172.21.15.28:0/499859793 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedc8068400 con 0x7fedc80c06d0 2023-12-16T03:26:57.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedbe7fc640 1 -- 172.21.15.28:0/499859793 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+12857 (secure 0 0 0) 0x7fedc4017020 con 0x7fedc80c06d0 2023-12-16T03:26:57.617 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:57.617 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":46,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:26:56.484213+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:26:57.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 -- 172.21.15.28:0/499859793 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fedac066470 msgr2=0x7fedac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fedac066470 0x7fedac068930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fedc80a5cc0 tx=0x7fedb8008040 comp rx=0 tx=0).stop 2023-12-16T03:26:57.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 -- 172.21.15.28:0/499859793 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedc80c06d0 msgr2=0x7fedc81e8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedc80c06d0 0x7fedc81e8cb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fedc400c420 tx=0x7fedc400c8e0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 -- 172.21.15.28:0/499859793 shutdown_connections 2023-12-16T03:26:57.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedc80c63c0 0x7fedc80a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fedc80c4100 0x7fedc81e96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fedac066470 0x7fedac068930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 --2- 172.21.15.28:0/499859793 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fedc80c06d0 0x7fedc81e8cb0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 -- 172.21.15.28:0/499859793 >> 172.21.15.28:0/499859793 conn(0x7fedc806a5b0 msgr2=0x7fedc806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:57.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 -- 172.21.15.28:0/499859793 shutdown_connections 2023-12-16T03:26:57.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.616+0000 7fedcff80640 1 -- 172.21.15.28:0/499859793 wait complete. 2023-12-16T03:26:57.638 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:26:57.639 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:26:57.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.780+0000 7ffa3a23a640 1 Processor -- start 2023-12-16T03:26:57.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.780+0000 7ffa3a23a640 1 -- start start 2023-12-16T03:26:57.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa3a23a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa3414f800 0x7ffa34072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa3a23a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa34071e90 con 0x7ffa340c1010 2023-12-16T03:26:57.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa3a23a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa340a5110 con 0x7ffa34072860 2023-12-16T03:26:57.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa3a23a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa34152d70 con 0x7ffa3414f800 2023-12-16T03:26:57.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa39238640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa3414f800 0x7ffa34072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa39238640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa3414f800 0x7ffa34072320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44318/0 (socket says 172.21.15.28:44318) 2023-12-16T03:26:57.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa39238640 1 -- 172.21.15.28:0/2774065271 learned_addr learned my addr 172.21.15.28:0/2774065271 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:57.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa39a39640 1 --1- 172.21.15.28:0/2774065271 >> v1:172.21.15.28:6789/0 conn(0x7ffa340c1010 0x7ffa3415cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40944/0 (socket says 172.21.15.28:40944) 2023-12-16T03:26:57.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa39238640 1 -- 172.21.15.28:0/2774065271 >> v1:172.21.15.134:6789/0 conn(0x7ffa34072860 legacy=0x7ffa3406fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:57.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa39238640 1 -- 172.21.15.28:0/2774065271 >> v1:172.21.15.28:6789/0 conn(0x7ffa340c1010 legacy=0x7ffa3415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa2bfff640 1 -- 172.21.15.28:0/2774065271 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762061665 0 0) 0x7ffa34071e90 con 0x7ffa340c1010 2023-12-16T03:26:57.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.784+0000 7ffa39238640 1 -- 172.21.15.28:0/2774065271 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa34153050 con 0x7ffa3414f800 2023-12-16T03:26:57.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa39238640 1 --2- 172.21.15.28:0/2774065271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa3414f800 0x7ffa34072320 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009870 tx=0x7ffa3001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7212b2478aa3dc6c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:57.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa2bfff640 1 -- 172.21.15.28:0/2774065271 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300a6040 con 0x7ffa3414f800 2023-12-16T03:26:57.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa2bfff640 1 -- 172.21.15.28:0/2774065271 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa300aa600 con 0x7ffa3414f800 2023-12-16T03:26:57.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa2bfff640 1 -- 172.21.15.28:0/2774065271 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300aa990 con 0x7ffa3414f800 2023-12-16T03:26:57.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 -- 172.21.15.28:0/2774065271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa3414f800 msgr2=0x7ffa34072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 --2- 172.21.15.28:0/2774065271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa3414f800 0x7ffa34072320 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009870 tx=0x7ffa3001c480 comp rx=0 tx=0).stop 2023-12-16T03:26:57.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 -- 172.21.15.28:0/2774065271 shutdown_connections 2023-12-16T03:26:57.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 --2- 172.21.15.28:0/2774065271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa3414f800 0x7ffa34072320 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 -- 172.21.15.28:0/2774065271 >> 172.21.15.28:0/2774065271 conn(0x7ffa340a7800 msgr2=0x7ffa340a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:57.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 -- 172.21.15.28:0/2774065271 shutdown_connections 2023-12-16T03:26:57.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 -- 172.21.15.28:0/2774065271 wait complete. 2023-12-16T03:26:57.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 Processor -- start 2023-12-16T03:26:57.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 -- start start 2023-12-16T03:26:57.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa34072860 0x7ffa340c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa340c1010 0x7ffa34147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa3414f800 0x7ffa34147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa341ed250 con 0x7ffa34072860 2023-12-16T03:26:57.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa341472e0 con 0x7ffa340c1010 2023-12-16T03:26:57.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa3a23a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa341ecf70 con 0x7ffa3414f800 2023-12-16T03:26:57.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.788+0000 7ffa39238640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa34072860 0x7ffa340c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa39238640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa34072860 0x7ffa340c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44322/0 (socket says 172.21.15.28:44322) 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa39238640 1 -- 172.21.15.28:0/752425088 learned_addr learned my addr 172.21.15.28:0/752425088 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa39a39640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa3414f800 0x7ffa34147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa38a37640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa340c1010 0x7ffa34147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa39238640 1 -- 172.21.15.28:0/752425088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa3414f800 msgr2=0x7ffa34147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa39238640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa3414f800 0x7ffa34147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa39238640 1 -- 172.21.15.28:0/752425088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa340c1010 msgr2=0x7ffa34147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa39238640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa340c1010 0x7ffa34147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa39238640 1 -- 172.21.15.28:0/752425088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa300094d0 con 0x7ffa34072860 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa38a37640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa340c1010 0x7ffa34147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa39238640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa34072860 0x7ffa340c2bb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ffa30019090 tx=0x7ffa3001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa29ffb640 1 -- 172.21.15.28:0/752425088 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300b3800 con 0x7ffa34072860 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa29ffb640 1 -- 172.21.15.28:0/752425088 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa300b3960 con 0x7ffa34072860 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa29ffb640 1 -- 172.21.15.28:0/752425088 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300b3cd0 con 0x7ffa34072860 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa3a23a640 1 -- 172.21.15.28:0/752425088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa34146c90 con 0x7ffa34072860 2023-12-16T03:26:57.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa3a23a640 1 -- 172.21.15.28:0/752425088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa340a5f80 con 0x7ffa34072860 2023-12-16T03:26:57.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa3a23a640 1 -- 172.21.15.28:0/752425088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa34146af0 con 0x7ffa34072860 2023-12-16T03:26:57.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.792+0000 7ffa29ffb640 1 -- 172.21.15.28:0/752425088 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ffa300b2380 con 0x7ffa34072860 2023-12-16T03:26:57.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.796+0000 7ffa29ffb640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa180664a0 0x7ffa18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:57.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.796+0000 7ffa29ffb640 1 -- 172.21.15.28:0/752425088 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffa3011df00 con 0x7ffa34072860 2023-12-16T03:26:57.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.796+0000 7ffa38a37640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa180664a0 0x7ffa18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:57.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.796+0000 7ffa38a37640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa180664a0 0x7ffa18068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffa340c0d80 tx=0x7ffa24009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:57.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.800+0000 7ffa29ffb640 1 -- 172.21.15.28:0/752425088 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ffa34146af0 con 0x7ffa34072860 2023-12-16T03:26:57.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 -- 172.21.15.28:0/752425088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa34146af0 con 0x7ffa34072860 2023-12-16T03:26:57.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa29ffb640 1 -- 172.21.15.28:0/752425088 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa34146af0 con 0x7ffa34072860 2023-12-16T03:26:57.962 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:26:57.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 -- 172.21.15.28:0/752425088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa180664a0 msgr2=0x7ffa18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa180664a0 0x7ffa18068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffa340c0d80 tx=0x7ffa24009040 comp rx=0 tx=0).stop 2023-12-16T03:26:57.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 -- 172.21.15.28:0/752425088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa34072860 msgr2=0x7ffa340c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:57.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa34072860 0x7ffa340c2bb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ffa30019090 tx=0x7ffa3001acc0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 -- 172.21.15.28:0/752425088 shutdown_connections 2023-12-16T03:26:57.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa3414f800 0x7ffa34147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa340c1010 0x7ffa34147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa180664a0 0x7ffa18068960 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 --2- 172.21.15.28:0/752425088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa34072860 0x7ffa340c2bb0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:57.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 -- 172.21.15.28:0/752425088 >> 172.21.15.28:0/752425088 conn(0x7ffa340a7800 msgr2=0x7ffa340a56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:57.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 -- 172.21.15.28:0/752425088 shutdown_connections 2023-12-16T03:26:57.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:57.960+0000 7ffa3a23a640 1 -- 172.21.15.28:0/752425088 wait complete. 2023-12-16T03:26:57.983 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-16T03:26:58.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f665f101640 1 Processor -- start 2023-12-16T03:26:58.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f665f101640 1 -- start start 2023-12-16T03:26:58.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f665f101640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f665806bbb0 0x7f66581600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f665f101640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665806c860 con 0x7f6658151e90 2023-12-16T03:26:58.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f665f101640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665806c040 con 0x7f66580c7ea0 2023-12-16T03:26:58.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f665f101640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66580c8750 con 0x7f665806bbb0 2023-12-16T03:26:58.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f665ce9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6658151e90 0x7f66580c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40950/0 (socket says 172.21.15.28:40950) 2023-12-16T03:26:58.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f665ce9d640 1 -- 172.21.15.28:0/365948942 learned_addr learned my addr 172.21.15.28:0/365948942 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f665d69e640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f665806bbb0 0x7f66581600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358231467 0 0) 0x7f665806c860 con 0x7f6658151e90 2023-12-16T03:26:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6648003530 con 0x7f6658151e90 2023-12-16T03:26:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4204577449 0 0) 0x7f6648003530 con 0x7f6658151e90 2023-12-16T03:26:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f665806bbb0 msgr2=0x7f66581600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f665806bbb0 0x7f66581600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 >> v1:172.21.15.134:6789/0 conn(0x7f66580c7ea0 legacy=0x7f665806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6658154930 con 0x7f6658151e90 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f664c001680 con 0x7f6658151e90 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 >> v1:172.21.15.28:6789/0 conn(0x7f6658151e90 legacy=0x7f66580c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f665806bbb0 0x7f66480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6648003f30 0x7f66480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6648004d10 0x7f6648005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66580c8750 con 0x7f6648004d10 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664800bbd0 con 0x7f6648003f30 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.124+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664800bd90 con 0x7f665806bbb0 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f665d69e640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6648004d10 0x7f6648005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f665ce9d640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f665806bbb0 0x7f66480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f6657fff640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6648003f30 0x7f66480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f665d69e640 1 -- 172.21.15.28:0/365948942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f665806bbb0 msgr2=0x7f66480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:58.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f665d69e640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f665806bbb0 0x7f66480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f665d69e640 1 -- 172.21.15.28:0/365948942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6648003f30 msgr2=0x7f66480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:58.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f665d69e640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6648003f30 0x7f66480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f665d69e640 1 -- 172.21.15.28:0/365948942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648003530 con 0x7f6648004d10 2023-12-16T03:26:58.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f665d69e640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6648004d10 0x7f6648005190 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6650009fc0 tx=0x7f665001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4eacba8b219c4be server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:58.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66500a5a50 con 0x7f6648004d10 2023-12-16T03:26:58.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665000f040 con 0x7f6648004d10 2023-12-16T03:26:58.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f66577fe640 1 -- 172.21.15.28:0/365948942 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66500a5df0 con 0x7f6648004d10 2023-12-16T03:26:58.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f665f101640 1 -- 172.21.15.28:0/365948942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6648004d10 msgr2=0x7f6648005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f665f101640 1 --2- 172.21.15.28:0/365948942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6648004d10 0x7f6648005190 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6650009fc0 tx=0x7f665001cc60 comp rx=0 tx=0).stop 2023-12-16T03:26:58.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.128+0000 7f665d69e640 1 -- 172.21.15.28:0/365948942 reap_dead start 2023-12-16T03:26:58.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 -- 172.21.15.28:0/365948942 shutdown_connections 2023-12-16T03:26:58.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 -- 172.21.15.28:0/365948942 >> 172.21.15.28:0/365948942 conn(0x7f66580ca170 msgr2=0x7f66580ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:58.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 -- 172.21.15.28:0/365948942 shutdown_connections 2023-12-16T03:26:58.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 -- 172.21.15.28:0/365948942 wait complete. 2023-12-16T03:26:58.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 Processor -- start 2023-12-16T03:26:58.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 -- start start 2023-12-16T03:26:58.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6648004d10 0x7f6658149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665814ef50 0x7f665814d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6658158600 0x7f665814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66581552d0 con 0x7f665814ef50 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66580c33f0 con 0x7f6648004d10 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665f101640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665814ec70 con 0x7f6658158600 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f6657fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665814ef50 0x7f665814d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f6657fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665814ef50 0x7f665814d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44334/0 (socket says 172.21.15.28:44334) 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f6657fff640 1 -- 172.21.15.28:0/1011972058 learned_addr learned my addr 172.21.15.28:0/1011972058 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665ce9d640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6648004d10 0x7f6658149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f665d69e640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6658158600 0x7f665814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f6657fff640 1 -- 172.21.15.28:0/1011972058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6658158600 msgr2=0x7f665814dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f6657fff640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6658158600 0x7f665814dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f6657fff640 1 -- 172.21.15.28:0/1011972058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6648004d10 msgr2=0x7f6658149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f6657fff640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6648004d10 0x7f6658149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f6657fff640 1 -- 172.21.15.28:0/1011972058 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66581f1360 con 0x7f665814ef50 2023-12-16T03:26:58.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.132+0000 7f6657fff640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665814ef50 0x7f665814d7d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f664400f7f0 tx=0x7f664400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:58.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.136+0000 7f66557fa640 1 -- 172.21.15.28:0/1011972058 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440050d0 con 0x7f665814ef50 2023-12-16T03:26:58.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.136+0000 7f66557fa640 1 -- 172.21.15.28:0/1011972058 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6644005230 con 0x7f665814ef50 2023-12-16T03:26:58.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.136+0000 7f66557fa640 1 -- 172.21.15.28:0/1011972058 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664400d6d0 con 0x7f665814ef50 2023-12-16T03:26:58.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.136+0000 7f665f101640 1 -- 172.21.15.28:0/1011972058 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66581f05a0 con 0x7f665814ef50 2023-12-16T03:26:58.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.136+0000 7f665f101640 1 -- 172.21.15.28:0/1011972058 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66581f0b60 con 0x7f665814ef50 2023-12-16T03:26:58.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.136+0000 7f665f101640 1 -- 172.21.15.28:0/1011972058 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6658068400 con 0x7f665814ef50 2023-12-16T03:26:58.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.136+0000 7f66557fa640 1 -- 172.21.15.28:0/1011972058 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f664400d830 con 0x7f665814ef50 2023-12-16T03:26:58.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.136+0000 7f66557fa640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f663c066470 0x7f663c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.136+0000 7f66557fa640 1 -- 172.21.15.28:0/1011972058 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6644083990 con 0x7f665814ef50 2023-12-16T03:26:58.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.136+0000 7f665ce9d640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f663c066470 0x7f663c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.136+0000 7f665ce9d640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f663c066470 0x7f663c068930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f664c0017b0 tx=0x7f664c0015a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:58.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.140+0000 7f66557fa640 1 -- 172.21.15.28:0/1011972058 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6644051170 con 0x7f665814ef50 2023-12-16T03:26:58.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.304+0000 7f665f101640 1 -- 172.21.15.28:0/1011972058 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f66580c40a0 con 0x7f665814ef50 2023-12-16T03:26:58.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.304+0000 7f66557fa640 1 -- 172.21.15.28:0/1011972058 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6644054790 con 0x7f665814ef50 2023-12-16T03:26:58.307 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:26:58.308 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2023-12-16T03:26:58.308 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:26:58.308 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2023-12-16T03:26:58.308 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2023-12-16T03:26:58.308 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:26:58.308 INFO:teuthology.orchestra.run.smithi028.stdout:] 2023-12-16T03:26:58.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 -- 172.21.15.28:0/1011972058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f663c066470 msgr2=0x7f663c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f663c066470 0x7f663c068930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f664c0017b0 tx=0x7f664c0015a0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 -- 172.21.15.28:0/1011972058 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665814ef50 msgr2=0x7f665814d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665814ef50 0x7f665814d7d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f664400f7f0 tx=0x7f664400fcb0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 -- 172.21.15.28:0/1011972058 shutdown_connections 2023-12-16T03:26:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6658158600 0x7f665814dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f663c066470 0x7f663c068930 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665814ef50 0x7f665814d7d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 --2- 172.21.15.28:0/1011972058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6648004d10 0x7f6658149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 -- 172.21.15.28:0/1011972058 >> 172.21.15.28:0/1011972058 conn(0x7f66580ca170 msgr2=0x7f665806b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 -- 172.21.15.28:0/1011972058 shutdown_connections 2023-12-16T03:26:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.308+0000 7f665f101640 1 -- 172.21.15.28:0/1011972058 wait complete. 2023-12-16T03:26:58.329 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-16T03:26:58.329 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-16T03:26:58.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.472+0000 7fdb6e9d1640 1 Processor -- start 2023-12-16T03:26:58.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.472+0000 7fdb6e9d1640 1 -- start start 2023-12-16T03:26:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.472+0000 7fdb6e9d1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdb68155320 0x7fdb6806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.472+0000 7fdb6e9d1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb68154e90 con 0x7fdb680c8b90 2023-12-16T03:26:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.472+0000 7fdb6e9d1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb680c5350 con 0x7fdb68151c70 2023-12-16T03:26:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.472+0000 7fdb6e9d1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb68154630 con 0x7fdb68155320 2023-12-16T03:26:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.476+0000 7fdb677fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdb68155320 0x7fdb6806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.476+0000 7fdb6cf6e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdb680c8b90 0x7fdb680c8050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40960/0 (socket says 172.21.15.28:40960) 2023-12-16T03:26:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.476+0000 7fdb6cf6e640 1 -- 172.21.15.28:0/521856819 learned_addr learned my addr 172.21.15.28:0/521856819 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:26:58.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.476+0000 7fdb677fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdb68155320 0x7fdb6806ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44338/0 (socket says 172.21.15.28:44338) 2023-12-16T03:26:58.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.476+0000 7fdb677fe640 1 -- 172.21.15.28:0/521856819 >> v1:172.21.15.134:6789/0 conn(0x7fdb68151c70 legacy=0x7fdb680c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.476+0000 7fdb677fe640 1 -- 172.21.15.28:0/521856819 >> v1:172.21.15.28:6789/0 conn(0x7fdb680c8b90 legacy=0x7fdb680c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.476+0000 7fdb66ffd640 1 -- 172.21.15.28:0/521856819 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984170094 0 0) 0x7fdb68154e90 con 0x7fdb680c8b90 2023-12-16T03:26:58.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.476+0000 7fdb677fe640 1 -- 172.21.15.28:0/521856819 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68152050 con 0x7fdb68155320 2023-12-16T03:26:58.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.480+0000 7fdb677fe640 1 --2- 172.21.15.28:0/521856819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb68155320 0x7fdb6806ca40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0097a0 tx=0x7fdb5c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e160ca1bad6a37c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.480+0000 7fdb66ffd640 1 -- 172.21.15.28:0/521856819 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0ab600 con 0x7fdb68155320 2023-12-16T03:26:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.480+0000 7fdb66ffd640 1 -- 172.21.15.28:0/521856819 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c0a7050 con 0x7fdb68155320 2023-12-16T03:26:58.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.480+0000 7fdb66ffd640 1 -- 172.21.15.28:0/521856819 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0ab980 con 0x7fdb68155320 2023-12-16T03:26:58.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.480+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/521856819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb68155320 msgr2=0x7fdb6806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.480+0000 7fdb6e9d1640 1 --2- 172.21.15.28:0/521856819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb68155320 0x7fdb6806ca40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0097a0 tx=0x7fdb5c01c3a0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.480+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/521856819 shutdown_connections 2023-12-16T03:26:58.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.480+0000 7fdb6e9d1640 1 --2- 172.21.15.28:0/521856819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb68155320 0x7fdb6806ca40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.480+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/521856819 >> 172.21.15.28:0/521856819 conn(0x7fdb680abcf0 msgr2=0x7fdb680ac100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:58.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.480+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/521856819 shutdown_connections 2023-12-16T03:26:58.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.480+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/521856819 wait complete. 2023-12-16T03:26:58.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6e9d1640 1 Processor -- start 2023-12-16T03:26:58.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6e9d1640 1 -- start start 2023-12-16T03:26:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6e9d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb680c8b90 0x7fdb680c03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6e9d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb68151c70 0x7fdb680c1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6e9d1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb68155320 0x7fdb68157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6e9d1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb68147cc0 con 0x7fdb68155320 2023-12-16T03:26:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6e9d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb68156d10 con 0x7fdb68151c70 2023-12-16T03:26:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6e9d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb68157830 con 0x7fdb680c8b90 2023-12-16T03:26:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6cf6e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb68155320 0x7fdb68157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6cf6e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb68155320 0x7fdb68157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44350/0 (socket says 172.21.15.28:44350) 2023-12-16T03:26:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6cf6e640 1 -- 172.21.15.28:0/2896868460 learned_addr learned my addr 172.21.15.28:0/2896868460 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb677fe640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb68151c70 0x7fdb680c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb67fff640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb680c8b90 0x7fdb680c03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6cf6e640 1 -- 172.21.15.28:0/2896868460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb680c8b90 msgr2=0x7fdb680c03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6cf6e640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb680c8b90 0x7fdb680c03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6cf6e640 1 -- 172.21.15.28:0/2896868460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb68151c70 msgr2=0x7fdb680c1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:58.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6cf6e640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb68151c70 0x7fdb680c1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:58.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6cf6e640 1 -- 172.21.15.28:0/2896868460 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0093b0 con 0x7fdb68155320 2023-12-16T03:26:58.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6cf6e640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb68155320 0x7fdb68157cc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c7c0 tx=0x7fdb6000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:58.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb64ff9640 1 -- 172.21.15.28:0/2896868460 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000a5e0 con 0x7fdb68155320 2023-12-16T03:26:58.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb64ff9640 1 -- 172.21.15.28:0/2896868460 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6000a760 con 0x7fdb68155320 2023-12-16T03:26:58.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/2896868460 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb68156f40 con 0x7fdb68155320 2023-12-16T03:26:58.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb64ff9640 1 -- 172.21.15.28:0/2896868460 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000ab10 con 0x7fdb68155320 2023-12-16T03:26:58.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/2896868460 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb681574c0 con 0x7fdb68155320 2023-12-16T03:26:58.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.484+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/2896868460 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb681579a0 con 0x7fdb68155320 2023-12-16T03:26:58.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.488+0000 7fdb64ff9640 1 -- 172.21.15.28:0/2896868460 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdb6000ac70 con 0x7fdb68155320 2023-12-16T03:26:58.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.488+0000 7fdb64ff9640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb54066470 0x7fdb54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:58.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.488+0000 7fdb64ff9640 1 -- 172.21.15.28:0/2896868460 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdb60082f40 con 0x7fdb68155320 2023-12-16T03:26:58.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.488+0000 7fdb67fff640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb54066470 0x7fdb54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:58.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.488+0000 7fdb67fff640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb54066470 0x7fdb54068930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb6815faf0 tx=0x7fdb58009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:58.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.492+0000 7fdb64ff9640 1 -- 172.21.15.28:0/2896868460 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdb60050720 con 0x7fdb68155320 2023-12-16T03:26:58.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:58.648+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/2896868460 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdb68068400 con 0x7fdb68155320 2023-12-16T03:26:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.484+0000 7fdb64ff9640 1 -- 172.21.15.28:0/2896868460 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdb60018020 con 0x7fdb68155320 2023-12-16T03:26:59.488 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2023-12-16T03:26:59.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.488+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/2896868460 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb54066470 msgr2=0x7fdb54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:59.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.488+0000 7fdb6e9d1640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb54066470 0x7fdb54068930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb6815faf0 tx=0x7fdb58009040 comp rx=0 tx=0).stop 2023-12-16T03:26:59.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.488+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/2896868460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb68155320 msgr2=0x7fdb68157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:59.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.488+0000 7fdb6e9d1640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb68155320 0x7fdb68157cc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c7c0 tx=0x7fdb6000cc80 comp rx=0 tx=0).stop 2023-12-16T03:26:59.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.488+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/2896868460 shutdown_connections 2023-12-16T03:26:59.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.488+0000 7fdb6e9d1640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdb54066470 0x7fdb54068930 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:59.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.488+0000 7fdb6e9d1640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb68155320 0x7fdb68157cc0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:59.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.488+0000 7fdb6e9d1640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb68151c70 0x7fdb680c1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:59.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.488+0000 7fdb6e9d1640 1 --2- 172.21.15.28:0/2896868460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb680c8b90 0x7fdb680c03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:59.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.488+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/2896868460 >> 172.21.15.28:0/2896868460 conn(0x7fdb680abcf0 msgr2=0x7fdb680ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:59.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.492+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/2896868460 shutdown_connections 2023-12-16T03:26:59.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.492+0000 7fdb6e9d1640 1 -- 172.21.15.28:0/2896868460 wait complete. 2023-12-16T03:26:59.522 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-16T03:26:59.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.672+0000 7fb1f4ebb640 1 Processor -- start 2023-12-16T03:26:59.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.672+0000 7fb1f4ebb640 1 -- start start 2023-12-16T03:26:59.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.672+0000 7fb1f4ebb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb1f0151e90 0x7fb1f00c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:59.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.672+0000 7fb1f4ebb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb1f00c7ea0 0x7fb1f006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:59.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.672+0000 7fb1f4ebb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f006c860 con 0x7fb1f00c4e60 2023-12-16T03:26:59.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.672+0000 7fb1f4ebb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f00c8750 con 0x7fb1f0151e90 2023-12-16T03:26:59.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.672+0000 7fb1f4ebb640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f01552d0 con 0x7fb1f00c7ea0 2023-12-16T03:26:59.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.672+0000 7fb1ee59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb1f0151e90 0x7fb1f00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:59.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.672+0000 7fb1ee59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb1f0151e90 0x7fb1f00c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54876/0 (socket says 172.21.15.28:54876) 2023-12-16T03:26:59.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.672+0000 7fb1ee59c640 1 -- 172.21.15.28:0/1848865792 learned_addr learned my addr 172.21.15.28:0/1848865792 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:59.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.672+0000 7fb1eed9d640 1 --1- 172.21.15.28:0/1848865792 >> v1:172.21.15.28:6789/0 conn(0x7fb1f00c4e60 0x7fb1f006b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57762/0 (socket says 172.21.15.28:57762) 2023-12-16T03:26:59.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1e7fff640 1 --2- 172.21.15.28:0/1848865792 >> v2:172.21.15.134:3300/0 conn(0x7fb1f00c7ea0 0x7fb1f006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:59.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1ee59c640 1 -- 172.21.15.28:0/1848865792 >> v2:172.21.15.134:3300/0 conn(0x7fb1f00c7ea0 msgr2=0x7fb1f006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:26:59.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1ee59c640 1 --2- 172.21.15.28:0/1848865792 >> v2:172.21.15.134:3300/0 conn(0x7fb1f00c7ea0 0x7fb1f006b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:59.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1ee59c640 1 -- 172.21.15.28:0/1848865792 >> v1:172.21.15.28:6789/0 conn(0x7fb1f00c4e60 legacy=0x7fb1f006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:59.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1ee59c640 1 -- 172.21.15.28:0/1848865792 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0154930 con 0x7fb1f0151e90 2023-12-16T03:26:59.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1edd9b640 1 -- 172.21.15.28:0/1848865792 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514749761 0 0) 0x7fb1f006c860 con 0x7fb1f00c4e60 2023-12-16T03:26:59.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1e7fff640 1 --2- 172.21.15.28:0/1848865792 >> v2:172.21.15.134:3300/0 conn(0x7fb1f00c7ea0 0x7fb1f006b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:26:59.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1ee59c640 1 --2- 172.21.15.28:0/1848865792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1f0151e90 0x7fb1f00c4920 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00a9a70 tx=0x7fb1e001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79c5f29f7e9bfda server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:59.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1edd9b640 1 -- 172.21.15.28:0/1848865792 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00ab600 con 0x7fb1f0151e90 2023-12-16T03:26:59.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1edd9b640 1 -- 172.21.15.28:0/1848865792 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e00a7050 con 0x7fb1f0151e90 2023-12-16T03:26:59.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1edd9b640 1 -- 172.21.15.28:0/1848865792 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00ab980 con 0x7fb1f0151e90 2023-12-16T03:26:59.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/1848865792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1f0151e90 msgr2=0x7fb1f00c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:59.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.676+0000 7fb1f4ebb640 1 --2- 172.21.15.28:0/1848865792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1f0151e90 0x7fb1f00c4920 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00a9a70 tx=0x7fb1e001c3e0 comp rx=0 tx=0).stop 2023-12-16T03:26:59.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/1848865792 shutdown_connections 2023-12-16T03:26:59.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 --2- 172.21.15.28:0/1848865792 >> v2:172.21.15.134:3300/0 conn(0x7fb1f00c7ea0 0x7fb1f006b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:59.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 --2- 172.21.15.28:0/1848865792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1f0151e90 0x7fb1f00c4920 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:59.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/1848865792 >> 172.21.15.28:0/1848865792 conn(0x7fb1f00ca170 msgr2=0x7fb1f00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:26:59.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/1848865792 shutdown_connections 2023-12-16T03:26:59.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/1848865792 wait complete. 2023-12-16T03:26:59.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 Processor -- start 2023-12-16T03:26:59.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 -- start start 2023-12-16T03:26:59.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1f00c4e60 0x7fb1f0145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:59.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1f00c7ea0 0x7fb1f014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:59.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1f0151e90 0x7fb1f014de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:59.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f014bfd0 con 0x7fb1f00c4e60 2023-12-16T03:26:59.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f014bac0 con 0x7fb1f00c7ea0 2023-12-16T03:26:59.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1f4ebb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f0150830 con 0x7fb1f0151e90 2023-12-16T03:26:59.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1ee59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1f00c4e60 0x7fb1f0145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1ee59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1f00c4e60 0x7fb1f0145700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54882/0 (socket says 172.21.15.28:54882) 2023-12-16T03:26:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1ee59c640 1 -- 172.21.15.28:0/4205003427 learned_addr learned my addr 172.21.15.28:0/4205003427 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:26:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1eed9d640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1f0151e90 0x7fb1f014de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1e7fff640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1f00c7ea0 0x7fb1f014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1ee59c640 1 -- 172.21.15.28:0/4205003427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1f0151e90 msgr2=0x7fb1f014de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1ee59c640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1f0151e90 0x7fb1f014de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1ee59c640 1 -- 172.21.15.28:0/4205003427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1f00c7ea0 msgr2=0x7fb1f014b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:26:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1ee59c640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1f00c7ea0 0x7fb1f014b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:26:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1ee59c640 1 -- 172.21.15.28:0/4205003427 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e00094d0 con 0x7fb1f00c4e60 2023-12-16T03:26:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.680+0000 7fb1ee59c640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1f00c4e60 0x7fb1f0145700 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb1e001a010 tx=0x7fb1e001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.684+0000 7fb1e6ffd640 1 -- 172.21.15.28:0/4205003427 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0004230 con 0x7fb1f00c4e60 2023-12-16T03:26:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.684+0000 7fb1e6ffd640 1 -- 172.21.15.28:0/4205003427 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e0004390 con 0x7fb1f00c4e60 2023-12-16T03:26:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.684+0000 7fb1e6ffd640 1 -- 172.21.15.28:0/4205003427 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0003820 con 0x7fb1f00c4e60 2023-12-16T03:26:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.684+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/4205003427 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f014bcf0 con 0x7fb1f00c4e60 2023-12-16T03:26:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.684+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/4205003427 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f01f05f0 con 0x7fb1f00c4e60 2023-12-16T03:26:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.684+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/4205003427 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f01f0170 con 0x7fb1f00c4e60 2023-12-16T03:26:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.684+0000 7fb1e6ffd640 1 -- 172.21.15.28:0/4205003427 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb1e00b2050 con 0x7fb1f00c4e60 2023-12-16T03:26:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.688+0000 7fb1e6ffd640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb1d0066470 0x7fb1d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:26:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.688+0000 7fb1e6ffd640 1 -- 172.21.15.28:0/4205003427 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb1e011df00 con 0x7fb1f00c4e60 2023-12-16T03:26:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.688+0000 7fb1e7fff640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb1d0066470 0x7fb1d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:26:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.688+0000 7fb1e7fff640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb1d0066470 0x7fb1d0068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0145c40 tx=0x7fb1d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:26:59.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.688+0000 7fb1e6ffd640 1 -- 172.21.15.28:0/4205003427 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb1e00eb8a0 con 0x7fb1f00c4e60 2023-12-16T03:26:59.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:26:59.848+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/4205003427 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb1f01f0170 con 0x7fb1f00c4e60 2023-12-16T03:27:00.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1e6ffd640 1 -- 172.21.15.28:0/4205003427 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb1f01f0170 con 0x7fb1f00c4e60 2023-12-16T03:27:00.493 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2023-12-16T03:27:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/4205003427 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb1d0066470 msgr2=0x7fb1d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb1d0066470 0x7fb1d0068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0145c40 tx=0x7fb1d8008040 comp rx=0 tx=0).stop 2023-12-16T03:27:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/4205003427 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1f00c4e60 msgr2=0x7fb1f0145700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1f00c4e60 0x7fb1f0145700 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb1e001a010 tx=0x7fb1e001ac20 comp rx=0 tx=0).stop 2023-12-16T03:27:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/4205003427 shutdown_connections 2023-12-16T03:27:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1f0151e90 0x7fb1f014de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1f00c7ea0 0x7fb1f014b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb1d0066470 0x7fb1d0068930 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 --2- 172.21.15.28:0/4205003427 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1f00c4e60 0x7fb1f0145700 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/4205003427 >> 172.21.15.28:0/4205003427 conn(0x7fb1f00ca170 msgr2=0x7fb1f0153ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/4205003427 shutdown_connections 2023-12-16T03:27:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.492+0000 7fb1f4ebb640 1 -- 172.21.15.28:0/4205003427 wait complete. 2023-12-16T03:27:00.534 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-16T03:27:00.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.676+0000 7fb49f49a640 1 Processor -- start 2023-12-16T03:27:00.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.676+0000 7fb49f49a640 1 -- start start 2023-12-16T03:27:00.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.676+0000 7fb49f49a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4980c5260 0x7fb49806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:00.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.676+0000 7fb49f49a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb4980c5640 0x7fb4980c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:00.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.676+0000 7fb49f49a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb4980c60f0 0x7fb498155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:00.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.676+0000 7fb49f49a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4980c17f0 con 0x7fb4980c60f0 2023-12-16T03:27:00.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.676+0000 7fb49f49a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4980c2580 con 0x7fb4980c5640 2023-12-16T03:27:00.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.676+0000 7fb49f49a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980c1a00 con 0x7fb4980c5260 2023-12-16T03:27:00.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb49da37640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb4980c60f0 0x7fb498155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:00.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb49da37640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb4980c60f0 0x7fb498155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54890/0 (socket says 172.21.15.28:54890) 2023-12-16T03:27:00.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb49da37640 1 -- 172.21.15.28:0/402862338 learned_addr learned my addr 172.21.15.28:0/402862338 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:00.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb49d236640 1 --2- 172.21.15.28:0/402862338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4980c5260 0x7fb49806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:00.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb49ca35640 1 --2- 172.21.15.28:0/402862338 >> v2:172.21.15.134:3300/0 conn(0x7fb4980c5640 0x7fb4980c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:00.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb49da37640 1 -- 172.21.15.28:0/402862338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4980c5260 msgr2=0x7fb49806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:00.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb49da37640 1 --2- 172.21.15.28:0/402862338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4980c5260 0x7fb49806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:00.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb49da37640 1 -- 172.21.15.28:0/402862338 >> v2:172.21.15.134:3300/0 conn(0x7fb4980c5640 msgr2=0x7fb4980c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:00.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb49da37640 1 --2- 172.21.15.28:0/402862338 >> v2:172.21.15.134:3300/0 conn(0x7fb4980c5640 0x7fb4980c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:00.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb49da37640 1 -- 172.21.15.28:0/402862338 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980c1ce0 con 0x7fb4980c60f0 2023-12-16T03:27:00.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb49da37640 1 --2- 172.21.15.28:0/402862338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4980c60f0 0x7fb498155de0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb4980c3870 tx=0x7fb49001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e992fe0abc809042 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:00.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb48ffff640 1 -- 172.21.15.28:0/402862338 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900a5790 con 0x7fb4980c60f0 2023-12-16T03:27:00.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb48ffff640 1 -- 172.21.15.28:0/402862338 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4900a58f0 con 0x7fb4980c60f0 2023-12-16T03:27:00.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.680+0000 7fb48ffff640 1 -- 172.21.15.28:0/402862338 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900a5c80 con 0x7fb4980c60f0 2023-12-16T03:27:00.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 -- 172.21.15.28:0/402862338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4980c60f0 msgr2=0x7fb498155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:00.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 --2- 172.21.15.28:0/402862338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4980c60f0 0x7fb498155de0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb4980c3870 tx=0x7fb49001c910 comp rx=0 tx=0).stop 2023-12-16T03:27:00.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 -- 172.21.15.28:0/402862338 shutdown_connections 2023-12-16T03:27:00.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 --2- 172.21.15.28:0/402862338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4980c60f0 0x7fb498155de0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:00.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 --2- 172.21.15.28:0/402862338 >> v2:172.21.15.134:3300/0 conn(0x7fb4980c5640 0x7fb4980c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:00.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 --2- 172.21.15.28:0/402862338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4980c5260 0x7fb49806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:00.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 -- 172.21.15.28:0/402862338 >> 172.21.15.28:0/402862338 conn(0x7fb49806a5b0 msgr2=0x7fb49806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:00.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 -- 172.21.15.28:0/402862338 shutdown_connections 2023-12-16T03:27:00.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 -- 172.21.15.28:0/402862338 wait complete. 2023-12-16T03:27:00.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 Processor -- start 2023-12-16T03:27:00.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 -- start start 2023-12-16T03:27:00.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4980c5260 0x7fb498152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:00.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4980c5640 0x7fb498150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:00.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4980c60f0 0x7fb4980a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:00.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb498156110 con 0x7fb4980c5640 2023-12-16T03:27:00.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4981ede10 con 0x7fb4980c5260 2023-12-16T03:27:00.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49f49a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4981ed520 con 0x7fb4980c60f0 2023-12-16T03:27:00.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49ca35640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4980c5640 0x7fb498150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:00.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49d236640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4980c5260 0x7fb498152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:00.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49ca35640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4980c5640 0x7fb498150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54892/0 (socket says 172.21.15.28:54892) 2023-12-16T03:27:00.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49ca35640 1 -- 172.21.15.28:0/367439708 learned_addr learned my addr 172.21.15.28:0/367439708 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:00.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49da37640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4980c60f0 0x7fb4980a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:00.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49d236640 1 -- 172.21.15.28:0/367439708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4980c60f0 msgr2=0x7fb4980a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:00.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49d236640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4980c60f0 0x7fb4980a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:00.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49d236640 1 -- 172.21.15.28:0/367439708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4980c5640 msgr2=0x7fb498150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:00.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49d236640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4980c5640 0x7fb498150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:00.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49d236640 1 -- 172.21.15.28:0/367439708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb490009b30 con 0x7fb4980c5260 2023-12-16T03:27:00.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.684+0000 7fb49ca35640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4980c5640 0x7fb498150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:00.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.688+0000 7fb49d236640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4980c5260 0x7fb498152b40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb49400d580 tx=0x7fb49400da40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:00.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.688+0000 7fb48dffb640 1 -- 172.21.15.28:0/367439708 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494014620 con 0x7fb4980c5260 2023-12-16T03:27:00.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.688+0000 7fb48dffb640 1 -- 172.21.15.28:0/367439708 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb494014780 con 0x7fb4980c5260 2023-12-16T03:27:00.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.688+0000 7fb49f49a640 1 -- 172.21.15.28:0/367439708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb498153080 con 0x7fb4980c5260 2023-12-16T03:27:00.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.688+0000 7fb48dffb640 1 -- 172.21.15.28:0/367439708 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494014b30 con 0x7fb4980c5260 2023-12-16T03:27:00.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.688+0000 7fb49f49a640 1 -- 172.21.15.28:0/367439708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4981edaa0 con 0x7fb4980c5260 2023-12-16T03:27:00.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.688+0000 7fb49f49a640 1 -- 172.21.15.28:0/367439708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb498068400 con 0x7fb4980c5260 2023-12-16T03:27:00.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.688+0000 7fb48dffb640 1 -- 172.21.15.28:0/367439708 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb494014c90 con 0x7fb4980c5260 2023-12-16T03:27:00.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.688+0000 7fb48dffb640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb47c066470 0x7fb47c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:00.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.688+0000 7fb48dffb640 1 -- 172.21.15.28:0/367439708 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb494084340 con 0x7fb4980c5260 2023-12-16T03:27:00.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.688+0000 7fb49ca35640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb47c066470 0x7fb47c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:00.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.692+0000 7fb49ca35640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb47c066470 0x7fb47c068930 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb4980a8a90 tx=0x7fb488008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:00.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.696+0000 7fb48dffb640 1 -- 172.21.15.28:0/367439708 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb494051840 con 0x7fb4980c5260 2023-12-16T03:27:00.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:00.884+0000 7fb49f49a640 1 -- 172.21.15.28:0/367439708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb49806ad40 con 0x7fb4980c5260 2023-12-16T03:27:01.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.496+0000 7fb48dffb640 1 -- 172.21.15.28:0/367439708 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb494054e60 con 0x7fb4980c5260 2023-12-16T03:27:01.509 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 8 and data pool 9 2023-12-16T03:27:01.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.520+0000 7fb49f49a640 1 -- 172.21.15.28:0/367439708 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb47c066470 msgr2=0x7fb47c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:01.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.520+0000 7fb49f49a640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb47c066470 0x7fb47c068930 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb4980a8a90 tx=0x7fb488008040 comp rx=0 tx=0).stop 2023-12-16T03:27:01.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.520+0000 7fb49f49a640 1 -- 172.21.15.28:0/367439708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4980c5260 msgr2=0x7fb498152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:01.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.520+0000 7fb49f49a640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4980c5260 0x7fb498152b40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb49400d580 tx=0x7fb49400da40 comp rx=0 tx=0).stop 2023-12-16T03:27:01.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.524+0000 7fb49f49a640 1 -- 172.21.15.28:0/367439708 shutdown_connections 2023-12-16T03:27:01.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.524+0000 7fb49f49a640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4980c60f0 0x7fb4980a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.524+0000 7fb49f49a640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb47c066470 0x7fb47c068930 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.524+0000 7fb49f49a640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4980c5640 0x7fb498150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.524+0000 7fb49f49a640 1 --2- 172.21.15.28:0/367439708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4980c5260 0x7fb498152b40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.524+0000 7fb49f49a640 1 -- 172.21.15.28:0/367439708 >> 172.21.15.28:0/367439708 conn(0x7fb49806a5b0 msgr2=0x7fb49814f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:01.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.524+0000 7fb49f49a640 1 -- 172.21.15.28:0/367439708 shutdown_connections 2023-12-16T03:27:01.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.524+0000 7fb49f49a640 1 -- 172.21.15.28:0/367439708 wait complete. 2023-12-16T03:27:01.562 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:01.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.704+0000 7efc34668640 1 Processor -- start 2023-12-16T03:27:01.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.704+0000 7efc34668640 1 -- start start 2023-12-16T03:27:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc34668640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc2c0c63c0 0x7efc2c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc34668640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efc2c0c4100 0x7efc2c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc34668640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c0c31c0 con 0x7efc2c0c29e0 2023-12-16T03:27:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc34668640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0c34a0 con 0x7efc2c0c4100 2023-12-16T03:27:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc34668640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0c1030 con 0x7efc2c0c63c0 2023-12-16T03:27:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc31c03640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efc2c0c4100 0x7efc2c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc31c03640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efc2c0c4100 0x7efc2c0c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54900/0 (socket says 172.21.15.28:54900) 2023-12-16T03:27:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc31c03640 1 -- 172.21.15.28:0/2835111460 learned_addr learned my addr 172.21.15.28:0/2835111460 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc32404640 1 --2- 172.21.15.28:0/2835111460 >> v2:172.21.15.134:3300/0 conn(0x7efc2c0c63c0 0x7efc2c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:01.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc31c03640 1 -- 172.21.15.28:0/2835111460 >> v2:172.21.15.134:3300/0 conn(0x7efc2c0c63c0 msgr2=0x7efc2c0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:01.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc31c03640 1 --2- 172.21.15.28:0/2835111460 >> v2:172.21.15.134:3300/0 conn(0x7efc2c0c63c0 0x7efc2c0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc31c03640 1 -- 172.21.15.28:0/2835111460 >> v1:172.21.15.134:6789/0 conn(0x7efc2c0c29e0 legacy=0x7efc2c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:01.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.708+0000 7efc31c03640 1 -- 172.21.15.28:0/2835111460 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0c1310 con 0x7efc2c0c4100 2023-12-16T03:27:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc31c03640 1 --2- 172.21.15.28:0/2835111460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c4100 0x7efc2c0c24a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7efc2c06e000 tx=0x7efc1c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b45b013ab62701 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc31402640 1 -- 172.21.15.28:0/2835111460 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0ac630 con 0x7efc2c0c4100 2023-12-16T03:27:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc31402640 1 -- 172.21.15.28:0/2835111460 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c0ac790 con 0x7efc2c0c4100 2023-12-16T03:27:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc31402640 1 -- 172.21.15.28:0/2835111460 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0acb20 con 0x7efc2c0c4100 2023-12-16T03:27:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 -- 172.21.15.28:0/2835111460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c4100 msgr2=0x7efc2c0c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 --2- 172.21.15.28:0/2835111460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c4100 0x7efc2c0c24a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7efc2c06e000 tx=0x7efc1c01c3b0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 -- 172.21.15.28:0/2835111460 shutdown_connections 2023-12-16T03:27:01.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 --2- 172.21.15.28:0/2835111460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c4100 0x7efc2c0c24a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 --2- 172.21.15.28:0/2835111460 >> v2:172.21.15.134:3300/0 conn(0x7efc2c0c63c0 0x7efc2c0c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 -- 172.21.15.28:0/2835111460 >> 172.21.15.28:0/2835111460 conn(0x7efc2c06a5b0 msgr2=0x7efc2c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:01.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 -- 172.21.15.28:0/2835111460 shutdown_connections 2023-12-16T03:27:01.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 -- 172.21.15.28:0/2835111460 wait complete. 2023-12-16T03:27:01.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 Processor -- start 2023-12-16T03:27:01.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 -- start start 2023-12-16T03:27:01.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c29e0 0x7efc2c1f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:01.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc2c0c4100 0x7efc2c1531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:01.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc2c0c63c0 0x7efc2c150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:01.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1f0350 con 0x7efc2c0c29e0 2023-12-16T03:27:01.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1ed940 con 0x7efc2c0c4100 2023-12-16T03:27:01.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.712+0000 7efc34668640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1f05f0 con 0x7efc2c0c63c0 2023-12-16T03:27:01.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc32404640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c29e0 0x7efc2c1f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc32404640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c29e0 0x7efc2c1f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54902/0 (socket says 172.21.15.28:54902) 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc32404640 1 -- 172.21.15.28:0/268150252 learned_addr learned my addr 172.21.15.28:0/268150252 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc31c03640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc2c0c4100 0x7efc2c1531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc32c05640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc2c0c63c0 0x7efc2c150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc32404640 1 -- 172.21.15.28:0/268150252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc2c0c63c0 msgr2=0x7efc2c150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc32404640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc2c0c63c0 0x7efc2c150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc32404640 1 -- 172.21.15.28:0/268150252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc2c0c4100 msgr2=0x7efc2c1531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc32404640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc2c0c4100 0x7efc2c1531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc32404640 1 -- 172.21.15.28:0/268150252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c0094d0 con 0x7efc2c0c29e0 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc32404640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c29e0 0x7efc2c1f0df0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efc2800e870 tx=0x7efc2800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc22ffd640 1 -- 172.21.15.28:0/268150252 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28009510 con 0x7efc2c0c29e0 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc22ffd640 1 -- 172.21.15.28:0/268150252 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2800eec0 con 0x7efc2c0c29e0 2023-12-16T03:27:01.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc34668640 1 -- 172.21.15.28:0/268150252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c1f08d0 con 0x7efc2c0c29e0 2023-12-16T03:27:01.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc22ffd640 1 -- 172.21.15.28:0/268150252 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2800cb40 con 0x7efc2c0c29e0 2023-12-16T03:27:01.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc34668640 1 -- 172.21.15.28:0/268150252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c1edc20 con 0x7efc2c0c29e0 2023-12-16T03:27:01.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc34668640 1 -- 172.21.15.28:0/268150252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c068400 con 0x7efc2c0c29e0 2023-12-16T03:27:01.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.716+0000 7efc22ffd640 1 -- 172.21.15.28:0/268150252 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7efc2800cca0 con 0x7efc2c0c29e0 2023-12-16T03:27:01.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.720+0000 7efc22ffd640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc10066470 0x7efc10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:01.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.720+0000 7efc22ffd640 1 -- 172.21.15.28:0/268150252 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc28083f10 con 0x7efc2c0c29e0 2023-12-16T03:27:01.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.720+0000 7efc31c03640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc10066470 0x7efc10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:01.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.720+0000 7efc31c03640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc10066470 0x7efc10068930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0ae000 tx=0x7efc1c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:01.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.724+0000 7efc22ffd640 1 -- 172.21.15.28:0/268150252 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7efc28051430 con 0x7efc2c0c29e0 2023-12-16T03:27:01.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.880+0000 7efc34668640 1 -- 172.21.15.28:0/268150252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc2c1f0a60 con 0x7efc2c0c29e0 2023-12-16T03:27:01.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.880+0000 7efc22ffd640 1 -- 172.21.15.28:0/268150252 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16578 (secure 0 0 0) 0x7efc28054a50 con 0x7efc2c0c29e0 2023-12-16T03:27:01.885 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:01.885 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":49,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:00.887655+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:01.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 -- 172.21.15.28:0/268150252 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc10066470 msgr2=0x7efc10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:01.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc10066470 0x7efc10068930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0ae000 tx=0x7efc1c008040 comp rx=0 tx=0).stop 2023-12-16T03:27:01.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 -- 172.21.15.28:0/268150252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c29e0 msgr2=0x7efc2c1f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:01.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c29e0 0x7efc2c1f0df0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efc2800e870 tx=0x7efc2800ec70 comp rx=0 tx=0).stop 2023-12-16T03:27:01.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 -- 172.21.15.28:0/268150252 shutdown_connections 2023-12-16T03:27:01.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc2c0c63c0 0x7efc2c150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc2c0c4100 0x7efc2c1531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc10066470 0x7efc10068930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 --2- 172.21.15.28:0/268150252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c29e0 0x7efc2c1f0df0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:01.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 -- 172.21.15.28:0/268150252 >> 172.21.15.28:0/268150252 conn(0x7efc2c06a5b0 msgr2=0x7efc2c15b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:01.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 -- 172.21.15.28:0/268150252 shutdown_connections 2023-12-16T03:27:01.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:01.884+0000 7efc34668640 1 -- 172.21.15.28:0/268150252 wait complete. 2023-12-16T03:27:01.906 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:02.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2cea1aa640 1 Processor -- start 2023-12-16T03:27:02.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2cea1aa640 1 -- start start 2023-12-16T03:27:02.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2cea1aa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2ce40af730 0x7f2ce40c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2cea1aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ce4155240 0x7f2ce406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2cea1aa640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce41521b0 con 0x7f2ce40c7eb0 2023-12-16T03:27:02.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2cea1aa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40c73d0 con 0x7f2ce40af730 2023-12-16T03:27:02.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2cea1aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40c6f00 con 0x7f2ce4155240 2023-12-16T03:27:02.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2ce37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2ce40af730 0x7f2ce40c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2ce37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2ce40af730 0x7f2ce40c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54904/0 (socket says 172.21.15.28:54904) 2023-12-16T03:27:02.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2ce37fe640 1 -- 172.21.15.28:0/3980566005 learned_addr learned my addr 172.21.15.28:0/3980566005 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:02.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2ce3fff640 1 --1- 172.21.15.28:0/3980566005 >> v1:172.21.15.28:6789/0 conn(0x7f2ce40c7eb0 0x7f2ce40c4930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57770/0 (socket says 172.21.15.28:57770) 2023-12-16T03:27:02.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2ce2ffd640 1 --2- 172.21.15.28:0/3980566005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ce4155240 0x7f2ce406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2ce37fe640 1 -- 172.21.15.28:0/3980566005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ce4155240 msgr2=0x7f2ce406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:02.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2ce37fe640 1 --2- 172.21.15.28:0/3980566005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ce4155240 0x7f2ce406c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2ce37fe640 1 -- 172.21.15.28:0/3980566005 >> v1:172.21.15.28:6789/0 conn(0x7f2ce40c7eb0 legacy=0x7f2ce40c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:02.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.048+0000 7f2ce37fe640 1 -- 172.21.15.28:0/3980566005 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce41556c0 con 0x7f2ce40af730 2023-12-16T03:27:02.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2ce37fe640 1 --2- 172.21.15.28:0/3980566005 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ce40af730 0x7f2ce40c69c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009870 tx=0x7f2cd401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ed6a98562ff05f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:02.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2ce27fc640 1 -- 172.21.15.28:0/3980566005 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40ab620 con 0x7f2ce40af730 2023-12-16T03:27:02.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2ce27fc640 1 -- 172.21.15.28:0/3980566005 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd40ab780 con 0x7f2ce40af730 2023-12-16T03:27:02.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2ce27fc640 1 -- 172.21.15.28:0/3980566005 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40abb10 con 0x7f2ce40af730 2023-12-16T03:27:02.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2cea1aa640 1 -- 172.21.15.28:0/3980566005 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ce40af730 msgr2=0x7f2ce40c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:02.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2cea1aa640 1 --2- 172.21.15.28:0/3980566005 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ce40af730 0x7f2ce40c69c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009870 tx=0x7f2cd401c420 comp rx=0 tx=0).stop 2023-12-16T03:27:02.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2cea1aa640 1 -- 172.21.15.28:0/3980566005 shutdown_connections 2023-12-16T03:27:02.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2cea1aa640 1 --2- 172.21.15.28:0/3980566005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ce4155240 0x7f2ce406c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2cea1aa640 1 --2- 172.21.15.28:0/3980566005 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ce40af730 0x7f2ce40c69c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2cea1aa640 1 -- 172.21.15.28:0/3980566005 >> 172.21.15.28:0/3980566005 conn(0x7f2ce40ca180 msgr2=0x7f2ce40ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:02.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2cea1aa640 1 -- 172.21.15.28:0/3980566005 shutdown_connections 2023-12-16T03:27:02.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.052+0000 7f2cea1aa640 1 -- 172.21.15.28:0/3980566005 wait complete. 2023-12-16T03:27:02.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2cea1aa640 1 Processor -- start 2023-12-16T03:27:02.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2cea1aa640 1 -- start start 2023-12-16T03:27:02.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2cea1aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ce40af730 0x7f2ce4149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2cea1aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce40c7eb0 0x7f2ce415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2cea1aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ce4155240 0x7f2ce414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2cea1aa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40c3aa0 con 0x7f2ce40af730 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2cea1aa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce414a9f0 con 0x7f2ce40c7eb0 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2cea1aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce415e9a0 con 0x7f2ce4155240 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ce37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ce40af730 0x7f2ce4149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ce37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ce40af730 0x7f2ce4149800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54918/0 (socket says 172.21.15.28:54918) 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ce37fe640 1 -- 172.21.15.28:0/981657453 learned_addr learned my addr 172.21.15.28:0/981657453 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ce2ffd640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce40c7eb0 0x7f2ce415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ce3fff640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ce4155240 0x7f2ce414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ce37fe640 1 -- 172.21.15.28:0/981657453 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ce4155240 msgr2=0x7f2ce414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ce37fe640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ce4155240 0x7f2ce414b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ce37fe640 1 -- 172.21.15.28:0/981657453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce40c7eb0 msgr2=0x7f2ce415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ce37fe640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce40c7eb0 0x7f2ce415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ce37fe640 1 -- 172.21.15.28:0/981657453 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40094d0 con 0x7f2ce40af730 2023-12-16T03:27:02.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ce37fe640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ce40af730 0x7f2ce4149800 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40ad040 tx=0x7f2cd401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:02.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ccbfff640 1 -- 172.21.15.28:0/981657453 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40abe40 con 0x7f2ce40af730 2023-12-16T03:27:02.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ccbfff640 1 -- 172.21.15.28:0/981657453 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd40be3f0 con 0x7f2ce40af730 2023-12-16T03:27:02.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2ccbfff640 1 -- 172.21.15.28:0/981657453 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40be7a0 con 0x7f2ce40af730 2023-12-16T03:27:02.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2cea1aa640 1 -- 172.21.15.28:0/981657453 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce4149de0 con 0x7f2ce40af730 2023-12-16T03:27:02.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.056+0000 7f2cea1aa640 1 -- 172.21.15.28:0/981657453 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce414a3a0 con 0x7f2ce40af730 2023-12-16T03:27:02.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.060+0000 7f2cea1aa640 1 -- 172.21.15.28:0/981657453 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce4066df0 con 0x7f2ce40af730 2023-12-16T03:27:02.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.060+0000 7f2ccbfff640 1 -- 172.21.15.28:0/981657453 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2cd40b43f0 con 0x7f2ce40af730 2023-12-16T03:27:02.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.060+0000 7f2ccbfff640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2cd0066470 0x7f2cd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.060+0000 7f2ccbfff640 1 -- 172.21.15.28:0/981657453 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cd411e720 con 0x7f2ce40af730 2023-12-16T03:27:02.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.060+0000 7f2ce2ffd640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2cd0066470 0x7f2cd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.060+0000 7f2ce2ffd640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2cd0066470 0x7f2cd0068930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40c5f80 tx=0x7f2cd8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:02.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.064+0000 7f2ccbfff640 1 -- 172.21.15.28:0/981657453 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2cd40ebc40 con 0x7f2ce40af730 2023-12-16T03:27:02.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.224+0000 7f2cea1aa640 1 -- 172.21.15.28:0/981657453 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ce404e930 con 0x7f2ce40af730 2023-12-16T03:27:02.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.224+0000 7f2ccbfff640 1 -- 172.21.15.28:0/981657453 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16578 (secure 0 0 0) 0x7f2cd40ef260 con 0x7f2ce40af730 2023-12-16T03:27:02.228 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:02.228 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":49,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:00.887655+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 -- 172.21.15.28:0/981657453 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2cd0066470 msgr2=0x7f2cd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2cd0066470 0x7f2cd0068930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40c5f80 tx=0x7f2cd8009190 comp rx=0 tx=0).stop 2023-12-16T03:27:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 -- 172.21.15.28:0/981657453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ce40af730 msgr2=0x7f2ce4149800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ce40af730 0x7f2ce4149800 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40ad040 tx=0x7f2cd401ac60 comp rx=0 tx=0).stop 2023-12-16T03:27:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 -- 172.21.15.28:0/981657453 shutdown_connections 2023-12-16T03:27:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ce4155240 0x7f2ce414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce40c7eb0 0x7f2ce415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2cd0066470 0x7f2cd0068930 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 --2- 172.21.15.28:0/981657453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ce40af730 0x7f2ce4149800 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 -- 172.21.15.28:0/981657453 >> 172.21.15.28:0/981657453 conn(0x7f2ce40ca180 msgr2=0x7f2ce40c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:02.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 -- 172.21.15.28:0/981657453 shutdown_connections 2023-12-16T03:27:02.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.228+0000 7f2cea1aa640 1 -- 172.21.15.28:0/981657453 wait complete. 2023-12-16T03:27:02.250 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-16T03:27:02.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.392+0000 7f265a232640 1 Processor -- start 2023-12-16T03:27:02.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.392+0000 7f265a232640 1 -- start start 2023-12-16T03:27:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f265a232640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540a5370 0x7f26540c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f265a232640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f26540c4110 0x7f2654150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f265a232640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26540c2760 con 0x7f2654072090 2023-12-16T03:27:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f265a232640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26540c3070 con 0x7f26540c4110 2023-12-16T03:27:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f265a232640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2654151bf0 con 0x7f26540a5370 2023-12-16T03:27:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f2653fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2654072090 0x7f26541514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57780/0 (socket says 172.21.15.28:57780) 2023-12-16T03:27:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f2653fff640 1 -- 172.21.15.28:0/612675848 learned_addr learned my addr 172.21.15.28:0/612675848 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f26537fe640 1 --2- 172.21.15.28:0/612675848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540a5370 0x7f26540c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f2652ffd640 1 --2- 172.21.15.28:0/612675848 >> v2:172.21.15.134:3300/0 conn(0x7f26540c4110 0x7f2654150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f26527fc640 1 -- 172.21.15.28:0/612675848 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118069819 0 0) 0x7f26540c2760 con 0x7f2654072090 2023-12-16T03:27:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f26527fc640 1 -- 172.21.15.28:0/612675848 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f263c003530 con 0x7f2654072090 2023-12-16T03:27:02.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f26537fe640 1 -- 172.21.15.28:0/612675848 >> v2:172.21.15.134:3300/0 conn(0x7f26540c4110 msgr2=0x7f2654150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:02.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f26537fe640 1 --2- 172.21.15.28:0/612675848 >> v2:172.21.15.134:3300/0 conn(0x7f26540c4110 0x7f2654150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f26537fe640 1 -- 172.21.15.28:0/612675848 >> v1:172.21.15.28:6789/0 conn(0x7f2654072090 legacy=0x7f26541514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:02.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.396+0000 7f26537fe640 1 -- 172.21.15.28:0/612675848 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26540a5750 con 0x7f26540a5370 2023-12-16T03:27:02.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f26537fe640 1 --2- 172.21.15.28:0/612675848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540a5370 0x7f26540c3bd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f26440097c0 tx=0x7f264401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=348c53877f4f34de server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:02.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f26527fc640 1 -- 172.21.15.28:0/612675848 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440ab600 con 0x7f26540a5370 2023-12-16T03:27:02.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f26527fc640 1 -- 172.21.15.28:0/612675848 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26440a7050 con 0x7f26540a5370 2023-12-16T03:27:02.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f26527fc640 1 -- 172.21.15.28:0/612675848 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440ab980 con 0x7f26540a5370 2023-12-16T03:27:02.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 -- 172.21.15.28:0/612675848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540a5370 msgr2=0x7f26540c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:02.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 --2- 172.21.15.28:0/612675848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540a5370 0x7f26540c3bd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f26440097c0 tx=0x7f264401c330 comp rx=0 tx=0).stop 2023-12-16T03:27:02.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 -- 172.21.15.28:0/612675848 shutdown_connections 2023-12-16T03:27:02.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 --2- 172.21.15.28:0/612675848 >> v2:172.21.15.134:3300/0 conn(0x7f26540c4110 0x7f2654150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 --2- 172.21.15.28:0/612675848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540a5370 0x7f26540c3bd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 -- 172.21.15.28:0/612675848 >> 172.21.15.28:0/612675848 conn(0x7f265406a5b0 msgr2=0x7f265406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:02.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 -- 172.21.15.28:0/612675848 shutdown_connections 2023-12-16T03:27:02.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 -- 172.21.15.28:0/612675848 wait complete. 2023-12-16T03:27:02.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 Processor -- start 2023-12-16T03:27:02.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 -- start start 2023-12-16T03:27:02.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2654072090 0x7f26541edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26540a5370 0x7f26540bf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540c4110 0x7f2654150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2654145e80 con 0x7f2654072090 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26541ee050 con 0x7f26540a5370 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.400+0000 7f265a232640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26541f0690 con 0x7f26540c4110 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f26537fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2654072090 0x7f26541edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f26537fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2654072090 0x7f26541edb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54934/0 (socket says 172.21.15.28:54934) 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f26537fe640 1 -- 172.21.15.28:0/2710852880 learned_addr learned my addr 172.21.15.28:0/2710852880 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f2652ffd640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26540a5370 0x7f26540bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f2653fff640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540c4110 0x7f2654150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f26537fe640 1 -- 172.21.15.28:0/2710852880 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540c4110 msgr2=0x7f2654150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f26537fe640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540c4110 0x7f2654150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f26537fe640 1 -- 172.21.15.28:0/2710852880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26540a5370 msgr2=0x7f26540bf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f26537fe640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26540a5370 0x7f26540bf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:02.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f26537fe640 1 -- 172.21.15.28:0/2710852880 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644009420 con 0x7f2654072090 2023-12-16T03:27:02.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f2653fff640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540c4110 0x7f2654150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:02.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f26537fe640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2654072090 0x7f26541edb10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f26440ae040 tx=0x7f264401ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:02.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f263bfff640 1 -- 172.21.15.28:0/2710852880 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440b7450 con 0x7f2654072090 2023-12-16T03:27:02.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f263bfff640 1 -- 172.21.15.28:0/2710852880 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26440b75b0 con 0x7f2654072090 2023-12-16T03:27:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f265a232640 1 -- 172.21.15.28:0/2710852880 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2654146eb0 con 0x7f2654072090 2023-12-16T03:27:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f263bfff640 1 -- 172.21.15.28:0/2710852880 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440b7960 con 0x7f2654072090 2023-12-16T03:27:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f265a232640 1 -- 172.21.15.28:0/2710852880 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265415ea30 con 0x7f2654072090 2023-12-16T03:27:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f265a232640 1 -- 172.21.15.28:0/2710852880 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2654068400 con 0x7f2654072090 2023-12-16T03:27:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f263bfff640 1 -- 172.21.15.28:0/2710852880 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f26440b7ac0 con 0x7f2654072090 2023-12-16T03:27:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.404+0000 7f263bfff640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2640066470 0x7f2640068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.408+0000 7f263bfff640 1 -- 172.21.15.28:0/2710852880 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f264411e570 con 0x7f2654072090 2023-12-16T03:27:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.408+0000 7f2652ffd640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2640066470 0x7f2640068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.408+0000 7f2652ffd640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2640066470 0x7f2640068930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2654155260 tx=0x7f2648009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:02.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.408+0000 7f263bfff640 1 -- 172.21.15.28:0/2710852880 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f26440eb9e0 con 0x7f2654072090 2023-12-16T03:27:02.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:02.604+0000 7f265a232640 1 -- 172.21.15.28:0/2710852880 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f26540c6780 con 0x7f2654072090 2023-12-16T03:27:03.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f263bfff640 1 -- 172.21.15.28:0/2710852880 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f26440ef000 con 0x7f2654072090 2023-12-16T03:27:03.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 -- 172.21.15.28:0/2710852880 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2640066470 msgr2=0x7f2640068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:03.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2640066470 0x7f2640068930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2654155260 tx=0x7f2648009190 comp rx=0 tx=0).stop 2023-12-16T03:27:03.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 -- 172.21.15.28:0/2710852880 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2654072090 msgr2=0x7f26541edb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:03.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2654072090 0x7f26541edb10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f26440ae040 tx=0x7f264401ab70 comp rx=0 tx=0).stop 2023-12-16T03:27:03.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 -- 172.21.15.28:0/2710852880 shutdown_connections 2023-12-16T03:27:03.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f26540c4110 0x7f2654150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:03.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26540a5370 0x7f26540bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:03.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2640066470 0x7f2640068930 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:03.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 --2- 172.21.15.28:0/2710852880 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2654072090 0x7f26541edb10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:03.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 -- 172.21.15.28:0/2710852880 >> 172.21.15.28:0/2710852880 conn(0x7f265406a5b0 msgr2=0x7f26540c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:03.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 -- 172.21.15.28:0/2710852880 shutdown_connections 2023-12-16T03:27:03.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.524+0000 7f265a232640 1 -- 172.21.15.28:0/2710852880 wait complete. 2023-12-16T03:27:03.551 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-16T03:27:03.551 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-16T03:27:03.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.696+0000 7f6e0fed6640 1 Processor -- start 2023-12-16T03:27:03.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.696+0000 7f6e0fed6640 1 -- start start 2023-12-16T03:27:03.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.696+0000 7f6e0fed6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e080c4100 0x7f6e080c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:03.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.696+0000 7f6e0fed6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e080c31c0 con 0x7f6e080c63c0 2023-12-16T03:27:03.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.696+0000 7f6e0fed6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e080c34a0 con 0x7f6e080c06d0 2023-12-16T03:27:03.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.696+0000 7f6e0fed6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e080c1030 con 0x7f6e080c4100 2023-12-16T03:27:03.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0dc72640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6e080c63c0 0x7f6e080c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57792/0 (socket says 172.21.15.28:57792) 2023-12-16T03:27:03.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0dc72640 1 -- 172.21.15.28:0/4267154855 learned_addr learned my addr 172.21.15.28:0/4267154855 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:03.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0d471640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e080c4100 0x7f6e080c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:03.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848922525 0 0) 0x7f6e080c31c0 con 0x7f6e080c63c0 2023-12-16T03:27:03.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6df4003530 con 0x7f6e080c63c0 2023-12-16T03:27:03.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315758213 0 0) 0x7f6e080c34a0 con 0x7f6e080c06d0 2023-12-16T03:27:03.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e080c31c0 con 0x7f6e080c06d0 2023-12-16T03:27:03.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4206698579 0 0) 0x7f6df4003530 con 0x7f6e080c63c0 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e080c4100 msgr2=0x7f6e080c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e080c4100 0x7f6e080c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 >> v1:172.21.15.134:6789/0 conn(0x7f6e080c06d0 legacy=0x7f6e080a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e080c1310 con 0x7f6e080c63c0 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f6e04001680 con 0x7f6e080c63c0 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 >> v1:172.21.15.28:6789/0 conn(0x7f6e080c63c0 legacy=0x7f6e080c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df4003b40 0x7f6df4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df40047d0 0x7f6df4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df40051e0 0x7f6df400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e080c1030 con 0x7f6df40047d0 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df400c110 con 0x7f6df40051e0 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df400c2d0 con 0x7f6df4003b40 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0d471640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6e080c4100 0x7f6e080c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:03.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0dc72640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df4003b40 0x7f6df4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:03.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0e473640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df40051e0 0x7f6df400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:03.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0d471640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df40047d0 0x7f6df4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:03.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0dc72640 1 -- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df40051e0 msgr2=0x7f6df400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:03.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0dc72640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df40051e0 0x7f6df400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:03.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0dc72640 1 -- 172.21.15.28:0/4267154855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df40047d0 msgr2=0x7f6df4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:03.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0dc72640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df40047d0 0x7f6df4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:03.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0dc72640 1 -- 172.21.15.28:0/4267154855 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df4003530 con 0x7f6df4003b40 2023-12-16T03:27:03.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.700+0000 7f6e0d471640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df40047d0 0x7f6df4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:03.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0dc72640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df4003b40 0x7f6df4003f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6e04007fb0 tx=0x7f6e0401cb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b16190a8334f027 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:03.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04005ae0 con 0x7f6df4003b40 2023-12-16T03:27:03.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e04005c40 con 0x7f6df4003b40 2023-12-16T03:27:03.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0cc70640 1 -- 172.21.15.28:0/4267154855 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e040072b0 con 0x7f6df4003b40 2023-12-16T03:27:03.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0fed6640 1 -- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df4003b40 msgr2=0x7f6df4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:03.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0fed6640 1 --2- 172.21.15.28:0/4267154855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df4003b40 0x7f6df4003f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6e04007fb0 tx=0x7f6e0401cb20 comp rx=0 tx=0).stop 2023-12-16T03:27:03.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0e473640 1 -- 172.21.15.28:0/4267154855 reap_dead start 2023-12-16T03:27:03.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0fed6640 1 -- 172.21.15.28:0/4267154855 shutdown_connections 2023-12-16T03:27:03.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0fed6640 1 -- 172.21.15.28:0/4267154855 >> 172.21.15.28:0/4267154855 conn(0x7f6e0806a5b0 msgr2=0x7f6e0806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:03.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0fed6640 1 -- 172.21.15.28:0/4267154855 shutdown_connections 2023-12-16T03:27:03.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0fed6640 1 -- 172.21.15.28:0/4267154855 wait complete. 2023-12-16T03:27:03.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0fed6640 1 Processor -- start 2023-12-16T03:27:03.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.704+0000 7f6e0fed6640 1 -- start start 2023-12-16T03:27:03.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0fed6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df4003b40 0x7f6e080bb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:03.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0fed6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e080c02c0 0x7f6e081ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:03.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0fed6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e081ed680 0x7f6e08071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:03.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0fed6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e080bbe40 con 0x7f6e081ed680 2023-12-16T03:27:03.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0fed6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e081ec9d0 con 0x7f6e080c02c0 2023-12-16T03:27:03.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0fed6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e080bc090 con 0x7f6df4003b40 2023-12-16T03:27:03.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0e473640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e081ed680 0x7f6e08071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:03.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0e473640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e081ed680 0x7f6e08071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54956/0 (socket says 172.21.15.28:54956) 2023-12-16T03:27:03.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0e473640 1 -- 172.21.15.28:0/3868819201 learned_addr learned my addr 172.21.15.28:0/3868819201 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:03.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0dc72640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df4003b40 0x7f6e080bb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:03.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0d471640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e080c02c0 0x7f6e081ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:03.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0e473640 1 -- 172.21.15.28:0/3868819201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df4003b40 msgr2=0x7f6e080bb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:03.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0e473640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df4003b40 0x7f6e080bb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:03.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0e473640 1 -- 172.21.15.28:0/3868819201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e080c02c0 msgr2=0x7f6e081ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:03.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0e473640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e080c02c0 0x7f6e081ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:03.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0e473640 1 -- 172.21.15.28:0/3868819201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e080c69b0 con 0x7f6e081ed680 2023-12-16T03:27:03.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0e473640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e081ed680 0x7f6e08071230 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6e080ab3d0 tx=0x7f6e0000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:03.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6dfe7fc640 1 -- 172.21.15.28:0/3868819201 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000fe50 con 0x7f6e081ed680 2023-12-16T03:27:03.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6dfe7fc640 1 -- 172.21.15.28:0/3868819201 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e00003980 con 0x7f6e081ed680 2023-12-16T03:27:03.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6dfe7fc640 1 -- 172.21.15.28:0/3868819201 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00003d30 con 0x7f6e081ed680 2023-12-16T03:27:03.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0fed6640 1 -- 172.21.15.28:0/3868819201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e080bc370 con 0x7f6e081ed680 2023-12-16T03:27:03.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0fed6640 1 -- 172.21.15.28:0/3868819201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e080bd160 con 0x7f6e081ed680 2023-12-16T03:27:03.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6e0fed6640 1 -- 172.21.15.28:0/3868819201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e08068400 con 0x7f6e081ed680 2023-12-16T03:27:03.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.708+0000 7f6dfe7fc640 1 -- 172.21.15.28:0/3868819201 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6e000050d0 con 0x7f6e081ed680 2023-12-16T03:27:03.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.712+0000 7f6dfe7fc640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dec066470 0x7f6dec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:03.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.712+0000 7f6dfe7fc640 1 -- 172.21.15.28:0/3868819201 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e00086270 con 0x7f6e081ed680 2023-12-16T03:27:03.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.712+0000 7f6e0dc72640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dec066470 0x7f6dec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:03.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.712+0000 7f6e0dc72640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dec066470 0x7f6dec068930 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6e04007f80 tx=0x7f6e04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.716+0000 7f6dfe7fc640 1 -- 172.21.15.28:0/3868819201 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6e00053780 con 0x7f6e081ed680 2023-12-16T03:27:03.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:03.908+0000 7f6e0fed6640 1 -- 172.21.15.28:0/3868819201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6e081ecdf0 con 0x7f6e081ed680 2023-12-16T03:27:04.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.528+0000 7f6dfe7fc640 1 -- 172.21.15.28:0/3868819201 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6e00056da0 con 0x7f6e081ed680 2023-12-16T03:27:04.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 -- 172.21.15.28:0/3868819201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dec066470 msgr2=0x7f6dec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:04.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dec066470 0x7f6dec068930 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6e04007f80 tx=0x7f6e04009040 comp rx=0 tx=0).stop 2023-12-16T03:27:04.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 -- 172.21.15.28:0/3868819201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e081ed680 msgr2=0x7f6e08071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:04.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e081ed680 0x7f6e08071230 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6e080ab3d0 tx=0x7f6e0000f520 comp rx=0 tx=0).stop 2023-12-16T03:27:04.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 -- 172.21.15.28:0/3868819201 shutdown_connections 2023-12-16T03:27:04.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dec066470 0x7f6dec068930 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e081ed680 0x7f6e08071230 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e080c02c0 0x7f6e081ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 --2- 172.21.15.28:0/3868819201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df4003b40 0x7f6e080bb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 -- 172.21.15.28:0/3868819201 >> 172.21.15.28:0/3868819201 conn(0x7f6e0806a5b0 msgr2=0x7f6e0806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:04.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 -- 172.21.15.28:0/3868819201 shutdown_connections 2023-12-16T03:27:04.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.532+0000 7f6e0fed6640 1 -- 172.21.15.28:0/3868819201 wait complete. 2023-12-16T03:27:04.555 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-16T03:27:04.555 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:27:04.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.696+0000 7f534e9f8640 1 Processor -- start 2023-12-16T03:27:04.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.696+0000 7f534e9f8640 1 -- start start 2023-12-16T03:27:04.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f534e9f8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f53480a7520 0x7f53480c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:04.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f534e9f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53480c6900 0x7f5348155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:04.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f534e9f8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f53480c30c0 0x7f53480c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:04.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f534e9f8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53480c1f80 con 0x7f53480a7520 2023-12-16T03:27:04.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f534e9f8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53480c7480 con 0x7f53480c30c0 2023-12-16T03:27:04.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f534e9f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53480a7900 con 0x7f53480c6900 2023-12-16T03:27:04.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f5347fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f53480a7520 0x7f53480c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:04.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f5347fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f53480a7520 0x7f53480c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54962/0 (socket says 172.21.15.28:54962) 2023-12-16T03:27:04.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f5347fff640 1 -- 172.21.15.28:0/68619455 learned_addr learned my addr 172.21.15.28:0/68619455 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:04.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f5347fff640 1 -- 172.21.15.28:0/68619455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53480c6900 msgr2=0x7f5348155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:04.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f5347fff640 1 --2- 172.21.15.28:0/68619455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53480c6900 0x7f5348155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f5347fff640 1 -- 172.21.15.28:0/68619455 >> v2:172.21.15.134:3300/0 conn(0x7f53480c30c0 msgr2=0x7f53480c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:04.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f5347fff640 1 --2- 172.21.15.28:0/68619455 >> v2:172.21.15.134:3300/0 conn(0x7f53480c30c0 0x7f53480c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.700+0000 7f5347fff640 1 -- 172.21.15.28:0/68619455 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480c60d0 con 0x7f53480a7520 2023-12-16T03:27:04.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f5347fff640 1 --2- 172.21.15.28:0/68619455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53480a7520 0x7f53480c6f40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f53480672f0 tx=0x7f533801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3007bc67d7d1fae server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:04.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f5346ffd640 1 -- 172.21.15.28:0/68619455 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380ab600 con 0x7f53480a7520 2023-12-16T03:27:04.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f5346ffd640 1 -- 172.21.15.28:0/68619455 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53380a7050 con 0x7f53480a7520 2023-12-16T03:27:04.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f5346ffd640 1 -- 172.21.15.28:0/68619455 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380ab980 con 0x7f53480a7520 2023-12-16T03:27:04.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 -- 172.21.15.28:0/68619455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53480a7520 msgr2=0x7f53480c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:04.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 --2- 172.21.15.28:0/68619455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53480a7520 0x7f53480c6f40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f53480672f0 tx=0x7f533801c470 comp rx=0 tx=0).stop 2023-12-16T03:27:04.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 -- 172.21.15.28:0/68619455 shutdown_connections 2023-12-16T03:27:04.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 --2- 172.21.15.28:0/68619455 >> v2:172.21.15.134:3300/0 conn(0x7f53480c30c0 0x7f53480c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 --2- 172.21.15.28:0/68619455 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53480c6900 0x7f5348155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 --2- 172.21.15.28:0/68619455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53480a7520 0x7f53480c6f40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 -- 172.21.15.28:0/68619455 >> 172.21.15.28:0/68619455 conn(0x7f53480a9b80 msgr2=0x7f53480a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:04.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 -- 172.21.15.28:0/68619455 shutdown_connections 2023-12-16T03:27:04.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 -- 172.21.15.28:0/68619455 wait complete. 2023-12-16T03:27:04.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 Processor -- start 2023-12-16T03:27:04.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 -- start start 2023-12-16T03:27:04.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53480a7520 0x7f534815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53480c30c0 0x7f53481590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53480c6900 0x7f5348155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348154580 con 0x7f53480a7520 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348154840 con 0x7f53480c30c0 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.704+0000 7f534e9f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5348154b20 con 0x7f53480c6900 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5347fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53480a7520 0x7f534815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5347fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53480a7520 0x7f534815b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54964/0 (socket says 172.21.15.28:54964) 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5347fff640 1 -- 172.21.15.28:0/1917513790 learned_addr learned my addr 172.21.15.28:0/1917513790 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f53477fe640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53480c30c0 0x7f53481590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f534cf95640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53480c6900 0x7f5348155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5347fff640 1 -- 172.21.15.28:0/1917513790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53480c6900 msgr2=0x7f5348155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5347fff640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53480c6900 0x7f5348155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5347fff640 1 -- 172.21.15.28:0/1917513790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53480c30c0 msgr2=0x7f53481590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5347fff640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53480c30c0 0x7f53481590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5347fff640 1 -- 172.21.15.28:0/1917513790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53380094d0 con 0x7f53480a7520 2023-12-16T03:27:04.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5347fff640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53480a7520 0x7f534815b4c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f53380ae040 tx=0x7f533801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:04.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5344ff9640 1 -- 172.21.15.28:0/1917513790 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380b6620 con 0x7f53480a7520 2023-12-16T03:27:04.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5344ff9640 1 -- 172.21.15.28:0/1917513790 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53380b67a0 con 0x7f53480a7520 2023-12-16T03:27:04.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5344ff9640 1 -- 172.21.15.28:0/1917513790 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380b6b50 con 0x7f53480a7520 2023-12-16T03:27:04.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f534e9f8640 1 -- 172.21.15.28:0/1917513790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5348154e00 con 0x7f53480a7520 2023-12-16T03:27:04.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f534e9f8640 1 -- 172.21.15.28:0/1917513790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534815ba00 con 0x7f53480a7520 2023-12-16T03:27:04.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f534e9f8640 1 -- 172.21.15.28:0/1917513790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5348068400 con 0x7f53480a7520 2023-12-16T03:27:04.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.708+0000 7f5344ff9640 1 -- 172.21.15.28:0/1917513790 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f53380b2040 con 0x7f53480a7520 2023-12-16T03:27:04.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.712+0000 7f5344ff9640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5334066470 0x7f5334068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:04.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.712+0000 7f5344ff9640 1 -- 172.21.15.28:0/1917513790 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f533811e310 con 0x7f53480a7520 2023-12-16T03:27:04.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.712+0000 7f53477fe640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5334066470 0x7f5334068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:04.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.712+0000 7f53477fe640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5334066470 0x7f5334068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f53481543b0 tx=0x7f533c009110 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:04.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.716+0000 7f5344ff9640 1 -- 172.21.15.28:0/1917513790 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f53380eb830 con 0x7f53480a7520 2023-12-16T03:27:04.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.904+0000 7f534e9f8640 1 -- 172.21.15.28:0/1917513790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53480ad150 con 0x7f53480a7520 2023-12-16T03:27:04.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f5344ff9640 1 -- 172.21.15.28:0/1917513790 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f53380eee50 con 0x7f53480a7520 2023-12-16T03:27:04.910 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:04.910 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3665146461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":3665146461},{"type":"v1","addr":"172.21.15.28:6837","nonce":3665146461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1938417336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1938417336},{"type":"v1","addr":"172.21.15.134:6835","nonce":1938417336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4009894510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4009894510},{"type":"v1","addr":"172.21.15.134:6834","nonce":4009894510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:00.888034+0000","modified":"2023-12-16T03:27:03.912013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/3717643902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3717643902},{"type":"v1","addr":"172.21.15.28:6836","nonce":3717643902}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-16T03:27:04.910 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 32 2023-12-16T03:27:04.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 -- 172.21.15.28:0/1917513790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5334066470 msgr2=0x7f5334068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:04.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5334066470 0x7f5334068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f53481543b0 tx=0x7f533c009110 comp rx=0 tx=0).stop 2023-12-16T03:27:04.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 -- 172.21.15.28:0/1917513790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53480a7520 msgr2=0x7f534815b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53480a7520 0x7f534815b4c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f53380ae040 tx=0x7f533801acb0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 -- 172.21.15.28:0/1917513790 shutdown_connections 2023-12-16T03:27:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53480c6900 0x7f5348155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53480c30c0 0x7f53481590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5334066470 0x7f5334068930 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 --2- 172.21.15.28:0/1917513790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53480a7520 0x7f534815b4c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 -- 172.21.15.28:0/1917513790 >> 172.21.15.28:0/1917513790 conn(0x7f53480a9b80 msgr2=0x7f53480c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 -- 172.21.15.28:0/1917513790 shutdown_connections 2023-12-16T03:27:04.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:04.908+0000 7f534e9f8640 1 -- 172.21.15.28:0/1917513790 wait complete. 2023-12-16T03:27:04.931 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:05.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0359e640 1 Processor -- start 2023-12-16T03:27:05.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0359e640 1 -- start start 2023-12-16T03:27:05.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0359e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fce04151cd0 0x7fce040ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce040c7c50 0x7fce041544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0359e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce040c8160 con 0x7fce040ca9a0 2023-12-16T03:27:05.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0359e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce04157b40 con 0x7fce04151cd0 2023-12-16T03:27:05.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0359e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce04157e20 con 0x7fce040c7c50 2023-12-16T03:27:05.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce01d9b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce040c7c50 0x7fce041544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0259c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fce04151cd0 0x7fce040ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce01d9b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce040c7c50 0x7fce041544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:40702/0 (socket says 172.21.15.28:40702) 2023-12-16T03:27:05.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0259c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fce04151cd0 0x7fce040ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:55394/0 (socket says 172.21.15.28:55394) 2023-12-16T03:27:05.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce01d9b640 1 -- 172.21.15.28:0/2704542464 learned_addr learned my addr 172.21.15.28:0/2704542464 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:05.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce02d9d640 1 --1- 172.21.15.28:0/2704542464 >> v1:172.21.15.134:6789/0 conn(0x7fce040ca9a0 0x7fce0406b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:50798/0 (socket says 172.21.15.28:50798) 2023-12-16T03:27:05.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0259c640 1 -- 172.21.15.28:0/2704542464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce040c7c50 msgr2=0x7fce041544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:05.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0259c640 1 --2- 172.21.15.28:0/2704542464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce040c7c50 0x7fce041544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0259c640 1 -- 172.21.15.28:0/2704542464 >> v1:172.21.15.134:6789/0 conn(0x7fce040ca9a0 legacy=0x7fce0406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0259c640 1 -- 172.21.15.28:0/2704542464 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04158100 con 0x7fce04151cd0 2023-12-16T03:27:05.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce01d9b640 1 --2- 172.21.15.28:0/2704542464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce040c7c50 0x7fce041544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:05.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.072+0000 7fce0159a640 1 -- 172.21.15.28:0/2704542464 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487833111 0 0) 0x7fce040c8160 con 0x7fce040ca9a0 2023-12-16T03:27:05.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0259c640 1 --2- 172.21.15.28:0/2704542464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce04151cd0 0x7fce040ca460 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40097c0 tx=0x7fcdf401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4e5b359752ffed4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:05.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0159a640 1 -- 172.21.15.28:0/2704542464 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40ab670 con 0x7fce04151cd0 2023-12-16T03:27:05.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0159a640 1 -- 172.21.15.28:0/2704542464 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40ab7d0 con 0x7fce04151cd0 2023-12-16T03:27:05.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0159a640 1 -- 172.21.15.28:0/2704542464 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40abb60 con 0x7fce04151cd0 2023-12-16T03:27:05.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0359e640 1 -- 172.21.15.28:0/2704542464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce04151cd0 msgr2=0x7fce040ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0359e640 1 --2- 172.21.15.28:0/2704542464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce04151cd0 0x7fce040ca460 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40097c0 tx=0x7fcdf401c450 comp rx=0 tx=0).stop 2023-12-16T03:27:05.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0359e640 1 -- 172.21.15.28:0/2704542464 shutdown_connections 2023-12-16T03:27:05.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0359e640 1 --2- 172.21.15.28:0/2704542464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce040c7c50 0x7fce041544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0359e640 1 --2- 172.21.15.28:0/2704542464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce04151cd0 0x7fce040ca460 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0359e640 1 -- 172.21.15.28:0/2704542464 >> 172.21.15.28:0/2704542464 conn(0x7fce040abee0 msgr2=0x7fce040c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:05.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0359e640 1 -- 172.21.15.28:0/2704542464 shutdown_connections 2023-12-16T03:27:05.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.076+0000 7fce0359e640 1 -- 172.21.15.28:0/2704542464 wait complete. 2023-12-16T03:27:05.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0359e640 1 Processor -- start 2023-12-16T03:27:05.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0359e640 1 -- start start 2023-12-16T03:27:05.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce040c7c50 0x7fce041571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce040ca9a0 0x7fce04148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce04151cd0 0x7fce04148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0359e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce04152e10 con 0x7fce040c7c50 2023-12-16T03:27:05.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0359e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce04153220 con 0x7fce040ca9a0 2023-12-16T03:27:05.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0359e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce04153500 con 0x7fce04151cd0 2023-12-16T03:27:05.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce040c7c50 0x7fce041571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce040c7c50 0x7fce041571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54974/0 (socket says 172.21.15.28:54974) 2023-12-16T03:27:05.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0259c640 1 -- 172.21.15.28:0/3460952945 learned_addr learned my addr 172.21.15.28:0/3460952945 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:05.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce02d9d640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce04151cd0 0x7fce04148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce01d9b640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce040ca9a0 0x7fce04148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0259c640 1 -- 172.21.15.28:0/3460952945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce04151cd0 msgr2=0x7fce04148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0259c640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce04151cd0 0x7fce04148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0259c640 1 -- 172.21.15.28:0/3460952945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce040ca9a0 msgr2=0x7fce04148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0259c640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce040ca9a0 0x7fce04148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0259c640 1 -- 172.21.15.28:0/3460952945 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf80094d0 con 0x7fce040c7c50 2023-12-16T03:27:05.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0259c640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce040c7c50 0x7fce041571a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40ad040 tx=0x7fcdf401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:05.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fcdf2ffd640 1 -- 172.21.15.28:0/3460952945 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40bf610 con 0x7fce040c7c50 2023-12-16T03:27:05.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fcdf2ffd640 1 -- 172.21.15.28:0/3460952945 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40bf790 con 0x7fce040c7c50 2023-12-16T03:27:05.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fcdf2ffd640 1 -- 172.21.15.28:0/3460952945 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40bfb40 con 0x7fce040c7c50 2023-12-16T03:27:05.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0359e640 1 -- 172.21.15.28:0/3460952945 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf4009420 con 0x7fce040c7c50 2023-12-16T03:27:05.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0359e640 1 -- 172.21.15.28:0/3460952945 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce040a9730 con 0x7fce040c7c50 2023-12-16T03:27:05.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.080+0000 7fce0359e640 1 -- 172.21.15.28:0/3460952945 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce040c6140 con 0x7fce040c7c50 2023-12-16T03:27:05.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.084+0000 7fcdf2ffd640 1 -- 172.21.15.28:0/3460952945 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcdf40bfca0 con 0x7fce040c7c50 2023-12-16T03:27:05.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.084+0000 7fcdf2ffd640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcde4066470 0x7fcde4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.084+0000 7fcdf2ffd640 1 -- 172.21.15.28:0/3460952945 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdf411e830 con 0x7fce040c7c50 2023-12-16T03:27:05.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.084+0000 7fce01d9b640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcde4066470 0x7fcde4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.084+0000 7fce01d9b640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcde4066470 0x7fcde4068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fce041549b0 tx=0x7fcdf8009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:05.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.088+0000 7fcdf2ffd640 1 -- 172.21.15.28:0/3460952945 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcdf40ebdf0 con 0x7fce040c7c50 2023-12-16T03:27:05.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.248+0000 7fce0359e640 1 -- 172.21.15.28:0/3460952945 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce04153a20 con 0x7fce040c7c50 2023-12-16T03:27:05.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.248+0000 7fcdf2ffd640 1 -- 172.21.15.28:0/3460952945 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16565 (secure 0 0 0) 0x7fcdf40ef410 con 0x7fce040c7c50 2023-12-16T03:27:05.251 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:05.252 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":50,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:02.508725+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:05.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 -- 172.21.15.28:0/3460952945 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcde4066470 msgr2=0x7fcde4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcde4066470 0x7fcde4068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fce041549b0 tx=0x7fcdf8009240 comp rx=0 tx=0).stop 2023-12-16T03:27:05.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 -- 172.21.15.28:0/3460952945 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce040c7c50 msgr2=0x7fce041571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce040c7c50 0x7fce041571a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40ad040 tx=0x7fcdf401ac90 comp rx=0 tx=0).stop 2023-12-16T03:27:05.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 -- 172.21.15.28:0/3460952945 shutdown_connections 2023-12-16T03:27:05.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce04151cd0 0x7fce04148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce040ca9a0 0x7fce04148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcde4066470 0x7fcde4068930 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 --2- 172.21.15.28:0/3460952945 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce040c7c50 0x7fce041571a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 -- 172.21.15.28:0/3460952945 >> 172.21.15.28:0/3460952945 conn(0x7fce040abee0 msgr2=0x7fce0414e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:05.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 -- 172.21.15.28:0/3460952945 shutdown_connections 2023-12-16T03:27:05.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.252+0000 7fce0359e640 1 -- 172.21.15.28:0/3460952945 wait complete. 2023-12-16T03:27:05.273 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-16T03:27:05.274 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:27:05.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.412+0000 7f9a7c9f8640 1 Processor -- start 2023-12-16T03:27:05.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.412+0000 7f9a7c9f8640 1 -- start start 2023-12-16T03:27:05.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a7c9f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a780c5640 0x7f9a780c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a7c9f8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a780c2580 con 0x7f9a780c5260 2023-12-16T03:27:05.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a7c9f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a780c1a00 con 0x7f9a780c60f0 2023-12-16T03:27:05.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a7c9f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78153510 con 0x7f9a780c5640 2023-12-16T03:27:05.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a7659c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9a780c5260 0x7f9a7806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57794/0 (socket says 172.21.15.28:57794) 2023-12-16T03:27:05.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a7659c640 1 -- 172.21.15.28:0/413400108 learned_addr learned my addr 172.21.15.28:0/413400108 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:05.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a6ffff640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a780c5640 0x7f9a780c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541809144 0 0) 0x7f9a780c2580 con 0x7f9a780c5260 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a64003530 con 0x7f9a780c5260 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3566978179 0 0) 0x7f9a64003530 con 0x7f9a780c5260 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a780c5640 msgr2=0x7f9a780c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a780c5640 0x7f9a780c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 >> v1:172.21.15.134:6789/0 conn(0x7f9a780c60f0 legacy=0x7f9a78155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780c1ce0 con 0x7f9a780c5260 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f9a68001680 con 0x7f9a780c5260 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 >> v1:172.21.15.28:6789/0 conn(0x7f9a780c5260 legacy=0x7f9a7806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a640039b0 0x7f9a64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a64004360 0x7f9a64004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a640050d0 0x7f9a6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6400bfb0 con 0x7f9a640050d0 2023-12-16T03:27:05.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6400c120 con 0x7f9a64004360 2023-12-16T03:27:05.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6400c2e0 con 0x7f9a640039b0 2023-12-16T03:27:05.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a6ffff640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a780c5640 0x7f9a780c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:05.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a76d9d640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a640050d0 0x7f9a6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a7659c640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a640039b0 0x7f9a64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a6ffff640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a64004360 0x7f9a64004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a76d9d640 1 -- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a640039b0 msgr2=0x7f9a64003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:05.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a76d9d640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a640039b0 0x7f9a64003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a76d9d640 1 -- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a64004360 msgr2=0x7f9a64004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:05.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a76d9d640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a64004360 0x7f9a64004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.416+0000 7f9a76d9d640 1 -- 172.21.15.28:0/413400108 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64003530 con 0x7f9a640050d0 2023-12-16T03:27:05.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a76d9d640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a640050d0 0x7f9a6400b990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9a70001f60 tx=0x7f9a7001c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16d946a1ca28bf3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:05.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a700a6650 con 0x7f9a640050d0 2023-12-16T03:27:05.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a700a67b0 con 0x7f9a640050d0 2023-12-16T03:27:05.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a75d9b640 1 -- 172.21.15.28:0/413400108 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a700a6ba0 con 0x7f9a640050d0 2023-12-16T03:27:05.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/413400108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a640050d0 msgr2=0x7f9a6400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a7c9f8640 1 --2- 172.21.15.28:0/413400108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a640050d0 0x7f9a6400b990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9a70001f60 tx=0x7f9a7001c860 comp rx=0 tx=0).stop 2023-12-16T03:27:05.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a76d9d640 1 -- 172.21.15.28:0/413400108 reap_dead start 2023-12-16T03:27:05.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/413400108 shutdown_connections 2023-12-16T03:27:05.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/413400108 >> 172.21.15.28:0/413400108 conn(0x7f9a7806a5b0 msgr2=0x7f9a7806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:05.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/413400108 shutdown_connections 2023-12-16T03:27:05.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/413400108 wait complete. 2023-12-16T03:27:05.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.420+0000 7f9a7c9f8640 1 Processor -- start 2023-12-16T03:27:05.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a7c9f8640 1 -- start start 2023-12-16T03:27:05.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a7c9f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a640050d0 0x7f9a7814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a7c9f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a7814f5f0 0x7f9a780a9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a7c9f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a780a9b80 0x7f9a78151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a7c9f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78071d40 con 0x7f9a780a9b80 2023-12-16T03:27:05.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a7c9f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78158e50 con 0x7f9a640050d0 2023-12-16T03:27:05.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a7c9f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a781585b0 con 0x7f9a7814f5f0 2023-12-16T03:27:05.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a76d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a780a9b80 0x7f9a78151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a7659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a640050d0 0x7f9a7814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a6ffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a7814f5f0 0x7f9a780a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a6ffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a7814f5f0 0x7f9a780a9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:40732/0 (socket says 172.21.15.28:40732) 2023-12-16T03:27:05.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a6ffff640 1 -- 172.21.15.28:0/2769375348 learned_addr learned my addr 172.21.15.28:0/2769375348 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:05.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a76d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a780a9b80 0x7f9a78151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54996/0 (socket says 172.21.15.28:54996) 2023-12-16T03:27:05.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a76d9d640 1 -- 172.21.15.28:0/2769375348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a7814f5f0 msgr2=0x7f9a780a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a76d9d640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a7814f5f0 0x7f9a780a9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a76d9d640 1 -- 172.21.15.28:0/2769375348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a640050d0 msgr2=0x7f9a7814ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a76d9d640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a640050d0 0x7f9a7814ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a76d9d640 1 -- 172.21.15.28:0/2769375348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a78158890 con 0x7f9a780a9b80 2023-12-16T03:27:05.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a6ffff640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a7814f5f0 0x7f9a780a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:05.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a76d9d640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a780a9b80 0x7f9a78151fe0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400c0f0 tx=0x7f9a64005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:05.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a6effd640 1 -- 172.21.15.28:0/2769375348 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a700a6650 con 0x7f9a780a9b80 2023-12-16T03:27:05.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a6effd640 1 -- 172.21.15.28:0/2769375348 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a700a69e0 con 0x7f9a780a9b80 2023-12-16T03:27:05.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a6effd640 1 -- 172.21.15.28:0/2769375348 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70003b80 con 0x7f9a780a9b80 2023-12-16T03:27:05.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/2769375348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a78158b70 con 0x7f9a780a9b80 2023-12-16T03:27:05.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/2769375348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7814f230 con 0x7f9a780a9b80 2023-12-16T03:27:05.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.424+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/2769375348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a780a8f80 con 0x7f9a780a9b80 2023-12-16T03:27:05.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.428+0000 7f9a6effd640 1 -- 172.21.15.28:0/2769375348 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9a70003ce0 con 0x7f9a780a9b80 2023-12-16T03:27:05.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.428+0000 7f9a6effd640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a580664a0 0x7f9a58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.428+0000 7f9a6effd640 1 -- 172.21.15.28:0/2769375348 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a7011d790 con 0x7f9a780a9b80 2023-12-16T03:27:05.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.428+0000 7f9a7659c640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a580664a0 0x7f9a58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.428+0000 7f9a7659c640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a580664a0 0x7f9a58068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9a68000c10 tx=0x7f9a68000fb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:05.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.432+0000 7f9a6effd640 1 -- 172.21.15.28:0/2769375348 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9a780a8f80 con 0x7f9a780a9b80 2023-12-16T03:27:05.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.588+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/2769375348 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a78156900 con 0x7f9a580664a0 2023-12-16T03:27:05.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.596+0000 7f9a6effd640 1 -- 172.21.15.28:0/2769375348 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289313 (secure 0 0 0) 0x7f9a68001600 con 0x7f9a580664a0 2023-12-16T03:27:05.601 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:27:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/2769375348 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a580664a0 msgr2=0x7f9a58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a580664a0 0x7f9a58068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9a68000c10 tx=0x7f9a68000fb0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/2769375348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a780a9b80 msgr2=0x7f9a78151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a780a9b80 0x7f9a78151fe0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400c0f0 tx=0x7f9a64005800 comp rx=0 tx=0).stop 2023-12-16T03:27:05.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/2769375348 shutdown_connections 2023-12-16T03:27:05.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9a580664a0 0x7f9a58068960 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a780a9b80 0x7f9a78151fe0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9a7814f5f0 0x7f9a780a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 --2- 172.21.15.28:0/2769375348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a640050d0 0x7f9a7814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/2769375348 >> 172.21.15.28:0/2769375348 conn(0x7f9a7806a5b0 msgr2=0x7f9a7815c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:05.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/2769375348 shutdown_connections 2023-12-16T03:27:05.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.600+0000 7f9a7c9f8640 1 -- 172.21.15.28:0/2769375348 wait complete. 2023-12-16T03:27:05.622 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-12-16T03:27:03.820012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238632,"kb_used_data":5824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736088,"statfs":{"total":773094113280,"available":772849754112,"internally_reserved":0,"allocated":5963776,"data_stored":3162420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.331314"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620803+0000","last_change":"2023-12-16T03:27:01.537420+0000","last_active":"2023-12-16T03:27:02.620803+0000","last_peered":"2023-12-16T03:27:02.620803+0000","last_clean":"2023-12-16T03:27:02.620803+0000","last_became_active":"2023-12-16T03:27:01.537176+0000","last_became_peered":"2023-12-16T03:27:01.537176+0000","last_unstale":"2023-12-16T03:27:02.620803+0000","last_undegraded":"2023-12-16T03:27:02.620803+0000","last_fullsized":"2023-12-16T03:27:02.620803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:23:26.860864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518261+0000","last_change":"2023-12-16T03:27:01.534498+0000","last_active":"2023-12-16T03:27:02.518261+0000","last_peered":"2023-12-16T03:27:02.518261+0000","last_clean":"2023-12-16T03:27:02.518261+0000","last_became_active":"2023-12-16T03:27:01.533730+0000","last_became_peered":"2023-12-16T03:27:01.533730+0000","last_unstale":"2023-12-16T03:27:02.518261+0000","last_undegraded":"2023-12-16T03:27:02.518261+0000","last_fullsized":"2023-12-16T03:27:02.518261+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:07.937228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.521514+0000","last_change":"2023-12-16T03:27:01.518121+0000","last_active":"2023-12-16T03:27:01.521514+0000","last_peered":"2023-12-16T03:27:01.521514+0000","last_clean":"2023-12-16T03:27:01.521514+0000","last_became_active":"2023-12-16T03:27:01.517826+0000","last_became_peered":"2023-12-16T03:27:01.517826+0000","last_unstale":"2023-12-16T03:27:01.521514+0000","last_undegraded":"2023-12-16T03:27:01.521514+0000","last_fullsized":"2023-12-16T03:27:01.521514+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:09.298222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521284+0000","last_change":"2023-12-16T03:27:01.531096+0000","last_active":"2023-12-16T03:27:02.521284+0000","last_peered":"2023-12-16T03:27:02.521284+0000","last_clean":"2023-12-16T03:27:02.521284+0000","last_became_active":"2023-12-16T03:27:01.530793+0000","last_became_peered":"2023-12-16T03:27:01.530793+0000","last_unstale":"2023-12-16T03:27:02.521284+0000","last_undegraded":"2023-12-16T03:27:02.521284+0000","last_fullsized":"2023-12-16T03:27:02.521284+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:59.366673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620647+0000","last_change":"2023-12-16T03:27:01.531904+0000","last_active":"2023-12-16T03:27:02.620647+0000","last_peered":"2023-12-16T03:27:02.620647+0000","last_clean":"2023-12-16T03:27:02.620647+0000","last_became_active":"2023-12-16T03:27:01.531705+0000","last_became_peered":"2023-12-16T03:27:01.531705+0000","last_unstale":"2023-12-16T03:27:02.620647+0000","last_undegraded":"2023-12-16T03:27:02.620647+0000","last_fullsized":"2023-12-16T03:27:02.620647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:24:38.684552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.541372+0000","last_change":"2023-12-16T03:27:01.537597+0000","last_active":"2023-12-16T03:27:01.541372+0000","last_peered":"2023-12-16T03:27:01.541372+0000","last_clean":"2023-12-16T03:27:01.541372+0000","last_became_active":"2023-12-16T03:27:01.537262+0000","last_became_peered":"2023-12-16T03:27:01.537262+0000","last_unstale":"2023-12-16T03:27:01.541372+0000","last_undegraded":"2023-12-16T03:27:01.541372+0000","last_fullsized":"2023-12-16T03:27:01.541372+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:54.171416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521060+0000","last_change":"2023-12-16T03:27:01.504710+0000","last_active":"2023-12-16T03:27:02.521060+0000","last_peered":"2023-12-16T03:27:02.521060+0000","last_clean":"2023-12-16T03:27:02.521060+0000","last_became_active":"2023-12-16T03:27:01.504412+0000","last_became_peered":"2023-12-16T03:27:01.504412+0000","last_unstale":"2023-12-16T03:27:02.521060+0000","last_undegraded":"2023-12-16T03:27:02.521060+0000","last_fullsized":"2023-12-16T03:27:02.521060+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:09.298222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517421+0000","last_change":"2023-12-16T03:27:01.514585+0000","last_active":"2023-12-16T03:27:02.517421+0000","last_peered":"2023-12-16T03:27:02.517421+0000","last_clean":"2023-12-16T03:27:02.517421+0000","last_became_active":"2023-12-16T03:27:01.514304+0000","last_became_peered":"2023-12-16T03:27:01.514304+0000","last_unstale":"2023-12-16T03:27:02.517421+0000","last_undegraded":"2023-12-16T03:27:02.517421+0000","last_fullsized":"2023-12-16T03:27:02.517421+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:44:59.949884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522137+0000","last_change":"2023-12-16T03:27:01.517287+0000","last_active":"2023-12-16T03:27:02.522137+0000","last_peered":"2023-12-16T03:27:02.522137+0000","last_clean":"2023-12-16T03:27:02.522137+0000","last_became_active":"2023-12-16T03:27:01.516865+0000","last_became_peered":"2023-12-16T03:27:01.516865+0000","last_unstale":"2023-12-16T03:27:02.522137+0000","last_undegraded":"2023-12-16T03:27:02.522137+0000","last_fullsized":"2023-12-16T03:27:02.522137+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:49.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.531565+0000","last_change":"2023-12-16T03:27:01.523610+0000","last_active":"2023-12-16T03:27:01.531565+0000","last_peered":"2023-12-16T03:27:01.531565+0000","last_clean":"2023-12-16T03:27:01.531565+0000","last_became_active":"2023-12-16T03:27:01.523269+0000","last_became_peered":"2023-12-16T03:27:01.523269+0000","last_unstale":"2023-12-16T03:27:01.531565+0000","last_undegraded":"2023-12-16T03:27:01.531565+0000","last_fullsized":"2023-12-16T03:27:01.531565+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:05.144244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539076+0000","last_change":"2023-12-16T03:27:01.534387+0000","last_active":"2023-12-16T03:27:01.539076+0000","last_peered":"2023-12-16T03:27:01.539076+0000","last_clean":"2023-12-16T03:27:01.539076+0000","last_became_active":"2023-12-16T03:27:01.534102+0000","last_became_peered":"2023-12-16T03:27:01.534102+0000","last_unstale":"2023-12-16T03:27:01.539076+0000","last_undegraded":"2023-12-16T03:27:01.539076+0000","last_fullsized":"2023-12-16T03:27:01.539076+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:05.091611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522015+0000","last_change":"2023-12-16T03:27:01.514907+0000","last_active":"2023-12-16T03:27:02.522015+0000","last_peered":"2023-12-16T03:27:02.522015+0000","last_clean":"2023-12-16T03:27:02.522015+0000","last_became_active":"2023-12-16T03:27:01.514396+0000","last_became_peered":"2023-12-16T03:27:01.514396+0000","last_unstale":"2023-12-16T03:27:02.522015+0000","last_undegraded":"2023-12-16T03:27:02.522015+0000","last_fullsized":"2023-12-16T03:27:02.522015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.534686+0000","last_change":"2023-12-16T03:27:01.533053+0000","last_active":"2023-12-16T03:27:01.534686+0000","last_peered":"2023-12-16T03:27:01.534686+0000","last_clean":"2023-12-16T03:27:01.534686+0000","last_became_active":"2023-12-16T03:27:01.532852+0000","last_became_peered":"2023-12-16T03:27:01.532852+0000","last_unstale":"2023-12-16T03:27:01.534686+0000","last_undegraded":"2023-12-16T03:27:01.534686+0000","last_fullsized":"2023-12-16T03:27:01.534686+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:49:41.666173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521644+0000","last_change":"2023-12-16T03:27:01.527464+0000","last_active":"2023-12-16T03:27:02.521644+0000","last_peered":"2023-12-16T03:27:02.521644+0000","last_clean":"2023-12-16T03:27:02.521644+0000","last_became_active":"2023-12-16T03:27:01.526439+0000","last_became_peered":"2023-12-16T03:27:01.526439+0000","last_unstale":"2023-12-16T03:27:02.521644+0000","last_undegraded":"2023-12-16T03:27:02.521644+0000","last_fullsized":"2023-12-16T03:27:02.521644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:55.347747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521374+0000","last_change":"2023-12-16T03:27:01.523106+0000","last_active":"2023-12-16T03:27:02.521374+0000","last_peered":"2023-12-16T03:27:02.521374+0000","last_clean":"2023-12-16T03:27:02.521374+0000","last_became_active":"2023-12-16T03:27:01.522824+0000","last_became_peered":"2023-12-16T03:27:01.522824+0000","last_unstale":"2023-12-16T03:27:02.521374+0000","last_undegraded":"2023-12-16T03:27:02.521374+0000","last_fullsized":"2023-12-16T03:27:02.521374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:04.563786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.526073+0000","last_change":"2023-12-16T03:27:01.513664+0000","last_active":"2023-12-16T03:27:01.526073+0000","last_peered":"2023-12-16T03:27:01.526073+0000","last_clean":"2023-12-16T03:27:01.526073+0000","last_became_active":"2023-12-16T03:27:01.513325+0000","last_became_peered":"2023-12-16T03:27:01.513325+0000","last_unstale":"2023-12-16T03:27:01.526073+0000","last_undegraded":"2023-12-16T03:27:01.526073+0000","last_fullsized":"2023-12-16T03:27:01.526073+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:09.298222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518510+0000","last_change":"2023-12-16T03:27:01.526203+0000","last_active":"2023-12-16T03:27:02.518510+0000","last_peered":"2023-12-16T03:27:02.518510+0000","last_clean":"2023-12-16T03:27:02.518510+0000","last_became_active":"2023-12-16T03:27:01.525873+0000","last_became_peered":"2023-12-16T03:27:01.525873+0000","last_unstale":"2023-12-16T03:27:02.518510+0000","last_undegraded":"2023-12-16T03:27:02.518510+0000","last_fullsized":"2023-12-16T03:27:02.518510+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:37:50.321166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.534373+0000","last_change":"2023-12-16T03:27:01.529407+0000","last_active":"2023-12-16T03:27:01.534373+0000","last_peered":"2023-12-16T03:27:01.534373+0000","last_clean":"2023-12-16T03:27:01.534373+0000","last_became_active":"2023-12-16T03:27:01.529024+0000","last_became_peered":"2023-12-16T03:27:01.529024+0000","last_unstale":"2023-12-16T03:27:01.534373+0000","last_undegraded":"2023-12-16T03:27:01.534373+0000","last_fullsized":"2023-12-16T03:27:01.534373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:49.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620695+0000","last_change":"2023-12-16T03:27:01.538362+0000","last_active":"2023-12-16T03:27:02.620695+0000","last_peered":"2023-12-16T03:27:02.620695+0000","last_clean":"2023-12-16T03:27:02.620695+0000","last_became_active":"2023-12-16T03:27:01.538024+0000","last_became_peered":"2023-12-16T03:27:01.538024+0000","last_unstale":"2023-12-16T03:27:02.620695+0000","last_undegraded":"2023-12-16T03:27:02.620695+0000","last_fullsized":"2023-12-16T03:27:02.620695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:44.941057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518035+0000","last_change":"2023-12-16T03:27:01.535927+0000","last_active":"2023-12-16T03:27:02.518035+0000","last_peered":"2023-12-16T03:27:02.518035+0000","last_clean":"2023-12-16T03:27:02.518035+0000","last_became_active":"2023-12-16T03:27:01.535618+0000","last_became_peered":"2023-12-16T03:27:01.535618+0000","last_unstale":"2023-12-16T03:27:02.518035+0000","last_undegraded":"2023-12-16T03:27:02.518035+0000","last_fullsized":"2023-12-16T03:27:02.518035+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:46.786632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.528977+0000","last_change":"2023-12-16T03:27:01.520051+0000","last_active":"2023-12-16T03:27:01.528977+0000","last_peered":"2023-12-16T03:27:01.528977+0000","last_clean":"2023-12-16T03:27:01.528977+0000","last_became_active":"2023-12-16T03:27:01.519803+0000","last_became_peered":"2023-12-16T03:27:01.519803+0000","last_unstale":"2023-12-16T03:27:01.528977+0000","last_undegraded":"2023-12-16T03:27:01.528977+0000","last_fullsized":"2023-12-16T03:27:01.528977+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:08.574639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517483+0000","last_change":"2023-12-16T03:27:01.523786+0000","last_active":"2023-12-16T03:27:02.517483+0000","last_peered":"2023-12-16T03:27:02.517483+0000","last_clean":"2023-12-16T03:27:02.517483+0000","last_became_active":"2023-12-16T03:27:01.523435+0000","last_became_peered":"2023-12-16T03:27:01.523435+0000","last_unstale":"2023-12-16T03:27:02.517483+0000","last_undegraded":"2023-12-16T03:27:02.517483+0000","last_fullsized":"2023-12-16T03:27:02.517483+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:59:37.033807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.543392+0000","last_change":"2023-12-16T03:27:01.539536+0000","last_active":"2023-12-16T03:27:01.543392+0000","last_peered":"2023-12-16T03:27:01.543392+0000","last_clean":"2023-12-16T03:27:01.543392+0000","last_became_active":"2023-12-16T03:27:01.539210+0000","last_became_peered":"2023-12-16T03:27:01.539210+0000","last_unstale":"2023-12-16T03:27:01.543392+0000","last_undegraded":"2023-12-16T03:27:01.543392+0000","last_fullsized":"2023-12-16T03:27:01.543392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:03:54.763274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.531238+0000","last_change":"2023-12-16T03:27:01.521374+0000","last_active":"2023-12-16T03:27:01.531238+0000","last_peered":"2023-12-16T03:27:01.531238+0000","last_clean":"2023-12-16T03:27:01.531238+0000","last_became_active":"2023-12-16T03:27:01.521080+0000","last_became_peered":"2023-12-16T03:27:01.521080+0000","last_unstale":"2023-12-16T03:27:01.531238+0000","last_undegraded":"2023-12-16T03:27:01.531238+0000","last_fullsized":"2023-12-16T03:27:01.531238+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:05.144244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620868+0000","last_change":"2023-12-16T03:27:01.537212+0000","last_active":"2023-12-16T03:27:02.620868+0000","last_peered":"2023-12-16T03:27:02.620868+0000","last_clean":"2023-12-16T03:27:02.620868+0000","last_became_active":"2023-12-16T03:27:01.536927+0000","last_became_peered":"2023-12-16T03:27:01.536927+0000","last_unstale":"2023-12-16T03:27:02.620868+0000","last_undegraded":"2023-12-16T03:27:02.620868+0000","last_fullsized":"2023-12-16T03:27:02.620868+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:59.764629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522228+0000","last_change":"2023-12-16T03:27:01.506167+0000","last_active":"2023-12-16T03:27:02.522228+0000","last_peered":"2023-12-16T03:27:02.522228+0000","last_clean":"2023-12-16T03:27:02.522228+0000","last_became_active":"2023-12-16T03:27:01.505856+0000","last_became_peered":"2023-12-16T03:27:01.505856+0000","last_unstale":"2023-12-16T03:27:02.522228+0000","last_undegraded":"2023-12-16T03:27:02.522228+0000","last_fullsized":"2023-12-16T03:27:02.522228+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.528124+0000","last_change":"2023-12-16T03:27:01.514340+0000","last_active":"2023-12-16T03:27:01.528124+0000","last_peered":"2023-12-16T03:27:01.528124+0000","last_clean":"2023-12-16T03:27:01.528124+0000","last_became_active":"2023-12-16T03:27:01.514047+0000","last_became_peered":"2023-12-16T03:27:01.514047+0000","last_unstale":"2023-12-16T03:27:01.528124+0000","last_undegraded":"2023-12-16T03:27:01.528124+0000","last_fullsized":"2023-12-16T03:27:01.528124+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620667+0000","last_change":"2023-12-16T03:27:01.531612+0000","last_active":"2023-12-16T03:27:02.620667+0000","last_peered":"2023-12-16T03:27:02.620667+0000","last_clean":"2023-12-16T03:27:02.620667+0000","last_became_active":"2023-12-16T03:27:01.531274+0000","last_became_peered":"2023-12-16T03:27:01.531274+0000","last_unstale":"2023-12-16T03:27:02.620667+0000","last_undegraded":"2023-12-16T03:27:02.620667+0000","last_fullsized":"2023-12-16T03:27:02.620667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:58.878396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517994+0000","last_change":"2023-12-16T03:27:01.527562+0000","last_active":"2023-12-16T03:27:02.517994+0000","last_peered":"2023-12-16T03:27:02.517994+0000","last_clean":"2023-12-16T03:27:02.517994+0000","last_became_active":"2023-12-16T03:27:01.525171+0000","last_became_peered":"2023-12-16T03:27:01.525171+0000","last_unstale":"2023-12-16T03:27:02.517994+0000","last_undegraded":"2023-12-16T03:27:02.517994+0000","last_fullsized":"2023-12-16T03:27:02.517994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:02:55.385594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.521232+0000","last_change":"2023-12-16T03:27:01.518371+0000","last_active":"2023-12-16T03:27:01.521232+0000","last_peered":"2023-12-16T03:27:01.521232+0000","last_clean":"2023-12-16T03:27:01.521232+0000","last_became_active":"2023-12-16T03:27:01.518088+0000","last_became_peered":"2023-12-16T03:27:01.518088+0000","last_unstale":"2023-12-16T03:27:01.521232+0000","last_undegraded":"2023-12-16T03:27:01.521232+0000","last_fullsized":"2023-12-16T03:27:01.521232+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:47:34.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620568+0000","last_change":"2023-12-16T03:27:01.532530+0000","last_active":"2023-12-16T03:27:02.620568+0000","last_peered":"2023-12-16T03:27:02.620568+0000","last_clean":"2023-12-16T03:27:02.620568+0000","last_became_active":"2023-12-16T03:27:01.532228+0000","last_became_peered":"2023-12-16T03:27:01.532228+0000","last_unstale":"2023-12-16T03:27:02.620568+0000","last_undegraded":"2023-12-16T03:27:02.620568+0000","last_fullsized":"2023-12-16T03:27:02.620568+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.578189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539886+0000","last_change":"2023-12-16T03:27:01.526590+0000","last_active":"2023-12-16T03:27:01.539886+0000","last_peered":"2023-12-16T03:27:01.539886+0000","last_clean":"2023-12-16T03:27:01.539886+0000","last_became_active":"2023-12-16T03:27:01.525400+0000","last_became_peered":"2023-12-16T03:27:01.525400+0000","last_unstale":"2023-12-16T03:27:01.539886+0000","last_undegraded":"2023-12-16T03:27:01.539886+0000","last_fullsized":"2023-12-16T03:27:01.539886+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:49.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539539+0000","last_change":"2023-12-16T03:27:01.519301+0000","last_active":"2023-12-16T03:27:01.539539+0000","last_peered":"2023-12-16T03:27:01.539539+0000","last_clean":"2023-12-16T03:27:01.539539+0000","last_became_active":"2023-12-16T03:27:01.519011+0000","last_became_peered":"2023-12-16T03:27:01.519011+0000","last_unstale":"2023-12-16T03:27:01.539539+0000","last_undegraded":"2023-12-16T03:27:01.539539+0000","last_fullsized":"2023-12-16T03:27:01.539539+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:08.574639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.546371+0000","last_change":"2023-12-16T03:27:00.515238+0000","last_active":"2023-12-16T03:27:01.546371+0000","last_peered":"2023-12-16T03:27:01.546371+0000","last_clean":"2023-12-16T03:27:01.546371+0000","last_became_active":"2023-12-16T03:27:00.514968+0000","last_became_peered":"2023-12-16T03:27:00.514968+0000","last_unstale":"2023-12-16T03:27:01.546371+0000","last_undegraded":"2023-12-16T03:27:01.546371+0000","last_fullsized":"2023-12-16T03:27:01.546371+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.532190+0000","last_change":"2023-12-16T03:27:01.522872+0000","last_active":"2023-12-16T03:27:01.532190+0000","last_peered":"2023-12-16T03:27:01.532190+0000","last_clean":"2023-12-16T03:27:01.532190+0000","last_became_active":"2023-12-16T03:27:01.522260+0000","last_became_peered":"2023-12-16T03:27:01.522260+0000","last_unstale":"2023-12-16T03:27:01.532190+0000","last_undegraded":"2023-12-16T03:27:01.532190+0000","last_fullsized":"2023-12-16T03:27:01.532190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:20:49.328346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518188+0000","last_change":"2023-12-16T03:27:00.521097+0000","last_active":"2023-12-16T03:27:02.518188+0000","last_peered":"2023-12-16T03:27:02.518188+0000","last_clean":"2023-12-16T03:27:02.518188+0000","last_became_active":"2023-12-16T03:27:00.520800+0000","last_became_peered":"2023-12-16T03:27:00.520800+0000","last_unstale":"2023-12-16T03:27:02.518188+0000","last_undegraded":"2023-12-16T03:27:02.518188+0000","last_fullsized":"2023-12-16T03:27:02.518188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:38:52.347850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.543212+0000","last_change":"2023-12-16T03:27:01.528475+0000","last_active":"2023-12-16T03:27:01.543212+0000","last_peered":"2023-12-16T03:27:01.543212+0000","last_clean":"2023-12-16T03:27:01.543212+0000","last_became_active":"2023-12-16T03:27:01.527985+0000","last_became_peered":"2023-12-16T03:27:01.527985+0000","last_unstale":"2023-12-16T03:27:01.543212+0000","last_undegraded":"2023-12-16T03:27:01.543212+0000","last_fullsized":"2023-12-16T03:27:01.543212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:55.347747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539812+0000","last_change":"2023-12-16T03:27:00.516992+0000","last_active":"2023-12-16T03:27:01.539812+0000","last_peered":"2023-12-16T03:27:01.539812+0000","last_clean":"2023-12-16T03:27:01.539812+0000","last_became_active":"2023-12-16T03:27:00.515339+0000","last_became_peered":"2023-12-16T03:27:00.515339+0000","last_unstale":"2023-12-16T03:27:01.539812+0000","last_undegraded":"2023-12-16T03:27:01.539812+0000","last_fullsized":"2023-12-16T03:27:01.539812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:58.358317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539728+0000","last_change":"2023-12-16T03:27:01.522006+0000","last_active":"2023-12-16T03:27:01.539728+0000","last_peered":"2023-12-16T03:27:01.539728+0000","last_clean":"2023-12-16T03:27:01.539728+0000","last_became_active":"2023-12-16T03:27:01.520949+0000","last_became_peered":"2023-12-16T03:27:01.520949+0000","last_unstale":"2023-12-16T03:27:01.539728+0000","last_undegraded":"2023-12-16T03:27:01.539728+0000","last_fullsized":"2023-12-16T03:27:01.539728+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:11.703476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522116+0000","last_change":"2023-12-16T03:27:00.515665+0000","last_active":"2023-12-16T03:27:02.522116+0000","last_peered":"2023-12-16T03:27:02.522116+0000","last_clean":"2023-12-16T03:27:02.522116+0000","last_became_active":"2023-12-16T03:27:00.514766+0000","last_became_peered":"2023-12-16T03:27:00.514766+0000","last_unstale":"2023-12-16T03:27:02.522116+0000","last_undegraded":"2023-12-16T03:27:02.522116+0000","last_fullsized":"2023-12-16T03:27:02.522116+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:54.339391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517703+0000","last_change":"2023-12-16T03:27:01.523755+0000","last_active":"2023-12-16T03:27:02.517703+0000","last_peered":"2023-12-16T03:27:02.517703+0000","last_clean":"2023-12-16T03:27:02.517703+0000","last_became_active":"2023-12-16T03:27:01.523179+0000","last_became_peered":"2023-12-16T03:27:01.523179+0000","last_unstale":"2023-12-16T03:27:02.517703+0000","last_undegraded":"2023-12-16T03:27:02.517703+0000","last_fullsized":"2023-12-16T03:27:02.517703+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:20:11.416554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521932+0000","last_change":"2023-12-16T03:27:00.512400+0000","last_active":"2023-12-16T03:27:02.521932+0000","last_peered":"2023-12-16T03:27:02.521932+0000","last_clean":"2023-12-16T03:27:02.521932+0000","last_became_active":"2023-12-16T03:27:00.512120+0000","last_became_peered":"2023-12-16T03:27:00.512120+0000","last_unstale":"2023-12-16T03:27:02.521932+0000","last_undegraded":"2023-12-16T03:27:02.521932+0000","last_fullsized":"2023-12-16T03:27:02.521932+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:32:09.899662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517854+0000","last_change":"2023-12-16T03:27:01.536014+0000","last_active":"2023-12-16T03:27:02.517854+0000","last_peered":"2023-12-16T03:27:02.517854+0000","last_clean":"2023-12-16T03:27:02.517854+0000","last_became_active":"2023-12-16T03:27:01.535729+0000","last_became_peered":"2023-12-16T03:27:01.535729+0000","last_unstale":"2023-12-16T03:27:02.517854+0000","last_undegraded":"2023-12-16T03:27:02.517854+0000","last_fullsized":"2023-12-16T03:27:02.517854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:22:11.774067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539770+0000","last_change":"2023-12-16T03:27:00.513060+0000","last_active":"2023-12-16T03:27:01.539770+0000","last_peered":"2023-12-16T03:27:01.539770+0000","last_clean":"2023-12-16T03:27:01.539770+0000","last_became_active":"2023-12-16T03:27:00.512780+0000","last_became_peered":"2023-12-16T03:27:00.512780+0000","last_unstale":"2023-12-16T03:27:01.539770+0000","last_undegraded":"2023-12-16T03:27:01.539770+0000","last_fullsized":"2023-12-16T03:27:01.539770+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:03.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.531219+0000","last_change":"2023-12-16T03:27:01.520984+0000","last_active":"2023-12-16T03:27:01.531219+0000","last_peered":"2023-12-16T03:27:01.531219+0000","last_clean":"2023-12-16T03:27:01.531219+0000","last_became_active":"2023-12-16T03:27:01.520045+0000","last_became_peered":"2023-12-16T03:27:01.520045+0000","last_unstale":"2023-12-16T03:27:01.531219+0000","last_undegraded":"2023-12-16T03:27:01.531219+0000","last_fullsized":"2023-12-16T03:27:01.531219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:35.754164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.520866+0000","last_change":"2023-12-16T03:27:00.513568+0000","last_active":"2023-12-16T03:27:02.520866+0000","last_peered":"2023-12-16T03:27:02.520866+0000","last_clean":"2023-12-16T03:27:02.520866+0000","last_became_active":"2023-12-16T03:27:00.513294+0000","last_became_peered":"2023-12-16T03:27:00.513294+0000","last_unstale":"2023-12-16T03:27:02.520866+0000","last_undegraded":"2023-12-16T03:27:02.520866+0000","last_fullsized":"2023-12-16T03:27:02.520866+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517520+0000","last_change":"2023-12-16T03:27:01.526843+0000","last_active":"2023-12-16T03:27:02.517520+0000","last_peered":"2023-12-16T03:27:02.517520+0000","last_clean":"2023-12-16T03:27:02.517520+0000","last_became_active":"2023-12-16T03:27:01.525795+0000","last_became_peered":"2023-12-16T03:27:01.525795+0000","last_unstale":"2023-12-16T03:27:02.517520+0000","last_undegraded":"2023-12-16T03:27:02.517520+0000","last_fullsized":"2023-12-16T03:27:02.517520+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:53.633088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.520945+0000","last_change":"2023-12-16T03:27:00.520498+0000","last_active":"2023-12-16T03:27:02.520945+0000","last_peered":"2023-12-16T03:27:02.520945+0000","last_clean":"2023-12-16T03:27:02.520945+0000","last_became_active":"2023-12-16T03:27:00.520179+0000","last_became_peered":"2023-12-16T03:27:00.520179+0000","last_unstale":"2023-12-16T03:27:02.520945+0000","last_undegraded":"2023-12-16T03:27:02.520945+0000","last_fullsized":"2023-12-16T03:27:02.520945+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:36.834249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521760+0000","last_change":"2023-12-16T03:27:01.525335+0000","last_active":"2023-12-16T03:27:02.521760+0000","last_peered":"2023-12-16T03:27:02.521760+0000","last_clean":"2023-12-16T03:27:02.521760+0000","last_became_active":"2023-12-16T03:27:01.524994+0000","last_became_peered":"2023-12-16T03:27:01.524994+0000","last_unstale":"2023-12-16T03:27:02.521760+0000","last_undegraded":"2023-12-16T03:27:02.521760+0000","last_fullsized":"2023-12-16T03:27:02.521760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:08.574639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.507941+0000","last_change":"2023-12-16T03:27:00.516706+0000","last_active":"2023-12-16T03:27:01.507941+0000","last_peered":"2023-12-16T03:27:01.507941+0000","last_clean":"2023-12-16T03:27:01.507941+0000","last_became_active":"2023-12-16T03:27:00.516403+0000","last_became_peered":"2023-12-16T03:27:00.516403+0000","last_unstale":"2023-12-16T03:27:01.507941+0000","last_undegraded":"2023-12-16T03:27:01.507941+0000","last_fullsized":"2023-12-16T03:27:01.507941+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:27.966699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.529744+0000","last_change":"2023-12-16T03:27:01.526628+0000","last_active":"2023-12-16T03:27:01.529744+0000","last_peered":"2023-12-16T03:27:01.529744+0000","last_clean":"2023-12-16T03:27:01.529744+0000","last_became_active":"2023-12-16T03:27:01.526319+0000","last_became_peered":"2023-12-16T03:27:01.526319+0000","last_unstale":"2023-12-16T03:27:01.529744+0000","last_undegraded":"2023-12-16T03:27:01.529744+0000","last_fullsized":"2023-12-16T03:27:01.529744+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:04.563786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518268+0000","last_change":"2023-12-16T03:27:00.524203+0000","last_active":"2023-12-16T03:27:02.518268+0000","last_peered":"2023-12-16T03:27:02.518268+0000","last_clean":"2023-12-16T03:27:02.518268+0000","last_became_active":"2023-12-16T03:27:00.523807+0000","last_became_peered":"2023-12-16T03:27:00.523807+0000","last_unstale":"2023-12-16T03:27:02.518268+0000","last_undegraded":"2023-12-16T03:27:02.518268+0000","last_fullsized":"2023-12-16T03:27:02.518268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:07:50.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.538943+0000","last_change":"2023-12-16T03:27:01.533076+0000","last_active":"2023-12-16T03:27:01.538943+0000","last_peered":"2023-12-16T03:27:01.538943+0000","last_clean":"2023-12-16T03:27:01.538943+0000","last_became_active":"2023-12-16T03:27:01.532721+0000","last_became_peered":"2023-12-16T03:27:01.532721+0000","last_unstale":"2023-12-16T03:27:01.538943+0000","last_undegraded":"2023-12-16T03:27:01.538943+0000","last_fullsized":"2023-12-16T03:27:01.538943+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:31.675848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.538942+0000","last_change":"2023-12-16T03:27:00.521385+0000","last_active":"2023-12-16T03:27:01.538942+0000","last_peered":"2023-12-16T03:27:01.538942+0000","last_clean":"2023-12-16T03:27:01.538942+0000","last_became_active":"2023-12-16T03:27:00.521116+0000","last_became_peered":"2023-12-16T03:27:00.521116+0000","last_unstale":"2023-12-16T03:27:01.538942+0000","last_undegraded":"2023-12-16T03:27:01.538942+0000","last_fullsized":"2023-12-16T03:27:01.538942+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.529561+0000","last_change":"2023-12-16T03:27:01.522382+0000","last_active":"2023-12-16T03:27:01.529561+0000","last_peered":"2023-12-16T03:27:01.529561+0000","last_clean":"2023-12-16T03:27:01.529561+0000","last_became_active":"2023-12-16T03:27:01.522101+0000","last_became_peered":"2023-12-16T03:27:01.522101+0000","last_unstale":"2023-12-16T03:27:01.529561+0000","last_undegraded":"2023-12-16T03:27:01.529561+0000","last_fullsized":"2023-12-16T03:27:01.529561+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:55.347747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521851+0000","last_change":"2023-12-16T03:27:00.514824+0000","last_active":"2023-12-16T03:27:02.521851+0000","last_peered":"2023-12-16T03:27:02.521851+0000","last_clean":"2023-12-16T03:27:02.521851+0000","last_became_active":"2023-12-16T03:27:00.514574+0000","last_became_peered":"2023-12-16T03:27:00.514574+0000","last_unstale":"2023-12-16T03:27:02.521851+0000","last_undegraded":"2023-12-16T03:27:02.521851+0000","last_fullsized":"2023-12-16T03:27:02.521851+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:49.770339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521171+0000","last_change":"2023-12-16T03:27:01.523308+0000","last_active":"2023-12-16T03:27:02.521171+0000","last_peered":"2023-12-16T03:27:02.521171+0000","last_clean":"2023-12-16T03:27:02.521171+0000","last_became_active":"2023-12-16T03:27:01.522582+0000","last_became_peered":"2023-12-16T03:27:01.522582+0000","last_unstale":"2023-12-16T03:27:02.521171+0000","last_undegraded":"2023-12-16T03:27:02.521171+0000","last_fullsized":"2023-12-16T03:27:02.521171+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:44.457252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517837+0000","last_change":"2023-12-16T03:27:00.524023+0000","last_active":"2023-12-16T03:27:02.517837+0000","last_peered":"2023-12-16T03:27:02.517837+0000","last_clean":"2023-12-16T03:27:02.517837+0000","last_became_active":"2023-12-16T03:27:00.523742+0000","last_became_peered":"2023-12-16T03:27:00.523742+0000","last_unstale":"2023-12-16T03:27:02.517837+0000","last_undegraded":"2023-12-16T03:27:02.517837+0000","last_fullsized":"2023-12-16T03:27:02.517837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:09:52.558814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.528878+0000","last_change":"2023-12-16T03:27:01.519766+0000","last_active":"2023-12-16T03:27:01.528878+0000","last_peered":"2023-12-16T03:27:01.528878+0000","last_clean":"2023-12-16T03:27:01.528878+0000","last_became_active":"2023-12-16T03:27:01.519473+0000","last_became_peered":"2023-12-16T03:27:01.519473+0000","last_unstale":"2023-12-16T03:27:01.528878+0000","last_undegraded":"2023-12-16T03:27:01.528878+0000","last_fullsized":"2023-12-16T03:27:01.528878+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:44.457252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.507683+0000","last_change":"2023-12-16T03:27:00.518062+0000","last_active":"2023-12-16T03:27:01.507683+0000","last_peered":"2023-12-16T03:27:01.507683+0000","last_clean":"2023-12-16T03:27:01.507683+0000","last_became_active":"2023-12-16T03:27:00.517664+0000","last_became_peered":"2023-12-16T03:27:00.517664+0000","last_unstale":"2023-12-16T03:27:01.507683+0000","last_undegraded":"2023-12-16T03:27:01.507683+0000","last_fullsized":"2023-12-16T03:27:01.507683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:47:04.667881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.520862+0000","last_change":"2023-12-16T03:27:01.514600+0000","last_active":"2023-12-16T03:27:02.520862+0000","last_peered":"2023-12-16T03:27:02.520862+0000","last_clean":"2023-12-16T03:27:02.520862+0000","last_became_active":"2023-12-16T03:27:01.514262+0000","last_became_peered":"2023-12-16T03:27:01.514262+0000","last_unstale":"2023-12-16T03:27:02.520862+0000","last_undegraded":"2023-12-16T03:27:02.520862+0000","last_fullsized":"2023-12-16T03:27:02.520862+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:28.975055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.520992+0000","last_change":"2023-12-16T03:27:00.514189+0000","last_active":"2023-12-16T03:27:02.520992+0000","last_peered":"2023-12-16T03:27:02.520992+0000","last_clean":"2023-12-16T03:27:02.520992+0000","last_became_active":"2023-12-16T03:27:00.513862+0000","last_became_peered":"2023-12-16T03:27:00.513862+0000","last_unstale":"2023-12-16T03:27:02.520992+0000","last_undegraded":"2023-12-16T03:27:02.520992+0000","last_fullsized":"2023-12-16T03:27:02.520992+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.545613+0000","last_change":"2023-12-16T03:27:01.540186+0000","last_active":"2023-12-16T03:27:01.545613+0000","last_peered":"2023-12-16T03:27:01.545613+0000","last_clean":"2023-12-16T03:27:01.545613+0000","last_became_active":"2023-12-16T03:27:01.539206+0000","last_became_peered":"2023-12-16T03:27:01.539206+0000","last_unstale":"2023-12-16T03:27:01.545613+0000","last_undegraded":"2023-12-16T03:27:01.545613+0000","last_fullsized":"2023-12-16T03:27:01.545613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:11.703476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":19,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.534910+0000","last_change":"2023-12-16T03:27:00.515681+0000","last_active":"2023-12-16T03:27:01.534910+0000","last_peered":"2023-12-16T03:27:01.534910+0000","last_clean":"2023-12-16T03:27:01.534910+0000","last_became_active":"2023-12-16T03:27:00.515413+0000","last_became_peered":"2023-12-16T03:27:00.515413+0000","last_unstale":"2023-12-16T03:27:01.534910+0000","last_undegraded":"2023-12-16T03:27:01.534910+0000","last_fullsized":"2023-12-16T03:27:01.534910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.528414+0000","last_change":"2023-12-16T03:27:01.518997+0000","last_active":"2023-12-16T03:27:01.528414+0000","last_peered":"2023-12-16T03:27:01.528414+0000","last_clean":"2023-12-16T03:27:01.528414+0000","last_became_active":"2023-12-16T03:27:01.518606+0000","last_became_peered":"2023-12-16T03:27:01.518606+0000","last_unstale":"2023-12-16T03:27:01.528414+0000","last_undegraded":"2023-12-16T03:27:01.528414+0000","last_fullsized":"2023-12-16T03:27:01.528414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:32:49.306278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518574+0000","last_change":"2023-12-16T03:27:00.522719+0000","last_active":"2023-12-16T03:27:02.518574+0000","last_peered":"2023-12-16T03:27:02.518574+0000","last_clean":"2023-12-16T03:27:02.518574+0000","last_became_active":"2023-12-16T03:27:00.522485+0000","last_became_peered":"2023-12-16T03:27:00.522485+0000","last_unstale":"2023-12-16T03:27:02.518574+0000","last_undegraded":"2023-12-16T03:27:02.518574+0000","last_fullsized":"2023-12-16T03:27:02.518574+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:48:48.483240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522393+0000","last_change":"2023-12-16T03:27:01.525968+0000","last_active":"2023-12-16T03:27:02.522393+0000","last_peered":"2023-12-16T03:27:02.522393+0000","last_clean":"2023-12-16T03:27:02.522393+0000","last_became_active":"2023-12-16T03:27:01.523176+0000","last_became_peered":"2023-12-16T03:27:01.523176+0000","last_unstale":"2023-12-16T03:27:02.522393+0000","last_undegraded":"2023-12-16T03:27:02.522393+0000","last_fullsized":"2023-12-16T03:27:02.522393+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539398+0000","last_change":"2023-12-16T03:27:00.514506+0000","last_active":"2023-12-16T03:27:01.539398+0000","last_peered":"2023-12-16T03:27:01.539398+0000","last_clean":"2023-12-16T03:27:01.539398+0000","last_became_active":"2023-12-16T03:27:00.514121+0000","last_became_peered":"2023-12-16T03:27:00.514121+0000","last_unstale":"2023-12-16T03:27:01.539398+0000","last_undegraded":"2023-12-16T03:27:01.539398+0000","last_fullsized":"2023-12-16T03:27:01.539398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:47:33.862583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518157+0000","last_change":"2023-12-16T03:27:01.517329+0000","last_active":"2023-12-16T03:27:02.518157+0000","last_peered":"2023-12-16T03:27:02.518157+0000","last_clean":"2023-12-16T03:27:02.518157+0000","last_became_active":"2023-12-16T03:27:01.517020+0000","last_became_peered":"2023-12-16T03:27:01.517020+0000","last_unstale":"2023-12-16T03:27:02.518157+0000","last_undegraded":"2023-12-16T03:27:02.518157+0000","last_fullsized":"2023-12-16T03:27:02.518157+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:37:11.829485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522073+0000","last_change":"2023-12-16T03:27:00.514408+0000","last_active":"2023-12-16T03:27:02.522073+0000","last_peered":"2023-12-16T03:27:02.522073+0000","last_clean":"2023-12-16T03:27:02.522073+0000","last_became_active":"2023-12-16T03:27:00.514141+0000","last_became_peered":"2023-12-16T03:27:00.514141+0000","last_unstale":"2023-12-16T03:27:02.522073+0000","last_undegraded":"2023-12-16T03:27:02.522073+0000","last_fullsized":"2023-12-16T03:27:02.522073+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:10.695120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.529580+0000","last_change":"2023-12-16T03:27:01.522466+0000","last_active":"2023-12-16T03:27:01.529580+0000","last_peered":"2023-12-16T03:27:01.529580+0000","last_clean":"2023-12-16T03:27:01.529580+0000","last_became_active":"2023-12-16T03:27:01.522111+0000","last_became_peered":"2023-12-16T03:27:01.522111+0000","last_unstale":"2023-12-16T03:27:01.529580+0000","last_undegraded":"2023-12-16T03:27:01.529580+0000","last_fullsized":"2023-12-16T03:27:01.529580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:18.664130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.500452+0000","last_change":"2023-12-16T03:27:00.520371+0000","last_active":"2023-12-16T03:27:01.500452+0000","last_peered":"2023-12-16T03:27:01.500452+0000","last_clean":"2023-12-16T03:27:01.500452+0000","last_became_active":"2023-12-16T03:27:00.520097+0000","last_became_peered":"2023-12-16T03:27:00.520097+0000","last_unstale":"2023-12-16T03:27:01.500452+0000","last_undegraded":"2023-12-16T03:27:01.500452+0000","last_fullsized":"2023-12-16T03:27:01.500452+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:32:48.297921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521322+0000","last_change":"2023-12-16T03:27:01.521651+0000","last_active":"2023-12-16T03:27:02.521322+0000","last_peered":"2023-12-16T03:27:02.521322+0000","last_clean":"2023-12-16T03:27:02.521322+0000","last_became_active":"2023-12-16T03:27:01.521167+0000","last_became_peered":"2023-12-16T03:27:01.521167+0000","last_unstale":"2023-12-16T03:27:02.521322+0000","last_undegraded":"2023-12-16T03:27:02.521322+0000","last_fullsized":"2023-12-16T03:27:02.521322+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:42:00.543610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517987+0000","last_change":"2023-12-16T03:27:00.521885+0000","last_active":"2023-12-16T03:27:02.517987+0000","last_peered":"2023-12-16T03:27:02.517987+0000","last_clean":"2023-12-16T03:27:02.517987+0000","last_became_active":"2023-12-16T03:27:00.521503+0000","last_became_peered":"2023-12-16T03:27:00.521503+0000","last_unstale":"2023-12-16T03:27:02.517987+0000","last_undegraded":"2023-12-16T03:27:02.517987+0000","last_fullsized":"2023-12-16T03:27:02.517987+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:47.207385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.535990+0000","last_change":"2023-12-16T03:27:01.516489+0000","last_active":"2023-12-16T03:27:01.535990+0000","last_peered":"2023-12-16T03:27:01.535990+0000","last_clean":"2023-12-16T03:27:01.535990+0000","last_became_active":"2023-12-16T03:27:01.516199+0000","last_became_peered":"2023-12-16T03:27:01.516199+0000","last_unstale":"2023-12-16T03:27:01.535990+0000","last_undegraded":"2023-12-16T03:27:01.535990+0000","last_fullsized":"2023-12-16T03:27:01.535990+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.516699+0000","last_change":"2023-12-16T03:27:00.508945+0000","last_active":"2023-12-16T03:27:01.516699+0000","last_peered":"2023-12-16T03:27:01.516699+0000","last_clean":"2023-12-16T03:27:01.516699+0000","last_became_active":"2023-12-16T03:27:00.508638+0000","last_became_peered":"2023-12-16T03:27:00.508638+0000","last_unstale":"2023-12-16T03:27:01.516699+0000","last_undegraded":"2023-12-16T03:27:01.516699+0000","last_fullsized":"2023-12-16T03:27:01.516699+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539502+0000","last_change":"2023-12-16T03:27:01.518954+0000","last_active":"2023-12-16T03:27:01.539502+0000","last_peered":"2023-12-16T03:27:01.539502+0000","last_clean":"2023-12-16T03:27:01.539502+0000","last_became_active":"2023-12-16T03:27:01.518665+0000","last_became_peered":"2023-12-16T03:27:01.518665+0000","last_unstale":"2023-12-16T03:27:01.539502+0000","last_undegraded":"2023-12-16T03:27:01.539502+0000","last_fullsized":"2023-12-16T03:27:01.539502+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:42:00.543610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.520878+0000","last_change":"2023-12-16T03:27:00.519726+0000","last_active":"2023-12-16T03:27:02.520878+0000","last_peered":"2023-12-16T03:27:02.520878+0000","last_clean":"2023-12-16T03:27:02.520878+0000","last_became_active":"2023-12-16T03:27:00.519420+0000","last_became_peered":"2023-12-16T03:27:00.519420+0000","last_unstale":"2023-12-16T03:27:02.520878+0000","last_undegraded":"2023-12-16T03:27:02.520878+0000","last_fullsized":"2023-12-16T03:27:02.520878+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:07.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522347+0000","last_change":"2023-12-16T03:27:01.531143+0000","last_active":"2023-12-16T03:27:02.522347+0000","last_peered":"2023-12-16T03:27:02.522347+0000","last_clean":"2023-12-16T03:27:02.522347+0000","last_became_active":"2023-12-16T03:27:01.530842+0000","last_became_peered":"2023-12-16T03:27:01.530842+0000","last_unstale":"2023-12-16T03:27:02.522347+0000","last_undegraded":"2023-12-16T03:27:02.522347+0000","last_fullsized":"2023-12-16T03:27:02.522347+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539194+0000","last_change":"2023-12-16T03:27:00.524413+0000","last_active":"2023-12-16T03:27:01.539194+0000","last_peered":"2023-12-16T03:27:01.539194+0000","last_clean":"2023-12-16T03:27:01.539194+0000","last_became_active":"2023-12-16T03:27:00.524142+0000","last_became_peered":"2023-12-16T03:27:00.524142+0000","last_unstale":"2023-12-16T03:27:01.539194+0000","last_undegraded":"2023-12-16T03:27:01.539194+0000","last_fullsized":"2023-12-16T03:27:01.539194+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522435+0000","last_change":"2023-12-16T03:27:01.518068+0000","last_active":"2023-12-16T03:27:02.522435+0000","last_peered":"2023-12-16T03:27:02.522435+0000","last_clean":"2023-12-16T03:27:02.522435+0000","last_became_active":"2023-12-16T03:27:01.516800+0000","last_became_peered":"2023-12-16T03:27:01.516800+0000","last_unstale":"2023-12-16T03:27:02.522435+0000","last_undegraded":"2023-12-16T03:27:02.522435+0000","last_fullsized":"2023-12-16T03:27:02.522435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.501113+0000","last_change":"2023-12-16T03:27:00.515007+0000","last_active":"2023-12-16T03:27:01.501113+0000","last_peered":"2023-12-16T03:27:01.501113+0000","last_clean":"2023-12-16T03:27:01.501113+0000","last_became_active":"2023-12-16T03:27:00.514820+0000","last_became_peered":"2023-12-16T03:27:00.514820+0000","last_unstale":"2023-12-16T03:27:01.501113+0000","last_undegraded":"2023-12-16T03:27:01.501113+0000","last_fullsized":"2023-12-16T03:27:01.501113+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:03:53.754918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.532027+0000","last_change":"2023-12-16T03:27:01.522052+0000","last_active":"2023-12-16T03:27:01.532027+0000","last_peered":"2023-12-16T03:27:01.532027+0000","last_clean":"2023-12-16T03:27:01.532027+0000","last_became_active":"2023-12-16T03:27:01.521669+0000","last_became_peered":"2023-12-16T03:27:01.521669+0000","last_unstale":"2023-12-16T03:27:01.532027+0000","last_undegraded":"2023-12-16T03:27:01.532027+0000","last_fullsized":"2023-12-16T03:27:01.532027+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:47:05.676237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.507782+0000","last_change":"2023-12-16T03:27:00.516627+0000","last_active":"2023-12-16T03:27:01.507782+0000","last_peered":"2023-12-16T03:27:01.507782+0000","last_clean":"2023-12-16T03:27:01.507782+0000","last_became_active":"2023-12-16T03:27:00.516381+0000","last_became_peered":"2023-12-16T03:27:00.516381+0000","last_unstale":"2023-12-16T03:27:01.507782+0000","last_undegraded":"2023-12-16T03:27:01.507782+0000","last_fullsized":"2023-12-16T03:27:01.507782+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539754+0000","last_change":"2023-12-16T03:27:01.522194+0000","last_active":"2023-12-16T03:27:01.539754+0000","last_peered":"2023-12-16T03:27:01.539754+0000","last_clean":"2023-12-16T03:27:01.539754+0000","last_became_active":"2023-12-16T03:27:01.521667+0000","last_became_peered":"2023-12-16T03:27:01.521667+0000","last_unstale":"2023-12-16T03:27:01.539754+0000","last_undegraded":"2023-12-16T03:27:01.539754+0000","last_fullsized":"2023-12-16T03:27:01.539754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:44.457252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522182+0000","last_change":"2023-12-16T03:27:00.511361+0000","last_active":"2023-12-16T03:27:02.522182+0000","last_peered":"2023-12-16T03:27:02.522182+0000","last_clean":"2023-12-16T03:27:02.522182+0000","last_became_active":"2023-12-16T03:27:00.511033+0000","last_became_peered":"2023-12-16T03:27:00.511033+0000","last_unstale":"2023-12-16T03:27:02.522182+0000","last_undegraded":"2023-12-16T03:27:02.522182+0000","last_fullsized":"2023-12-16T03:27:02.522182+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:48.295530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517738+0000","last_change":"2023-12-16T03:27:01.524848+0000","last_active":"2023-12-16T03:27:02.517738+0000","last_peered":"2023-12-16T03:27:02.517738+0000","last_clean":"2023-12-16T03:27:02.517738+0000","last_became_active":"2023-12-16T03:27:01.524561+0000","last_became_peered":"2023-12-16T03:27:01.524561+0000","last_unstale":"2023-12-16T03:27:02.517738+0000","last_undegraded":"2023-12-16T03:27:02.517738+0000","last_fullsized":"2023-12-16T03:27:02.517738+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.908171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.512682+0000","last_change":"2023-12-16T03:27:00.513344+0000","last_active":"2023-12-16T03:27:01.512682+0000","last_peered":"2023-12-16T03:27:01.512682+0000","last_clean":"2023-12-16T03:27:01.512682+0000","last_became_active":"2023-12-16T03:27:00.513101+0000","last_became_peered":"2023-12-16T03:27:00.513101+0000","last_unstale":"2023-12-16T03:27:01.512682+0000","last_undegraded":"2023-12-16T03:27:01.512682+0000","last_fullsized":"2023-12-16T03:27:01.512682+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:34.745808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.545628+0000","last_change":"2023-12-16T03:27:01.543099+0000","last_active":"2023-12-16T03:27:01.545628+0000","last_peered":"2023-12-16T03:27:01.545628+0000","last_clean":"2023-12-16T03:27:01.545628+0000","last_became_active":"2023-12-16T03:27:01.542711+0000","last_became_peered":"2023-12-16T03:27:01.542711+0000","last_unstale":"2023-12-16T03:27:01.545628+0000","last_undegraded":"2023-12-16T03:27:01.545628+0000","last_fullsized":"2023-12-16T03:27:01.545628+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:59.366673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521743+0000","last_change":"2023-12-16T03:27:00.513164+0000","last_active":"2023-12-16T03:27:02.521743+0000","last_peered":"2023-12-16T03:27:02.521743+0000","last_clean":"2023-12-16T03:27:02.521743+0000","last_became_active":"2023-12-16T03:27:00.512912+0000","last_became_peered":"2023-12-16T03:27:00.512912+0000","last_unstale":"2023-12-16T03:27:02.521743+0000","last_undegraded":"2023-12-16T03:27:02.521743+0000","last_fullsized":"2023-12-16T03:27:02.521743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.532156+0000","last_change":"2023-12-16T03:27:01.521887+0000","last_active":"2023-12-16T03:27:01.532156+0000","last_peered":"2023-12-16T03:27:01.532156+0000","last_clean":"2023-12-16T03:27:01.532156+0000","last_became_active":"2023-12-16T03:27:01.521554+0000","last_became_peered":"2023-12-16T03:27:01.521554+0000","last_unstale":"2023-12-16T03:27:01.532156+0000","last_undegraded":"2023-12-16T03:27:01.532156+0000","last_fullsized":"2023-12-16T03:27:01.532156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:29.070766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.511877+0000","last_change":"2023-12-16T03:27:00.512268+0000","last_active":"2023-12-16T03:27:01.511877+0000","last_peered":"2023-12-16T03:27:01.511877+0000","last_clean":"2023-12-16T03:27:01.511877+0000","last_became_active":"2023-12-16T03:27:00.511945+0000","last_became_peered":"2023-12-16T03:27:00.511945+0000","last_unstale":"2023-12-16T03:27:01.511877+0000","last_undegraded":"2023-12-16T03:27:01.511877+0000","last_fullsized":"2023-12-16T03:27:01.511877+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:49:40.657817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517644+0000","last_change":"2023-12-16T03:27:01.527192+0000","last_active":"2023-12-16T03:27:02.517644+0000","last_peered":"2023-12-16T03:27:02.517644+0000","last_clean":"2023-12-16T03:27:02.517644+0000","last_became_active":"2023-12-16T03:27:01.526892+0000","last_became_peered":"2023-12-16T03:27:01.526892+0000","last_unstale":"2023-12-16T03:27:02.517644+0000","last_undegraded":"2023-12-16T03:27:02.517644+0000","last_fullsized":"2023-12-16T03:27:02.517644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:00.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517517+0000","last_change":"2023-12-16T03:27:00.516056+0000","last_active":"2023-12-16T03:27:02.517517+0000","last_peered":"2023-12-16T03:27:02.517517+0000","last_clean":"2023-12-16T03:27:02.517517+0000","last_became_active":"2023-12-16T03:27:00.515763+0000","last_became_peered":"2023-12-16T03:27:00.515763+0000","last_unstale":"2023-12-16T03:27:02.517517+0000","last_undegraded":"2023-12-16T03:27:02.517517+0000","last_fullsized":"2023-12-16T03:27:02.517517+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:42.045050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517434+0000","last_change":"2023-12-16T03:27:01.520522+0000","last_active":"2023-12-16T03:27:02.517434+0000","last_peered":"2023-12-16T03:27:02.517434+0000","last_clean":"2023-12-16T03:27:02.517434+0000","last_became_active":"2023-12-16T03:27:01.520214+0000","last_became_peered":"2023-12-16T03:27:01.520214+0000","last_unstale":"2023-12-16T03:27:02.517434+0000","last_undegraded":"2023-12-16T03:27:02.517434+0000","last_fullsized":"2023-12-16T03:27:02.517434+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:42.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.506821+0000","last_change":"2023-12-16T03:27:00.514945+0000","last_active":"2023-12-16T03:27:01.506821+0000","last_peered":"2023-12-16T03:27:01.506821+0000","last_clean":"2023-12-16T03:27:01.506821+0000","last_became_active":"2023-12-16T03:27:00.514688+0000","last_became_peered":"2023-12-16T03:27:00.514688+0000","last_unstale":"2023-12-16T03:27:01.506821+0000","last_undegraded":"2023-12-16T03:27:01.506821+0000","last_fullsized":"2023-12-16T03:27:01.506821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-16T03:27:00.507093+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:27:00.507093+0000","last_peered":"2023-12-16T03:27:00.507093+0000","last_clean":"2023-12-16T03:27:00.507093+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:27:00.507093+0000","last_undegraded":"2023-12-16T03:27:00.507093+0000","last_fullsized":"2023-12-16T03:27:00.507093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":836061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.62}]},{"osd":2,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.78100000000000003}]},{"osd":3,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.54200000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76500000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.75}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":245533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.1890000000000001,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.752}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.6870000000000003,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.83599999999999997}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.2560000000000002,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.71999999999999997}]},{"osd":4,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.81499999999999995}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.61499999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.57099999999999995}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.73199999999999998}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70699999999999996}]},{"osd":4,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67500000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65800000000000003}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":598016,"data_stored":247145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.194,"5min":4.194,"15min":4.194},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.59299999999999997}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64100000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.1689999999999996,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.76700000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.2759999999999998,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.82099999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.84599999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.86399999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.60899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":245589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":5.4710000000000001,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":6.1189999999999998,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.29799999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.7890000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.39400000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.5779999999999998,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.67500000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.748}]},{"osd":6,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.6309999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":0.61499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":606208,"data_stored":251889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.433},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36399999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.495}]},{"osd":4,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":0.61699999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63}]},{"osd":7,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":245623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":4.3479999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.476,"5min":4.476,"15min":4.476},"last":0.56599999999999995}]},{"osd":2,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.4269999999999996,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.622}]},{"osd":3,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.6319999999999997,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.435},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.3849999999999998,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":7.5650000000000004,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.984,"5min":4.984,"15min":4.984},"last":0.64500000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":4.7720000000000002,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":7.6109999999999998,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.60399999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":7.681,"5min":7.681,"15min":7.681},"last":0.65300000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.8609999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1196032,"data_stored":838095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.1210000000000004,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.64100000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.1719999999999997,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.2350000000000003,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.58999999999999997}]},{"osd":3,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.0970000000000004,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.254,"5min":3.254,"15min":3.254},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":0.96099999999999997}]},{"osd":5,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.97499999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.3979999999999997,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.90400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:27:05.627 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:27:05.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc860d72640 1 Processor -- start 2023-12-16T03:27:05.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc860d72640 1 -- start start 2023-12-16T03:27:05.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc860d72640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc85c151e90 0x7fc85c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc860d72640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c0c7ea0 0x7fc85c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc860d72640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c06c860 con 0x7fc85c0c4e60 2023-12-16T03:27:05.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc860d72640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c0c8750 con 0x7fc85c151e90 2023-12-16T03:27:05.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc860d72640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1552d0 con 0x7fc85c0c7ea0 2023-12-16T03:27:05.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc85a59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc85c151e90 0x7fc85c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc853fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c0c7ea0 0x7fc85c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc853fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c0c7ea0 0x7fc85c06b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:40738/0 (socket says 172.21.15.28:40738) 2023-12-16T03:27:05.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc85a59c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc85c151e90 0x7fc85c0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:55434/0 (socket says 172.21.15.28:55434) 2023-12-16T03:27:05.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.804+0000 7fc853fff640 1 -- 172.21.15.28:0/3116808347 learned_addr learned my addr 172.21.15.28:0/3116808347 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:05.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.808+0000 7fc853fff640 1 -- 172.21.15.28:0/3116808347 >> v2:172.21.15.134:3300/0 conn(0x7fc85c151e90 msgr2=0x7fc85c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:05.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.808+0000 7fc853fff640 1 --2- 172.21.15.28:0/3116808347 >> v2:172.21.15.134:3300/0 conn(0x7fc85c151e90 0x7fc85c0c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.808+0000 7fc853fff640 1 -- 172.21.15.28:0/3116808347 >> v1:172.21.15.134:6789/0 conn(0x7fc85c0c4e60 legacy=0x7fc85c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.808+0000 7fc853fff640 1 -- 172.21.15.28:0/3116808347 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c154930 con 0x7fc85c0c7ea0 2023-12-16T03:27:05.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.808+0000 7fc85a59c640 1 --2- 172.21.15.28:0/3116808347 >> v2:172.21.15.134:3300/0 conn(0x7fc85c151e90 0x7fc85c0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:05.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.808+0000 7fc859d9b640 1 -- 172.21.15.28:0/3116808347 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347253909 0 0) 0x7fc85c06c860 con 0x7fc85c0c4e60 2023-12-16T03:27:05.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.808+0000 7fc853fff640 1 --2- 172.21.15.28:0/3116808347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c0c7ea0 0x7fc85c06b4a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc844009870 tx=0x7fc84401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29f69613d0140a7a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:05.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.808+0000 7fc859d9b640 1 -- 172.21.15.28:0/3116808347 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8440ab600 con 0x7fc85c0c7ea0 2023-12-16T03:27:05.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.808+0000 7fc859d9b640 1 -- 172.21.15.28:0/3116808347 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8440a7050 con 0x7fc85c0c7ea0 2023-12-16T03:27:05.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.808+0000 7fc859d9b640 1 -- 172.21.15.28:0/3116808347 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8440ab980 con 0x7fc85c0c7ea0 2023-12-16T03:27:05.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 -- 172.21.15.28:0/3116808347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c0c7ea0 msgr2=0x7fc85c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 --2- 172.21.15.28:0/3116808347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c0c7ea0 0x7fc85c06b4a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc844009870 tx=0x7fc84401c420 comp rx=0 tx=0).stop 2023-12-16T03:27:05.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 -- 172.21.15.28:0/3116808347 shutdown_connections 2023-12-16T03:27:05.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 --2- 172.21.15.28:0/3116808347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c0c7ea0 0x7fc85c06b4a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 --2- 172.21.15.28:0/3116808347 >> v2:172.21.15.134:3300/0 conn(0x7fc85c151e90 0x7fc85c0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 -- 172.21.15.28:0/3116808347 >> 172.21.15.28:0/3116808347 conn(0x7fc85c0ca170 msgr2=0x7fc85c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:05.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 -- 172.21.15.28:0/3116808347 shutdown_connections 2023-12-16T03:27:05.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 -- 172.21.15.28:0/3116808347 wait complete. 2023-12-16T03:27:05.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 Processor -- start 2023-12-16T03:27:05.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 -- start start 2023-12-16T03:27:05.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc85c0c4e60 0x7fc85c14e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85c0c7ea0 0x7fc85c0c0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c151e90 0x7fc85c157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c14c2c0 con 0x7fc85c0c4e60 2023-12-16T03:27:05.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1ed9d0 con 0x7fc85c0c7ea0 2023-12-16T03:27:05.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc860d72640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c14c580 con 0x7fc85c151e90 2023-12-16T03:27:05.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc85a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc85c0c4e60 0x7fc85c14e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc85a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc85c0c4e60 0x7fc85c14e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55010/0 (socket says 172.21.15.28:55010) 2023-12-16T03:27:05.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc85a59c640 1 -- 172.21.15.28:0/2502717763 learned_addr learned my addr 172.21.15.28:0/2502717763 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:05.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc853fff640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85c0c7ea0 0x7fc85c0c0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc85ad9d640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c151e90 0x7fc85c157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc85a59c640 1 -- 172.21.15.28:0/2502717763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c151e90 msgr2=0x7fc85c157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.812+0000 7fc85a59c640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c151e90 0x7fc85c157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc85a59c640 1 -- 172.21.15.28:0/2502717763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85c0c7ea0 msgr2=0x7fc85c0c0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc85a59c640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85c0c7ea0 0x7fc85c0c0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc85a59c640 1 -- 172.21.15.28:0/2502717763 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c009420 con 0x7fc85c0c4e60 2023-12-16T03:27:05.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc85a59c640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc85c0c4e60 0x7fc85c14e5f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00ebe0 tx=0x7fc84c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:05.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc852ffd640 1 -- 172.21.15.28:0/2502717763 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00eee0 con 0x7fc85c0c4e60 2023-12-16T03:27:05.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc852ffd640 1 -- 172.21.15.28:0/2502717763 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c00cc30 con 0x7fc85c0c4e60 2023-12-16T03:27:05.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc852ffd640 1 -- 172.21.15.28:0/2502717763 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c013470 con 0x7fc85c0c4e60 2023-12-16T03:27:05.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc860d72640 1 -- 172.21.15.28:0/2502717763 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8440094d0 con 0x7fc85c0c4e60 2023-12-16T03:27:05.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc860d72640 1 -- 172.21.15.28:0/2502717763 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c158170 con 0x7fc85c0c4e60 2023-12-16T03:27:05.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc860d72640 1 -- 172.21.15.28:0/2502717763 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c14c740 con 0x7fc85c0c4e60 2023-12-16T03:27:05.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc852ffd640 1 -- 172.21.15.28:0/2502717763 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc84c0135d0 con 0x7fc85c0c4e60 2023-12-16T03:27:05.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.816+0000 7fc852ffd640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc83c066470 0x7fc83c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:05.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.820+0000 7fc852ffd640 1 -- 172.21.15.28:0/2502717763 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc84c084140 con 0x7fc85c0c4e60 2023-12-16T03:27:05.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.820+0000 7fc853fff640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc83c066470 0x7fc83c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:05.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.820+0000 7fc853fff640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc83c066470 0x7fc83c068930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ad000 tx=0x7fc8440a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:05.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.824+0000 7fc852ffd640 1 -- 172.21.15.28:0/2502717763 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc84c051660 con 0x7fc85c0c4e60 2023-12-16T03:27:05.953 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:27:05.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:27:05.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.976+0000 7fc860d72640 1 -- 172.21.15.28:0/2502717763 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc85c14f300 con 0x7fc83c066470 2023-12-16T03:27:05.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.984+0000 7fc852ffd640 1 -- 172.21.15.28:0/2502717763 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289313 (secure 0 0 0) 0x7fc85c14f300 con 0x7fc83c066470 2023-12-16T03:27:05.990 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:05.991 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 -- 172.21.15.28:0/2502717763 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc83c066470 msgr2=0x7fc83c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc83c066470 0x7fc83c068930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ad000 tx=0x7fc8440a6000 comp rx=0 tx=0).stop 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 -- 172.21.15.28:0/2502717763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc85c0c4e60 msgr2=0x7fc85c14e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc85c0c4e60 0x7fc85c14e5f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00ebe0 tx=0x7fc84c00c520 comp rx=0 tx=0).stop 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 -- 172.21.15.28:0/2502717763 shutdown_connections 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc85c151e90 0x7fc85c157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc85c0c7ea0 0x7fc85c0c0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc83c066470 0x7fc83c068930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 --2- 172.21.15.28:0/2502717763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc85c0c4e60 0x7fc85c14e5f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 -- 172.21.15.28:0/2502717763 >> 172.21.15.28:0/2502717763 conn(0x7fc85c0ca170 msgr2=0x7fc85c0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 -- 172.21.15.28:0/2502717763 shutdown_connections 2023-12-16T03:27:05.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:05.988+0000 7fc860d72640 1 -- 172.21.15.28:0/2502717763 wait complete. 2023-12-16T03:27:06.011 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-12-16T03:27:05.820437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238632,"kb_used_data":5824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736088,"statfs":{"total":773094113280,"available":772849754112,"internally_reserved":0,"allocated":5963776,"data_stored":3162420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001030"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620803+0000","last_change":"2023-12-16T03:27:01.537420+0000","last_active":"2023-12-16T03:27:02.620803+0000","last_peered":"2023-12-16T03:27:02.620803+0000","last_clean":"2023-12-16T03:27:02.620803+0000","last_became_active":"2023-12-16T03:27:01.537176+0000","last_became_peered":"2023-12-16T03:27:01.537176+0000","last_unstale":"2023-12-16T03:27:02.620803+0000","last_undegraded":"2023-12-16T03:27:02.620803+0000","last_fullsized":"2023-12-16T03:27:02.620803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:23:26.860864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518261+0000","last_change":"2023-12-16T03:27:01.534498+0000","last_active":"2023-12-16T03:27:02.518261+0000","last_peered":"2023-12-16T03:27:02.518261+0000","last_clean":"2023-12-16T03:27:02.518261+0000","last_became_active":"2023-12-16T03:27:01.533730+0000","last_became_peered":"2023-12-16T03:27:01.533730+0000","last_unstale":"2023-12-16T03:27:02.518261+0000","last_undegraded":"2023-12-16T03:27:02.518261+0000","last_fullsized":"2023-12-16T03:27:02.518261+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:07.937228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.521514+0000","last_change":"2023-12-16T03:27:01.518121+0000","last_active":"2023-12-16T03:27:01.521514+0000","last_peered":"2023-12-16T03:27:01.521514+0000","last_clean":"2023-12-16T03:27:01.521514+0000","last_became_active":"2023-12-16T03:27:01.517826+0000","last_became_peered":"2023-12-16T03:27:01.517826+0000","last_unstale":"2023-12-16T03:27:01.521514+0000","last_undegraded":"2023-12-16T03:27:01.521514+0000","last_fullsized":"2023-12-16T03:27:01.521514+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:09.298222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521284+0000","last_change":"2023-12-16T03:27:01.531096+0000","last_active":"2023-12-16T03:27:02.521284+0000","last_peered":"2023-12-16T03:27:02.521284+0000","last_clean":"2023-12-16T03:27:02.521284+0000","last_became_active":"2023-12-16T03:27:01.530793+0000","last_became_peered":"2023-12-16T03:27:01.530793+0000","last_unstale":"2023-12-16T03:27:02.521284+0000","last_undegraded":"2023-12-16T03:27:02.521284+0000","last_fullsized":"2023-12-16T03:27:02.521284+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:59.366673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620647+0000","last_change":"2023-12-16T03:27:01.531904+0000","last_active":"2023-12-16T03:27:02.620647+0000","last_peered":"2023-12-16T03:27:02.620647+0000","last_clean":"2023-12-16T03:27:02.620647+0000","last_became_active":"2023-12-16T03:27:01.531705+0000","last_became_peered":"2023-12-16T03:27:01.531705+0000","last_unstale":"2023-12-16T03:27:02.620647+0000","last_undegraded":"2023-12-16T03:27:02.620647+0000","last_fullsized":"2023-12-16T03:27:02.620647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:24:38.684552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.541372+0000","last_change":"2023-12-16T03:27:01.537597+0000","last_active":"2023-12-16T03:27:01.541372+0000","last_peered":"2023-12-16T03:27:01.541372+0000","last_clean":"2023-12-16T03:27:01.541372+0000","last_became_active":"2023-12-16T03:27:01.537262+0000","last_became_peered":"2023-12-16T03:27:01.537262+0000","last_unstale":"2023-12-16T03:27:01.541372+0000","last_undegraded":"2023-12-16T03:27:01.541372+0000","last_fullsized":"2023-12-16T03:27:01.541372+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:54.171416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521060+0000","last_change":"2023-12-16T03:27:01.504710+0000","last_active":"2023-12-16T03:27:02.521060+0000","last_peered":"2023-12-16T03:27:02.521060+0000","last_clean":"2023-12-16T03:27:02.521060+0000","last_became_active":"2023-12-16T03:27:01.504412+0000","last_became_peered":"2023-12-16T03:27:01.504412+0000","last_unstale":"2023-12-16T03:27:02.521060+0000","last_undegraded":"2023-12-16T03:27:02.521060+0000","last_fullsized":"2023-12-16T03:27:02.521060+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:09.298222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517421+0000","last_change":"2023-12-16T03:27:01.514585+0000","last_active":"2023-12-16T03:27:02.517421+0000","last_peered":"2023-12-16T03:27:02.517421+0000","last_clean":"2023-12-16T03:27:02.517421+0000","last_became_active":"2023-12-16T03:27:01.514304+0000","last_became_peered":"2023-12-16T03:27:01.514304+0000","last_unstale":"2023-12-16T03:27:02.517421+0000","last_undegraded":"2023-12-16T03:27:02.517421+0000","last_fullsized":"2023-12-16T03:27:02.517421+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:44:59.949884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522137+0000","last_change":"2023-12-16T03:27:01.517287+0000","last_active":"2023-12-16T03:27:02.522137+0000","last_peered":"2023-12-16T03:27:02.522137+0000","last_clean":"2023-12-16T03:27:02.522137+0000","last_became_active":"2023-12-16T03:27:01.516865+0000","last_became_peered":"2023-12-16T03:27:01.516865+0000","last_unstale":"2023-12-16T03:27:02.522137+0000","last_undegraded":"2023-12-16T03:27:02.522137+0000","last_fullsized":"2023-12-16T03:27:02.522137+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:49.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.531565+0000","last_change":"2023-12-16T03:27:01.523610+0000","last_active":"2023-12-16T03:27:01.531565+0000","last_peered":"2023-12-16T03:27:01.531565+0000","last_clean":"2023-12-16T03:27:01.531565+0000","last_became_active":"2023-12-16T03:27:01.523269+0000","last_became_peered":"2023-12-16T03:27:01.523269+0000","last_unstale":"2023-12-16T03:27:01.531565+0000","last_undegraded":"2023-12-16T03:27:01.531565+0000","last_fullsized":"2023-12-16T03:27:01.531565+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:05.144244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539076+0000","last_change":"2023-12-16T03:27:01.534387+0000","last_active":"2023-12-16T03:27:01.539076+0000","last_peered":"2023-12-16T03:27:01.539076+0000","last_clean":"2023-12-16T03:27:01.539076+0000","last_became_active":"2023-12-16T03:27:01.534102+0000","last_became_peered":"2023-12-16T03:27:01.534102+0000","last_unstale":"2023-12-16T03:27:01.539076+0000","last_undegraded":"2023-12-16T03:27:01.539076+0000","last_fullsized":"2023-12-16T03:27:01.539076+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:41:05.091611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522015+0000","last_change":"2023-12-16T03:27:01.514907+0000","last_active":"2023-12-16T03:27:02.522015+0000","last_peered":"2023-12-16T03:27:02.522015+0000","last_clean":"2023-12-16T03:27:02.522015+0000","last_became_active":"2023-12-16T03:27:01.514396+0000","last_became_peered":"2023-12-16T03:27:01.514396+0000","last_unstale":"2023-12-16T03:27:02.522015+0000","last_undegraded":"2023-12-16T03:27:02.522015+0000","last_fullsized":"2023-12-16T03:27:02.522015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.534686+0000","last_change":"2023-12-16T03:27:01.533053+0000","last_active":"2023-12-16T03:27:01.534686+0000","last_peered":"2023-12-16T03:27:01.534686+0000","last_clean":"2023-12-16T03:27:01.534686+0000","last_became_active":"2023-12-16T03:27:01.532852+0000","last_became_peered":"2023-12-16T03:27:01.532852+0000","last_unstale":"2023-12-16T03:27:01.534686+0000","last_undegraded":"2023-12-16T03:27:01.534686+0000","last_fullsized":"2023-12-16T03:27:01.534686+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:49:41.666173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521644+0000","last_change":"2023-12-16T03:27:01.527464+0000","last_active":"2023-12-16T03:27:02.521644+0000","last_peered":"2023-12-16T03:27:02.521644+0000","last_clean":"2023-12-16T03:27:02.521644+0000","last_became_active":"2023-12-16T03:27:01.526439+0000","last_became_peered":"2023-12-16T03:27:01.526439+0000","last_unstale":"2023-12-16T03:27:02.521644+0000","last_undegraded":"2023-12-16T03:27:02.521644+0000","last_fullsized":"2023-12-16T03:27:02.521644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:55.347747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521374+0000","last_change":"2023-12-16T03:27:01.523106+0000","last_active":"2023-12-16T03:27:02.521374+0000","last_peered":"2023-12-16T03:27:02.521374+0000","last_clean":"2023-12-16T03:27:02.521374+0000","last_became_active":"2023-12-16T03:27:01.522824+0000","last_became_peered":"2023-12-16T03:27:01.522824+0000","last_unstale":"2023-12-16T03:27:02.521374+0000","last_undegraded":"2023-12-16T03:27:02.521374+0000","last_fullsized":"2023-12-16T03:27:02.521374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:04.563786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.526073+0000","last_change":"2023-12-16T03:27:01.513664+0000","last_active":"2023-12-16T03:27:01.526073+0000","last_peered":"2023-12-16T03:27:01.526073+0000","last_clean":"2023-12-16T03:27:01.526073+0000","last_became_active":"2023-12-16T03:27:01.513325+0000","last_became_peered":"2023-12-16T03:27:01.513325+0000","last_unstale":"2023-12-16T03:27:01.526073+0000","last_undegraded":"2023-12-16T03:27:01.526073+0000","last_fullsized":"2023-12-16T03:27:01.526073+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:09.298222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518510+0000","last_change":"2023-12-16T03:27:01.526203+0000","last_active":"2023-12-16T03:27:02.518510+0000","last_peered":"2023-12-16T03:27:02.518510+0000","last_clean":"2023-12-16T03:27:02.518510+0000","last_became_active":"2023-12-16T03:27:01.525873+0000","last_became_peered":"2023-12-16T03:27:01.525873+0000","last_unstale":"2023-12-16T03:27:02.518510+0000","last_undegraded":"2023-12-16T03:27:02.518510+0000","last_fullsized":"2023-12-16T03:27:02.518510+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:37:50.321166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.534373+0000","last_change":"2023-12-16T03:27:01.529407+0000","last_active":"2023-12-16T03:27:01.534373+0000","last_peered":"2023-12-16T03:27:01.534373+0000","last_clean":"2023-12-16T03:27:01.534373+0000","last_became_active":"2023-12-16T03:27:01.529024+0000","last_became_peered":"2023-12-16T03:27:01.529024+0000","last_unstale":"2023-12-16T03:27:01.534373+0000","last_undegraded":"2023-12-16T03:27:01.534373+0000","last_fullsized":"2023-12-16T03:27:01.534373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:49.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620695+0000","last_change":"2023-12-16T03:27:01.538362+0000","last_active":"2023-12-16T03:27:02.620695+0000","last_peered":"2023-12-16T03:27:02.620695+0000","last_clean":"2023-12-16T03:27:02.620695+0000","last_became_active":"2023-12-16T03:27:01.538024+0000","last_became_peered":"2023-12-16T03:27:01.538024+0000","last_unstale":"2023-12-16T03:27:02.620695+0000","last_undegraded":"2023-12-16T03:27:02.620695+0000","last_fullsized":"2023-12-16T03:27:02.620695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:44.941057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518035+0000","last_change":"2023-12-16T03:27:01.535927+0000","last_active":"2023-12-16T03:27:02.518035+0000","last_peered":"2023-12-16T03:27:02.518035+0000","last_clean":"2023-12-16T03:27:02.518035+0000","last_became_active":"2023-12-16T03:27:01.535618+0000","last_became_peered":"2023-12-16T03:27:01.535618+0000","last_unstale":"2023-12-16T03:27:02.518035+0000","last_undegraded":"2023-12-16T03:27:02.518035+0000","last_fullsized":"2023-12-16T03:27:02.518035+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:46.786632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.528977+0000","last_change":"2023-12-16T03:27:01.520051+0000","last_active":"2023-12-16T03:27:01.528977+0000","last_peered":"2023-12-16T03:27:01.528977+0000","last_clean":"2023-12-16T03:27:01.528977+0000","last_became_active":"2023-12-16T03:27:01.519803+0000","last_became_peered":"2023-12-16T03:27:01.519803+0000","last_unstale":"2023-12-16T03:27:01.528977+0000","last_undegraded":"2023-12-16T03:27:01.528977+0000","last_fullsized":"2023-12-16T03:27:01.528977+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:08.574639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517483+0000","last_change":"2023-12-16T03:27:01.523786+0000","last_active":"2023-12-16T03:27:02.517483+0000","last_peered":"2023-12-16T03:27:02.517483+0000","last_clean":"2023-12-16T03:27:02.517483+0000","last_became_active":"2023-12-16T03:27:01.523435+0000","last_became_peered":"2023-12-16T03:27:01.523435+0000","last_unstale":"2023-12-16T03:27:02.517483+0000","last_undegraded":"2023-12-16T03:27:02.517483+0000","last_fullsized":"2023-12-16T03:27:02.517483+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:59:37.033807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.543392+0000","last_change":"2023-12-16T03:27:01.539536+0000","last_active":"2023-12-16T03:27:01.543392+0000","last_peered":"2023-12-16T03:27:01.543392+0000","last_clean":"2023-12-16T03:27:01.543392+0000","last_became_active":"2023-12-16T03:27:01.539210+0000","last_became_peered":"2023-12-16T03:27:01.539210+0000","last_unstale":"2023-12-16T03:27:01.543392+0000","last_undegraded":"2023-12-16T03:27:01.543392+0000","last_fullsized":"2023-12-16T03:27:01.543392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:03:54.763274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.531238+0000","last_change":"2023-12-16T03:27:01.521374+0000","last_active":"2023-12-16T03:27:01.531238+0000","last_peered":"2023-12-16T03:27:01.531238+0000","last_clean":"2023-12-16T03:27:01.531238+0000","last_became_active":"2023-12-16T03:27:01.521080+0000","last_became_peered":"2023-12-16T03:27:01.521080+0000","last_unstale":"2023-12-16T03:27:01.531238+0000","last_undegraded":"2023-12-16T03:27:01.531238+0000","last_fullsized":"2023-12-16T03:27:01.531238+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:06:05.144244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620868+0000","last_change":"2023-12-16T03:27:01.537212+0000","last_active":"2023-12-16T03:27:02.620868+0000","last_peered":"2023-12-16T03:27:02.620868+0000","last_clean":"2023-12-16T03:27:02.620868+0000","last_became_active":"2023-12-16T03:27:01.536927+0000","last_became_peered":"2023-12-16T03:27:01.536927+0000","last_unstale":"2023-12-16T03:27:02.620868+0000","last_undegraded":"2023-12-16T03:27:02.620868+0000","last_fullsized":"2023-12-16T03:27:02.620868+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:59.764629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522228+0000","last_change":"2023-12-16T03:27:01.506167+0000","last_active":"2023-12-16T03:27:02.522228+0000","last_peered":"2023-12-16T03:27:02.522228+0000","last_clean":"2023-12-16T03:27:02.522228+0000","last_became_active":"2023-12-16T03:27:01.505856+0000","last_became_peered":"2023-12-16T03:27:01.505856+0000","last_unstale":"2023-12-16T03:27:02.522228+0000","last_undegraded":"2023-12-16T03:27:02.522228+0000","last_fullsized":"2023-12-16T03:27:02.522228+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.528124+0000","last_change":"2023-12-16T03:27:01.514340+0000","last_active":"2023-12-16T03:27:01.528124+0000","last_peered":"2023-12-16T03:27:01.528124+0000","last_clean":"2023-12-16T03:27:01.528124+0000","last_became_active":"2023-12-16T03:27:01.514047+0000","last_became_peered":"2023-12-16T03:27:01.514047+0000","last_unstale":"2023-12-16T03:27:01.528124+0000","last_undegraded":"2023-12-16T03:27:01.528124+0000","last_fullsized":"2023-12-16T03:27:01.528124+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620667+0000","last_change":"2023-12-16T03:27:01.531612+0000","last_active":"2023-12-16T03:27:02.620667+0000","last_peered":"2023-12-16T03:27:02.620667+0000","last_clean":"2023-12-16T03:27:02.620667+0000","last_became_active":"2023-12-16T03:27:01.531274+0000","last_became_peered":"2023-12-16T03:27:01.531274+0000","last_unstale":"2023-12-16T03:27:02.620667+0000","last_undegraded":"2023-12-16T03:27:02.620667+0000","last_fullsized":"2023-12-16T03:27:02.620667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:58.878396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517994+0000","last_change":"2023-12-16T03:27:01.527562+0000","last_active":"2023-12-16T03:27:02.517994+0000","last_peered":"2023-12-16T03:27:02.517994+0000","last_clean":"2023-12-16T03:27:02.517994+0000","last_became_active":"2023-12-16T03:27:01.525171+0000","last_became_peered":"2023-12-16T03:27:01.525171+0000","last_unstale":"2023-12-16T03:27:02.517994+0000","last_undegraded":"2023-12-16T03:27:02.517994+0000","last_fullsized":"2023-12-16T03:27:02.517994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:02:55.385594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.521232+0000","last_change":"2023-12-16T03:27:01.518371+0000","last_active":"2023-12-16T03:27:01.521232+0000","last_peered":"2023-12-16T03:27:01.521232+0000","last_clean":"2023-12-16T03:27:01.521232+0000","last_became_active":"2023-12-16T03:27:01.518088+0000","last_became_peered":"2023-12-16T03:27:01.518088+0000","last_unstale":"2023-12-16T03:27:01.521232+0000","last_undegraded":"2023-12-16T03:27:01.521232+0000","last_fullsized":"2023-12-16T03:27:01.521232+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:47:34.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.620568+0000","last_change":"2023-12-16T03:27:01.532530+0000","last_active":"2023-12-16T03:27:02.620568+0000","last_peered":"2023-12-16T03:27:02.620568+0000","last_clean":"2023-12-16T03:27:02.620568+0000","last_became_active":"2023-12-16T03:27:01.532228+0000","last_became_peered":"2023-12-16T03:27:01.532228+0000","last_unstale":"2023-12-16T03:27:02.620568+0000","last_undegraded":"2023-12-16T03:27:02.620568+0000","last_fullsized":"2023-12-16T03:27:02.620568+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.578189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539886+0000","last_change":"2023-12-16T03:27:01.526590+0000","last_active":"2023-12-16T03:27:01.539886+0000","last_peered":"2023-12-16T03:27:01.539886+0000","last_clean":"2023-12-16T03:27:01.539886+0000","last_became_active":"2023-12-16T03:27:01.525400+0000","last_became_peered":"2023-12-16T03:27:01.525400+0000","last_unstale":"2023-12-16T03:27:01.539886+0000","last_undegraded":"2023-12-16T03:27:01.539886+0000","last_fullsized":"2023-12-16T03:27:01.539886+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:49.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539539+0000","last_change":"2023-12-16T03:27:01.519301+0000","last_active":"2023-12-16T03:27:01.539539+0000","last_peered":"2023-12-16T03:27:01.539539+0000","last_clean":"2023-12-16T03:27:01.539539+0000","last_became_active":"2023-12-16T03:27:01.519011+0000","last_became_peered":"2023-12-16T03:27:01.519011+0000","last_unstale":"2023-12-16T03:27:01.539539+0000","last_undegraded":"2023-12-16T03:27:01.539539+0000","last_fullsized":"2023-12-16T03:27:01.539539+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:08.574639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.546371+0000","last_change":"2023-12-16T03:27:00.515238+0000","last_active":"2023-12-16T03:27:01.546371+0000","last_peered":"2023-12-16T03:27:01.546371+0000","last_clean":"2023-12-16T03:27:01.546371+0000","last_became_active":"2023-12-16T03:27:00.514968+0000","last_became_peered":"2023-12-16T03:27:00.514968+0000","last_unstale":"2023-12-16T03:27:01.546371+0000","last_undegraded":"2023-12-16T03:27:01.546371+0000","last_fullsized":"2023-12-16T03:27:01.546371+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.532190+0000","last_change":"2023-12-16T03:27:01.522872+0000","last_active":"2023-12-16T03:27:01.532190+0000","last_peered":"2023-12-16T03:27:01.532190+0000","last_clean":"2023-12-16T03:27:01.532190+0000","last_became_active":"2023-12-16T03:27:01.522260+0000","last_became_peered":"2023-12-16T03:27:01.522260+0000","last_unstale":"2023-12-16T03:27:01.532190+0000","last_undegraded":"2023-12-16T03:27:01.532190+0000","last_fullsized":"2023-12-16T03:27:01.532190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:20:49.328346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518188+0000","last_change":"2023-12-16T03:27:00.521097+0000","last_active":"2023-12-16T03:27:02.518188+0000","last_peered":"2023-12-16T03:27:02.518188+0000","last_clean":"2023-12-16T03:27:02.518188+0000","last_became_active":"2023-12-16T03:27:00.520800+0000","last_became_peered":"2023-12-16T03:27:00.520800+0000","last_unstale":"2023-12-16T03:27:02.518188+0000","last_undegraded":"2023-12-16T03:27:02.518188+0000","last_fullsized":"2023-12-16T03:27:02.518188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:38:52.347850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.543212+0000","last_change":"2023-12-16T03:27:01.528475+0000","last_active":"2023-12-16T03:27:01.543212+0000","last_peered":"2023-12-16T03:27:01.543212+0000","last_clean":"2023-12-16T03:27:01.543212+0000","last_became_active":"2023-12-16T03:27:01.527985+0000","last_became_peered":"2023-12-16T03:27:01.527985+0000","last_unstale":"2023-12-16T03:27:01.543212+0000","last_undegraded":"2023-12-16T03:27:01.543212+0000","last_fullsized":"2023-12-16T03:27:01.543212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:55.347747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539812+0000","last_change":"2023-12-16T03:27:00.516992+0000","last_active":"2023-12-16T03:27:01.539812+0000","last_peered":"2023-12-16T03:27:01.539812+0000","last_clean":"2023-12-16T03:27:01.539812+0000","last_became_active":"2023-12-16T03:27:00.515339+0000","last_became_peered":"2023-12-16T03:27:00.515339+0000","last_unstale":"2023-12-16T03:27:01.539812+0000","last_undegraded":"2023-12-16T03:27:01.539812+0000","last_fullsized":"2023-12-16T03:27:01.539812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:58.358317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539728+0000","last_change":"2023-12-16T03:27:01.522006+0000","last_active":"2023-12-16T03:27:01.539728+0000","last_peered":"2023-12-16T03:27:01.539728+0000","last_clean":"2023-12-16T03:27:01.539728+0000","last_became_active":"2023-12-16T03:27:01.520949+0000","last_became_peered":"2023-12-16T03:27:01.520949+0000","last_unstale":"2023-12-16T03:27:01.539728+0000","last_undegraded":"2023-12-16T03:27:01.539728+0000","last_fullsized":"2023-12-16T03:27:01.539728+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:11.703476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522116+0000","last_change":"2023-12-16T03:27:00.515665+0000","last_active":"2023-12-16T03:27:02.522116+0000","last_peered":"2023-12-16T03:27:02.522116+0000","last_clean":"2023-12-16T03:27:02.522116+0000","last_became_active":"2023-12-16T03:27:00.514766+0000","last_became_peered":"2023-12-16T03:27:00.514766+0000","last_unstale":"2023-12-16T03:27:02.522116+0000","last_undegraded":"2023-12-16T03:27:02.522116+0000","last_fullsized":"2023-12-16T03:27:02.522116+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:54.339391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517703+0000","last_change":"2023-12-16T03:27:01.523755+0000","last_active":"2023-12-16T03:27:02.517703+0000","last_peered":"2023-12-16T03:27:02.517703+0000","last_clean":"2023-12-16T03:27:02.517703+0000","last_became_active":"2023-12-16T03:27:01.523179+0000","last_became_peered":"2023-12-16T03:27:01.523179+0000","last_unstale":"2023-12-16T03:27:02.517703+0000","last_undegraded":"2023-12-16T03:27:02.517703+0000","last_fullsized":"2023-12-16T03:27:02.517703+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:20:11.416554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521932+0000","last_change":"2023-12-16T03:27:00.512400+0000","last_active":"2023-12-16T03:27:02.521932+0000","last_peered":"2023-12-16T03:27:02.521932+0000","last_clean":"2023-12-16T03:27:02.521932+0000","last_became_active":"2023-12-16T03:27:00.512120+0000","last_became_peered":"2023-12-16T03:27:00.512120+0000","last_unstale":"2023-12-16T03:27:02.521932+0000","last_undegraded":"2023-12-16T03:27:02.521932+0000","last_fullsized":"2023-12-16T03:27:02.521932+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:32:09.899662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517854+0000","last_change":"2023-12-16T03:27:01.536014+0000","last_active":"2023-12-16T03:27:02.517854+0000","last_peered":"2023-12-16T03:27:02.517854+0000","last_clean":"2023-12-16T03:27:02.517854+0000","last_became_active":"2023-12-16T03:27:01.535729+0000","last_became_peered":"2023-12-16T03:27:01.535729+0000","last_unstale":"2023-12-16T03:27:02.517854+0000","last_undegraded":"2023-12-16T03:27:02.517854+0000","last_fullsized":"2023-12-16T03:27:02.517854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:22:11.774067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539770+0000","last_change":"2023-12-16T03:27:00.513060+0000","last_active":"2023-12-16T03:27:01.539770+0000","last_peered":"2023-12-16T03:27:01.539770+0000","last_clean":"2023-12-16T03:27:01.539770+0000","last_became_active":"2023-12-16T03:27:00.512780+0000","last_became_peered":"2023-12-16T03:27:00.512780+0000","last_unstale":"2023-12-16T03:27:01.539770+0000","last_undegraded":"2023-12-16T03:27:01.539770+0000","last_fullsized":"2023-12-16T03:27:01.539770+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:03.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.531219+0000","last_change":"2023-12-16T03:27:01.520984+0000","last_active":"2023-12-16T03:27:01.531219+0000","last_peered":"2023-12-16T03:27:01.531219+0000","last_clean":"2023-12-16T03:27:01.531219+0000","last_became_active":"2023-12-16T03:27:01.520045+0000","last_became_peered":"2023-12-16T03:27:01.520045+0000","last_unstale":"2023-12-16T03:27:01.531219+0000","last_undegraded":"2023-12-16T03:27:01.531219+0000","last_fullsized":"2023-12-16T03:27:01.531219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:35.754164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.520866+0000","last_change":"2023-12-16T03:27:00.513568+0000","last_active":"2023-12-16T03:27:02.520866+0000","last_peered":"2023-12-16T03:27:02.520866+0000","last_clean":"2023-12-16T03:27:02.520866+0000","last_became_active":"2023-12-16T03:27:00.513294+0000","last_became_peered":"2023-12-16T03:27:00.513294+0000","last_unstale":"2023-12-16T03:27:02.520866+0000","last_undegraded":"2023-12-16T03:27:02.520866+0000","last_fullsized":"2023-12-16T03:27:02.520866+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517520+0000","last_change":"2023-12-16T03:27:01.526843+0000","last_active":"2023-12-16T03:27:02.517520+0000","last_peered":"2023-12-16T03:27:02.517520+0000","last_clean":"2023-12-16T03:27:02.517520+0000","last_became_active":"2023-12-16T03:27:01.525795+0000","last_became_peered":"2023-12-16T03:27:01.525795+0000","last_unstale":"2023-12-16T03:27:02.517520+0000","last_undegraded":"2023-12-16T03:27:02.517520+0000","last_fullsized":"2023-12-16T03:27:02.517520+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:53.633088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.520945+0000","last_change":"2023-12-16T03:27:00.520498+0000","last_active":"2023-12-16T03:27:02.520945+0000","last_peered":"2023-12-16T03:27:02.520945+0000","last_clean":"2023-12-16T03:27:02.520945+0000","last_became_active":"2023-12-16T03:27:00.520179+0000","last_became_peered":"2023-12-16T03:27:00.520179+0000","last_unstale":"2023-12-16T03:27:02.520945+0000","last_undegraded":"2023-12-16T03:27:02.520945+0000","last_fullsized":"2023-12-16T03:27:02.520945+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:36.834249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521760+0000","last_change":"2023-12-16T03:27:01.525335+0000","last_active":"2023-12-16T03:27:02.521760+0000","last_peered":"2023-12-16T03:27:02.521760+0000","last_clean":"2023-12-16T03:27:02.521760+0000","last_became_active":"2023-12-16T03:27:01.524994+0000","last_became_peered":"2023-12-16T03:27:01.524994+0000","last_unstale":"2023-12-16T03:27:02.521760+0000","last_undegraded":"2023-12-16T03:27:02.521760+0000","last_fullsized":"2023-12-16T03:27:02.521760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:08.574639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.507941+0000","last_change":"2023-12-16T03:27:00.516706+0000","last_active":"2023-12-16T03:27:01.507941+0000","last_peered":"2023-12-16T03:27:01.507941+0000","last_clean":"2023-12-16T03:27:01.507941+0000","last_became_active":"2023-12-16T03:27:00.516403+0000","last_became_peered":"2023-12-16T03:27:00.516403+0000","last_unstale":"2023-12-16T03:27:01.507941+0000","last_undegraded":"2023-12-16T03:27:01.507941+0000","last_fullsized":"2023-12-16T03:27:01.507941+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:27.966699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.529744+0000","last_change":"2023-12-16T03:27:01.526628+0000","last_active":"2023-12-16T03:27:01.529744+0000","last_peered":"2023-12-16T03:27:01.529744+0000","last_clean":"2023-12-16T03:27:01.529744+0000","last_became_active":"2023-12-16T03:27:01.526319+0000","last_became_peered":"2023-12-16T03:27:01.526319+0000","last_unstale":"2023-12-16T03:27:01.529744+0000","last_undegraded":"2023-12-16T03:27:01.529744+0000","last_fullsized":"2023-12-16T03:27:01.529744+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:04.563786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518268+0000","last_change":"2023-12-16T03:27:00.524203+0000","last_active":"2023-12-16T03:27:02.518268+0000","last_peered":"2023-12-16T03:27:02.518268+0000","last_clean":"2023-12-16T03:27:02.518268+0000","last_became_active":"2023-12-16T03:27:00.523807+0000","last_became_peered":"2023-12-16T03:27:00.523807+0000","last_unstale":"2023-12-16T03:27:02.518268+0000","last_undegraded":"2023-12-16T03:27:02.518268+0000","last_fullsized":"2023-12-16T03:27:02.518268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:07:50.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.538943+0000","last_change":"2023-12-16T03:27:01.533076+0000","last_active":"2023-12-16T03:27:01.538943+0000","last_peered":"2023-12-16T03:27:01.538943+0000","last_clean":"2023-12-16T03:27:01.538943+0000","last_became_active":"2023-12-16T03:27:01.532721+0000","last_became_peered":"2023-12-16T03:27:01.532721+0000","last_unstale":"2023-12-16T03:27:01.538943+0000","last_undegraded":"2023-12-16T03:27:01.538943+0000","last_fullsized":"2023-12-16T03:27:01.538943+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:31.675848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.538942+0000","last_change":"2023-12-16T03:27:00.521385+0000","last_active":"2023-12-16T03:27:01.538942+0000","last_peered":"2023-12-16T03:27:01.538942+0000","last_clean":"2023-12-16T03:27:01.538942+0000","last_became_active":"2023-12-16T03:27:00.521116+0000","last_became_peered":"2023-12-16T03:27:00.521116+0000","last_unstale":"2023-12-16T03:27:01.538942+0000","last_undegraded":"2023-12-16T03:27:01.538942+0000","last_fullsized":"2023-12-16T03:27:01.538942+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.529561+0000","last_change":"2023-12-16T03:27:01.522382+0000","last_active":"2023-12-16T03:27:01.529561+0000","last_peered":"2023-12-16T03:27:01.529561+0000","last_clean":"2023-12-16T03:27:01.529561+0000","last_became_active":"2023-12-16T03:27:01.522101+0000","last_became_peered":"2023-12-16T03:27:01.522101+0000","last_unstale":"2023-12-16T03:27:01.529561+0000","last_undegraded":"2023-12-16T03:27:01.529561+0000","last_fullsized":"2023-12-16T03:27:01.529561+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:55.347747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521851+0000","last_change":"2023-12-16T03:27:00.514824+0000","last_active":"2023-12-16T03:27:02.521851+0000","last_peered":"2023-12-16T03:27:02.521851+0000","last_clean":"2023-12-16T03:27:02.521851+0000","last_became_active":"2023-12-16T03:27:00.514574+0000","last_became_peered":"2023-12-16T03:27:00.514574+0000","last_unstale":"2023-12-16T03:27:02.521851+0000","last_undegraded":"2023-12-16T03:27:02.521851+0000","last_fullsized":"2023-12-16T03:27:02.521851+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:49.770339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521171+0000","last_change":"2023-12-16T03:27:01.523308+0000","last_active":"2023-12-16T03:27:02.521171+0000","last_peered":"2023-12-16T03:27:02.521171+0000","last_clean":"2023-12-16T03:27:02.521171+0000","last_became_active":"2023-12-16T03:27:01.522582+0000","last_became_peered":"2023-12-16T03:27:01.522582+0000","last_unstale":"2023-12-16T03:27:02.521171+0000","last_undegraded":"2023-12-16T03:27:02.521171+0000","last_fullsized":"2023-12-16T03:27:02.521171+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:44.457252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517837+0000","last_change":"2023-12-16T03:27:00.524023+0000","last_active":"2023-12-16T03:27:02.517837+0000","last_peered":"2023-12-16T03:27:02.517837+0000","last_clean":"2023-12-16T03:27:02.517837+0000","last_became_active":"2023-12-16T03:27:00.523742+0000","last_became_peered":"2023-12-16T03:27:00.523742+0000","last_unstale":"2023-12-16T03:27:02.517837+0000","last_undegraded":"2023-12-16T03:27:02.517837+0000","last_fullsized":"2023-12-16T03:27:02.517837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:09:52.558814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.528878+0000","last_change":"2023-12-16T03:27:01.519766+0000","last_active":"2023-12-16T03:27:01.528878+0000","last_peered":"2023-12-16T03:27:01.528878+0000","last_clean":"2023-12-16T03:27:01.528878+0000","last_became_active":"2023-12-16T03:27:01.519473+0000","last_became_peered":"2023-12-16T03:27:01.519473+0000","last_unstale":"2023-12-16T03:27:01.528878+0000","last_undegraded":"2023-12-16T03:27:01.528878+0000","last_fullsized":"2023-12-16T03:27:01.528878+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:44.457252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.507683+0000","last_change":"2023-12-16T03:27:00.518062+0000","last_active":"2023-12-16T03:27:01.507683+0000","last_peered":"2023-12-16T03:27:01.507683+0000","last_clean":"2023-12-16T03:27:01.507683+0000","last_became_active":"2023-12-16T03:27:00.517664+0000","last_became_peered":"2023-12-16T03:27:00.517664+0000","last_unstale":"2023-12-16T03:27:01.507683+0000","last_undegraded":"2023-12-16T03:27:01.507683+0000","last_fullsized":"2023-12-16T03:27:01.507683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:47:04.667881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.520862+0000","last_change":"2023-12-16T03:27:01.514600+0000","last_active":"2023-12-16T03:27:02.520862+0000","last_peered":"2023-12-16T03:27:02.520862+0000","last_clean":"2023-12-16T03:27:02.520862+0000","last_became_active":"2023-12-16T03:27:01.514262+0000","last_became_peered":"2023-12-16T03:27:01.514262+0000","last_unstale":"2023-12-16T03:27:02.520862+0000","last_undegraded":"2023-12-16T03:27:02.520862+0000","last_fullsized":"2023-12-16T03:27:02.520862+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:28.975055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.520992+0000","last_change":"2023-12-16T03:27:00.514189+0000","last_active":"2023-12-16T03:27:02.520992+0000","last_peered":"2023-12-16T03:27:02.520992+0000","last_clean":"2023-12-16T03:27:02.520992+0000","last_became_active":"2023-12-16T03:27:00.513862+0000","last_became_peered":"2023-12-16T03:27:00.513862+0000","last_unstale":"2023-12-16T03:27:02.520992+0000","last_undegraded":"2023-12-16T03:27:02.520992+0000","last_fullsized":"2023-12-16T03:27:02.520992+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.545613+0000","last_change":"2023-12-16T03:27:01.540186+0000","last_active":"2023-12-16T03:27:01.545613+0000","last_peered":"2023-12-16T03:27:01.545613+0000","last_clean":"2023-12-16T03:27:01.545613+0000","last_became_active":"2023-12-16T03:27:01.539206+0000","last_became_peered":"2023-12-16T03:27:01.539206+0000","last_unstale":"2023-12-16T03:27:01.545613+0000","last_undegraded":"2023-12-16T03:27:01.545613+0000","last_fullsized":"2023-12-16T03:27:01.545613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:11.703476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":19,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.534910+0000","last_change":"2023-12-16T03:27:00.515681+0000","last_active":"2023-12-16T03:27:01.534910+0000","last_peered":"2023-12-16T03:27:01.534910+0000","last_clean":"2023-12-16T03:27:01.534910+0000","last_became_active":"2023-12-16T03:27:00.515413+0000","last_became_peered":"2023-12-16T03:27:00.515413+0000","last_unstale":"2023-12-16T03:27:01.534910+0000","last_undegraded":"2023-12-16T03:27:01.534910+0000","last_fullsized":"2023-12-16T03:27:01.534910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.528414+0000","last_change":"2023-12-16T03:27:01.518997+0000","last_active":"2023-12-16T03:27:01.528414+0000","last_peered":"2023-12-16T03:27:01.528414+0000","last_clean":"2023-12-16T03:27:01.528414+0000","last_became_active":"2023-12-16T03:27:01.518606+0000","last_became_peered":"2023-12-16T03:27:01.518606+0000","last_unstale":"2023-12-16T03:27:01.528414+0000","last_undegraded":"2023-12-16T03:27:01.528414+0000","last_fullsized":"2023-12-16T03:27:01.528414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:32:49.306278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518574+0000","last_change":"2023-12-16T03:27:00.522719+0000","last_active":"2023-12-16T03:27:02.518574+0000","last_peered":"2023-12-16T03:27:02.518574+0000","last_clean":"2023-12-16T03:27:02.518574+0000","last_became_active":"2023-12-16T03:27:00.522485+0000","last_became_peered":"2023-12-16T03:27:00.522485+0000","last_unstale":"2023-12-16T03:27:02.518574+0000","last_undegraded":"2023-12-16T03:27:02.518574+0000","last_fullsized":"2023-12-16T03:27:02.518574+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:48:48.483240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522393+0000","last_change":"2023-12-16T03:27:01.525968+0000","last_active":"2023-12-16T03:27:02.522393+0000","last_peered":"2023-12-16T03:27:02.522393+0000","last_clean":"2023-12-16T03:27:02.522393+0000","last_became_active":"2023-12-16T03:27:01.523176+0000","last_became_peered":"2023-12-16T03:27:01.523176+0000","last_unstale":"2023-12-16T03:27:02.522393+0000","last_undegraded":"2023-12-16T03:27:02.522393+0000","last_fullsized":"2023-12-16T03:27:02.522393+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539398+0000","last_change":"2023-12-16T03:27:00.514506+0000","last_active":"2023-12-16T03:27:01.539398+0000","last_peered":"2023-12-16T03:27:01.539398+0000","last_clean":"2023-12-16T03:27:01.539398+0000","last_became_active":"2023-12-16T03:27:00.514121+0000","last_became_peered":"2023-12-16T03:27:00.514121+0000","last_unstale":"2023-12-16T03:27:01.539398+0000","last_undegraded":"2023-12-16T03:27:01.539398+0000","last_fullsized":"2023-12-16T03:27:01.539398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:47:33.862583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.518157+0000","last_change":"2023-12-16T03:27:01.517329+0000","last_active":"2023-12-16T03:27:02.518157+0000","last_peered":"2023-12-16T03:27:02.518157+0000","last_clean":"2023-12-16T03:27:02.518157+0000","last_became_active":"2023-12-16T03:27:01.517020+0000","last_became_peered":"2023-12-16T03:27:01.517020+0000","last_unstale":"2023-12-16T03:27:02.518157+0000","last_undegraded":"2023-12-16T03:27:02.518157+0000","last_fullsized":"2023-12-16T03:27:02.518157+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:37:11.829485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522073+0000","last_change":"2023-12-16T03:27:00.514408+0000","last_active":"2023-12-16T03:27:02.522073+0000","last_peered":"2023-12-16T03:27:02.522073+0000","last_clean":"2023-12-16T03:27:02.522073+0000","last_became_active":"2023-12-16T03:27:00.514141+0000","last_became_peered":"2023-12-16T03:27:00.514141+0000","last_unstale":"2023-12-16T03:27:02.522073+0000","last_undegraded":"2023-12-16T03:27:02.522073+0000","last_fullsized":"2023-12-16T03:27:02.522073+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:10.695120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.529580+0000","last_change":"2023-12-16T03:27:01.522466+0000","last_active":"2023-12-16T03:27:01.529580+0000","last_peered":"2023-12-16T03:27:01.529580+0000","last_clean":"2023-12-16T03:27:01.529580+0000","last_became_active":"2023-12-16T03:27:01.522111+0000","last_became_peered":"2023-12-16T03:27:01.522111+0000","last_unstale":"2023-12-16T03:27:01.529580+0000","last_undegraded":"2023-12-16T03:27:01.529580+0000","last_fullsized":"2023-12-16T03:27:01.529580+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:18.664130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.500452+0000","last_change":"2023-12-16T03:27:00.520371+0000","last_active":"2023-12-16T03:27:01.500452+0000","last_peered":"2023-12-16T03:27:01.500452+0000","last_clean":"2023-12-16T03:27:01.500452+0000","last_became_active":"2023-12-16T03:27:00.520097+0000","last_became_peered":"2023-12-16T03:27:00.520097+0000","last_unstale":"2023-12-16T03:27:01.500452+0000","last_undegraded":"2023-12-16T03:27:01.500452+0000","last_fullsized":"2023-12-16T03:27:01.500452+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:32:48.297921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521322+0000","last_change":"2023-12-16T03:27:01.521651+0000","last_active":"2023-12-16T03:27:02.521322+0000","last_peered":"2023-12-16T03:27:02.521322+0000","last_clean":"2023-12-16T03:27:02.521322+0000","last_became_active":"2023-12-16T03:27:01.521167+0000","last_became_peered":"2023-12-16T03:27:01.521167+0000","last_unstale":"2023-12-16T03:27:02.521322+0000","last_undegraded":"2023-12-16T03:27:02.521322+0000","last_fullsized":"2023-12-16T03:27:02.521322+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:42:00.543610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517987+0000","last_change":"2023-12-16T03:27:00.521885+0000","last_active":"2023-12-16T03:27:02.517987+0000","last_peered":"2023-12-16T03:27:02.517987+0000","last_clean":"2023-12-16T03:27:02.517987+0000","last_became_active":"2023-12-16T03:27:00.521503+0000","last_became_peered":"2023-12-16T03:27:00.521503+0000","last_unstale":"2023-12-16T03:27:02.517987+0000","last_undegraded":"2023-12-16T03:27:02.517987+0000","last_fullsized":"2023-12-16T03:27:02.517987+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:47.207385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.535990+0000","last_change":"2023-12-16T03:27:01.516489+0000","last_active":"2023-12-16T03:27:01.535990+0000","last_peered":"2023-12-16T03:27:01.535990+0000","last_clean":"2023-12-16T03:27:01.535990+0000","last_became_active":"2023-12-16T03:27:01.516199+0000","last_became_peered":"2023-12-16T03:27:01.516199+0000","last_unstale":"2023-12-16T03:27:01.535990+0000","last_undegraded":"2023-12-16T03:27:01.535990+0000","last_fullsized":"2023-12-16T03:27:01.535990+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.516699+0000","last_change":"2023-12-16T03:27:00.508945+0000","last_active":"2023-12-16T03:27:01.516699+0000","last_peered":"2023-12-16T03:27:01.516699+0000","last_clean":"2023-12-16T03:27:01.516699+0000","last_became_active":"2023-12-16T03:27:00.508638+0000","last_became_peered":"2023-12-16T03:27:00.508638+0000","last_unstale":"2023-12-16T03:27:01.516699+0000","last_undegraded":"2023-12-16T03:27:01.516699+0000","last_fullsized":"2023-12-16T03:27:01.516699+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539502+0000","last_change":"2023-12-16T03:27:01.518954+0000","last_active":"2023-12-16T03:27:01.539502+0000","last_peered":"2023-12-16T03:27:01.539502+0000","last_clean":"2023-12-16T03:27:01.539502+0000","last_became_active":"2023-12-16T03:27:01.518665+0000","last_became_peered":"2023-12-16T03:27:01.518665+0000","last_unstale":"2023-12-16T03:27:01.539502+0000","last_undegraded":"2023-12-16T03:27:01.539502+0000","last_fullsized":"2023-12-16T03:27:01.539502+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:42:00.543610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.520878+0000","last_change":"2023-12-16T03:27:00.519726+0000","last_active":"2023-12-16T03:27:02.520878+0000","last_peered":"2023-12-16T03:27:02.520878+0000","last_clean":"2023-12-16T03:27:02.520878+0000","last_became_active":"2023-12-16T03:27:00.519420+0000","last_became_peered":"2023-12-16T03:27:00.519420+0000","last_unstale":"2023-12-16T03:27:02.520878+0000","last_undegraded":"2023-12-16T03:27:02.520878+0000","last_fullsized":"2023-12-16T03:27:02.520878+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:07.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522347+0000","last_change":"2023-12-16T03:27:01.531143+0000","last_active":"2023-12-16T03:27:02.522347+0000","last_peered":"2023-12-16T03:27:02.522347+0000","last_clean":"2023-12-16T03:27:02.522347+0000","last_became_active":"2023-12-16T03:27:01.530842+0000","last_became_peered":"2023-12-16T03:27:01.530842+0000","last_unstale":"2023-12-16T03:27:02.522347+0000","last_undegraded":"2023-12-16T03:27:02.522347+0000","last_fullsized":"2023-12-16T03:27:02.522347+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539194+0000","last_change":"2023-12-16T03:27:00.524413+0000","last_active":"2023-12-16T03:27:01.539194+0000","last_peered":"2023-12-16T03:27:01.539194+0000","last_clean":"2023-12-16T03:27:01.539194+0000","last_became_active":"2023-12-16T03:27:00.524142+0000","last_became_peered":"2023-12-16T03:27:00.524142+0000","last_unstale":"2023-12-16T03:27:01.539194+0000","last_undegraded":"2023-12-16T03:27:01.539194+0000","last_fullsized":"2023-12-16T03:27:01.539194+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522435+0000","last_change":"2023-12-16T03:27:01.518068+0000","last_active":"2023-12-16T03:27:02.522435+0000","last_peered":"2023-12-16T03:27:02.522435+0000","last_clean":"2023-12-16T03:27:02.522435+0000","last_became_active":"2023-12-16T03:27:01.516800+0000","last_became_peered":"2023-12-16T03:27:01.516800+0000","last_unstale":"2023-12-16T03:27:02.522435+0000","last_undegraded":"2023-12-16T03:27:02.522435+0000","last_fullsized":"2023-12-16T03:27:02.522435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.501113+0000","last_change":"2023-12-16T03:27:00.515007+0000","last_active":"2023-12-16T03:27:01.501113+0000","last_peered":"2023-12-16T03:27:01.501113+0000","last_clean":"2023-12-16T03:27:01.501113+0000","last_became_active":"2023-12-16T03:27:00.514820+0000","last_became_peered":"2023-12-16T03:27:00.514820+0000","last_unstale":"2023-12-16T03:27:01.501113+0000","last_undegraded":"2023-12-16T03:27:01.501113+0000","last_fullsized":"2023-12-16T03:27:01.501113+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:03:53.754918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.532027+0000","last_change":"2023-12-16T03:27:01.522052+0000","last_active":"2023-12-16T03:27:01.532027+0000","last_peered":"2023-12-16T03:27:01.532027+0000","last_clean":"2023-12-16T03:27:01.532027+0000","last_became_active":"2023-12-16T03:27:01.521669+0000","last_became_peered":"2023-12-16T03:27:01.521669+0000","last_unstale":"2023-12-16T03:27:01.532027+0000","last_undegraded":"2023-12-16T03:27:01.532027+0000","last_fullsized":"2023-12-16T03:27:01.532027+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:47:05.676237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.507782+0000","last_change":"2023-12-16T03:27:00.516627+0000","last_active":"2023-12-16T03:27:01.507782+0000","last_peered":"2023-12-16T03:27:01.507782+0000","last_clean":"2023-12-16T03:27:01.507782+0000","last_became_active":"2023-12-16T03:27:00.516381+0000","last_became_peered":"2023-12-16T03:27:00.516381+0000","last_unstale":"2023-12-16T03:27:01.507782+0000","last_undegraded":"2023-12-16T03:27:01.507782+0000","last_fullsized":"2023-12-16T03:27:01.507782+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.539754+0000","last_change":"2023-12-16T03:27:01.522194+0000","last_active":"2023-12-16T03:27:01.539754+0000","last_peered":"2023-12-16T03:27:01.539754+0000","last_clean":"2023-12-16T03:27:01.539754+0000","last_became_active":"2023-12-16T03:27:01.521667+0000","last_became_peered":"2023-12-16T03:27:01.521667+0000","last_unstale":"2023-12-16T03:27:01.539754+0000","last_undegraded":"2023-12-16T03:27:01.539754+0000","last_fullsized":"2023-12-16T03:27:01.539754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:44.457252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.522182+0000","last_change":"2023-12-16T03:27:00.511361+0000","last_active":"2023-12-16T03:27:02.522182+0000","last_peered":"2023-12-16T03:27:02.522182+0000","last_clean":"2023-12-16T03:27:02.522182+0000","last_became_active":"2023-12-16T03:27:00.511033+0000","last_became_peered":"2023-12-16T03:27:00.511033+0000","last_unstale":"2023-12-16T03:27:02.522182+0000","last_undegraded":"2023-12-16T03:27:02.522182+0000","last_fullsized":"2023-12-16T03:27:02.522182+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:48.295530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517738+0000","last_change":"2023-12-16T03:27:01.524848+0000","last_active":"2023-12-16T03:27:02.517738+0000","last_peered":"2023-12-16T03:27:02.517738+0000","last_clean":"2023-12-16T03:27:02.517738+0000","last_became_active":"2023-12-16T03:27:01.524561+0000","last_became_peered":"2023-12-16T03:27:01.524561+0000","last_unstale":"2023-12-16T03:27:02.517738+0000","last_undegraded":"2023-12-16T03:27:02.517738+0000","last_fullsized":"2023-12-16T03:27:02.517738+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.908171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.512682+0000","last_change":"2023-12-16T03:27:00.513344+0000","last_active":"2023-12-16T03:27:01.512682+0000","last_peered":"2023-12-16T03:27:01.512682+0000","last_clean":"2023-12-16T03:27:01.512682+0000","last_became_active":"2023-12-16T03:27:00.513101+0000","last_became_peered":"2023-12-16T03:27:00.513101+0000","last_unstale":"2023-12-16T03:27:01.512682+0000","last_undegraded":"2023-12-16T03:27:01.512682+0000","last_fullsized":"2023-12-16T03:27:01.512682+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:34.745808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.545628+0000","last_change":"2023-12-16T03:27:01.543099+0000","last_active":"2023-12-16T03:27:01.545628+0000","last_peered":"2023-12-16T03:27:01.545628+0000","last_clean":"2023-12-16T03:27:01.545628+0000","last_became_active":"2023-12-16T03:27:01.542711+0000","last_became_peered":"2023-12-16T03:27:01.542711+0000","last_unstale":"2023-12-16T03:27:01.545628+0000","last_undegraded":"2023-12-16T03:27:01.545628+0000","last_fullsized":"2023-12-16T03:27:01.545628+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:59.366673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.521743+0000","last_change":"2023-12-16T03:27:00.513164+0000","last_active":"2023-12-16T03:27:02.521743+0000","last_peered":"2023-12-16T03:27:02.521743+0000","last_clean":"2023-12-16T03:27:02.521743+0000","last_became_active":"2023-12-16T03:27:00.512912+0000","last_became_peered":"2023-12-16T03:27:00.512912+0000","last_unstale":"2023-12-16T03:27:02.521743+0000","last_undegraded":"2023-12-16T03:27:02.521743+0000","last_fullsized":"2023-12-16T03:27:02.521743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.532156+0000","last_change":"2023-12-16T03:27:01.521887+0000","last_active":"2023-12-16T03:27:01.532156+0000","last_peered":"2023-12-16T03:27:01.532156+0000","last_clean":"2023-12-16T03:27:01.532156+0000","last_became_active":"2023-12-16T03:27:01.521554+0000","last_became_peered":"2023-12-16T03:27:01.521554+0000","last_unstale":"2023-12-16T03:27:01.532156+0000","last_undegraded":"2023-12-16T03:27:01.532156+0000","last_fullsized":"2023-12-16T03:27:01.532156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:33:29.070766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.511877+0000","last_change":"2023-12-16T03:27:00.512268+0000","last_active":"2023-12-16T03:27:01.511877+0000","last_peered":"2023-12-16T03:27:01.511877+0000","last_clean":"2023-12-16T03:27:01.511877+0000","last_became_active":"2023-12-16T03:27:00.511945+0000","last_became_peered":"2023-12-16T03:27:00.511945+0000","last_unstale":"2023-12-16T03:27:01.511877+0000","last_undegraded":"2023-12-16T03:27:01.511877+0000","last_fullsized":"2023-12-16T03:27:01.511877+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:49:40.657817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517644+0000","last_change":"2023-12-16T03:27:01.527192+0000","last_active":"2023-12-16T03:27:02.517644+0000","last_peered":"2023-12-16T03:27:02.517644+0000","last_clean":"2023-12-16T03:27:02.517644+0000","last_became_active":"2023-12-16T03:27:01.526892+0000","last_became_peered":"2023-12-16T03:27:01.526892+0000","last_unstale":"2023-12-16T03:27:02.517644+0000","last_undegraded":"2023-12-16T03:27:02.517644+0000","last_fullsized":"2023-12-16T03:27:02.517644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:00.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517517+0000","last_change":"2023-12-16T03:27:00.516056+0000","last_active":"2023-12-16T03:27:02.517517+0000","last_peered":"2023-12-16T03:27:02.517517+0000","last_clean":"2023-12-16T03:27:02.517517+0000","last_became_active":"2023-12-16T03:27:00.515763+0000","last_became_peered":"2023-12-16T03:27:00.515763+0000","last_unstale":"2023-12-16T03:27:02.517517+0000","last_undegraded":"2023-12-16T03:27:02.517517+0000","last_fullsized":"2023-12-16T03:27:02.517517+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:42.045050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.517434+0000","last_change":"2023-12-16T03:27:01.520522+0000","last_active":"2023-12-16T03:27:02.517434+0000","last_peered":"2023-12-16T03:27:02.517434+0000","last_clean":"2023-12-16T03:27:02.517434+0000","last_became_active":"2023-12-16T03:27:01.520214+0000","last_became_peered":"2023-12-16T03:27:01.520214+0000","last_unstale":"2023-12-16T03:27:02.517434+0000","last_undegraded":"2023-12-16T03:27:02.517434+0000","last_fullsized":"2023-12-16T03:27:02.517434+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:42.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-16T03:27:01.506821+0000","last_change":"2023-12-16T03:27:00.514945+0000","last_active":"2023-12-16T03:27:01.506821+0000","last_peered":"2023-12-16T03:27:01.506821+0000","last_clean":"2023-12-16T03:27:01.506821+0000","last_became_active":"2023-12-16T03:27:00.514688+0000","last_became_peered":"2023-12-16T03:27:00.514688+0000","last_unstale":"2023-12-16T03:27:01.506821+0000","last_undegraded":"2023-12-16T03:27:01.506821+0000","last_fullsized":"2023-12-16T03:27:01.506821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-16T03:27:00.507093+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:27:00.507093+0000","last_peered":"2023-12-16T03:27:00.507093+0000","last_clean":"2023-12-16T03:27:00.507093+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:27:00.507093+0000","last_undegraded":"2023-12-16T03:27:00.507093+0000","last_fullsized":"2023-12-16T03:27:00.507093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":836061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.62}]},{"osd":2,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.78100000000000003}]},{"osd":3,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.54200000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76500000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.75}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":245533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.1890000000000001,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.752}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.6870000000000003,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":4.2210000000000001,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.83599999999999997}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.2560000000000002,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.71999999999999997}]},{"osd":4,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.81499999999999995}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.61499999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.57099999999999995}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.73199999999999998}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70699999999999996}]},{"osd":4,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67500000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65800000000000003}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":598016,"data_stored":247145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":4.194,"5min":4.194,"15min":4.194},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.59299999999999997}]},{"osd":1,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64100000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.1689999999999996,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.76700000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":4.2759999999999998,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.82099999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.84599999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.86399999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:26:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.60899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":245589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":5.4710000000000001,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":6.1189999999999998,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.29799999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":3.7890000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.39400000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.5779999999999998,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.67500000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.748}]},{"osd":6,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.6309999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":0.61499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":606208,"data_stored":251889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.433},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36399999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.495}]},{"osd":4,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":0.61699999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63}]},{"osd":7,"last update":"Sat Dec 16 03:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":589824,"data_stored":245623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":4.3479999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":4.476,"5min":4.476,"15min":4.476},"last":0.56599999999999995}]},{"osd":2,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.4269999999999996,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.622}]},{"osd":3,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":4.6319999999999997,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.435},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.3849999999999998,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":7.5650000000000004,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.984,"5min":4.984,"15min":4.984},"last":0.64500000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":4.7720000000000002,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":7.6109999999999998,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.60399999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":7.681,"5min":7.681,"15min":7.681},"last":0.65300000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:26:05 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":5.0439999999999996,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.8609999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1196032,"data_stored":838095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.1210000000000004,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.64100000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.1719999999999997,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.2350000000000003,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.58999999999999997}]},{"osd":3,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.0970000000000004,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.254,"5min":3.254,"15min":3.254},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":0.96099999999999997}]},{"osd":5,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.4859999999999998,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.97499999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.3650000000000002,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.3979999999999997,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Dec 16 03:26:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.90400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:27:06.016 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-16T03:27:06.016 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-16T03:27:06.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e22bc4640 1 Processor -- start 2023-12-16T03:27:06.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e22bc4640 1 -- start start 2023-12-16T03:27:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e22bc4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4e1c14c600 0x7f4e1c0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e22bc4640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4e1c0ac4a0 0x7f4e1c0ab520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e22bc4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1c0c0d10 con 0x7f4e1c0a9670 2023-12-16T03:27:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e22bc4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c0c2cb0 con 0x7f4e1c14c600 2023-12-16T03:27:06.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e22bc4640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c073d10 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e20960640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4e1c14c600 0x7f4e1c0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e20960640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4e1c14c600 0x7f4e1c0abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55014/0 (socket says 172.21.15.28:55014) 2023-12-16T03:27:06.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e20960640 1 -- 172.21.15.28:0/788749126 learned_addr learned my addr 172.21.15.28:0/788749126 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:06.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e21161640 1 --2- 172.21.15.28:0/788749126 >> v2:172.21.15.134:3300/0 conn(0x7f4e1c0ac4a0 0x7f4e1c0ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e20960640 1 -- 172.21.15.28:0/788749126 >> v2:172.21.15.134:3300/0 conn(0x7f4e1c0ac4a0 msgr2=0x7f4e1c0ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:06.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e20960640 1 --2- 172.21.15.28:0/788749126 >> v2:172.21.15.134:3300/0 conn(0x7f4e1c0ac4a0 0x7f4e1c0ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e20960640 1 -- 172.21.15.28:0/788749126 >> v1:172.21.15.134:6789/0 conn(0x7f4e1c0a9670 legacy=0x7f4e1c0aae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.200+0000 7f4e20960640 1 -- 172.21.15.28:0/788749126 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c152fd0 con 0x7f4e1c14c600 2023-12-16T03:27:06.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e20960640 1 --2- 172.21.15.28:0/788749126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e1c14c600 0x7f4e1c0abf60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c066df0 tx=0x7f4e1001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6c685cd0be72c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:06.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e1b7fe640 1 -- 172.21.15.28:0/788749126 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e100ab640 con 0x7f4e1c14c600 2023-12-16T03:27:06.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e1b7fe640 1 -- 172.21.15.28:0/788749126 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e100a7070 con 0x7f4e1c14c600 2023-12-16T03:27:06.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e1b7fe640 1 -- 172.21.15.28:0/788749126 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e100ab9c0 con 0x7f4e1c14c600 2023-12-16T03:27:06.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e22bc4640 1 -- 172.21.15.28:0/788749126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e1c14c600 msgr2=0x7f4e1c0abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e22bc4640 1 --2- 172.21.15.28:0/788749126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e1c14c600 0x7f4e1c0abf60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c066df0 tx=0x7f4e1001c440 comp rx=0 tx=0).stop 2023-12-16T03:27:06.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e22bc4640 1 -- 172.21.15.28:0/788749126 shutdown_connections 2023-12-16T03:27:06.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e22bc4640 1 --2- 172.21.15.28:0/788749126 >> v2:172.21.15.134:3300/0 conn(0x7f4e1c0ac4a0 0x7f4e1c0ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e22bc4640 1 --2- 172.21.15.28:0/788749126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e1c14c600 0x7f4e1c0abf60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e22bc4640 1 -- 172.21.15.28:0/788749126 >> 172.21.15.28:0/788749126 conn(0x7f4e1c0c30c0 msgr2=0x7f4e1c0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:06.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e22bc4640 1 -- 172.21.15.28:0/788749126 shutdown_connections 2023-12-16T03:27:06.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.204+0000 7f4e22bc4640 1 -- 172.21.15.28:0/788749126 wait complete. 2023-12-16T03:27:06.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e22bc4640 1 Processor -- start 2023-12-16T03:27:06.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e22bc4640 1 -- start start 2023-12-16T03:27:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e22bc4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e1c0a9670 0x7f4e1c0bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e22bc4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e1c0ac4a0 0x7f4e1c1489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e22bc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1c14c600 0x7f4e1c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e22bc4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c070aa0 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e22bc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c1f0d60 con 0x7f4e1c14c600 2023-12-16T03:27:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e22bc4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c14e4c0 con 0x7f4e1c0a9670 2023-12-16T03:27:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e1bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e1c0ac4a0 0x7f4e1c1489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e1bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e1c0ac4a0 0x7f4e1c1489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55030/0 (socket says 172.21.15.28:55030) 2023-12-16T03:27:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e1bfff640 1 -- 172.21.15.28:0/2085357418 learned_addr learned my addr 172.21.15.28:0/2085357418 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e20960640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e1c0a9670 0x7f4e1c0bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e21161640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1c14c600 0x7f4e1c148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e1bfff640 1 -- 172.21.15.28:0/2085357418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e1c0a9670 msgr2=0x7f4e1c0bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e1bfff640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e1c0a9670 0x7f4e1c0bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e1bfff640 1 -- 172.21.15.28:0/2085357418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1c14c600 msgr2=0x7f4e1c148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e1bfff640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1c14c600 0x7f4e1c148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e1bfff640 1 -- 172.21.15.28:0/2085357418 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100094d0 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e1bfff640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e1c0ac4a0 0x7f4e1c1489d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800c390 tx=0x7f4e0800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e197fa640 1 -- 172.21.15.28:0/2085357418 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e080052d0 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e197fa640 1 -- 172.21.15.28:0/2085357418 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e08005430 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e197fa640 1 -- 172.21.15.28:0/2085357418 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08003820 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e22bc4640 1 -- 172.21.15.28:0/2085357418 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c1effa0 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.208+0000 7f4e22bc4640 1 -- 172.21.15.28:0/2085357418 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c1f0560 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.212+0000 7f4e22bc4640 1 -- 172.21.15.28:0/2085357418 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c0c28e0 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.212+0000 7f4e197fa640 1 -- 172.21.15.28:0/2085357418 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4e08003980 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.212+0000 7f4e197fa640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e000664a0 0x7f4e00068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.212+0000 7f4e197fa640 1 -- 172.21.15.28:0/2085357418 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e08083260 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.212+0000 7f4e20960640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e000664a0 0x7f4e00068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.212+0000 7f4e20960640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e000664a0 0x7f4e00068960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4e100af000 tx=0x7f4e100b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:06.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.216+0000 7f4e197fa640 1 -- 172.21.15.28:0/2085357418 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4e08050820 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.432+0000 7f4e22bc4640 1 -- 172.21.15.28:0/2085357418 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4e1c068400 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e197fa640 1 -- 172.21.15.28:0/2085357418 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f4e08053e40 con 0x7f4e1c0ac4a0 2023-12-16T03:27:06.437 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2023-12-16T03:27:06.437 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1lvVeHJBAAIUmgW3XLan0rUG31Cw+zwQ== 2023-12-16T03:27:06.437 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2023-12-16T03:27:06.438 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2023-12-16T03:27:06.438 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-16T03:27:06.438 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 -- 172.21.15.28:0/2085357418 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e000664a0 msgr2=0x7f4e00068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e000664a0 0x7f4e00068960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4e100af000 tx=0x7f4e100b6040 comp rx=0 tx=0).stop 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 -- 172.21.15.28:0/2085357418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e1c0ac4a0 msgr2=0x7f4e1c1489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e1c0ac4a0 0x7f4e1c1489d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800c390 tx=0x7f4e0800c850 comp rx=0 tx=0).stop 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 -- 172.21.15.28:0/2085357418 shutdown_connections 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e1c14c600 0x7f4e1c148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4e000664a0 0x7f4e00068960 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4e1c0ac4a0 0x7f4e1c1489d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 --2- 172.21.15.28:0/2085357418 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4e1c0a9670 0x7f4e1c0bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 -- 172.21.15.28:0/2085357418 >> 172.21.15.28:0/2085357418 conn(0x7f4e1c0c30c0 msgr2=0x7f4e1c149e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 -- 172.21.15.28:0/2085357418 shutdown_connections 2023-12-16T03:27:06.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.436+0000 7f4e22bc4640 1 -- 172.21.15.28:0/2085357418 wait complete. 2023-12-16T03:27:06.459 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:27:06.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5069f5f640 1 Processor -- start 2023-12-16T03:27:06.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5069f5f640 1 -- start start 2023-12-16T03:27:06.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5069f5f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5064151cd0 0x7f50640ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5069f5f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50640c7c50 0x7f50641544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5069f5f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50640c8160 con 0x7f50640ca9a0 2023-12-16T03:27:06.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5069f5f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5064157b40 con 0x7f5064151cd0 2023-12-16T03:27:06.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5069f5f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5064157e20 con 0x7f50640c7c50 2023-12-16T03:27:06.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f506975e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f50640ca9a0 0x7f506406b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57798/0 (socket says 172.21.15.28:57798) 2023-12-16T03:27:06.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f506975e640 1 -- 172.21.15.28:0/1682048648 learned_addr learned my addr 172.21.15.28:0/1682048648 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5063fff640 1 --2- 172.21.15.28:0/1682048648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50640c7c50 0x7f50641544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5068f5d640 1 --2- 172.21.15.28:0/1682048648 >> v2:172.21.15.134:3300/0 conn(0x7f5064151cd0 0x7f50640ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f50637fe640 1 -- 172.21.15.28:0/1682048648 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370738326 0 0) 0x7f50640c8160 con 0x7f50640ca9a0 2023-12-16T03:27:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f50637fe640 1 -- 172.21.15.28:0/1682048648 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5054003530 con 0x7f50640ca9a0 2023-12-16T03:27:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5063fff640 1 -- 172.21.15.28:0/1682048648 >> v2:172.21.15.134:3300/0 conn(0x7f5064151cd0 msgr2=0x7f50640ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f50637fe640 1 -- 172.21.15.28:0/1682048648 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 565533085 0 0) 0x7f5054003530 con 0x7f50640ca9a0 2023-12-16T03:27:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5063fff640 1 --2- 172.21.15.28:0/1682048648 >> v2:172.21.15.134:3300/0 conn(0x7f5064151cd0 0x7f50640ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5063fff640 1 -- 172.21.15.28:0/1682048648 >> v1:172.21.15.28:6789/0 conn(0x7f50640ca9a0 legacy=0x7f506406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.600+0000 7f5063fff640 1 -- 172.21.15.28:0/1682048648 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064158100 con 0x7f50640c7c50 2023-12-16T03:27:06.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f5063fff640 1 --2- 172.21.15.28:0/1682048648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50640c7c50 0x7f50641544d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f50500097c0 tx=0x7f505001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2ca07311016ebbf server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:06.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f50637fe640 1 -- 172.21.15.28:0/1682048648 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c001a00 con 0x7f50640c7c50 2023-12-16T03:27:06.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f50637fe640 1 -- 172.21.15.28:0/1682048648 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50500a7050 con 0x7f50640c7c50 2023-12-16T03:27:06.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f50637fe640 1 -- 172.21.15.28:0/1682048648 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50500ab620 con 0x7f50640c7c50 2023-12-16T03:27:06.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f5069f5f640 1 -- 172.21.15.28:0/1682048648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50640c7c50 msgr2=0x7f50641544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f5069f5f640 1 --2- 172.21.15.28:0/1682048648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50640c7c50 0x7f50641544d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f50500097c0 tx=0x7f505001c370 comp rx=0 tx=0).stop 2023-12-16T03:27:06.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f5069f5f640 1 -- 172.21.15.28:0/1682048648 shutdown_connections 2023-12-16T03:27:06.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f5069f5f640 1 --2- 172.21.15.28:0/1682048648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50640c7c50 0x7f50641544d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f5069f5f640 1 --2- 172.21.15.28:0/1682048648 >> v2:172.21.15.134:3300/0 conn(0x7f5064151cd0 0x7f50640ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f5069f5f640 1 -- 172.21.15.28:0/1682048648 >> 172.21.15.28:0/1682048648 conn(0x7f50640abee0 msgr2=0x7f50640c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:06.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f5069f5f640 1 -- 172.21.15.28:0/1682048648 shutdown_connections 2023-12-16T03:27:06.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.604+0000 7f5069f5f640 1 -- 172.21.15.28:0/1682048648 wait complete. 2023-12-16T03:27:06.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5069f5f640 1 Processor -- start 2023-12-16T03:27:06.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5069f5f640 1 -- start start 2023-12-16T03:27:06.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5069f5f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50640c7c50 0x7f50641ece40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5069f5f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50640ca9a0 0x7f5064152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5069f5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5064151cd0 0x7f50640c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5069f5f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50640c2ee0 con 0x7f50640ca9a0 2023-12-16T03:27:06.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5069f5f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50641edde0 con 0x7f5064151cd0 2023-12-16T03:27:06.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5069f5f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50641ed540 con 0x7f50640c7c50 2023-12-16T03:27:06.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5063fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50640ca9a0 0x7f5064152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5063fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50640ca9a0 0x7f5064152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55046/0 (socket says 172.21.15.28:55046) 2023-12-16T03:27:06.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5063fff640 1 -- 172.21.15.28:0/2857275912 learned_addr learned my addr 172.21.15.28:0/2857275912 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:06.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5068f5d640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50640c7c50 0x7f50641ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f506975e640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5064151cd0 0x7f50640c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5063fff640 1 -- 172.21.15.28:0/2857275912 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50640c7c50 msgr2=0x7f50641ece40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5063fff640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50640c7c50 0x7f50641ece40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5063fff640 1 -- 172.21.15.28:0/2857275912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5064151cd0 msgr2=0x7f50640c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5063fff640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5064151cd0 0x7f50640c3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5063fff640 1 -- 172.21.15.28:0/2857275912 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5050009420 con 0x7f50640ca9a0 2023-12-16T03:27:06.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f5063fff640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50640ca9a0 0x7f5064152580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f50500ae040 tx=0x7f505001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:06.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f50617fa640 1 -- 172.21.15.28:0/2857275912 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5050006e20 con 0x7f50640ca9a0 2023-12-16T03:27:06.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f50617fa640 1 -- 172.21.15.28:0/2857275912 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50500b7450 con 0x7f50640ca9a0 2023-12-16T03:27:06.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.608+0000 7f50617fa640 1 -- 172.21.15.28:0/2857275912 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50500b7800 con 0x7f50640ca9a0 2023-12-16T03:27:06.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.612+0000 7f5069f5f640 1 -- 172.21.15.28:0/2857275912 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50641ed820 con 0x7f50640ca9a0 2023-12-16T03:27:06.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.612+0000 7f5069f5f640 1 -- 172.21.15.28:0/2857275912 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50640c2590 con 0x7f50640ca9a0 2023-12-16T03:27:06.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.612+0000 7f5069f5f640 1 -- 172.21.15.28:0/2857275912 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50640c6140 con 0x7f50640ca9a0 2023-12-16T03:27:06.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.612+0000 7f50617fa640 1 -- 172.21.15.28:0/2857275912 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f50500b7960 con 0x7f50640ca9a0 2023-12-16T03:27:06.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.612+0000 7f50617fa640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5048066470 0x7f5048068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:06.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.612+0000 7f50617fa640 1 -- 172.21.15.28:0/2857275912 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f505011e520 con 0x7f50640ca9a0 2023-12-16T03:27:06.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.612+0000 7f5068f5d640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5048066470 0x7f5048068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:06.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.616+0000 7f5068f5d640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5048066470 0x7f5048068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5058009b60 tx=0x7f5058009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:06.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.616+0000 7f50617fa640 1 -- 172.21.15.28:0/2857275912 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f50500eb9a0 con 0x7f50640ca9a0 2023-12-16T03:27:06.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 -- 172.21.15.28:0/2857275912 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f506404e850 con 0x7f50640ca9a0 2023-12-16T03:27:06.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f50617fa640 1 -- 172.21.15.28:0/2857275912 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f50500eefc0 con 0x7f50640ca9a0 2023-12-16T03:27:06.810 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:06.810 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3665146461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":3665146461},{"type":"v1","addr":"172.21.15.28:6837","nonce":3665146461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1938417336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1938417336},{"type":"v1","addr":"172.21.15.134:6835","nonce":1938417336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4009894510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4009894510},{"type":"v1","addr":"172.21.15.134:6834","nonce":4009894510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:00.888034+0000","modified":"2023-12-16T03:27:03.912013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/3717643902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3717643902},{"type":"v1","addr":"172.21.15.28:6836","nonce":3717643902}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-16T03:27:06.811 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 32 2023-12-16T03:27:06.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 -- 172.21.15.28:0/2857275912 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5048066470 msgr2=0x7f5048068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5048066470 0x7f5048068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5058009b60 tx=0x7f5058009190 comp rx=0 tx=0).stop 2023-12-16T03:27:06.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 -- 172.21.15.28:0/2857275912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50640ca9a0 msgr2=0x7f5064152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:06.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50640ca9a0 0x7f5064152580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f50500ae040 tx=0x7f505001abb0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 -- 172.21.15.28:0/2857275912 shutdown_connections 2023-12-16T03:27:06.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5064151cd0 0x7f50640c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5048066470 0x7f5048068930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50640ca9a0 0x7f5064152580 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 --2- 172.21.15.28:0/2857275912 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50640c7c50 0x7f50641ece40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:06.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 -- 172.21.15.28:0/2857275912 >> 172.21.15.28:0/2857275912 conn(0x7f50640abee0 msgr2=0x7f5064150720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:06.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 -- 172.21.15.28:0/2857275912 shutdown_connections 2023-12-16T03:27:06.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:06.808+0000 7f5069f5f640 1 -- 172.21.15.28:0/2857275912 wait complete. 2023-12-16T03:27:07.234 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-16T03:27:00.888034+0000', 'modified': '2023-12-16T03:27:03.912013+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5781}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5781': {'gid': 5781, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.28:6836/3717643902', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6834', 'nonce': 3717643902}, {'type': 'v1', 'addr': '172.21.15.28:6836', 'nonce': 3717643902}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-16T03:27:07.234 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-16T03:27:07.235 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-16T03:27:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff46c25a640 1 Processor -- start 2023-12-16T03:27:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff46c25a640 1 -- start start 2023-12-16T03:27:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff46c25a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4640c5260 0x7ff46406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff46c25a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff464156960 con 0x7ff4640c5640 2023-12-16T03:27:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff46c25a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4640c2580 con 0x7ff464155de0 2023-12-16T03:27:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff46c25a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff464153510 con 0x7ff4640c5260 2023-12-16T03:27:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff4697f5640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff4640c5640 0x7ff4640c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57812/0 (socket says 172.21.15.28:57812) 2023-12-16T03:27:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff4697f5640 1 -- 172.21.15.28:0/3864653521 learned_addr learned my addr 172.21.15.28:0/3864653521 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff469ff6640 1 --2- 172.21.15.28:0/3864653521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4640c5260 0x7ff46406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff468ff4640 1 -- 172.21.15.28:0/3864653521 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858236033 0 0) 0x7ff454001120 con 0x7ff4640c5640 2023-12-16T03:27:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff468ff4640 1 -- 172.21.15.28:0/3864653521 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff450003530 con 0x7ff4640c5640 2023-12-16T03:27:07.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff468ff4640 1 -- 172.21.15.28:0/3864653521 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425821781 0 0) 0x7ff4640c2580 con 0x7ff464155de0 2023-12-16T03:27:07.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff468ff4640 1 -- 172.21.15.28:0/3864653521 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff454001120 con 0x7ff464155de0 2023-12-16T03:27:07.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff469ff6640 1 -- 172.21.15.28:0/3864653521 >> v1:172.21.15.134:6789/0 conn(0x7ff464155de0 legacy=0x7ff464156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff469ff6640 1 -- 172.21.15.28:0/3864653521 >> v1:172.21.15.28:6789/0 conn(0x7ff4640c5640 legacy=0x7ff4640c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.380+0000 7ff469ff6640 1 -- 172.21.15.28:0/3864653521 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640c1a00 con 0x7ff4640c5260 2023-12-16T03:27:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.384+0000 7ff469ff6640 1 --2- 172.21.15.28:0/3864653521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4640c5260 0x7ff46406d5b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4600097f0 tx=0x7ff46001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e72763c5faf1b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.384+0000 7ff468ff4640 1 -- 172.21.15.28:0/3864653521 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600ab600 con 0x7ff4640c5260 2023-12-16T03:27:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.384+0000 7ff468ff4640 1 -- 172.21.15.28:0/3864653521 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4600a7050 con 0x7ff4640c5260 2023-12-16T03:27:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.384+0000 7ff468ff4640 1 -- 172.21.15.28:0/3864653521 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600ab960 con 0x7ff4640c5260 2023-12-16T03:27:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.384+0000 7ff46c25a640 1 -- 172.21.15.28:0/3864653521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4640c5260 msgr2=0x7ff46406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.384+0000 7ff46c25a640 1 --2- 172.21.15.28:0/3864653521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4640c5260 0x7ff46406d5b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4600097f0 tx=0x7ff46001c430 comp rx=0 tx=0).stop 2023-12-16T03:27:07.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.384+0000 7ff46c25a640 1 -- 172.21.15.28:0/3864653521 shutdown_connections 2023-12-16T03:27:07.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.384+0000 7ff46c25a640 1 --2- 172.21.15.28:0/3864653521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4640c5260 0x7ff46406d5b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.384+0000 7ff46c25a640 1 -- 172.21.15.28:0/3864653521 >> 172.21.15.28:0/3864653521 conn(0x7ff46406a5b0 msgr2=0x7ff46406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:07.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46c25a640 1 -- 172.21.15.28:0/3864653521 shutdown_connections 2023-12-16T03:27:07.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46c25a640 1 -- 172.21.15.28:0/3864653521 wait complete. 2023-12-16T03:27:07.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46c25a640 1 Processor -- start 2023-12-16T03:27:07.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46c25a640 1 -- start start 2023-12-16T03:27:07.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46c25a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4640c5260 0x7ff46415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46c25a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4640c5640 0x7ff46414e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46c25a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff464155de0 0x7ff46414ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46c25a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640bffa0 con 0x7ff464155de0 2023-12-16T03:27:07.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46c25a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4641eef20 con 0x7ff4640c5260 2023-12-16T03:27:07.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46c25a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640bf9e0 con 0x7ff4640c5640 2023-12-16T03:27:07.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46a7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff464155de0 0x7ff46414ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46a7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff464155de0 0x7ff46414ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55058/0 (socket says 172.21.15.28:55058) 2023-12-16T03:27:07.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46a7f7640 1 -- 172.21.15.28:0/1375589225 learned_addr learned my addr 172.21.15.28:0/1375589225 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:07.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff4697f5640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4640c5640 0x7ff46414e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff469ff6640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4640c5260 0x7ff46415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46a7f7640 1 -- 172.21.15.28:0/1375589225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4640c5640 msgr2=0x7ff46414e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46a7f7640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4640c5640 0x7ff46414e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46a7f7640 1 -- 172.21.15.28:0/1375589225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4640c5260 msgr2=0x7ff46415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46a7f7640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4640c5260 0x7ff46415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46a7f7640 1 -- 172.21.15.28:0/1375589225 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff460009420 con 0x7ff464155de0 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46a7f7640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff464155de0 0x7ff46414ed50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00c730 tx=0x7ff45c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff45a7fc640 1 -- 172.21.15.28:0/1375589225 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c003b80 con 0x7ff464155de0 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff45a7fc640 1 -- 172.21.15.28:0/1375589225 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c003ce0 con 0x7ff464155de0 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff45a7fc640 1 -- 172.21.15.28:0/1375589225 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00aa90 con 0x7ff464155de0 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.388+0000 7ff46c25a640 1 -- 172.21.15.28:0/1375589225 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4640bfcc0 con 0x7ff464155de0 2023-12-16T03:27:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.392+0000 7ff46c25a640 1 -- 172.21.15.28:0/1375589225 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46415d9a0 con 0x7ff464155de0 2023-12-16T03:27:07.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.392+0000 7ff45a7fc640 1 -- 172.21.15.28:0/1375589225 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff45c00abf0 con 0x7ff464155de0 2023-12-16T03:27:07.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.392+0000 7ff45a7fc640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff448066470 0x7ff448068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.392+0000 7ff45a7fc640 1 -- 172.21.15.28:0/1375589225 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff45c083b60 con 0x7ff464155de0 2023-12-16T03:27:07.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.392+0000 7ff469ff6640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff448066470 0x7ff448068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.392+0000 7ff46f5d5000 1 Processor -- start 2023-12-16T03:27:07.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.392+0000 7ff46f5d5000 1 -- start start 2023-12-16T03:27:07.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff469ff6640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff448066470 0x7ff448068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff4600ad000 tx=0x7ff460008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:07.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544650 0x556e1b544a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b545350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b545890 0x556e1b58ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1b40ef00 con 0x556e1b544f70 2023-12-16T03:27:07.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1b39edd0 con 0x556e1b544650 2023-12-16T03:27:07.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e1b39c300 con 0x556e1b545890 2023-12-16T03:27:07.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4697f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b545350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4697f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b545350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55066/0 (socket says 172.21.15.28:55066) 2023-12-16T03:27:07.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4697f5640 1 -- 172.21.15.28:0/3572671229 learned_addr learned my addr 172.21.15.28:0/3572671229 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:07.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46a7f7640 1 --2- 172.21.15.28:0/3572671229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b545890 0x556e1b58ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff469ff6640 1 --2- 172.21.15.28:0/3572671229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544650 0x556e1b544a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4697f5640 1 -- 172.21.15.28:0/3572671229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b545890 msgr2=0x556e1b58ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:07.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4697f5640 1 --2- 172.21.15.28:0/3572671229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b545890 0x556e1b58ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4697f5640 1 -- 172.21.15.28:0/3572671229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544650 msgr2=0x556e1b544a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:07.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4697f5640 1 --2- 172.21.15.28:0/3572671229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544650 0x556e1b544a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4697f5640 1 -- 172.21.15.28:0/3572671229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e1b08f890 con 0x556e1b544f70 2023-12-16T03:27:07.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4697f5640 1 --2- 172.21.15.28:0/3572671229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b545350 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff4640c5aa0 tx=0x7ff454007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fb9cc923f98cc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4477fe640 1 -- 172.21.15.28:0/3572671229 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454005ad0 con 0x556e1b544f70 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4477fe640 1 -- 172.21.15.28:0/3572671229 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff454005c30 con 0x556e1b544f70 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff4477fe640 1 -- 172.21.15.28:0/3572671229 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4540070d0 con 0x556e1b544f70 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3572671229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 msgr2=0x556e1b545350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/3572671229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b545350 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff4640c5aa0 tx=0x7ff454007d40 comp rx=0 tx=0).stop 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3572671229 shutdown_connections 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/3572671229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b545890 0x556e1b58ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/3572671229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b545350 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/3572671229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544650 0x556e1b544a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3572671229 >> 172.21.15.28:0/3572671229 conn(0x556e1b54d2f0 msgr2=0x556e1b584b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3572671229 shutdown_connections 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3572671229 wait complete. 2023-12-16T03:27:07.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 -- start start 2023-12-16T03:27:07.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.396+0000 7ff46f5d5000 1 Processor -- start 2023-12-16T03:27:07.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544650 0x556e1b549400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544f70 0x556e1b549940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b545890 0x556e1b549e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1b397bf0 con 0x556e1b544650 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1b34fc60 con 0x556e1b544f70 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e1b355b00 con 0x556e1b545890 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 10 client.0 _ll_register_callbacks cb 0x556e1b532710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff469ff6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544650 0x556e1b549400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff469ff6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544650 0x556e1b549400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55072/0 (socket says 172.21.15.28:55072) 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff469ff6640 1 -- 172.21.15.28:0/3624324533 learned_addr learned my addr 172.21.15.28:0/3624324533 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46a7f7640 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b545890 0x556e1b549e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff4697f5640 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544f70 0x556e1b549940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff469ff6640 1 -- 172.21.15.28:0/3624324533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b545890 msgr2=0x556e1b549e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff469ff6640 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b545890 0x556e1b549e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff469ff6640 1 -- 172.21.15.28:0/3624324533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544f70 msgr2=0x556e1b549940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff469ff6640 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544f70 0x556e1b549940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff469ff6640 1 -- 172.21.15.28:0/3624324533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff450003530 con 0x556e1b544650 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff469ff6640 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544650 0x556e1b549400 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff46001aae0 tx=0x7ff46001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e8b8bfb5d000a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff444ff9640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff444ff9640 1 -- 172.21.15.28:0/3624324533 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600b65f0 con 0x556e1b544650 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff444ff9640 1 -- 172.21.15.28:0/3624324533 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4600bd040 con 0x556e1b544650 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3624324533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e1b355490 con 0x556e1b544650 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff444ff9640 1 -- 172.21.15.28:0/3624324533 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4600b6750 con 0x556e1b544650 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 10 client.5922 fetch_fsmap learned FSMap version 32 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3624324533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x556e1b358200 con 0x556e1b544650 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff444ff9640 1 -- 172.21.15.28:0/3624324533 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556e1b355490 con 0x556e1b544650 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff444ff9640 1 -- 172.21.15.28:0/3624324533 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff4600b68b0 con 0x556e1b544650 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 10 client.5922 fetch_fsmap finished waiting for FSMap version 32 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 10 client.5922 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 20 client.5922 populate_metadata read hostname 'smithi028' 2023-12-16T03:27:07.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.28:6834/3717643902,v1:172.21.15.28:6836/3717643902] conn(0x556e1b597140 0x556e1b599530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 4 client.5922 mds_command: new command op to 5781 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-16T03:27:07.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3624324533 --> [v2:172.21.15.28:6834/3717643902,v1:172.21.15.28:6836/3717643902] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e1b396540 con 0x556e1b597140 2023-12-16T03:27:07.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff4697f5640 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.28:6834/3717643902,v1:172.21.15.28:6836/3717643902] conn(0x556e1b597140 0x556e1b599530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff4697f5640 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.28:6834/3717643902,v1:172.21.15.28:6836/3717643902] conn(0x556e1b597140 0x556e1b599530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c18d4ba44090206e server_cookie=871836c8f10b0738 in_seq=0 out_seq=0 2023-12-16T03:27:07.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.400+0000 7ff444ff9640 10 client.5922 ms_handle_connect on v2:172.21.15.28:6834/3717643902 2023-12-16T03:27:07.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff444ff9640 1 -- 172.21.15.28:0/3624324533 <== mds.0 v2:172.21.15.28:6834/3717643902 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556e1b396540 con 0x556e1b597140 2023-12-16T03:27:07.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff444ff9640 10 client.5922 handle_command_reply: tid=0 2023-12-16T03:27:07.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 1 client.5922 shutdown 2023-12-16T03:27:07.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3624324533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544650 msgr2=0x556e1b549400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544650 0x556e1b549400 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff46001aae0 tx=0x7ff46001ac70 comp rx=0 tx=0).stop 2023-12-16T03:27:07.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3624324533 shutdown_connections 2023-12-16T03:27:07.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.28:6834/3717643902,v1:172.21.15.28:6836/3717643902] conn(0x556e1b597140 0x556e1b599530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b545890 0x556e1b549e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544f70 0x556e1b549940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff444ff9640 0 client.5922 ms_handle_reset on v2:172.21.15.28:6834/3717643902 2023-12-16T03:27:07.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/3624324533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544650 0x556e1b549400 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3624324533 >> 172.21.15.28:0/3624324533 conn(0x556e1b54d2f0 msgr2=0x556e1b543d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:07.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3624324533 shutdown_connections 2023-12-16T03:27:07.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 1 -- 172.21.15.28:0/3624324533 wait complete. 2023-12-16T03:27:07.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.404+0000 7ff46f5d5000 20 client.5922 trim_cache size 0 max 16384 2023-12-16T03:27:07.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 Processor -- start 2023-12-16T03:27:07.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 -- start start 2023-12-16T03:27:07.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b54d2f0 0x556e1b594740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544650 0x556e1b599530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b544f70 0x556e1b599a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1b050940 con 0x556e1b54d2f0 2023-12-16T03:27:07.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1b39bbf0 con 0x556e1b544650 2023-12-16T03:27:07.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e1b395400 con 0x556e1b544f70 2023-12-16T03:27:07.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff469ff6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b54d2f0 0x556e1b594740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff469ff6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b54d2f0 0x556e1b594740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55082/0 (socket says 172.21.15.28:55082) 2023-12-16T03:27:07.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff469ff6640 1 -- 172.21.15.28:0/1018781390 learned_addr learned my addr 172.21.15.28:0/1018781390 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:07.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff4697f5640 1 --2- 172.21.15.28:0/1018781390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544650 0x556e1b599530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46a7f7640 1 --2- 172.21.15.28:0/1018781390 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b544f70 0x556e1b599a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff469ff6640 1 -- 172.21.15.28:0/1018781390 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b544f70 msgr2=0x556e1b599a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:07.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff469ff6640 1 --2- 172.21.15.28:0/1018781390 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b544f70 0x556e1b599a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff469ff6640 1 -- 172.21.15.28:0/1018781390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544650 msgr2=0x556e1b599530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff469ff6640 1 --2- 172.21.15.28:0/1018781390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544650 0x556e1b599530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff469ff6640 1 -- 172.21.15.28:0/1018781390 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e1b33e500 con 0x556e1b54d2f0 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46a7f7640 1 --2- 172.21.15.28:0/1018781390 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b544f70 0x556e1b599a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff469ff6640 1 --2- 172.21.15.28:0/1018781390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b54d2f0 0x556e1b594740 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff460000c10 tx=0x7ff4600c5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aab65dd2aac8a02 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff447fff640 1 -- 172.21.15.28:0/1018781390 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600b67f0 con 0x556e1b54d2f0 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff447fff640 1 -- 172.21.15.28:0/1018781390 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4600a4ed0 con 0x556e1b54d2f0 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff447fff640 1 -- 172.21.15.28:0/1018781390 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600c4480 con 0x556e1b54d2f0 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1018781390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b54d2f0 msgr2=0x556e1b594740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/1018781390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b54d2f0 0x556e1b594740 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff460000c10 tx=0x7ff4600c5000 comp rx=0 tx=0).stop 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1018781390 shutdown_connections 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/1018781390 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b544f70 0x556e1b599a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/1018781390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b544650 0x556e1b599530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/1018781390 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b54d2f0 0x556e1b594740 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1018781390 >> 172.21.15.28:0/1018781390 conn(0x556e1b543e50 msgr2=0x556e1b580c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:07.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1018781390 shutdown_connections 2023-12-16T03:27:07.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.420+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1018781390 wait complete. 2023-12-16T03:27:07.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 -- start start 2023-12-16T03:27:07.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 Processor -- start 2023-12-16T03:27:07.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b544650 0x556e1b5b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b5b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b54d2f0 0x556e1b5b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1b39a750 con 0x556e1b544f70 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1b339cd0 con 0x556e1b54d2f0 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e1b0901b0 con 0x556e1b544650 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 10 client.0 _ll_register_callbacks cb 0x556e1b512f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff4697f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b5b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff4697f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b5b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55090/0 (socket says 172.21.15.28:55090) 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff4697f5640 1 -- 172.21.15.28:0/1844214499 learned_addr learned my addr 172.21.15.28:0/1844214499 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff469ff6640 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b544650 0x556e1b5b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46a7f7640 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b54d2f0 0x556e1b5b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff4697f5640 1 -- 172.21.15.28:0/1844214499 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b544650 msgr2=0x556e1b5b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff4697f5640 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b544650 0x556e1b5b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff4697f5640 1 -- 172.21.15.28:0/1844214499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b54d2f0 msgr2=0x556e1b5b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff4697f5640 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b54d2f0 0x556e1b5b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff4697f5640 1 -- 172.21.15.28:0/1844214499 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e1b358200 con 0x556e1b544f70 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff4697f5640 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b5b1c60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff454007d80 tx=0x7ff454000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f491864ea9cecb31 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff444ff9640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff444ff9640 1 -- 172.21.15.28:0/1844214499 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454023040 con 0x556e1b544f70 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1844214499 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e1b31ea50 con 0x556e1b544f70 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff444ff9640 1 -- 172.21.15.28:0/1844214499 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff454029580 con 0x556e1b544f70 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff444ff9640 1 -- 172.21.15.28:0/1844214499 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff454029740 con 0x556e1b544f70 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 10 client.5928 fetch_fsmap learned FSMap version 32 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1844214499 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x556e1b08fcc0 con 0x556e1b544f70 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff444ff9640 1 -- 172.21.15.28:0/1844214499 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556e1b31ea50 con 0x556e1b544f70 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff444ff9640 1 -- 172.21.15.28:0/1844214499 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff454012070 con 0x556e1b544f70 2023-12-16T03:27:07.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 10 client.5928 fetch_fsmap finished waiting for FSMap version 32 2023-12-16T03:27:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 10 client.5928 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-16T03:27:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 20 client.5928 populate_metadata read hostname 'smithi028' 2023-12-16T03:27:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.28:6834/3717643902,v1:172.21.15.28:6836/3717643902] conn(0x556e1b545890 0x556e1b5f5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 4 client.5928 mds_command: new command op to 5781 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-16T03:27:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1844214499 --> [v2:172.21.15.28:6834/3717643902,v1:172.21.15.28:6836/3717643902] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556e1b3c5f30 con 0x556e1b545890 2023-12-16T03:27:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.424+0000 7ff469ff6640 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.28:6834/3717643902,v1:172.21.15.28:6836/3717643902] conn(0x556e1b545890 0x556e1b5f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff469ff6640 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.28:6834/3717643902,v1:172.21.15.28:6836/3717643902] conn(0x556e1b545890 0x556e1b5f5520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10b6b16c519a21a9 server_cookie=4a9b5d7c11c0ccf8 in_seq=0 out_seq=0 2023-12-16T03:27:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff444ff9640 10 client.5928 ms_handle_connect on v2:172.21.15.28:6834/3717643902 2023-12-16T03:27:07.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff444ff9640 1 -- 172.21.15.28:0/1844214499 <== mds.0 v2:172.21.15.28:6834/3717643902 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x556e1b3c5f30 con 0x556e1b545890 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff444ff9640 10 client.5928 handle_command_reply: tid=0 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 1 client.5928 shutdown 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1844214499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 msgr2=0x556e1b5b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b5b1c60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff454007d80 tx=0x7ff454000ee0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1844214499 shutdown_connections 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556e1b54d2f0 0x556e1b5b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556e1b544f70 0x556e1b5b1c60 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.28:6834/3717643902,v1:172.21.15.28:6836/3717643902] conn(0x556e1b545890 0x556e1b5f5520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 1 --2- 172.21.15.28:0/1844214499 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556e1b544650 0x556e1b5b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1844214499 >> 172.21.15.28:0/1844214499 conn(0x556e1b543e50 msgr2=0x556e1b593520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff444ff9640 0 client.5928 ms_handle_reset on v2:172.21.15.28:6834/3717643902 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1844214499 shutdown_connections 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 1 -- 172.21.15.28:0/1844214499 wait complete. 2023-12-16T03:27:07.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46f5d5000 20 client.5928 trim_cache size 0 max 16384 2023-12-16T03:27:07.435 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:27:07.435 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "96b65b79-be1d-4832-b923-85c874d6fb27", 2023-12-16T03:27:07.435 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2023-12-16T03:27:07.435 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 5781, 2023-12-16T03:27:07.435 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2023-12-16T03:27:07.435 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2023-12-16T03:27:07.435 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2023-12-16T03:27:07.435 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 5.9330358419999998, 2023-12-16T03:27:07.435 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 32, 2023-12-16T03:27:07.435 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 50, 2023-12-16T03:27:07.436 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 50, 2023-12-16T03:27:07.436 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 11.845052684000001 2023-12-16T03:27:07.436 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:27:07.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 -- 172.21.15.28:0/1375589225 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff448066470 msgr2=0x7ff448068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff448066470 0x7ff448068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff4600ad000 tx=0x7ff460008040 comp rx=0 tx=0).stop 2023-12-16T03:27:07.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 -- 172.21.15.28:0/1375589225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff464155de0 msgr2=0x7ff46414ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff464155de0 0x7ff46414ed50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00c730 tx=0x7ff45c00cbf0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 -- 172.21.15.28:0/1375589225 shutdown_connections 2023-12-16T03:27:07.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff448066470 0x7ff448068930 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff464155de0 0x7ff46414ed50 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff4640c5640 0x7ff46414e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 --2- 172.21.15.28:0/1375589225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4640c5260 0x7ff46415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 -- 172.21.15.28:0/1375589225 >> 172.21.15.28:0/1375589225 conn(0x7ff46406a5b0 msgr2=0x7ff464066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:07.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 -- 172.21.15.28:0/1375589225 shutdown_connections 2023-12-16T03:27:07.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.428+0000 7ff46c25a640 1 -- 172.21.15.28:0/1375589225 wait complete. 2023-12-16T03:27:07.450 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:27:07.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14c56d6640 1 Processor -- start 2023-12-16T03:27:07.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14c56d6640 1 -- start start 2023-12-16T03:27:07.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14c56d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c006e4d0 0x7f14c0154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14c56d6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c00a5f60 con 0x7f14c0151bb0 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14c56d6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c0158a20 con 0x7f14c006eea0 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14c56d6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c0157c60 con 0x7f14c006e4d0 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14beffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f14c0151bb0 0x7f14c00c3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57814/0 (socket says 172.21.15.28:57814) 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14beffd640 1 -- 172.21.15.28:0/1892458333 learned_addr learned my addr 172.21.15.28:0/1892458333 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14be7fc640 1 --2- 172.21.15.28:0/1892458333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c006e4d0 0x7f14c0154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14bdffb640 1 -- 172.21.15.28:0/1892458333 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656721566 0 0) 0x7f14c00a5f60 con 0x7f14c0151bb0 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14bdffb640 1 -- 172.21.15.28:0/1892458333 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a8003530 con 0x7f14c0151bb0 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14bdffb640 1 -- 172.21.15.28:0/1892458333 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816761288 0 0) 0x7f14c0158a20 con 0x7f14c006eea0 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14bdffb640 1 -- 172.21.15.28:0/1892458333 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c00a5f60 con 0x7f14c006eea0 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14be7fc640 1 -- 172.21.15.28:0/1892458333 >> v1:172.21.15.134:6789/0 conn(0x7f14c006eea0 legacy=0x7f14c0154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14be7fc640 1 -- 172.21.15.28:0/1892458333 >> v1:172.21.15.28:6789/0 conn(0x7f14c0151bb0 legacy=0x7f14c00c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14bdffb640 1 -- 172.21.15.28:0/1892458333 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4237925854 0 0) 0x7f14a8003530 con 0x7f14c0151bb0 2023-12-16T03:27:07.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.592+0000 7f14be7fc640 1 -- 172.21.15.28:0/1892458333 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0157f40 con 0x7f14c006e4d0 2023-12-16T03:27:07.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.596+0000 7f14be7fc640 1 --2- 172.21.15.28:0/1892458333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c006e4d0 0x7f14c0154650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f14b40097f0 tx=0x7f14b401c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5699ee224d5bdce7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:07.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.596+0000 7f14bdffb640 1 -- 172.21.15.28:0/1892458333 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b0001680 con 0x7f14c006e4d0 2023-12-16T03:27:07.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.596+0000 7f14bdffb640 1 -- 172.21.15.28:0/1892458333 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b40a7050 con 0x7f14c006e4d0 2023-12-16T03:27:07.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.596+0000 7f14bdffb640 1 -- 172.21.15.28:0/1892458333 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40ab620 con 0x7f14c006e4d0 2023-12-16T03:27:07.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.596+0000 7f14c56d6640 1 -- 172.21.15.28:0/1892458333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c006e4d0 msgr2=0x7f14c0154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.596+0000 7f14c56d6640 1 --2- 172.21.15.28:0/1892458333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c006e4d0 0x7f14c0154650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f14b40097f0 tx=0x7f14b401c320 comp rx=0 tx=0).stop 2023-12-16T03:27:07.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.596+0000 7f14c56d6640 1 -- 172.21.15.28:0/1892458333 shutdown_connections 2023-12-16T03:27:07.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.596+0000 7f14c56d6640 1 --2- 172.21.15.28:0/1892458333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c006e4d0 0x7f14c0154650 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.596+0000 7f14c56d6640 1 -- 172.21.15.28:0/1892458333 >> 172.21.15.28:0/1892458333 conn(0x7f14c00c6b70 msgr2=0x7f14c00c6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:07.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.596+0000 7f14c56d6640 1 -- 172.21.15.28:0/1892458333 shutdown_connections 2023-12-16T03:27:07.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.596+0000 7f14c56d6640 1 -- 172.21.15.28:0/1892458333 wait complete. 2023-12-16T03:27:07.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14c56d6640 1 Processor -- start 2023-12-16T03:27:07.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14c56d6640 1 -- start start 2023-12-16T03:27:07.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14c56d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c006e4d0 0x7f14c00a73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14c56d6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14c006eea0 0x7f14c0154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14c56d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c0151bb0 0x7f14c00a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14c56d6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c00a6ce0 con 0x7f14c006eea0 2023-12-16T03:27:07.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14c56d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c014d980 con 0x7f14c0151bb0 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14c56d6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c01510c0 con 0x7f14c006e4d0 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14be7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14c006eea0 0x7f14c0154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14be7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14c006eea0 0x7f14c0154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55094/0 (socket says 172.21.15.28:55094) 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14be7fc640 1 -- 172.21.15.28:0/1913595333 learned_addr learned my addr 172.21.15.28:0/1913595333 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14bf7fe640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c0151bb0 0x7f14c00a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14beffd640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c006e4d0 0x7f14c00a73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14be7fc640 1 -- 172.21.15.28:0/1913595333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c006e4d0 msgr2=0x7f14c00a73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14be7fc640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c006e4d0 0x7f14c00a73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14be7fc640 1 -- 172.21.15.28:0/1913595333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c0151bb0 msgr2=0x7f14c00a7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14be7fc640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c0151bb0 0x7f14c00a7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14be7fc640 1 -- 172.21.15.28:0/1913595333 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4009420 con 0x7f14c006eea0 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14bf7fe640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c0151bb0 0x7f14c00a7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14be7fc640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14c006eea0 0x7f14c0154740 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f14b40ae040 tx=0x7f14b401ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14a77fe640 1 -- 172.21.15.28:0/1913595333 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40abcd0 con 0x7f14c006eea0 2023-12-16T03:27:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14a77fe640 1 -- 172.21.15.28:0/1913595333 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b40abe50 con 0x7f14c006eea0 2023-12-16T03:27:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14a77fe640 1 -- 172.21.15.28:0/1913595333 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4004260 con 0x7f14c006eea0 2023-12-16T03:27:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14c56d6640 1 -- 172.21.15.28:0/1913595333 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c0158f60 con 0x7f14c006eea0 2023-12-16T03:27:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.600+0000 7f14c56d6640 1 -- 172.21.15.28:0/1913595333 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c00a6ee0 con 0x7f14c006eea0 2023-12-16T03:27:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.604+0000 7f14c56d6640 1 -- 172.21.15.28:0/1913595333 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c004e850 con 0x7f14c006eea0 2023-12-16T03:27:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.604+0000 7f14a77fe640 1 -- 172.21.15.28:0/1913595333 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f14b40043c0 con 0x7f14c006eea0 2023-12-16T03:27:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.604+0000 7f14a77fe640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f14ac066470 0x7f14ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.604+0000 7f14a77fe640 1 -- 172.21.15.28:0/1913595333 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14b411e530 con 0x7f14c006eea0 2023-12-16T03:27:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.604+0000 7f14beffd640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f14ac066470 0x7f14ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:07.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.604+0000 7f14beffd640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f14ac066470 0x7f14ac068930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f14b00011f0 tx=0x7f14b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:07.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.608+0000 7f14a77fe640 1 -- 172.21.15.28:0/1913595333 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f14b40eb9a0 con 0x7f14c006eea0 2023-12-16T03:27:07.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.804+0000 7f14c56d6640 1 -- 172.21.15.28:0/1913595333 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f14c006e970 con 0x7f14c006eea0 2023-12-16T03:27:07.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.804+0000 7f14a77fe640 1 -- 172.21.15.28:0/1913595333 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f14b40eefc0 con 0x7f14c006eea0 2023-12-16T03:27:07.808 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:27:07.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 -- 172.21.15.28:0/1913595333 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f14ac066470 msgr2=0x7f14ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f14ac066470 0x7f14ac068930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f14b00011f0 tx=0x7f14b0009040 comp rx=0 tx=0).stop 2023-12-16T03:27:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 -- 172.21.15.28:0/1913595333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14c006eea0 msgr2=0x7f14c0154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14c006eea0 0x7f14c0154740 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f14b40ae040 tx=0x7f14b401ab60 comp rx=0 tx=0).stop 2023-12-16T03:27:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 -- 172.21.15.28:0/1913595333 shutdown_connections 2023-12-16T03:27:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14c0151bb0 0x7f14c00a7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f14ac066470 0x7f14ac068930 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f14c006eea0 0x7f14c0154740 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 --2- 172.21.15.28:0/1913595333 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f14c006e4d0 0x7f14c00a73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 -- 172.21.15.28:0/1913595333 >> 172.21.15.28:0/1913595333 conn(0x7f14c00c6b70 msgr2=0x7f14c00c34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 -- 172.21.15.28:0/1913595333 shutdown_connections 2023-12-16T03:27:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:07.808+0000 7f14c56d6640 1 -- 172.21.15.28:0/1913595333 wait complete. 2023-12-16T03:27:07.829 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-16T03:27:07.830 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:27:07.830 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2023-12-16T03:27:07.830 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-16T03:27:07.830 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T03:27:07.830 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-16T03:27:07.830 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:27:07.830 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:27:07.830 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:27:07.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:07.830 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2023-12-16T03:27:07.840 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42278sec preferred_lft 42278sec 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:9f:0c:41:28 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:07.841 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:27:07.842 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:07.842 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:27:07.842 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:07.842 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:27:07.842 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:07.842 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:27:07.842 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T03:27:07.842 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:27:07.842 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:07.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:07.843 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:27:07.908 INFO:teuthology.orchestra.run.smithi028.stdout:1 2023-12-16T03:27:07.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:07.910 DEBUG:teuthology.orchestra.run.smithi028:> route 2023-12-16T03:27:07.967 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2023-12-16T03:27:07.967 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:27:07.967 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-16T03:27:07.967 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:27:07.967 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-16T03:27:07.967 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:27:07.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:07.967 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec bash -c ' 2023-12-16T03:27:07.968 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2023-12-16T03:27:07.968 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-16T03:27:07.968 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-16T03:27:07.968 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-16T03:27:07.968 DEBUG:teuthology.orchestra.run.smithi028:> ') 2023-12-16T03:27:08.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:08.065 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2023-12-16T03:27:08.074 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T03:27:08.075 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:27:08.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:08.075 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2023-12-16T03:27:08.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:27:08.138 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T03:27:08.189 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:27:08.189 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:27:08.241 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-16T03:27:08.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:08.241 DEBUG:teuthology.orchestra.run.smithi028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:08.336 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:08.336 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:27:08.350 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:08.351 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:27:08.351 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:27:08.351 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: trying mount with new device syntax: 0@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs=/ 2023-12-16T03:27:08.351 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:27:08.354 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:27:08.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:08.354 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:27:08.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:08.376 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:27:08.433 INFO:teuthology.orchestra.run.smithi028.stdout:client5788 2023-12-16T03:27:08.433 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:27:08.433 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:08.485 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:27:08.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88d05f5640 1 Processor -- start 2023-12-16T03:27:08.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88d05f5640 1 -- start start 2023-12-16T03:27:08.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88d05f5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f88c80a5370 0x7f88c80c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88d05f5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88c80c4110 0x7f88c8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88d05f5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c80c2760 con 0x7f88c8072090 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88d05f5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c80c3070 con 0x7f88c80a5370 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88d05f5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c8151bf0 con 0x7f88c80c4110 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88ce391640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f88c80a5370 0x7f88c80c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88ce391640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f88c80a5370 0x7f88c80c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55108/0 (socket says 172.21.15.28:55108) 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88ce391640 1 -- 172.21.15.28:0/162658250 learned_addr learned my addr 172.21.15.28:0/162658250 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88cdb90640 1 --2- 172.21.15.28:0/162658250 >> v2:172.21.15.134:3300/0 conn(0x7f88c80c4110 0x7f88c8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88ce391640 1 -- 172.21.15.28:0/162658250 >> v2:172.21.15.134:3300/0 conn(0x7f88c80c4110 msgr2=0x7f88c8150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88ce391640 1 --2- 172.21.15.28:0/162658250 >> v2:172.21.15.134:3300/0 conn(0x7f88c80c4110 0x7f88c8150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.668+0000 7f88ce391640 1 -- 172.21.15.28:0/162658250 >> v1:172.21.15.134:6789/0 conn(0x7f88c8072090 legacy=0x7f88c81514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:08.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88ce391640 1 -- 172.21.15.28:0/162658250 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80a5750 con 0x7f88c80a5370 2023-12-16T03:27:08.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88ce391640 1 --2- 172.21.15.28:0/162658250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c80a5370 0x7f88c80c3bd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f88c806b360 tx=0x7f88c401d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74666f9610eee57 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:08.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88cd38f640 1 -- 172.21.15.28:0/162658250 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c40a7620 con 0x7f88c80a5370 2023-12-16T03:27:08.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88cd38f640 1 -- 172.21.15.28:0/162658250 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c40a7780 con 0x7f88c80a5370 2023-12-16T03:27:08.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88cd38f640 1 -- 172.21.15.28:0/162658250 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c40a7b10 con 0x7f88c80a5370 2023-12-16T03:27:08.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88d05f5640 1 -- 172.21.15.28:0/162658250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c80a5370 msgr2=0x7f88c80c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:08.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88d05f5640 1 --2- 172.21.15.28:0/162658250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c80a5370 0x7f88c80c3bd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f88c806b360 tx=0x7f88c401d5e0 comp rx=0 tx=0).stop 2023-12-16T03:27:08.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88d05f5640 1 -- 172.21.15.28:0/162658250 shutdown_connections 2023-12-16T03:27:08.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88d05f5640 1 --2- 172.21.15.28:0/162658250 >> v2:172.21.15.134:3300/0 conn(0x7f88c80c4110 0x7f88c8150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:08.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88d05f5640 1 --2- 172.21.15.28:0/162658250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c80a5370 0x7f88c80c3bd0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:08.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88d05f5640 1 -- 172.21.15.28:0/162658250 >> 172.21.15.28:0/162658250 conn(0x7f88c806a5b0 msgr2=0x7f88c806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:08.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88d05f5640 1 -- 172.21.15.28:0/162658250 shutdown_connections 2023-12-16T03:27:08.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.672+0000 7f88d05f5640 1 -- 172.21.15.28:0/162658250 wait complete. 2023-12-16T03:27:08.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88d05f5640 1 Processor -- start 2023-12-16T03:27:08.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88d05f5640 1 -- start start 2023-12-16T03:27:08.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88d05f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c8072090 0x7f88c81f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:08.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88d05f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c80a5370 0x7f88c80a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:08.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88d05f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c80c4110 0x7f88c80bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:08.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88d05f5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c8155170 con 0x7f88c8072090 2023-12-16T03:27:08.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88d05f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c81535a0 con 0x7f88c80a5370 2023-12-16T03:27:08.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88d05f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c81f1190 con 0x7f88c80c4110 2023-12-16T03:27:08.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88ce391640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c8072090 0x7f88c81f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:08.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88ce391640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c8072090 0x7f88c81f0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55120/0 (socket says 172.21.15.28:55120) 2023-12-16T03:27:08.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88ce391640 1 -- 172.21.15.28:0/3957548313 learned_addr learned my addr 172.21.15.28:0/3957548313 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88cdb90640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c80a5370 0x7f88c80a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88ceb92640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c80c4110 0x7f88c80bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88ce391640 1 -- 172.21.15.28:0/3957548313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c80c4110 msgr2=0x7f88c80bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88ce391640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c80c4110 0x7f88c80bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88ce391640 1 -- 172.21.15.28:0/3957548313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c80a5370 msgr2=0x7f88c80a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88ce391640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c80a5370 0x7f88c80a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88ce391640 1 -- 172.21.15.28:0/3957548313 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40094d0 con 0x7f88c8072090 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88ce391640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c8072090 0x7f88c81f0c50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f88c401a1f0 tx=0x7f88c401a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88beffd640 1 -- 172.21.15.28:0/3957548313 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c40b1810 con 0x7f88c8072090 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88beffd640 1 -- 172.21.15.28:0/3957548313 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c400c050 con 0x7f88c8072090 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88beffd640 1 -- 172.21.15.28:0/3957548313 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c40b1bb0 con 0x7f88c8072090 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88d05f5640 1 -- 172.21.15.28:0/3957548313 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c8154bb0 con 0x7f88c8072090 2023-12-16T03:27:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.676+0000 7f88d05f5640 1 -- 172.21.15.28:0/3957548313 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c81f0450 con 0x7f88c8072090 2023-12-16T03:27:08.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.680+0000 7f88d05f5640 1 -- 172.21.15.28:0/3957548313 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c81f02b0 con 0x7f88c8072090 2023-12-16T03:27:08.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.680+0000 7f88beffd640 1 -- 172.21.15.28:0/3957548313 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f88c40b1d10 con 0x7f88c8072090 2023-12-16T03:27:08.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.680+0000 7f88beffd640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88ac066470 0x7f88ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:08.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.680+0000 7f88beffd640 1 -- 172.21.15.28:0/3957548313 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88c411e890 con 0x7f88c8072090 2023-12-16T03:27:08.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.680+0000 7f88cdb90640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88ac066470 0x7f88ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:08.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.680+0000 7f88cdb90640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88ac066470 0x7f88ac068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f88c80c56a0 tx=0x7f88b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.684+0000 7f88beffd640 1 -- 172.21.15.28:0/3957548313 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f88c81f02b0 con 0x7f88c8072090 2023-12-16T03:27:08.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 -- 172.21.15.28:0/3957548313 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88c81f02b0 con 0x7f88c8072090 2023-12-16T03:27:08.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88beffd640 1 -- 172.21.15.28:0/3957548313 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f88c81f02b0 con 0x7f88c8072090 2023-12-16T03:27:08.879 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:27:08.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 -- 172.21.15.28:0/3957548313 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88ac066470 msgr2=0x7f88ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:08.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88ac066470 0x7f88ac068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f88c80c56a0 tx=0x7f88b8008040 comp rx=0 tx=0).stop 2023-12-16T03:27:08.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 -- 172.21.15.28:0/3957548313 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c8072090 msgr2=0x7f88c81f0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:08.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c8072090 0x7f88c81f0c50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f88c401a1f0 tx=0x7f88c401a380 comp rx=0 tx=0).stop 2023-12-16T03:27:08.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 -- 172.21.15.28:0/3957548313 shutdown_connections 2023-12-16T03:27:08.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88c80c4110 0x7f88c80bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:08.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88c80a5370 0x7f88c80a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:08.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88ac066470 0x7f88ac068930 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:08.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 --2- 172.21.15.28:0/3957548313 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88c8072090 0x7f88c81f0c50 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:08.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 -- 172.21.15.28:0/3957548313 >> 172.21.15.28:0/3957548313 conn(0x7f88c806a5b0 msgr2=0x7f88c814c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:08.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 -- 172.21.15.28:0/3957548313 shutdown_connections 2023-12-16T03:27:08.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:08.876+0000 7f88d05f5640 1 -- 172.21.15.28:0/3957548313 wait complete. 2023-12-16T03:27:08.899 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-16T03:27:08.900 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:27:08.900 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-12-16T03:27:08.900 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-16T03:27:08.900 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:27:08.900 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-16T03:27:08.900 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:27:08.900 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:27:08.900 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:27:08.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:08.900 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-12-16T03:27:08.910 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-12-16T03:27:08.911 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42311sec preferred_lft 42311sec 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 02:42:8f:0f:48:af brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:27:08.912 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:08.913 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:27:08.913 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:08.913 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:27:08.913 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T03:27:08.913 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:27:08.913 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:08.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:08.914 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:27:08.981 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-12-16T03:27:08.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:08.983 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-12-16T03:27:09.036 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-12-16T03:27:09.036 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:27:09.036 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-16T03:27:09.036 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T03:27:09.036 INFO:teuthology.orchestra.run.smithi134.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:27:09.036 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T03:27:09.036 INFO:teuthology.orchestra.run.smithi134.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:27:09.036 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:27:09.036 INFO:teuthology.orchestra.run.smithi134.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:27:09.037 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:27:09.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:09.037 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:27:09.037 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:27:09.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T03:27:09.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T03:27:09.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T03:27:09.037 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:27:09.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:09.131 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-16T03:27:09.140 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T03:27:09.141 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:27:09.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:09.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-12-16T03:27:09.205 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:27:09.205 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T03:27:09.257 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:27:09.257 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:27:09.257 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:27:09.309 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-16T03:27:09.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:09.309 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:09.404 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:09.404 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:27:09.419 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:09.419 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:27:09.419 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:27:09.419 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: 1@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs=/ 2023-12-16T03:27:09.419 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:27:09.423 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:27:09.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:09.423 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:27:09.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:09.444 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:27:09.500 INFO:teuthology.orchestra.run.smithi134.stdout:client5943 2023-12-16T03:27:09.500 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:27:09.500 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:09.550 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-16T03:27:09.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.692+0000 7f8ba1b1d640 1 Processor -- start 2023-12-16T03:27:09.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.692+0000 7f8ba1b1d640 1 -- start start 2023-12-16T03:27:09.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8ba1b1d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8b9c151dc0 0x7f8b9c0c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:09.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8ba1b1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0c7ed0 0x7f8b9c154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:09.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8ba1b1d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c0ac4f0 con 0x7f8b9c0bd660 2023-12-16T03:27:09.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8ba1b1d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c158780 con 0x7f8b9c151dc0 2023-12-16T03:27:09.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8ba1b1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c158a60 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8b9affd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0c7ed0 0x7f8b9c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:09.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8b9affd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0c7ed0 0x7f8b9c154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:38890/0 (socket says 172.21.15.28:38890) 2023-12-16T03:27:09.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8b9affd640 1 -- 172.21.15.28:0/1963625416 learned_addr learned my addr 172.21.15.28:0/1963625416 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:09.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8b9b7fe640 1 --2- 172.21.15.28:0/1963625416 >> v2:172.21.15.134:3300/0 conn(0x7f8b9c151dc0 0x7f8b9c0c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:09.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8b9affd640 1 -- 172.21.15.28:0/1963625416 >> v2:172.21.15.134:3300/0 conn(0x7f8b9c151dc0 msgr2=0x7f8b9c0c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:09.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8b9affd640 1 --2- 172.21.15.28:0/1963625416 >> v2:172.21.15.134:3300/0 conn(0x7f8b9c151dc0 0x7f8b9c0c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:09.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8b9affd640 1 -- 172.21.15.28:0/1963625416 >> v1:172.21.15.134:6789/0 conn(0x7f8b9c0bd660 legacy=0x7f8b9c154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:09.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.696+0000 7f8b9affd640 1 -- 172.21.15.28:0/1963625416 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c0ac180 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8b9affd640 1 --2- 172.21.15.28:0/1963625416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0c7ed0 0x7f8b9c154650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009870 tx=0x7f8b9001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7a1a7df4da4aea8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:09.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8b9a7fc640 1 -- 172.21.15.28:0/1963625416 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900ab600 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8b9a7fc640 1 -- 172.21.15.28:0/1963625416 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b900a7050 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8b9a7fc640 1 -- 172.21.15.28:0/1963625416 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900ab980 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/1963625416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0c7ed0 msgr2=0x7f8b9c154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:09.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8ba1b1d640 1 --2- 172.21.15.28:0/1963625416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0c7ed0 0x7f8b9c154650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009870 tx=0x7f8b9001c420 comp rx=0 tx=0).stop 2023-12-16T03:27:09.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/1963625416 shutdown_connections 2023-12-16T03:27:09.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8ba1b1d640 1 --2- 172.21.15.28:0/1963625416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0c7ed0 0x7f8b9c154650 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:09.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8ba1b1d640 1 --2- 172.21.15.28:0/1963625416 >> v2:172.21.15.134:3300/0 conn(0x7f8b9c151dc0 0x7f8b9c0c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:09.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/1963625416 >> 172.21.15.28:0/1963625416 conn(0x7f8b9c071eb0 msgr2=0x7f8b9c0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:09.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/1963625416 shutdown_connections 2023-12-16T03:27:09.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/1963625416 wait complete. 2023-12-16T03:27:09.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8ba1b1d640 1 Processor -- start 2023-12-16T03:27:09.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.700+0000 7f8ba1b1d640 1 -- start start 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8ba1b1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0bd660 0x7f8b9c14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8ba1b1d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b9c0c7ed0 0x7f8b9c15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8ba1b1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b9c151dc0 0x7f8b9c0bf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8ba1b1d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0ab9d0 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8ba1b1d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c1f2300 con 0x7f8b9c151dc0 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8ba1b1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0c8a20 con 0x7f8b9c0bd660 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b9c0c7ed0 0x7f8b9c15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b9c0c7ed0 0x7f8b9c15e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58576/0 (socket says 172.21.15.28:58576) 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9affd640 1 -- 172.21.15.28:0/3994792439 learned_addr learned my addr 172.21.15.28:0/3994792439 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9b7fe640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0bd660 0x7f8b9c14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9bfff640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b9c151dc0 0x7f8b9c0bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:09.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9affd640 1 -- 172.21.15.28:0/3994792439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0bd660 msgr2=0x7f8b9c14faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9affd640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0bd660 0x7f8b9c14faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9affd640 1 -- 172.21.15.28:0/3994792439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b9c151dc0 msgr2=0x7f8b9c0bf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9affd640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b9c151dc0 0x7f8b9c0bf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9affd640 1 -- 172.21.15.28:0/3994792439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b900094d0 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9bfff640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b9c151dc0 0x7f8b9c0bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b9affd640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b9c0c7ed0 0x7f8b9c15e6f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8b900ae040 tx=0x7f8b900191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b83fff640 1 -- 172.21.15.28:0/3994792439 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900b4420 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b83fff640 1 -- 172.21.15.28:0/3994792439 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b900b4580 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/3994792439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9c1f16f0 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b83fff640 1 -- 172.21.15.28:0/3994792439 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900b4930 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/3994792439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c1f1cb0 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/3994792439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9c068400 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.704+0000 7f8b83fff640 1 -- 172.21.15.28:0/3994792439 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8b900b2070 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.708+0000 7f8b83fff640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b88066470 0x7f8b88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.708+0000 7f8b83fff640 1 -- 172.21.15.28:0/3994792439 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b9011d8d0 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.708+0000 7f8b9b7fe640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b88066470 0x7f8b88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.708+0000 7f8b9b7fe640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b88066470 0x7f8b88068930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009aa0 tx=0x7f8b8c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:09.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.712+0000 7f8b83fff640 1 -- 172.21.15.28:0/3994792439 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8b900ead40 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/3994792439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f8b9c06c9a0 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8b83fff640 1 -- 172.21.15.28:0/3994792439 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v15) v1 ==== 84+0+0 (secure 0 0 0) 0x7f8b900b0090 con 0x7f8b9c0c7ed0 2023-12-16T03:27:09.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/3994792439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b88066470 msgr2=0x7f8b88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:09.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b88066470 0x7f8b88068930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009aa0 tx=0x7f8b8c009190 comp rx=0 tx=0).stop 2023-12-16T03:27:09.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/3994792439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b9c0c7ed0 msgr2=0x7f8b9c15e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:09.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b9c0c7ed0 0x7f8b9c15e6f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8b900ae040 tx=0x7f8b900191c0 comp rx=0 tx=0).stop 2023-12-16T03:27:09.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/3994792439 shutdown_connections 2023-12-16T03:27:09.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b9c151dc0 0x7f8b9c0bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:09.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b88066470 0x7f8b88068930 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:09.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b9c0c7ed0 0x7f8b9c15e6f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:09.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 --2- 172.21.15.28:0/3994792439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b9c0bd660 0x7f8b9c14faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:09.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/3994792439 >> 172.21.15.28:0/3994792439 conn(0x7f8b9c071eb0 msgr2=0x7f8b9c150a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:09.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/3994792439 shutdown_connections 2023-12-16T03:27:09.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:09.928+0000 7f8ba1b1d640 1 -- 172.21.15.28:0/3994792439 wait complete. 2023-12-16T03:27:09.952 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:10.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c50c9a640 1 Processor -- start 2023-12-16T03:27:10.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c50c9a640 1 -- start start 2023-12-16T03:27:10.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c50c9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c1555c0 0x7f7c4c0a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c50c9a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7c4c0c61e0 0x7f7c4c0c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c50c9a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4c0c28e0 con 0x7f7c4c0c6c70 2023-12-16T03:27:10.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c50c9a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c0c3680 con 0x7f7c4c0c61e0 2023-12-16T03:27:10.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c50c9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0c2b80 con 0x7f7c4c1555c0 2023-12-16T03:27:10.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c4a59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c1555c0 0x7f7c4c0a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c4a59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c1555c0 0x7f7c4c0a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:38912/0 (socket says 172.21.15.28:38912) 2023-12-16T03:27:10.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c4a59c640 1 -- 172.21.15.28:0/3679638612 learned_addr learned my addr 172.21.15.28:0/3679638612 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:10.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c49d9b640 1 --2- 172.21.15.28:0/3679638612 >> v2:172.21.15.134:3300/0 conn(0x7f7c4c0c61e0 0x7f7c4c0c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c4a59c640 1 -- 172.21.15.28:0/3679638612 >> v2:172.21.15.134:3300/0 conn(0x7f7c4c0c61e0 msgr2=0x7f7c4c0c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:10.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c4a59c640 1 --2- 172.21.15.28:0/3679638612 >> v2:172.21.15.134:3300/0 conn(0x7f7c4c0c61e0 0x7f7c4c0c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c4a59c640 1 -- 172.21.15.28:0/3679638612 >> v1:172.21.15.134:6789/0 conn(0x7f7c4c0c6c70 legacy=0x7f7c4c0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.096+0000 7f7c4a59c640 1 -- 172.21.15.28:0/3679638612 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c0c32a0 con 0x7f7c4c1555c0 2023-12-16T03:27:10.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c4a59c640 1 --2- 172.21.15.28:0/3679638612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c1555c0 0x7f7c4c0a6df0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009870 tx=0x7f7c3c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7df032745141fc9a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:10.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c4959a640 1 -- 172.21.15.28:0/3679638612 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0ab650 con 0x7f7c4c1555c0 2023-12-16T03:27:10.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c4959a640 1 -- 172.21.15.28:0/3679638612 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0ab7b0 con 0x7f7c4c1555c0 2023-12-16T03:27:10.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c4959a640 1 -- 172.21.15.28:0/3679638612 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0abb40 con 0x7f7c4c1555c0 2023-12-16T03:27:10.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c50c9a640 1 -- 172.21.15.28:0/3679638612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c1555c0 msgr2=0x7f7c4c0a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c50c9a640 1 --2- 172.21.15.28:0/3679638612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c1555c0 0x7f7c4c0a6df0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009870 tx=0x7f7c3c01c540 comp rx=0 tx=0).stop 2023-12-16T03:27:10.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c50c9a640 1 -- 172.21.15.28:0/3679638612 shutdown_connections 2023-12-16T03:27:10.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c50c9a640 1 --2- 172.21.15.28:0/3679638612 >> v2:172.21.15.134:3300/0 conn(0x7f7c4c0c61e0 0x7f7c4c0c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c50c9a640 1 --2- 172.21.15.28:0/3679638612 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c1555c0 0x7f7c4c0a6df0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c50c9a640 1 -- 172.21.15.28:0/3679638612 >> 172.21.15.28:0/3679638612 conn(0x7f7c4c0c7e40 msgr2=0x7f7c4c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:10.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c50c9a640 1 -- 172.21.15.28:0/3679638612 shutdown_connections 2023-12-16T03:27:10.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.100+0000 7f7c50c9a640 1 -- 172.21.15.28:0/3679638612 wait complete. 2023-12-16T03:27:10.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c50c9a640 1 Processor -- start 2023-12-16T03:27:10.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c50c9a640 1 -- start start 2023-12-16T03:27:10.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c50c9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c0c61e0 0x7f7c4c0a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c50c9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c0c6c70 0x7f7c4c14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c50c9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c4c1555c0 0x7f7c4c1f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c50c9a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c06e4f0 con 0x7f7c4c1555c0 2023-12-16T03:27:10.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c50c9a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0a7320 con 0x7f7c4c0c6c70 2023-12-16T03:27:10.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c50c9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0ac310 con 0x7f7c4c0c61e0 2023-12-16T03:27:10.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c4ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c4c1555c0 0x7f7c4c1f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c4ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c4c1555c0 0x7f7c4c1f0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58592/0 (socket says 172.21.15.28:58592) 2023-12-16T03:27:10.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c4ad9d640 1 -- 172.21.15.28:0/865586980 learned_addr learned my addr 172.21.15.28:0/865586980 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:10.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c49d9b640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c0c6c70 0x7f7c4c14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c4a59c640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c0c61e0 0x7f7c4c0a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c4ad9d640 1 -- 172.21.15.28:0/865586980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c0c61e0 msgr2=0x7f7c4c0a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c4ad9d640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c0c61e0 0x7f7c4c0a6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c4ad9d640 1 -- 172.21.15.28:0/865586980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c0c6c70 msgr2=0x7f7c4c14f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c4ad9d640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c0c6c70 0x7f7c4c14f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c4ad9d640 1 -- 172.21.15.28:0/865586980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0094d0 con 0x7f7c4c1555c0 2023-12-16T03:27:10.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c4a59c640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c0c61e0 0x7f7c4c0a6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:10.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c4ad9d640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c4c1555c0 0x7f7c4c1f0810 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c770 tx=0x7f7c4400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:10.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c3affd640 1 -- 172.21.15.28:0/865586980 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44003b80 con 0x7f7c4c1555c0 2023-12-16T03:27:10.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c3affd640 1 -- 172.21.15.28:0/865586980 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c44003ce0 con 0x7f7c4c1555c0 2023-12-16T03:27:10.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c3affd640 1 -- 172.21.15.28:0/865586980 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400aa90 con 0x7f7c4c1555c0 2023-12-16T03:27:10.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c50c9a640 1 -- 172.21.15.28:0/865586980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4c0ac5f0 con 0x7f7c4c1555c0 2023-12-16T03:27:10.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c50c9a640 1 -- 172.21.15.28:0/865586980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c1f02f0 con 0x7f7c4c1555c0 2023-12-16T03:27:10.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.104+0000 7f7c50c9a640 1 -- 172.21.15.28:0/865586980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4c068400 con 0x7f7c4c1555c0 2023-12-16T03:27:10.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.108+0000 7f7c3affd640 1 -- 172.21.15.28:0/865586980 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7c4400abf0 con 0x7f7c4c1555c0 2023-12-16T03:27:10.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.108+0000 7f7c3affd640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c2c066470 0x7f7c2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.108+0000 7f7c3affd640 1 -- 172.21.15.28:0/865586980 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c44083b80 con 0x7f7c4c1555c0 2023-12-16T03:27:10.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.108+0000 7f7c4a59c640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c2c066470 0x7f7c2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.108+0000 7f7c4a59c640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c2c066470 0x7f7c2c068930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0af000 tx=0x7f7c3c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:10.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.112+0000 7f7c3affd640 1 -- 172.21.15.28:0/865586980 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7c440510a0 con 0x7f7c4c1555c0 2023-12-16T03:27:10.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.272+0000 7f7c50c9a640 1 -- 172.21.15.28:0/865586980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c4c0c5fc0 con 0x7f7c4c1555c0 2023-12-16T03:27:10.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.272+0000 7f7c3affd640 1 -- 172.21.15.28:0/865586980 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f7c440546c0 con 0x7f7c4c1555c0 2023-12-16T03:27:10.276 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:10.276 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":50,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:02.508725+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:10.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 -- 172.21.15.28:0/865586980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c2c066470 msgr2=0x7f7c2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c2c066470 0x7f7c2c068930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0af000 tx=0x7f7c3c0a7000 comp rx=0 tx=0).stop 2023-12-16T03:27:10.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 -- 172.21.15.28:0/865586980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c4c1555c0 msgr2=0x7f7c4c1f0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c4c1555c0 0x7f7c4c1f0810 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c770 tx=0x7f7c4400cc30 comp rx=0 tx=0).stop 2023-12-16T03:27:10.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 -- 172.21.15.28:0/865586980 shutdown_connections 2023-12-16T03:27:10.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c2c066470 0x7f7c2c068930 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c4c1555c0 0x7f7c4c1f0810 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c4c0c6c70 0x7f7c4c14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 --2- 172.21.15.28:0/865586980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c4c0c61e0 0x7f7c4c0a6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 -- 172.21.15.28:0/865586980 >> 172.21.15.28:0/865586980 conn(0x7f7c4c0c7e40 msgr2=0x7f7c4c06ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:10.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 -- 172.21.15.28:0/865586980 shutdown_connections 2023-12-16T03:27:10.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.276+0000 7f7c50c9a640 1 -- 172.21.15.28:0/865586980 wait complete. 2023-12-16T03:27:10.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:26:58.698173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:26:59.897067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:27:10.298 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:27:10.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.440+0000 7ff410df8640 1 Processor -- start 2023-12-16T03:27:10.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.440+0000 7ff410df8640 1 -- start start 2023-12-16T03:27:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff410df8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff40c151e90 0x7ff40c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff410df8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff40c0c7ea0 0x7ff40c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff410df8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff40c0c4e60 0x7ff40c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff410df8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c0c8750 con 0x7ff40c151e90 2023-12-16T03:27:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff410df8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c1552d0 con 0x7ff40c0c7ea0 2023-12-16T03:27:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff410df8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c5c60 con 0x7ff40c0c4e60 2023-12-16T03:27:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff40a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff40c151e90 0x7ff40c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff40a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff40c151e90 0x7ff40c0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58598/0 (socket says 172.21.15.28:58598) 2023-12-16T03:27:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff40a59c640 1 -- 172.21.15.28:0/2535166604 learned_addr learned my addr 172.21.15.28:0/2535166604 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff409d9b640 1 --2- 172.21.15.28:0/2535166604 >> v2:172.21.15.134:3300/0 conn(0x7ff40c0c7ea0 0x7ff40c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff40ad9d640 1 --2- 172.21.15.28:0/2535166604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff40c0c4e60 0x7ff40c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff40a59c640 1 -- 172.21.15.28:0/2535166604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff40c0c4e60 msgr2=0x7ff40c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff40a59c640 1 --2- 172.21.15.28:0/2535166604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff40c0c4e60 0x7ff40c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff40a59c640 1 -- 172.21.15.28:0/2535166604 >> v2:172.21.15.134:3300/0 conn(0x7ff40c0c7ea0 msgr2=0x7ff40c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff40a59c640 1 --2- 172.21.15.28:0/2535166604 >> v2:172.21.15.134:3300/0 conn(0x7ff40c0c7ea0 0x7ff40c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff40a59c640 1 -- 172.21.15.28:0/2535166604 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c06c860 con 0x7ff40c151e90 2023-12-16T03:27:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff409d9b640 1 --2- 172.21.15.28:0/2535166604 >> v2:172.21.15.134:3300/0 conn(0x7ff40c0c7ea0 0x7ff40c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:10.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.444+0000 7ff40a59c640 1 --2- 172.21.15.28:0/2535166604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff40c151e90 0x7ff40c0c4920 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0a9a70 tx=0x7ff3fc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d70f47deff5983 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:10.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff40959a640 1 -- 172.21.15.28:0/2535166604 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0ab600 con 0x7ff40c151e90 2023-12-16T03:27:10.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff40959a640 1 -- 172.21.15.28:0/2535166604 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc0a7050 con 0x7ff40c151e90 2023-12-16T03:27:10.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff40959a640 1 -- 172.21.15.28:0/2535166604 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0ab980 con 0x7ff40c151e90 2023-12-16T03:27:10.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 -- 172.21.15.28:0/2535166604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff40c151e90 msgr2=0x7ff40c0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 --2- 172.21.15.28:0/2535166604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff40c151e90 0x7ff40c0c4920 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0a9a70 tx=0x7ff3fc01c3e0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 -- 172.21.15.28:0/2535166604 shutdown_connections 2023-12-16T03:27:10.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 --2- 172.21.15.28:0/2535166604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff40c0c4e60 0x7ff40c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 --2- 172.21.15.28:0/2535166604 >> v2:172.21.15.134:3300/0 conn(0x7ff40c0c7ea0 0x7ff40c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 --2- 172.21.15.28:0/2535166604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff40c151e90 0x7ff40c0c4920 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 -- 172.21.15.28:0/2535166604 >> 172.21.15.28:0/2535166604 conn(0x7ff40c0ca170 msgr2=0x7ff40c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:10.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 -- 172.21.15.28:0/2535166604 shutdown_connections 2023-12-16T03:27:10.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 -- 172.21.15.28:0/2535166604 wait complete. 2023-12-16T03:27:10.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 Processor -- start 2023-12-16T03:27:10.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 -- start start 2023-12-16T03:27:10.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff40c0c4e60 0x7ff40c1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff40c0c7ea0 0x7ff40c0c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff40c151e90 0x7ff40c0c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c27d0 con 0x7ff40c151e90 2023-12-16T03:27:10.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c1280 con 0x7ff40c0c7ea0 2023-12-16T03:27:10.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.448+0000 7ff410df8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c1560 con 0x7ff40c0c4e60 2023-12-16T03:27:10.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff40ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff40c151e90 0x7ff40c0c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff40a59c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff40c0c4e60 0x7ff40c1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff40ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff40c151e90 0x7ff40c0c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58608/0 (socket says 172.21.15.28:58608) 2023-12-16T03:27:10.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff40ad9d640 1 -- 172.21.15.28:0/166333330 learned_addr learned my addr 172.21.15.28:0/166333330 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:10.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff409d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff40c0c7ea0 0x7ff40c0c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff40ad9d640 1 -- 172.21.15.28:0/166333330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff40c0c4e60 msgr2=0x7ff40c1526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff40ad9d640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff40c0c4e60 0x7ff40c1526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff40ad9d640 1 -- 172.21.15.28:0/166333330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff40c0c7ea0 msgr2=0x7ff40c0c19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff40ad9d640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff40c0c7ea0 0x7ff40c0c19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff40ad9d640 1 -- 172.21.15.28:0/166333330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0094d0 con 0x7ff40c151e90 2023-12-16T03:27:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff40ad9d640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff40c151e90 0x7ff40c0c35e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff40400eed0 tx=0x7ff40400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff3faffd640 1 -- 172.21.15.28:0/166333330 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404010040 con 0x7ff40c151e90 2023-12-16T03:27:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff3faffd640 1 -- 172.21.15.28:0/166333330 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40400bd20 con 0x7ff40c151e90 2023-12-16T03:27:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff3faffd640 1 -- 172.21.15.28:0/166333330 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404014640 con 0x7ff40c151e90 2023-12-16T03:27:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff410df8640 1 -- 172.21.15.28:0/166333330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c1464c0 con 0x7ff40c151e90 2023-12-16T03:27:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff410df8640 1 -- 172.21.15.28:0/166333330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c1540c0 con 0x7ff40c151e90 2023-12-16T03:27:10.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff410df8640 1 -- 172.21.15.28:0/166333330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c068400 con 0x7ff40c151e90 2023-12-16T03:27:10.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.452+0000 7ff3faffd640 1 -- 172.21.15.28:0/166333330 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff4040147a0 con 0x7ff40c151e90 2023-12-16T03:27:10.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.456+0000 7ff3faffd640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3ec066470 0x7ff3ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.456+0000 7ff3faffd640 1 -- 172.21.15.28:0/166333330 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff404084670 con 0x7ff40c151e90 2023-12-16T03:27:10.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.456+0000 7ff40a59c640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3ec066470 0x7ff3ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.456+0000 7ff40a59c640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3ec066470 0x7ff3ec068930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0ad000 tx=0x7ff3fc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:10.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.460+0000 7ff3faffd640 1 -- 172.21.15.28:0/166333330 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff404051ba0 con 0x7ff40c151e90 2023-12-16T03:27:10.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.616+0000 7ff410df8640 1 -- 172.21.15.28:0/166333330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff40c06ca50 con 0x7ff40c151e90 2023-12-16T03:27:10.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.616+0000 7ff3faffd640 1 -- 172.21.15.28:0/166333330 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4040551c0 con 0x7ff40c151e90 2023-12-16T03:27:10.621 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:27:10.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 -- 172.21.15.28:0/166333330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3ec066470 msgr2=0x7ff3ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3ec066470 0x7ff3ec068930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0ad000 tx=0x7ff3fc0a6000 comp rx=0 tx=0).stop 2023-12-16T03:27:10.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 -- 172.21.15.28:0/166333330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff40c151e90 msgr2=0x7ff40c0c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff40c151e90 0x7ff40c0c35e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff40400eed0 tx=0x7ff40400b480 comp rx=0 tx=0).stop 2023-12-16T03:27:10.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 -- 172.21.15.28:0/166333330 shutdown_connections 2023-12-16T03:27:10.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3ec066470 0x7ff3ec068930 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff40c151e90 0x7ff40c0c35e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff40c0c7ea0 0x7ff40c0c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 --2- 172.21.15.28:0/166333330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff40c0c4e60 0x7ff40c1526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 -- 172.21.15.28:0/166333330 >> 172.21.15.28:0/166333330 conn(0x7ff40c0ca170 msgr2=0x7ff40c0c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:10.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 -- 172.21.15.28:0/166333330 shutdown_connections 2023-12-16T03:27:10.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.620+0000 7ff410df8640 1 -- 172.21.15.28:0/166333330 wait complete. 2023-12-16T03:27:10.642 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:27:10.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.784+0000 7f9f62e3a640 1 Processor -- start 2023-12-16T03:27:10.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.784+0000 7f9f62e3a640 1 -- start start 2023-12-16T03:27:10.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62e3a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f5c14f800 0x7f9f5c072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62e3a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9f5c072860 0x7f9f5c06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62e3a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f5c0c1010 0x7f9f5c155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62e3a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c071e90 con 0x7f9f5c0c1010 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62e3a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c0a5110 con 0x7f9f5c072860 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62e3a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c152d70 con 0x7f9f5c14f800 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62639640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f5c0c1010 0x7f9f5c155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62639640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f5c0c1010 0x7f9f5c155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58610/0 (socket says 172.21.15.28:58610) 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62639640 1 -- 172.21.15.28:0/18843242 learned_addr learned my addr 172.21.15.28:0/18843242 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f61e38640 1 --2- 172.21.15.28:0/18843242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f5c14f800 0x7f9f5c072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f61637640 1 --2- 172.21.15.28:0/18843242 >> v2:172.21.15.134:3300/0 conn(0x7f9f5c072860 0x7f9f5c06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62639640 1 -- 172.21.15.28:0/18843242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f5c14f800 msgr2=0x7f9f5c072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62639640 1 --2- 172.21.15.28:0/18843242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f5c14f800 0x7f9f5c072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62639640 1 -- 172.21.15.28:0/18843242 >> v2:172.21.15.134:3300/0 conn(0x7f9f5c072860 msgr2=0x7f9f5c06fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62639640 1 --2- 172.21.15.28:0/18843242 >> v2:172.21.15.134:3300/0 conn(0x7f9f5c072860 0x7f9f5c06fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.788+0000 7f9f62639640 1 -- 172.21.15.28:0/18843242 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c153050 con 0x7f9f5c0c1010 2023-12-16T03:27:10.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62639640 1 --2- 172.21.15.28:0/18843242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f5c0c1010 0x7f9f5c155840 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0a88c0 tx=0x7f9f5401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fc19d4a619dcfd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:10.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f60e36640 1 -- 172.21.15.28:0/18843242 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f540a57b0 con 0x7f9f5c0c1010 2023-12-16T03:27:10.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f60e36640 1 -- 172.21.15.28:0/18843242 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f540a5910 con 0x7f9f5c0c1010 2023-12-16T03:27:10.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f60e36640 1 -- 172.21.15.28:0/18843242 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f540a5ca0 con 0x7f9f5c0c1010 2023-12-16T03:27:10.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 -- 172.21.15.28:0/18843242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f5c0c1010 msgr2=0x7f9f5c155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 --2- 172.21.15.28:0/18843242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f5c0c1010 0x7f9f5c155840 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0a88c0 tx=0x7f9f5401c910 comp rx=0 tx=0).stop 2023-12-16T03:27:10.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 -- 172.21.15.28:0/18843242 shutdown_connections 2023-12-16T03:27:10.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 --2- 172.21.15.28:0/18843242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f5c0c1010 0x7f9f5c155840 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 --2- 172.21.15.28:0/18843242 >> v2:172.21.15.134:3300/0 conn(0x7f9f5c072860 0x7f9f5c06fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 --2- 172.21.15.28:0/18843242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f5c14f800 0x7f9f5c072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 -- 172.21.15.28:0/18843242 >> 172.21.15.28:0/18843242 conn(0x7f9f5c0a7800 msgr2=0x7f9f5c0a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:10.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 -- 172.21.15.28:0/18843242 shutdown_connections 2023-12-16T03:27:10.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 -- 172.21.15.28:0/18843242 wait complete. 2023-12-16T03:27:10.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 Processor -- start 2023-12-16T03:27:10.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 -- start start 2023-12-16T03:27:10.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f5c072860 0x7f9f5c143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f5c0c1010 0x7f9f5c14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f5c14f800 0x7f9f5c1ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c1ecfc0 con 0x7f9f5c072860 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c06bf70 con 0x7f9f5c14f800 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.792+0000 7f9f62e3a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0a73e0 con 0x7f9f5c0c1010 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f61e38640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f5c072860 0x7f9f5c143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f61e38640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f5c072860 0x7f9f5c143790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58620/0 (socket says 172.21.15.28:58620) 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f61e38640 1 -- 172.21.15.28:0/3170859851 learned_addr learned my addr 172.21.15.28:0/3170859851 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f61637640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f5c0c1010 0x7f9f5c14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f62639640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f5c14f800 0x7f9f5c1ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f61e38640 1 -- 172.21.15.28:0/3170859851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f5c0c1010 msgr2=0x7f9f5c14d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f61e38640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f5c0c1010 0x7f9f5c14d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f61e38640 1 -- 172.21.15.28:0/3170859851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f5c14f800 msgr2=0x7f9f5c1ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f61e38640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f5c14f800 0x7f9f5c1ed410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f61e38640 1 -- 172.21.15.28:0/3170859851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54009b30 con 0x7f9f5c072860 2023-12-16T03:27:10.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f61e38640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f5c072860 0x7f9f5c143790 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800d5f0 tx=0x7f9f5800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f527fc640 1 -- 172.21.15.28:0/3170859851 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f580125f0 con 0x7f9f5c072860 2023-12-16T03:27:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f527fc640 1 -- 172.21.15.28:0/3170859851 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f58012750 con 0x7f9f5c072860 2023-12-16T03:27:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f527fc640 1 -- 172.21.15.28:0/3170859851 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f58012ae0 con 0x7f9f5c072860 2023-12-16T03:27:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f62e3a640 1 -- 172.21.15.28:0/3170859851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c14ed00 con 0x7f9f5c072860 2023-12-16T03:27:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f62e3a640 1 -- 172.21.15.28:0/3170859851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c06def0 con 0x7f9f5c072860 2023-12-16T03:27:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f62e3a640 1 -- 172.21.15.28:0/3170859851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c04e850 con 0x7f9f5c072860 2023-12-16T03:27:10.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f527fc640 1 -- 172.21.15.28:0/3170859851 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9f58012c40 con 0x7f9f5c072860 2023-12-16T03:27:10.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.796+0000 7f9f527fc640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f400664a0 0x7f9f40068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:10.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.800+0000 7f9f527fc640 1 -- 172.21.15.28:0/3170859851 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f58084120 con 0x7f9f5c072860 2023-12-16T03:27:10.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.800+0000 7f9f61637640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f400664a0 0x7f9f40068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:10.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.800+0000 7f9f61637640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f400664a0 0x7f9f40068960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c06f5b0 tx=0x7f9f4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:10.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.800+0000 7f9f527fc640 1 -- 172.21.15.28:0/3170859851 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9f58051640 con 0x7f9f5c072860 2023-12-16T03:27:10.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 -- 172.21.15.28:0/3170859851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f5c0c5370 con 0x7f9f5c072860 2023-12-16T03:27:10.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f527fc640 1 -- 172.21.15.28:0/3170859851 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f58004650 con 0x7f9f5c072860 2023-12-16T03:27:10.963 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:27:10.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 -- 172.21.15.28:0/3170859851 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f400664a0 msgr2=0x7f9f40068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f400664a0 0x7f9f40068960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c06f5b0 tx=0x7f9f4c008040 comp rx=0 tx=0).stop 2023-12-16T03:27:10.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 -- 172.21.15.28:0/3170859851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f5c072860 msgr2=0x7f9f5c143790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:10.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f5c072860 0x7f9f5c143790 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800d5f0 tx=0x7f9f5800dab0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 -- 172.21.15.28:0/3170859851 shutdown_connections 2023-12-16T03:27:10.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f5c14f800 0x7f9f5c1ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f5c0c1010 0x7f9f5c14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f400664a0 0x7f9f40068960 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 --2- 172.21.15.28:0/3170859851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f5c072860 0x7f9f5c143790 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:10.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 -- 172.21.15.28:0/3170859851 >> 172.21.15.28:0/3170859851 conn(0x7f9f5c0a7800 msgr2=0x7f9f5c14b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:10.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 -- 172.21.15.28:0/3170859851 shutdown_connections 2023-12-16T03:27:10.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:10.960+0000 7f9f62e3a640 1 -- 172.21.15.28:0/3170859851 wait complete. 2023-12-16T03:27:10.984 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:27:11.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd99d99d640 1 Processor -- start 2023-12-16T03:27:11.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd99d99d640 1 -- start start 2023-12-16T03:27:11.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd99d99d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd998151e90 0x7fd9980c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd99d99d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99806c860 con 0x7fd9980c7ea0 2023-12-16T03:27:11.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd99d99d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd998154930 con 0x7fd9980c4e60 2023-12-16T03:27:11.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd99d99d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9980c8750 con 0x7fd998151e90 2023-12-16T03:27:11.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd9967fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd9980c7ea0 0x7fd99806b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40948/0 (socket says 172.21.15.28:40948) 2023-12-16T03:27:11.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd9967fc640 1 -- 172.21.15.28:0/597512151 learned_addr learned my addr 172.21.15.28:0/597512151 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:11.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd996ffd640 1 --2- 172.21.15.28:0/597512151 >> v2:172.21.15.134:3300/0 conn(0x7fd998151e90 0x7fd9980c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd995ffb640 1 -- 172.21.15.28:0/597512151 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145947799 0 0) 0x7fd99806c860 con 0x7fd9980c7ea0 2023-12-16T03:27:11.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd995ffb640 1 -- 172.21.15.28:0/597512151 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd980003530 con 0x7fd9980c7ea0 2023-12-16T03:27:11.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd995ffb640 1 -- 172.21.15.28:0/597512151 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077693547 0 0) 0x7fd998154930 con 0x7fd9980c4e60 2023-12-16T03:27:11.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd995ffb640 1 -- 172.21.15.28:0/597512151 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd99806c860 con 0x7fd9980c4e60 2023-12-16T03:27:11.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd996ffd640 1 -- 172.21.15.28:0/597512151 >> v1:172.21.15.134:6789/0 conn(0x7fd9980c4e60 legacy=0x7fd99815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd996ffd640 1 -- 172.21.15.28:0/597512151 >> v1:172.21.15.28:6789/0 conn(0x7fd9980c7ea0 legacy=0x7fd99806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.128+0000 7fd996ffd640 1 -- 172.21.15.28:0/597512151 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998154c10 con 0x7fd998151e90 2023-12-16T03:27:11.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.132+0000 7fd996ffd640 1 --2- 172.21.15.28:0/597512151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd998151e90 0x7fd9980c4920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd9880097c0 tx=0x7fd98801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a98bad807c2ba3bf server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:11.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.132+0000 7fd995ffb640 1 -- 172.21.15.28:0/597512151 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9880ab600 con 0x7fd998151e90 2023-12-16T03:27:11.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.132+0000 7fd995ffb640 1 -- 172.21.15.28:0/597512151 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9880a7050 con 0x7fd998151e90 2023-12-16T03:27:11.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.132+0000 7fd995ffb640 1 -- 172.21.15.28:0/597512151 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9880ab980 con 0x7fd998151e90 2023-12-16T03:27:11.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.132+0000 7fd99d99d640 1 -- 172.21.15.28:0/597512151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd998151e90 msgr2=0x7fd9980c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.132+0000 7fd99d99d640 1 --2- 172.21.15.28:0/597512151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd998151e90 0x7fd9980c4920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd9880097c0 tx=0x7fd98801c360 comp rx=0 tx=0).stop 2023-12-16T03:27:11.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.132+0000 7fd99d99d640 1 -- 172.21.15.28:0/597512151 shutdown_connections 2023-12-16T03:27:11.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.132+0000 7fd99d99d640 1 --2- 172.21.15.28:0/597512151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd998151e90 0x7fd9980c4920 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.132+0000 7fd99d99d640 1 -- 172.21.15.28:0/597512151 >> 172.21.15.28:0/597512151 conn(0x7fd9980ca170 msgr2=0x7fd9980ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:11.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.132+0000 7fd99d99d640 1 -- 172.21.15.28:0/597512151 shutdown_connections 2023-12-16T03:27:11.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.132+0000 7fd99d99d640 1 -- 172.21.15.28:0/597512151 wait complete. 2023-12-16T03:27:11.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd99d99d640 1 Processor -- start 2023-12-16T03:27:11.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd99d99d640 1 -- start start 2023-12-16T03:27:11.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd99d99d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd9980c4e60 0x7fd9981ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd99d99d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9980c7ea0 0x7fd9981edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd99d99d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd998151e90 0x7fd998149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd99d99d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981552d0 con 0x7fd9980c4e60 2023-12-16T03:27:11.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd99d99d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981ee5d0 con 0x7fd9980c7ea0 2023-12-16T03:27:11.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd99d99d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981ee080 con 0x7fd998151e90 2023-12-16T03:27:11.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd996ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd9980c4e60 0x7fd9981ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd996ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd9980c4e60 0x7fd9981ed600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58634/0 (socket says 172.21.15.28:58634) 2023-12-16T03:27:11.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd996ffd640 1 -- 172.21.15.28:0/225456540 learned_addr learned my addr 172.21.15.28:0/225456540 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:11.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd9977fe640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd998151e90 0x7fd998149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd9967fc640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9980c7ea0 0x7fd9981edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd996ffd640 1 -- 172.21.15.28:0/225456540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd998151e90 msgr2=0x7fd998149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd996ffd640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd998151e90 0x7fd998149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd996ffd640 1 -- 172.21.15.28:0/225456540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9980c7ea0 msgr2=0x7fd9981edb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd996ffd640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9980c7ea0 0x7fd9981edb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd996ffd640 1 -- 172.21.15.28:0/225456540 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd988009420 con 0x7fd9980c4e60 2023-12-16T03:27:11.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd996ffd640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd9980c4e60 0x7fd9981ed600 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd988018f70 tx=0x7fd98801aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:11.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd97ffff640 1 -- 172.21.15.28:0/225456540 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9880abd20 con 0x7fd9980c4e60 2023-12-16T03:27:11.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd97ffff640 1 -- 172.21.15.28:0/225456540 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9880b7450 con 0x7fd9980c4e60 2023-12-16T03:27:11.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd97ffff640 1 -- 172.21.15.28:0/225456540 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9880abea0 con 0x7fd9980c4e60 2023-12-16T03:27:11.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd99d99d640 1 -- 172.21.15.28:0/225456540 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9981ee2f0 con 0x7fd9980c4e60 2023-12-16T03:27:11.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd99d99d640 1 -- 172.21.15.28:0/225456540 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9980bdf10 con 0x7fd9980c4e60 2023-12-16T03:27:11.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.136+0000 7fd99d99d640 1 -- 172.21.15.28:0/225456540 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99814a840 con 0x7fd9980c4e60 2023-12-16T03:27:11.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.140+0000 7fd97ffff640 1 -- 172.21.15.28:0/225456540 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd9880b7800 con 0x7fd9980c4e60 2023-12-16T03:27:11.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.140+0000 7fd97ffff640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd984066470 0x7fd984068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.140+0000 7fd97ffff640 1 -- 172.21.15.28:0/225456540 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd98811e4f0 con 0x7fd9980c4e60 2023-12-16T03:27:11.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.140+0000 7fd9967fc640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd984066470 0x7fd984068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.140+0000 7fd9967fc640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd984066470 0x7fd984068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd99814f2d0 tx=0x7fd98c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:11.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.144+0000 7fd97ffff640 1 -- 172.21.15.28:0/225456540 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd9880eb970 con 0x7fd9980c4e60 2023-12-16T03:27:11.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd99d99d640 1 -- 172.21.15.28:0/225456540 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9980bda70 con 0x7fd9980c4e60 2023-12-16T03:27:11.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd97ffff640 1 -- 172.21.15.28:0/225456540 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd9880eef90 con 0x7fd9980c4e60 2023-12-16T03:27:11.303 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:27:11.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd99d99d640 1 -- 172.21.15.28:0/225456540 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd984066470 msgr2=0x7fd984068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd99d99d640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd984066470 0x7fd984068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd99814f2d0 tx=0x7fd98c009040 comp rx=0 tx=0).stop 2023-12-16T03:27:11.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd99d99d640 1 -- 172.21.15.28:0/225456540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd9980c4e60 msgr2=0x7fd9981ed600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd99d99d640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd9980c4e60 0x7fd9981ed600 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd988018f70 tx=0x7fd98801aba0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd99d99d640 1 -- 172.21.15.28:0/225456540 shutdown_connections 2023-12-16T03:27:11.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd99d99d640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd998151e90 0x7fd998149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd99d99d640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9980c7ea0 0x7fd9981edb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd99d99d640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd984066470 0x7fd984068930 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd99d99d640 1 --2- 172.21.15.28:0/225456540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd9980c4e60 0x7fd9981ed600 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.300+0000 7fd99d99d640 1 -- 172.21.15.28:0/225456540 >> 172.21.15.28:0/225456540 conn(0x7fd9980ca170 msgr2=0x7fd998148420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:11.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.304+0000 7fd99d99d640 1 -- 172.21.15.28:0/225456540 shutdown_connections 2023-12-16T03:27:11.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.304+0000 7fd99d99d640 1 -- 172.21.15.28:0/225456540 wait complete. 2023-12-16T03:27:11.325 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-16T03:27:11.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.464+0000 7fa96dbf8640 1 Processor -- start 2023-12-16T03:27:11.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.464+0000 7fa96dbf8640 1 -- start start 2023-12-16T03:27:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.464+0000 7fa96dbf8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa968073a70 0x7fa9680bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.464+0000 7fa96dbf8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96806a5b0 con 0x7fa96814b010 2023-12-16T03:27:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.464+0000 7fa96dbf8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96806b710 con 0x7fa968157c20 2023-12-16T03:27:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.464+0000 7fa96dbf8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9680c1d60 con 0x7fa968073a70 2023-12-16T03:27:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.464+0000 7fa9677fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa96814b010 0x7fa96806b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40958/0 (socket says 172.21.15.28:40958) 2023-12-16T03:27:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.464+0000 7fa9677fe640 1 -- 172.21.15.28:0/4186041561 learned_addr learned my addr 172.21.15.28:0/4186041561 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.468+0000 7fa966ffd640 1 --2- 172.21.15.28:0/4186041561 >> v2:172.21.15.134:3300/0 conn(0x7fa968073a70 0x7fa9680bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.468+0000 7fa9667fc640 1 -- 172.21.15.28:0/4186041561 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602708098 0 0) 0x7fa96806a5b0 con 0x7fa96814b010 2023-12-16T03:27:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.468+0000 7fa9667fc640 1 -- 172.21.15.28:0/4186041561 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa950003530 con 0x7fa96814b010 2023-12-16T03:27:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.468+0000 7fa966ffd640 1 -- 172.21.15.28:0/4186041561 >> v1:172.21.15.134:6789/0 conn(0x7fa968157c20 legacy=0x7fa968158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.468+0000 7fa966ffd640 1 -- 172.21.15.28:0/4186041561 >> v1:172.21.15.28:6789/0 conn(0x7fa96814b010 legacy=0x7fa96806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.468+0000 7fa966ffd640 1 -- 172.21.15.28:0/4186041561 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680c2040 con 0x7fa968073a70 2023-12-16T03:27:11.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.468+0000 7fa966ffd640 1 --2- 172.21.15.28:0/4186041561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa968073a70 0x7fa9680bf9f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0097c0 tx=0x7fa95c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=900c2e4d5f396a34 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:11.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.468+0000 7fa9667fc640 1 -- 172.21.15.28:0/4186041561 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0a8970 con 0x7fa968073a70 2023-12-16T03:27:11.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.468+0000 7fa9667fc640 1 -- 172.21.15.28:0/4186041561 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c0a8ad0 con 0x7fa968073a70 2023-12-16T03:27:11.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.468+0000 7fa9667fc640 1 -- 172.21.15.28:0/4186041561 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0a8e60 con 0x7fa968073a70 2023-12-16T03:27:11.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 -- 172.21.15.28:0/4186041561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa968073a70 msgr2=0x7fa9680bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 --2- 172.21.15.28:0/4186041561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa968073a70 0x7fa9680bf9f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0097c0 tx=0x7fa95c01ec70 comp rx=0 tx=0).stop 2023-12-16T03:27:11.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 -- 172.21.15.28:0/4186041561 shutdown_connections 2023-12-16T03:27:11.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 --2- 172.21.15.28:0/4186041561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa968073a70 0x7fa9680bf9f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 -- 172.21.15.28:0/4186041561 >> 172.21.15.28:0/4186041561 conn(0x7fa9680c30c0 msgr2=0x7fa9680c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:11.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 -- 172.21.15.28:0/4186041561 shutdown_connections 2023-12-16T03:27:11.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 -- 172.21.15.28:0/4186041561 wait complete. 2023-12-16T03:27:11.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 Processor -- start 2023-12-16T03:27:11.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 -- start start 2023-12-16T03:27:11.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa968073a70 0x7fa9680ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa96814b010 0x7fa968153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa968157c20 0x7fa968071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680bf6c0 con 0x7fa968073a70 2023-12-16T03:27:11.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680ac0f0 con 0x7fa968157c20 2023-12-16T03:27:11.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa96dbf8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680bf3e0 con 0x7fa96814b010 2023-12-16T03:27:11.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa9677fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa968073a70 0x7fa9680ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa9677fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa968073a70 0x7fa9680ac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58638/0 (socket says 172.21.15.28:58638) 2023-12-16T03:27:11.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa9677fe640 1 -- 172.21.15.28:0/856381157 learned_addr learned my addr 172.21.15.28:0/856381157 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa966ffd640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa96814b010 0x7fa968153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.472+0000 7fa967fff640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa968157c20 0x7fa968071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa9677fe640 1 -- 172.21.15.28:0/856381157 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa96814b010 msgr2=0x7fa968153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa9677fe640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa96814b010 0x7fa968153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa9677fe640 1 -- 172.21.15.28:0/856381157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa968157c20 msgr2=0x7fa968071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa9677fe640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa968157c20 0x7fa968071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa9677fe640 1 -- 172.21.15.28:0/856381157 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c009420 con 0x7fa968073a70 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa9677fe640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa968073a70 0x7fa9680ac5d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c4d0 tx=0x7fa95800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa94ffff640 1 -- 172.21.15.28:0/856381157 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958005cf0 con 0x7fa968073a70 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa94ffff640 1 -- 172.21.15.28:0/856381157 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958005e50 con 0x7fa968073a70 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa96dbf8640 1 -- 172.21.15.28:0/856381157 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa968151c90 con 0x7fa968073a70 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa94ffff640 1 -- 172.21.15.28:0/856381157 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958007270 con 0x7fa968073a70 2023-12-16T03:27:11.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa96dbf8640 1 -- 172.21.15.28:0/856381157 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9680a9460 con 0x7fa968073a70 2023-12-16T03:27:11.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa96dbf8640 1 -- 172.21.15.28:0/856381157 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa968151af0 con 0x7fa968073a70 2023-12-16T03:27:11.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa94ffff640 1 -- 172.21.15.28:0/856381157 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa9580073d0 con 0x7fa968073a70 2023-12-16T03:27:11.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa94ffff640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa9540664a0 0x7fa954068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa94ffff640 1 -- 172.21.15.28:0/856381157 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa958083390 con 0x7fa968073a70 2023-12-16T03:27:11.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.476+0000 7fa966ffd640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa9540664a0 0x7fa954068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.480+0000 7fa966ffd640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa9540664a0 0x7fa954068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0b2000 tx=0x7fa95c0aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:11.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.480+0000 7fa94ffff640 1 -- 172.21.15.28:0/856381157 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa968151af0 con 0x7fa968073a70 2023-12-16T03:27:11.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.648+0000 7fa96dbf8640 1 -- 172.21.15.28:0/856381157 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa968151af0 con 0x7fa968073a70 2023-12-16T03:27:11.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.648+0000 7fa94ffff640 1 -- 172.21.15.28:0/856381157 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+207 (secure 0 0 0) 0x7fa9580170e0 con 0x7fa968073a70 2023-12-16T03:27:11.652 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:11.652 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2023-12-16T03:27:11.652 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:11.652 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2023-12-16T03:27:11.652 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2023-12-16T03:27:11.652 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:11.652 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:11.652 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 8, 2023-12-16T03:27:11.652 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": "cephfs_metadata" 2023-12-16T03:27:11.652 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:11.652 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:11.653 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 9, 2023-12-16T03:27:11.653 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": "cephfs_data" 2023-12-16T03:27:11.653 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:11.653 INFO:teuthology.orchestra.run.smithi028.stdout:] 2023-12-16T03:27:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 -- 172.21.15.28:0/856381157 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa9540664a0 msgr2=0x7fa954068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa9540664a0 0x7fa954068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0b2000 tx=0x7fa95c0aa070 comp rx=0 tx=0).stop 2023-12-16T03:27:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 -- 172.21.15.28:0/856381157 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa968073a70 msgr2=0x7fa9680ac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa968073a70 0x7fa9680ac5d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c4d0 tx=0x7fa95800c990 comp rx=0 tx=0).stop 2023-12-16T03:27:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 -- 172.21.15.28:0/856381157 shutdown_connections 2023-12-16T03:27:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa968157c20 0x7fa968071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa96814b010 0x7fa968153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa9540664a0 0x7fa954068960 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 --2- 172.21.15.28:0/856381157 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa968073a70 0x7fa9680ac5d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 -- 172.21.15.28:0/856381157 >> 172.21.15.28:0/856381157 conn(0x7fa9680c30c0 msgr2=0x7fa968158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:11.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 -- 172.21.15.28:0/856381157 shutdown_connections 2023-12-16T03:27:11.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.652+0000 7fa96dbf8640 1 -- 172.21.15.28:0/856381157 wait complete. 2023-12-16T03:27:11.673 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-16T03:27:11.673 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-16T03:27:11.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.816+0000 7f0c88e46640 1 Processor -- start 2023-12-16T03:27:11.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.816+0000 7f0c88e46640 1 -- start start 2023-12-16T03:27:11.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c88e46640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c840c4fb0 0x7f0c840c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c88e46640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0c8406db90 0x7f0c8406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c88e46640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c840aa750 con 0x7f0c8406c840 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c88e46640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8406e530 con 0x7f0c8406db90 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c88e46640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840a8f90 con 0x7f0c840c4fb0 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c81d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0c8406db90 0x7f0c8406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c82d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0c8406c840 0x7f0c8406ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40974/0 (socket says 172.21.15.28:40974) 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c81d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0c8406db90 0x7f0c8406dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58640/0 (socket says 172.21.15.28:58640) 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c82d9d640 1 -- 172.21.15.28:0/92137119 learned_addr learned my addr 172.21.15.28:0/92137119 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c8259c640 1 --2- 172.21.15.28:0/92137119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c840c4fb0 0x7f0c840c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c81d9b640 1 -- 172.21.15.28:0/92137119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c840c4fb0 msgr2=0x7f0c840c1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c81d9b640 1 --2- 172.21.15.28:0/92137119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c840c4fb0 0x7f0c840c1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c81d9b640 1 -- 172.21.15.28:0/92137119 >> v1:172.21.15.28:6789/0 conn(0x7f0c8406c840 legacy=0x7f0c8406ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c81d9b640 1 -- 172.21.15.28:0/92137119 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c840a9270 con 0x7f0c8406db90 2023-12-16T03:27:11.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.820+0000 7f0c8159a640 1 -- 172.21.15.28:0/92137119 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713043974 0 0) 0x7f0c840aa750 con 0x7f0c8406c840 2023-12-16T03:27:11.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c81d9b640 1 --2- 172.21.15.28:0/92137119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c8406db90 0x7f0c8406dff0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0c780097c0 tx=0x7f0c7801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c53937ff4ced85 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:11.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c8159a640 1 -- 172.21.15.28:0/92137119 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c780ad660 con 0x7f0c8406db90 2023-12-16T03:27:11.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c8159a640 1 -- 172.21.15.28:0/92137119 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c780ad7c0 con 0x7f0c8406db90 2023-12-16T03:27:11.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c8159a640 1 -- 172.21.15.28:0/92137119 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c780adb50 con 0x7f0c8406db90 2023-12-16T03:27:11.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c88e46640 1 -- 172.21.15.28:0/92137119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c8406db90 msgr2=0x7f0c8406dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c88e46640 1 --2- 172.21.15.28:0/92137119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c8406db90 0x7f0c8406dff0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0c780097c0 tx=0x7f0c7801c360 comp rx=0 tx=0).stop 2023-12-16T03:27:11.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c88e46640 1 -- 172.21.15.28:0/92137119 shutdown_connections 2023-12-16T03:27:11.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c88e46640 1 --2- 172.21.15.28:0/92137119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c8406db90 0x7f0c8406dff0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c88e46640 1 --2- 172.21.15.28:0/92137119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c840c4fb0 0x7f0c840c1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c88e46640 1 -- 172.21.15.28:0/92137119 >> 172.21.15.28:0/92137119 conn(0x7f0c840c5d40 msgr2=0x7f0c840c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:11.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c88e46640 1 -- 172.21.15.28:0/92137119 shutdown_connections 2023-12-16T03:27:11.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c88e46640 1 -- 172.21.15.28:0/92137119 wait complete. 2023-12-16T03:27:11.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c88e46640 1 Processor -- start 2023-12-16T03:27:11.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.824+0000 7f0c88e46640 1 -- start start 2023-12-16T03:27:11.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c88e46640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8406c840 0x7f0c8415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c88e46640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c8406db90 0x7f0c841f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c88e46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c840c4fb0 0x7f0c841508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c88e46640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c841f1860 con 0x7f0c840c4fb0 2023-12-16T03:27:11.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c88e46640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8414f270 con 0x7f0c8406c840 2023-12-16T03:27:11.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c88e46640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8414f550 con 0x7f0c8406db90 2023-12-16T03:27:11.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c82d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c840c4fb0 0x7f0c841508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c82d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c840c4fb0 0x7f0c841508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58644/0 (socket says 172.21.15.28:58644) 2023-12-16T03:27:11.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c82d9d640 1 -- 172.21.15.28:0/916486329 learned_addr learned my addr 172.21.15.28:0/916486329 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:11.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c81d9b640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c8406db90 0x7f0c841f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c8259c640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8406c840 0x7f0c8415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c82d9d640 1 -- 172.21.15.28:0/916486329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c8406db90 msgr2=0x7f0c841f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c82d9d640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c8406db90 0x7f0c841f1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c82d9d640 1 -- 172.21.15.28:0/916486329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8406c840 msgr2=0x7f0c8415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:11.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c82d9d640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8406c840 0x7f0c8415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:11.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c82d9d640 1 -- 172.21.15.28:0/916486329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c78009420 con 0x7f0c840c4fb0 2023-12-16T03:27:11.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c82d9d640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c840c4fb0 0x7f0c841508c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c001570 tx=0x7f0c7c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:11.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c72ffd640 1 -- 172.21.15.28:0/916486329 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00a640 con 0x7f0c840c4fb0 2023-12-16T03:27:11.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c72ffd640 1 -- 172.21.15.28:0/916486329 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c00a7c0 con 0x7f0c840c4fb0 2023-12-16T03:27:11.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c88e46640 1 -- 172.21.15.28:0/916486329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c841ed4e0 con 0x7f0c840c4fb0 2023-12-16T03:27:11.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c72ffd640 1 -- 172.21.15.28:0/916486329 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00ab70 con 0x7f0c840c4fb0 2023-12-16T03:27:11.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c88e46640 1 -- 172.21.15.28:0/916486329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8414e200 con 0x7f0c840c4fb0 2023-12-16T03:27:11.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.828+0000 7f0c88e46640 1 -- 172.21.15.28:0/916486329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c841eda00 con 0x7f0c840c4fb0 2023-12-16T03:27:11.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.832+0000 7f0c72ffd640 1 -- 172.21.15.28:0/916486329 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0c7c00acd0 con 0x7f0c840c4fb0 2023-12-16T03:27:11.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.832+0000 7f0c72ffd640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c640664a0 0x7f0c64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:11.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.832+0000 7f0c72ffd640 1 -- 172.21.15.28:0/916486329 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c7c0835c0 con 0x7f0c840c4fb0 2023-12-16T03:27:11.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.832+0000 7f0c8259c640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c640664a0 0x7f0c64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:11.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.832+0000 7f0c8259c640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c640664a0 0x7f0c64068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0c8415f000 tx=0x7f0c74008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:11.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.836+0000 7f0c72ffd640 1 -- 172.21.15.28:0/916486329 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0c841eda00 con 0x7f0c840c4fb0 2023-12-16T03:27:11.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:11.996+0000 7f0c88e46640 1 -- 172.21.15.28:0/916486329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0c841eda00 con 0x7f0c840c4fb0 2023-12-16T03:27:12.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c72ffd640 1 -- 172.21.15.28:0/916486329 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v51) v1 ==== 140+0+0 (secure 0 0 0) 0x7f0c841eda00 con 0x7f0c840c4fb0 2023-12-16T03:27:12.566 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_metadata' created 2023-12-16T03:27:12.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 -- 172.21.15.28:0/916486329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c640664a0 msgr2=0x7f0c64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:12.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c640664a0 0x7f0c64068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0c8415f000 tx=0x7f0c74008040 comp rx=0 tx=0).stop 2023-12-16T03:27:12.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 -- 172.21.15.28:0/916486329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c840c4fb0 msgr2=0x7f0c841508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:12.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c840c4fb0 0x7f0c841508c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c001570 tx=0x7f0c7c00cca0 comp rx=0 tx=0).stop 2023-12-16T03:27:12.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 -- 172.21.15.28:0/916486329 shutdown_connections 2023-12-16T03:27:12.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c640664a0 0x7f0c64068960 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:12.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0c840c4fb0 0x7f0c841508c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:12.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0c8406db90 0x7f0c841f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:12.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 --2- 172.21.15.28:0/916486329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8406c840 0x7f0c8415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:12.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 -- 172.21.15.28:0/916486329 >> 172.21.15.28:0/916486329 conn(0x7f0c840c5d40 msgr2=0x7f0c840bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:12.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 -- 172.21.15.28:0/916486329 shutdown_connections 2023-12-16T03:27:12.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.564+0000 7f0c88e46640 1 -- 172.21.15.28:0/916486329 wait complete. 2023-12-16T03:27:12.598 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-16T03:27:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.748+0000 7f53cf8fe640 1 Processor -- start 2023-12-16T03:27:12.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.748+0000 7f53cf8fe640 1 -- start start 2023-12-16T03:27:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.748+0000 7f53cf8fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53c80c5260 0x7f53c806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.748+0000 7f53cf8fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f53c80c5640 0x7f53c80c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.748+0000 7f53cf8fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c80c2580 con 0x7f53c80c60f0 2023-12-16T03:27:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.748+0000 7f53cf8fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c8153510 con 0x7f53c80c5640 2023-12-16T03:27:12.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.748+0000 7f53cf8fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80c17f0 con 0x7f53c80c5260 2023-12-16T03:27:12.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.748+0000 7f53cd69a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53c80c5260 0x7f53c806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:12.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.748+0000 7f53cce99640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f53c80c5640 0x7f53c80c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:12.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.748+0000 7f53cde9b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f53c80c60f0 0x7f53c8155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:48774/0 (socket says 172.21.15.28:48774) 2023-12-16T03:27:12.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.748+0000 7f53cde9b640 1 -- 172.21.15.28:0/2748995641 learned_addr learned my addr 172.21.15.28:0/2748995641 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:12.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.752+0000 7f53cd69a640 1 -- 172.21.15.28:0/2748995641 >> v2:172.21.15.134:3300/0 conn(0x7f53c80c5640 msgr2=0x7f53c80c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:12.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.752+0000 7f53cd69a640 1 --2- 172.21.15.28:0/2748995641 >> v2:172.21.15.134:3300/0 conn(0x7f53c80c5640 0x7f53c80c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:12.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.752+0000 7f53cd69a640 1 -- 172.21.15.28:0/2748995641 >> v1:172.21.15.134:6789/0 conn(0x7f53c80c60f0 legacy=0x7f53c8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:12.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.752+0000 7f53cd69a640 1 -- 172.21.15.28:0/2748995641 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80c1a00 con 0x7f53c80c5260 2023-12-16T03:27:12.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.752+0000 7f53cce99640 1 --2- 172.21.15.28:0/2748995641 >> v2:172.21.15.134:3300/0 conn(0x7f53c80c5640 0x7f53c80c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:12.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.752+0000 7f53cd69a640 1 --2- 172.21.15.28:0/2748995641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53c80c5260 0x7f53c806d5b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53c80c1930 tx=0x7f53c401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81b79c8f7432beef server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:12.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.752+0000 7f53bffff640 1 -- 172.21.15.28:0/2748995641 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c40ab600 con 0x7f53c80c5260 2023-12-16T03:27:12.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.752+0000 7f53bffff640 1 -- 172.21.15.28:0/2748995641 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c40a7050 con 0x7f53c80c5260 2023-12-16T03:27:12.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.752+0000 7f53bffff640 1 -- 172.21.15.28:0/2748995641 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c40ab980 con 0x7f53c80c5260 2023-12-16T03:27:12.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 -- 172.21.15.28:0/2748995641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53c80c5260 msgr2=0x7f53c806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:12.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 --2- 172.21.15.28:0/2748995641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53c80c5260 0x7f53c806d5b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53c80c1930 tx=0x7f53c401c3c0 comp rx=0 tx=0).stop 2023-12-16T03:27:12.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 -- 172.21.15.28:0/2748995641 shutdown_connections 2023-12-16T03:27:12.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 --2- 172.21.15.28:0/2748995641 >> v2:172.21.15.134:3300/0 conn(0x7f53c80c5640 0x7f53c80c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:12.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 --2- 172.21.15.28:0/2748995641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53c80c5260 0x7f53c806d5b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:12.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 -- 172.21.15.28:0/2748995641 >> 172.21.15.28:0/2748995641 conn(0x7f53c806a5b0 msgr2=0x7f53c806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:12.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 -- 172.21.15.28:0/2748995641 shutdown_connections 2023-12-16T03:27:12.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 -- 172.21.15.28:0/2748995641 wait complete. 2023-12-16T03:27:12.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 Processor -- start 2023-12-16T03:27:12.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 -- start start 2023-12-16T03:27:12.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53c80c5260 0x7f53c814af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:12.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c80c5640 0x7f53c81ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:12.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53c80c60f0 0x7f53c80aa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:12.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c8145bc0 con 0x7f53c80c5640 2023-12-16T03:27:12.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c814a820 con 0x7f53c80c60f0 2023-12-16T03:27:12.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cf8fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c814ab00 con 0x7f53c80c5260 2023-12-16T03:27:12.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cce99640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c80c5640 0x7f53c81ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:12.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cce99640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c80c5640 0x7f53c81ed120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58648/0 (socket says 172.21.15.28:58648) 2023-12-16T03:27:12.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cce99640 1 -- 172.21.15.28:0/4264267554 learned_addr learned my addr 172.21.15.28:0/4264267554 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:12.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cd69a640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53c80c5260 0x7f53c814af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:12.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cde9b640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53c80c60f0 0x7f53c80aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:12.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cce99640 1 -- 172.21.15.28:0/4264267554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53c80c5260 msgr2=0x7f53c814af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:12.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cce99640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53c80c5260 0x7f53c814af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:12.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cce99640 1 -- 172.21.15.28:0/4264267554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53c80c60f0 msgr2=0x7f53c80aa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:12.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cce99640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53c80c60f0 0x7f53c80aa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:12.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.756+0000 7f53cce99640 1 -- 172.21.15.28:0/4264267554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b8009420 con 0x7f53c80c5640 2023-12-16T03:27:12.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.760+0000 7f53cce99640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c80c5640 0x7f53c81ed120 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f53b800e9b0 tx=0x7f53b800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:12.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.760+0000 7f53bdffb640 1 -- 172.21.15.28:0/4264267554 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b800c9a0 con 0x7f53c80c5640 2023-12-16T03:27:12.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.760+0000 7f53bdffb640 1 -- 172.21.15.28:0/4264267554 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b800cb00 con 0x7f53c80c5640 2023-12-16T03:27:12.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.760+0000 7f53cf8fe640 1 -- 172.21.15.28:0/4264267554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c4009420 con 0x7f53c80c5640 2023-12-16T03:27:12.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.760+0000 7f53bdffb640 1 -- 172.21.15.28:0/4264267554 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8013470 con 0x7f53c80c5640 2023-12-16T03:27:12.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.760+0000 7f53cf8fe640 1 -- 172.21.15.28:0/4264267554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c814a030 con 0x7f53c80c5640 2023-12-16T03:27:12.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.760+0000 7f53cf8fe640 1 -- 172.21.15.28:0/4264267554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c8068400 con 0x7f53c80c5640 2023-12-16T03:27:12.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.760+0000 7f53bdffb640 1 -- 172.21.15.28:0/4264267554 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f53b80135d0 con 0x7f53c80c5640 2023-12-16T03:27:12.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.760+0000 7f53bdffb640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53ac066470 0x7f53ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:12.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.760+0000 7f53bdffb640 1 -- 172.21.15.28:0/4264267554 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f53b80841d0 con 0x7f53c80c5640 2023-12-16T03:27:12.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.760+0000 7f53cd69a640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53ac066470 0x7f53ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:12.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.764+0000 7f53cd69a640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53ac066470 0x7f53ac068930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f53c40ad000 tx=0x7f53c40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:12.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.768+0000 7f53bdffb640 1 -- 172.21.15.28:0/4264267554 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f53b80515a0 con 0x7f53c80c5640 2023-12-16T03:27:12.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:12.924+0000 7f53cf8fe640 1 -- 172.21.15.28:0/4264267554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f53c806d390 con 0x7f53c80c5640 2023-12-16T03:27:13.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53bdffb640 1 -- 172.21.15.28:0/4264267554 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v52) v1 ==== 172+0+0 (secure 0 0 0) 0x7f53b8054bc0 con 0x7f53c80c5640 2023-12-16T03:27:13.569 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_data' created 2023-12-16T03:27:13.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 -- 172.21.15.28:0/4264267554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53ac066470 msgr2=0x7f53ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:13.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53ac066470 0x7f53ac068930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f53c40ad000 tx=0x7f53c40a6000 comp rx=0 tx=0).stop 2023-12-16T03:27:13.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 -- 172.21.15.28:0/4264267554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c80c5640 msgr2=0x7f53c81ed120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:13.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c80c5640 0x7f53c81ed120 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f53b800e9b0 tx=0x7f53b800ee70 comp rx=0 tx=0).stop 2023-12-16T03:27:13.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 -- 172.21.15.28:0/4264267554 shutdown_connections 2023-12-16T03:27:13.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53c80c60f0 0x7f53c80aa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:13.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f53ac066470 0x7f53ac068930 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:13.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f53c80c5640 0x7f53c81ed120 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:13.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 --2- 172.21.15.28:0/4264267554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53c80c5260 0x7f53c814af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:13.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 -- 172.21.15.28:0/4264267554 >> 172.21.15.28:0/4264267554 conn(0x7f53c806a5b0 msgr2=0x7f53c815cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:13.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 -- 172.21.15.28:0/4264267554 shutdown_connections 2023-12-16T03:27:13.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.568+0000 7f53cf8fe640 1 -- 172.21.15.28:0/4264267554 wait complete. 2023-12-16T03:27:13.614 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-16T03:27:13.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.756+0000 7f5592638640 1 Processor -- start 2023-12-16T03:27:13.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.756+0000 7f5592638640 1 -- start start 2023-12-16T03:27:13.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5592638640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f558c151cd0 0x7f558c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:13.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5592638640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f558c0c7c50 0x7f558c1544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:13.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5592638640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558c0c8160 con 0x7f558c0ca9a0 2023-12-16T03:27:13.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5592638640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558c157b40 con 0x7f558c0c7c50 2023-12-16T03:27:13.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5592638640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558c157e20 con 0x7f558c151cd0 2023-12-16T03:27:13.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5590e35640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f558c0c7c50 0x7f558c1544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:13.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5590e35640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f558c0c7c50 0x7f558c1544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58654/0 (socket says 172.21.15.28:58654) 2023-12-16T03:27:13.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5590e35640 1 -- 172.21.15.28:0/2885456570 learned_addr learned my addr 172.21.15.28:0/2885456570 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:13.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5591636640 1 --2- 172.21.15.28:0/2885456570 >> v2:172.21.15.134:3300/0 conn(0x7f558c151cd0 0x7f558c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:13.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5590e35640 1 -- 172.21.15.28:0/2885456570 >> v2:172.21.15.134:3300/0 conn(0x7f558c151cd0 msgr2=0x7f558c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:13.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5590e35640 1 --2- 172.21.15.28:0/2885456570 >> v2:172.21.15.134:3300/0 conn(0x7f558c151cd0 0x7f558c0ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:13.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5590e35640 1 -- 172.21.15.28:0/2885456570 >> v1:172.21.15.134:6789/0 conn(0x7f558c0ca9a0 legacy=0x7f558c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:13.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.760+0000 7f5590e35640 1 -- 172.21.15.28:0/2885456570 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c158100 con 0x7f558c0c7c50 2023-12-16T03:27:13.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5590e35640 1 --2- 172.21.15.28:0/2885456570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f558c0c7c50 0x7f558c1544d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f558c08b9c0 tx=0x7f557c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09a66420ef8176b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:13.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5583fff640 1 -- 172.21.15.28:0/2885456570 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c0aa650 con 0x7f558c0c7c50 2023-12-16T03:27:13.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5583fff640 1 -- 172.21.15.28:0/2885456570 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c0aa7b0 con 0x7f558c0c7c50 2023-12-16T03:27:13.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5583fff640 1 -- 172.21.15.28:0/2885456570 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c0aab40 con 0x7f558c0c7c50 2023-12-16T03:27:13.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5592638640 1 -- 172.21.15.28:0/2885456570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f558c0c7c50 msgr2=0x7f558c1544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:13.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5592638640 1 --2- 172.21.15.28:0/2885456570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f558c0c7c50 0x7f558c1544d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f558c08b9c0 tx=0x7f557c01c4d0 comp rx=0 tx=0).stop 2023-12-16T03:27:13.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5592638640 1 -- 172.21.15.28:0/2885456570 shutdown_connections 2023-12-16T03:27:13.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5592638640 1 --2- 172.21.15.28:0/2885456570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f558c0c7c50 0x7f558c1544d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:13.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5592638640 1 --2- 172.21.15.28:0/2885456570 >> v2:172.21.15.134:3300/0 conn(0x7f558c151cd0 0x7f558c0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:13.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5592638640 1 -- 172.21.15.28:0/2885456570 >> 172.21.15.28:0/2885456570 conn(0x7f558c0abee0 msgr2=0x7f558c0c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:13.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5592638640 1 -- 172.21.15.28:0/2885456570 shutdown_connections 2023-12-16T03:27:13.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5592638640 1 -- 172.21.15.28:0/2885456570 wait complete. 2023-12-16T03:27:13.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5592638640 1 Processor -- start 2023-12-16T03:27:13.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5592638640 1 -- start start 2023-12-16T03:27:13.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.764+0000 7f5592638640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f558c0c7c50 0x7f558c1ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:13.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5592638640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f558c0ca9a0 0x7f558c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:13.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5592638640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f558c151cd0 0x7f558c152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5592638640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c152670 con 0x7f558c151cd0 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5592638640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c0c31b0 con 0x7f558c0c7c50 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5592638640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558c1ede90 con 0x7f558c0ca9a0 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5591e37640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f558c151cd0 0x7f558c152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5591636640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f558c0c7c50 0x7f558c1ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5590e35640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f558c0ca9a0 0x7f558c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5591636640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f558c0c7c50 0x7f558c1ed950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:58418/0 (socket says 172.21.15.28:58418) 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5591e37640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f558c151cd0 0x7f558c152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58670/0 (socket says 172.21.15.28:58670) 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5591636640 1 -- 172.21.15.28:0/4124340307 learned_addr learned my addr 172.21.15.28:0/4124340307 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5591e37640 1 -- 172.21.15.28:0/4124340307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f558c0ca9a0 msgr2=0x7f558c1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5591e37640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f558c0ca9a0 0x7f558c1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5591e37640 1 -- 172.21.15.28:0/4124340307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f558c0c7c50 msgr2=0x7f558c1ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5591e37640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f558c0c7c50 0x7f558c1ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:13.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5591e37640 1 -- 172.21.15.28:0/4124340307 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0094d0 con 0x7f558c151cd0 2023-12-16T03:27:13.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5591e37640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f558c151cd0 0x7f558c152a90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f558400c700 tx=0x7f558400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:13.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5581ffb640 1 -- 172.21.15.28:0/4124340307 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584003b80 con 0x7f558c151cd0 2023-12-16T03:27:13.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5581ffb640 1 -- 172.21.15.28:0/4124340307 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5584003ce0 con 0x7f558c151cd0 2023-12-16T03:27:13.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5592638640 1 -- 172.21.15.28:0/4124340307 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558c152320 con 0x7f558c151cd0 2023-12-16T03:27:13.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5581ffb640 1 -- 172.21.15.28:0/4124340307 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558400aa30 con 0x7f558c151cd0 2023-12-16T03:27:13.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5592638640 1 -- 172.21.15.28:0/4124340307 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558c153c80 con 0x7f558c151cd0 2023-12-16T03:27:13.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5592638640 1 -- 172.21.15.28:0/4124340307 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558c0c6120 con 0x7f558c151cd0 2023-12-16T03:27:13.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.768+0000 7f5581ffb640 1 -- 172.21.15.28:0/4124340307 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f558400ab90 con 0x7f558c151cd0 2023-12-16T03:27:13.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.772+0000 7f5581ffb640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55700664a0 0x7f5570068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:13.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.772+0000 7f5581ffb640 1 -- 172.21.15.28:0/4124340307 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f5584084860 con 0x7f558c151cd0 2023-12-16T03:27:13.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.772+0000 7f5591636640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55700664a0 0x7f5570068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:13.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.772+0000 7f5591636640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55700664a0 0x7f5570068960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5588007a70 tx=0x7f5588008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:13.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.776+0000 7f5581ffb640 1 -- 172.21.15.28:0/4124340307 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5584051b10 con 0x7f558c151cd0 2023-12-16T03:27:13.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:13.964+0000 7f5592638640 1 -- 172.21.15.28:0/4124340307 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f558c1527b0 con 0x7f558c151cd0 2023-12-16T03:27:14.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.584+0000 7f5581ffb640 1 -- 172.21.15.28:0/4124340307 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v33) v1 ==== 177+0+0 (secure 0 0 0) 0x7f558c1527b0 con 0x7f558c151cd0 2023-12-16T03:27:14.589 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 10 and data pool 11 2023-12-16T03:27:14.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.588+0000 7f5592638640 1 -- 172.21.15.28:0/4124340307 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55700664a0 msgr2=0x7f5570068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.588+0000 7f5592638640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55700664a0 0x7f5570068960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5588007a70 tx=0x7f5588008040 comp rx=0 tx=0).stop 2023-12-16T03:27:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.588+0000 7f5592638640 1 -- 172.21.15.28:0/4124340307 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f558c151cd0 msgr2=0x7f558c152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.588+0000 7f5592638640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f558c151cd0 0x7f558c152a90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f558400c700 tx=0x7f558400cbc0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.588+0000 7f5592638640 1 -- 172.21.15.28:0/4124340307 shutdown_connections 2023-12-16T03:27:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.588+0000 7f5592638640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f55700664a0 0x7f5570068960 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.588+0000 7f5592638640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f558c151cd0 0x7f558c152a90 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.588+0000 7f5592638640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f558c0ca9a0 0x7f558c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.588+0000 7f5592638640 1 --2- 172.21.15.28:0/4124340307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f558c0c7c50 0x7f558c1ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.588+0000 7f5592638640 1 -- 172.21.15.28:0/4124340307 >> 172.21.15.28:0/4124340307 conn(0x7f558c0abee0 msgr2=0x7f558c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.588+0000 7f5592638640 1 -- 172.21.15.28:0/4124340307 shutdown_connections 2023-12-16T03:27:14.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.592+0000 7f5592638640 1 -- 172.21.15.28:0/4124340307 wait complete. 2023-12-16T03:27:14.643 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:14.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.784+0000 7f86f9380640 1 Processor -- start 2023-12-16T03:27:14.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.784+0000 7f86f9380640 1 -- start start 2023-12-16T03:27:14.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.784+0000 7f86f9380640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86f40c3ad0 0x7f86f40c0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.784+0000 7f86f9380640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86f40a84a0 0x7f86f4155b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86f9380640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f4072b20 con 0x7f86f4072740 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86f9380640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f40c11c0 con 0x7f86f40a84a0 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86f9380640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4156b40 con 0x7f86f40c3ad0 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86ebfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86f40c3ad0 0x7f86f40c0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86f37fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f86f40a84a0 0x7f86f4155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86f2ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f86f4072740 0x7f86f40c5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:48796/0 (socket says 172.21.15.28:48796) 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86f2ffd640 1 -- 172.21.15.28:0/2666528966 learned_addr learned my addr 172.21.15.28:0/2666528966 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86f37fe640 1 -- 172.21.15.28:0/2666528966 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86f40c3ad0 msgr2=0x7f86f40c0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86f37fe640 1 --2- 172.21.15.28:0/2666528966 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86f40c3ad0 0x7f86f40c0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86f37fe640 1 -- 172.21.15.28:0/2666528966 >> v1:172.21.15.134:6789/0 conn(0x7f86f4072740 legacy=0x7f86f40c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:14.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86f37fe640 1 -- 172.21.15.28:0/2666528966 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f40c5710 con 0x7f86f40a84a0 2023-12-16T03:27:14.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.788+0000 7f86f37fe640 1 --2- 172.21.15.28:0/2666528966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86f40a84a0 0x7f86f4155b70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009dc0 tx=0x7f86ec01c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef3ea25ab5330533 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:14.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f27fc640 1 -- 172.21.15.28:0/2666528966 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0a5740 con 0x7f86f40a84a0 2023-12-16T03:27:14.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f27fc640 1 -- 172.21.15.28:0/2666528966 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec0a58a0 con 0x7f86f40a84a0 2023-12-16T03:27:14.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f27fc640 1 -- 172.21.15.28:0/2666528966 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0a5c30 con 0x7f86f40a84a0 2023-12-16T03:27:14.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 -- 172.21.15.28:0/2666528966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86f40a84a0 msgr2=0x7f86f4155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:14.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 --2- 172.21.15.28:0/2666528966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86f40a84a0 0x7f86f4155b70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009dc0 tx=0x7f86ec01c8a0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 -- 172.21.15.28:0/2666528966 shutdown_connections 2023-12-16T03:27:14.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 --2- 172.21.15.28:0/2666528966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86f40a84a0 0x7f86f4155b70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 --2- 172.21.15.28:0/2666528966 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86f40c3ad0 0x7f86f40c0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 -- 172.21.15.28:0/2666528966 >> 172.21.15.28:0/2666528966 conn(0x7f86f40a7980 msgr2=0x7f86f40a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:14.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 -- 172.21.15.28:0/2666528966 shutdown_connections 2023-12-16T03:27:14.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 -- 172.21.15.28:0/2666528966 wait complete. 2023-12-16T03:27:14.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 Processor -- start 2023-12-16T03:27:14.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 -- start start 2023-12-16T03:27:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86f4072740 0x7f86f41494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f40a84a0 0x7f86f4154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86f40c3ad0 0x7f86f41ee9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4149a00 con 0x7f86f40a84a0 2023-12-16T03:27:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4143ff0 con 0x7f86f40c3ad0 2023-12-16T03:27:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f9380640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4144260 con 0x7f86f4072740 2023-12-16T03:27:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86ebfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f40a84a0 0x7f86f4154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86ebfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f40a84a0 0x7f86f4154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58674/0 (socket says 172.21.15.28:58674) 2023-12-16T03:27:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86ebfff640 1 -- 172.21.15.28:0/2068428052 learned_addr learned my addr 172.21.15.28:0/2068428052 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.792+0000 7f86f2ffd640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86f4072740 0x7f86f41494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86f37fe640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86f40c3ad0 0x7f86f41ee9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86ebfff640 1 -- 172.21.15.28:0/2068428052 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86f4072740 msgr2=0x7f86f41494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86ebfff640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86f4072740 0x7f86f41494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86ebfff640 1 -- 172.21.15.28:0/2068428052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86f40c3ad0 msgr2=0x7f86f41ee9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86ebfff640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86f40c3ad0 0x7f86f41ee9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86ebfff640 1 -- 172.21.15.28:0/2068428052 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec009a70 con 0x7f86f40a84a0 2023-12-16T03:27:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86ebfff640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f40a84a0 0x7f86f4154f20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00e930 tx=0x7f86dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:14.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86eb7fe640 1 -- 172.21.15.28:0/2068428052 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc009690 con 0x7f86f40a84a0 2023-12-16T03:27:14.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86eb7fe640 1 -- 172.21.15.28:0/2068428052 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc00ca00 con 0x7f86f40a84a0 2023-12-16T03:27:14.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86eb7fe640 1 -- 172.21.15.28:0/2068428052 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00cd90 con 0x7f86f40a84a0 2023-12-16T03:27:14.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86f9380640 1 -- 172.21.15.28:0/2068428052 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f4149d80 con 0x7f86f40a84a0 2023-12-16T03:27:14.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86f9380640 1 -- 172.21.15.28:0/2068428052 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f41ef370 con 0x7f86f40a84a0 2023-12-16T03:27:14.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86f9380640 1 -- 172.21.15.28:0/2068428052 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f41ef530 con 0x7f86f40a84a0 2023-12-16T03:27:14.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.796+0000 7f86eb7fe640 1 -- 172.21.15.28:0/2068428052 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f86dc013470 con 0x7f86f40a84a0 2023-12-16T03:27:14.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.800+0000 7f86eb7fe640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f86d4066470 0x7f86d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:14.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.800+0000 7f86eb7fe640 1 -- 172.21.15.28:0/2068428052 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f86dc0843c0 con 0x7f86f40a84a0 2023-12-16T03:27:14.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.800+0000 7f86f2ffd640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f86d4066470 0x7f86d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:14.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.800+0000 7f86f2ffd640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f86d4066470 0x7f86d4068930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f86e4005890 tx=0x7f86e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:14.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.804+0000 7f86eb7fe640 1 -- 172.21.15.28:0/2068428052 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f86dc051590 con 0x7f86f40a84a0 2023-12-16T03:27:14.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.960+0000 7f86f9380640 1 -- 172.21.15.28:0/2068428052 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86f4067f00 con 0x7f86f40a84a0 2023-12-16T03:27:14.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86eb7fe640 1 -- 172.21.15.28:0/2068428052 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20293 (secure 0 0 0) 0x7f86dc054bb0 con 0x7f86f40a84a0 2023-12-16T03:27:14.967 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:14.967 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":53,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:13.968547+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:14.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 -- 172.21.15.28:0/2068428052 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f86d4066470 msgr2=0x7f86d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:14.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f86d4066470 0x7f86d4068930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f86e4005890 tx=0x7f86e4009040 comp rx=0 tx=0).stop 2023-12-16T03:27:14.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 -- 172.21.15.28:0/2068428052 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f40a84a0 msgr2=0x7f86f4154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:14.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f40a84a0 0x7f86f4154f20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00e930 tx=0x7f86dc00edf0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 -- 172.21.15.28:0/2068428052 shutdown_connections 2023-12-16T03:27:14.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86f40c3ad0 0x7f86f41ee9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f86d4066470 0x7f86d4068930 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f40a84a0 0x7f86f4154f20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 --2- 172.21.15.28:0/2068428052 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f86f4072740 0x7f86f41494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:14.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 -- 172.21.15.28:0/2068428052 >> 172.21.15.28:0/2068428052 conn(0x7f86f40a7980 msgr2=0x7f86f415c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:14.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 -- 172.21.15.28:0/2068428052 shutdown_connections 2023-12-16T03:27:14.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:14.964+0000 7f86f9380640 1 -- 172.21.15.28:0/2068428052 wait complete. 2023-12-16T03:27:14.989 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:15.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f2327e32640 1 Processor -- start 2023-12-16T03:27:15.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f2327e32640 1 -- start start 2023-12-16T03:27:15.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f2327e32640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2320073a70 0x7f23200bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f2327e32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2320157c20 0x7f23201580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f2327e32640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232006a5b0 con 0x7f232014b010 2023-12-16T03:27:15.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f2327e32640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232006b710 con 0x7f2320073a70 2023-12-16T03:27:15.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f2327e32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200c1d60 con 0x7f2320157c20 2023-12-16T03:27:15.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f23253cd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2320073a70 0x7f23200bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:15.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f2325bce640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f232014b010 0x7f232006b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40984/0 (socket says 172.21.15.28:40984) 2023-12-16T03:27:15.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f2325bce640 1 -- 172.21.15.28:0/2014009517 learned_addr learned my addr 172.21.15.28:0/2014009517 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:15.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f23263cf640 1 --2- 172.21.15.28:0/2014009517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2320157c20 0x7f23201580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:15.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f23253cd640 1 -- 172.21.15.28:0/2014009517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2320157c20 msgr2=0x7f23201580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:15.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f23253cd640 1 --2- 172.21.15.28:0/2014009517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2320157c20 0x7f23201580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f23253cd640 1 -- 172.21.15.28:0/2014009517 >> v1:172.21.15.28:6789/0 conn(0x7f232014b010 legacy=0x7f232006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:15.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f23253cd640 1 -- 172.21.15.28:0/2014009517 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200c2040 con 0x7f2320073a70 2023-12-16T03:27:15.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.128+0000 7f2324bcc640 1 -- 172.21.15.28:0/2014009517 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887138403 0 0) 0x7f232006a5b0 con 0x7f232014b010 2023-12-16T03:27:15.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f23253cd640 1 --2- 172.21.15.28:0/2014009517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2320073a70 0x7f23200bf9f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f23100097c0 tx=0x7f231001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942cab7e30adb19a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:15.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f2324bcc640 1 -- 172.21.15.28:0/2014009517 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100a8970 con 0x7f2320073a70 2023-12-16T03:27:15.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f2324bcc640 1 -- 172.21.15.28:0/2014009517 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23100a8ad0 con 0x7f2320073a70 2023-12-16T03:27:15.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f2324bcc640 1 -- 172.21.15.28:0/2014009517 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100a8e60 con 0x7f2320073a70 2023-12-16T03:27:15.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f2327e32640 1 -- 172.21.15.28:0/2014009517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2320073a70 msgr2=0x7f23200bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:15.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f2327e32640 1 --2- 172.21.15.28:0/2014009517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2320073a70 0x7f23200bf9f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f23100097c0 tx=0x7f231001ec70 comp rx=0 tx=0).stop 2023-12-16T03:27:15.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f2327e32640 1 -- 172.21.15.28:0/2014009517 shutdown_connections 2023-12-16T03:27:15.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f2327e32640 1 --2- 172.21.15.28:0/2014009517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2320157c20 0x7f23201580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f2327e32640 1 --2- 172.21.15.28:0/2014009517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2320073a70 0x7f23200bf9f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f2327e32640 1 -- 172.21.15.28:0/2014009517 >> 172.21.15.28:0/2014009517 conn(0x7f23200c30c0 msgr2=0x7f23200c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:15.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f2327e32640 1 -- 172.21.15.28:0/2014009517 shutdown_connections 2023-12-16T03:27:15.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.132+0000 7f2327e32640 1 -- 172.21.15.28:0/2014009517 wait complete. 2023-12-16T03:27:15.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2327e32640 1 Processor -- start 2023-12-16T03:27:15.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2327e32640 1 -- start start 2023-12-16T03:27:15.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2327e32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2320073a70 0x7f23201451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2327e32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f232014b010 0x7f23201524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2327e32640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2320157c20 0x7f2320143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2327e32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320070d90 con 0x7f232014b010 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2327e32640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320071070 con 0x7f2320157c20 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2327e32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2320071350 con 0x7f2320073a70 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23253cd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f232014b010 0x7f23201524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23253cd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f232014b010 0x7f23201524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58682/0 (socket says 172.21.15.28:58682) 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23253cd640 1 -- 172.21.15.28:0/3570338503 learned_addr learned my addr 172.21.15.28:0/3570338503 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2325bce640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2320073a70 0x7f23201451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23253cd640 1 -- 172.21.15.28:0/3570338503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2320073a70 msgr2=0x7f23201451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23253cd640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2320073a70 0x7f23201451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23263cf640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2320157c20 0x7f2320143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23253cd640 1 -- 172.21.15.28:0/3570338503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2320157c20 msgr2=0x7f2320143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23253cd640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2320157c20 0x7f2320143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23253cd640 1 -- 172.21.15.28:0/3570338503 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310009420 con 0x7f232014b010 2023-12-16T03:27:15.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2325bce640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2320073a70 0x7f23201451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:15.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23253cd640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f232014b010 0x7f23201524d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f23100b3040 tx=0x7f231001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:15.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23167fc640 1 -- 172.21.15.28:0/3570338503 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100b9630 con 0x7f232014b010 2023-12-16T03:27:15.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23167fc640 1 -- 172.21.15.28:0/3570338503 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23100b97b0 con 0x7f232014b010 2023-12-16T03:27:15.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f23167fc640 1 -- 172.21.15.28:0/3570338503 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100b9b60 con 0x7f232014b010 2023-12-16T03:27:15.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2327e32640 1 -- 172.21.15.28:0/3570338503 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2320071630 con 0x7f232014b010 2023-12-16T03:27:15.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.136+0000 7f2327e32640 1 -- 172.21.15.28:0/3570338503 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320145730 con 0x7f232014b010 2023-12-16T03:27:15.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.140+0000 7f2327e32640 1 -- 172.21.15.28:0/3570338503 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23200735d0 con 0x7f232014b010 2023-12-16T03:27:15.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.140+0000 7f23167fc640 1 -- 172.21.15.28:0/3570338503 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f23100b7040 con 0x7f232014b010 2023-12-16T03:27:15.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.140+0000 7f23167fc640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2304066470 0x7f2304068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.140+0000 7f23167fc640 1 -- 172.21.15.28:0/3570338503 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2310122220 con 0x7f232014b010 2023-12-16T03:27:15.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.140+0000 7f2325bce640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2304066470 0x7f2304068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:15.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.140+0000 7f2325bce640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2304066470 0x7f2304068930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f231c000f70 tx=0x7f231c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.144+0000 7f23167fc640 1 -- 172.21.15.28:0/3570338503 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f23200735d0 con 0x7f232014b010 2023-12-16T03:27:15.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.304+0000 7f2327e32640 1 -- 172.21.15.28:0/3570338503 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2320071b50 con 0x7f232014b010 2023-12-16T03:27:15.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.304+0000 7f23167fc640 1 -- 172.21.15.28:0/3570338503 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20293 (secure 0 0 0) 0x7f2320071b50 con 0x7f232014b010 2023-12-16T03:27:15.307 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:15.307 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":53,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:13.968547+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:15.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.304+0000 7f2327e32640 1 -- 172.21.15.28:0/3570338503 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2304066470 msgr2=0x7f2304068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:15.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.304+0000 7f2327e32640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2304066470 0x7f2304068930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f231c000f70 tx=0x7f231c009040 comp rx=0 tx=0).stop 2023-12-16T03:27:15.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.304+0000 7f2327e32640 1 -- 172.21.15.28:0/3570338503 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f232014b010 msgr2=0x7f23201524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:15.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.304+0000 7f2327e32640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f232014b010 0x7f23201524d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f23100b3040 tx=0x7f231001ba10 comp rx=0 tx=0).stop 2023-12-16T03:27:15.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.308+0000 7f2327e32640 1 -- 172.21.15.28:0/3570338503 shutdown_connections 2023-12-16T03:27:15.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.308+0000 7f2327e32640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2320157c20 0x7f2320143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.308+0000 7f2327e32640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2304066470 0x7f2304068930 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.308+0000 7f2327e32640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f232014b010 0x7f23201524d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.308+0000 7f2327e32640 1 --2- 172.21.15.28:0/3570338503 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2320073a70 0x7f23201451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.308+0000 7f2327e32640 1 -- 172.21.15.28:0/3570338503 >> 172.21.15.28:0/3570338503 conn(0x7f23200c30c0 msgr2=0x7f23200c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:15.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.308+0000 7f2327e32640 1 -- 172.21.15.28:0/3570338503 shutdown_connections 2023-12-16T03:27:15.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.308+0000 7f2327e32640 1 -- 172.21.15.28:0/3570338503 wait complete. 2023-12-16T03:27:15.329 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-16T03:27:15.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0195279640 1 Processor -- start 2023-12-16T03:27:15.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0195279640 1 -- start start 2023-12-16T03:27:15.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0195279640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f01900c7ed0 0x7f0190154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0195279640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01900bd660 0x7f0190154b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0195279640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01900ac4f0 con 0x7f0190151dc0 2023-12-16T03:27:15.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0195279640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0190158780 con 0x7f01900c7ed0 2023-12-16T03:27:15.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0195279640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0190158a60 con 0x7f01900bd660 2023-12-16T03:27:15.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0187fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f01900c7ed0 0x7f0190154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:15.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f018effd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0190151dc0 0x7f01900c4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40996/0 (socket says 172.21.15.28:40996) 2023-12-16T03:27:15.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0187fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f01900c7ed0 0x7f0190154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58686/0 (socket says 172.21.15.28:58686) 2023-12-16T03:27:15.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f018effd640 1 -- 172.21.15.28:0/298360048 learned_addr learned my addr 172.21.15.28:0/298360048 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:15.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0187fff640 1 -- 172.21.15.28:0/298360048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01900bd660 msgr2=0x7f0190154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:15.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0187fff640 1 --2- 172.21.15.28:0/298360048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01900bd660 0x7f0190154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0187fff640 1 -- 172.21.15.28:0/298360048 >> v1:172.21.15.28:6789/0 conn(0x7f0190151dc0 legacy=0x7f01900c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:15.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f0187fff640 1 -- 172.21.15.28:0/298360048 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900ac180 con 0x7f01900c7ed0 2023-12-16T03:27:15.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.476+0000 7f018e7fc640 1 -- 172.21.15.28:0/298360048 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383763038 0 0) 0x7f01900ac4f0 con 0x7f0190151dc0 2023-12-16T03:27:15.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f0187fff640 1 --2- 172.21.15.28:0/298360048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01900c7ed0 0x7f0190154650 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f01780097f0 tx=0x7f017801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3049e66c4646d5b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:15.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f018e7fc640 1 -- 172.21.15.28:0/298360048 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780ab600 con 0x7f01900c7ed0 2023-12-16T03:27:15.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f018e7fc640 1 -- 172.21.15.28:0/298360048 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01780a7050 con 0x7f01900c7ed0 2023-12-16T03:27:15.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f018e7fc640 1 -- 172.21.15.28:0/298360048 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780ab980 con 0x7f01900c7ed0 2023-12-16T03:27:15.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f0195279640 1 -- 172.21.15.28:0/298360048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01900c7ed0 msgr2=0x7f0190154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:15.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f0195279640 1 --2- 172.21.15.28:0/298360048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01900c7ed0 0x7f0190154650 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f01780097f0 tx=0x7f017801c360 comp rx=0 tx=0).stop 2023-12-16T03:27:15.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f0195279640 1 -- 172.21.15.28:0/298360048 shutdown_connections 2023-12-16T03:27:15.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f0195279640 1 --2- 172.21.15.28:0/298360048 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01900bd660 0x7f0190154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f0195279640 1 --2- 172.21.15.28:0/298360048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01900c7ed0 0x7f0190154650 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f0195279640 1 -- 172.21.15.28:0/298360048 >> 172.21.15.28:0/298360048 conn(0x7f0190071eb0 msgr2=0x7f01900722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:15.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f0195279640 1 -- 172.21.15.28:0/298360048 shutdown_connections 2023-12-16T03:27:15.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f0195279640 1 -- 172.21.15.28:0/298360048 wait complete. 2023-12-16T03:27:15.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f0195279640 1 Processor -- start 2023-12-16T03:27:15.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.480+0000 7f0195279640 1 -- start start 2023-12-16T03:27:15.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f0195279640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01900bd660 0x7f01900c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f0195279640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01900c7ed0 0x7f01900bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f0195279640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0190151dc0 0x7f01900c0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f0195279640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900bf830 con 0x7f01900bd660 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f0195279640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900be800 con 0x7f0190151dc0 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f0195279640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0190155ba0 con 0x7f01900c7ed0 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f018effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01900bd660 0x7f01900c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f018effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01900bd660 0x7f01900c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58696/0 (socket says 172.21.15.28:58696) 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f018effd640 1 -- 172.21.15.28:0/952538408 learned_addr learned my addr 172.21.15.28:0/952538408 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f018effd640 1 -- 172.21.15.28:0/952538408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01900c7ed0 msgr2=0x7f01900bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f018effd640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01900c7ed0 0x7f01900bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f018effd640 1 -- 172.21.15.28:0/952538408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0190151dc0 msgr2=0x7f01900c0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f018effd640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0190151dc0 0x7f01900c0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f018effd640 1 -- 172.21.15.28:0/952538408 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178009420 con 0x7f01900bd660 2023-12-16T03:27:15.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f018effd640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01900bd660 0x7f01900c3cd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f018000c4b0 tx=0x7f018000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:15.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f01877fe640 1 -- 172.21.15.28:0/952538408 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800074e0 con 0x7f01900bd660 2023-12-16T03:27:15.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f01877fe640 1 -- 172.21.15.28:0/952538408 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180007660 con 0x7f01900bd660 2023-12-16T03:27:15.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f0195279640 1 -- 172.21.15.28:0/952538408 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0190156ca0 con 0x7f01900bd660 2023-12-16T03:27:15.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f01877fe640 1 -- 172.21.15.28:0/952538408 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180004a30 con 0x7f01900bd660 2023-12-16T03:27:15.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f0195279640 1 -- 172.21.15.28:0/952538408 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01901569c0 con 0x7f01900bd660 2023-12-16T03:27:15.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f0195279640 1 -- 172.21.15.28:0/952538408 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0190068400 con 0x7f01900bd660 2023-12-16T03:27:15.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.484+0000 7f01877fe640 1 -- 172.21.15.28:0/952538408 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0180004b90 con 0x7f01900bd660 2023-12-16T03:27:15.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.488+0000 7f01877fe640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01700664a0 0x7f0170068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:15.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.488+0000 7f01877fe640 1 -- 172.21.15.28:0/952538408 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0180083610 con 0x7f01900bd660 2023-12-16T03:27:15.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.488+0000 7f0187fff640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01700664a0 0x7f0170068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:15.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.488+0000 7f0187fff640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01700664a0 0x7f0170068960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f01780ad000 tx=0x7f0178008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:15.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.492+0000 7f01877fe640 1 -- 172.21.15.28:0/952538408 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0180050720 con 0x7f01900bd660 2023-12-16T03:27:15.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:15.684+0000 7f0195279640 1 -- 172.21.15.28:0/952538408 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f019006c9a0 con 0x7f01900bd660 2023-12-16T03:27:16.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.616+0000 7f01877fe640 1 -- 172.21.15.28:0/952538408 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 119+0+0 (secure 0 0 0) 0x7f0180053d40 con 0x7f01900bd660 2023-12-16T03:27:16.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 -- 172.21.15.28:0/952538408 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01700664a0 msgr2=0x7f0170068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:16.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01700664a0 0x7f0170068960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f01780ad000 tx=0x7f0178008040 comp rx=0 tx=0).stop 2023-12-16T03:27:16.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 -- 172.21.15.28:0/952538408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01900bd660 msgr2=0x7f01900c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:16.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01900bd660 0x7f01900c3cd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f018000c4b0 tx=0x7f018000c970 comp rx=0 tx=0).stop 2023-12-16T03:27:16.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 -- 172.21.15.28:0/952538408 shutdown_connections 2023-12-16T03:27:16.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0190151dc0 0x7f01900c0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:16.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01900c7ed0 0x7f01900bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:16.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01700664a0 0x7f0170068960 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:16.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 --2- 172.21.15.28:0/952538408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01900bd660 0x7f01900c3cd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:16.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 -- 172.21.15.28:0/952538408 >> 172.21.15.28:0/952538408 conn(0x7f0190071eb0 msgr2=0x7f0190150390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:16.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 -- 172.21.15.28:0/952538408 shutdown_connections 2023-12-16T03:27:16.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.620+0000 7f0195279640 1 -- 172.21.15.28:0/952538408 wait complete. 2023-12-16T03:27:16.646 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-16T03:27:16.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-16T03:27:16.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.792+0000 7f7c7e0c8640 1 Processor -- start 2023-12-16T03:27:16.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.792+0000 7f7c7e0c8640 1 -- start start 2023-12-16T03:27:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7e0c8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7c780c7ed0 0x7f7c780c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7e0c8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c780c4bb0 0x7f7c7806c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7e0c8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c78151ff0 con 0x7f7c780c4730 2023-12-16T03:27:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7e0c8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7806c600 con 0x7f7c780c7ed0 2023-12-16T03:27:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7e0c8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78155160 con 0x7f7c780c4bb0 2023-12-16T03:27:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7c8c5640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7c780c4730 0x7f7c7806b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40998/0 (socket says 172.21.15.28:40998) 2023-12-16T03:27:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7c8c5640 1 -- 172.21.15.28:0/2986378322 learned_addr learned my addr 172.21.15.28:0/2986378322 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7d0c6640 1 --2- 172.21.15.28:0/2986378322 >> v2:172.21.15.134:3300/0 conn(0x7f7c780c7ed0 0x7f7c780c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7d8c7640 1 --2- 172.21.15.28:0/2986378322 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c780c4bb0 0x7f7c7806c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c6ffff640 1 -- 172.21.15.28:0/2986378322 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499074667 0 0) 0x7f7c68001120 con 0x7f7c780c4730 2023-12-16T03:27:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c6ffff640 1 -- 172.21.15.28:0/2986378322 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c64003530 con 0x7f7c780c4730 2023-12-16T03:27:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7d0c6640 1 -- 172.21.15.28:0/2986378322 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c780c4bb0 msgr2=0x7f7c7806c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7d0c6640 1 --2- 172.21.15.28:0/2986378322 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c780c4bb0 0x7f7c7806c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7d0c6640 1 -- 172.21.15.28:0/2986378322 >> v1:172.21.15.28:6789/0 conn(0x7f7c780c4730 legacy=0x7f7c7806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.796+0000 7f7c7d0c6640 1 -- 172.21.15.28:0/2986378322 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c780c5040 con 0x7f7c780c7ed0 2023-12-16T03:27:16.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c7d0c6640 1 --2- 172.21.15.28:0/2986378322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c780c7ed0 0x7f7c780c82b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7c740097c0 tx=0x7f7c7401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb983d660170b548 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c6ffff640 1 -- 172.21.15.28:0/2986378322 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c740ab610 con 0x7f7c780c7ed0 2023-12-16T03:27:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c6ffff640 1 -- 172.21.15.28:0/2986378322 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c740ab770 con 0x7f7c780c7ed0 2023-12-16T03:27:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c6ffff640 1 -- 172.21.15.28:0/2986378322 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c740abb00 con 0x7f7c780c7ed0 2023-12-16T03:27:16.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2986378322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c780c7ed0 msgr2=0x7f7c780c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c7e0c8640 1 --2- 172.21.15.28:0/2986378322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c780c7ed0 0x7f7c780c82b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7c740097c0 tx=0x7f7c7401c3f0 comp rx=0 tx=0).stop 2023-12-16T03:27:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2986378322 shutdown_connections 2023-12-16T03:27:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c7e0c8640 1 --2- 172.21.15.28:0/2986378322 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c780c4bb0 0x7f7c7806c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c7e0c8640 1 --2- 172.21.15.28:0/2986378322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c780c7ed0 0x7f7c780c82b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2986378322 >> 172.21.15.28:0/2986378322 conn(0x7f7c780ab940 msgr2=0x7f7c780abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2986378322 shutdown_connections 2023-12-16T03:27:16.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2986378322 wait complete. 2023-12-16T03:27:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c7e0c8640 1 Processor -- start 2023-12-16T03:27:16.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.800+0000 7f7c7e0c8640 1 -- start start 2023-12-16T03:27:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7e0c8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c780c4730 0x7f7c780c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7e0c8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c780c4bb0 0x7f7c780bdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7e0c8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c780c7ed0 0x7f7c78149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7e0c8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78157fd0 con 0x7f7c780c7ed0 2023-12-16T03:27:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7e0c8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78157cf0 con 0x7f7c780c4bb0 2023-12-16T03:27:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7e0c8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c781f0500 con 0x7f7c780c4730 2023-12-16T03:27:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7d8c7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c780c7ed0 0x7f7c78149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7d8c7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c780c7ed0 0x7f7c78149090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58704/0 (socket says 172.21.15.28:58704) 2023-12-16T03:27:16.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7d8c7640 1 -- 172.21.15.28:0/2461510419 learned_addr learned my addr 172.21.15.28:0/2461510419 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7d0c6640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c780c4730 0x7f7c780c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7c8c5640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c780c4bb0 0x7f7c780bdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7d8c7640 1 -- 172.21.15.28:0/2461510419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c780c4730 msgr2=0x7f7c780c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7d8c7640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c780c4730 0x7f7c780c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7d8c7640 1 -- 172.21.15.28:0/2461510419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c780c4bb0 msgr2=0x7f7c780bdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7d8c7640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c780c4bb0 0x7f7c780bdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7d8c7640 1 -- 172.21.15.28:0/2461510419 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74009420 con 0x7f7c780c7ed0 2023-12-16T03:27:16.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7d8c7640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c780c7ed0 0x7f7c78149090 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000efc0 tx=0x7f7c7000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:16.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c6dffb640 1 -- 172.21.15.28:0/2461510419 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70014480 con 0x7f7c780c7ed0 2023-12-16T03:27:16.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c6dffb640 1 -- 172.21.15.28:0/2461510419 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7000f040 con 0x7f7c780c7ed0 2023-12-16T03:27:16.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c6dffb640 1 -- 172.21.15.28:0/2461510419 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70014820 con 0x7f7c780c7ed0 2023-12-16T03:27:16.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2461510419 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c781f07e0 con 0x7f7c780c7ed0 2023-12-16T03:27:16.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2461510419 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c780ca4e0 con 0x7f7c780c7ed0 2023-12-16T03:27:16.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2461510419 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7804e850 con 0x7f7c780c7ed0 2023-12-16T03:27:16.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.804+0000 7f7c6dffb640 1 -- 172.21.15.28:0/2461510419 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7c70014980 con 0x7f7c780c7ed0 2023-12-16T03:27:16.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.808+0000 7f7c6dffb640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c5c066470 0x7f7c5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.808+0000 7f7c6dffb640 1 -- 172.21.15.28:0/2461510419 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7c70084fe0 con 0x7f7c780c7ed0 2023-12-16T03:27:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.808+0000 7f7c7d0c6640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c5c066470 0x7f7c5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:16.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.808+0000 7f7c7d0c6640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c5c066470 0x7f7c5c068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7c740af000 tx=0x7f7c740a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:16.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:16.812+0000 7f7c6dffb640 1 -- 172.21.15.28:0/2461510419 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7c70052170 con 0x7f7c780c7ed0 2023-12-16T03:27:17.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.000+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2461510419 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7c780bd330 con 0x7f7c780c7ed0 2023-12-16T03:27:17.479 INFO:tasks.ceph.mds.b.smithi134.stderr:2023-12-16T03:27:17.476+0000 7f137d005640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:27:17.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c6dffb640 1 -- 172.21.15.28:0/2461510419 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 123+0+0 (secure 0 0 0) 0x7f7c70055790 con 0x7f7c780c7ed0 2023-12-16T03:27:17.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2461510419 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c5c066470 msgr2=0x7f7c5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c5c066470 0x7f7c5c068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7c740af000 tx=0x7f7c740a7000 comp rx=0 tx=0).stop 2023-12-16T03:27:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2461510419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c780c7ed0 msgr2=0x7f7c78149090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c780c7ed0 0x7f7c78149090 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000efc0 tx=0x7f7c7000c490 comp rx=0 tx=0).stop 2023-12-16T03:27:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2461510419 shutdown_connections 2023-12-16T03:27:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c5c066470 0x7f7c5c068930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7c780c7ed0 0x7f7c78149090 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c780c4bb0 0x7f7c780bdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 --2- 172.21.15.28:0/2461510419 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c780c4730 0x7f7c780c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2461510419 >> 172.21.15.28:0/2461510419 conn(0x7f7c780ab940 msgr2=0x7f7c7814fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2461510419 shutdown_connections 2023-12-16T03:27:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.628+0000 7f7c7e0c8640 1 -- 172.21.15.28:0/2461510419 wait complete. 2023-12-16T03:27:17.655 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-16T03:27:17.655 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:27:17.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb23da09640 1 Processor -- start 2023-12-16T03:27:17.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb23da09640 1 -- start start 2023-12-16T03:27:17.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb23da09640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb238151dc0 0x7fb2380c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:17.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb23da09640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2380c7ed0 0x7fb238154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:17.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb23da09640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2380ac4f0 con 0x7fb2380bd660 2023-12-16T03:27:17.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb23da09640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb238158780 con 0x7fb238151dc0 2023-12-16T03:27:17.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb23da09640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb238158a60 con 0x7fb2380c7ed0 2023-12-16T03:27:17.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb236ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb238151dc0 0x7fb2380c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:17.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb236ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb238151dc0 0x7fb2380c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58712/0 (socket says 172.21.15.28:58712) 2023-12-16T03:27:17.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb236ffd640 1 -- 172.21.15.28:0/1406244900 learned_addr learned my addr 172.21.15.28:0/1406244900 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:17.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb22ffff640 1 --2- 172.21.15.28:0/1406244900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2380c7ed0 0x7fb238154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:17.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb236ffd640 1 -- 172.21.15.28:0/1406244900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2380c7ed0 msgr2=0x7fb238154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:17.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb236ffd640 1 --2- 172.21.15.28:0/1406244900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2380c7ed0 0x7fb238154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:17.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb236ffd640 1 -- 172.21.15.28:0/1406244900 >> v1:172.21.15.134:6789/0 conn(0x7fb2380bd660 legacy=0x7fb238154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:17.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.800+0000 7fb236ffd640 1 -- 172.21.15.28:0/1406244900 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2380ac180 con 0x7fb238151dc0 2023-12-16T03:27:17.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb236ffd640 1 --2- 172.21.15.28:0/1406244900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb238151dc0 0x7fb2380c4950 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb228009870 tx=0x7fb22801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e36a24bd116d14 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:17.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb2367fc640 1 -- 172.21.15.28:0/1406244900 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2280ab600 con 0x7fb238151dc0 2023-12-16T03:27:17.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb2367fc640 1 -- 172.21.15.28:0/1406244900 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2280a7050 con 0x7fb238151dc0 2023-12-16T03:27:17.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb2367fc640 1 -- 172.21.15.28:0/1406244900 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2280ab980 con 0x7fb238151dc0 2023-12-16T03:27:17.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb23da09640 1 -- 172.21.15.28:0/1406244900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb238151dc0 msgr2=0x7fb2380c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:17.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb23da09640 1 --2- 172.21.15.28:0/1406244900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb238151dc0 0x7fb2380c4950 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb228009870 tx=0x7fb22801c420 comp rx=0 tx=0).stop 2023-12-16T03:27:17.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb23da09640 1 -- 172.21.15.28:0/1406244900 shutdown_connections 2023-12-16T03:27:17.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb23da09640 1 --2- 172.21.15.28:0/1406244900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2380c7ed0 0x7fb238154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:17.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb23da09640 1 --2- 172.21.15.28:0/1406244900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb238151dc0 0x7fb2380c4950 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:17.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb23da09640 1 -- 172.21.15.28:0/1406244900 >> 172.21.15.28:0/1406244900 conn(0x7fb238071eb0 msgr2=0x7fb2380722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:17.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb23da09640 1 -- 172.21.15.28:0/1406244900 shutdown_connections 2023-12-16T03:27:17.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.804+0000 7fb23da09640 1 -- 172.21.15.28:0/1406244900 wait complete. 2023-12-16T03:27:17.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb23da09640 1 Processor -- start 2023-12-16T03:27:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb23da09640 1 -- start start 2023-12-16T03:27:17.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb23da09640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2380bd660 0x7fb2380aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:17.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb23da09640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2380c7ed0 0x7fb2381f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:17.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb23da09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb238151dc0 0x7fb2381ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb23da09640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380c09e0 con 0x7fb238151dc0 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb23da09640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380c3b80 con 0x7fb2380c7ed0 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb23da09640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380c04d0 con 0x7fb2380bd660 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb238151dc0 0x7fb2381ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb22ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2380c7ed0 0x7fb2381f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb238151dc0 0x7fb2381ed7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58728/0 (socket says 172.21.15.28:58728) 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb236ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2380bd660 0x7fb2380aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb2377fe640 1 -- 172.21.15.28:0/367537044 learned_addr learned my addr 172.21.15.28:0/367537044 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb2377fe640 1 -- 172.21.15.28:0/367537044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2380bd660 msgr2=0x7fb2380aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb2377fe640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2380bd660 0x7fb2380aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb2377fe640 1 -- 172.21.15.28:0/367537044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2380c7ed0 msgr2=0x7fb2381f0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:17.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb2377fe640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2380c7ed0 0x7fb2381f0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:17.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb2377fe640 1 -- 172.21.15.28:0/367537044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280094d0 con 0x7fb238151dc0 2023-12-16T03:27:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb2377fe640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb238151dc0 0x7fb2381ed7b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c730 tx=0x7fb23000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb234ff9640 1 -- 172.21.15.28:0/367537044 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230003b80 con 0x7fb238151dc0 2023-12-16T03:27:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb234ff9640 1 -- 172.21.15.28:0/367537044 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb230003ce0 con 0x7fb238151dc0 2023-12-16T03:27:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb234ff9640 1 -- 172.21.15.28:0/367537044 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230005310 con 0x7fb238151dc0 2023-12-16T03:27:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb23da09640 1 -- 172.21.15.28:0/367537044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2380bd490 con 0x7fb238151dc0 2023-12-16T03:27:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.808+0000 7fb23da09640 1 -- 172.21.15.28:0/367537044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2380bd1b0 con 0x7fb238151dc0 2023-12-16T03:27:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.812+0000 7fb23da09640 1 -- 172.21.15.28:0/367537044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2380bd010 con 0x7fb238151dc0 2023-12-16T03:27:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.812+0000 7fb234ff9640 1 -- 172.21.15.28:0/367537044 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb230005680 con 0x7fb238151dc0 2023-12-16T03:27:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.812+0000 7fb234ff9640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb2180664a0 0x7fb218068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.812+0000 7fb234ff9640 1 -- 172.21.15.28:0/367537044 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb230084070 con 0x7fb238151dc0 2023-12-16T03:27:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.812+0000 7fb236ffd640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb2180664a0 0x7fb218068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:17.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.812+0000 7fb236ffd640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb2180664a0 0x7fb218068960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb2280ad000 tx=0x7fb228008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:17.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:17.816+0000 7fb234ff9640 1 -- 172.21.15.28:0/367537044 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb2300b5290 con 0x7fb238151dc0 2023-12-16T03:27:18.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.008+0000 7fb23da09640 1 -- 172.21.15.28:0/367537044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb238068400 con 0x7fb238151dc0 2023-12-16T03:27:18.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.008+0000 7fb234ff9640 1 -- 172.21.15.28:0/367537044 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6188 (secure 0 0 0) 0x7fb230058840 con 0x7fb238151dc0 2023-12-16T03:27:18.011 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:18.011 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3665146461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":3665146461},{"type":"v1","addr":"172.21.15.28:6837","nonce":3665146461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1938417336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1938417336},{"type":"v1","addr":"172.21.15.134:6835","nonce":1938417336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:00.888034+0000","modified":"2023-12-16T03:27:03.912013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/3717643902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3717643902},{"type":"v1","addr":"172.21.15.28:6836","nonce":3717643902}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:13.968886+0000","modified":"2023-12-16T03:27:17.002993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6834/4009894510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4009894510},{"type":"v1","addr":"172.21.15.134:6834","nonce":4009894510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-16T03:27:18.012 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 36 2023-12-16T03:27:18.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.008+0000 7fb23da09640 1 -- 172.21.15.28:0/367537044 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb2180664a0 msgr2=0x7fb218068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.008+0000 7fb23da09640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb2180664a0 0x7fb218068960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb2280ad000 tx=0x7fb228008040 comp rx=0 tx=0).stop 2023-12-16T03:27:18.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.008+0000 7fb23da09640 1 -- 172.21.15.28:0/367537044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb238151dc0 msgr2=0x7fb2381ed7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.008+0000 7fb23da09640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb238151dc0 0x7fb2381ed7b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c730 tx=0x7fb23000cbf0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.008+0000 7fb23da09640 1 -- 172.21.15.28:0/367537044 shutdown_connections 2023-12-16T03:27:18.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.008+0000 7fb23da09640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb2180664a0 0x7fb218068960 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.008+0000 7fb23da09640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb238151dc0 0x7fb2381ed7b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.008+0000 7fb23da09640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2380c7ed0 0x7fb2381f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.008+0000 7fb23da09640 1 --2- 172.21.15.28:0/367537044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb2380bd660 0x7fb2380aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.012+0000 7fb23da09640 1 -- 172.21.15.28:0/367537044 >> 172.21.15.28:0/367537044 conn(0x7fb238071eb0 msgr2=0x7fb2380c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:18.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.012+0000 7fb23da09640 1 -- 172.21.15.28:0/367537044 shutdown_connections 2023-12-16T03:27:18.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.012+0000 7fb23da09640 1 -- 172.21.15.28:0/367537044 wait complete. 2023-12-16T03:27:18.033 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:18.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.172+0000 7fc157bc4640 1 Processor -- start 2023-12-16T03:27:18.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.172+0000 7fc157bc4640 1 -- start start 2023-12-16T03:27:18.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc157bc4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1500c5c60 0x7fc1500c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc157bc4640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1500c3bd0 con 0x7fc1500a5240 2023-12-16T03:27:18.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc157bc4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1500bf1e0 con 0x7fc1501561f0 2023-12-16T03:27:18.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc157bc4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500c3e20 con 0x7fc1500c5c60 2023-12-16T03:27:18.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc155960640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc1500a5240 0x7fc1500bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41014/0 (socket says 172.21.15.28:41014) 2023-12-16T03:27:18.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc155960640 1 -- 172.21.15.28:0/3435329838 learned_addr learned my addr 172.21.15.28:0/3435329838 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:18.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc15515f640 1 --2- 172.21.15.28:0/3435329838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1500c5c60 0x7fc1500c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc15495e640 1 -- 172.21.15.28:0/3435329838 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459309059 0 0) 0x7fc1500c3bd0 con 0x7fc1500a5240 2023-12-16T03:27:18.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc15495e640 1 -- 172.21.15.28:0/3435329838 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc13c003530 con 0x7fc1500a5240 2023-12-16T03:27:18.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc15495e640 1 -- 172.21.15.28:0/3435329838 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690413852 0 0) 0x7fc1500bf1e0 con 0x7fc1501561f0 2023-12-16T03:27:18.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc15495e640 1 -- 172.21.15.28:0/3435329838 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1500c3bd0 con 0x7fc1501561f0 2023-12-16T03:27:18.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc15515f640 1 -- 172.21.15.28:0/3435329838 >> v1:172.21.15.134:6789/0 conn(0x7fc1501561f0 legacy=0x7fc150156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc15515f640 1 -- 172.21.15.28:0/3435329838 >> v1:172.21.15.28:6789/0 conn(0x7fc1500a5240 legacy=0x7fc1500bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.176+0000 7fc15515f640 1 -- 172.21.15.28:0/3435329838 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1500c4100 con 0x7fc1500c5c60 2023-12-16T03:27:18.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc15515f640 1 --2- 172.21.15.28:0/3435329838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1500c5c60 0x7fc1500c60a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc140009820 tx=0x7fc14001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f01894ebfb685e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:18.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc15495e640 1 -- 172.21.15.28:0/3435329838 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140004230 con 0x7fc1500c5c60 2023-12-16T03:27:18.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc15495e640 1 -- 172.21.15.28:0/3435329838 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1400a7050 con 0x7fc1500c5c60 2023-12-16T03:27:18.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc15495e640 1 -- 172.21.15.28:0/3435329838 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140003620 con 0x7fc1500c5c60 2023-12-16T03:27:18.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc157bc4640 1 -- 172.21.15.28:0/3435329838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1500c5c60 msgr2=0x7fc1500c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc157bc4640 1 --2- 172.21.15.28:0/3435329838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1500c5c60 0x7fc1500c60a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc140009820 tx=0x7fc14001c350 comp rx=0 tx=0).stop 2023-12-16T03:27:18.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc157bc4640 1 -- 172.21.15.28:0/3435329838 shutdown_connections 2023-12-16T03:27:18.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc157bc4640 1 --2- 172.21.15.28:0/3435329838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1500c5c60 0x7fc1500c60a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc157bc4640 1 -- 172.21.15.28:0/3435329838 >> 172.21.15.28:0/3435329838 conn(0x7fc15006a5b0 msgr2=0x7fc15006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:18.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc157bc4640 1 -- 172.21.15.28:0/3435329838 shutdown_connections 2023-12-16T03:27:18.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc157bc4640 1 -- 172.21.15.28:0/3435329838 wait complete. 2023-12-16T03:27:18.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc157bc4640 1 Processor -- start 2023-12-16T03:27:18.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.180+0000 7fc157bc4640 1 -- start start 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc157bc4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500a5240 0x7fc15014db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc157bc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1500c5c60 0x7fc150153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc157bc4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1501561f0 0x7fc1501508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc157bc4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc150153e60 con 0x7fc1500a5240 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc157bc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15014add0 con 0x7fc1500c5c60 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc157bc4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1501529d0 con 0x7fc1501561f0 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc155960640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500a5240 0x7fc15014db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc155960640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500a5240 0x7fc15014db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58744/0 (socket says 172.21.15.28:58744) 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc155960640 1 -- 172.21.15.28:0/1715762227 learned_addr learned my addr 172.21.15.28:0/1715762227 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc15515f640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1500c5c60 0x7fc150153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc156161640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1501561f0 0x7fc1501508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc155960640 1 -- 172.21.15.28:0/1715762227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1501561f0 msgr2=0x7fc1501508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc155960640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1501561f0 0x7fc1501508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc155960640 1 -- 172.21.15.28:0/1715762227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1500c5c60 msgr2=0x7fc150153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc155960640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1500c5c60 0x7fc150153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc155960640 1 -- 172.21.15.28:0/1715762227 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc140009420 con 0x7fc1500a5240 2023-12-16T03:27:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc155960640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500a5240 0x7fc15014db10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00c4b0 tx=0x7fc14c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc1467fc640 1 -- 172.21.15.28:0/1715762227 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c005cf0 con 0x7fc1500a5240 2023-12-16T03:27:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc1467fc640 1 -- 172.21.15.28:0/1715762227 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14c005e50 con 0x7fc1500a5240 2023-12-16T03:27:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc1467fc640 1 -- 172.21.15.28:0/1715762227 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c007290 con 0x7fc1500a5240 2023-12-16T03:27:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc157bc4640 1 -- 172.21.15.28:0/1715762227 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc150156f10 con 0x7fc1500a5240 2023-12-16T03:27:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc157bc4640 1 -- 172.21.15.28:0/1715762227 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc150150df0 con 0x7fc1500a5240 2023-12-16T03:27:18.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc157bc4640 1 -- 172.21.15.28:0/1715762227 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15014d830 con 0x7fc1500a5240 2023-12-16T03:27:18.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.184+0000 7fc1467fc640 1 -- 172.21.15.28:0/1715762227 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc14c0073f0 con 0x7fc1500a5240 2023-12-16T03:27:18.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.188+0000 7fc1467fc640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc1340664a0 0x7fc134068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.188+0000 7fc1467fc640 1 -- 172.21.15.28:0/1715762227 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc14c083790 con 0x7fc1500a5240 2023-12-16T03:27:18.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.188+0000 7fc15515f640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc1340664a0 0x7fc134068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.188+0000 7fc15515f640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc1340664a0 0x7fc134068960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc1400ad000 tx=0x7fc1400a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:18.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.192+0000 7fc1467fc640 1 -- 172.21.15.28:0/1715762227 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc15014d830 con 0x7fc1500a5240 2023-12-16T03:27:18.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.348+0000 7fc157bc4640 1 -- 172.21.15.28:0/1715762227 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc15014d830 con 0x7fc1500a5240 2023-12-16T03:27:18.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc1467fc640 1 -- 172.21.15.28:0/1715762227 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20280 (secure 0 0 0) 0x7fc15014d830 con 0x7fc1500a5240 2023-12-16T03:27:18.354 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:18.354 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":54,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:15.600556+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:18.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 -- 172.21.15.28:0/1715762227 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc1340664a0 msgr2=0x7fc134068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc1340664a0 0x7fc134068960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc1400ad000 tx=0x7fc1400a6000 comp rx=0 tx=0).stop 2023-12-16T03:27:18.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 -- 172.21.15.28:0/1715762227 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500a5240 msgr2=0x7fc15014db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500a5240 0x7fc15014db10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00c4b0 tx=0x7fc14c00c970 comp rx=0 tx=0).stop 2023-12-16T03:27:18.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 -- 172.21.15.28:0/1715762227 shutdown_connections 2023-12-16T03:27:18.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc1501561f0 0x7fc1501508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1500c5c60 0x7fc150153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc1340664a0 0x7fc134068960 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 --2- 172.21.15.28:0/1715762227 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500a5240 0x7fc15014db10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 -- 172.21.15.28:0/1715762227 >> 172.21.15.28:0/1715762227 conn(0x7fc15006a5b0 msgr2=0x7fc15006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:18.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 -- 172.21.15.28:0/1715762227 shutdown_connections 2023-12-16T03:27:18.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.352+0000 7fc157bc4640 1 -- 172.21.15.28:0/1715762227 wait complete. 2023-12-16T03:27:18.375 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-16T03:27:18.376 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:27:18.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a9a380640 1 Processor -- start 2023-12-16T03:27:18.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a9a380640 1 -- start start 2023-12-16T03:27:18.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a9a380640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4a940a6df0 0x7f4a940c1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a9a380640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a940c1ec0 con 0x7f4a941555c0 2023-12-16T03:27:18.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a9a380640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a940c28e0 con 0x7f4a940c61e0 2023-12-16T03:27:18.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a9a380640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a940c3680 con 0x7f4a940a6df0 2023-12-16T03:27:18.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a93fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4a941555c0 0x7f4a940c6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41026/0 (socket says 172.21.15.28:41026) 2023-12-16T03:27:18.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a93fff640 1 -- 172.21.15.28:0/1354481653 learned_addr learned my addr 172.21.15.28:0/1354481653 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:18.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a9891d640 1 --2- 172.21.15.28:0/1354481653 >> v2:172.21.15.134:3300/0 conn(0x7f4a940a6df0 0x7f4a940c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a92ffd640 1 -- 172.21.15.28:0/1354481653 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157964307 0 0) 0x7f4a940c1ec0 con 0x7f4a941555c0 2023-12-16T03:27:18.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a92ffd640 1 -- 172.21.15.28:0/1354481653 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a7c003530 con 0x7f4a941555c0 2023-12-16T03:27:18.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a9891d640 1 -- 172.21.15.28:0/1354481653 >> v1:172.21.15.134:6789/0 conn(0x7f4a940c61e0 legacy=0x7f4a940c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a9891d640 1 -- 172.21.15.28:0/1354481653 >> v1:172.21.15.28:6789/0 conn(0x7f4a941555c0 legacy=0x7f4a940c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.516+0000 7f4a9891d640 1 -- 172.21.15.28:0/1354481653 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a940c2b80 con 0x7f4a940a6df0 2023-12-16T03:27:18.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.520+0000 7f4a9891d640 1 --2- 172.21.15.28:0/1354481653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a940a6df0 0x7f4a940c1980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009d90 tx=0x7f4a8c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=496841b591c430dc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:18.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.520+0000 7f4a92ffd640 1 -- 172.21.15.28:0/1354481653 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0a5890 con 0x7f4a940a6df0 2023-12-16T03:27:18.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.520+0000 7f4a92ffd640 1 -- 172.21.15.28:0/1354481653 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8c0a59f0 con 0x7f4a940a6df0 2023-12-16T03:27:18.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.520+0000 7f4a92ffd640 1 -- 172.21.15.28:0/1354481653 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0a5d80 con 0x7f4a940a6df0 2023-12-16T03:27:18.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.520+0000 7f4a9a380640 1 -- 172.21.15.28:0/1354481653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a940a6df0 msgr2=0x7f4a940c1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.520+0000 7f4a9a380640 1 --2- 172.21.15.28:0/1354481653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a940a6df0 0x7f4a940c1980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009d90 tx=0x7f4a8c01c950 comp rx=0 tx=0).stop 2023-12-16T03:27:18.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.520+0000 7f4a9a380640 1 -- 172.21.15.28:0/1354481653 shutdown_connections 2023-12-16T03:27:18.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.520+0000 7f4a9a380640 1 --2- 172.21.15.28:0/1354481653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a940a6df0 0x7f4a940c1980 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.520+0000 7f4a9a380640 1 -- 172.21.15.28:0/1354481653 >> 172.21.15.28:0/1354481653 conn(0x7f4a940c7e40 msgr2=0x7f4a940c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:18.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.520+0000 7f4a9a380640 1 -- 172.21.15.28:0/1354481653 shutdown_connections 2023-12-16T03:27:18.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.520+0000 7f4a9a380640 1 -- 172.21.15.28:0/1354481653 wait complete. 2023-12-16T03:27:18.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9a380640 1 Processor -- start 2023-12-16T03:27:18.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9a380640 1 -- start start 2023-12-16T03:27:18.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9a380640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a940a6df0 0x7f4a941491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9a380640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a940c61e0 0x7f4a9414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9a380640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a941555c0 0x7f4a94147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9a380640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a94158c40 con 0x7f4a941555c0 2023-12-16T03:27:18.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9a380640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a941587b0 con 0x7f4a940c61e0 2023-12-16T03:27:18.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9a380640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a94153fa0 con 0x7f4a940a6df0 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9891d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a941555c0 0x7f4a94147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9891d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a941555c0 0x7f4a94147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58746/0 (socket says 172.21.15.28:58746) 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9891d640 1 -- 172.21.15.28:0/2146317582 learned_addr learned my addr 172.21.15.28:0/2146317582 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a937fe640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a940c61e0 0x7f4a9414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a93fff640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a940a6df0 0x7f4a941491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9891d640 1 -- 172.21.15.28:0/2146317582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a940a6df0 msgr2=0x7f4a941491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9891d640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a940a6df0 0x7f4a941491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9891d640 1 -- 172.21.15.28:0/2146317582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a940c61e0 msgr2=0x7f4a9414e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9891d640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a940c61e0 0x7f4a9414e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9891d640 1 -- 172.21.15.28:0/2146317582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c009a70 con 0x7f4a941555c0 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a93fff640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a940a6df0 0x7f4a941491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a937fe640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a940c61e0 0x7f4a9414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:18.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9891d640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a941555c0 0x7f4a94147280 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0b0040 tx=0x7f4a8c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:18.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a90ff9640 1 -- 172.21.15.28:0/2146317582 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0b9650 con 0x7f4a941555c0 2023-12-16T03:27:18.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a90ff9640 1 -- 172.21.15.28:0/2146317582 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8c0b97b0 con 0x7f4a941555c0 2023-12-16T03:27:18.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9a380640 1 -- 172.21.15.28:0/2146317582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a94157cf0 con 0x7f4a941555c0 2023-12-16T03:27:18.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a90ff9640 1 -- 172.21.15.28:0/2146317582 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0b9b40 con 0x7f4a941555c0 2023-12-16T03:27:18.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.524+0000 7f4a9a380640 1 -- 172.21.15.28:0/2146317582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a941f1290 con 0x7f4a941555c0 2023-12-16T03:27:18.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.528+0000 7f4a9a380640 1 -- 172.21.15.28:0/2146317582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a94158920 con 0x7f4a941555c0 2023-12-16T03:27:18.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.528+0000 7f4a90ff9640 1 -- 172.21.15.28:0/2146317582 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4a8c0b9ca0 con 0x7f4a941555c0 2023-12-16T03:27:18.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.528+0000 7f4a90ff9640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a80066470 0x7f4a80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.528+0000 7f4a90ff9640 1 -- 172.21.15.28:0/2146317582 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4a8c11f450 con 0x7f4a941555c0 2023-12-16T03:27:18.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.528+0000 7f4a93fff640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a80066470 0x7f4a80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.528+0000 7f4a93fff640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a80066470 0x7f4a80068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4a840011f0 tx=0x7f4a84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:18.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.532+0000 7f4a90ff9640 1 -- 172.21.15.28:0/2146317582 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4a8c0ec560 con 0x7f4a941555c0 2023-12-16T03:27:18.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.688+0000 7f4a9a380640 1 -- 172.21.15.28:0/2146317582 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a9415ff20 con 0x7f4a80066470 2023-12-16T03:27:18.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.700+0000 7f4a90ff9640 1 -- 172.21.15.28:0/2146317582 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+516198 (secure 0 0 0) 0x7f4a9415ff20 con 0x7f4a80066470 2023-12-16T03:27:18.710 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:18.714 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:27:18.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 -- 172.21.15.28:0/2146317582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a80066470 msgr2=0x7f4a80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a80066470 0x7f4a80068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4a840011f0 tx=0x7f4a84009040 comp rx=0 tx=0).stop 2023-12-16T03:27:18.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 -- 172.21.15.28:0/2146317582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a941555c0 msgr2=0x7f4a94147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a941555c0 0x7f4a94147280 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0b0040 tx=0x7f4a8c0196f0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 -- 172.21.15.28:0/2146317582 shutdown_connections 2023-12-16T03:27:18.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4a80066470 0x7f4a80068930 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a941555c0 0x7f4a94147280 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a940c61e0 0x7f4a9414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 --2- 172.21.15.28:0/2146317582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4a940a6df0 0x7f4a941491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 -- 172.21.15.28:0/2146317582 >> 172.21.15.28:0/2146317582 conn(0x7f4a940c7e40 msgr2=0x7f4a94154790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:18.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 -- 172.21.15.28:0/2146317582 shutdown_connections 2023-12-16T03:27:18.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.708+0000 7f4a9a380640 1 -- 172.21.15.28:0/2146317582 wait complete. 2023-12-16T03:27:18.730 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-12-16T03:27:17.822355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238736,"kb_used_data":5932,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735984,"statfs":{"total":773094113280,"available":772849647616,"internally_reserved":0,"allocated":6074368,"data_stored":3223223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1495,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.256218"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829460+0000","last_change":"2023-12-16T03:27:01.537420+0000","last_active":"2023-12-16T03:27:02.829460+0000","last_peered":"2023-12-16T03:27:02.829460+0000","last_clean":"2023-12-16T03:27:02.829460+0000","last_became_active":"2023-12-16T03:27:01.537176+0000","last_became_peered":"2023-12-16T03:27:01.537176+0000","last_unstale":"2023-12-16T03:27:02.829460+0000","last_undegraded":"2023-12-16T03:27:02.829460+0000","last_fullsized":"2023-12-16T03:27:02.829460+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:23:26.860864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830469+0000","last_change":"2023-12-16T03:27:01.534498+0000","last_active":"2023-12-16T03:27:02.830469+0000","last_peered":"2023-12-16T03:27:02.830469+0000","last_clean":"2023-12-16T03:27:02.830469+0000","last_became_active":"2023-12-16T03:27:01.533730+0000","last_became_peered":"2023-12-16T03:27:01.533730+0000","last_unstale":"2023-12-16T03:27:02.830469+0000","last_undegraded":"2023-12-16T03:27:02.830469+0000","last_fullsized":"2023-12-16T03:27:02.830469+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:07.937228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053229+0000","last_change":"2023-12-16T03:27:01.518121+0000","last_active":"2023-12-16T03:27:03.053229+0000","last_peered":"2023-12-16T03:27:03.053229+0000","last_clean":"2023-12-16T03:27:03.053229+0000","last_became_active":"2023-12-16T03:27:01.517826+0000","last_became_peered":"2023-12-16T03:27:01.517826+0000","last_unstale":"2023-12-16T03:27:03.053229+0000","last_undegraded":"2023-12-16T03:27:03.053229+0000","last_fullsized":"2023-12-16T03:27:03.053229+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:46.909657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828744+0000","last_change":"2023-12-16T03:27:01.531096+0000","last_active":"2023-12-16T03:27:02.828744+0000","last_peered":"2023-12-16T03:27:02.828744+0000","last_clean":"2023-12-16T03:27:02.828744+0000","last_became_active":"2023-12-16T03:27:01.530793+0000","last_became_peered":"2023-12-16T03:27:01.530793+0000","last_unstale":"2023-12-16T03:27:02.828744+0000","last_undegraded":"2023-12-16T03:27:02.828744+0000","last_fullsized":"2023-12-16T03:27:02.828744+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:59.366673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829423+0000","last_change":"2023-12-16T03:27:01.531904+0000","last_active":"2023-12-16T03:27:02.829423+0000","last_peered":"2023-12-16T03:27:02.829423+0000","last_clean":"2023-12-16T03:27:02.829423+0000","last_became_active":"2023-12-16T03:27:01.531705+0000","last_became_peered":"2023-12-16T03:27:01.531705+0000","last_unstale":"2023-12-16T03:27:02.829423+0000","last_undegraded":"2023-12-16T03:27:02.829423+0000","last_fullsized":"2023-12-16T03:27:02.829423+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:24:38.684552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052563+0000","last_change":"2023-12-16T03:27:01.537597+0000","last_active":"2023-12-16T03:27:03.052563+0000","last_peered":"2023-12-16T03:27:03.052563+0000","last_clean":"2023-12-16T03:27:03.052563+0000","last_became_active":"2023-12-16T03:27:01.537262+0000","last_became_peered":"2023-12-16T03:27:01.537262+0000","last_unstale":"2023-12-16T03:27:03.052563+0000","last_undegraded":"2023-12-16T03:27:03.052563+0000","last_fullsized":"2023-12-16T03:27:03.052563+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828516+0000","last_change":"2023-12-16T03:27:01.504710+0000","last_active":"2023-12-16T03:27:02.828516+0000","last_peered":"2023-12-16T03:27:02.828516+0000","last_clean":"2023-12-16T03:27:02.828516+0000","last_became_active":"2023-12-16T03:27:01.504412+0000","last_became_peered":"2023-12-16T03:27:01.504412+0000","last_unstale":"2023-12-16T03:27:02.828516+0000","last_undegraded":"2023-12-16T03:27:02.828516+0000","last_fullsized":"2023-12-16T03:27:02.828516+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:09.298222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830343+0000","last_change":"2023-12-16T03:27:01.514585+0000","last_active":"2023-12-16T03:27:02.830343+0000","last_peered":"2023-12-16T03:27:02.830343+0000","last_clean":"2023-12-16T03:27:02.830343+0000","last_became_active":"2023-12-16T03:27:01.514304+0000","last_became_peered":"2023-12-16T03:27:01.514304+0000","last_unstale":"2023-12-16T03:27:02.830343+0000","last_undegraded":"2023-12-16T03:27:02.830343+0000","last_fullsized":"2023-12-16T03:27:02.830343+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:44:59.949884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828650+0000","last_change":"2023-12-16T03:27:01.517287+0000","last_active":"2023-12-16T03:27:02.828650+0000","last_peered":"2023-12-16T03:27:02.828650+0000","last_clean":"2023-12-16T03:27:02.828650+0000","last_became_active":"2023-12-16T03:27:01.516865+0000","last_became_peered":"2023-12-16T03:27:01.516865+0000","last_unstale":"2023-12-16T03:27:02.828650+0000","last_undegraded":"2023-12-16T03:27:02.828650+0000","last_fullsized":"2023-12-16T03:27:02.828650+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:49.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053568+0000","last_change":"2023-12-16T03:27:01.523610+0000","last_active":"2023-12-16T03:27:03.053568+0000","last_peered":"2023-12-16T03:27:03.053568+0000","last_clean":"2023-12-16T03:27:03.053568+0000","last_became_active":"2023-12-16T03:27:01.523269+0000","last_became_peered":"2023-12-16T03:27:01.523269+0000","last_unstale":"2023-12-16T03:27:03.053568+0000","last_undegraded":"2023-12-16T03:27:03.053568+0000","last_fullsized":"2023-12-16T03:27:03.053568+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:43.020903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053472+0000","last_change":"2023-12-16T03:27:01.534387+0000","last_active":"2023-12-16T03:27:03.053472+0000","last_peered":"2023-12-16T03:27:03.053472+0000","last_clean":"2023-12-16T03:27:03.053472+0000","last_became_active":"2023-12-16T03:27:01.534102+0000","last_became_peered":"2023-12-16T03:27:01.534102+0000","last_unstale":"2023-12-16T03:27:03.053472+0000","last_undegraded":"2023-12-16T03:27:03.053472+0000","last_fullsized":"2023-12-16T03:27:03.053472+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:48:59.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828760+0000","last_change":"2023-12-16T03:27:01.514907+0000","last_active":"2023-12-16T03:27:02.828760+0000","last_peered":"2023-12-16T03:27:02.828760+0000","last_clean":"2023-12-16T03:27:02.828760+0000","last_became_active":"2023-12-16T03:27:01.514396+0000","last_became_peered":"2023-12-16T03:27:01.514396+0000","last_unstale":"2023-12-16T03:27:02.828760+0000","last_undegraded":"2023-12-16T03:27:02.828760+0000","last_fullsized":"2023-12-16T03:27:02.828760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052844+0000","last_change":"2023-12-16T03:27:01.533053+0000","last_active":"2023-12-16T03:27:03.052844+0000","last_peered":"2023-12-16T03:27:03.052844+0000","last_clean":"2023-12-16T03:27:03.052844+0000","last_became_active":"2023-12-16T03:27:01.532852+0000","last_became_peered":"2023-12-16T03:27:01.532852+0000","last_unstale":"2023-12-16T03:27:03.052844+0000","last_undegraded":"2023-12-16T03:27:03.052844+0000","last_fullsized":"2023-12-16T03:27:03.052844+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:05.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828556+0000","last_change":"2023-12-16T03:27:01.527464+0000","last_active":"2023-12-16T03:27:02.828556+0000","last_peered":"2023-12-16T03:27:02.828556+0000","last_clean":"2023-12-16T03:27:02.828556+0000","last_became_active":"2023-12-16T03:27:01.526439+0000","last_became_peered":"2023-12-16T03:27:01.526439+0000","last_unstale":"2023-12-16T03:27:02.828556+0000","last_undegraded":"2023-12-16T03:27:02.828556+0000","last_fullsized":"2023-12-16T03:27:02.828556+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:55.347747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828538+0000","last_change":"2023-12-16T03:27:01.523106+0000","last_active":"2023-12-16T03:27:02.828538+0000","last_peered":"2023-12-16T03:27:02.828538+0000","last_clean":"2023-12-16T03:27:02.828538+0000","last_became_active":"2023-12-16T03:27:01.522824+0000","last_became_peered":"2023-12-16T03:27:01.522824+0000","last_unstale":"2023-12-16T03:27:02.828538+0000","last_undegraded":"2023-12-16T03:27:02.828538+0000","last_fullsized":"2023-12-16T03:27:02.828538+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:04.563786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052553+0000","last_change":"2023-12-16T03:27:01.513664+0000","last_active":"2023-12-16T03:27:03.052553+0000","last_peered":"2023-12-16T03:27:03.052553+0000","last_clean":"2023-12-16T03:27:03.052553+0000","last_became_active":"2023-12-16T03:27:01.513325+0000","last_became_peered":"2023-12-16T03:27:01.513325+0000","last_unstale":"2023-12-16T03:27:03.052553+0000","last_undegraded":"2023-12-16T03:27:03.052553+0000","last_fullsized":"2023-12-16T03:27:03.052553+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830495+0000","last_change":"2023-12-16T03:27:01.526203+0000","last_active":"2023-12-16T03:27:02.830495+0000","last_peered":"2023-12-16T03:27:02.830495+0000","last_clean":"2023-12-16T03:27:02.830495+0000","last_became_active":"2023-12-16T03:27:01.525873+0000","last_became_peered":"2023-12-16T03:27:01.525873+0000","last_unstale":"2023-12-16T03:27:02.830495+0000","last_undegraded":"2023-12-16T03:27:02.830495+0000","last_fullsized":"2023-12-16T03:27:02.830495+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:37:50.321166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053467+0000","last_change":"2023-12-16T03:27:01.529407+0000","last_active":"2023-12-16T03:27:03.053467+0000","last_peered":"2023-12-16T03:27:03.053467+0000","last_clean":"2023-12-16T03:27:03.053467+0000","last_became_active":"2023-12-16T03:27:01.529024+0000","last_became_peered":"2023-12-16T03:27:01.529024+0000","last_unstale":"2023-12-16T03:27:03.053467+0000","last_undegraded":"2023-12-16T03:27:03.053467+0000","last_fullsized":"2023-12-16T03:27:03.053467+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829448+0000","last_change":"2023-12-16T03:27:01.538362+0000","last_active":"2023-12-16T03:27:02.829448+0000","last_peered":"2023-12-16T03:27:02.829448+0000","last_clean":"2023-12-16T03:27:02.829448+0000","last_became_active":"2023-12-16T03:27:01.538024+0000","last_became_peered":"2023-12-16T03:27:01.538024+0000","last_unstale":"2023-12-16T03:27:02.829448+0000","last_undegraded":"2023-12-16T03:27:02.829448+0000","last_fullsized":"2023-12-16T03:27:02.829448+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:44.941057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830452+0000","last_change":"2023-12-16T03:27:01.535927+0000","last_active":"2023-12-16T03:27:02.830452+0000","last_peered":"2023-12-16T03:27:02.830452+0000","last_clean":"2023-12-16T03:27:02.830452+0000","last_became_active":"2023-12-16T03:27:01.535618+0000","last_became_peered":"2023-12-16T03:27:01.535618+0000","last_unstale":"2023-12-16T03:27:02.830452+0000","last_undegraded":"2023-12-16T03:27:02.830452+0000","last_fullsized":"2023-12-16T03:27:02.830452+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:46.786632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053065+0000","last_change":"2023-12-16T03:27:01.520051+0000","last_active":"2023-12-16T03:27:03.053065+0000","last_peered":"2023-12-16T03:27:03.053065+0000","last_clean":"2023-12-16T03:27:03.053065+0000","last_became_active":"2023-12-16T03:27:01.519803+0000","last_became_peered":"2023-12-16T03:27:01.519803+0000","last_unstale":"2023-12-16T03:27:03.053065+0000","last_undegraded":"2023-12-16T03:27:03.053065+0000","last_fullsized":"2023-12-16T03:27:03.053065+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830392+0000","last_change":"2023-12-16T03:27:01.523786+0000","last_active":"2023-12-16T03:27:02.830392+0000","last_peered":"2023-12-16T03:27:02.830392+0000","last_clean":"2023-12-16T03:27:02.830392+0000","last_became_active":"2023-12-16T03:27:01.523435+0000","last_became_peered":"2023-12-16T03:27:01.523435+0000","last_unstale":"2023-12-16T03:27:02.830392+0000","last_undegraded":"2023-12-16T03:27:02.830392+0000","last_fullsized":"2023-12-16T03:27:02.830392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:59:37.033807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052538+0000","last_change":"2023-12-16T03:27:01.539536+0000","last_active":"2023-12-16T03:27:03.052538+0000","last_peered":"2023-12-16T03:27:03.052538+0000","last_clean":"2023-12-16T03:27:03.052538+0000","last_became_active":"2023-12-16T03:27:01.539210+0000","last_became_peered":"2023-12-16T03:27:01.539210+0000","last_unstale":"2023-12-16T03:27:03.052538+0000","last_undegraded":"2023-12-16T03:27:03.052538+0000","last_fullsized":"2023-12-16T03:27:03.052538+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052446+0000","last_change":"2023-12-16T03:27:01.521374+0000","last_active":"2023-12-16T03:27:03.052446+0000","last_peered":"2023-12-16T03:27:03.052446+0000","last_clean":"2023-12-16T03:27:03.052446+0000","last_became_active":"2023-12-16T03:27:01.521080+0000","last_became_peered":"2023-12-16T03:27:01.521080+0000","last_unstale":"2023-12-16T03:27:03.052446+0000","last_undegraded":"2023-12-16T03:27:03.052446+0000","last_fullsized":"2023-12-16T03:27:03.052446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:47.409565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829472+0000","last_change":"2023-12-16T03:27:01.537212+0000","last_active":"2023-12-16T03:27:02.829472+0000","last_peered":"2023-12-16T03:27:02.829472+0000","last_clean":"2023-12-16T03:27:02.829472+0000","last_became_active":"2023-12-16T03:27:01.536927+0000","last_became_peered":"2023-12-16T03:27:01.536927+0000","last_unstale":"2023-12-16T03:27:02.829472+0000","last_undegraded":"2023-12-16T03:27:02.829472+0000","last_fullsized":"2023-12-16T03:27:02.829472+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:59.764629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828835+0000","last_change":"2023-12-16T03:27:01.506167+0000","last_active":"2023-12-16T03:27:02.828835+0000","last_peered":"2023-12-16T03:27:02.828835+0000","last_clean":"2023-12-16T03:27:02.828835+0000","last_became_active":"2023-12-16T03:27:01.505856+0000","last_became_peered":"2023-12-16T03:27:01.505856+0000","last_unstale":"2023-12-16T03:27:02.828835+0000","last_undegraded":"2023-12-16T03:27:02.828835+0000","last_fullsized":"2023-12-16T03:27:02.828835+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052711+0000","last_change":"2023-12-16T03:27:01.514340+0000","last_active":"2023-12-16T03:27:03.052711+0000","last_peered":"2023-12-16T03:27:03.052711+0000","last_clean":"2023-12-16T03:27:03.052711+0000","last_became_active":"2023-12-16T03:27:01.514047+0000","last_became_peered":"2023-12-16T03:27:01.514047+0000","last_unstale":"2023-12-16T03:27:03.052711+0000","last_undegraded":"2023-12-16T03:27:03.052711+0000","last_fullsized":"2023-12-16T03:27:03.052711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829435+0000","last_change":"2023-12-16T03:27:01.531612+0000","last_active":"2023-12-16T03:27:02.829435+0000","last_peered":"2023-12-16T03:27:02.829435+0000","last_clean":"2023-12-16T03:27:02.829435+0000","last_became_active":"2023-12-16T03:27:01.531274+0000","last_became_peered":"2023-12-16T03:27:01.531274+0000","last_unstale":"2023-12-16T03:27:02.829435+0000","last_undegraded":"2023-12-16T03:27:02.829435+0000","last_fullsized":"2023-12-16T03:27:02.829435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:58.878396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830436+0000","last_change":"2023-12-16T03:27:01.527562+0000","last_active":"2023-12-16T03:27:02.830436+0000","last_peered":"2023-12-16T03:27:02.830436+0000","last_clean":"2023-12-16T03:27:02.830436+0000","last_became_active":"2023-12-16T03:27:01.525171+0000","last_became_peered":"2023-12-16T03:27:01.525171+0000","last_unstale":"2023-12-16T03:27:02.830436+0000","last_undegraded":"2023-12-16T03:27:02.830436+0000","last_fullsized":"2023-12-16T03:27:02.830436+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:02:55.385594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053042+0000","last_change":"2023-12-16T03:27:01.518371+0000","last_active":"2023-12-16T03:27:03.053042+0000","last_peered":"2023-12-16T03:27:03.053042+0000","last_clean":"2023-12-16T03:27:03.053042+0000","last_became_active":"2023-12-16T03:27:01.518088+0000","last_became_peered":"2023-12-16T03:27:01.518088+0000","last_unstale":"2023-12-16T03:27:03.053042+0000","last_undegraded":"2023-12-16T03:27:03.053042+0000","last_fullsized":"2023-12-16T03:27:03.053042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829405+0000","last_change":"2023-12-16T03:27:01.532530+0000","last_active":"2023-12-16T03:27:02.829405+0000","last_peered":"2023-12-16T03:27:02.829405+0000","last_clean":"2023-12-16T03:27:02.829405+0000","last_became_active":"2023-12-16T03:27:01.532228+0000","last_became_peered":"2023-12-16T03:27:01.532228+0000","last_unstale":"2023-12-16T03:27:02.829405+0000","last_undegraded":"2023-12-16T03:27:02.829405+0000","last_fullsized":"2023-12-16T03:27:02.829405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.578189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052711+0000","last_change":"2023-12-16T03:27:01.526590+0000","last_active":"2023-12-16T03:27:03.052711+0000","last_peered":"2023-12-16T03:27:03.052711+0000","last_clean":"2023-12-16T03:27:03.052711+0000","last_became_active":"2023-12-16T03:27:01.525400+0000","last_became_peered":"2023-12-16T03:27:01.525400+0000","last_unstale":"2023-12-16T03:27:03.052711+0000","last_undegraded":"2023-12-16T03:27:03.052711+0000","last_fullsized":"2023-12-16T03:27:03.052711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:46.909657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568670+0000","last_change":"2023-12-16T03:27:12.568670+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568670+0000","last_undegraded":"2023-12-16T03:27:12.568670+0000","last_fullsized":"2023-12-16T03:27:12.568670+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053156+0000","last_change":"2023-12-16T03:27:01.519301+0000","last_active":"2023-12-16T03:27:03.053156+0000","last_peered":"2023-12-16T03:27:03.053156+0000","last_clean":"2023-12-16T03:27:03.053156+0000","last_became_active":"2023-12-16T03:27:01.519011+0000","last_became_peered":"2023-12-16T03:27:01.519011+0000","last_unstale":"2023-12-16T03:27:03.053156+0000","last_undegraded":"2023-12-16T03:27:03.053156+0000","last_fullsized":"2023-12-16T03:27:03.053156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:34.578819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053311+0000","last_change":"2023-12-16T03:27:00.515238+0000","last_active":"2023-12-16T03:27:03.053311+0000","last_peered":"2023-12-16T03:27:03.053311+0000","last_clean":"2023-12-16T03:27:03.053311+0000","last_became_active":"2023-12-16T03:27:00.514968+0000","last_became_peered":"2023-12-16T03:27:00.514968+0000","last_unstale":"2023-12-16T03:27:03.053311+0000","last_undegraded":"2023-12-16T03:27:03.053311+0000","last_fullsized":"2023-12-16T03:27:03.053311+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574048+0000","last_change":"2023-12-16T03:27:12.574048+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574048+0000","last_undegraded":"2023-12-16T03:27:12.574048+0000","last_fullsized":"2023-12-16T03:27:12.574048+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053623+0000","last_change":"2023-12-16T03:27:01.522872+0000","last_active":"2023-12-16T03:27:03.053623+0000","last_peered":"2023-12-16T03:27:03.053623+0000","last_clean":"2023-12-16T03:27:03.053623+0000","last_became_active":"2023-12-16T03:27:01.522260+0000","last_became_peered":"2023-12-16T03:27:01.522260+0000","last_unstale":"2023-12-16T03:27:03.053623+0000","last_undegraded":"2023-12-16T03:27:03.053623+0000","last_fullsized":"2023-12-16T03:27:03.053623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:50.778695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830478+0000","last_change":"2023-12-16T03:27:00.521097+0000","last_active":"2023-12-16T03:27:02.830478+0000","last_peered":"2023-12-16T03:27:02.830478+0000","last_clean":"2023-12-16T03:27:02.830478+0000","last_became_active":"2023-12-16T03:27:00.520800+0000","last_became_peered":"2023-12-16T03:27:00.520800+0000","last_unstale":"2023-12-16T03:27:02.830478+0000","last_undegraded":"2023-12-16T03:27:02.830478+0000","last_fullsized":"2023-12-16T03:27:02.830478+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:38:52.347850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574268+0000","last_change":"2023-12-16T03:27:12.574268+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574268+0000","last_undegraded":"2023-12-16T03:27:12.574268+0000","last_fullsized":"2023-12-16T03:27:12.574268+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052934+0000","last_change":"2023-12-16T03:27:01.528475+0000","last_active":"2023-12-16T03:27:03.052934+0000","last_peered":"2023-12-16T03:27:03.052934+0000","last_clean":"2023-12-16T03:27:03.052934+0000","last_became_active":"2023-12-16T03:27:01.527985+0000","last_became_peered":"2023-12-16T03:27:01.527985+0000","last_unstale":"2023-12-16T03:27:03.052934+0000","last_undegraded":"2023-12-16T03:27:03.052934+0000","last_fullsized":"2023-12-16T03:27:03.052934+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:33.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053087+0000","last_change":"2023-12-16T03:27:00.516992+0000","last_active":"2023-12-16T03:27:03.053087+0000","last_peered":"2023-12-16T03:27:03.053087+0000","last_clean":"2023-12-16T03:27:03.053087+0000","last_became_active":"2023-12-16T03:27:00.515339+0000","last_became_peered":"2023-12-16T03:27:00.515339+0000","last_unstale":"2023-12-16T03:27:03.053087+0000","last_undegraded":"2023-12-16T03:27:03.053087+0000","last_fullsized":"2023-12-16T03:27:03.053087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:58.358317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573237+0000","last_change":"2023-12-16T03:27:12.573237+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573237+0000","last_undegraded":"2023-12-16T03:27:12.573237+0000","last_fullsized":"2023-12-16T03:27:12.573237+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052856+0000","last_change":"2023-12-16T03:27:01.522006+0000","last_active":"2023-12-16T03:27:03.052856+0000","last_peered":"2023-12-16T03:27:03.052856+0000","last_clean":"2023-12-16T03:27:03.052856+0000","last_became_active":"2023-12-16T03:27:01.520949+0000","last_became_peered":"2023-12-16T03:27:01.520949+0000","last_unstale":"2023-12-16T03:27:03.052856+0000","last_undegraded":"2023-12-16T03:27:03.052856+0000","last_fullsized":"2023-12-16T03:27:03.052856+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:29.951188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828778+0000","last_change":"2023-12-16T03:27:00.515665+0000","last_active":"2023-12-16T03:27:02.828778+0000","last_peered":"2023-12-16T03:27:02.828778+0000","last_clean":"2023-12-16T03:27:02.828778+0000","last_became_active":"2023-12-16T03:27:00.514766+0000","last_became_peered":"2023-12-16T03:27:00.514766+0000","last_unstale":"2023-12-16T03:27:02.828778+0000","last_undegraded":"2023-12-16T03:27:02.828778+0000","last_fullsized":"2023-12-16T03:27:02.828778+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:54.339391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574727+0000","last_change":"2023-12-16T03:27:12.574727+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574727+0000","last_undegraded":"2023-12-16T03:27:12.574727+0000","last_fullsized":"2023-12-16T03:27:12.574727+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830400+0000","last_change":"2023-12-16T03:27:01.523755+0000","last_active":"2023-12-16T03:27:02.830400+0000","last_peered":"2023-12-16T03:27:02.830400+0000","last_clean":"2023-12-16T03:27:02.830400+0000","last_became_active":"2023-12-16T03:27:01.523179+0000","last_became_peered":"2023-12-16T03:27:01.523179+0000","last_unstale":"2023-12-16T03:27:02.830400+0000","last_undegraded":"2023-12-16T03:27:02.830400+0000","last_fullsized":"2023-12-16T03:27:02.830400+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:20:11.416554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828595+0000","last_change":"2023-12-16T03:27:00.512400+0000","last_active":"2023-12-16T03:27:02.828595+0000","last_peered":"2023-12-16T03:27:02.828595+0000","last_clean":"2023-12-16T03:27:02.828595+0000","last_became_active":"2023-12-16T03:27:00.512120+0000","last_became_peered":"2023-12-16T03:27:00.512120+0000","last_unstale":"2023-12-16T03:27:02.828595+0000","last_undegraded":"2023-12-16T03:27:02.828595+0000","last_fullsized":"2023-12-16T03:27:02.828595+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:32:09.899662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570554+0000","last_change":"2023-12-16T03:27:12.570554+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570554+0000","last_undegraded":"2023-12-16T03:27:12.570554+0000","last_fullsized":"2023-12-16T03:27:12.570554+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830417+0000","last_change":"2023-12-16T03:27:01.536014+0000","last_active":"2023-12-16T03:27:02.830417+0000","last_peered":"2023-12-16T03:27:02.830417+0000","last_clean":"2023-12-16T03:27:02.830417+0000","last_became_active":"2023-12-16T03:27:01.535729+0000","last_became_peered":"2023-12-16T03:27:01.535729+0000","last_unstale":"2023-12-16T03:27:02.830417+0000","last_undegraded":"2023-12-16T03:27:02.830417+0000","last_fullsized":"2023-12-16T03:27:02.830417+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:22:11.774067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052634+0000","last_change":"2023-12-16T03:27:00.513060+0000","last_active":"2023-12-16T03:27:03.052634+0000","last_peered":"2023-12-16T03:27:03.052634+0000","last_clean":"2023-12-16T03:27:03.052634+0000","last_became_active":"2023-12-16T03:27:00.512780+0000","last_became_peered":"2023-12-16T03:27:00.512780+0000","last_unstale":"2023-12-16T03:27:03.052634+0000","last_undegraded":"2023-12-16T03:27:03.052634+0000","last_fullsized":"2023-12-16T03:27:03.052634+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:03.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573037+0000","last_change":"2023-12-16T03:27:12.573037+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573037+0000","last_undegraded":"2023-12-16T03:27:12.573037+0000","last_fullsized":"2023-12-16T03:27:12.573037+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052594+0000","last_change":"2023-12-16T03:27:01.520984+0000","last_active":"2023-12-16T03:27:03.052594+0000","last_peered":"2023-12-16T03:27:03.052594+0000","last_clean":"2023-12-16T03:27:03.052594+0000","last_became_active":"2023-12-16T03:27:01.520045+0000","last_became_peered":"2023-12-16T03:27:01.520045+0000","last_unstale":"2023-12-16T03:27:03.052594+0000","last_undegraded":"2023-12-16T03:27:03.052594+0000","last_fullsized":"2023-12-16T03:27:03.052594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:37.842605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828664+0000","last_change":"2023-12-16T03:27:00.513568+0000","last_active":"2023-12-16T03:27:02.828664+0000","last_peered":"2023-12-16T03:27:02.828664+0000","last_clean":"2023-12-16T03:27:02.828664+0000","last_became_active":"2023-12-16T03:27:00.513294+0000","last_became_peered":"2023-12-16T03:27:00.513294+0000","last_unstale":"2023-12-16T03:27:02.828664+0000","last_undegraded":"2023-12-16T03:27:02.828664+0000","last_fullsized":"2023-12-16T03:27:02.828664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574576+0000","last_change":"2023-12-16T03:27:12.574576+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574576+0000","last_undegraded":"2023-12-16T03:27:12.574576+0000","last_fullsized":"2023-12-16T03:27:12.574576+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830375+0000","last_change":"2023-12-16T03:27:01.526843+0000","last_active":"2023-12-16T03:27:02.830375+0000","last_peered":"2023-12-16T03:27:02.830375+0000","last_clean":"2023-12-16T03:27:02.830375+0000","last_became_active":"2023-12-16T03:27:01.525795+0000","last_became_peered":"2023-12-16T03:27:01.525795+0000","last_unstale":"2023-12-16T03:27:02.830375+0000","last_undegraded":"2023-12-16T03:27:02.830375+0000","last_fullsized":"2023-12-16T03:27:02.830375+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:53.633088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828495+0000","last_change":"2023-12-16T03:27:00.520498+0000","last_active":"2023-12-16T03:27:02.828495+0000","last_peered":"2023-12-16T03:27:02.828495+0000","last_clean":"2023-12-16T03:27:02.828495+0000","last_became_active":"2023-12-16T03:27:00.520179+0000","last_became_peered":"2023-12-16T03:27:00.520179+0000","last_unstale":"2023-12-16T03:27:02.828495+0000","last_undegraded":"2023-12-16T03:27:02.828495+0000","last_fullsized":"2023-12-16T03:27:02.828495+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:36.834249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573562+0000","last_change":"2023-12-16T03:27:12.573562+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573562+0000","last_undegraded":"2023-12-16T03:27:12.573562+0000","last_fullsized":"2023-12-16T03:27:12.573562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828634+0000","last_change":"2023-12-16T03:27:01.525335+0000","last_active":"2023-12-16T03:27:02.828634+0000","last_peered":"2023-12-16T03:27:02.828634+0000","last_clean":"2023-12-16T03:27:02.828634+0000","last_became_active":"2023-12-16T03:27:01.524994+0000","last_became_peered":"2023-12-16T03:27:01.524994+0000","last_unstale":"2023-12-16T03:27:02.828634+0000","last_undegraded":"2023-12-16T03:27:02.828634+0000","last_fullsized":"2023-12-16T03:27:02.828634+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:08.574639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053413+0000","last_change":"2023-12-16T03:27:00.516706+0000","last_active":"2023-12-16T03:27:03.053413+0000","last_peered":"2023-12-16T03:27:03.053413+0000","last_clean":"2023-12-16T03:27:03.053413+0000","last_became_active":"2023-12-16T03:27:00.516403+0000","last_became_peered":"2023-12-16T03:27:00.516403+0000","last_unstale":"2023-12-16T03:27:03.053413+0000","last_undegraded":"2023-12-16T03:27:03.053413+0000","last_fullsized":"2023-12-16T03:27:03.053413+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:27.966699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574730+0000","last_change":"2023-12-16T03:27:12.574730+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574730+0000","last_undegraded":"2023-12-16T03:27:12.574730+0000","last_fullsized":"2023-12-16T03:27:12.574730+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053478+0000","last_change":"2023-12-16T03:27:01.526628+0000","last_active":"2023-12-16T03:27:03.053478+0000","last_peered":"2023-12-16T03:27:03.053478+0000","last_clean":"2023-12-16T03:27:03.053478+0000","last_became_active":"2023-12-16T03:27:01.526319+0000","last_became_peered":"2023-12-16T03:27:01.526319+0000","last_unstale":"2023-12-16T03:27:03.053478+0000","last_undegraded":"2023-12-16T03:27:03.053478+0000","last_fullsized":"2023-12-16T03:27:03.053478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:32.633580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830487+0000","last_change":"2023-12-16T03:27:00.524203+0000","last_active":"2023-12-16T03:27:02.830487+0000","last_peered":"2023-12-16T03:27:02.830487+0000","last_clean":"2023-12-16T03:27:02.830487+0000","last_became_active":"2023-12-16T03:27:00.523807+0000","last_became_peered":"2023-12-16T03:27:00.523807+0000","last_unstale":"2023-12-16T03:27:02.830487+0000","last_undegraded":"2023-12-16T03:27:02.830487+0000","last_fullsized":"2023-12-16T03:27:02.830487+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:07:50.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.569019+0000","last_change":"2023-12-16T03:27:12.569019+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.569019+0000","last_undegraded":"2023-12-16T03:27:12.569019+0000","last_fullsized":"2023-12-16T03:27:12.569019+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053160+0000","last_change":"2023-12-16T03:27:01.533076+0000","last_active":"2023-12-16T03:27:03.053160+0000","last_peered":"2023-12-16T03:27:03.053160+0000","last_clean":"2023-12-16T03:27:03.053160+0000","last_became_active":"2023-12-16T03:27:01.532721+0000","last_became_peered":"2023-12-16T03:27:01.532721+0000","last_unstale":"2023-12-16T03:27:03.053160+0000","last_undegraded":"2023-12-16T03:27:03.053160+0000","last_fullsized":"2023-12-16T03:27:03.053160+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:37.842605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053510+0000","last_change":"2023-12-16T03:27:00.521385+0000","last_active":"2023-12-16T03:27:03.053510+0000","last_peered":"2023-12-16T03:27:03.053510+0000","last_clean":"2023-12-16T03:27:03.053510+0000","last_became_active":"2023-12-16T03:27:00.521116+0000","last_became_peered":"2023-12-16T03:27:00.521116+0000","last_unstale":"2023-12-16T03:27:03.053510+0000","last_undegraded":"2023-12-16T03:27:03.053510+0000","last_fullsized":"2023-12-16T03:27:03.053510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573979+0000","last_change":"2023-12-16T03:27:12.573979+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573979+0000","last_undegraded":"2023-12-16T03:27:12.573979+0000","last_fullsized":"2023-12-16T03:27:12.573979+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053295+0000","last_change":"2023-12-16T03:27:01.522382+0000","last_active":"2023-12-16T03:27:03.053295+0000","last_peered":"2023-12-16T03:27:03.053295+0000","last_clean":"2023-12-16T03:27:03.053295+0000","last_became_active":"2023-12-16T03:27:01.522101+0000","last_became_peered":"2023-12-16T03:27:01.522101+0000","last_unstale":"2023-12-16T03:27:03.053295+0000","last_undegraded":"2023-12-16T03:27:03.053295+0000","last_fullsized":"2023-12-16T03:27:03.053295+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:29.951188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":21,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:09.416701+0000","last_change":"2023-12-16T03:27:00.514824+0000","last_active":"2023-12-16T03:27:09.416701+0000","last_peered":"2023-12-16T03:27:09.416701+0000","last_clean":"2023-12-16T03:27:09.416701+0000","last_became_active":"2023-12-16T03:27:00.514574+0000","last_became_peered":"2023-12-16T03:27:00.514574+0000","last_unstale":"2023-12-16T03:27:09.416701+0000","last_undegraded":"2023-12-16T03:27:09.416701+0000","last_fullsized":"2023-12-16T03:27:09.416701+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:49.770339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.569118+0000","last_change":"2023-12-16T03:27:12.569118+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.569118+0000","last_undegraded":"2023-12-16T03:27:12.569118+0000","last_fullsized":"2023-12-16T03:27:12.569118+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828701+0000","last_change":"2023-12-16T03:27:01.523308+0000","last_active":"2023-12-16T03:27:02.828701+0000","last_peered":"2023-12-16T03:27:02.828701+0000","last_clean":"2023-12-16T03:27:02.828701+0000","last_became_active":"2023-12-16T03:27:01.522582+0000","last_became_peered":"2023-12-16T03:27:01.522582+0000","last_unstale":"2023-12-16T03:27:02.828701+0000","last_undegraded":"2023-12-16T03:27:02.828701+0000","last_fullsized":"2023-12-16T03:27:02.828701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:44.457252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830426+0000","last_change":"2023-12-16T03:27:00.524023+0000","last_active":"2023-12-16T03:27:02.830426+0000","last_peered":"2023-12-16T03:27:02.830426+0000","last_clean":"2023-12-16T03:27:02.830426+0000","last_became_active":"2023-12-16T03:27:00.523742+0000","last_became_peered":"2023-12-16T03:27:00.523742+0000","last_unstale":"2023-12-16T03:27:02.830426+0000","last_undegraded":"2023-12-16T03:27:02.830426+0000","last_fullsized":"2023-12-16T03:27:02.830426+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:09:52.558814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568829+0000","last_change":"2023-12-16T03:27:12.568829+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568829+0000","last_undegraded":"2023-12-16T03:27:12.568829+0000","last_fullsized":"2023-12-16T03:27:12.568829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053099+0000","last_change":"2023-12-16T03:27:01.519766+0000","last_active":"2023-12-16T03:27:03.053099+0000","last_peered":"2023-12-16T03:27:03.053099+0000","last_clean":"2023-12-16T03:27:03.053099+0000","last_became_active":"2023-12-16T03:27:01.519473+0000","last_became_peered":"2023-12-16T03:27:01.519473+0000","last_unstale":"2023-12-16T03:27:03.053099+0000","last_undegraded":"2023-12-16T03:27:03.053099+0000","last_fullsized":"2023-12-16T03:27:03.053099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052412+0000","last_change":"2023-12-16T03:27:00.518062+0000","last_active":"2023-12-16T03:27:03.052412+0000","last_peered":"2023-12-16T03:27:03.052412+0000","last_clean":"2023-12-16T03:27:03.052412+0000","last_became_active":"2023-12-16T03:27:00.517664+0000","last_became_peered":"2023-12-16T03:27:00.517664+0000","last_unstale":"2023-12-16T03:27:03.052412+0000","last_undegraded":"2023-12-16T03:27:03.052412+0000","last_fullsized":"2023-12-16T03:27:03.052412+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:47:04.667881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574778+0000","last_change":"2023-12-16T03:27:12.574778+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574778+0000","last_undegraded":"2023-12-16T03:27:12.574778+0000","last_fullsized":"2023-12-16T03:27:12.574778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828470+0000","last_change":"2023-12-16T03:27:01.514600+0000","last_active":"2023-12-16T03:27:02.828470+0000","last_peered":"2023-12-16T03:27:02.828470+0000","last_clean":"2023-12-16T03:27:02.828470+0000","last_became_active":"2023-12-16T03:27:01.514262+0000","last_became_peered":"2023-12-16T03:27:01.514262+0000","last_unstale":"2023-12-16T03:27:02.828470+0000","last_undegraded":"2023-12-16T03:27:02.828470+0000","last_fullsized":"2023-12-16T03:27:02.828470+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:28.975055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828684+0000","last_change":"2023-12-16T03:27:00.514189+0000","last_active":"2023-12-16T03:27:02.828684+0000","last_peered":"2023-12-16T03:27:02.828684+0000","last_clean":"2023-12-16T03:27:02.828684+0000","last_became_active":"2023-12-16T03:27:00.513862+0000","last_became_peered":"2023-12-16T03:27:00.513862+0000","last_unstale":"2023-12-16T03:27:02.828684+0000","last_undegraded":"2023-12-16T03:27:02.828684+0000","last_fullsized":"2023-12-16T03:27:02.828684+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574099+0000","last_change":"2023-12-16T03:27:12.574099+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574099+0000","last_undegraded":"2023-12-16T03:27:12.574099+0000","last_fullsized":"2023-12-16T03:27:12.574099+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052577+0000","last_change":"2023-12-16T03:27:01.540186+0000","last_active":"2023-12-16T03:27:03.052577+0000","last_peered":"2023-12-16T03:27:03.052577+0000","last_clean":"2023-12-16T03:27:03.052577+0000","last_became_active":"2023-12-16T03:27:01.539206+0000","last_became_peered":"2023-12-16T03:27:01.539206+0000","last_unstale":"2023-12-16T03:27:03.052577+0000","last_undegraded":"2023-12-16T03:27:03.052577+0000","last_fullsized":"2023-12-16T03:27:03.052577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":21,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052488+0000","last_change":"2023-12-16T03:27:00.515681+0000","last_active":"2023-12-16T03:27:03.052488+0000","last_peered":"2023-12-16T03:27:03.052488+0000","last_clean":"2023-12-16T03:27:03.052488+0000","last_became_active":"2023-12-16T03:27:00.515413+0000","last_became_peered":"2023-12-16T03:27:00.515413+0000","last_unstale":"2023-12-16T03:27:03.052488+0000","last_undegraded":"2023-12-16T03:27:03.052488+0000","last_fullsized":"2023-12-16T03:27:03.052488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574928+0000","last_change":"2023-12-16T03:27:12.574928+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574928+0000","last_undegraded":"2023-12-16T03:27:12.574928+0000","last_fullsized":"2023-12-16T03:27:12.574928+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053454+0000","last_change":"2023-12-16T03:27:01.518997+0000","last_active":"2023-12-16T03:27:03.053454+0000","last_peered":"2023-12-16T03:27:03.053454+0000","last_clean":"2023-12-16T03:27:03.053454+0000","last_became_active":"2023-12-16T03:27:01.518606+0000","last_became_peered":"2023-12-16T03:27:01.518606+0000","last_unstale":"2023-12-16T03:27:03.053454+0000","last_undegraded":"2023-12-16T03:27:03.053454+0000","last_fullsized":"2023-12-16T03:27:03.053454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:34.578819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830504+0000","last_change":"2023-12-16T03:27:00.522719+0000","last_active":"2023-12-16T03:27:02.830504+0000","last_peered":"2023-12-16T03:27:02.830504+0000","last_clean":"2023-12-16T03:27:02.830504+0000","last_became_active":"2023-12-16T03:27:00.522485+0000","last_became_peered":"2023-12-16T03:27:00.522485+0000","last_unstale":"2023-12-16T03:27:02.830504+0000","last_undegraded":"2023-12-16T03:27:02.830504+0000","last_fullsized":"2023-12-16T03:27:02.830504+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:48:48.483240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574072+0000","last_change":"2023-12-16T03:27:12.574072+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574072+0000","last_undegraded":"2023-12-16T03:27:12.574072+0000","last_fullsized":"2023-12-16T03:27:12.574072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828875+0000","last_change":"2023-12-16T03:27:01.525968+0000","last_active":"2023-12-16T03:27:02.828875+0000","last_peered":"2023-12-16T03:27:02.828875+0000","last_clean":"2023-12-16T03:27:02.828875+0000","last_became_active":"2023-12-16T03:27:01.523176+0000","last_became_peered":"2023-12-16T03:27:01.523176+0000","last_unstale":"2023-12-16T03:27:02.828875+0000","last_undegraded":"2023-12-16T03:27:02.828875+0000","last_fullsized":"2023-12-16T03:27:02.828875+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053080+0000","last_change":"2023-12-16T03:27:00.514506+0000","last_active":"2023-12-16T03:27:03.053080+0000","last_peered":"2023-12-16T03:27:03.053080+0000","last_clean":"2023-12-16T03:27:03.053080+0000","last_became_active":"2023-12-16T03:27:00.514121+0000","last_became_peered":"2023-12-16T03:27:00.514121+0000","last_unstale":"2023-12-16T03:27:03.053080+0000","last_undegraded":"2023-12-16T03:27:03.053080+0000","last_fullsized":"2023-12-16T03:27:03.053080+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:47:33.862583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.575351+0000","last_change":"2023-12-16T03:27:12.575351+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.575351+0000","last_undegraded":"2023-12-16T03:27:12.575351+0000","last_fullsized":"2023-12-16T03:27:12.575351+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830461+0000","last_change":"2023-12-16T03:27:01.517329+0000","last_active":"2023-12-16T03:27:02.830461+0000","last_peered":"2023-12-16T03:27:02.830461+0000","last_clean":"2023-12-16T03:27:02.830461+0000","last_became_active":"2023-12-16T03:27:01.517020+0000","last_became_peered":"2023-12-16T03:27:01.517020+0000","last_unstale":"2023-12-16T03:27:02.830461+0000","last_undegraded":"2023-12-16T03:27:02.830461+0000","last_fullsized":"2023-12-16T03:27:02.830461+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:37:11.829485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828814+0000","last_change":"2023-12-16T03:27:00.514408+0000","last_active":"2023-12-16T03:27:02.828814+0000","last_peered":"2023-12-16T03:27:02.828814+0000","last_clean":"2023-12-16T03:27:02.828814+0000","last_became_active":"2023-12-16T03:27:00.514141+0000","last_became_peered":"2023-12-16T03:27:00.514141+0000","last_unstale":"2023-12-16T03:27:02.828814+0000","last_undegraded":"2023-12-16T03:27:02.828814+0000","last_fullsized":"2023-12-16T03:27:02.828814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:10.695120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568619+0000","last_change":"2023-12-16T03:27:12.568619+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568619+0000","last_undegraded":"2023-12-16T03:27:12.568619+0000","last_fullsized":"2023-12-16T03:27:12.568619+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053441+0000","last_change":"2023-12-16T03:27:01.522466+0000","last_active":"2023-12-16T03:27:03.053441+0000","last_peered":"2023-12-16T03:27:03.053441+0000","last_clean":"2023-12-16T03:27:03.053441+0000","last_became_active":"2023-12-16T03:27:01.522111+0000","last_became_peered":"2023-12-16T03:27:01.522111+0000","last_unstale":"2023-12-16T03:27:03.053441+0000","last_undegraded":"2023-12-16T03:27:03.053441+0000","last_fullsized":"2023-12-16T03:27:03.053441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:33.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053145+0000","last_change":"2023-12-16T03:27:00.520371+0000","last_active":"2023-12-16T03:27:03.053145+0000","last_peered":"2023-12-16T03:27:03.053145+0000","last_clean":"2023-12-16T03:27:03.053145+0000","last_became_active":"2023-12-16T03:27:00.520097+0000","last_became_peered":"2023-12-16T03:27:00.520097+0000","last_unstale":"2023-12-16T03:27:03.053145+0000","last_undegraded":"2023-12-16T03:27:03.053145+0000","last_fullsized":"2023-12-16T03:27:03.053145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:32:48.297921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570732+0000","last_change":"2023-12-16T03:27:12.570732+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570732+0000","last_undegraded":"2023-12-16T03:27:12.570732+0000","last_fullsized":"2023-12-16T03:27:12.570732+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828726+0000","last_change":"2023-12-16T03:27:01.521651+0000","last_active":"2023-12-16T03:27:02.828726+0000","last_peered":"2023-12-16T03:27:02.828726+0000","last_clean":"2023-12-16T03:27:02.828726+0000","last_became_active":"2023-12-16T03:27:01.521167+0000","last_became_peered":"2023-12-16T03:27:01.521167+0000","last_unstale":"2023-12-16T03:27:02.828726+0000","last_undegraded":"2023-12-16T03:27:02.828726+0000","last_fullsized":"2023-12-16T03:27:02.828726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:42:00.543610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830444+0000","last_change":"2023-12-16T03:27:00.521885+0000","last_active":"2023-12-16T03:27:02.830444+0000","last_peered":"2023-12-16T03:27:02.830444+0000","last_clean":"2023-12-16T03:27:02.830444+0000","last_became_active":"2023-12-16T03:27:00.521503+0000","last_became_peered":"2023-12-16T03:27:00.521503+0000","last_unstale":"2023-12-16T03:27:02.830444+0000","last_undegraded":"2023-12-16T03:27:02.830444+0000","last_fullsized":"2023-12-16T03:27:02.830444+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:47.207385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573173+0000","last_change":"2023-12-16T03:27:12.573173+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573173+0000","last_undegraded":"2023-12-16T03:27:12.573173+0000","last_fullsized":"2023-12-16T03:27:12.573173+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052775+0000","last_change":"2023-12-16T03:27:01.516489+0000","last_active":"2023-12-16T03:27:03.052775+0000","last_peered":"2023-12-16T03:27:03.052775+0000","last_clean":"2023-12-16T03:27:03.052775+0000","last_became_active":"2023-12-16T03:27:01.516199+0000","last_became_peered":"2023-12-16T03:27:01.516199+0000","last_unstale":"2023-12-16T03:27:03.052775+0000","last_undegraded":"2023-12-16T03:27:03.052775+0000","last_fullsized":"2023-12-16T03:27:03.052775+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:09.981763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053056+0000","last_change":"2023-12-16T03:27:00.508945+0000","last_active":"2023-12-16T03:27:03.053056+0000","last_peered":"2023-12-16T03:27:03.053056+0000","last_clean":"2023-12-16T03:27:03.053056+0000","last_became_active":"2023-12-16T03:27:00.508638+0000","last_became_peered":"2023-12-16T03:27:00.508638+0000","last_unstale":"2023-12-16T03:27:03.053056+0000","last_undegraded":"2023-12-16T03:27:03.053056+0000","last_fullsized":"2023-12-16T03:27:03.053056+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573496+0000","last_change":"2023-12-16T03:27:12.573496+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573496+0000","last_undegraded":"2023-12-16T03:27:12.573496+0000","last_fullsized":"2023-12-16T03:27:12.573496+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053200+0000","last_change":"2023-12-16T03:27:01.518954+0000","last_active":"2023-12-16T03:27:03.053200+0000","last_peered":"2023-12-16T03:27:03.053200+0000","last_clean":"2023-12-16T03:27:03.053200+0000","last_became_active":"2023-12-16T03:27:01.518665+0000","last_became_peered":"2023-12-16T03:27:01.518665+0000","last_unstale":"2023-12-16T03:27:03.053200+0000","last_undegraded":"2023-12-16T03:27:03.053200+0000","last_fullsized":"2023-12-16T03:27:03.053200+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:32.633580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828639+0000","last_change":"2023-12-16T03:27:00.519726+0000","last_active":"2023-12-16T03:27:02.828639+0000","last_peered":"2023-12-16T03:27:02.828639+0000","last_clean":"2023-12-16T03:27:02.828639+0000","last_became_active":"2023-12-16T03:27:00.519420+0000","last_became_peered":"2023-12-16T03:27:00.519420+0000","last_unstale":"2023-12-16T03:27:02.828639+0000","last_undegraded":"2023-12-16T03:27:02.828639+0000","last_fullsized":"2023-12-16T03:27:02.828639+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:07.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570609+0000","last_change":"2023-12-16T03:27:12.570609+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570609+0000","last_undegraded":"2023-12-16T03:27:12.570609+0000","last_fullsized":"2023-12-16T03:27:12.570609+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828858+0000","last_change":"2023-12-16T03:27:01.531143+0000","last_active":"2023-12-16T03:27:02.828858+0000","last_peered":"2023-12-16T03:27:02.828858+0000","last_clean":"2023-12-16T03:27:02.828858+0000","last_became_active":"2023-12-16T03:27:01.530842+0000","last_became_peered":"2023-12-16T03:27:01.530842+0000","last_unstale":"2023-12-16T03:27:02.828858+0000","last_undegraded":"2023-12-16T03:27:02.828858+0000","last_fullsized":"2023-12-16T03:27:02.828858+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053609+0000","last_change":"2023-12-16T03:27:00.524413+0000","last_active":"2023-12-16T03:27:03.053609+0000","last_peered":"2023-12-16T03:27:03.053609+0000","last_clean":"2023-12-16T03:27:03.053609+0000","last_became_active":"2023-12-16T03:27:00.524142+0000","last_became_peered":"2023-12-16T03:27:00.524142+0000","last_unstale":"2023-12-16T03:27:03.053609+0000","last_undegraded":"2023-12-16T03:27:03.053609+0000","last_fullsized":"2023-12-16T03:27:03.053609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573254+0000","last_change":"2023-12-16T03:27:12.573254+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573254+0000","last_undegraded":"2023-12-16T03:27:12.573254+0000","last_fullsized":"2023-12-16T03:27:12.573254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828891+0000","last_change":"2023-12-16T03:27:01.518068+0000","last_active":"2023-12-16T03:27:02.828891+0000","last_peered":"2023-12-16T03:27:02.828891+0000","last_clean":"2023-12-16T03:27:02.828891+0000","last_became_active":"2023-12-16T03:27:01.516800+0000","last_became_peered":"2023-12-16T03:27:01.516800+0000","last_unstale":"2023-12-16T03:27:02.828891+0000","last_undegraded":"2023-12-16T03:27:02.828891+0000","last_fullsized":"2023-12-16T03:27:02.828891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:05.590414+0000","last_change":"2023-12-16T03:27:00.515007+0000","last_active":"2023-12-16T03:27:05.590414+0000","last_peered":"2023-12-16T03:27:05.590414+0000","last_clean":"2023-12-16T03:27:05.590414+0000","last_became_active":"2023-12-16T03:27:00.514820+0000","last_became_peered":"2023-12-16T03:27:00.514820+0000","last_unstale":"2023-12-16T03:27:05.590414+0000","last_undegraded":"2023-12-16T03:27:05.590414+0000","last_fullsized":"2023-12-16T03:27:05.590414+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:03:53.754918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574830+0000","last_change":"2023-12-16T03:27:12.574830+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574830+0000","last_undegraded":"2023-12-16T03:27:12.574830+0000","last_fullsized":"2023-12-16T03:27:12.574830+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053283+0000","last_change":"2023-12-16T03:27:01.522052+0000","last_active":"2023-12-16T03:27:03.053283+0000","last_peered":"2023-12-16T03:27:03.053283+0000","last_clean":"2023-12-16T03:27:03.053283+0000","last_became_active":"2023-12-16T03:27:01.521669+0000","last_became_peered":"2023-12-16T03:27:01.521669+0000","last_unstale":"2023-12-16T03:27:03.053283+0000","last_undegraded":"2023-12-16T03:27:03.053283+0000","last_fullsized":"2023-12-16T03:27:03.053283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:05.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052729+0000","last_change":"2023-12-16T03:27:00.516627+0000","last_active":"2023-12-16T03:27:03.052729+0000","last_peered":"2023-12-16T03:27:03.052729+0000","last_clean":"2023-12-16T03:27:03.052729+0000","last_became_active":"2023-12-16T03:27:00.516381+0000","last_became_peered":"2023-12-16T03:27:00.516381+0000","last_unstale":"2023-12-16T03:27:03.052729+0000","last_undegraded":"2023-12-16T03:27:03.052729+0000","last_fullsized":"2023-12-16T03:27:03.052729+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.569868+0000","last_change":"2023-12-16T03:27:12.569868+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.569868+0000","last_undegraded":"2023-12-16T03:27:12.569868+0000","last_fullsized":"2023-12-16T03:27:12.569868+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052986+0000","last_change":"2023-12-16T03:27:01.522194+0000","last_active":"2023-12-16T03:27:03.052986+0000","last_peered":"2023-12-16T03:27:03.052986+0000","last_clean":"2023-12-16T03:27:03.052986+0000","last_became_active":"2023-12-16T03:27:01.521667+0000","last_became_peered":"2023-12-16T03:27:01.521667+0000","last_unstale":"2023-12-16T03:27:03.052986+0000","last_undegraded":"2023-12-16T03:27:03.052986+0000","last_fullsized":"2023-12-16T03:27:03.052986+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828797+0000","last_change":"2023-12-16T03:27:00.511361+0000","last_active":"2023-12-16T03:27:02.828797+0000","last_peered":"2023-12-16T03:27:02.828797+0000","last_clean":"2023-12-16T03:27:02.828797+0000","last_became_active":"2023-12-16T03:27:00.511033+0000","last_became_peered":"2023-12-16T03:27:00.511033+0000","last_unstale":"2023-12-16T03:27:02.828797+0000","last_undegraded":"2023-12-16T03:27:02.828797+0000","last_fullsized":"2023-12-16T03:27:02.828797+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:48.295530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568615+0000","last_change":"2023-12-16T03:27:12.568615+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568615+0000","last_undegraded":"2023-12-16T03:27:12.568615+0000","last_fullsized":"2023-12-16T03:27:12.568615+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830408+0000","last_change":"2023-12-16T03:27:01.524848+0000","last_active":"2023-12-16T03:27:02.830408+0000","last_peered":"2023-12-16T03:27:02.830408+0000","last_clean":"2023-12-16T03:27:02.830408+0000","last_became_active":"2023-12-16T03:27:01.524561+0000","last_became_peered":"2023-12-16T03:27:01.524561+0000","last_unstale":"2023-12-16T03:27:02.830408+0000","last_undegraded":"2023-12-16T03:27:02.830408+0000","last_fullsized":"2023-12-16T03:27:02.830408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.908171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052896+0000","last_change":"2023-12-16T03:27:00.513344+0000","last_active":"2023-12-16T03:27:03.052896+0000","last_peered":"2023-12-16T03:27:03.052896+0000","last_clean":"2023-12-16T03:27:03.052896+0000","last_became_active":"2023-12-16T03:27:00.513101+0000","last_became_peered":"2023-12-16T03:27:00.513101+0000","last_unstale":"2023-12-16T03:27:03.052896+0000","last_undegraded":"2023-12-16T03:27:03.052896+0000","last_fullsized":"2023-12-16T03:27:03.052896+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:34.745808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573469+0000","last_change":"2023-12-16T03:27:12.573469+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573469+0000","last_undegraded":"2023-12-16T03:27:12.573469+0000","last_fullsized":"2023-12-16T03:27:12.573469+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053255+0000","last_change":"2023-12-16T03:27:01.543099+0000","last_active":"2023-12-16T03:27:03.053255+0000","last_peered":"2023-12-16T03:27:03.053255+0000","last_clean":"2023-12-16T03:27:03.053255+0000","last_became_active":"2023-12-16T03:27:01.542711+0000","last_became_peered":"2023-12-16T03:27:01.542711+0000","last_unstale":"2023-12-16T03:27:03.053255+0000","last_undegraded":"2023-12-16T03:27:03.053255+0000","last_fullsized":"2023-12-16T03:27:03.053255+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:09.981763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828573+0000","last_change":"2023-12-16T03:27:00.513164+0000","last_active":"2023-12-16T03:27:02.828573+0000","last_peered":"2023-12-16T03:27:02.828573+0000","last_clean":"2023-12-16T03:27:02.828573+0000","last_became_active":"2023-12-16T03:27:00.512912+0000","last_became_peered":"2023-12-16T03:27:00.512912+0000","last_unstale":"2023-12-16T03:27:02.828573+0000","last_undegraded":"2023-12-16T03:27:02.828573+0000","last_fullsized":"2023-12-16T03:27:02.828573+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570585+0000","last_change":"2023-12-16T03:27:12.570585+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570585+0000","last_undegraded":"2023-12-16T03:27:12.570585+0000","last_fullsized":"2023-12-16T03:27:12.570585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052586+0000","last_change":"2023-12-16T03:27:01.521887+0000","last_active":"2023-12-16T03:27:03.052586+0000","last_peered":"2023-12-16T03:27:03.052586+0000","last_clean":"2023-12-16T03:27:03.052586+0000","last_became_active":"2023-12-16T03:27:01.521554+0000","last_became_peered":"2023-12-16T03:27:01.521554+0000","last_unstale":"2023-12-16T03:27:03.052586+0000","last_undegraded":"2023-12-16T03:27:03.052586+0000","last_fullsized":"2023-12-16T03:27:03.052586+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:47.409565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052670+0000","last_change":"2023-12-16T03:27:00.512268+0000","last_active":"2023-12-16T03:27:03.052670+0000","last_peered":"2023-12-16T03:27:03.052670+0000","last_clean":"2023-12-16T03:27:03.052670+0000","last_became_active":"2023-12-16T03:27:00.511945+0000","last_became_peered":"2023-12-16T03:27:00.511945+0000","last_unstale":"2023-12-16T03:27:03.052670+0000","last_undegraded":"2023-12-16T03:27:03.052670+0000","last_fullsized":"2023-12-16T03:27:03.052670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:49:40.657817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574958+0000","last_change":"2023-12-16T03:27:12.574958+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574958+0000","last_undegraded":"2023-12-16T03:27:12.574958+0000","last_fullsized":"2023-12-16T03:27:12.574958+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830383+0000","last_change":"2023-12-16T03:27:01.527192+0000","last_active":"2023-12-16T03:27:02.830383+0000","last_peered":"2023-12-16T03:27:02.830383+0000","last_clean":"2023-12-16T03:27:02.830383+0000","last_became_active":"2023-12-16T03:27:01.526892+0000","last_became_peered":"2023-12-16T03:27:01.526892+0000","last_unstale":"2023-12-16T03:27:02.830383+0000","last_undegraded":"2023-12-16T03:27:02.830383+0000","last_fullsized":"2023-12-16T03:27:02.830383+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:00.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830365+0000","last_change":"2023-12-16T03:27:00.516056+0000","last_active":"2023-12-16T03:27:02.830365+0000","last_peered":"2023-12-16T03:27:02.830365+0000","last_clean":"2023-12-16T03:27:02.830365+0000","last_became_active":"2023-12-16T03:27:00.515763+0000","last_became_peered":"2023-12-16T03:27:00.515763+0000","last_unstale":"2023-12-16T03:27:02.830365+0000","last_undegraded":"2023-12-16T03:27:02.830365+0000","last_fullsized":"2023-12-16T03:27:02.830365+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:42.045050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.575249+0000","last_change":"2023-12-16T03:27:12.575249+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.575249+0000","last_undegraded":"2023-12-16T03:27:12.575249+0000","last_fullsized":"2023-12-16T03:27:12.575249+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830356+0000","last_change":"2023-12-16T03:27:01.520522+0000","last_active":"2023-12-16T03:27:02.830356+0000","last_peered":"2023-12-16T03:27:02.830356+0000","last_clean":"2023-12-16T03:27:02.830356+0000","last_became_active":"2023-12-16T03:27:01.520214+0000","last_became_peered":"2023-12-16T03:27:01.520214+0000","last_unstale":"2023-12-16T03:27:02.830356+0000","last_undegraded":"2023-12-16T03:27:02.830356+0000","last_fullsized":"2023-12-16T03:27:02.830356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:42.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052580+0000","last_change":"2023-12-16T03:27:00.514945+0000","last_active":"2023-12-16T03:27:03.052580+0000","last_peered":"2023-12-16T03:27:03.052580+0000","last_clean":"2023-12-16T03:27:03.052580+0000","last_became_active":"2023-12-16T03:27:00.514688+0000","last_became_peered":"2023-12-16T03:27:00.514688+0000","last_unstale":"2023-12-16T03:27:03.052580+0000","last_undegraded":"2023-12-16T03:27:03.052580+0000","last_fullsized":"2023-12-16T03:27:03.052580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:07.829384+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:27:07.829384+0000","last_peered":"2023-12-16T03:27:07.829384+0000","last_clean":"2023-12-16T03:27:07.829384+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:27:07.829384+0000","last_undegraded":"2023-12-16T03:27:07.829384+0000","last_fullsized":"2023-12-16T03:27:07.829384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":842361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":1.155,"15min":1.155},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90700000000000003,"5min":1.585,"15min":1.585},"last":0.62}]},{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88200000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.81299999999999994,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85099999999999998,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77300000000000002,"15min":0.79100000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.79600000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92700000000000005,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.51700000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96299999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94399999999999995,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81899999999999995,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.874,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46800000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.004,"15min":1.004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.89300000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":598016,"data_stored":251833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.437,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93400000000000005,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93799999999999994,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82899999999999996,"15min":0.85499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95399999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":1.02,"15min":1.075},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96299999999999997,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.98099999999999998,"15min":1.0289999999999999},"min":{"1min":0.51200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.042,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.069,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.87,"15min":0.89700000000000002},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":4.242,"15min":4.242},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.90300000000000002,"15min":0.93500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92600000000000005,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88100000000000001,"5min":1.111,"15min":1.111},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.52300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":1.073,"15min":1.073},"last":0.62}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.077,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.99099999999999999,"5min":1.246,"15min":1.246},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.74399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":259156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.60999999999999999},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.77300000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.872},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1,"15min":1},"last":0.82199999999999995}]},{"osd":2,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":1.004}]},{"osd":3,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.93999999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74399999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.755,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64000000000000001,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73599999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.748},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.79200000000000004}]},{"osd":7,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.82399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.89100000000000001,"5min":1.105,"15min":1.105},"last":0.95999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":610304,"data_stored":254940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.78200000000000003,"15min":0.81000000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":4.194,"15min":4.194},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85299999999999998,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.60599999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.91500000000000004,"5min":1.288,"15min":1.288},"last":0.745}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.93500000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84399999999999997,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.92500000000000004,"15min":0.96199999999999997},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86099999999999999,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.80000000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.92800000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.751,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.44600000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96499999999999997,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88600000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.871}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88900000000000001,"5min":1.881,"15min":1.881},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.81999999999999995,"15min":0.83999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":606208,"data_stored":251889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.747,"15min":0.80400000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67700000000000005,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.80900000000000005,"15min":0.871},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.52200000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.66700000000000004,"15min":0.70499999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63500000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.442},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.66300000000000003,"15min":0.68400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.72999999999999998,"15min":0.76500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.496}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94999999999999996,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.629},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.048,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.89400000000000002,"15min":0.92200000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.89500000000000002,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.86899999999999999,"15min":0.89100000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.006,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.92500000000000004,"15min":0.95299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97499999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.93400000000000005,"15min":0.96399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94499999999999995,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.95299999999999996,"15min":0.97999999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0609999999999999,"5min":3.375,"15min":3.375},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":618496,"data_stored":258560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48399999999999999,"15min":0.48499999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.875,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.312}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.503,"15min":0.498},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.36199999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.502},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.022},"last":0.46800000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77200000000000002,"15min":0.77700000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1060000000000001,"5min":1.587,"15min":1.587},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0609999999999999,"5min":1.913,"15min":1.913},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.55500000000000005}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.179,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.04,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.58699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":258594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.60999999999999999,"15min":0.64200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97199999999999998,"5min":4.476,"15min":4.476},"last":0.499}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.80800000000000005,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73899999999999999,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.749,"15min":0.79300000000000004},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.70299999999999996,"15min":0.73399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.66700000000000004,"15min":0.70099999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.436}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.03,"15min":1.0820000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0840000000000001,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.93799999999999994,"15min":0.97199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.133,"5min":4.984,"15min":4.984},"last":0.63800000000000001}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.90200000000000002,"15min":0.93999999999999995},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.996,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.745,"5min":1.089,"15min":1.147},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0209999999999999,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.95199999999999996,"15min":0.98899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0880000000000001,"15min":1.147},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95299999999999996,"5min":7.681,"15min":7.681},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":1.0369999999999999,"15min":1.077},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.177,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.995,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.98199999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.67600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1208320,"data_stored":845890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.751,"15min":0.80900000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68200000000000005,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.89300000000000002,"15min":0.95899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70699999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.93000000000000005,"15min":0.999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.028,"15min":1.1100000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82199999999999995,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.92800000000000005,"15min":1.0109999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57399999999999995,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.316},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.78100000000000003,"15min":0.82599999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":3.254,"15min":3.254},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95099999999999996,"15min":0.98599999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.0900000000000001,"15min":1.151},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.98499999999999999,"15min":1.036},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97499999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97899999999999998,"15min":1.0249999999999999},"min":{"1min":0.54700000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.171,"15min":1.2450000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94399999999999995,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":1.181,"15min":1.2490000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95899999999999996,"5min":4.444,"15min":4.444},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0109999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:27:18.739 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:27:18.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.916+0000 7f7807c9c640 1 Processor -- start 2023-12-16T03:27:18.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.916+0000 7f7807c9c640 1 -- start start 2023-12-16T03:27:18.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.916+0000 7f7807c9c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f78000bffc0 0x7f780015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.916+0000 7f7807c9c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780015c600 con 0x7f780006d520 2023-12-16T03:27:18.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.916+0000 7f7807c9c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780015a5c0 con 0x7f78001560e0 2023-12-16T03:27:18.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.916+0000 7f7807c9c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78001594e0 con 0x7f78000bffc0 2023-12-16T03:27:18.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.916+0000 7f7805237640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f780006d520 0x7f78000c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41034/0 (socket says 172.21.15.28:41034) 2023-12-16T03:27:18.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.916+0000 7f7805237640 1 -- 172.21.15.28:0/3295568368 learned_addr learned my addr 172.21.15.28:0/3295568368 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:18.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.916+0000 7f7806239640 1 --2- 172.21.15.28:0/3295568368 >> v2:172.21.15.28:3300/0 conn(0x7f78000bffc0 0x7f780015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.916+0000 7f7804a36640 1 -- 172.21.15.28:0/3295568368 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325717042 0 0) 0x7f780015c600 con 0x7f780006d520 2023-12-16T03:27:18.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7804a36640 1 -- 172.21.15.28:0/3295568368 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77ec003530 con 0x7f780006d520 2023-12-16T03:27:18.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7806239640 1 -- 172.21.15.28:0/3295568368 >> v1:172.21.15.134:6789/0 conn(0x7f78001560e0 legacy=0x7f7800159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7804a36640 1 -- 172.21.15.28:0/3295568368 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841378168 0 0) 0x7f780015a5c0 con 0x7f78001560e0 2023-12-16T03:27:18.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7806239640 1 -- 172.21.15.28:0/3295568368 >> v1:172.21.15.28:6789/0 conn(0x7f780006d520 legacy=0x7f78000c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7806239640 1 -- 172.21.15.28:0/3295568368 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78001597c0 con 0x7f78000bffc0 2023-12-16T03:27:18.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7806239640 1 --2- 172.21.15.28:0/3295568368 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78000bffc0 0x7f780015ca90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009d90 tx=0x7f77f801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32c4c5bf5e3eb92 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:18.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7804a36640 1 -- 172.21.15.28:0/3295568368 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f80a59e0 con 0x7f78000bffc0 2023-12-16T03:27:18.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7804a36640 1 -- 172.21.15.28:0/3295568368 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f80a5b40 con 0x7f78000bffc0 2023-12-16T03:27:18.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7804a36640 1 -- 172.21.15.28:0/3295568368 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f80ad440 con 0x7f78000bffc0 2023-12-16T03:27:18.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7807c9c640 1 -- 172.21.15.28:0/3295568368 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78000bffc0 msgr2=0x7f780015ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7807c9c640 1 --2- 172.21.15.28:0/3295568368 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78000bffc0 0x7f780015ca90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009d90 tx=0x7f77f801c920 comp rx=0 tx=0).stop 2023-12-16T03:27:18.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7807c9c640 1 -- 172.21.15.28:0/3295568368 shutdown_connections 2023-12-16T03:27:18.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7807c9c640 1 --2- 172.21.15.28:0/3295568368 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78000bffc0 0x7f780015ca90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.920+0000 7f7807c9c640 1 -- 172.21.15.28:0/3295568368 >> 172.21.15.28:0/3295568368 conn(0x7f780006a5b0 msgr2=0x7f780006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:18.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7807c9c640 1 -- 172.21.15.28:0/3295568368 shutdown_connections 2023-12-16T03:27:18.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7807c9c640 1 -- 172.21.15.28:0/3295568368 wait complete. 2023-12-16T03:27:18.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7807c9c640 1 Processor -- start 2023-12-16T03:27:18.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7807c9c640 1 -- start start 2023-12-16T03:27:18.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7807c9c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f780006d520 0x7f78000c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7807c9c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78000bffc0 0x7f7800156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7807c9c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78001560e0 0x7f7800157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7807c9c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78000c4c70 con 0x7f78001560e0 2023-12-16T03:27:18.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7807c9c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780015bb20 con 0x7f780006d520 2023-12-16T03:27:18.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7807c9c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7800150ca0 con 0x7f78000bffc0 2023-12-16T03:27:18.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7806239640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78001560e0 0x7f7800157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7806239640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78001560e0 0x7f7800157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58770/0 (socket says 172.21.15.28:58770) 2023-12-16T03:27:18.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7806239640 1 -- 172.21.15.28:0/395824182 learned_addr learned my addr 172.21.15.28:0/395824182 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:18.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7805a38640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f780006d520 0x7f78000c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7805237640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78000bffc0 0x7f7800156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7806239640 1 -- 172.21.15.28:0/395824182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78000bffc0 msgr2=0x7f7800156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7806239640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78000bffc0 0x7f7800156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7806239640 1 -- 172.21.15.28:0/395824182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f780006d520 msgr2=0x7f78000c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:18.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7806239640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f780006d520 0x7f78000c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:18.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7806239640 1 -- 172.21.15.28:0/395824182 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8009a70 con 0x7f78001560e0 2023-12-16T03:27:18.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.924+0000 7f7806239640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78001560e0 0x7f7800157130 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f77f80b0040 tx=0x7f77f80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:18.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.928+0000 7f77f67fc640 1 -- 172.21.15.28:0/395824182 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f80add30 con 0x7f78001560e0 2023-12-16T03:27:18.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.928+0000 7f77f67fc640 1 -- 172.21.15.28:0/395824182 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f80ade90 con 0x7f78001560e0 2023-12-16T03:27:18.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.928+0000 7f77f67fc640 1 -- 172.21.15.28:0/395824182 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8003be0 con 0x7f78001560e0 2023-12-16T03:27:18.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.928+0000 7f7807c9c640 1 -- 172.21.15.28:0/395824182 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78000c4560 con 0x7f78001560e0 2023-12-16T03:27:18.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.928+0000 7f7807c9c640 1 -- 172.21.15.28:0/395824182 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7800150f40 con 0x7f78001560e0 2023-12-16T03:27:18.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.928+0000 7f7807c9c640 1 -- 172.21.15.28:0/395824182 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7800150b00 con 0x7f78001560e0 2023-12-16T03:27:18.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.928+0000 7f77f67fc640 1 -- 172.21.15.28:0/395824182 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f77f80b4050 con 0x7f78001560e0 2023-12-16T03:27:18.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.928+0000 7f77f67fc640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f77e4066470 0x7f77e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:18.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.928+0000 7f77f67fc640 1 -- 172.21.15.28:0/395824182 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f77f811f450 con 0x7f78001560e0 2023-12-16T03:27:18.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.928+0000 7f7805a38640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f77e4066470 0x7f77e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:18.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.928+0000 7f7805a38640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f77e4066470 0x7f77e4068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f77fc000f70 tx=0x7f77fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:18.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:18.932+0000 7f77f67fc640 1 -- 172.21.15.28:0/395824182 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7800150b00 con 0x7f78001560e0 2023-12-16T03:27:19.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.088+0000 7f7807c9c640 1 -- 172.21.15.28:0/395824182 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f780006cf40 con 0x7f77e4066470 2023-12-16T03:27:19.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.100+0000 7f77f67fc640 1 -- 172.21.15.28:0/395824182 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+516198 (secure 0 0 0) 0x7f77fc001d00 con 0x7f77e4066470 2023-12-16T03:27:19.108 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:19.112 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:27:19.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 -- 172.21.15.28:0/395824182 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f77e4066470 msgr2=0x7f77e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f77e4066470 0x7f77e4068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f77fc000f70 tx=0x7f77fc009040 comp rx=0 tx=0).stop 2023-12-16T03:27:19.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 -- 172.21.15.28:0/395824182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78001560e0 msgr2=0x7f7800157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78001560e0 0x7f7800157130 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f77f80b0040 tx=0x7f77f80196c0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 -- 172.21.15.28:0/395824182 shutdown_connections 2023-12-16T03:27:19.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f77e4066470 0x7f77e4068930 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78001560e0 0x7f7800157130 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78000bffc0 0x7f7800156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 --2- 172.21.15.28:0/395824182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f780006d520 0x7f78000c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 -- 172.21.15.28:0/395824182 >> 172.21.15.28:0/395824182 conn(0x7f780006a5b0 msgr2=0x7f7800071470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:19.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 -- 172.21.15.28:0/395824182 shutdown_connections 2023-12-16T03:27:19.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.104+0000 7f7807c9c640 1 -- 172.21.15.28:0/395824182 wait complete. 2023-12-16T03:27:19.127 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-12-16T03:27:17.822355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238736,"kb_used_data":5932,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735984,"statfs":{"total":773094113280,"available":772849647616,"internally_reserved":0,"allocated":6074368,"data_stored":3223223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1495,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.256218"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829460+0000","last_change":"2023-12-16T03:27:01.537420+0000","last_active":"2023-12-16T03:27:02.829460+0000","last_peered":"2023-12-16T03:27:02.829460+0000","last_clean":"2023-12-16T03:27:02.829460+0000","last_became_active":"2023-12-16T03:27:01.537176+0000","last_became_peered":"2023-12-16T03:27:01.537176+0000","last_unstale":"2023-12-16T03:27:02.829460+0000","last_undegraded":"2023-12-16T03:27:02.829460+0000","last_fullsized":"2023-12-16T03:27:02.829460+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:23:26.860864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830469+0000","last_change":"2023-12-16T03:27:01.534498+0000","last_active":"2023-12-16T03:27:02.830469+0000","last_peered":"2023-12-16T03:27:02.830469+0000","last_clean":"2023-12-16T03:27:02.830469+0000","last_became_active":"2023-12-16T03:27:01.533730+0000","last_became_peered":"2023-12-16T03:27:01.533730+0000","last_unstale":"2023-12-16T03:27:02.830469+0000","last_undegraded":"2023-12-16T03:27:02.830469+0000","last_fullsized":"2023-12-16T03:27:02.830469+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:07.937228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053229+0000","last_change":"2023-12-16T03:27:01.518121+0000","last_active":"2023-12-16T03:27:03.053229+0000","last_peered":"2023-12-16T03:27:03.053229+0000","last_clean":"2023-12-16T03:27:03.053229+0000","last_became_active":"2023-12-16T03:27:01.517826+0000","last_became_peered":"2023-12-16T03:27:01.517826+0000","last_unstale":"2023-12-16T03:27:03.053229+0000","last_undegraded":"2023-12-16T03:27:03.053229+0000","last_fullsized":"2023-12-16T03:27:03.053229+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:46.909657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828744+0000","last_change":"2023-12-16T03:27:01.531096+0000","last_active":"2023-12-16T03:27:02.828744+0000","last_peered":"2023-12-16T03:27:02.828744+0000","last_clean":"2023-12-16T03:27:02.828744+0000","last_became_active":"2023-12-16T03:27:01.530793+0000","last_became_peered":"2023-12-16T03:27:01.530793+0000","last_unstale":"2023-12-16T03:27:02.828744+0000","last_undegraded":"2023-12-16T03:27:02.828744+0000","last_fullsized":"2023-12-16T03:27:02.828744+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:59.366673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829423+0000","last_change":"2023-12-16T03:27:01.531904+0000","last_active":"2023-12-16T03:27:02.829423+0000","last_peered":"2023-12-16T03:27:02.829423+0000","last_clean":"2023-12-16T03:27:02.829423+0000","last_became_active":"2023-12-16T03:27:01.531705+0000","last_became_peered":"2023-12-16T03:27:01.531705+0000","last_unstale":"2023-12-16T03:27:02.829423+0000","last_undegraded":"2023-12-16T03:27:02.829423+0000","last_fullsized":"2023-12-16T03:27:02.829423+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:24:38.684552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052563+0000","last_change":"2023-12-16T03:27:01.537597+0000","last_active":"2023-12-16T03:27:03.052563+0000","last_peered":"2023-12-16T03:27:03.052563+0000","last_clean":"2023-12-16T03:27:03.052563+0000","last_became_active":"2023-12-16T03:27:01.537262+0000","last_became_peered":"2023-12-16T03:27:01.537262+0000","last_unstale":"2023-12-16T03:27:03.052563+0000","last_undegraded":"2023-12-16T03:27:03.052563+0000","last_fullsized":"2023-12-16T03:27:03.052563+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828516+0000","last_change":"2023-12-16T03:27:01.504710+0000","last_active":"2023-12-16T03:27:02.828516+0000","last_peered":"2023-12-16T03:27:02.828516+0000","last_clean":"2023-12-16T03:27:02.828516+0000","last_became_active":"2023-12-16T03:27:01.504412+0000","last_became_peered":"2023-12-16T03:27:01.504412+0000","last_unstale":"2023-12-16T03:27:02.828516+0000","last_undegraded":"2023-12-16T03:27:02.828516+0000","last_fullsized":"2023-12-16T03:27:02.828516+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:09.298222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830343+0000","last_change":"2023-12-16T03:27:01.514585+0000","last_active":"2023-12-16T03:27:02.830343+0000","last_peered":"2023-12-16T03:27:02.830343+0000","last_clean":"2023-12-16T03:27:02.830343+0000","last_became_active":"2023-12-16T03:27:01.514304+0000","last_became_peered":"2023-12-16T03:27:01.514304+0000","last_unstale":"2023-12-16T03:27:02.830343+0000","last_undegraded":"2023-12-16T03:27:02.830343+0000","last_fullsized":"2023-12-16T03:27:02.830343+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:44:59.949884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828650+0000","last_change":"2023-12-16T03:27:01.517287+0000","last_active":"2023-12-16T03:27:02.828650+0000","last_peered":"2023-12-16T03:27:02.828650+0000","last_clean":"2023-12-16T03:27:02.828650+0000","last_became_active":"2023-12-16T03:27:01.516865+0000","last_became_peered":"2023-12-16T03:27:01.516865+0000","last_unstale":"2023-12-16T03:27:02.828650+0000","last_undegraded":"2023-12-16T03:27:02.828650+0000","last_fullsized":"2023-12-16T03:27:02.828650+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:49.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053568+0000","last_change":"2023-12-16T03:27:01.523610+0000","last_active":"2023-12-16T03:27:03.053568+0000","last_peered":"2023-12-16T03:27:03.053568+0000","last_clean":"2023-12-16T03:27:03.053568+0000","last_became_active":"2023-12-16T03:27:01.523269+0000","last_became_peered":"2023-12-16T03:27:01.523269+0000","last_unstale":"2023-12-16T03:27:03.053568+0000","last_undegraded":"2023-12-16T03:27:03.053568+0000","last_fullsized":"2023-12-16T03:27:03.053568+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:43.020903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053472+0000","last_change":"2023-12-16T03:27:01.534387+0000","last_active":"2023-12-16T03:27:03.053472+0000","last_peered":"2023-12-16T03:27:03.053472+0000","last_clean":"2023-12-16T03:27:03.053472+0000","last_became_active":"2023-12-16T03:27:01.534102+0000","last_became_peered":"2023-12-16T03:27:01.534102+0000","last_unstale":"2023-12-16T03:27:03.053472+0000","last_undegraded":"2023-12-16T03:27:03.053472+0000","last_fullsized":"2023-12-16T03:27:03.053472+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:48:59.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828760+0000","last_change":"2023-12-16T03:27:01.514907+0000","last_active":"2023-12-16T03:27:02.828760+0000","last_peered":"2023-12-16T03:27:02.828760+0000","last_clean":"2023-12-16T03:27:02.828760+0000","last_became_active":"2023-12-16T03:27:01.514396+0000","last_became_peered":"2023-12-16T03:27:01.514396+0000","last_unstale":"2023-12-16T03:27:02.828760+0000","last_undegraded":"2023-12-16T03:27:02.828760+0000","last_fullsized":"2023-12-16T03:27:02.828760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052844+0000","last_change":"2023-12-16T03:27:01.533053+0000","last_active":"2023-12-16T03:27:03.052844+0000","last_peered":"2023-12-16T03:27:03.052844+0000","last_clean":"2023-12-16T03:27:03.052844+0000","last_became_active":"2023-12-16T03:27:01.532852+0000","last_became_peered":"2023-12-16T03:27:01.532852+0000","last_unstale":"2023-12-16T03:27:03.052844+0000","last_undegraded":"2023-12-16T03:27:03.052844+0000","last_fullsized":"2023-12-16T03:27:03.052844+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:05.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828556+0000","last_change":"2023-12-16T03:27:01.527464+0000","last_active":"2023-12-16T03:27:02.828556+0000","last_peered":"2023-12-16T03:27:02.828556+0000","last_clean":"2023-12-16T03:27:02.828556+0000","last_became_active":"2023-12-16T03:27:01.526439+0000","last_became_peered":"2023-12-16T03:27:01.526439+0000","last_unstale":"2023-12-16T03:27:02.828556+0000","last_undegraded":"2023-12-16T03:27:02.828556+0000","last_fullsized":"2023-12-16T03:27:02.828556+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:55.347747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828538+0000","last_change":"2023-12-16T03:27:01.523106+0000","last_active":"2023-12-16T03:27:02.828538+0000","last_peered":"2023-12-16T03:27:02.828538+0000","last_clean":"2023-12-16T03:27:02.828538+0000","last_became_active":"2023-12-16T03:27:01.522824+0000","last_became_peered":"2023-12-16T03:27:01.522824+0000","last_unstale":"2023-12-16T03:27:02.828538+0000","last_undegraded":"2023-12-16T03:27:02.828538+0000","last_fullsized":"2023-12-16T03:27:02.828538+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:04.563786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052553+0000","last_change":"2023-12-16T03:27:01.513664+0000","last_active":"2023-12-16T03:27:03.052553+0000","last_peered":"2023-12-16T03:27:03.052553+0000","last_clean":"2023-12-16T03:27:03.052553+0000","last_became_active":"2023-12-16T03:27:01.513325+0000","last_became_peered":"2023-12-16T03:27:01.513325+0000","last_unstale":"2023-12-16T03:27:03.052553+0000","last_undegraded":"2023-12-16T03:27:03.052553+0000","last_fullsized":"2023-12-16T03:27:03.052553+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830495+0000","last_change":"2023-12-16T03:27:01.526203+0000","last_active":"2023-12-16T03:27:02.830495+0000","last_peered":"2023-12-16T03:27:02.830495+0000","last_clean":"2023-12-16T03:27:02.830495+0000","last_became_active":"2023-12-16T03:27:01.525873+0000","last_became_peered":"2023-12-16T03:27:01.525873+0000","last_unstale":"2023-12-16T03:27:02.830495+0000","last_undegraded":"2023-12-16T03:27:02.830495+0000","last_fullsized":"2023-12-16T03:27:02.830495+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:37:50.321166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053467+0000","last_change":"2023-12-16T03:27:01.529407+0000","last_active":"2023-12-16T03:27:03.053467+0000","last_peered":"2023-12-16T03:27:03.053467+0000","last_clean":"2023-12-16T03:27:03.053467+0000","last_became_active":"2023-12-16T03:27:01.529024+0000","last_became_peered":"2023-12-16T03:27:01.529024+0000","last_unstale":"2023-12-16T03:27:03.053467+0000","last_undegraded":"2023-12-16T03:27:03.053467+0000","last_fullsized":"2023-12-16T03:27:03.053467+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829448+0000","last_change":"2023-12-16T03:27:01.538362+0000","last_active":"2023-12-16T03:27:02.829448+0000","last_peered":"2023-12-16T03:27:02.829448+0000","last_clean":"2023-12-16T03:27:02.829448+0000","last_became_active":"2023-12-16T03:27:01.538024+0000","last_became_peered":"2023-12-16T03:27:01.538024+0000","last_unstale":"2023-12-16T03:27:02.829448+0000","last_undegraded":"2023-12-16T03:27:02.829448+0000","last_fullsized":"2023-12-16T03:27:02.829448+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:44.941057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830452+0000","last_change":"2023-12-16T03:27:01.535927+0000","last_active":"2023-12-16T03:27:02.830452+0000","last_peered":"2023-12-16T03:27:02.830452+0000","last_clean":"2023-12-16T03:27:02.830452+0000","last_became_active":"2023-12-16T03:27:01.535618+0000","last_became_peered":"2023-12-16T03:27:01.535618+0000","last_unstale":"2023-12-16T03:27:02.830452+0000","last_undegraded":"2023-12-16T03:27:02.830452+0000","last_fullsized":"2023-12-16T03:27:02.830452+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:46.786632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053065+0000","last_change":"2023-12-16T03:27:01.520051+0000","last_active":"2023-12-16T03:27:03.053065+0000","last_peered":"2023-12-16T03:27:03.053065+0000","last_clean":"2023-12-16T03:27:03.053065+0000","last_became_active":"2023-12-16T03:27:01.519803+0000","last_became_peered":"2023-12-16T03:27:01.519803+0000","last_unstale":"2023-12-16T03:27:03.053065+0000","last_undegraded":"2023-12-16T03:27:03.053065+0000","last_fullsized":"2023-12-16T03:27:03.053065+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830392+0000","last_change":"2023-12-16T03:27:01.523786+0000","last_active":"2023-12-16T03:27:02.830392+0000","last_peered":"2023-12-16T03:27:02.830392+0000","last_clean":"2023-12-16T03:27:02.830392+0000","last_became_active":"2023-12-16T03:27:01.523435+0000","last_became_peered":"2023-12-16T03:27:01.523435+0000","last_unstale":"2023-12-16T03:27:02.830392+0000","last_undegraded":"2023-12-16T03:27:02.830392+0000","last_fullsized":"2023-12-16T03:27:02.830392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:59:37.033807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052538+0000","last_change":"2023-12-16T03:27:01.539536+0000","last_active":"2023-12-16T03:27:03.052538+0000","last_peered":"2023-12-16T03:27:03.052538+0000","last_clean":"2023-12-16T03:27:03.052538+0000","last_became_active":"2023-12-16T03:27:01.539210+0000","last_became_peered":"2023-12-16T03:27:01.539210+0000","last_unstale":"2023-12-16T03:27:03.052538+0000","last_undegraded":"2023-12-16T03:27:03.052538+0000","last_fullsized":"2023-12-16T03:27:03.052538+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052446+0000","last_change":"2023-12-16T03:27:01.521374+0000","last_active":"2023-12-16T03:27:03.052446+0000","last_peered":"2023-12-16T03:27:03.052446+0000","last_clean":"2023-12-16T03:27:03.052446+0000","last_became_active":"2023-12-16T03:27:01.521080+0000","last_became_peered":"2023-12-16T03:27:01.521080+0000","last_unstale":"2023-12-16T03:27:03.052446+0000","last_undegraded":"2023-12-16T03:27:03.052446+0000","last_fullsized":"2023-12-16T03:27:03.052446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:47.409565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829472+0000","last_change":"2023-12-16T03:27:01.537212+0000","last_active":"2023-12-16T03:27:02.829472+0000","last_peered":"2023-12-16T03:27:02.829472+0000","last_clean":"2023-12-16T03:27:02.829472+0000","last_became_active":"2023-12-16T03:27:01.536927+0000","last_became_peered":"2023-12-16T03:27:01.536927+0000","last_unstale":"2023-12-16T03:27:02.829472+0000","last_undegraded":"2023-12-16T03:27:02.829472+0000","last_fullsized":"2023-12-16T03:27:02.829472+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:59.764629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828835+0000","last_change":"2023-12-16T03:27:01.506167+0000","last_active":"2023-12-16T03:27:02.828835+0000","last_peered":"2023-12-16T03:27:02.828835+0000","last_clean":"2023-12-16T03:27:02.828835+0000","last_became_active":"2023-12-16T03:27:01.505856+0000","last_became_peered":"2023-12-16T03:27:01.505856+0000","last_unstale":"2023-12-16T03:27:02.828835+0000","last_undegraded":"2023-12-16T03:27:02.828835+0000","last_fullsized":"2023-12-16T03:27:02.828835+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052711+0000","last_change":"2023-12-16T03:27:01.514340+0000","last_active":"2023-12-16T03:27:03.052711+0000","last_peered":"2023-12-16T03:27:03.052711+0000","last_clean":"2023-12-16T03:27:03.052711+0000","last_became_active":"2023-12-16T03:27:01.514047+0000","last_became_peered":"2023-12-16T03:27:01.514047+0000","last_unstale":"2023-12-16T03:27:03.052711+0000","last_undegraded":"2023-12-16T03:27:03.052711+0000","last_fullsized":"2023-12-16T03:27:03.052711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829435+0000","last_change":"2023-12-16T03:27:01.531612+0000","last_active":"2023-12-16T03:27:02.829435+0000","last_peered":"2023-12-16T03:27:02.829435+0000","last_clean":"2023-12-16T03:27:02.829435+0000","last_became_active":"2023-12-16T03:27:01.531274+0000","last_became_peered":"2023-12-16T03:27:01.531274+0000","last_unstale":"2023-12-16T03:27:02.829435+0000","last_undegraded":"2023-12-16T03:27:02.829435+0000","last_fullsized":"2023-12-16T03:27:02.829435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:58.878396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830436+0000","last_change":"2023-12-16T03:27:01.527562+0000","last_active":"2023-12-16T03:27:02.830436+0000","last_peered":"2023-12-16T03:27:02.830436+0000","last_clean":"2023-12-16T03:27:02.830436+0000","last_became_active":"2023-12-16T03:27:01.525171+0000","last_became_peered":"2023-12-16T03:27:01.525171+0000","last_unstale":"2023-12-16T03:27:02.830436+0000","last_undegraded":"2023-12-16T03:27:02.830436+0000","last_fullsized":"2023-12-16T03:27:02.830436+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:02:55.385594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053042+0000","last_change":"2023-12-16T03:27:01.518371+0000","last_active":"2023-12-16T03:27:03.053042+0000","last_peered":"2023-12-16T03:27:03.053042+0000","last_clean":"2023-12-16T03:27:03.053042+0000","last_became_active":"2023-12-16T03:27:01.518088+0000","last_became_peered":"2023-12-16T03:27:01.518088+0000","last_unstale":"2023-12-16T03:27:03.053042+0000","last_undegraded":"2023-12-16T03:27:03.053042+0000","last_fullsized":"2023-12-16T03:27:03.053042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829405+0000","last_change":"2023-12-16T03:27:01.532530+0000","last_active":"2023-12-16T03:27:02.829405+0000","last_peered":"2023-12-16T03:27:02.829405+0000","last_clean":"2023-12-16T03:27:02.829405+0000","last_became_active":"2023-12-16T03:27:01.532228+0000","last_became_peered":"2023-12-16T03:27:01.532228+0000","last_unstale":"2023-12-16T03:27:02.829405+0000","last_undegraded":"2023-12-16T03:27:02.829405+0000","last_fullsized":"2023-12-16T03:27:02.829405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.578189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052711+0000","last_change":"2023-12-16T03:27:01.526590+0000","last_active":"2023-12-16T03:27:03.052711+0000","last_peered":"2023-12-16T03:27:03.052711+0000","last_clean":"2023-12-16T03:27:03.052711+0000","last_became_active":"2023-12-16T03:27:01.525400+0000","last_became_peered":"2023-12-16T03:27:01.525400+0000","last_unstale":"2023-12-16T03:27:03.052711+0000","last_undegraded":"2023-12-16T03:27:03.052711+0000","last_fullsized":"2023-12-16T03:27:03.052711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:46.909657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568670+0000","last_change":"2023-12-16T03:27:12.568670+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568670+0000","last_undegraded":"2023-12-16T03:27:12.568670+0000","last_fullsized":"2023-12-16T03:27:12.568670+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053156+0000","last_change":"2023-12-16T03:27:01.519301+0000","last_active":"2023-12-16T03:27:03.053156+0000","last_peered":"2023-12-16T03:27:03.053156+0000","last_clean":"2023-12-16T03:27:03.053156+0000","last_became_active":"2023-12-16T03:27:01.519011+0000","last_became_peered":"2023-12-16T03:27:01.519011+0000","last_unstale":"2023-12-16T03:27:03.053156+0000","last_undegraded":"2023-12-16T03:27:03.053156+0000","last_fullsized":"2023-12-16T03:27:03.053156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:34.578819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053311+0000","last_change":"2023-12-16T03:27:00.515238+0000","last_active":"2023-12-16T03:27:03.053311+0000","last_peered":"2023-12-16T03:27:03.053311+0000","last_clean":"2023-12-16T03:27:03.053311+0000","last_became_active":"2023-12-16T03:27:00.514968+0000","last_became_peered":"2023-12-16T03:27:00.514968+0000","last_unstale":"2023-12-16T03:27:03.053311+0000","last_undegraded":"2023-12-16T03:27:03.053311+0000","last_fullsized":"2023-12-16T03:27:03.053311+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574048+0000","last_change":"2023-12-16T03:27:12.574048+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574048+0000","last_undegraded":"2023-12-16T03:27:12.574048+0000","last_fullsized":"2023-12-16T03:27:12.574048+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053623+0000","last_change":"2023-12-16T03:27:01.522872+0000","last_active":"2023-12-16T03:27:03.053623+0000","last_peered":"2023-12-16T03:27:03.053623+0000","last_clean":"2023-12-16T03:27:03.053623+0000","last_became_active":"2023-12-16T03:27:01.522260+0000","last_became_peered":"2023-12-16T03:27:01.522260+0000","last_unstale":"2023-12-16T03:27:03.053623+0000","last_undegraded":"2023-12-16T03:27:03.053623+0000","last_fullsized":"2023-12-16T03:27:03.053623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:50.778695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830478+0000","last_change":"2023-12-16T03:27:00.521097+0000","last_active":"2023-12-16T03:27:02.830478+0000","last_peered":"2023-12-16T03:27:02.830478+0000","last_clean":"2023-12-16T03:27:02.830478+0000","last_became_active":"2023-12-16T03:27:00.520800+0000","last_became_peered":"2023-12-16T03:27:00.520800+0000","last_unstale":"2023-12-16T03:27:02.830478+0000","last_undegraded":"2023-12-16T03:27:02.830478+0000","last_fullsized":"2023-12-16T03:27:02.830478+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:38:52.347850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574268+0000","last_change":"2023-12-16T03:27:12.574268+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574268+0000","last_undegraded":"2023-12-16T03:27:12.574268+0000","last_fullsized":"2023-12-16T03:27:12.574268+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052934+0000","last_change":"2023-12-16T03:27:01.528475+0000","last_active":"2023-12-16T03:27:03.052934+0000","last_peered":"2023-12-16T03:27:03.052934+0000","last_clean":"2023-12-16T03:27:03.052934+0000","last_became_active":"2023-12-16T03:27:01.527985+0000","last_became_peered":"2023-12-16T03:27:01.527985+0000","last_unstale":"2023-12-16T03:27:03.052934+0000","last_undegraded":"2023-12-16T03:27:03.052934+0000","last_fullsized":"2023-12-16T03:27:03.052934+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:33.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053087+0000","last_change":"2023-12-16T03:27:00.516992+0000","last_active":"2023-12-16T03:27:03.053087+0000","last_peered":"2023-12-16T03:27:03.053087+0000","last_clean":"2023-12-16T03:27:03.053087+0000","last_became_active":"2023-12-16T03:27:00.515339+0000","last_became_peered":"2023-12-16T03:27:00.515339+0000","last_unstale":"2023-12-16T03:27:03.053087+0000","last_undegraded":"2023-12-16T03:27:03.053087+0000","last_fullsized":"2023-12-16T03:27:03.053087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:58.358317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573237+0000","last_change":"2023-12-16T03:27:12.573237+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573237+0000","last_undegraded":"2023-12-16T03:27:12.573237+0000","last_fullsized":"2023-12-16T03:27:12.573237+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052856+0000","last_change":"2023-12-16T03:27:01.522006+0000","last_active":"2023-12-16T03:27:03.052856+0000","last_peered":"2023-12-16T03:27:03.052856+0000","last_clean":"2023-12-16T03:27:03.052856+0000","last_became_active":"2023-12-16T03:27:01.520949+0000","last_became_peered":"2023-12-16T03:27:01.520949+0000","last_unstale":"2023-12-16T03:27:03.052856+0000","last_undegraded":"2023-12-16T03:27:03.052856+0000","last_fullsized":"2023-12-16T03:27:03.052856+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:29.951188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828778+0000","last_change":"2023-12-16T03:27:00.515665+0000","last_active":"2023-12-16T03:27:02.828778+0000","last_peered":"2023-12-16T03:27:02.828778+0000","last_clean":"2023-12-16T03:27:02.828778+0000","last_became_active":"2023-12-16T03:27:00.514766+0000","last_became_peered":"2023-12-16T03:27:00.514766+0000","last_unstale":"2023-12-16T03:27:02.828778+0000","last_undegraded":"2023-12-16T03:27:02.828778+0000","last_fullsized":"2023-12-16T03:27:02.828778+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:54.339391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574727+0000","last_change":"2023-12-16T03:27:12.574727+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574727+0000","last_undegraded":"2023-12-16T03:27:12.574727+0000","last_fullsized":"2023-12-16T03:27:12.574727+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830400+0000","last_change":"2023-12-16T03:27:01.523755+0000","last_active":"2023-12-16T03:27:02.830400+0000","last_peered":"2023-12-16T03:27:02.830400+0000","last_clean":"2023-12-16T03:27:02.830400+0000","last_became_active":"2023-12-16T03:27:01.523179+0000","last_became_peered":"2023-12-16T03:27:01.523179+0000","last_unstale":"2023-12-16T03:27:02.830400+0000","last_undegraded":"2023-12-16T03:27:02.830400+0000","last_fullsized":"2023-12-16T03:27:02.830400+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:20:11.416554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828595+0000","last_change":"2023-12-16T03:27:00.512400+0000","last_active":"2023-12-16T03:27:02.828595+0000","last_peered":"2023-12-16T03:27:02.828595+0000","last_clean":"2023-12-16T03:27:02.828595+0000","last_became_active":"2023-12-16T03:27:00.512120+0000","last_became_peered":"2023-12-16T03:27:00.512120+0000","last_unstale":"2023-12-16T03:27:02.828595+0000","last_undegraded":"2023-12-16T03:27:02.828595+0000","last_fullsized":"2023-12-16T03:27:02.828595+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:32:09.899662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570554+0000","last_change":"2023-12-16T03:27:12.570554+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570554+0000","last_undegraded":"2023-12-16T03:27:12.570554+0000","last_fullsized":"2023-12-16T03:27:12.570554+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830417+0000","last_change":"2023-12-16T03:27:01.536014+0000","last_active":"2023-12-16T03:27:02.830417+0000","last_peered":"2023-12-16T03:27:02.830417+0000","last_clean":"2023-12-16T03:27:02.830417+0000","last_became_active":"2023-12-16T03:27:01.535729+0000","last_became_peered":"2023-12-16T03:27:01.535729+0000","last_unstale":"2023-12-16T03:27:02.830417+0000","last_undegraded":"2023-12-16T03:27:02.830417+0000","last_fullsized":"2023-12-16T03:27:02.830417+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:22:11.774067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052634+0000","last_change":"2023-12-16T03:27:00.513060+0000","last_active":"2023-12-16T03:27:03.052634+0000","last_peered":"2023-12-16T03:27:03.052634+0000","last_clean":"2023-12-16T03:27:03.052634+0000","last_became_active":"2023-12-16T03:27:00.512780+0000","last_became_peered":"2023-12-16T03:27:00.512780+0000","last_unstale":"2023-12-16T03:27:03.052634+0000","last_undegraded":"2023-12-16T03:27:03.052634+0000","last_fullsized":"2023-12-16T03:27:03.052634+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:03.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573037+0000","last_change":"2023-12-16T03:27:12.573037+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573037+0000","last_undegraded":"2023-12-16T03:27:12.573037+0000","last_fullsized":"2023-12-16T03:27:12.573037+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052594+0000","last_change":"2023-12-16T03:27:01.520984+0000","last_active":"2023-12-16T03:27:03.052594+0000","last_peered":"2023-12-16T03:27:03.052594+0000","last_clean":"2023-12-16T03:27:03.052594+0000","last_became_active":"2023-12-16T03:27:01.520045+0000","last_became_peered":"2023-12-16T03:27:01.520045+0000","last_unstale":"2023-12-16T03:27:03.052594+0000","last_undegraded":"2023-12-16T03:27:03.052594+0000","last_fullsized":"2023-12-16T03:27:03.052594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:37.842605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828664+0000","last_change":"2023-12-16T03:27:00.513568+0000","last_active":"2023-12-16T03:27:02.828664+0000","last_peered":"2023-12-16T03:27:02.828664+0000","last_clean":"2023-12-16T03:27:02.828664+0000","last_became_active":"2023-12-16T03:27:00.513294+0000","last_became_peered":"2023-12-16T03:27:00.513294+0000","last_unstale":"2023-12-16T03:27:02.828664+0000","last_undegraded":"2023-12-16T03:27:02.828664+0000","last_fullsized":"2023-12-16T03:27:02.828664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574576+0000","last_change":"2023-12-16T03:27:12.574576+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574576+0000","last_undegraded":"2023-12-16T03:27:12.574576+0000","last_fullsized":"2023-12-16T03:27:12.574576+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830375+0000","last_change":"2023-12-16T03:27:01.526843+0000","last_active":"2023-12-16T03:27:02.830375+0000","last_peered":"2023-12-16T03:27:02.830375+0000","last_clean":"2023-12-16T03:27:02.830375+0000","last_became_active":"2023-12-16T03:27:01.525795+0000","last_became_peered":"2023-12-16T03:27:01.525795+0000","last_unstale":"2023-12-16T03:27:02.830375+0000","last_undegraded":"2023-12-16T03:27:02.830375+0000","last_fullsized":"2023-12-16T03:27:02.830375+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:53.633088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828495+0000","last_change":"2023-12-16T03:27:00.520498+0000","last_active":"2023-12-16T03:27:02.828495+0000","last_peered":"2023-12-16T03:27:02.828495+0000","last_clean":"2023-12-16T03:27:02.828495+0000","last_became_active":"2023-12-16T03:27:00.520179+0000","last_became_peered":"2023-12-16T03:27:00.520179+0000","last_unstale":"2023-12-16T03:27:02.828495+0000","last_undegraded":"2023-12-16T03:27:02.828495+0000","last_fullsized":"2023-12-16T03:27:02.828495+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:36.834249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573562+0000","last_change":"2023-12-16T03:27:12.573562+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573562+0000","last_undegraded":"2023-12-16T03:27:12.573562+0000","last_fullsized":"2023-12-16T03:27:12.573562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828634+0000","last_change":"2023-12-16T03:27:01.525335+0000","last_active":"2023-12-16T03:27:02.828634+0000","last_peered":"2023-12-16T03:27:02.828634+0000","last_clean":"2023-12-16T03:27:02.828634+0000","last_became_active":"2023-12-16T03:27:01.524994+0000","last_became_peered":"2023-12-16T03:27:01.524994+0000","last_unstale":"2023-12-16T03:27:02.828634+0000","last_undegraded":"2023-12-16T03:27:02.828634+0000","last_fullsized":"2023-12-16T03:27:02.828634+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:08.574639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053413+0000","last_change":"2023-12-16T03:27:00.516706+0000","last_active":"2023-12-16T03:27:03.053413+0000","last_peered":"2023-12-16T03:27:03.053413+0000","last_clean":"2023-12-16T03:27:03.053413+0000","last_became_active":"2023-12-16T03:27:00.516403+0000","last_became_peered":"2023-12-16T03:27:00.516403+0000","last_unstale":"2023-12-16T03:27:03.053413+0000","last_undegraded":"2023-12-16T03:27:03.053413+0000","last_fullsized":"2023-12-16T03:27:03.053413+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:27.966699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574730+0000","last_change":"2023-12-16T03:27:12.574730+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574730+0000","last_undegraded":"2023-12-16T03:27:12.574730+0000","last_fullsized":"2023-12-16T03:27:12.574730+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053478+0000","last_change":"2023-12-16T03:27:01.526628+0000","last_active":"2023-12-16T03:27:03.053478+0000","last_peered":"2023-12-16T03:27:03.053478+0000","last_clean":"2023-12-16T03:27:03.053478+0000","last_became_active":"2023-12-16T03:27:01.526319+0000","last_became_peered":"2023-12-16T03:27:01.526319+0000","last_unstale":"2023-12-16T03:27:03.053478+0000","last_undegraded":"2023-12-16T03:27:03.053478+0000","last_fullsized":"2023-12-16T03:27:03.053478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:32.633580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830487+0000","last_change":"2023-12-16T03:27:00.524203+0000","last_active":"2023-12-16T03:27:02.830487+0000","last_peered":"2023-12-16T03:27:02.830487+0000","last_clean":"2023-12-16T03:27:02.830487+0000","last_became_active":"2023-12-16T03:27:00.523807+0000","last_became_peered":"2023-12-16T03:27:00.523807+0000","last_unstale":"2023-12-16T03:27:02.830487+0000","last_undegraded":"2023-12-16T03:27:02.830487+0000","last_fullsized":"2023-12-16T03:27:02.830487+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:07:50.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.569019+0000","last_change":"2023-12-16T03:27:12.569019+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.569019+0000","last_undegraded":"2023-12-16T03:27:12.569019+0000","last_fullsized":"2023-12-16T03:27:12.569019+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053160+0000","last_change":"2023-12-16T03:27:01.533076+0000","last_active":"2023-12-16T03:27:03.053160+0000","last_peered":"2023-12-16T03:27:03.053160+0000","last_clean":"2023-12-16T03:27:03.053160+0000","last_became_active":"2023-12-16T03:27:01.532721+0000","last_became_peered":"2023-12-16T03:27:01.532721+0000","last_unstale":"2023-12-16T03:27:03.053160+0000","last_undegraded":"2023-12-16T03:27:03.053160+0000","last_fullsized":"2023-12-16T03:27:03.053160+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:37.842605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053510+0000","last_change":"2023-12-16T03:27:00.521385+0000","last_active":"2023-12-16T03:27:03.053510+0000","last_peered":"2023-12-16T03:27:03.053510+0000","last_clean":"2023-12-16T03:27:03.053510+0000","last_became_active":"2023-12-16T03:27:00.521116+0000","last_became_peered":"2023-12-16T03:27:00.521116+0000","last_unstale":"2023-12-16T03:27:03.053510+0000","last_undegraded":"2023-12-16T03:27:03.053510+0000","last_fullsized":"2023-12-16T03:27:03.053510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573979+0000","last_change":"2023-12-16T03:27:12.573979+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573979+0000","last_undegraded":"2023-12-16T03:27:12.573979+0000","last_fullsized":"2023-12-16T03:27:12.573979+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053295+0000","last_change":"2023-12-16T03:27:01.522382+0000","last_active":"2023-12-16T03:27:03.053295+0000","last_peered":"2023-12-16T03:27:03.053295+0000","last_clean":"2023-12-16T03:27:03.053295+0000","last_became_active":"2023-12-16T03:27:01.522101+0000","last_became_peered":"2023-12-16T03:27:01.522101+0000","last_unstale":"2023-12-16T03:27:03.053295+0000","last_undegraded":"2023-12-16T03:27:03.053295+0000","last_fullsized":"2023-12-16T03:27:03.053295+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:29.951188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":21,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:09.416701+0000","last_change":"2023-12-16T03:27:00.514824+0000","last_active":"2023-12-16T03:27:09.416701+0000","last_peered":"2023-12-16T03:27:09.416701+0000","last_clean":"2023-12-16T03:27:09.416701+0000","last_became_active":"2023-12-16T03:27:00.514574+0000","last_became_peered":"2023-12-16T03:27:00.514574+0000","last_unstale":"2023-12-16T03:27:09.416701+0000","last_undegraded":"2023-12-16T03:27:09.416701+0000","last_fullsized":"2023-12-16T03:27:09.416701+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:49.770339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.569118+0000","last_change":"2023-12-16T03:27:12.569118+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.569118+0000","last_undegraded":"2023-12-16T03:27:12.569118+0000","last_fullsized":"2023-12-16T03:27:12.569118+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828701+0000","last_change":"2023-12-16T03:27:01.523308+0000","last_active":"2023-12-16T03:27:02.828701+0000","last_peered":"2023-12-16T03:27:02.828701+0000","last_clean":"2023-12-16T03:27:02.828701+0000","last_became_active":"2023-12-16T03:27:01.522582+0000","last_became_peered":"2023-12-16T03:27:01.522582+0000","last_unstale":"2023-12-16T03:27:02.828701+0000","last_undegraded":"2023-12-16T03:27:02.828701+0000","last_fullsized":"2023-12-16T03:27:02.828701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:44.457252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830426+0000","last_change":"2023-12-16T03:27:00.524023+0000","last_active":"2023-12-16T03:27:02.830426+0000","last_peered":"2023-12-16T03:27:02.830426+0000","last_clean":"2023-12-16T03:27:02.830426+0000","last_became_active":"2023-12-16T03:27:00.523742+0000","last_became_peered":"2023-12-16T03:27:00.523742+0000","last_unstale":"2023-12-16T03:27:02.830426+0000","last_undegraded":"2023-12-16T03:27:02.830426+0000","last_fullsized":"2023-12-16T03:27:02.830426+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:09:52.558814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568829+0000","last_change":"2023-12-16T03:27:12.568829+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568829+0000","last_undegraded":"2023-12-16T03:27:12.568829+0000","last_fullsized":"2023-12-16T03:27:12.568829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053099+0000","last_change":"2023-12-16T03:27:01.519766+0000","last_active":"2023-12-16T03:27:03.053099+0000","last_peered":"2023-12-16T03:27:03.053099+0000","last_clean":"2023-12-16T03:27:03.053099+0000","last_became_active":"2023-12-16T03:27:01.519473+0000","last_became_peered":"2023-12-16T03:27:01.519473+0000","last_unstale":"2023-12-16T03:27:03.053099+0000","last_undegraded":"2023-12-16T03:27:03.053099+0000","last_fullsized":"2023-12-16T03:27:03.053099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052412+0000","last_change":"2023-12-16T03:27:00.518062+0000","last_active":"2023-12-16T03:27:03.052412+0000","last_peered":"2023-12-16T03:27:03.052412+0000","last_clean":"2023-12-16T03:27:03.052412+0000","last_became_active":"2023-12-16T03:27:00.517664+0000","last_became_peered":"2023-12-16T03:27:00.517664+0000","last_unstale":"2023-12-16T03:27:03.052412+0000","last_undegraded":"2023-12-16T03:27:03.052412+0000","last_fullsized":"2023-12-16T03:27:03.052412+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:47:04.667881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574778+0000","last_change":"2023-12-16T03:27:12.574778+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574778+0000","last_undegraded":"2023-12-16T03:27:12.574778+0000","last_fullsized":"2023-12-16T03:27:12.574778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828470+0000","last_change":"2023-12-16T03:27:01.514600+0000","last_active":"2023-12-16T03:27:02.828470+0000","last_peered":"2023-12-16T03:27:02.828470+0000","last_clean":"2023-12-16T03:27:02.828470+0000","last_became_active":"2023-12-16T03:27:01.514262+0000","last_became_peered":"2023-12-16T03:27:01.514262+0000","last_unstale":"2023-12-16T03:27:02.828470+0000","last_undegraded":"2023-12-16T03:27:02.828470+0000","last_fullsized":"2023-12-16T03:27:02.828470+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:28.975055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828684+0000","last_change":"2023-12-16T03:27:00.514189+0000","last_active":"2023-12-16T03:27:02.828684+0000","last_peered":"2023-12-16T03:27:02.828684+0000","last_clean":"2023-12-16T03:27:02.828684+0000","last_became_active":"2023-12-16T03:27:00.513862+0000","last_became_peered":"2023-12-16T03:27:00.513862+0000","last_unstale":"2023-12-16T03:27:02.828684+0000","last_undegraded":"2023-12-16T03:27:02.828684+0000","last_fullsized":"2023-12-16T03:27:02.828684+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574099+0000","last_change":"2023-12-16T03:27:12.574099+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574099+0000","last_undegraded":"2023-12-16T03:27:12.574099+0000","last_fullsized":"2023-12-16T03:27:12.574099+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052577+0000","last_change":"2023-12-16T03:27:01.540186+0000","last_active":"2023-12-16T03:27:03.052577+0000","last_peered":"2023-12-16T03:27:03.052577+0000","last_clean":"2023-12-16T03:27:03.052577+0000","last_became_active":"2023-12-16T03:27:01.539206+0000","last_became_peered":"2023-12-16T03:27:01.539206+0000","last_unstale":"2023-12-16T03:27:03.052577+0000","last_undegraded":"2023-12-16T03:27:03.052577+0000","last_fullsized":"2023-12-16T03:27:03.052577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":21,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052488+0000","last_change":"2023-12-16T03:27:00.515681+0000","last_active":"2023-12-16T03:27:03.052488+0000","last_peered":"2023-12-16T03:27:03.052488+0000","last_clean":"2023-12-16T03:27:03.052488+0000","last_became_active":"2023-12-16T03:27:00.515413+0000","last_became_peered":"2023-12-16T03:27:00.515413+0000","last_unstale":"2023-12-16T03:27:03.052488+0000","last_undegraded":"2023-12-16T03:27:03.052488+0000","last_fullsized":"2023-12-16T03:27:03.052488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574928+0000","last_change":"2023-12-16T03:27:12.574928+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574928+0000","last_undegraded":"2023-12-16T03:27:12.574928+0000","last_fullsized":"2023-12-16T03:27:12.574928+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053454+0000","last_change":"2023-12-16T03:27:01.518997+0000","last_active":"2023-12-16T03:27:03.053454+0000","last_peered":"2023-12-16T03:27:03.053454+0000","last_clean":"2023-12-16T03:27:03.053454+0000","last_became_active":"2023-12-16T03:27:01.518606+0000","last_became_peered":"2023-12-16T03:27:01.518606+0000","last_unstale":"2023-12-16T03:27:03.053454+0000","last_undegraded":"2023-12-16T03:27:03.053454+0000","last_fullsized":"2023-12-16T03:27:03.053454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:34.578819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830504+0000","last_change":"2023-12-16T03:27:00.522719+0000","last_active":"2023-12-16T03:27:02.830504+0000","last_peered":"2023-12-16T03:27:02.830504+0000","last_clean":"2023-12-16T03:27:02.830504+0000","last_became_active":"2023-12-16T03:27:00.522485+0000","last_became_peered":"2023-12-16T03:27:00.522485+0000","last_unstale":"2023-12-16T03:27:02.830504+0000","last_undegraded":"2023-12-16T03:27:02.830504+0000","last_fullsized":"2023-12-16T03:27:02.830504+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:48:48.483240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574072+0000","last_change":"2023-12-16T03:27:12.574072+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574072+0000","last_undegraded":"2023-12-16T03:27:12.574072+0000","last_fullsized":"2023-12-16T03:27:12.574072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828875+0000","last_change":"2023-12-16T03:27:01.525968+0000","last_active":"2023-12-16T03:27:02.828875+0000","last_peered":"2023-12-16T03:27:02.828875+0000","last_clean":"2023-12-16T03:27:02.828875+0000","last_became_active":"2023-12-16T03:27:01.523176+0000","last_became_peered":"2023-12-16T03:27:01.523176+0000","last_unstale":"2023-12-16T03:27:02.828875+0000","last_undegraded":"2023-12-16T03:27:02.828875+0000","last_fullsized":"2023-12-16T03:27:02.828875+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053080+0000","last_change":"2023-12-16T03:27:00.514506+0000","last_active":"2023-12-16T03:27:03.053080+0000","last_peered":"2023-12-16T03:27:03.053080+0000","last_clean":"2023-12-16T03:27:03.053080+0000","last_became_active":"2023-12-16T03:27:00.514121+0000","last_became_peered":"2023-12-16T03:27:00.514121+0000","last_unstale":"2023-12-16T03:27:03.053080+0000","last_undegraded":"2023-12-16T03:27:03.053080+0000","last_fullsized":"2023-12-16T03:27:03.053080+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:47:33.862583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.575351+0000","last_change":"2023-12-16T03:27:12.575351+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.575351+0000","last_undegraded":"2023-12-16T03:27:12.575351+0000","last_fullsized":"2023-12-16T03:27:12.575351+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830461+0000","last_change":"2023-12-16T03:27:01.517329+0000","last_active":"2023-12-16T03:27:02.830461+0000","last_peered":"2023-12-16T03:27:02.830461+0000","last_clean":"2023-12-16T03:27:02.830461+0000","last_became_active":"2023-12-16T03:27:01.517020+0000","last_became_peered":"2023-12-16T03:27:01.517020+0000","last_unstale":"2023-12-16T03:27:02.830461+0000","last_undegraded":"2023-12-16T03:27:02.830461+0000","last_fullsized":"2023-12-16T03:27:02.830461+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:37:11.829485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828814+0000","last_change":"2023-12-16T03:27:00.514408+0000","last_active":"2023-12-16T03:27:02.828814+0000","last_peered":"2023-12-16T03:27:02.828814+0000","last_clean":"2023-12-16T03:27:02.828814+0000","last_became_active":"2023-12-16T03:27:00.514141+0000","last_became_peered":"2023-12-16T03:27:00.514141+0000","last_unstale":"2023-12-16T03:27:02.828814+0000","last_undegraded":"2023-12-16T03:27:02.828814+0000","last_fullsized":"2023-12-16T03:27:02.828814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:10.695120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568619+0000","last_change":"2023-12-16T03:27:12.568619+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568619+0000","last_undegraded":"2023-12-16T03:27:12.568619+0000","last_fullsized":"2023-12-16T03:27:12.568619+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053441+0000","last_change":"2023-12-16T03:27:01.522466+0000","last_active":"2023-12-16T03:27:03.053441+0000","last_peered":"2023-12-16T03:27:03.053441+0000","last_clean":"2023-12-16T03:27:03.053441+0000","last_became_active":"2023-12-16T03:27:01.522111+0000","last_became_peered":"2023-12-16T03:27:01.522111+0000","last_unstale":"2023-12-16T03:27:03.053441+0000","last_undegraded":"2023-12-16T03:27:03.053441+0000","last_fullsized":"2023-12-16T03:27:03.053441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:33.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053145+0000","last_change":"2023-12-16T03:27:00.520371+0000","last_active":"2023-12-16T03:27:03.053145+0000","last_peered":"2023-12-16T03:27:03.053145+0000","last_clean":"2023-12-16T03:27:03.053145+0000","last_became_active":"2023-12-16T03:27:00.520097+0000","last_became_peered":"2023-12-16T03:27:00.520097+0000","last_unstale":"2023-12-16T03:27:03.053145+0000","last_undegraded":"2023-12-16T03:27:03.053145+0000","last_fullsized":"2023-12-16T03:27:03.053145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:32:48.297921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570732+0000","last_change":"2023-12-16T03:27:12.570732+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570732+0000","last_undegraded":"2023-12-16T03:27:12.570732+0000","last_fullsized":"2023-12-16T03:27:12.570732+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828726+0000","last_change":"2023-12-16T03:27:01.521651+0000","last_active":"2023-12-16T03:27:02.828726+0000","last_peered":"2023-12-16T03:27:02.828726+0000","last_clean":"2023-12-16T03:27:02.828726+0000","last_became_active":"2023-12-16T03:27:01.521167+0000","last_became_peered":"2023-12-16T03:27:01.521167+0000","last_unstale":"2023-12-16T03:27:02.828726+0000","last_undegraded":"2023-12-16T03:27:02.828726+0000","last_fullsized":"2023-12-16T03:27:02.828726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:42:00.543610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830444+0000","last_change":"2023-12-16T03:27:00.521885+0000","last_active":"2023-12-16T03:27:02.830444+0000","last_peered":"2023-12-16T03:27:02.830444+0000","last_clean":"2023-12-16T03:27:02.830444+0000","last_became_active":"2023-12-16T03:27:00.521503+0000","last_became_peered":"2023-12-16T03:27:00.521503+0000","last_unstale":"2023-12-16T03:27:02.830444+0000","last_undegraded":"2023-12-16T03:27:02.830444+0000","last_fullsized":"2023-12-16T03:27:02.830444+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:47.207385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573173+0000","last_change":"2023-12-16T03:27:12.573173+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573173+0000","last_undegraded":"2023-12-16T03:27:12.573173+0000","last_fullsized":"2023-12-16T03:27:12.573173+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052775+0000","last_change":"2023-12-16T03:27:01.516489+0000","last_active":"2023-12-16T03:27:03.052775+0000","last_peered":"2023-12-16T03:27:03.052775+0000","last_clean":"2023-12-16T03:27:03.052775+0000","last_became_active":"2023-12-16T03:27:01.516199+0000","last_became_peered":"2023-12-16T03:27:01.516199+0000","last_unstale":"2023-12-16T03:27:03.052775+0000","last_undegraded":"2023-12-16T03:27:03.052775+0000","last_fullsized":"2023-12-16T03:27:03.052775+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:09.981763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053056+0000","last_change":"2023-12-16T03:27:00.508945+0000","last_active":"2023-12-16T03:27:03.053056+0000","last_peered":"2023-12-16T03:27:03.053056+0000","last_clean":"2023-12-16T03:27:03.053056+0000","last_became_active":"2023-12-16T03:27:00.508638+0000","last_became_peered":"2023-12-16T03:27:00.508638+0000","last_unstale":"2023-12-16T03:27:03.053056+0000","last_undegraded":"2023-12-16T03:27:03.053056+0000","last_fullsized":"2023-12-16T03:27:03.053056+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573496+0000","last_change":"2023-12-16T03:27:12.573496+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573496+0000","last_undegraded":"2023-12-16T03:27:12.573496+0000","last_fullsized":"2023-12-16T03:27:12.573496+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053200+0000","last_change":"2023-12-16T03:27:01.518954+0000","last_active":"2023-12-16T03:27:03.053200+0000","last_peered":"2023-12-16T03:27:03.053200+0000","last_clean":"2023-12-16T03:27:03.053200+0000","last_became_active":"2023-12-16T03:27:01.518665+0000","last_became_peered":"2023-12-16T03:27:01.518665+0000","last_unstale":"2023-12-16T03:27:03.053200+0000","last_undegraded":"2023-12-16T03:27:03.053200+0000","last_fullsized":"2023-12-16T03:27:03.053200+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:32.633580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828639+0000","last_change":"2023-12-16T03:27:00.519726+0000","last_active":"2023-12-16T03:27:02.828639+0000","last_peered":"2023-12-16T03:27:02.828639+0000","last_clean":"2023-12-16T03:27:02.828639+0000","last_became_active":"2023-12-16T03:27:00.519420+0000","last_became_peered":"2023-12-16T03:27:00.519420+0000","last_unstale":"2023-12-16T03:27:02.828639+0000","last_undegraded":"2023-12-16T03:27:02.828639+0000","last_fullsized":"2023-12-16T03:27:02.828639+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:07.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570609+0000","last_change":"2023-12-16T03:27:12.570609+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570609+0000","last_undegraded":"2023-12-16T03:27:12.570609+0000","last_fullsized":"2023-12-16T03:27:12.570609+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828858+0000","last_change":"2023-12-16T03:27:01.531143+0000","last_active":"2023-12-16T03:27:02.828858+0000","last_peered":"2023-12-16T03:27:02.828858+0000","last_clean":"2023-12-16T03:27:02.828858+0000","last_became_active":"2023-12-16T03:27:01.530842+0000","last_became_peered":"2023-12-16T03:27:01.530842+0000","last_unstale":"2023-12-16T03:27:02.828858+0000","last_undegraded":"2023-12-16T03:27:02.828858+0000","last_fullsized":"2023-12-16T03:27:02.828858+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053609+0000","last_change":"2023-12-16T03:27:00.524413+0000","last_active":"2023-12-16T03:27:03.053609+0000","last_peered":"2023-12-16T03:27:03.053609+0000","last_clean":"2023-12-16T03:27:03.053609+0000","last_became_active":"2023-12-16T03:27:00.524142+0000","last_became_peered":"2023-12-16T03:27:00.524142+0000","last_unstale":"2023-12-16T03:27:03.053609+0000","last_undegraded":"2023-12-16T03:27:03.053609+0000","last_fullsized":"2023-12-16T03:27:03.053609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573254+0000","last_change":"2023-12-16T03:27:12.573254+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573254+0000","last_undegraded":"2023-12-16T03:27:12.573254+0000","last_fullsized":"2023-12-16T03:27:12.573254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828891+0000","last_change":"2023-12-16T03:27:01.518068+0000","last_active":"2023-12-16T03:27:02.828891+0000","last_peered":"2023-12-16T03:27:02.828891+0000","last_clean":"2023-12-16T03:27:02.828891+0000","last_became_active":"2023-12-16T03:27:01.516800+0000","last_became_peered":"2023-12-16T03:27:01.516800+0000","last_unstale":"2023-12-16T03:27:02.828891+0000","last_undegraded":"2023-12-16T03:27:02.828891+0000","last_fullsized":"2023-12-16T03:27:02.828891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:05.590414+0000","last_change":"2023-12-16T03:27:00.515007+0000","last_active":"2023-12-16T03:27:05.590414+0000","last_peered":"2023-12-16T03:27:05.590414+0000","last_clean":"2023-12-16T03:27:05.590414+0000","last_became_active":"2023-12-16T03:27:00.514820+0000","last_became_peered":"2023-12-16T03:27:00.514820+0000","last_unstale":"2023-12-16T03:27:05.590414+0000","last_undegraded":"2023-12-16T03:27:05.590414+0000","last_fullsized":"2023-12-16T03:27:05.590414+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:03:53.754918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574830+0000","last_change":"2023-12-16T03:27:12.574830+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574830+0000","last_undegraded":"2023-12-16T03:27:12.574830+0000","last_fullsized":"2023-12-16T03:27:12.574830+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053283+0000","last_change":"2023-12-16T03:27:01.522052+0000","last_active":"2023-12-16T03:27:03.053283+0000","last_peered":"2023-12-16T03:27:03.053283+0000","last_clean":"2023-12-16T03:27:03.053283+0000","last_became_active":"2023-12-16T03:27:01.521669+0000","last_became_peered":"2023-12-16T03:27:01.521669+0000","last_unstale":"2023-12-16T03:27:03.053283+0000","last_undegraded":"2023-12-16T03:27:03.053283+0000","last_fullsized":"2023-12-16T03:27:03.053283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:05.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052729+0000","last_change":"2023-12-16T03:27:00.516627+0000","last_active":"2023-12-16T03:27:03.052729+0000","last_peered":"2023-12-16T03:27:03.052729+0000","last_clean":"2023-12-16T03:27:03.052729+0000","last_became_active":"2023-12-16T03:27:00.516381+0000","last_became_peered":"2023-12-16T03:27:00.516381+0000","last_unstale":"2023-12-16T03:27:03.052729+0000","last_undegraded":"2023-12-16T03:27:03.052729+0000","last_fullsized":"2023-12-16T03:27:03.052729+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.569868+0000","last_change":"2023-12-16T03:27:12.569868+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.569868+0000","last_undegraded":"2023-12-16T03:27:12.569868+0000","last_fullsized":"2023-12-16T03:27:12.569868+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052986+0000","last_change":"2023-12-16T03:27:01.522194+0000","last_active":"2023-12-16T03:27:03.052986+0000","last_peered":"2023-12-16T03:27:03.052986+0000","last_clean":"2023-12-16T03:27:03.052986+0000","last_became_active":"2023-12-16T03:27:01.521667+0000","last_became_peered":"2023-12-16T03:27:01.521667+0000","last_unstale":"2023-12-16T03:27:03.052986+0000","last_undegraded":"2023-12-16T03:27:03.052986+0000","last_fullsized":"2023-12-16T03:27:03.052986+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828797+0000","last_change":"2023-12-16T03:27:00.511361+0000","last_active":"2023-12-16T03:27:02.828797+0000","last_peered":"2023-12-16T03:27:02.828797+0000","last_clean":"2023-12-16T03:27:02.828797+0000","last_became_active":"2023-12-16T03:27:00.511033+0000","last_became_peered":"2023-12-16T03:27:00.511033+0000","last_unstale":"2023-12-16T03:27:02.828797+0000","last_undegraded":"2023-12-16T03:27:02.828797+0000","last_fullsized":"2023-12-16T03:27:02.828797+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:48.295530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568615+0000","last_change":"2023-12-16T03:27:12.568615+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568615+0000","last_undegraded":"2023-12-16T03:27:12.568615+0000","last_fullsized":"2023-12-16T03:27:12.568615+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830408+0000","last_change":"2023-12-16T03:27:01.524848+0000","last_active":"2023-12-16T03:27:02.830408+0000","last_peered":"2023-12-16T03:27:02.830408+0000","last_clean":"2023-12-16T03:27:02.830408+0000","last_became_active":"2023-12-16T03:27:01.524561+0000","last_became_peered":"2023-12-16T03:27:01.524561+0000","last_unstale":"2023-12-16T03:27:02.830408+0000","last_undegraded":"2023-12-16T03:27:02.830408+0000","last_fullsized":"2023-12-16T03:27:02.830408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.908171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052896+0000","last_change":"2023-12-16T03:27:00.513344+0000","last_active":"2023-12-16T03:27:03.052896+0000","last_peered":"2023-12-16T03:27:03.052896+0000","last_clean":"2023-12-16T03:27:03.052896+0000","last_became_active":"2023-12-16T03:27:00.513101+0000","last_became_peered":"2023-12-16T03:27:00.513101+0000","last_unstale":"2023-12-16T03:27:03.052896+0000","last_undegraded":"2023-12-16T03:27:03.052896+0000","last_fullsized":"2023-12-16T03:27:03.052896+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:34.745808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573469+0000","last_change":"2023-12-16T03:27:12.573469+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573469+0000","last_undegraded":"2023-12-16T03:27:12.573469+0000","last_fullsized":"2023-12-16T03:27:12.573469+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053255+0000","last_change":"2023-12-16T03:27:01.543099+0000","last_active":"2023-12-16T03:27:03.053255+0000","last_peered":"2023-12-16T03:27:03.053255+0000","last_clean":"2023-12-16T03:27:03.053255+0000","last_became_active":"2023-12-16T03:27:01.542711+0000","last_became_peered":"2023-12-16T03:27:01.542711+0000","last_unstale":"2023-12-16T03:27:03.053255+0000","last_undegraded":"2023-12-16T03:27:03.053255+0000","last_fullsized":"2023-12-16T03:27:03.053255+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:09.981763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828573+0000","last_change":"2023-12-16T03:27:00.513164+0000","last_active":"2023-12-16T03:27:02.828573+0000","last_peered":"2023-12-16T03:27:02.828573+0000","last_clean":"2023-12-16T03:27:02.828573+0000","last_became_active":"2023-12-16T03:27:00.512912+0000","last_became_peered":"2023-12-16T03:27:00.512912+0000","last_unstale":"2023-12-16T03:27:02.828573+0000","last_undegraded":"2023-12-16T03:27:02.828573+0000","last_fullsized":"2023-12-16T03:27:02.828573+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570585+0000","last_change":"2023-12-16T03:27:12.570585+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570585+0000","last_undegraded":"2023-12-16T03:27:12.570585+0000","last_fullsized":"2023-12-16T03:27:12.570585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052586+0000","last_change":"2023-12-16T03:27:01.521887+0000","last_active":"2023-12-16T03:27:03.052586+0000","last_peered":"2023-12-16T03:27:03.052586+0000","last_clean":"2023-12-16T03:27:03.052586+0000","last_became_active":"2023-12-16T03:27:01.521554+0000","last_became_peered":"2023-12-16T03:27:01.521554+0000","last_unstale":"2023-12-16T03:27:03.052586+0000","last_undegraded":"2023-12-16T03:27:03.052586+0000","last_fullsized":"2023-12-16T03:27:03.052586+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:47.409565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052670+0000","last_change":"2023-12-16T03:27:00.512268+0000","last_active":"2023-12-16T03:27:03.052670+0000","last_peered":"2023-12-16T03:27:03.052670+0000","last_clean":"2023-12-16T03:27:03.052670+0000","last_became_active":"2023-12-16T03:27:00.511945+0000","last_became_peered":"2023-12-16T03:27:00.511945+0000","last_unstale":"2023-12-16T03:27:03.052670+0000","last_undegraded":"2023-12-16T03:27:03.052670+0000","last_fullsized":"2023-12-16T03:27:03.052670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:49:40.657817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574958+0000","last_change":"2023-12-16T03:27:12.574958+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574958+0000","last_undegraded":"2023-12-16T03:27:12.574958+0000","last_fullsized":"2023-12-16T03:27:12.574958+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830383+0000","last_change":"2023-12-16T03:27:01.527192+0000","last_active":"2023-12-16T03:27:02.830383+0000","last_peered":"2023-12-16T03:27:02.830383+0000","last_clean":"2023-12-16T03:27:02.830383+0000","last_became_active":"2023-12-16T03:27:01.526892+0000","last_became_peered":"2023-12-16T03:27:01.526892+0000","last_unstale":"2023-12-16T03:27:02.830383+0000","last_undegraded":"2023-12-16T03:27:02.830383+0000","last_fullsized":"2023-12-16T03:27:02.830383+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:00.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830365+0000","last_change":"2023-12-16T03:27:00.516056+0000","last_active":"2023-12-16T03:27:02.830365+0000","last_peered":"2023-12-16T03:27:02.830365+0000","last_clean":"2023-12-16T03:27:02.830365+0000","last_became_active":"2023-12-16T03:27:00.515763+0000","last_became_peered":"2023-12-16T03:27:00.515763+0000","last_unstale":"2023-12-16T03:27:02.830365+0000","last_undegraded":"2023-12-16T03:27:02.830365+0000","last_fullsized":"2023-12-16T03:27:02.830365+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:42.045050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.575249+0000","last_change":"2023-12-16T03:27:12.575249+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.575249+0000","last_undegraded":"2023-12-16T03:27:12.575249+0000","last_fullsized":"2023-12-16T03:27:12.575249+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830356+0000","last_change":"2023-12-16T03:27:01.520522+0000","last_active":"2023-12-16T03:27:02.830356+0000","last_peered":"2023-12-16T03:27:02.830356+0000","last_clean":"2023-12-16T03:27:02.830356+0000","last_became_active":"2023-12-16T03:27:01.520214+0000","last_became_peered":"2023-12-16T03:27:01.520214+0000","last_unstale":"2023-12-16T03:27:02.830356+0000","last_undegraded":"2023-12-16T03:27:02.830356+0000","last_fullsized":"2023-12-16T03:27:02.830356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:42.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052580+0000","last_change":"2023-12-16T03:27:00.514945+0000","last_active":"2023-12-16T03:27:03.052580+0000","last_peered":"2023-12-16T03:27:03.052580+0000","last_clean":"2023-12-16T03:27:03.052580+0000","last_became_active":"2023-12-16T03:27:00.514688+0000","last_became_peered":"2023-12-16T03:27:00.514688+0000","last_unstale":"2023-12-16T03:27:03.052580+0000","last_undegraded":"2023-12-16T03:27:03.052580+0000","last_fullsized":"2023-12-16T03:27:03.052580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:07.829384+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:27:07.829384+0000","last_peered":"2023-12-16T03:27:07.829384+0000","last_clean":"2023-12-16T03:27:07.829384+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:27:07.829384+0000","last_undegraded":"2023-12-16T03:27:07.829384+0000","last_fullsized":"2023-12-16T03:27:07.829384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":842361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":1.155,"15min":1.155},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90700000000000003,"5min":1.585,"15min":1.585},"last":0.62}]},{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88200000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.81299999999999994,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85099999999999998,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77300000000000002,"15min":0.79100000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.79600000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92700000000000005,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.51700000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96299999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94399999999999995,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81899999999999995,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.874,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46800000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.004,"15min":1.004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.89300000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":598016,"data_stored":251833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.437,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93400000000000005,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93799999999999994,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82899999999999996,"15min":0.85499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95399999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":1.02,"15min":1.075},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96299999999999997,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.98099999999999998,"15min":1.0289999999999999},"min":{"1min":0.51200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.042,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.069,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.87,"15min":0.89700000000000002},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":4.242,"15min":4.242},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.90300000000000002,"15min":0.93500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92600000000000005,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88100000000000001,"5min":1.111,"15min":1.111},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.52300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":1.073,"15min":1.073},"last":0.62}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.077,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.99099999999999999,"5min":1.246,"15min":1.246},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.74399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":259156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.60999999999999999},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.77300000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.872},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1,"15min":1},"last":0.82199999999999995}]},{"osd":2,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":1.004}]},{"osd":3,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.93999999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74399999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.755,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64000000000000001,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73599999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.748},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.79200000000000004}]},{"osd":7,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.82399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.89100000000000001,"5min":1.105,"15min":1.105},"last":0.95999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":610304,"data_stored":254940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.78200000000000003,"15min":0.81000000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":4.194,"15min":4.194},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85299999999999998,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.60599999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.91500000000000004,"5min":1.288,"15min":1.288},"last":0.745}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.93500000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84399999999999997,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.92500000000000004,"15min":0.96199999999999997},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86099999999999999,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.80000000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.92800000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.751,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.44600000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96499999999999997,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88600000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.871}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88900000000000001,"5min":1.881,"15min":1.881},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.81999999999999995,"15min":0.83999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":606208,"data_stored":251889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.747,"15min":0.80400000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67700000000000005,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.80900000000000005,"15min":0.871},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.52200000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.66700000000000004,"15min":0.70499999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63500000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.442},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.66300000000000003,"15min":0.68400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.72999999999999998,"15min":0.76500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.496}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94999999999999996,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.629},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.048,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.89400000000000002,"15min":0.92200000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.89500000000000002,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.86899999999999999,"15min":0.89100000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.006,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.92500000000000004,"15min":0.95299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97499999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.93400000000000005,"15min":0.96399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94499999999999995,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.95299999999999996,"15min":0.97999999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0609999999999999,"5min":3.375,"15min":3.375},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":618496,"data_stored":258560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48399999999999999,"15min":0.48499999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.875,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.312}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.503,"15min":0.498},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.36199999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.502},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.022},"last":0.46800000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77200000000000002,"15min":0.77700000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1060000000000001,"5min":1.587,"15min":1.587},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0609999999999999,"5min":1.913,"15min":1.913},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.55500000000000005}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.179,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.04,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.58699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":258594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.60999999999999999,"15min":0.64200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97199999999999998,"5min":4.476,"15min":4.476},"last":0.499}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.80800000000000005,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73899999999999999,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.749,"15min":0.79300000000000004},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.70299999999999996,"15min":0.73399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.66700000000000004,"15min":0.70099999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.436}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.03,"15min":1.0820000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0840000000000001,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.93799999999999994,"15min":0.97199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.133,"5min":4.984,"15min":4.984},"last":0.63800000000000001}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.90200000000000002,"15min":0.93999999999999995},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.996,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.745,"5min":1.089,"15min":1.147},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0209999999999999,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.95199999999999996,"15min":0.98899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0880000000000001,"15min":1.147},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95299999999999996,"5min":7.681,"15min":7.681},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":1.0369999999999999,"15min":1.077},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.177,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.995,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.98199999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.67600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1208320,"data_stored":845890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.751,"15min":0.80900000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68200000000000005,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.89300000000000002,"15min":0.95899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70699999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.93000000000000005,"15min":0.999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.028,"15min":1.1100000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82199999999999995,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.92800000000000005,"15min":1.0109999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57399999999999995,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.316},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.78100000000000003,"15min":0.82599999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":3.254,"15min":3.254},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95099999999999996,"15min":0.98599999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.0900000000000001,"15min":1.151},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.98499999999999999,"15min":1.036},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97499999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97899999999999998,"15min":1.0249999999999999},"min":{"1min":0.54700000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.171,"15min":1.2450000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94399999999999995,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":1.181,"15min":1.2490000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95899999999999996,"5min":4.444,"15min":4.444},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0109999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:27:19.136 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:27:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.312+0000 7fe63c2fe640 1 Processor -- start 2023-12-16T03:27:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.312+0000 7fe63c2fe640 1 -- start start 2023-12-16T03:27:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.312+0000 7fe63c2fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6340c4100 0x7fe6340c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.312+0000 7fe63c2fe640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6340c31c0 con 0x7fe6340c63c0 2023-12-16T03:27:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.312+0000 7fe63c2fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6340c34a0 con 0x7fe6340c06d0 2023-12-16T03:27:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.312+0000 7fe63c2fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340c1030 con 0x7fe6340c4100 2023-12-16T03:27:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.312+0000 7fe63a09a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe6340c63c0 0x7fe6340c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41044/0 (socket says 172.21.15.28:41044) 2023-12-16T03:27:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.312+0000 7fe63a09a640 1 -- 172.21.15.28:0/2434082295 learned_addr learned my addr 172.21.15.28:0/2434082295 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.312+0000 7fe639899640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6340c4100 0x7fe6340c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.312+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985336337 0 0) 0x7fe6340c31c0 con 0x7fe6340c63c0 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.312+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe620003530 con 0x7fe6340c63c0 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1364674736 0 0) 0x7fe620003530 con 0x7fe6340c63c0 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6340c4100 msgr2=0x7fe6340c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6340c4100 0x7fe6340c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 >> v1:172.21.15.134:6789/0 conn(0x7fe6340c06d0 legacy=0x7fe6340a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6340c1310 con 0x7fe6340c63c0 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fe630001680 con 0x7fe6340c63c0 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 >> v1:172.21.15.28:6789/0 conn(0x7fe6340c63c0 legacy=0x7fe6340c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6340c4100 0x7fe6200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 0x7fe6200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe620004d10 0x7fe620005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340c1030 con 0x7fe620003ef0 2023-12-16T03:27:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62000bb80 con 0x7fe620004d10 2023-12-16T03:27:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62000df50 con 0x7fe6340c4100 2023-12-16T03:27:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639899640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 0x7fe6200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe63a09a640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6340c4100 0x7fe6200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe63a89b640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe620004d10 0x7fe620005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639899640 1 -- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6340c4100 msgr2=0x7fe6200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639899640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe6340c4100 0x7fe6200039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639899640 1 -- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe620004d10 msgr2=0x7fe620005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639899640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe620004d10 0x7fe620005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639899640 1 -- 172.21.15.28:0/2434082295 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620003530 con 0x7fe620003ef0 2023-12-16T03:27:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe63a89b640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe620004d10 0x7fe620005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.316+0000 7fe639899640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 0x7fe6200047d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe624009ab0 tx=0x7fe62401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca620d64ad6b453 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6240a9410 con 0x7fe620003ef0 2023-12-16T03:27:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6240a9570 con 0x7fe620003ef0 2023-12-16T03:27:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe639098640 1 -- 172.21.15.28:0/2434082295 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6240a9920 con 0x7fe620003ef0 2023-12-16T03:27:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 -- 172.21.15.28:0/2434082295 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 msgr2=0x7fe6200047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 --2- 172.21.15.28:0/2434082295 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 0x7fe6200047d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe624009ab0 tx=0x7fe62401ca30 comp rx=0 tx=0).stop 2023-12-16T03:27:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63a89b640 1 -- 172.21.15.28:0/2434082295 reap_dead start 2023-12-16T03:27:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 -- 172.21.15.28:0/2434082295 shutdown_connections 2023-12-16T03:27:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 -- 172.21.15.28:0/2434082295 >> 172.21.15.28:0/2434082295 conn(0x7fe63406a5b0 msgr2=0x7fe63406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 -- 172.21.15.28:0/2434082295 shutdown_connections 2023-12-16T03:27:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 -- 172.21.15.28:0/2434082295 wait complete. 2023-12-16T03:27:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 Processor -- start 2023-12-16T03:27:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 -- start start 2023-12-16T03:27:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 0x7fe6341e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe63409b3b0 0x7fe6341dfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe634099cd0 0x7fe63409a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6341df4f0 con 0x7fe620003ef0 2023-12-16T03:27:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6341e3610 con 0x7fe634099cd0 2023-12-16T03:27:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63c2fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6341e38f0 con 0x7fe63409b3b0 2023-12-16T03:27:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.320+0000 7fe63a09a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 0x7fe6341e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63a09a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 0x7fe6341e16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58792/0 (socket says 172.21.15.28:58792) 2023-12-16T03:27:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63a09a640 1 -- 172.21.15.28:0/3116089765 learned_addr learned my addr 172.21.15.28:0/3116089765 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe639899640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe63409b3b0 0x7fe6341dfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63a89b640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe634099cd0 0x7fe63409a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63a09a640 1 -- 172.21.15.28:0/3116089765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe63409b3b0 msgr2=0x7fe6341dfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63a09a640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe63409b3b0 0x7fe6341dfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63a09a640 1 -- 172.21.15.28:0/3116089765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe634099cd0 msgr2=0x7fe63409a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63a09a640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe634099cd0 0x7fe63409a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63a09a640 1 -- 172.21.15.28:0/3116089765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6340c69b0 con 0x7fe620003ef0 2023-12-16T03:27:19.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63a09a640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 0x7fe6341e16b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe630007310 tx=0x7fe6300077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:19.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe62affd640 1 -- 172.21.15.28:0/3116089765 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630001670 con 0x7fe620003ef0 2023-12-16T03:27:19.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe62affd640 1 -- 172.21.15.28:0/3116089765 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000f8c0 con 0x7fe620003ef0 2023-12-16T03:27:19.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe62affd640 1 -- 172.21.15.28:0/3116089765 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000fc30 con 0x7fe620003ef0 2023-12-16T03:27:19.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63c2fe640 1 -- 172.21.15.28:0/3116089765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6341df7b0 con 0x7fe620003ef0 2023-12-16T03:27:19.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63c2fe640 1 -- 172.21.15.28:0/3116089765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6341e0210 con 0x7fe620003ef0 2023-12-16T03:27:19.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe63c2fe640 1 -- 172.21.15.28:0/3116089765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6341e3750 con 0x7fe620003ef0 2023-12-16T03:27:19.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe62affd640 1 -- 172.21.15.28:0/3116089765 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe63000fd90 con 0x7fe620003ef0 2023-12-16T03:27:19.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe62affd640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe618066470 0x7fe618068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.324+0000 7fe62affd640 1 -- 172.21.15.28:0/3116089765 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe6300841a0 con 0x7fe620003ef0 2023-12-16T03:27:19.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.328+0000 7fe639899640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe618066470 0x7fe618068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.328+0000 7fe639899640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe618066470 0x7fe618068930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe6240ae000 tx=0x7fe6240b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:19.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.328+0000 7fe62affd640 1 -- 172.21.15.28:0/3116089765 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe6341e3750 con 0x7fe620003ef0 2023-12-16T03:27:19.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.484+0000 7fe63c2fe640 1 -- 172.21.15.28:0/3116089765 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6341df630 con 0x7fe618066470 2023-12-16T03:27:19.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.496+0000 7fe62affd640 1 -- 172.21.15.28:0/3116089765 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+516198 (secure 0 0 0) 0x7fe6240b7040 con 0x7fe618066470 2023-12-16T03:27:19.504 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:19.508 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:27:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 -- 172.21.15.28:0/3116089765 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe618066470 msgr2=0x7fe618068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe618066470 0x7fe618068930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe6240ae000 tx=0x7fe6240b3040 comp rx=0 tx=0).stop 2023-12-16T03:27:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 -- 172.21.15.28:0/3116089765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 msgr2=0x7fe6341e16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 0x7fe6341e16b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe630007310 tx=0x7fe6300077d0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 -- 172.21.15.28:0/3116089765 shutdown_connections 2023-12-16T03:27:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe634099cd0 0x7fe63409a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe63409b3b0 0x7fe6341dfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe618066470 0x7fe618068930 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 --2- 172.21.15.28:0/3116089765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe620003ef0 0x7fe6341e16b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 -- 172.21.15.28:0/3116089765 >> 172.21.15.28:0/3116089765 conn(0x7fe63406a5b0 msgr2=0x7fe634155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 -- 172.21.15.28:0/3116089765 shutdown_connections 2023-12-16T03:27:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.500+0000 7fe63c2fe640 1 -- 172.21.15.28:0/3116089765 wait complete. 2023-12-16T03:27:19.524 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-12-16T03:27:17.822355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238736,"kb_used_data":5932,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735984,"statfs":{"total":773094113280,"available":772849647616,"internally_reserved":0,"allocated":6074368,"data_stored":3223223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1495,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.256218"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829460+0000","last_change":"2023-12-16T03:27:01.537420+0000","last_active":"2023-12-16T03:27:02.829460+0000","last_peered":"2023-12-16T03:27:02.829460+0000","last_clean":"2023-12-16T03:27:02.829460+0000","last_became_active":"2023-12-16T03:27:01.537176+0000","last_became_peered":"2023-12-16T03:27:01.537176+0000","last_unstale":"2023-12-16T03:27:02.829460+0000","last_undegraded":"2023-12-16T03:27:02.829460+0000","last_fullsized":"2023-12-16T03:27:02.829460+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:23:26.860864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830469+0000","last_change":"2023-12-16T03:27:01.534498+0000","last_active":"2023-12-16T03:27:02.830469+0000","last_peered":"2023-12-16T03:27:02.830469+0000","last_clean":"2023-12-16T03:27:02.830469+0000","last_became_active":"2023-12-16T03:27:01.533730+0000","last_became_peered":"2023-12-16T03:27:01.533730+0000","last_unstale":"2023-12-16T03:27:02.830469+0000","last_undegraded":"2023-12-16T03:27:02.830469+0000","last_fullsized":"2023-12-16T03:27:02.830469+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:07.937228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053229+0000","last_change":"2023-12-16T03:27:01.518121+0000","last_active":"2023-12-16T03:27:03.053229+0000","last_peered":"2023-12-16T03:27:03.053229+0000","last_clean":"2023-12-16T03:27:03.053229+0000","last_became_active":"2023-12-16T03:27:01.517826+0000","last_became_peered":"2023-12-16T03:27:01.517826+0000","last_unstale":"2023-12-16T03:27:03.053229+0000","last_undegraded":"2023-12-16T03:27:03.053229+0000","last_fullsized":"2023-12-16T03:27:03.053229+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:46.909657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828744+0000","last_change":"2023-12-16T03:27:01.531096+0000","last_active":"2023-12-16T03:27:02.828744+0000","last_peered":"2023-12-16T03:27:02.828744+0000","last_clean":"2023-12-16T03:27:02.828744+0000","last_became_active":"2023-12-16T03:27:01.530793+0000","last_became_peered":"2023-12-16T03:27:01.530793+0000","last_unstale":"2023-12-16T03:27:02.828744+0000","last_undegraded":"2023-12-16T03:27:02.828744+0000","last_fullsized":"2023-12-16T03:27:02.828744+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:59.366673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829423+0000","last_change":"2023-12-16T03:27:01.531904+0000","last_active":"2023-12-16T03:27:02.829423+0000","last_peered":"2023-12-16T03:27:02.829423+0000","last_clean":"2023-12-16T03:27:02.829423+0000","last_became_active":"2023-12-16T03:27:01.531705+0000","last_became_peered":"2023-12-16T03:27:01.531705+0000","last_unstale":"2023-12-16T03:27:02.829423+0000","last_undegraded":"2023-12-16T03:27:02.829423+0000","last_fullsized":"2023-12-16T03:27:02.829423+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:24:38.684552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052563+0000","last_change":"2023-12-16T03:27:01.537597+0000","last_active":"2023-12-16T03:27:03.052563+0000","last_peered":"2023-12-16T03:27:03.052563+0000","last_clean":"2023-12-16T03:27:03.052563+0000","last_became_active":"2023-12-16T03:27:01.537262+0000","last_became_peered":"2023-12-16T03:27:01.537262+0000","last_unstale":"2023-12-16T03:27:03.052563+0000","last_undegraded":"2023-12-16T03:27:03.052563+0000","last_fullsized":"2023-12-16T03:27:03.052563+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828516+0000","last_change":"2023-12-16T03:27:01.504710+0000","last_active":"2023-12-16T03:27:02.828516+0000","last_peered":"2023-12-16T03:27:02.828516+0000","last_clean":"2023-12-16T03:27:02.828516+0000","last_became_active":"2023-12-16T03:27:01.504412+0000","last_became_peered":"2023-12-16T03:27:01.504412+0000","last_unstale":"2023-12-16T03:27:02.828516+0000","last_undegraded":"2023-12-16T03:27:02.828516+0000","last_fullsized":"2023-12-16T03:27:02.828516+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:09.298222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830343+0000","last_change":"2023-12-16T03:27:01.514585+0000","last_active":"2023-12-16T03:27:02.830343+0000","last_peered":"2023-12-16T03:27:02.830343+0000","last_clean":"2023-12-16T03:27:02.830343+0000","last_became_active":"2023-12-16T03:27:01.514304+0000","last_became_peered":"2023-12-16T03:27:01.514304+0000","last_unstale":"2023-12-16T03:27:02.830343+0000","last_undegraded":"2023-12-16T03:27:02.830343+0000","last_fullsized":"2023-12-16T03:27:02.830343+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:44:59.949884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828650+0000","last_change":"2023-12-16T03:27:01.517287+0000","last_active":"2023-12-16T03:27:02.828650+0000","last_peered":"2023-12-16T03:27:02.828650+0000","last_clean":"2023-12-16T03:27:02.828650+0000","last_became_active":"2023-12-16T03:27:01.516865+0000","last_became_peered":"2023-12-16T03:27:01.516865+0000","last_unstale":"2023-12-16T03:27:02.828650+0000","last_undegraded":"2023-12-16T03:27:02.828650+0000","last_fullsized":"2023-12-16T03:27:02.828650+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:49.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053568+0000","last_change":"2023-12-16T03:27:01.523610+0000","last_active":"2023-12-16T03:27:03.053568+0000","last_peered":"2023-12-16T03:27:03.053568+0000","last_clean":"2023-12-16T03:27:03.053568+0000","last_became_active":"2023-12-16T03:27:01.523269+0000","last_became_peered":"2023-12-16T03:27:01.523269+0000","last_unstale":"2023-12-16T03:27:03.053568+0000","last_undegraded":"2023-12-16T03:27:03.053568+0000","last_fullsized":"2023-12-16T03:27:03.053568+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:43.020903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053472+0000","last_change":"2023-12-16T03:27:01.534387+0000","last_active":"2023-12-16T03:27:03.053472+0000","last_peered":"2023-12-16T03:27:03.053472+0000","last_clean":"2023-12-16T03:27:03.053472+0000","last_became_active":"2023-12-16T03:27:01.534102+0000","last_became_peered":"2023-12-16T03:27:01.534102+0000","last_unstale":"2023-12-16T03:27:03.053472+0000","last_undegraded":"2023-12-16T03:27:03.053472+0000","last_fullsized":"2023-12-16T03:27:03.053472+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:48:59.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828760+0000","last_change":"2023-12-16T03:27:01.514907+0000","last_active":"2023-12-16T03:27:02.828760+0000","last_peered":"2023-12-16T03:27:02.828760+0000","last_clean":"2023-12-16T03:27:02.828760+0000","last_became_active":"2023-12-16T03:27:01.514396+0000","last_became_peered":"2023-12-16T03:27:01.514396+0000","last_unstale":"2023-12-16T03:27:02.828760+0000","last_undegraded":"2023-12-16T03:27:02.828760+0000","last_fullsized":"2023-12-16T03:27:02.828760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052844+0000","last_change":"2023-12-16T03:27:01.533053+0000","last_active":"2023-12-16T03:27:03.052844+0000","last_peered":"2023-12-16T03:27:03.052844+0000","last_clean":"2023-12-16T03:27:03.052844+0000","last_became_active":"2023-12-16T03:27:01.532852+0000","last_became_peered":"2023-12-16T03:27:01.532852+0000","last_unstale":"2023-12-16T03:27:03.052844+0000","last_undegraded":"2023-12-16T03:27:03.052844+0000","last_fullsized":"2023-12-16T03:27:03.052844+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:05.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828556+0000","last_change":"2023-12-16T03:27:01.527464+0000","last_active":"2023-12-16T03:27:02.828556+0000","last_peered":"2023-12-16T03:27:02.828556+0000","last_clean":"2023-12-16T03:27:02.828556+0000","last_became_active":"2023-12-16T03:27:01.526439+0000","last_became_peered":"2023-12-16T03:27:01.526439+0000","last_unstale":"2023-12-16T03:27:02.828556+0000","last_undegraded":"2023-12-16T03:27:02.828556+0000","last_fullsized":"2023-12-16T03:27:02.828556+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:55.347747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828538+0000","last_change":"2023-12-16T03:27:01.523106+0000","last_active":"2023-12-16T03:27:02.828538+0000","last_peered":"2023-12-16T03:27:02.828538+0000","last_clean":"2023-12-16T03:27:02.828538+0000","last_became_active":"2023-12-16T03:27:01.522824+0000","last_became_peered":"2023-12-16T03:27:01.522824+0000","last_unstale":"2023-12-16T03:27:02.828538+0000","last_undegraded":"2023-12-16T03:27:02.828538+0000","last_fullsized":"2023-12-16T03:27:02.828538+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:04.563786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052553+0000","last_change":"2023-12-16T03:27:01.513664+0000","last_active":"2023-12-16T03:27:03.052553+0000","last_peered":"2023-12-16T03:27:03.052553+0000","last_clean":"2023-12-16T03:27:03.052553+0000","last_became_active":"2023-12-16T03:27:01.513325+0000","last_became_peered":"2023-12-16T03:27:01.513325+0000","last_unstale":"2023-12-16T03:27:03.052553+0000","last_undegraded":"2023-12-16T03:27:03.052553+0000","last_fullsized":"2023-12-16T03:27:03.052553+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830495+0000","last_change":"2023-12-16T03:27:01.526203+0000","last_active":"2023-12-16T03:27:02.830495+0000","last_peered":"2023-12-16T03:27:02.830495+0000","last_clean":"2023-12-16T03:27:02.830495+0000","last_became_active":"2023-12-16T03:27:01.525873+0000","last_became_peered":"2023-12-16T03:27:01.525873+0000","last_unstale":"2023-12-16T03:27:02.830495+0000","last_undegraded":"2023-12-16T03:27:02.830495+0000","last_fullsized":"2023-12-16T03:27:02.830495+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:37:50.321166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053467+0000","last_change":"2023-12-16T03:27:01.529407+0000","last_active":"2023-12-16T03:27:03.053467+0000","last_peered":"2023-12-16T03:27:03.053467+0000","last_clean":"2023-12-16T03:27:03.053467+0000","last_became_active":"2023-12-16T03:27:01.529024+0000","last_became_peered":"2023-12-16T03:27:01.529024+0000","last_unstale":"2023-12-16T03:27:03.053467+0000","last_undegraded":"2023-12-16T03:27:03.053467+0000","last_fullsized":"2023-12-16T03:27:03.053467+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829448+0000","last_change":"2023-12-16T03:27:01.538362+0000","last_active":"2023-12-16T03:27:02.829448+0000","last_peered":"2023-12-16T03:27:02.829448+0000","last_clean":"2023-12-16T03:27:02.829448+0000","last_became_active":"2023-12-16T03:27:01.538024+0000","last_became_peered":"2023-12-16T03:27:01.538024+0000","last_unstale":"2023-12-16T03:27:02.829448+0000","last_undegraded":"2023-12-16T03:27:02.829448+0000","last_fullsized":"2023-12-16T03:27:02.829448+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:44.941057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830452+0000","last_change":"2023-12-16T03:27:01.535927+0000","last_active":"2023-12-16T03:27:02.830452+0000","last_peered":"2023-12-16T03:27:02.830452+0000","last_clean":"2023-12-16T03:27:02.830452+0000","last_became_active":"2023-12-16T03:27:01.535618+0000","last_became_peered":"2023-12-16T03:27:01.535618+0000","last_unstale":"2023-12-16T03:27:02.830452+0000","last_undegraded":"2023-12-16T03:27:02.830452+0000","last_fullsized":"2023-12-16T03:27:02.830452+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:46.786632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053065+0000","last_change":"2023-12-16T03:27:01.520051+0000","last_active":"2023-12-16T03:27:03.053065+0000","last_peered":"2023-12-16T03:27:03.053065+0000","last_clean":"2023-12-16T03:27:03.053065+0000","last_became_active":"2023-12-16T03:27:01.519803+0000","last_became_peered":"2023-12-16T03:27:01.519803+0000","last_unstale":"2023-12-16T03:27:03.053065+0000","last_undegraded":"2023-12-16T03:27:03.053065+0000","last_fullsized":"2023-12-16T03:27:03.053065+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830392+0000","last_change":"2023-12-16T03:27:01.523786+0000","last_active":"2023-12-16T03:27:02.830392+0000","last_peered":"2023-12-16T03:27:02.830392+0000","last_clean":"2023-12-16T03:27:02.830392+0000","last_became_active":"2023-12-16T03:27:01.523435+0000","last_became_peered":"2023-12-16T03:27:01.523435+0000","last_unstale":"2023-12-16T03:27:02.830392+0000","last_undegraded":"2023-12-16T03:27:02.830392+0000","last_fullsized":"2023-12-16T03:27:02.830392+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:59:37.033807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052538+0000","last_change":"2023-12-16T03:27:01.539536+0000","last_active":"2023-12-16T03:27:03.052538+0000","last_peered":"2023-12-16T03:27:03.052538+0000","last_clean":"2023-12-16T03:27:03.052538+0000","last_became_active":"2023-12-16T03:27:01.539210+0000","last_became_peered":"2023-12-16T03:27:01.539210+0000","last_unstale":"2023-12-16T03:27:03.052538+0000","last_undegraded":"2023-12-16T03:27:03.052538+0000","last_fullsized":"2023-12-16T03:27:03.052538+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052446+0000","last_change":"2023-12-16T03:27:01.521374+0000","last_active":"2023-12-16T03:27:03.052446+0000","last_peered":"2023-12-16T03:27:03.052446+0000","last_clean":"2023-12-16T03:27:03.052446+0000","last_became_active":"2023-12-16T03:27:01.521080+0000","last_became_peered":"2023-12-16T03:27:01.521080+0000","last_unstale":"2023-12-16T03:27:03.052446+0000","last_undegraded":"2023-12-16T03:27:03.052446+0000","last_fullsized":"2023-12-16T03:27:03.052446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:47.409565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829472+0000","last_change":"2023-12-16T03:27:01.537212+0000","last_active":"2023-12-16T03:27:02.829472+0000","last_peered":"2023-12-16T03:27:02.829472+0000","last_clean":"2023-12-16T03:27:02.829472+0000","last_became_active":"2023-12-16T03:27:01.536927+0000","last_became_peered":"2023-12-16T03:27:01.536927+0000","last_unstale":"2023-12-16T03:27:02.829472+0000","last_undegraded":"2023-12-16T03:27:02.829472+0000","last_fullsized":"2023-12-16T03:27:02.829472+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:59.764629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828835+0000","last_change":"2023-12-16T03:27:01.506167+0000","last_active":"2023-12-16T03:27:02.828835+0000","last_peered":"2023-12-16T03:27:02.828835+0000","last_clean":"2023-12-16T03:27:02.828835+0000","last_became_active":"2023-12-16T03:27:01.505856+0000","last_became_peered":"2023-12-16T03:27:01.505856+0000","last_unstale":"2023-12-16T03:27:02.828835+0000","last_undegraded":"2023-12-16T03:27:02.828835+0000","last_fullsized":"2023-12-16T03:27:02.828835+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052711+0000","last_change":"2023-12-16T03:27:01.514340+0000","last_active":"2023-12-16T03:27:03.052711+0000","last_peered":"2023-12-16T03:27:03.052711+0000","last_clean":"2023-12-16T03:27:03.052711+0000","last_became_active":"2023-12-16T03:27:01.514047+0000","last_became_peered":"2023-12-16T03:27:01.514047+0000","last_unstale":"2023-12-16T03:27:03.052711+0000","last_undegraded":"2023-12-16T03:27:03.052711+0000","last_fullsized":"2023-12-16T03:27:03.052711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829435+0000","last_change":"2023-12-16T03:27:01.531612+0000","last_active":"2023-12-16T03:27:02.829435+0000","last_peered":"2023-12-16T03:27:02.829435+0000","last_clean":"2023-12-16T03:27:02.829435+0000","last_became_active":"2023-12-16T03:27:01.531274+0000","last_became_peered":"2023-12-16T03:27:01.531274+0000","last_unstale":"2023-12-16T03:27:02.829435+0000","last_undegraded":"2023-12-16T03:27:02.829435+0000","last_fullsized":"2023-12-16T03:27:02.829435+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:58.878396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830436+0000","last_change":"2023-12-16T03:27:01.527562+0000","last_active":"2023-12-16T03:27:02.830436+0000","last_peered":"2023-12-16T03:27:02.830436+0000","last_clean":"2023-12-16T03:27:02.830436+0000","last_became_active":"2023-12-16T03:27:01.525171+0000","last_became_peered":"2023-12-16T03:27:01.525171+0000","last_unstale":"2023-12-16T03:27:02.830436+0000","last_undegraded":"2023-12-16T03:27:02.830436+0000","last_fullsized":"2023-12-16T03:27:02.830436+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:02:55.385594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053042+0000","last_change":"2023-12-16T03:27:01.518371+0000","last_active":"2023-12-16T03:27:03.053042+0000","last_peered":"2023-12-16T03:27:03.053042+0000","last_clean":"2023-12-16T03:27:03.053042+0000","last_became_active":"2023-12-16T03:27:01.518088+0000","last_became_peered":"2023-12-16T03:27:01.518088+0000","last_unstale":"2023-12-16T03:27:03.053042+0000","last_undegraded":"2023-12-16T03:27:03.053042+0000","last_fullsized":"2023-12-16T03:27:03.053042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.829405+0000","last_change":"2023-12-16T03:27:01.532530+0000","last_active":"2023-12-16T03:27:02.829405+0000","last_peered":"2023-12-16T03:27:02.829405+0000","last_clean":"2023-12-16T03:27:02.829405+0000","last_became_active":"2023-12-16T03:27:01.532228+0000","last_became_peered":"2023-12-16T03:27:01.532228+0000","last_unstale":"2023-12-16T03:27:02.829405+0000","last_undegraded":"2023-12-16T03:27:02.829405+0000","last_fullsized":"2023-12-16T03:27:02.829405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.578189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052711+0000","last_change":"2023-12-16T03:27:01.526590+0000","last_active":"2023-12-16T03:27:03.052711+0000","last_peered":"2023-12-16T03:27:03.052711+0000","last_clean":"2023-12-16T03:27:03.052711+0000","last_became_active":"2023-12-16T03:27:01.525400+0000","last_became_peered":"2023-12-16T03:27:01.525400+0000","last_unstale":"2023-12-16T03:27:03.052711+0000","last_undegraded":"2023-12-16T03:27:03.052711+0000","last_fullsized":"2023-12-16T03:27:03.052711+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:46.909657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568670+0000","last_change":"2023-12-16T03:27:12.568670+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568670+0000","last_undegraded":"2023-12-16T03:27:12.568670+0000","last_fullsized":"2023-12-16T03:27:12.568670+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053156+0000","last_change":"2023-12-16T03:27:01.519301+0000","last_active":"2023-12-16T03:27:03.053156+0000","last_peered":"2023-12-16T03:27:03.053156+0000","last_clean":"2023-12-16T03:27:03.053156+0000","last_became_active":"2023-12-16T03:27:01.519011+0000","last_became_peered":"2023-12-16T03:27:01.519011+0000","last_unstale":"2023-12-16T03:27:03.053156+0000","last_undegraded":"2023-12-16T03:27:03.053156+0000","last_fullsized":"2023-12-16T03:27:03.053156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:34.578819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053311+0000","last_change":"2023-12-16T03:27:00.515238+0000","last_active":"2023-12-16T03:27:03.053311+0000","last_peered":"2023-12-16T03:27:03.053311+0000","last_clean":"2023-12-16T03:27:03.053311+0000","last_became_active":"2023-12-16T03:27:00.514968+0000","last_became_peered":"2023-12-16T03:27:00.514968+0000","last_unstale":"2023-12-16T03:27:03.053311+0000","last_undegraded":"2023-12-16T03:27:03.053311+0000","last_fullsized":"2023-12-16T03:27:03.053311+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574048+0000","last_change":"2023-12-16T03:27:12.574048+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574048+0000","last_undegraded":"2023-12-16T03:27:12.574048+0000","last_fullsized":"2023-12-16T03:27:12.574048+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053623+0000","last_change":"2023-12-16T03:27:01.522872+0000","last_active":"2023-12-16T03:27:03.053623+0000","last_peered":"2023-12-16T03:27:03.053623+0000","last_clean":"2023-12-16T03:27:03.053623+0000","last_became_active":"2023-12-16T03:27:01.522260+0000","last_became_peered":"2023-12-16T03:27:01.522260+0000","last_unstale":"2023-12-16T03:27:03.053623+0000","last_undegraded":"2023-12-16T03:27:03.053623+0000","last_fullsized":"2023-12-16T03:27:03.053623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:50.778695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830478+0000","last_change":"2023-12-16T03:27:00.521097+0000","last_active":"2023-12-16T03:27:02.830478+0000","last_peered":"2023-12-16T03:27:02.830478+0000","last_clean":"2023-12-16T03:27:02.830478+0000","last_became_active":"2023-12-16T03:27:00.520800+0000","last_became_peered":"2023-12-16T03:27:00.520800+0000","last_unstale":"2023-12-16T03:27:02.830478+0000","last_undegraded":"2023-12-16T03:27:02.830478+0000","last_fullsized":"2023-12-16T03:27:02.830478+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:38:52.347850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574268+0000","last_change":"2023-12-16T03:27:12.574268+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574268+0000","last_undegraded":"2023-12-16T03:27:12.574268+0000","last_fullsized":"2023-12-16T03:27:12.574268+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052934+0000","last_change":"2023-12-16T03:27:01.528475+0000","last_active":"2023-12-16T03:27:03.052934+0000","last_peered":"2023-12-16T03:27:03.052934+0000","last_clean":"2023-12-16T03:27:03.052934+0000","last_became_active":"2023-12-16T03:27:01.527985+0000","last_became_peered":"2023-12-16T03:27:01.527985+0000","last_unstale":"2023-12-16T03:27:03.052934+0000","last_undegraded":"2023-12-16T03:27:03.052934+0000","last_fullsized":"2023-12-16T03:27:03.052934+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:33.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053087+0000","last_change":"2023-12-16T03:27:00.516992+0000","last_active":"2023-12-16T03:27:03.053087+0000","last_peered":"2023-12-16T03:27:03.053087+0000","last_clean":"2023-12-16T03:27:03.053087+0000","last_became_active":"2023-12-16T03:27:00.515339+0000","last_became_peered":"2023-12-16T03:27:00.515339+0000","last_unstale":"2023-12-16T03:27:03.053087+0000","last_undegraded":"2023-12-16T03:27:03.053087+0000","last_fullsized":"2023-12-16T03:27:03.053087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:58.358317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573237+0000","last_change":"2023-12-16T03:27:12.573237+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573237+0000","last_undegraded":"2023-12-16T03:27:12.573237+0000","last_fullsized":"2023-12-16T03:27:12.573237+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052856+0000","last_change":"2023-12-16T03:27:01.522006+0000","last_active":"2023-12-16T03:27:03.052856+0000","last_peered":"2023-12-16T03:27:03.052856+0000","last_clean":"2023-12-16T03:27:03.052856+0000","last_became_active":"2023-12-16T03:27:01.520949+0000","last_became_peered":"2023-12-16T03:27:01.520949+0000","last_unstale":"2023-12-16T03:27:03.052856+0000","last_undegraded":"2023-12-16T03:27:03.052856+0000","last_fullsized":"2023-12-16T03:27:03.052856+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:29.951188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828778+0000","last_change":"2023-12-16T03:27:00.515665+0000","last_active":"2023-12-16T03:27:02.828778+0000","last_peered":"2023-12-16T03:27:02.828778+0000","last_clean":"2023-12-16T03:27:02.828778+0000","last_became_active":"2023-12-16T03:27:00.514766+0000","last_became_peered":"2023-12-16T03:27:00.514766+0000","last_unstale":"2023-12-16T03:27:02.828778+0000","last_undegraded":"2023-12-16T03:27:02.828778+0000","last_fullsized":"2023-12-16T03:27:02.828778+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:54.339391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574727+0000","last_change":"2023-12-16T03:27:12.574727+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574727+0000","last_undegraded":"2023-12-16T03:27:12.574727+0000","last_fullsized":"2023-12-16T03:27:12.574727+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830400+0000","last_change":"2023-12-16T03:27:01.523755+0000","last_active":"2023-12-16T03:27:02.830400+0000","last_peered":"2023-12-16T03:27:02.830400+0000","last_clean":"2023-12-16T03:27:02.830400+0000","last_became_active":"2023-12-16T03:27:01.523179+0000","last_became_peered":"2023-12-16T03:27:01.523179+0000","last_unstale":"2023-12-16T03:27:02.830400+0000","last_undegraded":"2023-12-16T03:27:02.830400+0000","last_fullsized":"2023-12-16T03:27:02.830400+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:20:11.416554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828595+0000","last_change":"2023-12-16T03:27:00.512400+0000","last_active":"2023-12-16T03:27:02.828595+0000","last_peered":"2023-12-16T03:27:02.828595+0000","last_clean":"2023-12-16T03:27:02.828595+0000","last_became_active":"2023-12-16T03:27:00.512120+0000","last_became_peered":"2023-12-16T03:27:00.512120+0000","last_unstale":"2023-12-16T03:27:02.828595+0000","last_undegraded":"2023-12-16T03:27:02.828595+0000","last_fullsized":"2023-12-16T03:27:02.828595+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:32:09.899662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570554+0000","last_change":"2023-12-16T03:27:12.570554+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570554+0000","last_undegraded":"2023-12-16T03:27:12.570554+0000","last_fullsized":"2023-12-16T03:27:12.570554+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830417+0000","last_change":"2023-12-16T03:27:01.536014+0000","last_active":"2023-12-16T03:27:02.830417+0000","last_peered":"2023-12-16T03:27:02.830417+0000","last_clean":"2023-12-16T03:27:02.830417+0000","last_became_active":"2023-12-16T03:27:01.535729+0000","last_became_peered":"2023-12-16T03:27:01.535729+0000","last_unstale":"2023-12-16T03:27:02.830417+0000","last_undegraded":"2023-12-16T03:27:02.830417+0000","last_fullsized":"2023-12-16T03:27:02.830417+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:22:11.774067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052634+0000","last_change":"2023-12-16T03:27:00.513060+0000","last_active":"2023-12-16T03:27:03.052634+0000","last_peered":"2023-12-16T03:27:03.052634+0000","last_clean":"2023-12-16T03:27:03.052634+0000","last_became_active":"2023-12-16T03:27:00.512780+0000","last_became_peered":"2023-12-16T03:27:00.512780+0000","last_unstale":"2023-12-16T03:27:03.052634+0000","last_undegraded":"2023-12-16T03:27:03.052634+0000","last_fullsized":"2023-12-16T03:27:03.052634+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:03.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573037+0000","last_change":"2023-12-16T03:27:12.573037+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573037+0000","last_undegraded":"2023-12-16T03:27:12.573037+0000","last_fullsized":"2023-12-16T03:27:12.573037+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052594+0000","last_change":"2023-12-16T03:27:01.520984+0000","last_active":"2023-12-16T03:27:03.052594+0000","last_peered":"2023-12-16T03:27:03.052594+0000","last_clean":"2023-12-16T03:27:03.052594+0000","last_became_active":"2023-12-16T03:27:01.520045+0000","last_became_peered":"2023-12-16T03:27:01.520045+0000","last_unstale":"2023-12-16T03:27:03.052594+0000","last_undegraded":"2023-12-16T03:27:03.052594+0000","last_fullsized":"2023-12-16T03:27:03.052594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:37.842605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828664+0000","last_change":"2023-12-16T03:27:00.513568+0000","last_active":"2023-12-16T03:27:02.828664+0000","last_peered":"2023-12-16T03:27:02.828664+0000","last_clean":"2023-12-16T03:27:02.828664+0000","last_became_active":"2023-12-16T03:27:00.513294+0000","last_became_peered":"2023-12-16T03:27:00.513294+0000","last_unstale":"2023-12-16T03:27:02.828664+0000","last_undegraded":"2023-12-16T03:27:02.828664+0000","last_fullsized":"2023-12-16T03:27:02.828664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574576+0000","last_change":"2023-12-16T03:27:12.574576+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574576+0000","last_undegraded":"2023-12-16T03:27:12.574576+0000","last_fullsized":"2023-12-16T03:27:12.574576+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830375+0000","last_change":"2023-12-16T03:27:01.526843+0000","last_active":"2023-12-16T03:27:02.830375+0000","last_peered":"2023-12-16T03:27:02.830375+0000","last_clean":"2023-12-16T03:27:02.830375+0000","last_became_active":"2023-12-16T03:27:01.525795+0000","last_became_peered":"2023-12-16T03:27:01.525795+0000","last_unstale":"2023-12-16T03:27:02.830375+0000","last_undegraded":"2023-12-16T03:27:02.830375+0000","last_fullsized":"2023-12-16T03:27:02.830375+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:53.633088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828495+0000","last_change":"2023-12-16T03:27:00.520498+0000","last_active":"2023-12-16T03:27:02.828495+0000","last_peered":"2023-12-16T03:27:02.828495+0000","last_clean":"2023-12-16T03:27:02.828495+0000","last_became_active":"2023-12-16T03:27:00.520179+0000","last_became_peered":"2023-12-16T03:27:00.520179+0000","last_unstale":"2023-12-16T03:27:02.828495+0000","last_undegraded":"2023-12-16T03:27:02.828495+0000","last_fullsized":"2023-12-16T03:27:02.828495+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:36.834249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573562+0000","last_change":"2023-12-16T03:27:12.573562+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573562+0000","last_undegraded":"2023-12-16T03:27:12.573562+0000","last_fullsized":"2023-12-16T03:27:12.573562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828634+0000","last_change":"2023-12-16T03:27:01.525335+0000","last_active":"2023-12-16T03:27:02.828634+0000","last_peered":"2023-12-16T03:27:02.828634+0000","last_clean":"2023-12-16T03:27:02.828634+0000","last_became_active":"2023-12-16T03:27:01.524994+0000","last_became_peered":"2023-12-16T03:27:01.524994+0000","last_unstale":"2023-12-16T03:27:02.828634+0000","last_undegraded":"2023-12-16T03:27:02.828634+0000","last_fullsized":"2023-12-16T03:27:02.828634+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:08.574639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053413+0000","last_change":"2023-12-16T03:27:00.516706+0000","last_active":"2023-12-16T03:27:03.053413+0000","last_peered":"2023-12-16T03:27:03.053413+0000","last_clean":"2023-12-16T03:27:03.053413+0000","last_became_active":"2023-12-16T03:27:00.516403+0000","last_became_peered":"2023-12-16T03:27:00.516403+0000","last_unstale":"2023-12-16T03:27:03.053413+0000","last_undegraded":"2023-12-16T03:27:03.053413+0000","last_fullsized":"2023-12-16T03:27:03.053413+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:27.966699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574730+0000","last_change":"2023-12-16T03:27:12.574730+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574730+0000","last_undegraded":"2023-12-16T03:27:12.574730+0000","last_fullsized":"2023-12-16T03:27:12.574730+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053478+0000","last_change":"2023-12-16T03:27:01.526628+0000","last_active":"2023-12-16T03:27:03.053478+0000","last_peered":"2023-12-16T03:27:03.053478+0000","last_clean":"2023-12-16T03:27:03.053478+0000","last_became_active":"2023-12-16T03:27:01.526319+0000","last_became_peered":"2023-12-16T03:27:01.526319+0000","last_unstale":"2023-12-16T03:27:03.053478+0000","last_undegraded":"2023-12-16T03:27:03.053478+0000","last_fullsized":"2023-12-16T03:27:03.053478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:32.633580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830487+0000","last_change":"2023-12-16T03:27:00.524203+0000","last_active":"2023-12-16T03:27:02.830487+0000","last_peered":"2023-12-16T03:27:02.830487+0000","last_clean":"2023-12-16T03:27:02.830487+0000","last_became_active":"2023-12-16T03:27:00.523807+0000","last_became_peered":"2023-12-16T03:27:00.523807+0000","last_unstale":"2023-12-16T03:27:02.830487+0000","last_undegraded":"2023-12-16T03:27:02.830487+0000","last_fullsized":"2023-12-16T03:27:02.830487+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:07:50.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.569019+0000","last_change":"2023-12-16T03:27:12.569019+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.569019+0000","last_undegraded":"2023-12-16T03:27:12.569019+0000","last_fullsized":"2023-12-16T03:27:12.569019+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053160+0000","last_change":"2023-12-16T03:27:01.533076+0000","last_active":"2023-12-16T03:27:03.053160+0000","last_peered":"2023-12-16T03:27:03.053160+0000","last_clean":"2023-12-16T03:27:03.053160+0000","last_became_active":"2023-12-16T03:27:01.532721+0000","last_became_peered":"2023-12-16T03:27:01.532721+0000","last_unstale":"2023-12-16T03:27:03.053160+0000","last_undegraded":"2023-12-16T03:27:03.053160+0000","last_fullsized":"2023-12-16T03:27:03.053160+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:37.842605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053510+0000","last_change":"2023-12-16T03:27:00.521385+0000","last_active":"2023-12-16T03:27:03.053510+0000","last_peered":"2023-12-16T03:27:03.053510+0000","last_clean":"2023-12-16T03:27:03.053510+0000","last_became_active":"2023-12-16T03:27:00.521116+0000","last_became_peered":"2023-12-16T03:27:00.521116+0000","last_unstale":"2023-12-16T03:27:03.053510+0000","last_undegraded":"2023-12-16T03:27:03.053510+0000","last_fullsized":"2023-12-16T03:27:03.053510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573979+0000","last_change":"2023-12-16T03:27:12.573979+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573979+0000","last_undegraded":"2023-12-16T03:27:12.573979+0000","last_fullsized":"2023-12-16T03:27:12.573979+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053295+0000","last_change":"2023-12-16T03:27:01.522382+0000","last_active":"2023-12-16T03:27:03.053295+0000","last_peered":"2023-12-16T03:27:03.053295+0000","last_clean":"2023-12-16T03:27:03.053295+0000","last_became_active":"2023-12-16T03:27:01.522101+0000","last_became_peered":"2023-12-16T03:27:01.522101+0000","last_unstale":"2023-12-16T03:27:03.053295+0000","last_undegraded":"2023-12-16T03:27:03.053295+0000","last_fullsized":"2023-12-16T03:27:03.053295+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:29.951188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":21,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:09.416701+0000","last_change":"2023-12-16T03:27:00.514824+0000","last_active":"2023-12-16T03:27:09.416701+0000","last_peered":"2023-12-16T03:27:09.416701+0000","last_clean":"2023-12-16T03:27:09.416701+0000","last_became_active":"2023-12-16T03:27:00.514574+0000","last_became_peered":"2023-12-16T03:27:00.514574+0000","last_unstale":"2023-12-16T03:27:09.416701+0000","last_undegraded":"2023-12-16T03:27:09.416701+0000","last_fullsized":"2023-12-16T03:27:09.416701+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:49.770339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.569118+0000","last_change":"2023-12-16T03:27:12.569118+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.569118+0000","last_undegraded":"2023-12-16T03:27:12.569118+0000","last_fullsized":"2023-12-16T03:27:12.569118+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828701+0000","last_change":"2023-12-16T03:27:01.523308+0000","last_active":"2023-12-16T03:27:02.828701+0000","last_peered":"2023-12-16T03:27:02.828701+0000","last_clean":"2023-12-16T03:27:02.828701+0000","last_became_active":"2023-12-16T03:27:01.522582+0000","last_became_peered":"2023-12-16T03:27:01.522582+0000","last_unstale":"2023-12-16T03:27:02.828701+0000","last_undegraded":"2023-12-16T03:27:02.828701+0000","last_fullsized":"2023-12-16T03:27:02.828701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:44.457252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830426+0000","last_change":"2023-12-16T03:27:00.524023+0000","last_active":"2023-12-16T03:27:02.830426+0000","last_peered":"2023-12-16T03:27:02.830426+0000","last_clean":"2023-12-16T03:27:02.830426+0000","last_became_active":"2023-12-16T03:27:00.523742+0000","last_became_peered":"2023-12-16T03:27:00.523742+0000","last_unstale":"2023-12-16T03:27:02.830426+0000","last_undegraded":"2023-12-16T03:27:02.830426+0000","last_fullsized":"2023-12-16T03:27:02.830426+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:09:52.558814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568829+0000","last_change":"2023-12-16T03:27:12.568829+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568829+0000","last_undegraded":"2023-12-16T03:27:12.568829+0000","last_fullsized":"2023-12-16T03:27:12.568829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053099+0000","last_change":"2023-12-16T03:27:01.519766+0000","last_active":"2023-12-16T03:27:03.053099+0000","last_peered":"2023-12-16T03:27:03.053099+0000","last_clean":"2023-12-16T03:27:03.053099+0000","last_became_active":"2023-12-16T03:27:01.519473+0000","last_became_peered":"2023-12-16T03:27:01.519473+0000","last_unstale":"2023-12-16T03:27:03.053099+0000","last_undegraded":"2023-12-16T03:27:03.053099+0000","last_fullsized":"2023-12-16T03:27:03.053099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052412+0000","last_change":"2023-12-16T03:27:00.518062+0000","last_active":"2023-12-16T03:27:03.052412+0000","last_peered":"2023-12-16T03:27:03.052412+0000","last_clean":"2023-12-16T03:27:03.052412+0000","last_became_active":"2023-12-16T03:27:00.517664+0000","last_became_peered":"2023-12-16T03:27:00.517664+0000","last_unstale":"2023-12-16T03:27:03.052412+0000","last_undegraded":"2023-12-16T03:27:03.052412+0000","last_fullsized":"2023-12-16T03:27:03.052412+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:47:04.667881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574778+0000","last_change":"2023-12-16T03:27:12.574778+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574778+0000","last_undegraded":"2023-12-16T03:27:12.574778+0000","last_fullsized":"2023-12-16T03:27:12.574778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828470+0000","last_change":"2023-12-16T03:27:01.514600+0000","last_active":"2023-12-16T03:27:02.828470+0000","last_peered":"2023-12-16T03:27:02.828470+0000","last_clean":"2023-12-16T03:27:02.828470+0000","last_became_active":"2023-12-16T03:27:01.514262+0000","last_became_peered":"2023-12-16T03:27:01.514262+0000","last_unstale":"2023-12-16T03:27:02.828470+0000","last_undegraded":"2023-12-16T03:27:02.828470+0000","last_fullsized":"2023-12-16T03:27:02.828470+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:28.975055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828684+0000","last_change":"2023-12-16T03:27:00.514189+0000","last_active":"2023-12-16T03:27:02.828684+0000","last_peered":"2023-12-16T03:27:02.828684+0000","last_clean":"2023-12-16T03:27:02.828684+0000","last_became_active":"2023-12-16T03:27:00.513862+0000","last_became_peered":"2023-12-16T03:27:00.513862+0000","last_unstale":"2023-12-16T03:27:02.828684+0000","last_undegraded":"2023-12-16T03:27:02.828684+0000","last_fullsized":"2023-12-16T03:27:02.828684+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574099+0000","last_change":"2023-12-16T03:27:12.574099+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574099+0000","last_undegraded":"2023-12-16T03:27:12.574099+0000","last_fullsized":"2023-12-16T03:27:12.574099+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052577+0000","last_change":"2023-12-16T03:27:01.540186+0000","last_active":"2023-12-16T03:27:03.052577+0000","last_peered":"2023-12-16T03:27:03.052577+0000","last_clean":"2023-12-16T03:27:03.052577+0000","last_became_active":"2023-12-16T03:27:01.539206+0000","last_became_peered":"2023-12-16T03:27:01.539206+0000","last_unstale":"2023-12-16T03:27:03.052577+0000","last_undegraded":"2023-12-16T03:27:03.052577+0000","last_fullsized":"2023-12-16T03:27:03.052577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":21,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052488+0000","last_change":"2023-12-16T03:27:00.515681+0000","last_active":"2023-12-16T03:27:03.052488+0000","last_peered":"2023-12-16T03:27:03.052488+0000","last_clean":"2023-12-16T03:27:03.052488+0000","last_became_active":"2023-12-16T03:27:00.515413+0000","last_became_peered":"2023-12-16T03:27:00.515413+0000","last_unstale":"2023-12-16T03:27:03.052488+0000","last_undegraded":"2023-12-16T03:27:03.052488+0000","last_fullsized":"2023-12-16T03:27:03.052488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574928+0000","last_change":"2023-12-16T03:27:12.574928+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574928+0000","last_undegraded":"2023-12-16T03:27:12.574928+0000","last_fullsized":"2023-12-16T03:27:12.574928+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053454+0000","last_change":"2023-12-16T03:27:01.518997+0000","last_active":"2023-12-16T03:27:03.053454+0000","last_peered":"2023-12-16T03:27:03.053454+0000","last_clean":"2023-12-16T03:27:03.053454+0000","last_became_active":"2023-12-16T03:27:01.518606+0000","last_became_peered":"2023-12-16T03:27:01.518606+0000","last_unstale":"2023-12-16T03:27:03.053454+0000","last_undegraded":"2023-12-16T03:27:03.053454+0000","last_fullsized":"2023-12-16T03:27:03.053454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:34.578819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830504+0000","last_change":"2023-12-16T03:27:00.522719+0000","last_active":"2023-12-16T03:27:02.830504+0000","last_peered":"2023-12-16T03:27:02.830504+0000","last_clean":"2023-12-16T03:27:02.830504+0000","last_became_active":"2023-12-16T03:27:00.522485+0000","last_became_peered":"2023-12-16T03:27:00.522485+0000","last_unstale":"2023-12-16T03:27:02.830504+0000","last_undegraded":"2023-12-16T03:27:02.830504+0000","last_fullsized":"2023-12-16T03:27:02.830504+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:48:48.483240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574072+0000","last_change":"2023-12-16T03:27:12.574072+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574072+0000","last_undegraded":"2023-12-16T03:27:12.574072+0000","last_fullsized":"2023-12-16T03:27:12.574072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828875+0000","last_change":"2023-12-16T03:27:01.525968+0000","last_active":"2023-12-16T03:27:02.828875+0000","last_peered":"2023-12-16T03:27:02.828875+0000","last_clean":"2023-12-16T03:27:02.828875+0000","last_became_active":"2023-12-16T03:27:01.523176+0000","last_became_peered":"2023-12-16T03:27:01.523176+0000","last_unstale":"2023-12-16T03:27:02.828875+0000","last_undegraded":"2023-12-16T03:27:02.828875+0000","last_fullsized":"2023-12-16T03:27:02.828875+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053080+0000","last_change":"2023-12-16T03:27:00.514506+0000","last_active":"2023-12-16T03:27:03.053080+0000","last_peered":"2023-12-16T03:27:03.053080+0000","last_clean":"2023-12-16T03:27:03.053080+0000","last_became_active":"2023-12-16T03:27:00.514121+0000","last_became_peered":"2023-12-16T03:27:00.514121+0000","last_unstale":"2023-12-16T03:27:03.053080+0000","last_undegraded":"2023-12-16T03:27:03.053080+0000","last_fullsized":"2023-12-16T03:27:03.053080+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:47:33.862583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.575351+0000","last_change":"2023-12-16T03:27:12.575351+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.575351+0000","last_undegraded":"2023-12-16T03:27:12.575351+0000","last_fullsized":"2023-12-16T03:27:12.575351+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830461+0000","last_change":"2023-12-16T03:27:01.517329+0000","last_active":"2023-12-16T03:27:02.830461+0000","last_peered":"2023-12-16T03:27:02.830461+0000","last_clean":"2023-12-16T03:27:02.830461+0000","last_became_active":"2023-12-16T03:27:01.517020+0000","last_became_peered":"2023-12-16T03:27:01.517020+0000","last_unstale":"2023-12-16T03:27:02.830461+0000","last_undegraded":"2023-12-16T03:27:02.830461+0000","last_fullsized":"2023-12-16T03:27:02.830461+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:37:11.829485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828814+0000","last_change":"2023-12-16T03:27:00.514408+0000","last_active":"2023-12-16T03:27:02.828814+0000","last_peered":"2023-12-16T03:27:02.828814+0000","last_clean":"2023-12-16T03:27:02.828814+0000","last_became_active":"2023-12-16T03:27:00.514141+0000","last_became_peered":"2023-12-16T03:27:00.514141+0000","last_unstale":"2023-12-16T03:27:02.828814+0000","last_undegraded":"2023-12-16T03:27:02.828814+0000","last_fullsized":"2023-12-16T03:27:02.828814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:10.695120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568619+0000","last_change":"2023-12-16T03:27:12.568619+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568619+0000","last_undegraded":"2023-12-16T03:27:12.568619+0000","last_fullsized":"2023-12-16T03:27:12.568619+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053441+0000","last_change":"2023-12-16T03:27:01.522466+0000","last_active":"2023-12-16T03:27:03.053441+0000","last_peered":"2023-12-16T03:27:03.053441+0000","last_clean":"2023-12-16T03:27:03.053441+0000","last_became_active":"2023-12-16T03:27:01.522111+0000","last_became_peered":"2023-12-16T03:27:01.522111+0000","last_unstale":"2023-12-16T03:27:03.053441+0000","last_undegraded":"2023-12-16T03:27:03.053441+0000","last_fullsized":"2023-12-16T03:27:03.053441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:33.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053145+0000","last_change":"2023-12-16T03:27:00.520371+0000","last_active":"2023-12-16T03:27:03.053145+0000","last_peered":"2023-12-16T03:27:03.053145+0000","last_clean":"2023-12-16T03:27:03.053145+0000","last_became_active":"2023-12-16T03:27:00.520097+0000","last_became_peered":"2023-12-16T03:27:00.520097+0000","last_unstale":"2023-12-16T03:27:03.053145+0000","last_undegraded":"2023-12-16T03:27:03.053145+0000","last_fullsized":"2023-12-16T03:27:03.053145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:32:48.297921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570732+0000","last_change":"2023-12-16T03:27:12.570732+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570732+0000","last_undegraded":"2023-12-16T03:27:12.570732+0000","last_fullsized":"2023-12-16T03:27:12.570732+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828726+0000","last_change":"2023-12-16T03:27:01.521651+0000","last_active":"2023-12-16T03:27:02.828726+0000","last_peered":"2023-12-16T03:27:02.828726+0000","last_clean":"2023-12-16T03:27:02.828726+0000","last_became_active":"2023-12-16T03:27:01.521167+0000","last_became_peered":"2023-12-16T03:27:01.521167+0000","last_unstale":"2023-12-16T03:27:02.828726+0000","last_undegraded":"2023-12-16T03:27:02.828726+0000","last_fullsized":"2023-12-16T03:27:02.828726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:42:00.543610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830444+0000","last_change":"2023-12-16T03:27:00.521885+0000","last_active":"2023-12-16T03:27:02.830444+0000","last_peered":"2023-12-16T03:27:02.830444+0000","last_clean":"2023-12-16T03:27:02.830444+0000","last_became_active":"2023-12-16T03:27:00.521503+0000","last_became_peered":"2023-12-16T03:27:00.521503+0000","last_unstale":"2023-12-16T03:27:02.830444+0000","last_undegraded":"2023-12-16T03:27:02.830444+0000","last_fullsized":"2023-12-16T03:27:02.830444+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:47.207385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573173+0000","last_change":"2023-12-16T03:27:12.573173+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573173+0000","last_undegraded":"2023-12-16T03:27:12.573173+0000","last_fullsized":"2023-12-16T03:27:12.573173+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052775+0000","last_change":"2023-12-16T03:27:01.516489+0000","last_active":"2023-12-16T03:27:03.052775+0000","last_peered":"2023-12-16T03:27:03.052775+0000","last_clean":"2023-12-16T03:27:03.052775+0000","last_became_active":"2023-12-16T03:27:01.516199+0000","last_became_peered":"2023-12-16T03:27:01.516199+0000","last_unstale":"2023-12-16T03:27:03.052775+0000","last_undegraded":"2023-12-16T03:27:03.052775+0000","last_fullsized":"2023-12-16T03:27:03.052775+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:09.981763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053056+0000","last_change":"2023-12-16T03:27:00.508945+0000","last_active":"2023-12-16T03:27:03.053056+0000","last_peered":"2023-12-16T03:27:03.053056+0000","last_clean":"2023-12-16T03:27:03.053056+0000","last_became_active":"2023-12-16T03:27:00.508638+0000","last_became_peered":"2023-12-16T03:27:00.508638+0000","last_unstale":"2023-12-16T03:27:03.053056+0000","last_undegraded":"2023-12-16T03:27:03.053056+0000","last_fullsized":"2023-12-16T03:27:03.053056+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573496+0000","last_change":"2023-12-16T03:27:12.573496+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573496+0000","last_undegraded":"2023-12-16T03:27:12.573496+0000","last_fullsized":"2023-12-16T03:27:12.573496+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053200+0000","last_change":"2023-12-16T03:27:01.518954+0000","last_active":"2023-12-16T03:27:03.053200+0000","last_peered":"2023-12-16T03:27:03.053200+0000","last_clean":"2023-12-16T03:27:03.053200+0000","last_became_active":"2023-12-16T03:27:01.518665+0000","last_became_peered":"2023-12-16T03:27:01.518665+0000","last_unstale":"2023-12-16T03:27:03.053200+0000","last_undegraded":"2023-12-16T03:27:03.053200+0000","last_fullsized":"2023-12-16T03:27:03.053200+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:32.633580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828639+0000","last_change":"2023-12-16T03:27:00.519726+0000","last_active":"2023-12-16T03:27:02.828639+0000","last_peered":"2023-12-16T03:27:02.828639+0000","last_clean":"2023-12-16T03:27:02.828639+0000","last_became_active":"2023-12-16T03:27:00.519420+0000","last_became_peered":"2023-12-16T03:27:00.519420+0000","last_unstale":"2023-12-16T03:27:02.828639+0000","last_undegraded":"2023-12-16T03:27:02.828639+0000","last_fullsized":"2023-12-16T03:27:02.828639+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:07.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570609+0000","last_change":"2023-12-16T03:27:12.570609+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570609+0000","last_undegraded":"2023-12-16T03:27:12.570609+0000","last_fullsized":"2023-12-16T03:27:12.570609+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828858+0000","last_change":"2023-12-16T03:27:01.531143+0000","last_active":"2023-12-16T03:27:02.828858+0000","last_peered":"2023-12-16T03:27:02.828858+0000","last_clean":"2023-12-16T03:27:02.828858+0000","last_became_active":"2023-12-16T03:27:01.530842+0000","last_became_peered":"2023-12-16T03:27:01.530842+0000","last_unstale":"2023-12-16T03:27:02.828858+0000","last_undegraded":"2023-12-16T03:27:02.828858+0000","last_fullsized":"2023-12-16T03:27:02.828858+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053609+0000","last_change":"2023-12-16T03:27:00.524413+0000","last_active":"2023-12-16T03:27:03.053609+0000","last_peered":"2023-12-16T03:27:03.053609+0000","last_clean":"2023-12-16T03:27:03.053609+0000","last_became_active":"2023-12-16T03:27:00.524142+0000","last_became_peered":"2023-12-16T03:27:00.524142+0000","last_unstale":"2023-12-16T03:27:03.053609+0000","last_undegraded":"2023-12-16T03:27:03.053609+0000","last_fullsized":"2023-12-16T03:27:03.053609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573254+0000","last_change":"2023-12-16T03:27:12.573254+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573254+0000","last_undegraded":"2023-12-16T03:27:12.573254+0000","last_fullsized":"2023-12-16T03:27:12.573254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828891+0000","last_change":"2023-12-16T03:27:01.518068+0000","last_active":"2023-12-16T03:27:02.828891+0000","last_peered":"2023-12-16T03:27:02.828891+0000","last_clean":"2023-12-16T03:27:02.828891+0000","last_became_active":"2023-12-16T03:27:01.516800+0000","last_became_peered":"2023-12-16T03:27:01.516800+0000","last_unstale":"2023-12-16T03:27:02.828891+0000","last_undegraded":"2023-12-16T03:27:02.828891+0000","last_fullsized":"2023-12-16T03:27:02.828891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:05.590414+0000","last_change":"2023-12-16T03:27:00.515007+0000","last_active":"2023-12-16T03:27:05.590414+0000","last_peered":"2023-12-16T03:27:05.590414+0000","last_clean":"2023-12-16T03:27:05.590414+0000","last_became_active":"2023-12-16T03:27:00.514820+0000","last_became_peered":"2023-12-16T03:27:00.514820+0000","last_unstale":"2023-12-16T03:27:05.590414+0000","last_undegraded":"2023-12-16T03:27:05.590414+0000","last_fullsized":"2023-12-16T03:27:05.590414+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:03:53.754918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574830+0000","last_change":"2023-12-16T03:27:12.574830+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574830+0000","last_undegraded":"2023-12-16T03:27:12.574830+0000","last_fullsized":"2023-12-16T03:27:12.574830+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053283+0000","last_change":"2023-12-16T03:27:01.522052+0000","last_active":"2023-12-16T03:27:03.053283+0000","last_peered":"2023-12-16T03:27:03.053283+0000","last_clean":"2023-12-16T03:27:03.053283+0000","last_became_active":"2023-12-16T03:27:01.521669+0000","last_became_peered":"2023-12-16T03:27:01.521669+0000","last_unstale":"2023-12-16T03:27:03.053283+0000","last_undegraded":"2023-12-16T03:27:03.053283+0000","last_fullsized":"2023-12-16T03:27:03.053283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:05.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052729+0000","last_change":"2023-12-16T03:27:00.516627+0000","last_active":"2023-12-16T03:27:03.052729+0000","last_peered":"2023-12-16T03:27:03.052729+0000","last_clean":"2023-12-16T03:27:03.052729+0000","last_became_active":"2023-12-16T03:27:00.516381+0000","last_became_peered":"2023-12-16T03:27:00.516381+0000","last_unstale":"2023-12-16T03:27:03.052729+0000","last_undegraded":"2023-12-16T03:27:03.052729+0000","last_fullsized":"2023-12-16T03:27:03.052729+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.569868+0000","last_change":"2023-12-16T03:27:12.569868+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.569868+0000","last_undegraded":"2023-12-16T03:27:12.569868+0000","last_fullsized":"2023-12-16T03:27:12.569868+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052986+0000","last_change":"2023-12-16T03:27:01.522194+0000","last_active":"2023-12-16T03:27:03.052986+0000","last_peered":"2023-12-16T03:27:03.052986+0000","last_clean":"2023-12-16T03:27:03.052986+0000","last_became_active":"2023-12-16T03:27:01.521667+0000","last_became_peered":"2023-12-16T03:27:01.521667+0000","last_unstale":"2023-12-16T03:27:03.052986+0000","last_undegraded":"2023-12-16T03:27:03.052986+0000","last_fullsized":"2023-12-16T03:27:03.052986+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828797+0000","last_change":"2023-12-16T03:27:00.511361+0000","last_active":"2023-12-16T03:27:02.828797+0000","last_peered":"2023-12-16T03:27:02.828797+0000","last_clean":"2023-12-16T03:27:02.828797+0000","last_became_active":"2023-12-16T03:27:00.511033+0000","last_became_peered":"2023-12-16T03:27:00.511033+0000","last_unstale":"2023-12-16T03:27:02.828797+0000","last_undegraded":"2023-12-16T03:27:02.828797+0000","last_fullsized":"2023-12-16T03:27:02.828797+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:48.295530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.568615+0000","last_change":"2023-12-16T03:27:12.568615+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.568615+0000","last_undegraded":"2023-12-16T03:27:12.568615+0000","last_fullsized":"2023-12-16T03:27:12.568615+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830408+0000","last_change":"2023-12-16T03:27:01.524848+0000","last_active":"2023-12-16T03:27:02.830408+0000","last_peered":"2023-12-16T03:27:02.830408+0000","last_clean":"2023-12-16T03:27:02.830408+0000","last_became_active":"2023-12-16T03:27:01.524561+0000","last_became_peered":"2023-12-16T03:27:01.524561+0000","last_unstale":"2023-12-16T03:27:02.830408+0000","last_undegraded":"2023-12-16T03:27:02.830408+0000","last_fullsized":"2023-12-16T03:27:02.830408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.908171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052896+0000","last_change":"2023-12-16T03:27:00.513344+0000","last_active":"2023-12-16T03:27:03.052896+0000","last_peered":"2023-12-16T03:27:03.052896+0000","last_clean":"2023-12-16T03:27:03.052896+0000","last_became_active":"2023-12-16T03:27:00.513101+0000","last_became_peered":"2023-12-16T03:27:00.513101+0000","last_unstale":"2023-12-16T03:27:03.052896+0000","last_undegraded":"2023-12-16T03:27:03.052896+0000","last_fullsized":"2023-12-16T03:27:03.052896+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:34.745808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.573469+0000","last_change":"2023-12-16T03:27:12.573469+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.573469+0000","last_undegraded":"2023-12-16T03:27:12.573469+0000","last_fullsized":"2023-12-16T03:27:12.573469+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.053255+0000","last_change":"2023-12-16T03:27:01.543099+0000","last_active":"2023-12-16T03:27:03.053255+0000","last_peered":"2023-12-16T03:27:03.053255+0000","last_clean":"2023-12-16T03:27:03.053255+0000","last_became_active":"2023-12-16T03:27:01.542711+0000","last_became_peered":"2023-12-16T03:27:01.542711+0000","last_unstale":"2023-12-16T03:27:03.053255+0000","last_undegraded":"2023-12-16T03:27:03.053255+0000","last_fullsized":"2023-12-16T03:27:03.053255+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:09.981763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.828573+0000","last_change":"2023-12-16T03:27:00.513164+0000","last_active":"2023-12-16T03:27:02.828573+0000","last_peered":"2023-12-16T03:27:02.828573+0000","last_clean":"2023-12-16T03:27:02.828573+0000","last_became_active":"2023-12-16T03:27:00.512912+0000","last_became_peered":"2023-12-16T03:27:00.512912+0000","last_unstale":"2023-12-16T03:27:02.828573+0000","last_undegraded":"2023-12-16T03:27:02.828573+0000","last_fullsized":"2023-12-16T03:27:02.828573+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.570585+0000","last_change":"2023-12-16T03:27:12.570585+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.570585+0000","last_undegraded":"2023-12-16T03:27:12.570585+0000","last_fullsized":"2023-12-16T03:27:12.570585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052586+0000","last_change":"2023-12-16T03:27:01.521887+0000","last_active":"2023-12-16T03:27:03.052586+0000","last_peered":"2023-12-16T03:27:03.052586+0000","last_clean":"2023-12-16T03:27:03.052586+0000","last_became_active":"2023-12-16T03:27:01.521554+0000","last_became_peered":"2023-12-16T03:27:01.521554+0000","last_unstale":"2023-12-16T03:27:03.052586+0000","last_undegraded":"2023-12-16T03:27:03.052586+0000","last_fullsized":"2023-12-16T03:27:03.052586+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:47.409565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052670+0000","last_change":"2023-12-16T03:27:00.512268+0000","last_active":"2023-12-16T03:27:03.052670+0000","last_peered":"2023-12-16T03:27:03.052670+0000","last_clean":"2023-12-16T03:27:03.052670+0000","last_became_active":"2023-12-16T03:27:00.511945+0000","last_became_peered":"2023-12-16T03:27:00.511945+0000","last_unstale":"2023-12-16T03:27:03.052670+0000","last_undegraded":"2023-12-16T03:27:03.052670+0000","last_fullsized":"2023-12-16T03:27:03.052670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:49:40.657817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.574958+0000","last_change":"2023-12-16T03:27:12.574958+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.574958+0000","last_undegraded":"2023-12-16T03:27:12.574958+0000","last_fullsized":"2023-12-16T03:27:12.574958+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830383+0000","last_change":"2023-12-16T03:27:01.527192+0000","last_active":"2023-12-16T03:27:02.830383+0000","last_peered":"2023-12-16T03:27:02.830383+0000","last_clean":"2023-12-16T03:27:02.830383+0000","last_became_active":"2023-12-16T03:27:01.526892+0000","last_became_peered":"2023-12-16T03:27:01.526892+0000","last_unstale":"2023-12-16T03:27:02.830383+0000","last_undegraded":"2023-12-16T03:27:02.830383+0000","last_fullsized":"2023-12-16T03:27:02.830383+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:00.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830365+0000","last_change":"2023-12-16T03:27:00.516056+0000","last_active":"2023-12-16T03:27:02.830365+0000","last_peered":"2023-12-16T03:27:02.830365+0000","last_clean":"2023-12-16T03:27:02.830365+0000","last_became_active":"2023-12-16T03:27:00.515763+0000","last_became_peered":"2023-12-16T03:27:00.515763+0000","last_unstale":"2023-12-16T03:27:02.830365+0000","last_undegraded":"2023-12-16T03:27:02.830365+0000","last_fullsized":"2023-12-16T03:27:02.830365+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:42.045050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:13.565300+0000","last_change":"2023-12-16T03:27:13.565300+0000","last_active":"2023-12-16T03:27:13.565300+0000","last_peered":"2023-12-16T03:27:13.565300+0000","last_clean":"2023-12-16T03:27:13.565300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:13.565300+0000","last_undegraded":"2023-12-16T03:27:13.565300+0000","last_fullsized":"2023-12-16T03:27:13.565300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-12-16T03:27:12.575249+0000","last_change":"2023-12-16T03:27:12.575249+0000","last_active":"2023-12-16T03:27:12.557676+0000","last_peered":"2023-12-16T03:27:12.557676+0000","last_clean":"2023-12-16T03:27:12.557676+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:12.575249+0000","last_undegraded":"2023-12-16T03:27:12.575249+0000","last_fullsized":"2023-12-16T03:27:12.575249+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:02.830356+0000","last_change":"2023-12-16T03:27:01.520522+0000","last_active":"2023-12-16T03:27:02.830356+0000","last_peered":"2023-12-16T03:27:02.830356+0000","last_clean":"2023-12-16T03:27:02.830356+0000","last_became_active":"2023-12-16T03:27:01.520214+0000","last_became_peered":"2023-12-16T03:27:01.520214+0000","last_unstale":"2023-12-16T03:27:02.830356+0000","last_undegraded":"2023-12-16T03:27:02.830356+0000","last_fullsized":"2023-12-16T03:27:02.830356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:42.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:03.052580+0000","last_change":"2023-12-16T03:27:00.514945+0000","last_active":"2023-12-16T03:27:03.052580+0000","last_peered":"2023-12-16T03:27:03.052580+0000","last_clean":"2023-12-16T03:27:03.052580+0000","last_became_active":"2023-12-16T03:27:00.514688+0000","last_became_peered":"2023-12-16T03:27:00.514688+0000","last_unstale":"2023-12-16T03:27:03.052580+0000","last_undegraded":"2023-12-16T03:27:03.052580+0000","last_fullsized":"2023-12-16T03:27:03.052580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-16T03:27:07.829384+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:27:07.829384+0000","last_peered":"2023-12-16T03:27:07.829384+0000","last_clean":"2023-12-16T03:27:07.829384+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:27:07.829384+0000","last_undegraded":"2023-12-16T03:27:07.829384+0000","last_fullsized":"2023-12-16T03:27:07.829384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":842361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":1.155,"15min":1.155},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90700000000000003,"5min":1.585,"15min":1.585},"last":0.62}]},{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88200000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.81299999999999994,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85099999999999998,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77300000000000002,"15min":0.79100000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.79600000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92700000000000005,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.51700000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96299999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94399999999999995,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81899999999999995,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.874,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46800000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.004,"15min":1.004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.89300000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":598016,"data_stored":251833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.437,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93400000000000005,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93799999999999994,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82899999999999996,"15min":0.85499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95399999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":1.02,"15min":1.075},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96299999999999997,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.98099999999999998,"15min":1.0289999999999999},"min":{"1min":0.51200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.042,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.069,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.87,"15min":0.89700000000000002},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":4.242,"15min":4.242},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.90300000000000002,"15min":0.93500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92600000000000005,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88100000000000001,"5min":1.111,"15min":1.111},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.52300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":1.073,"15min":1.073},"last":0.62}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.077,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.99099999999999999,"5min":1.246,"15min":1.246},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.74399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":259156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.60999999999999999},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.77300000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.872},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1,"15min":1},"last":0.82199999999999995}]},{"osd":2,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":1.004}]},{"osd":3,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.93999999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74399999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.755,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64000000000000001,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73599999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.748},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.79200000000000004}]},{"osd":7,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.82399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.89100000000000001,"5min":1.105,"15min":1.105},"last":0.95999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":610304,"data_stored":254940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.78200000000000003,"15min":0.81000000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":4.194,"15min":4.194},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85299999999999998,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.60599999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.91500000000000004,"5min":1.288,"15min":1.288},"last":0.745}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.93500000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84399999999999997,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.92500000000000004,"15min":0.96199999999999997},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86099999999999999,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.80000000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.92800000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.751,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.44600000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96499999999999997,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88600000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.871}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88900000000000001,"5min":1.881,"15min":1.881},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.81999999999999995,"15min":0.83999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":606208,"data_stored":251889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.747,"15min":0.80400000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67700000000000005,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.80900000000000005,"15min":0.871},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.52200000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.66700000000000004,"15min":0.70499999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63500000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.442},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.66300000000000003,"15min":0.68400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.72999999999999998,"15min":0.76500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.496}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94999999999999996,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.629},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.048,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.89400000000000002,"15min":0.92200000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.89500000000000002,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.86899999999999999,"15min":0.89100000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.006,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.92500000000000004,"15min":0.95299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97499999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.93400000000000005,"15min":0.96399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94499999999999995,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.95299999999999996,"15min":0.97999999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0609999999999999,"5min":3.375,"15min":3.375},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":618496,"data_stored":258560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48399999999999999,"15min":0.48499999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.875,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.312}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.503,"15min":0.498},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.36199999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.502},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.022},"last":0.46800000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77200000000000002,"15min":0.77700000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1060000000000001,"5min":1.587,"15min":1.587},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0609999999999999,"5min":1.913,"15min":1.913},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.55500000000000005}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.179,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.04,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.58699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":614400,"data_stored":258594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.60999999999999999,"15min":0.64200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97199999999999998,"5min":4.476,"15min":4.476},"last":0.499}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.80800000000000005,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73899999999999999,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.749,"15min":0.79300000000000004},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.70299999999999996,"15min":0.73399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.66700000000000004,"15min":0.70099999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.436}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.03,"15min":1.0820000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0840000000000001,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.93799999999999994,"15min":0.97199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.133,"5min":4.984,"15min":4.984},"last":0.63800000000000001}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.90200000000000002,"15min":0.93999999999999995},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.996,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.745,"5min":1.089,"15min":1.147},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0209999999999999,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.95199999999999996,"15min":0.98899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0880000000000001,"15min":1.147},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95299999999999996,"5min":7.681,"15min":7.681},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":1.0369999999999999,"15min":1.077},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.177,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.995,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.98199999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.67600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1208320,"data_stored":845890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.751,"15min":0.80900000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68200000000000005,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.89300000000000002,"15min":0.95899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70699999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.93000000000000005,"15min":0.999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.028,"15min":1.1100000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82199999999999995,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.92800000000000005,"15min":1.0109999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57399999999999995,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.316},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.78100000000000003,"15min":0.82599999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":3.254,"15min":3.254},"last":0.59699999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95099999999999996,"15min":0.98599999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.0900000000000001,"15min":1.151},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.98499999999999999,"15min":1.036},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97499999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97899999999999998,"15min":1.0249999999999999},"min":{"1min":0.54700000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.171,"15min":1.2450000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94399999999999995,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":1.181,"15min":1.2490000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95899999999999996,"5min":4.444,"15min":4.444},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0109999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:27:19.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-12-16T03:27:19.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-12-16T03:27:19.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-12-16T03:27:19.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-12-16T03:27:19.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-12-16T03:27:19.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-12-16T03:27:19.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-12-16T03:27:19.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-12-16T03:27:19.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-12-16T03:27:19.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-12-16T03:27:19.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-12-16T03:27:19.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-12-16T03:27:19.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-12-16T03:27:19.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-12-16T03:27:19.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-12-16T03:27:19.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-12-16T03:27:19.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-12-16T03:27:19.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-12-16T03:27:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-12-16T03:27:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-12-16T03:27:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-12-16T03:27:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-12-16T03:27:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-12-16T03:27:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-12-16T03:27:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-12-16T03:27:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-12-16T03:27:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-12-16T03:27:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-12-16T03:27:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.568670+0000', 'last_change': '2023-12-16T03:27:12.568670+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.568670+0000', 'last_undegraded': '2023-12-16T03:27:12.568670+0000', 'last_fullsized': '2023-12-16T03:27:12.568670+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:27:19.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-12-16T03:27:19.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-12-16T03:27:19.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.574048+0000', 'last_change': '2023-12-16T03:27:12.574048+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.574048+0000', 'last_undegraded': '2023-12-16T03:27:12.574048+0000', 'last_fullsized': '2023-12-16T03:27:12.574048+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:27:19.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-12-16T03:27:19.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-12-16T03:27:19.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.574268+0000', 'last_change': '2023-12-16T03:27:12.574268+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.574268+0000', 'last_undegraded': '2023-12-16T03:27:12.574268+0000', 'last_fullsized': '2023-12-16T03:27:12.574268+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:27:19.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-12-16T03:27:19.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-12-16T03:27:19.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.573237+0000', 'last_change': '2023-12-16T03:27:12.573237+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.573237+0000', 'last_undegraded': '2023-12-16T03:27:12.573237+0000', 'last_fullsized': '2023-12-16T03:27:12.573237+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-16T03:27:19.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-12-16T03:27:19.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-12-16T03:27:19.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.574727+0000', 'last_change': '2023-12-16T03:27:12.574727+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.574727+0000', 'last_undegraded': '2023-12-16T03:27:12.574727+0000', 'last_fullsized': '2023-12-16T03:27:12.574727+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:27:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-12-16T03:27:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-12-16T03:27:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.570554+0000', 'last_change': '2023-12-16T03:27:12.570554+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.570554+0000', 'last_undegraded': '2023-12-16T03:27:12.570554+0000', 'last_fullsized': '2023-12-16T03:27:12.570554+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-16T03:27:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-12-16T03:27:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-12-16T03:27:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.573037+0000', 'last_change': '2023-12-16T03:27:12.573037+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.573037+0000', 'last_undegraded': '2023-12-16T03:27:12.573037+0000', 'last_fullsized': '2023-12-16T03:27:12.573037+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:27:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-12-16T03:27:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-12-16T03:27:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.574576+0000', 'last_change': '2023-12-16T03:27:12.574576+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.574576+0000', 'last_undegraded': '2023-12-16T03:27:12.574576+0000', 'last_fullsized': '2023-12-16T03:27:12.574576+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:27:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-12-16T03:27:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-12-16T03:27:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.573562+0000', 'last_change': '2023-12-16T03:27:12.573562+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.573562+0000', 'last_undegraded': '2023-12-16T03:27:12.573562+0000', 'last_fullsized': '2023-12-16T03:27:12.573562+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-16T03:27:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-12-16T03:27:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-12-16T03:27:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.574730+0000', 'last_change': '2023-12-16T03:27:12.574730+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.574730+0000', 'last_undegraded': '2023-12-16T03:27:12.574730+0000', 'last_fullsized': '2023-12-16T03:27:12.574730+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:27:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-12-16T03:27:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-12-16T03:27:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.569019+0000', 'last_change': '2023-12-16T03:27:12.569019+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.569019+0000', 'last_undegraded': '2023-12-16T03:27:12.569019+0000', 'last_fullsized': '2023-12-16T03:27:12.569019+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:27:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-12-16T03:27:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-12-16T03:27:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.573979+0000', 'last_change': '2023-12-16T03:27:12.573979+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.573979+0000', 'last_undegraded': '2023-12-16T03:27:12.573979+0000', 'last_fullsized': '2023-12-16T03:27:12.573979+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:27:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-12-16T03:27:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-12-16T03:27:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.569118+0000', 'last_change': '2023-12-16T03:27:12.569118+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.569118+0000', 'last_undegraded': '2023-12-16T03:27:12.569118+0000', 'last_fullsized': '2023-12-16T03:27:12.569118+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.568829+0000', 'last_change': '2023-12-16T03:27:12.568829+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.568829+0000', 'last_undegraded': '2023-12-16T03:27:12.568829+0000', 'last_fullsized': '2023-12-16T03:27:12.568829+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.574778+0000', 'last_change': '2023-12-16T03:27:12.574778+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.574778+0000', 'last_undegraded': '2023-12-16T03:27:12.574778+0000', 'last_fullsized': '2023-12-16T03:27:12.574778+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-12-16T03:27:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.574099+0000', 'last_change': '2023-12-16T03:27:12.574099+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.574099+0000', 'last_undegraded': '2023-12-16T03:27:12.574099+0000', 'last_fullsized': '2023-12-16T03:27:12.574099+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:27:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-12-16T03:27:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-12-16T03:27:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.574928+0000', 'last_change': '2023-12-16T03:27:12.574928+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.574928+0000', 'last_undegraded': '2023-12-16T03:27:12.574928+0000', 'last_fullsized': '2023-12-16T03:27:12.574928+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:27:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-12-16T03:27:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-12-16T03:27:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.574072+0000', 'last_change': '2023-12-16T03:27:12.574072+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.574072+0000', 'last_undegraded': '2023-12-16T03:27:12.574072+0000', 'last_fullsized': '2023-12-16T03:27:12.574072+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-16T03:27:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-12-16T03:27:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.575351+0000', 'last_change': '2023-12-16T03:27:12.575351+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.575351+0000', 'last_undegraded': '2023-12-16T03:27:12.575351+0000', 'last_fullsized': '2023-12-16T03:27:12.575351+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.568619+0000', 'last_change': '2023-12-16T03:27:12.568619+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.568619+0000', 'last_undegraded': '2023-12-16T03:27:12.568619+0000', 'last_fullsized': '2023-12-16T03:27:12.568619+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.570732+0000', 'last_change': '2023-12-16T03:27:12.570732+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.570732+0000', 'last_undegraded': '2023-12-16T03:27:12.570732+0000', 'last_fullsized': '2023-12-16T03:27:12.570732+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-12-16T03:27:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.573173+0000', 'last_change': '2023-12-16T03:27:12.573173+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.573173+0000', 'last_undegraded': '2023-12-16T03:27:12.573173+0000', 'last_fullsized': '2023-12-16T03:27:12.573173+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.573496+0000', 'last_change': '2023-12-16T03:27:12.573496+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.573496+0000', 'last_undegraded': '2023-12-16T03:27:12.573496+0000', 'last_fullsized': '2023-12-16T03:27:12.573496+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.570609+0000', 'last_change': '2023-12-16T03:27:12.570609+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.570609+0000', 'last_undegraded': '2023-12-16T03:27:12.570609+0000', 'last_fullsized': '2023-12-16T03:27:12.570609+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-12-16T03:27:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-12-16T03:27:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.573254+0000', 'last_change': '2023-12-16T03:27:12.573254+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.573254+0000', 'last_undegraded': '2023-12-16T03:27:12.573254+0000', 'last_fullsized': '2023-12-16T03:27:12.573254+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-16T03:27:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-12-16T03:27:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-12-16T03:27:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.574830+0000', 'last_change': '2023-12-16T03:27:12.574830+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.574830+0000', 'last_undegraded': '2023-12-16T03:27:12.574830+0000', 'last_fullsized': '2023-12-16T03:27:12.574830+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:27:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-12-16T03:27:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-12-16T03:27:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.569868+0000', 'last_change': '2023-12-16T03:27:12.569868+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.569868+0000', 'last_undegraded': '2023-12-16T03:27:12.569868+0000', 'last_fullsized': '2023-12-16T03:27:12.569868+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-16T03:27:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-12-16T03:27:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-12-16T03:27:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.568615+0000', 'last_change': '2023-12-16T03:27:12.568615+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.568615+0000', 'last_undegraded': '2023-12-16T03:27:12.568615+0000', 'last_fullsized': '2023-12-16T03:27:12.568615+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-16T03:27:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-12-16T03:27:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-12-16T03:27:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.573469+0000', 'last_change': '2023-12-16T03:27:12.573469+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.573469+0000', 'last_undegraded': '2023-12-16T03:27:12.573469+0000', 'last_fullsized': '2023-12-16T03:27:12.573469+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:27:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-12-16T03:27:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-12-16T03:27:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.570585+0000', 'last_change': '2023-12-16T03:27:12.570585+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.570585+0000', 'last_undegraded': '2023-12-16T03:27:12.570585+0000', 'last_fullsized': '2023-12-16T03:27:12.570585+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-16T03:27:19.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-12-16T03:27:19.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-12-16T03:27:19.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.574958+0000', 'last_change': '2023-12-16T03:27:12.574958+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.574958+0000', 'last_undegraded': '2023-12-16T03:27:12.574958+0000', 'last_fullsized': '2023-12-16T03:27:12.574958+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-16T03:27:19.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-12-16T03:27:19.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-16T03:27:13.565300+0000', 'last_change': '2023-12-16T03:27:13.565300+0000', 'last_active': '2023-12-16T03:27:13.565300+0000', 'last_peered': '2023-12-16T03:27:13.565300+0000', 'last_clean': '2023-12-16T03:27:13.565300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:13.565300+0000', 'last_undegraded': '2023-12-16T03:27:13.565300+0000', 'last_fullsized': '2023-12-16T03:27:13.565300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:13.565300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-16T03:27:19.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-12-16T03:27:19.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2023-12-16T03:27:12.575249+0000', 'last_change': '2023-12-16T03:27:12.575249+0000', 'last_active': '2023-12-16T03:27:12.557676+0000', 'last_peered': '2023-12-16T03:27:12.557676+0000', 'last_clean': '2023-12-16T03:27:12.557676+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-16T03:27:12.575249+0000', 'last_undegraded': '2023-12-16T03:27:12.575249+0000', 'last_fullsized': '2023-12-16T03:27:12.575249+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'last_clean_scrub_stamp': '2023-12-16T03:27:12.557676+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-16T03:27:19.551 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-16T03:27:19.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1d24fe640 1 Processor -- start 2023-12-16T03:27:19.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1d24fe640 1 -- start start 2023-12-16T03:27:19.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1d24fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe1cc151e90 0x7fe1cc0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1d24fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc0c7ea0 0x7fe1cc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1d24fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc06c860 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1d24fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0c8750 con 0x7fe1cc151e90 2023-12-16T03:27:19.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1d24fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1552d0 con 0x7fe1cc0c7ea0 2023-12-16T03:27:19.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1cb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc0c7ea0 0x7fe1cc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1cbfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe1cc151e90 0x7fe1cc0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1cb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc0c7ea0 0x7fe1cc06b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:35890/0 (socket says 172.21.15.28:35890) 2023-12-16T03:27:19.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1cb7fe640 1 -- 172.21.15.28:0/2646428347 learned_addr learned my addr 172.21.15.28:0/2646428347 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:19.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1d0a9b640 1 --1- 172.21.15.28:0/2646428347 >> v1:172.21.15.134:6789/0 conn(0x7fe1cc0c4e60 0x7fe1cc06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:34240/0 (socket says 172.21.15.28:34240) 2023-12-16T03:27:19.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1cb7fe640 1 -- 172.21.15.28:0/2646428347 >> v2:172.21.15.134:3300/0 conn(0x7fe1cc151e90 msgr2=0x7fe1cc0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:19.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1cb7fe640 1 --2- 172.21.15.28:0/2646428347 >> v2:172.21.15.134:3300/0 conn(0x7fe1cc151e90 0x7fe1cc0c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1cb7fe640 1 -- 172.21.15.28:0/2646428347 >> v1:172.21.15.134:6789/0 conn(0x7fe1cc0c4e60 legacy=0x7fe1cc06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.708+0000 7fe1cb7fe640 1 -- 172.21.15.28:0/2646428347 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc154930 con 0x7fe1cc0c7ea0 2023-12-16T03:27:19.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1cb7fe640 1 --2- 172.21.15.28:0/2646428347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc0c7ea0 0x7fe1cc06b4a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009870 tx=0x7fe1c001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5268f00e852e2ad2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:19.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1caffd640 1 -- 172.21.15.28:0/2646428347 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00ab600 con 0x7fe1cc0c7ea0 2023-12-16T03:27:19.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1caffd640 1 -- 172.21.15.28:0/2646428347 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c00a7050 con 0x7fe1cc0c7ea0 2023-12-16T03:27:19.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1caffd640 1 -- 172.21.15.28:0/2646428347 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00ab980 con 0x7fe1cc0c7ea0 2023-12-16T03:27:19.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1d24fe640 1 -- 172.21.15.28:0/2646428347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc0c7ea0 msgr2=0x7fe1cc06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1d24fe640 1 --2- 172.21.15.28:0/2646428347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc0c7ea0 0x7fe1cc06b4a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009870 tx=0x7fe1c001c420 comp rx=0 tx=0).stop 2023-12-16T03:27:19.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1d24fe640 1 -- 172.21.15.28:0/2646428347 shutdown_connections 2023-12-16T03:27:19.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1d24fe640 1 --2- 172.21.15.28:0/2646428347 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc0c7ea0 0x7fe1cc06b4a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1d24fe640 1 --2- 172.21.15.28:0/2646428347 >> v2:172.21.15.134:3300/0 conn(0x7fe1cc151e90 0x7fe1cc0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1d24fe640 1 -- 172.21.15.28:0/2646428347 >> 172.21.15.28:0/2646428347 conn(0x7fe1cc0ca170 msgr2=0x7fe1cc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:19.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1d24fe640 1 -- 172.21.15.28:0/2646428347 shutdown_connections 2023-12-16T03:27:19.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.712+0000 7fe1d24fe640 1 -- 172.21.15.28:0/2646428347 wait complete. 2023-12-16T03:27:19.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1d24fe640 1 Processor -- start 2023-12-16T03:27:19.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1d24fe640 1 -- start start 2023-12-16T03:27:19.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1d24fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1cc0c4e60 0x7fe1cc153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1d24fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0c7ea0 0x7fe1cc157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1d24fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc151e90 0x7fe1cc158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1d24fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1edbb0 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1d24fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1f10d0 con 0x7fe1cc0c7ea0 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1d24fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1ecfa0 con 0x7fe1cc151e90 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1cbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1cc0c4e60 0x7fe1cc153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1cbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1cc0c4e60 0x7fe1cc153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47198/0 (socket says 172.21.15.28:47198) 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1cbfff640 1 -- 172.21.15.28:0/3150196082 learned_addr learned my addr 172.21.15.28:0/3150196082 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1cb7fe640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0c7ea0 0x7fe1cc157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1d0a9b640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc151e90 0x7fe1cc158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1cbfff640 1 -- 172.21.15.28:0/3150196082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc151e90 msgr2=0x7fe1cc158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1cbfff640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc151e90 0x7fe1cc158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1cbfff640 1 -- 172.21.15.28:0/3150196082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0c7ea0 msgr2=0x7fe1cc157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1cbfff640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0c7ea0 0x7fe1cc157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1cbfff640 1 -- 172.21.15.28:0/3150196082 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c00094d0 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1cb7fe640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0c7ea0 0x7fe1cc157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1cbfff640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1cc0c4e60 0x7fe1cc153da0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00e930 tx=0x7fe1bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1c8ff9640 1 -- 172.21.15.28:0/3150196082 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc009690 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1c8ff9640 1 -- 172.21.15.28:0/3150196082 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc00ca00 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1c8ff9640 1 -- 172.21.15.28:0/3150196082 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc00cd70 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1d24fe640 1 -- 172.21.15.28:0/3150196082 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc1ed280 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.716+0000 7fe1d24fe640 1 -- 172.21.15.28:0/3150196082 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc1ed840 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.720+0000 7fe1d24fe640 1 -- 172.21.15.28:0/3150196082 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc068400 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.720+0000 7fe1c8ff9640 1 -- 172.21.15.28:0/3150196082 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe1bc013470 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.720+0000 7fe1c8ff9640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b80664a0 0x7fe1b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.720+0000 7fe1c8ff9640 1 -- 172.21.15.28:0/3150196082 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe1bc084370 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.720+0000 7fe1cb7fe640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b80664a0 0x7fe1b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:19.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.720+0000 7fe1cb7fe640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b80664a0 0x7fe1b8068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00ad000 tx=0x7fe1c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:19.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.724+0000 7fe1c8ff9640 1 -- 172.21.15.28:0/3150196082 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe1bc0515f0 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.936+0000 7fe1d24fe640 1 -- 172.21.15.28:0/3150196082 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe1cc158b20 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.936+0000 7fe1c8ff9640 1 -- 172.21.15.28:0/3150196082 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1694 (secure 0 0 0) 0x7fe1bc054c10 con 0x7fe1cc0c4e60 2023-12-16T03:27:19.941 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:19.942 INFO:teuthology.orchestra.run.smithi028.stdout:{"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":149,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1702697102,"num_in_osds":8,"osd_in_since":1702697093,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97},{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32}],"num_pgs":193,"num_pools":5,"num_objects":24,"data_bytes":594273,"bytes_used":244465664,"bytes_avail":772849647616,"bytes_total":773094113280,"unknown_pgs_ratio":0.33160620927810669,"inactive_pgs_ratio":0.16580310463905334,"write_bytes_sec":584,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":36,"id":4,"up":1,"in":1,"max":1,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":5641},{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5781}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-12-16T03:26:47.817354+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-16T03:27:19.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 -- 172.21.15.28:0/3150196082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b80664a0 msgr2=0x7fe1b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b80664a0 0x7fe1b8068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00ad000 tx=0x7fe1c0008040 comp rx=0 tx=0).stop 2023-12-16T03:27:19.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 -- 172.21.15.28:0/3150196082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1cc0c4e60 msgr2=0x7fe1cc153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:19.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1cc0c4e60 0x7fe1cc153da0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00e930 tx=0x7fe1bc00edf0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 -- 172.21.15.28:0/3150196082 shutdown_connections 2023-12-16T03:27:19.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1cc151e90 0x7fe1cc158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0c7ea0 0x7fe1cc157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe1b80664a0 0x7fe1b8068960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 --2- 172.21.15.28:0/3150196082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1cc0c4e60 0x7fe1cc153da0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:19.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 -- 172.21.15.28:0/3150196082 >> 172.21.15.28:0/3150196082 conn(0x7fe1cc0ca170 msgr2=0x7fe1cc14f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:19.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 -- 172.21.15.28:0/3150196082 shutdown_connections 2023-12-16T03:27:19.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:19.940+0000 7fe1d24fe640 1 -- 172.21.15.28:0/3150196082 wait complete. 2023-12-16T03:27:19.961 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-16T03:27:19.962 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:27:20.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.100+0000 7f56d11b8640 1 Processor -- start 2023-12-16T03:27:20.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.100+0000 7f56d11b8640 1 -- start start 2023-12-16T03:27:20.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56d11b8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc073a70 0x7f56cc0bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:20.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56d11b8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f56cc157c20 0x7f56cc1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:20.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56d11b8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc06a5b0 con 0x7f56cc14b010 2023-12-16T03:27:20.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56d11b8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc06b710 con 0x7f56cc157c20 2023-12-16T03:27:20.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56d11b8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0c1d60 con 0x7f56cc073a70 2023-12-16T03:27:20.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56cad9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f56cc14b010 0x7f56cc06b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44922/0 (socket says 172.21.15.28:44922) 2023-12-16T03:27:20.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56cad9d640 1 -- 172.21.15.28:0/1633476650 learned_addr learned my addr 172.21.15.28:0/1633476650 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:20.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56cb59e640 1 --2- 172.21.15.28:0/1633476650 >> v2:172.21.15.134:3300/0 conn(0x7f56cc157c20 0x7f56cc1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:20.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56c3fff640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc073a70 0x7f56cc0bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:20.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367135383 0 0) 0x7f56cc06a5b0 con 0x7f56cc14b010 2023-12-16T03:27:20.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b8003530 con 0x7f56cc14b010 2023-12-16T03:27:20.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 334616099 0 0) 0x7f56b8003530 con 0x7f56cc14b010 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc073a70 msgr2=0x7f56cc0bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc073a70 0x7f56cc0bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 >> v2:172.21.15.134:3300/0 conn(0x7f56cc157c20 msgr2=0x7f56cc1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 --2- 172.21.15.28:0/1633476650 >> v2:172.21.15.134:3300/0 conn(0x7f56cc157c20 0x7f56cc1580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0c2040 con 0x7f56cc14b010 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f56bc001680 con 0x7f56cc14b010 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 >> v1:172.21.15.28:6789/0 conn(0x7f56cc14b010 legacy=0x7f56cc06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 0x7f56b8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc073a70 0x7f56b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b8004d10 0x7f56b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc06b710 con 0x7f56b8003980 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0c1d60 con 0x7f56b8004d10 2023-12-16T03:27:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b800b990 con 0x7f56cc073a70 2023-12-16T03:27:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56cad9d640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 0x7f56b8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56c3fff640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc073a70 0x7f56b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56cb59e640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b8004d10 0x7f56b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56cad9d640 1 -- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc073a70 msgr2=0x7f56b80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56cad9d640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc073a70 0x7f56b80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56cad9d640 1 -- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b8004d10 msgr2=0x7f56b8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56cad9d640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b8004d10 0x7f56b8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56cad9d640 1 -- 172.21.15.28:0/1633476650 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8003530 con 0x7f56b8003980 2023-12-16T03:27:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.104+0000 7f56c3fff640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc073a70 0x7f56b80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:20.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.108+0000 7f56cad9d640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 0x7f56b8003da0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00c240 tx=0x7f56bc01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c4c6d56aa3ceca server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:20.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.108+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc005ae0 con 0x7f56b8003980 2023-12-16T03:27:20.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.108+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc0ab070 con 0x7f56b8003980 2023-12-16T03:27:20.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.108+0000 7f56ca59c640 1 -- 172.21.15.28:0/1633476650 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc005ea0 con 0x7f56b8003980 2023-12-16T03:27:20.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.108+0000 7f56d11b8640 1 -- 172.21.15.28:0/1633476650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 msgr2=0x7f56b8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:20.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.108+0000 7f56d11b8640 1 --2- 172.21.15.28:0/1633476650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 0x7f56b8003da0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00c240 tx=0x7f56bc01f3d0 comp rx=0 tx=0).stop 2023-12-16T03:27:20.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.108+0000 7f56cb59e640 1 -- 172.21.15.28:0/1633476650 reap_dead start 2023-12-16T03:27:20.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.108+0000 7f56d11b8640 1 -- 172.21.15.28:0/1633476650 shutdown_connections 2023-12-16T03:27:20.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.108+0000 7f56d11b8640 1 -- 172.21.15.28:0/1633476650 >> 172.21.15.28:0/1633476650 conn(0x7f56cc0c30c0 msgr2=0x7f56cc0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:20.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.108+0000 7f56d11b8640 1 -- 172.21.15.28:0/1633476650 shutdown_connections 2023-12-16T03:27:20.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.108+0000 7f56d11b8640 1 -- 172.21.15.28:0/1633476650 wait complete. 2023-12-16T03:27:20.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56d11b8640 1 Processor -- start 2023-12-16T03:27:20.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56d11b8640 1 -- start start 2023-12-16T03:27:20.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56d11b8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 0x7f56cc1eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56d11b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56cc0a9460 0x7f56cc0ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56d11b8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc1510f0 0x7f56cc1e9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56d11b8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0aa8f0 con 0x7f56b8003980 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56d11b8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0ab150 con 0x7f56cc0a9460 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56d11b8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc1ea5e0 con 0x7f56cc1510f0 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56cad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 0x7f56cc1eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56cad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 0x7f56cc1eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47216/0 (socket says 172.21.15.28:47216) 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56cad9d640 1 -- 172.21.15.28:0/331780977 learned_addr learned my addr 172.21.15.28:0/331780977 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56c3fff640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56cc0a9460 0x7f56cc0ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56cb59e640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc1510f0 0x7f56cc1e9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56cad9d640 1 -- 172.21.15.28:0/331780977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc1510f0 msgr2=0x7f56cc1e9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56cad9d640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc1510f0 0x7f56cc1e9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56cad9d640 1 -- 172.21.15.28:0/331780977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56cc0a9460 msgr2=0x7f56cc0ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:20.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56cad9d640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56cc0a9460 0x7f56cc0ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:20.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56cad9d640 1 -- 172.21.15.28:0/331780977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0aab00 con 0x7f56b8003980 2023-12-16T03:27:20.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56cad9d640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 0x7f56cc1eacc0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f56bc01f200 tx=0x7f56b8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:20.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56c37fe640 1 -- 172.21.15.28:0/331780977 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0b7070 con 0x7f56b8003980 2023-12-16T03:27:20.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56c37fe640 1 -- 172.21.15.28:0/331780977 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc005940 con 0x7f56b8003980 2023-12-16T03:27:20.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56c37fe640 1 -- 172.21.15.28:0/331780977 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc005cd0 con 0x7f56b8003980 2023-12-16T03:27:20.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56d11b8640 1 -- 172.21.15.28:0/331780977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc0aade0 con 0x7f56b8003980 2023-12-16T03:27:20.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56d11b8640 1 -- 172.21.15.28:0/331780977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc0abb20 con 0x7f56b8003980 2023-12-16T03:27:20.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.112+0000 7f56d11b8640 1 -- 172.21.15.28:0/331780977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc068400 con 0x7f56b8003980 2023-12-16T03:27:20.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.116+0000 7f56c37fe640 1 -- 172.21.15.28:0/331780977 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f56bc0ad020 con 0x7f56b8003980 2023-12-16T03:27:20.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.116+0000 7f56c37fe640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f56ac066470 0x7f56ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:20.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.116+0000 7f56c37fe640 1 -- 172.21.15.28:0/331780977 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f56bc121060 con 0x7f56b8003980 2023-12-16T03:27:20.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.116+0000 7f56c3fff640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f56ac066470 0x7f56ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:20.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.116+0000 7f56c3fff640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f56ac066470 0x7f56ac068930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f56cc14aa00 tx=0x7f56b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:20.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.120+0000 7f56c37fe640 1 -- 172.21.15.28:0/331780977 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f56bc0f1c00 con 0x7f56b8003980 2023-12-16T03:27:20.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.272+0000 7f56d11b8640 1 -- 172.21.15.28:0/331780977 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56cc0735f0 con 0x7f56ac066470 2023-12-16T03:27:20.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.288+0000 7f56c37fe640 1 -- 172.21.15.28:0/331780977 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528105 (secure 0 0 0) 0x7f56b4013960 con 0x7f56ac066470 2023-12-16T03:27:20.299 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:20.304 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:27:20.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 -- 172.21.15.28:0/331780977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f56ac066470 msgr2=0x7f56ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:20.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f56ac066470 0x7f56ac068930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f56cc14aa00 tx=0x7f56b4008040 comp rx=0 tx=0).stop 2023-12-16T03:27:20.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 -- 172.21.15.28:0/331780977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 msgr2=0x7f56cc1eacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:20.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 0x7f56cc1eacc0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f56bc01f200 tx=0x7f56b8005800 comp rx=0 tx=0).stop 2023-12-16T03:27:20.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 -- 172.21.15.28:0/331780977 shutdown_connections 2023-12-16T03:27:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56cc1510f0 0x7f56cc1e9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56cc0a9460 0x7f56cc0ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f56ac066470 0x7f56ac068930 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 --2- 172.21.15.28:0/331780977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56b8003980 0x7f56cc1eacc0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 -- 172.21.15.28:0/331780977 >> 172.21.15.28:0/331780977 conn(0x7f56cc0c30c0 msgr2=0x7f56cc157140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 -- 172.21.15.28:0/331780977 shutdown_connections 2023-12-16T03:27:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:20.292+0000 7f56d11b8640 1 -- 172.21.15.28:0/331780977 wait complete. 2023-12-16T03:27:20.316 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-12-16T03:27:19.822665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":361,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243352,"kb_used_data":6344,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731368,"statfs":{"total":773094113280,"available":772844920832,"internally_reserved":0,"allocated":6496256,"data_stored":3436758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.252765"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931492+0000","last_change":"2023-12-16T03:27:14.618845+0000","last_active":"2023-12-16T03:27:15.931492+0000","last_peered":"2023-12-16T03:27:15.931492+0000","last_clean":"2023-12-16T03:27:15.931492+0000","last_became_active":"2023-12-16T03:27:14.615198+0000","last_became_peered":"2023-12-16T03:27:14.615198+0000","last_unstale":"2023-12-16T03:27:15.931492+0000","last_undegraded":"2023-12-16T03:27:15.931492+0000","last_fullsized":"2023-12-16T03:27:15.931492+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:46.749445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.612544+0000","last_change":"2023-12-16T03:27:01.537420+0000","last_active":"2023-12-16T03:27:14.612544+0000","last_peered":"2023-12-16T03:27:14.612544+0000","last_clean":"2023-12-16T03:27:14.612544+0000","last_became_active":"2023-12-16T03:27:01.537176+0000","last_became_peered":"2023-12-16T03:27:01.537176+0000","last_unstale":"2023-12-16T03:27:14.612544+0000","last_undegraded":"2023-12-16T03:27:14.612544+0000","last_fullsized":"2023-12-16T03:27:14.612544+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:23:26.860864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.615672+0000","last_change":"2023-12-16T03:27:14.629251+0000","last_active":"2023-12-16T03:27:15.615672+0000","last_peered":"2023-12-16T03:27:15.615672+0000","last_clean":"2023-12-16T03:27:15.615672+0000","last_became_active":"2023-12-16T03:27:14.628954+0000","last_became_peered":"2023-12-16T03:27:14.628954+0000","last_unstale":"2023-12-16T03:27:15.615672+0000","last_undegraded":"2023-12-16T03:27:15.615672+0000","last_fullsized":"2023-12-16T03:27:15.615672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:11.840620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609483+0000","last_change":"2023-12-16T03:27:01.534498+0000","last_active":"2023-12-16T03:27:14.609483+0000","last_peered":"2023-12-16T03:27:14.609483+0000","last_clean":"2023-12-16T03:27:14.609483+0000","last_became_active":"2023-12-16T03:27:01.533730+0000","last_became_peered":"2023-12-16T03:27:01.533730+0000","last_unstale":"2023-12-16T03:27:14.609483+0000","last_undegraded":"2023-12-16T03:27:14.609483+0000","last_fullsized":"2023-12-16T03:27:14.609483+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:07.937228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619460+0000","last_change":"2023-12-16T03:27:14.634383+0000","last_active":"2023-12-16T03:27:15.619460+0000","last_peered":"2023-12-16T03:27:15.619460+0000","last_clean":"2023-12-16T03:27:15.619460+0000","last_became_active":"2023-12-16T03:27:14.634078+0000","last_became_peered":"2023-12-16T03:27:14.634078+0000","last_unstale":"2023-12-16T03:27:15.619460+0000","last_undegraded":"2023-12-16T03:27:15.619460+0000","last_fullsized":"2023-12-16T03:27:15.619460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:05.173478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.626980+0000","last_change":"2023-12-16T03:27:01.518121+0000","last_active":"2023-12-16T03:27:14.626980+0000","last_peered":"2023-12-16T03:27:14.626980+0000","last_clean":"2023-12-16T03:27:14.626980+0000","last_became_active":"2023-12-16T03:27:01.517826+0000","last_became_peered":"2023-12-16T03:27:01.517826+0000","last_unstale":"2023-12-16T03:27:14.626980+0000","last_undegraded":"2023-12-16T03:27:14.626980+0000","last_fullsized":"2023-12-16T03:27:14.626980+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:46.909657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617911+0000","last_change":"2023-12-16T03:27:14.617065+0000","last_active":"2023-12-16T03:27:15.617911+0000","last_peered":"2023-12-16T03:27:15.617911+0000","last_clean":"2023-12-16T03:27:15.617911+0000","last_became_active":"2023-12-16T03:27:14.616588+0000","last_became_peered":"2023-12-16T03:27:14.616588+0000","last_unstale":"2023-12-16T03:27:15.617911+0000","last_undegraded":"2023-12-16T03:27:15.617911+0000","last_fullsized":"2023-12-16T03:27:15.617911+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:13.026993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595038+0000","last_change":"2023-12-16T03:27:01.531096+0000","last_active":"2023-12-16T03:27:14.595038+0000","last_peered":"2023-12-16T03:27:14.595038+0000","last_clean":"2023-12-16T03:27:14.595038+0000","last_became_active":"2023-12-16T03:27:01.530793+0000","last_became_peered":"2023-12-16T03:27:01.530793+0000","last_unstale":"2023-12-16T03:27:14.595038+0000","last_undegraded":"2023-12-16T03:27:14.595038+0000","last_fullsized":"2023-12-16T03:27:14.595038+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:59.366673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.754556+0000","last_change":"2023-12-16T03:27:14.600558+0000","last_active":"2023-12-16T03:27:15.754556+0000","last_peered":"2023-12-16T03:27:15.754556+0000","last_clean":"2023-12-16T03:27:15.754556+0000","last_became_active":"2023-12-16T03:27:14.600267+0000","last_became_peered":"2023-12-16T03:27:14.600267+0000","last_unstale":"2023-12-16T03:27:15.754556+0000","last_undegraded":"2023-12-16T03:27:15.754556+0000","last_fullsized":"2023-12-16T03:27:15.754556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:20:24.493662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609848+0000","last_change":"2023-12-16T03:27:01.531904+0000","last_active":"2023-12-16T03:27:14.609848+0000","last_peered":"2023-12-16T03:27:14.609848+0000","last_clean":"2023-12-16T03:27:14.609848+0000","last_became_active":"2023-12-16T03:27:01.531705+0000","last_became_peered":"2023-12-16T03:27:01.531705+0000","last_unstale":"2023-12-16T03:27:14.609848+0000","last_undegraded":"2023-12-16T03:27:14.609848+0000","last_fullsized":"2023-12-16T03:27:14.609848+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:24:38.684552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617809+0000","last_change":"2023-12-16T03:27:14.614217+0000","last_active":"2023-12-16T03:27:15.617809+0000","last_peered":"2023-12-16T03:27:15.617809+0000","last_clean":"2023-12-16T03:27:15.617809+0000","last_became_active":"2023-12-16T03:27:14.613936+0000","last_became_peered":"2023-12-16T03:27:14.613936+0000","last_unstale":"2023-12-16T03:27:15.617809+0000","last_undegraded":"2023-12-16T03:27:15.617809+0000","last_fullsized":"2023-12-16T03:27:15.617809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:01.292849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602995+0000","last_change":"2023-12-16T03:27:01.537597+0000","last_active":"2023-12-16T03:27:14.602995+0000","last_peered":"2023-12-16T03:27:14.602995+0000","last_clean":"2023-12-16T03:27:14.602995+0000","last_became_active":"2023-12-16T03:27:01.537262+0000","last_became_peered":"2023-12-16T03:27:01.537262+0000","last_unstale":"2023-12-16T03:27:14.602995+0000","last_undegraded":"2023-12-16T03:27:14.602995+0000","last_fullsized":"2023-12-16T03:27:14.602995+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342653+0000","last_change":"2023-12-16T03:27:14.618241+0000","last_active":"2023-12-16T03:27:16.342653+0000","last_peered":"2023-12-16T03:27:16.342653+0000","last_clean":"2023-12-16T03:27:16.342653+0000","last_became_active":"2023-12-16T03:27:14.617805+0000","last_became_peered":"2023-12-16T03:27:14.617805+0000","last_unstale":"2023-12-16T03:27:16.342653+0000","last_undegraded":"2023-12-16T03:27:16.342653+0000","last_fullsized":"2023-12-16T03:27:16.342653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:56.098012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.598695+0000","last_change":"2023-12-16T03:27:01.504710+0000","last_active":"2023-12-16T03:27:14.598695+0000","last_peered":"2023-12-16T03:27:14.598695+0000","last_clean":"2023-12-16T03:27:14.598695+0000","last_became_active":"2023-12-16T03:27:01.504412+0000","last_became_peered":"2023-12-16T03:27:01.504412+0000","last_unstale":"2023-12-16T03:27:14.598695+0000","last_undegraded":"2023-12-16T03:27:14.598695+0000","last_fullsized":"2023-12-16T03:27:14.598695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:09.298222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617182+0000","last_change":"2023-12-16T03:27:14.629585+0000","last_active":"2023-12-16T03:27:15.617182+0000","last_peered":"2023-12-16T03:27:15.617182+0000","last_clean":"2023-12-16T03:27:15.617182+0000","last_became_active":"2023-12-16T03:27:14.629299+0000","last_became_peered":"2023-12-16T03:27:14.629299+0000","last_unstale":"2023-12-16T03:27:15.617182+0000","last_undegraded":"2023-12-16T03:27:15.617182+0000","last_fullsized":"2023-12-16T03:27:15.617182+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:20:37.946431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.600353+0000","last_change":"2023-12-16T03:27:01.514585+0000","last_active":"2023-12-16T03:27:14.600353+0000","last_peered":"2023-12-16T03:27:14.600353+0000","last_clean":"2023-12-16T03:27:14.600353+0000","last_became_active":"2023-12-16T03:27:01.514304+0000","last_became_peered":"2023-12-16T03:27:01.514304+0000","last_unstale":"2023-12-16T03:27:14.600353+0000","last_undegraded":"2023-12-16T03:27:14.600353+0000","last_fullsized":"2023-12-16T03:27:14.600353+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:44:59.949884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619126+0000","last_change":"2023-12-16T03:27:14.630574+0000","last_active":"2023-12-16T03:27:15.619126+0000","last_peered":"2023-12-16T03:27:15.619126+0000","last_clean":"2023-12-16T03:27:15.619126+0000","last_became_active":"2023-12-16T03:27:14.629743+0000","last_became_peered":"2023-12-16T03:27:14.629743+0000","last_unstale":"2023-12-16T03:27:15.619126+0000","last_undegraded":"2023-12-16T03:27:15.619126+0000","last_fullsized":"2023-12-16T03:27:15.619126+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:52.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602211+0000","last_change":"2023-12-16T03:27:01.517287+0000","last_active":"2023-12-16T03:27:14.602211+0000","last_peered":"2023-12-16T03:27:14.602211+0000","last_clean":"2023-12-16T03:27:14.602211+0000","last_became_active":"2023-12-16T03:27:01.516865+0000","last_became_peered":"2023-12-16T03:27:01.516865+0000","last_unstale":"2023-12-16T03:27:14.602211+0000","last_undegraded":"2023-12-16T03:27:14.602211+0000","last_fullsized":"2023-12-16T03:27:14.602211+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:49.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.615366+0000","last_change":"2023-12-16T03:27:14.617508+0000","last_active":"2023-12-16T03:27:15.615366+0000","last_peered":"2023-12-16T03:27:15.615366+0000","last_clean":"2023-12-16T03:27:15.615366+0000","last_became_active":"2023-12-16T03:27:14.615609+0000","last_became_peered":"2023-12-16T03:27:14.615609+0000","last_unstale":"2023-12-16T03:27:15.615366+0000","last_undegraded":"2023-12-16T03:27:15.615366+0000","last_fullsized":"2023-12-16T03:27:15.615366+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:17.099834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.593637+0000","last_change":"2023-12-16T03:27:01.523610+0000","last_active":"2023-12-16T03:27:14.593637+0000","last_peered":"2023-12-16T03:27:14.593637+0000","last_clean":"2023-12-16T03:27:14.593637+0000","last_became_active":"2023-12-16T03:27:01.523269+0000","last_became_peered":"2023-12-16T03:27:01.523269+0000","last_unstale":"2023-12-16T03:27:14.593637+0000","last_undegraded":"2023-12-16T03:27:14.593637+0000","last_fullsized":"2023-12-16T03:27:14.593637+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:43.020903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343448+0000","last_change":"2023-12-16T03:27:14.625055+0000","last_active":"2023-12-16T03:27:16.343448+0000","last_peered":"2023-12-16T03:27:16.343448+0000","last_clean":"2023-12-16T03:27:16.343448+0000","last_became_active":"2023-12-16T03:27:14.624746+0000","last_became_peered":"2023-12-16T03:27:14.624746+0000","last_unstale":"2023-12-16T03:27:16.343448+0000","last_undegraded":"2023-12-16T03:27:16.343448+0000","last_fullsized":"2023-12-16T03:27:16.343448+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:22.375331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.593512+0000","last_change":"2023-12-16T03:27:01.534387+0000","last_active":"2023-12-16T03:27:14.593512+0000","last_peered":"2023-12-16T03:27:14.593512+0000","last_clean":"2023-12-16T03:27:14.593512+0000","last_became_active":"2023-12-16T03:27:01.534102+0000","last_became_peered":"2023-12-16T03:27:01.534102+0000","last_unstale":"2023-12-16T03:27:14.593512+0000","last_undegraded":"2023-12-16T03:27:14.593512+0000","last_fullsized":"2023-12-16T03:27:14.593512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:48:59.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342800+0000","last_change":"2023-12-16T03:27:14.616229+0000","last_active":"2023-12-16T03:27:16.342800+0000","last_peered":"2023-12-16T03:27:16.342800+0000","last_clean":"2023-12-16T03:27:16.342800+0000","last_became_active":"2023-12-16T03:27:14.615809+0000","last_became_peered":"2023-12-16T03:27:14.615809+0000","last_unstale":"2023-12-16T03:27:16.342800+0000","last_undegraded":"2023-12-16T03:27:16.342800+0000","last_fullsized":"2023-12-16T03:27:16.342800+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:01.292849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595141+0000","last_change":"2023-12-16T03:27:01.514907+0000","last_active":"2023-12-16T03:27:14.595141+0000","last_peered":"2023-12-16T03:27:14.595141+0000","last_clean":"2023-12-16T03:27:14.595141+0000","last_became_active":"2023-12-16T03:27:01.514396+0000","last_became_peered":"2023-12-16T03:27:01.514396+0000","last_unstale":"2023-12-16T03:27:14.595141+0000","last_undegraded":"2023-12-16T03:27:14.595141+0000","last_fullsized":"2023-12-16T03:27:14.595141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342428+0000","last_change":"2023-12-16T03:27:14.614822+0000","last_active":"2023-12-16T03:27:16.342428+0000","last_peered":"2023-12-16T03:27:16.342428+0000","last_clean":"2023-12-16T03:27:16.342428+0000","last_became_active":"2023-12-16T03:27:14.614472+0000","last_became_peered":"2023-12-16T03:27:14.614472+0000","last_unstale":"2023-12-16T03:27:16.342428+0000","last_undegraded":"2023-12-16T03:27:16.342428+0000","last_fullsized":"2023-12-16T03:27:16.342428+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:21.014337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.608453+0000","last_change":"2023-12-16T03:27:01.533053+0000","last_active":"2023-12-16T03:27:14.608453+0000","last_peered":"2023-12-16T03:27:14.608453+0000","last_clean":"2023-12-16T03:27:14.608453+0000","last_became_active":"2023-12-16T03:27:01.532852+0000","last_became_peered":"2023-12-16T03:27:01.532852+0000","last_unstale":"2023-12-16T03:27:14.608453+0000","last_undegraded":"2023-12-16T03:27:14.608453+0000","last_fullsized":"2023-12-16T03:27:14.608453+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:05.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342015+0000","last_change":"2023-12-16T03:27:14.625175+0000","last_active":"2023-12-16T03:27:16.342015+0000","last_peered":"2023-12-16T03:27:16.342015+0000","last_clean":"2023-12-16T03:27:16.342015+0000","last_became_active":"2023-12-16T03:27:14.624893+0000","last_became_peered":"2023-12-16T03:27:14.624893+0000","last_unstale":"2023-12-16T03:27:16.342015+0000","last_undegraded":"2023-12-16T03:27:16.342015+0000","last_fullsized":"2023-12-16T03:27:16.342015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:56.130515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.599097+0000","last_change":"2023-12-16T03:27:01.527464+0000","last_active":"2023-12-16T03:27:14.599097+0000","last_peered":"2023-12-16T03:27:14.599097+0000","last_clean":"2023-12-16T03:27:14.599097+0000","last_became_active":"2023-12-16T03:27:01.526439+0000","last_became_peered":"2023-12-16T03:27:01.526439+0000","last_unstale":"2023-12-16T03:27:14.599097+0000","last_undegraded":"2023-12-16T03:27:14.599097+0000","last_fullsized":"2023-12-16T03:27:14.599097+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:55.347747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343215+0000","last_change":"2023-12-16T03:27:14.623035+0000","last_active":"2023-12-16T03:27:16.343215+0000","last_peered":"2023-12-16T03:27:16.343215+0000","last_clean":"2023-12-16T03:27:16.343215+0000","last_became_active":"2023-12-16T03:27:14.622753+0000","last_became_peered":"2023-12-16T03:27:14.622753+0000","last_unstale":"2023-12-16T03:27:16.343215+0000","last_undegraded":"2023-12-16T03:27:16.343215+0000","last_fullsized":"2023-12-16T03:27:16.343215+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:38:03.398274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.598863+0000","last_change":"2023-12-16T03:27:01.523106+0000","last_active":"2023-12-16T03:27:14.598863+0000","last_peered":"2023-12-16T03:27:14.598863+0000","last_clean":"2023-12-16T03:27:14.598863+0000","last_became_active":"2023-12-16T03:27:01.522824+0000","last_became_peered":"2023-12-16T03:27:01.522824+0000","last_unstale":"2023-12-16T03:27:14.598863+0000","last_undegraded":"2023-12-16T03:27:14.598863+0000","last_fullsized":"2023-12-16T03:27:14.598863+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:04.563786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343002+0000","last_change":"2023-12-16T03:27:14.620549+0000","last_active":"2023-12-16T03:27:16.343002+0000","last_peered":"2023-12-16T03:27:16.343002+0000","last_clean":"2023-12-16T03:27:16.343002+0000","last_became_active":"2023-12-16T03:27:14.618707+0000","last_became_peered":"2023-12-16T03:27:14.618707+0000","last_unstale":"2023-12-16T03:27:16.343002+0000","last_undegraded":"2023-12-16T03:27:16.343002+0000","last_fullsized":"2023-12-16T03:27:16.343002+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:33.188009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602479+0000","last_change":"2023-12-16T03:27:01.513664+0000","last_active":"2023-12-16T03:27:14.602479+0000","last_peered":"2023-12-16T03:27:14.602479+0000","last_clean":"2023-12-16T03:27:14.602479+0000","last_became_active":"2023-12-16T03:27:01.513325+0000","last_became_peered":"2023-12-16T03:27:01.513325+0000","last_unstale":"2023-12-16T03:27:14.602479+0000","last_undegraded":"2023-12-16T03:27:14.602479+0000","last_fullsized":"2023-12-16T03:27:14.602479+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617256+0000","last_change":"2023-12-16T03:27:14.617146+0000","last_active":"2023-12-16T03:27:15.617256+0000","last_peered":"2023-12-16T03:27:15.617256+0000","last_clean":"2023-12-16T03:27:15.617256+0000","last_became_active":"2023-12-16T03:27:14.616808+0000","last_became_peered":"2023-12-16T03:27:14.616808+0000","last_unstale":"2023-12-16T03:27:15.617256+0000","last_undegraded":"2023-12-16T03:27:15.617256+0000","last_fullsized":"2023-12-16T03:27:15.617256+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:39:06.433314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.611208+0000","last_change":"2023-12-16T03:27:01.526203+0000","last_active":"2023-12-16T03:27:14.611208+0000","last_peered":"2023-12-16T03:27:14.611208+0000","last_clean":"2023-12-16T03:27:14.611208+0000","last_became_active":"2023-12-16T03:27:01.525873+0000","last_became_peered":"2023-12-16T03:27:01.525873+0000","last_unstale":"2023-12-16T03:27:14.611208+0000","last_undegraded":"2023-12-16T03:27:14.611208+0000","last_fullsized":"2023-12-16T03:27:14.611208+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:37:50.321166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343512+0000","last_change":"2023-12-16T03:27:14.617920+0000","last_active":"2023-12-16T03:27:16.343512+0000","last_peered":"2023-12-16T03:27:16.343512+0000","last_clean":"2023-12-16T03:27:16.343512+0000","last_became_active":"2023-12-16T03:27:14.616966+0000","last_became_peered":"2023-12-16T03:27:14.616966+0000","last_unstale":"2023-12-16T03:27:16.343512+0000","last_undegraded":"2023-12-16T03:27:16.343512+0000","last_fullsized":"2023-12-16T03:27:16.343512+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:06.139993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.624109+0000","last_change":"2023-12-16T03:27:01.529407+0000","last_active":"2023-12-16T03:27:14.624109+0000","last_peered":"2023-12-16T03:27:14.624109+0000","last_clean":"2023-12-16T03:27:14.624109+0000","last_became_active":"2023-12-16T03:27:01.529024+0000","last_became_peered":"2023-12-16T03:27:01.529024+0000","last_unstale":"2023-12-16T03:27:14.624109+0000","last_undegraded":"2023-12-16T03:27:14.624109+0000","last_fullsized":"2023-12-16T03:27:14.624109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343536+0000","last_change":"2023-12-16T03:27:14.620094+0000","last_active":"2023-12-16T03:27:16.343536+0000","last_peered":"2023-12-16T03:27:16.343536+0000","last_clean":"2023-12-16T03:27:16.343536+0000","last_became_active":"2023-12-16T03:27:14.619849+0000","last_became_peered":"2023-12-16T03:27:14.619849+0000","last_unstale":"2023-12-16T03:27:16.343536+0000","last_undegraded":"2023-12-16T03:27:16.343536+0000","last_fullsized":"2023-12-16T03:27:16.343536+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:17.640895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.610989+0000","last_change":"2023-12-16T03:27:01.538362+0000","last_active":"2023-12-16T03:27:14.610989+0000","last_peered":"2023-12-16T03:27:14.610989+0000","last_clean":"2023-12-16T03:27:14.610989+0000","last_became_active":"2023-12-16T03:27:01.538024+0000","last_became_peered":"2023-12-16T03:27:01.538024+0000","last_unstale":"2023-12-16T03:27:14.610989+0000","last_undegraded":"2023-12-16T03:27:14.610989+0000","last_fullsized":"2023-12-16T03:27:14.610989+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:44.941057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.615453+0000","last_change":"2023-12-16T03:27:14.623711+0000","last_active":"2023-12-16T03:27:15.615453+0000","last_peered":"2023-12-16T03:27:15.615453+0000","last_clean":"2023-12-16T03:27:15.615453+0000","last_became_active":"2023-12-16T03:27:14.623416+0000","last_became_peered":"2023-12-16T03:27:14.623416+0000","last_unstale":"2023-12-16T03:27:15.615453+0000","last_undegraded":"2023-12-16T03:27:15.615453+0000","last_fullsized":"2023-12-16T03:27:15.615453+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:54.798720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609950+0000","last_change":"2023-12-16T03:27:01.535927+0000","last_active":"2023-12-16T03:27:14.609950+0000","last_peered":"2023-12-16T03:27:14.609950+0000","last_clean":"2023-12-16T03:27:14.609950+0000","last_became_active":"2023-12-16T03:27:01.535618+0000","last_became_peered":"2023-12-16T03:27:01.535618+0000","last_unstale":"2023-12-16T03:27:14.609950+0000","last_undegraded":"2023-12-16T03:27:14.609950+0000","last_fullsized":"2023-12-16T03:27:14.609950+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:46.786632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.618644+0000","last_change":"2023-12-16T03:27:14.624537+0000","last_active":"2023-12-16T03:27:15.618644+0000","last_peered":"2023-12-16T03:27:15.618644+0000","last_clean":"2023-12-16T03:27:15.618644+0000","last_became_active":"2023-12-16T03:27:14.624252+0000","last_became_peered":"2023-12-16T03:27:14.624252+0000","last_unstale":"2023-12-16T03:27:15.618644+0000","last_undegraded":"2023-12-16T03:27:15.618644+0000","last_fullsized":"2023-12-16T03:27:15.618644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:06.139993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.615325+0000","last_change":"2023-12-16T03:27:01.520051+0000","last_active":"2023-12-16T03:27:14.615325+0000","last_peered":"2023-12-16T03:27:14.615325+0000","last_clean":"2023-12-16T03:27:14.615325+0000","last_became_active":"2023-12-16T03:27:01.519803+0000","last_became_peered":"2023-12-16T03:27:01.519803+0000","last_unstale":"2023-12-16T03:27:14.615325+0000","last_undegraded":"2023-12-16T03:27:14.615325+0000","last_fullsized":"2023-12-16T03:27:14.615325+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.618512+0000","last_change":"2023-12-16T03:27:14.636524+0000","last_active":"2023-12-16T03:27:15.618512+0000","last_peered":"2023-12-16T03:27:15.618512+0000","last_clean":"2023-12-16T03:27:15.618512+0000","last_became_active":"2023-12-16T03:27:14.635617+0000","last_became_peered":"2023-12-16T03:27:14.635617+0000","last_unstale":"2023-12-16T03:27:15.618512+0000","last_undegraded":"2023-12-16T03:27:15.618512+0000","last_fullsized":"2023-12-16T03:27:15.618512+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:38:03.398274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607262+0000","last_change":"2023-12-16T03:27:01.523786+0000","last_active":"2023-12-16T03:27:14.607262+0000","last_peered":"2023-12-16T03:27:14.607262+0000","last_clean":"2023-12-16T03:27:14.607262+0000","last_became_active":"2023-12-16T03:27:01.523435+0000","last_became_peered":"2023-12-16T03:27:01.523435+0000","last_unstale":"2023-12-16T03:27:14.607262+0000","last_undegraded":"2023-12-16T03:27:14.607262+0000","last_fullsized":"2023-12-16T03:27:14.607262+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:59:37.033807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342543+0000","last_change":"2023-12-16T03:27:14.611189+0000","last_active":"2023-12-16T03:27:16.342543+0000","last_peered":"2023-12-16T03:27:16.342543+0000","last_clean":"2023-12-16T03:27:16.342543+0000","last_became_active":"2023-12-16T03:27:14.610841+0000","last_became_peered":"2023-12-16T03:27:14.610841+0000","last_unstale":"2023-12-16T03:27:16.342543+0000","last_undegraded":"2023-12-16T03:27:16.342543+0000","last_fullsized":"2023-12-16T03:27:16.342543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:08:04.940525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.612971+0000","last_change":"2023-12-16T03:27:01.539536+0000","last_active":"2023-12-16T03:27:14.612971+0000","last_peered":"2023-12-16T03:27:14.612971+0000","last_clean":"2023-12-16T03:27:14.612971+0000","last_became_active":"2023-12-16T03:27:01.539210+0000","last_became_peered":"2023-12-16T03:27:01.539210+0000","last_unstale":"2023-12-16T03:27:14.612971+0000","last_undegraded":"2023-12-16T03:27:14.612971+0000","last_fullsized":"2023-12-16T03:27:14.612971+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342283+0000","last_change":"2023-12-16T03:27:14.621328+0000","last_active":"2023-12-16T03:27:16.342283+0000","last_peered":"2023-12-16T03:27:16.342283+0000","last_clean":"2023-12-16T03:27:16.342283+0000","last_became_active":"2023-12-16T03:27:14.617909+0000","last_became_peered":"2023-12-16T03:27:14.617909+0000","last_unstale":"2023-12-16T03:27:16.342283+0000","last_undegraded":"2023-12-16T03:27:16.342283+0000","last_fullsized":"2023-12-16T03:27:16.342283+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:02.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606218+0000","last_change":"2023-12-16T03:27:01.521374+0000","last_active":"2023-12-16T03:27:14.606218+0000","last_peered":"2023-12-16T03:27:14.606218+0000","last_clean":"2023-12-16T03:27:14.606218+0000","last_became_active":"2023-12-16T03:27:01.521080+0000","last_became_peered":"2023-12-16T03:27:01.521080+0000","last_unstale":"2023-12-16T03:27:14.606218+0000","last_undegraded":"2023-12-16T03:27:14.606218+0000","last_fullsized":"2023-12-16T03:27:14.606218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:47.409565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931347+0000","last_change":"2023-12-16T03:27:14.625210+0000","last_active":"2023-12-16T03:27:15.931347+0000","last_peered":"2023-12-16T03:27:15.931347+0000","last_clean":"2023-12-16T03:27:15.931347+0000","last_became_active":"2023-12-16T03:27:14.624924+0000","last_became_peered":"2023-12-16T03:27:14.624924+0000","last_unstale":"2023-12-16T03:27:15.931347+0000","last_undegraded":"2023-12-16T03:27:15.931347+0000","last_fullsized":"2023-12-16T03:27:15.931347+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:52:58.531150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.612785+0000","last_change":"2023-12-16T03:27:01.537212+0000","last_active":"2023-12-16T03:27:14.612785+0000","last_peered":"2023-12-16T03:27:14.612785+0000","last_clean":"2023-12-16T03:27:14.612785+0000","last_became_active":"2023-12-16T03:27:01.536927+0000","last_became_peered":"2023-12-16T03:27:01.536927+0000","last_unstale":"2023-12-16T03:27:14.612785+0000","last_undegraded":"2023-12-16T03:27:14.612785+0000","last_fullsized":"2023-12-16T03:27:14.612785+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:59.764629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342620+0000","last_change":"2023-12-16T03:27:14.615707+0000","last_active":"2023-12-16T03:27:16.342620+0000","last_peered":"2023-12-16T03:27:16.342620+0000","last_clean":"2023-12-16T03:27:16.342620+0000","last_became_active":"2023-12-16T03:27:14.613062+0000","last_became_peered":"2023-12-16T03:27:14.613062+0000","last_unstale":"2023-12-16T03:27:16.342620+0000","last_undegraded":"2023-12-16T03:27:16.342620+0000","last_fullsized":"2023-12-16T03:27:16.342620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:10:06.644279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.598217+0000","last_change":"2023-12-16T03:27:01.506167+0000","last_active":"2023-12-16T03:27:14.598217+0000","last_peered":"2023-12-16T03:27:14.598217+0000","last_clean":"2023-12-16T03:27:14.598217+0000","last_became_active":"2023-12-16T03:27:01.505856+0000","last_became_peered":"2023-12-16T03:27:01.505856+0000","last_unstale":"2023-12-16T03:27:14.598217+0000","last_undegraded":"2023-12-16T03:27:14.598217+0000","last_fullsized":"2023-12-16T03:27:14.598217+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342859+0000","last_change":"2023-12-16T03:27:14.630309+0000","last_active":"2023-12-16T03:27:16.342859+0000","last_peered":"2023-12-16T03:27:16.342859+0000","last_clean":"2023-12-16T03:27:16.342859+0000","last_became_active":"2023-12-16T03:27:14.630023+0000","last_became_peered":"2023-12-16T03:27:14.630023+0000","last_unstale":"2023-12-16T03:27:16.342859+0000","last_undegraded":"2023-12-16T03:27:16.342859+0000","last_fullsized":"2023-12-16T03:27:16.342859+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:13.026993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606857+0000","last_change":"2023-12-16T03:27:01.514340+0000","last_active":"2023-12-16T03:27:14.606857+0000","last_peered":"2023-12-16T03:27:14.606857+0000","last_clean":"2023-12-16T03:27:14.606857+0000","last_became_active":"2023-12-16T03:27:01.514047+0000","last_became_peered":"2023-12-16T03:27:01.514047+0000","last_unstale":"2023-12-16T03:27:14.606857+0000","last_undegraded":"2023-12-16T03:27:14.606857+0000","last_fullsized":"2023-12-16T03:27:14.606857+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.755261+0000","last_change":"2023-12-16T03:27:14.622354+0000","last_active":"2023-12-16T03:27:15.755261+0000","last_peered":"2023-12-16T03:27:15.755261+0000","last_clean":"2023-12-16T03:27:15.755261+0000","last_became_active":"2023-12-16T03:27:14.622002+0000","last_became_peered":"2023-12-16T03:27:14.622002+0000","last_unstale":"2023-12-16T03:27:15.755261+0000","last_undegraded":"2023-12-16T03:27:15.755261+0000","last_fullsized":"2023-12-16T03:27:15.755261+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:37:24.906594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.610076+0000","last_change":"2023-12-16T03:27:01.531612+0000","last_active":"2023-12-16T03:27:14.610076+0000","last_peered":"2023-12-16T03:27:14.610076+0000","last_clean":"2023-12-16T03:27:14.610076+0000","last_became_active":"2023-12-16T03:27:01.531274+0000","last_became_peered":"2023-12-16T03:27:01.531274+0000","last_unstale":"2023-12-16T03:27:14.610076+0000","last_undegraded":"2023-12-16T03:27:14.610076+0000","last_fullsized":"2023-12-16T03:27:14.610076+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:58.878396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.754682+0000","last_change":"2023-12-16T03:27:14.604526+0000","last_active":"2023-12-16T03:27:15.754682+0000","last_peered":"2023-12-16T03:27:15.754682+0000","last_clean":"2023-12-16T03:27:15.754682+0000","last_became_active":"2023-12-16T03:27:14.604214+0000","last_became_peered":"2023-12-16T03:27:14.604214+0000","last_unstale":"2023-12-16T03:27:15.754682+0000","last_undegraded":"2023-12-16T03:27:15.754682+0000","last_fullsized":"2023-12-16T03:27:15.754682+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:22:24.851175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.608145+0000","last_change":"2023-12-16T03:27:01.527562+0000","last_active":"2023-12-16T03:27:14.608145+0000","last_peered":"2023-12-16T03:27:14.608145+0000","last_clean":"2023-12-16T03:27:14.608145+0000","last_became_active":"2023-12-16T03:27:01.525171+0000","last_became_peered":"2023-12-16T03:27:01.525171+0000","last_unstale":"2023-12-16T03:27:14.608145+0000","last_undegraded":"2023-12-16T03:27:14.608145+0000","last_fullsized":"2023-12-16T03:27:14.608145+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:02:55.385594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617661+0000","last_change":"2023-12-16T03:27:14.615113+0000","last_active":"2023-12-16T03:27:15.617661+0000","last_peered":"2023-12-16T03:27:15.617661+0000","last_clean":"2023-12-16T03:27:15.617661+0000","last_became_active":"2023-12-16T03:27:14.614825+0000","last_became_peered":"2023-12-16T03:27:14.614825+0000","last_unstale":"2023-12-16T03:27:15.617661+0000","last_undegraded":"2023-12-16T03:27:15.617661+0000","last_fullsized":"2023-12-16T03:27:15.617661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:10:06.644279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.614973+0000","last_change":"2023-12-16T03:27:01.518371+0000","last_active":"2023-12-16T03:27:14.614973+0000","last_peered":"2023-12-16T03:27:14.614973+0000","last_clean":"2023-12-16T03:27:14.614973+0000","last_became_active":"2023-12-16T03:27:01.518088+0000","last_became_peered":"2023-12-16T03:27:01.518088+0000","last_unstale":"2023-12-16T03:27:14.614973+0000","last_undegraded":"2023-12-16T03:27:14.614973+0000","last_fullsized":"2023-12-16T03:27:14.614973+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931593+0000","last_change":"2023-12-16T03:27:14.617044+0000","last_active":"2023-12-16T03:27:15.931593+0000","last_peered":"2023-12-16T03:27:15.931593+0000","last_clean":"2023-12-16T03:27:15.931593+0000","last_became_active":"2023-12-16T03:27:14.616743+0000","last_became_peered":"2023-12-16T03:27:14.616743+0000","last_unstale":"2023-12-16T03:27:15.931593+0000","last_undegraded":"2023-12-16T03:27:15.931593+0000","last_fullsized":"2023-12-16T03:27:15.931593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:00:24.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606299+0000","last_change":"2023-12-16T03:27:01.532530+0000","last_active":"2023-12-16T03:27:14.606299+0000","last_peered":"2023-12-16T03:27:14.606299+0000","last_clean":"2023-12-16T03:27:14.606299+0000","last_became_active":"2023-12-16T03:27:01.532228+0000","last_became_peered":"2023-12-16T03:27:01.532228+0000","last_unstale":"2023-12-16T03:27:14.606299+0000","last_undegraded":"2023-12-16T03:27:14.606299+0000","last_fullsized":"2023-12-16T03:27:14.606299+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.578189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.754626+0000","last_change":"2023-12-16T03:27:14.621399+0000","last_active":"2023-12-16T03:27:15.754626+0000","last_peered":"2023-12-16T03:27:15.754626+0000","last_clean":"2023-12-16T03:27:15.754626+0000","last_became_active":"2023-12-16T03:27:14.621084+0000","last_became_peered":"2023-12-16T03:27:14.621084+0000","last_unstale":"2023-12-16T03:27:15.754626+0000","last_undegraded":"2023-12-16T03:27:15.754626+0000","last_fullsized":"2023-12-16T03:27:15.754626+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:17:00.985279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602718+0000","last_change":"2023-12-16T03:27:01.526590+0000","last_active":"2023-12-16T03:27:14.602718+0000","last_peered":"2023-12-16T03:27:14.602718+0000","last_clean":"2023-12-16T03:27:14.602718+0000","last_became_active":"2023-12-16T03:27:01.525400+0000","last_became_peered":"2023-12-16T03:27:01.525400+0000","last_unstale":"2023-12-16T03:27:14.602718+0000","last_undegraded":"2023-12-16T03:27:14.602718+0000","last_fullsized":"2023-12-16T03:27:14.602718+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:46.909657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617241+0000","last_change":"2023-12-16T03:27:14.628017+0000","last_active":"2023-12-16T03:27:15.617241+0000","last_peered":"2023-12-16T03:27:15.617241+0000","last_clean":"2023-12-16T03:27:15.617241+0000","last_became_active":"2023-12-16T03:27:14.627723+0000","last_became_peered":"2023-12-16T03:27:14.627723+0000","last_unstale":"2023-12-16T03:27:15.617241+0000","last_undegraded":"2023-12-16T03:27:15.617241+0000","last_fullsized":"2023-12-16T03:27:15.617241+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:02.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.639849+0000","last_change":"2023-12-16T03:27:13.596763+0000","last_active":"2023-12-16T03:27:14.639849+0000","last_peered":"2023-12-16T03:27:14.639849+0000","last_clean":"2023-12-16T03:27:14.639849+0000","last_became_active":"2023-12-16T03:27:13.596458+0000","last_became_peered":"2023-12-16T03:27:13.596458+0000","last_unstale":"2023-12-16T03:27:14.639849+0000","last_undegraded":"2023-12-16T03:27:14.639849+0000","last_fullsized":"2023-12-16T03:27:14.639849+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:46.648303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603706+0000","last_change":"2023-12-16T03:27:01.519301+0000","last_active":"2023-12-16T03:27:14.603706+0000","last_peered":"2023-12-16T03:27:14.603706+0000","last_clean":"2023-12-16T03:27:14.603706+0000","last_became_active":"2023-12-16T03:27:01.519011+0000","last_became_peered":"2023-12-16T03:27:01.519011+0000","last_unstale":"2023-12-16T03:27:14.603706+0000","last_undegraded":"2023-12-16T03:27:14.603706+0000","last_fullsized":"2023-12-16T03:27:14.603706+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:34.578819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603739+0000","last_change":"2023-12-16T03:27:00.515238+0000","last_active":"2023-12-16T03:27:14.603739+0000","last_peered":"2023-12-16T03:27:14.603739+0000","last_clean":"2023-12-16T03:27:14.603739+0000","last_became_active":"2023-12-16T03:27:00.514968+0000","last_became_peered":"2023-12-16T03:27:00.514968+0000","last_unstale":"2023-12-16T03:27:14.603739+0000","last_undegraded":"2023-12-16T03:27:14.603739+0000","last_fullsized":"2023-12-16T03:27:14.603739+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619231+0000","last_change":"2023-12-16T03:27:14.628020+0000","last_active":"2023-12-16T03:27:15.619231+0000","last_peered":"2023-12-16T03:27:15.619231+0000","last_clean":"2023-12-16T03:27:15.619231+0000","last_became_active":"2023-12-16T03:27:14.627709+0000","last_became_peered":"2023-12-16T03:27:14.627709+0000","last_unstale":"2023-12-16T03:27:15.619231+0000","last_undegraded":"2023-12-16T03:27:15.619231+0000","last_fullsized":"2023-12-16T03:27:15.619231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:18.325494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.633700+0000","last_change":"2023-12-16T03:27:13.602746+0000","last_active":"2023-12-16T03:27:14.633700+0000","last_peered":"2023-12-16T03:27:14.633700+0000","last_clean":"2023-12-16T03:27:14.633700+0000","last_became_active":"2023-12-16T03:27:13.602161+0000","last_became_peered":"2023-12-16T03:27:13.602161+0000","last_unstale":"2023-12-16T03:27:14.633700+0000","last_undegraded":"2023-12-16T03:27:14.633700+0000","last_fullsized":"2023-12-16T03:27:14.633700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:42.020672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.593946+0000","last_change":"2023-12-16T03:27:01.522872+0000","last_active":"2023-12-16T03:27:14.593946+0000","last_peered":"2023-12-16T03:27:14.593946+0000","last_clean":"2023-12-16T03:27:14.593946+0000","last_became_active":"2023-12-16T03:27:01.522260+0000","last_became_peered":"2023-12-16T03:27:01.522260+0000","last_unstale":"2023-12-16T03:27:14.593946+0000","last_undegraded":"2023-12-16T03:27:14.593946+0000","last_fullsized":"2023-12-16T03:27:14.593946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:50.778695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609606+0000","last_change":"2023-12-16T03:27:00.521097+0000","last_active":"2023-12-16T03:27:14.609606+0000","last_peered":"2023-12-16T03:27:14.609606+0000","last_clean":"2023-12-16T03:27:14.609606+0000","last_became_active":"2023-12-16T03:27:00.520800+0000","last_became_peered":"2023-12-16T03:27:00.520800+0000","last_unstale":"2023-12-16T03:27:14.609606+0000","last_undegraded":"2023-12-16T03:27:14.609606+0000","last_fullsized":"2023-12-16T03:27:14.609606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:38:52.347850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619382+0000","last_change":"2023-12-16T03:27:14.637583+0000","last_active":"2023-12-16T03:27:15.619382+0000","last_peered":"2023-12-16T03:27:15.619382+0000","last_clean":"2023-12-16T03:27:15.619382+0000","last_became_active":"2023-12-16T03:27:14.637059+0000","last_became_peered":"2023-12-16T03:27:14.637059+0000","last_unstale":"2023-12-16T03:27:15.619382+0000","last_undegraded":"2023-12-16T03:27:15.619382+0000","last_fullsized":"2023-12-16T03:27:15.619382+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:08:25.904235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.632060+0000","last_change":"2023-12-16T03:27:13.599946+0000","last_active":"2023-12-16T03:27:14.632060+0000","last_peered":"2023-12-16T03:27:14.632060+0000","last_clean":"2023-12-16T03:27:14.632060+0000","last_became_active":"2023-12-16T03:27:13.599547+0000","last_became_peered":"2023-12-16T03:27:13.599547+0000","last_unstale":"2023-12-16T03:27:14.632060+0000","last_undegraded":"2023-12-16T03:27:14.632060+0000","last_fullsized":"2023-12-16T03:27:14.632060+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:58.856116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.604369+0000","last_change":"2023-12-16T03:27:01.528475+0000","last_active":"2023-12-16T03:27:14.604369+0000","last_peered":"2023-12-16T03:27:14.604369+0000","last_clean":"2023-12-16T03:27:14.604369+0000","last_became_active":"2023-12-16T03:27:01.527985+0000","last_became_peered":"2023-12-16T03:27:01.527985+0000","last_unstale":"2023-12-16T03:27:14.604369+0000","last_undegraded":"2023-12-16T03:27:14.604369+0000","last_fullsized":"2023-12-16T03:27:14.604369+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:33.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607112+0000","last_change":"2023-12-16T03:27:00.516992+0000","last_active":"2023-12-16T03:27:14.607112+0000","last_peered":"2023-12-16T03:27:14.607112+0000","last_clean":"2023-12-16T03:27:14.607112+0000","last_became_active":"2023-12-16T03:27:00.515339+0000","last_became_peered":"2023-12-16T03:27:00.515339+0000","last_unstale":"2023-12-16T03:27:14.607112+0000","last_undegraded":"2023-12-16T03:27:14.607112+0000","last_fullsized":"2023-12-16T03:27:14.607112+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:58.358317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343683+0000","last_change":"2023-12-16T03:27:14.620464+0000","last_active":"2023-12-16T03:27:16.343683+0000","last_peered":"2023-12-16T03:27:16.343683+0000","last_clean":"2023-12-16T03:27:16.343683+0000","last_became_active":"2023-12-16T03:27:14.620144+0000","last_became_peered":"2023-12-16T03:27:14.620144+0000","last_unstale":"2023-12-16T03:27:16.343683+0000","last_undegraded":"2023-12-16T03:27:16.343683+0000","last_fullsized":"2023-12-16T03:27:16.343683+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:42:08.424856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.623186+0000","last_change":"2023-12-16T03:27:13.595171+0000","last_active":"2023-12-16T03:27:14.623186+0000","last_peered":"2023-12-16T03:27:14.623186+0000","last_clean":"2023-12-16T03:27:14.623186+0000","last_became_active":"2023-12-16T03:27:13.594431+0000","last_became_peered":"2023-12-16T03:27:13.594431+0000","last_unstale":"2023-12-16T03:27:14.623186+0000","last_undegraded":"2023-12-16T03:27:14.623186+0000","last_fullsized":"2023-12-16T03:27:14.623186+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:22:23.843551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606940+0000","last_change":"2023-12-16T03:27:01.522006+0000","last_active":"2023-12-16T03:27:14.606940+0000","last_peered":"2023-12-16T03:27:14.606940+0000","last_clean":"2023-12-16T03:27:14.606940+0000","last_became_active":"2023-12-16T03:27:01.520949+0000","last_became_peered":"2023-12-16T03:27:01.520949+0000","last_unstale":"2023-12-16T03:27:14.606940+0000","last_undegraded":"2023-12-16T03:27:14.606940+0000","last_fullsized":"2023-12-16T03:27:14.606940+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:29.951188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595252+0000","last_change":"2023-12-16T03:27:00.515665+0000","last_active":"2023-12-16T03:27:14.595252+0000","last_peered":"2023-12-16T03:27:14.595252+0000","last_clean":"2023-12-16T03:27:14.595252+0000","last_became_active":"2023-12-16T03:27:00.514766+0000","last_became_peered":"2023-12-16T03:27:00.514766+0000","last_unstale":"2023-12-16T03:27:14.595252+0000","last_undegraded":"2023-12-16T03:27:14.595252+0000","last_fullsized":"2023-12-16T03:27:14.595252+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:54.339391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342227+0000","last_change":"2023-12-16T03:27:14.610886+0000","last_active":"2023-12-16T03:27:16.342227+0000","last_peered":"2023-12-16T03:27:16.342227+0000","last_clean":"2023-12-16T03:27:16.342227+0000","last_became_active":"2023-12-16T03:27:14.610583+0000","last_became_peered":"2023-12-16T03:27:14.610583+0000","last_unstale":"2023-12-16T03:27:16.342227+0000","last_undegraded":"2023-12-16T03:27:16.342227+0000","last_fullsized":"2023-12-16T03:27:16.342227+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:18.192952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.591797+0000","last_change":"2023-12-16T03:27:13.596040+0000","last_active":"2023-12-16T03:27:14.591797+0000","last_peered":"2023-12-16T03:27:14.591797+0000","last_clean":"2023-12-16T03:27:14.591797+0000","last_became_active":"2023-12-16T03:27:13.595774+0000","last_became_peered":"2023-12-16T03:27:13.595774+0000","last_unstale":"2023-12-16T03:27:14.591797+0000","last_undegraded":"2023-12-16T03:27:14.591797+0000","last_fullsized":"2023-12-16T03:27:14.591797+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:29:01.373370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607346+0000","last_change":"2023-12-16T03:27:01.523755+0000","last_active":"2023-12-16T03:27:14.607346+0000","last_peered":"2023-12-16T03:27:14.607346+0000","last_clean":"2023-12-16T03:27:14.607346+0000","last_became_active":"2023-12-16T03:27:01.523179+0000","last_became_peered":"2023-12-16T03:27:01.523179+0000","last_unstale":"2023-12-16T03:27:14.607346+0000","last_undegraded":"2023-12-16T03:27:14.607346+0000","last_fullsized":"2023-12-16T03:27:14.607346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:20:11.416554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.601294+0000","last_change":"2023-12-16T03:27:00.512400+0000","last_active":"2023-12-16T03:27:14.601294+0000","last_peered":"2023-12-16T03:27:14.601294+0000","last_clean":"2023-12-16T03:27:14.601294+0000","last_became_active":"2023-12-16T03:27:00.512120+0000","last_became_peered":"2023-12-16T03:27:00.512120+0000","last_unstale":"2023-12-16T03:27:14.601294+0000","last_undegraded":"2023-12-16T03:27:14.601294+0000","last_fullsized":"2023-12-16T03:27:14.601294+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:32:09.899662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342225+0000","last_change":"2023-12-16T03:27:14.617225+0000","last_active":"2023-12-16T03:27:16.342225+0000","last_peered":"2023-12-16T03:27:16.342225+0000","last_clean":"2023-12-16T03:27:16.342225+0000","last_became_active":"2023-12-16T03:27:14.616913+0000","last_became_peered":"2023-12-16T03:27:14.616913+0000","last_unstale":"2023-12-16T03:27:16.342225+0000","last_undegraded":"2023-12-16T03:27:16.342225+0000","last_fullsized":"2023-12-16T03:27:16.342225+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:59.863741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606078+0000","last_change":"2023-12-16T03:27:13.587351+0000","last_active":"2023-12-16T03:27:14.606078+0000","last_peered":"2023-12-16T03:27:14.606078+0000","last_clean":"2023-12-16T03:27:14.606078+0000","last_became_active":"2023-12-16T03:27:13.585827+0000","last_became_peered":"2023-12-16T03:27:13.585827+0000","last_unstale":"2023-12-16T03:27:14.606078+0000","last_undegraded":"2023-12-16T03:27:14.606078+0000","last_fullsized":"2023-12-16T03:27:14.606078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:34.233642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607862+0000","last_change":"2023-12-16T03:27:01.536014+0000","last_active":"2023-12-16T03:27:14.607862+0000","last_peered":"2023-12-16T03:27:14.607862+0000","last_clean":"2023-12-16T03:27:14.607862+0000","last_became_active":"2023-12-16T03:27:01.535729+0000","last_became_peered":"2023-12-16T03:27:01.535729+0000","last_unstale":"2023-12-16T03:27:14.607862+0000","last_undegraded":"2023-12-16T03:27:14.607862+0000","last_fullsized":"2023-12-16T03:27:14.607862+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:22:11.774067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603142+0000","last_change":"2023-12-16T03:27:00.513060+0000","last_active":"2023-12-16T03:27:14.603142+0000","last_peered":"2023-12-16T03:27:14.603142+0000","last_clean":"2023-12-16T03:27:14.603142+0000","last_became_active":"2023-12-16T03:27:00.512780+0000","last_became_peered":"2023-12-16T03:27:00.512780+0000","last_unstale":"2023-12-16T03:27:14.603142+0000","last_undegraded":"2023-12-16T03:27:14.603142+0000","last_fullsized":"2023-12-16T03:27:14.603142+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:03.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.754758+0000","last_change":"2023-12-16T03:27:14.610295+0000","last_active":"2023-12-16T03:27:15.754758+0000","last_peered":"2023-12-16T03:27:15.754758+0000","last_clean":"2023-12-16T03:27:15.754758+0000","last_became_active":"2023-12-16T03:27:14.610001+0000","last_became_peered":"2023-12-16T03:27:14.610001+0000","last_unstale":"2023-12-16T03:27:15.754758+0000","last_undegraded":"2023-12-16T03:27:15.754758+0000","last_fullsized":"2023-12-16T03:27:15.754758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:03:08.462703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.634460+0000","last_change":"2023-12-16T03:27:13.597592+0000","last_active":"2023-12-16T03:27:14.634460+0000","last_peered":"2023-12-16T03:27:14.634460+0000","last_clean":"2023-12-16T03:27:14.634460+0000","last_became_active":"2023-12-16T03:27:13.596242+0000","last_became_peered":"2023-12-16T03:27:13.596242+0000","last_unstale":"2023-12-16T03:27:14.634460+0000","last_undegraded":"2023-12-16T03:27:14.634460+0000","last_fullsized":"2023-12-16T03:27:14.634460+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:39.607214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606233+0000","last_change":"2023-12-16T03:27:01.520984+0000","last_active":"2023-12-16T03:27:14.606233+0000","last_peered":"2023-12-16T03:27:14.606233+0000","last_clean":"2023-12-16T03:27:14.606233+0000","last_became_active":"2023-12-16T03:27:01.520045+0000","last_became_peered":"2023-12-16T03:27:01.520045+0000","last_unstale":"2023-12-16T03:27:14.606233+0000","last_undegraded":"2023-12-16T03:27:14.606233+0000","last_fullsized":"2023-12-16T03:27:14.606233+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:37.842605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.596316+0000","last_change":"2023-12-16T03:27:00.513568+0000","last_active":"2023-12-16T03:27:14.596316+0000","last_peered":"2023-12-16T03:27:14.596316+0000","last_clean":"2023-12-16T03:27:14.596316+0000","last_became_active":"2023-12-16T03:27:00.513294+0000","last_became_peered":"2023-12-16T03:27:00.513294+0000","last_unstale":"2023-12-16T03:27:14.596316+0000","last_undegraded":"2023-12-16T03:27:14.596316+0000","last_fullsized":"2023-12-16T03:27:14.596316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342388+0000","last_change":"2023-12-16T03:27:14.628979+0000","last_active":"2023-12-16T03:27:16.342388+0000","last_peered":"2023-12-16T03:27:16.342388+0000","last_clean":"2023-12-16T03:27:16.342388+0000","last_became_active":"2023-12-16T03:27:14.618939+0000","last_became_peered":"2023-12-16T03:27:14.618939+0000","last_unstale":"2023-12-16T03:27:16.342388+0000","last_undegraded":"2023-12-16T03:27:16.342388+0000","last_fullsized":"2023-12-16T03:27:16.342388+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:39:06.433314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.623497+0000","last_change":"2023-12-16T03:27:13.599384+0000","last_active":"2023-12-16T03:27:14.623497+0000","last_peered":"2023-12-16T03:27:14.623497+0000","last_clean":"2023-12-16T03:27:14.623497+0000","last_became_active":"2023-12-16T03:27:13.599050+0000","last_became_peered":"2023-12-16T03:27:13.599050+0000","last_unstale":"2023-12-16T03:27:14.623497+0000","last_undegraded":"2023-12-16T03:27:14.623497+0000","last_fullsized":"2023-12-16T03:27:14.623497+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:22.051248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602990+0000","last_change":"2023-12-16T03:27:01.526843+0000","last_active":"2023-12-16T03:27:14.602990+0000","last_peered":"2023-12-16T03:27:14.602990+0000","last_clean":"2023-12-16T03:27:14.602990+0000","last_became_active":"2023-12-16T03:27:01.525795+0000","last_became_peered":"2023-12-16T03:27:01.525795+0000","last_unstale":"2023-12-16T03:27:14.602990+0000","last_undegraded":"2023-12-16T03:27:14.602990+0000","last_fullsized":"2023-12-16T03:27:14.602990+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:53.633088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.597359+0000","last_change":"2023-12-16T03:27:00.520498+0000","last_active":"2023-12-16T03:27:14.597359+0000","last_peered":"2023-12-16T03:27:14.597359+0000","last_clean":"2023-12-16T03:27:14.597359+0000","last_became_active":"2023-12-16T03:27:00.520179+0000","last_became_peered":"2023-12-16T03:27:00.520179+0000","last_unstale":"2023-12-16T03:27:14.597359+0000","last_undegraded":"2023-12-16T03:27:14.597359+0000","last_fullsized":"2023-12-16T03:27:14.597359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:36.834249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617539+0000","last_change":"2023-12-16T03:27:14.617976+0000","last_active":"2023-12-16T03:27:15.617539+0000","last_peered":"2023-12-16T03:27:15.617539+0000","last_clean":"2023-12-16T03:27:15.617539+0000","last_became_active":"2023-12-16T03:27:14.617637+0000","last_became_peered":"2023-12-16T03:27:14.617637+0000","last_unstale":"2023-12-16T03:27:15.617539+0000","last_undegraded":"2023-12-16T03:27:15.617539+0000","last_fullsized":"2023-12-16T03:27:15.617539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:08:04.940525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"53'3","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.631122+0000","last_change":"2023-12-16T03:27:13.597036+0000","last_active":"2023-12-16T03:27:14.631122+0000","last_peered":"2023-12-16T03:27:14.631122+0000","last_clean":"2023-12-16T03:27:14.631122+0000","last_became_active":"2023-12-16T03:27:13.596700+0000","last_became_peered":"2023-12-16T03:27:13.596700+0000","last_unstale":"2023-12-16T03:27:14.631122+0000","last_undegraded":"2023-12-16T03:27:14.631122+0000","last_fullsized":"2023-12-16T03:27:14.631122+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:25:22.549914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603619+0000","last_change":"2023-12-16T03:27:01.525335+0000","last_active":"2023-12-16T03:27:14.603619+0000","last_peered":"2023-12-16T03:27:14.603619+0000","last_clean":"2023-12-16T03:27:14.603619+0000","last_became_active":"2023-12-16T03:27:01.524994+0000","last_became_peered":"2023-12-16T03:27:01.524994+0000","last_unstale":"2023-12-16T03:27:14.603619+0000","last_undegraded":"2023-12-16T03:27:14.603619+0000","last_fullsized":"2023-12-16T03:27:14.603619+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:08.574639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.622227+0000","last_change":"2023-12-16T03:27:00.516706+0000","last_active":"2023-12-16T03:27:14.622227+0000","last_peered":"2023-12-16T03:27:14.622227+0000","last_clean":"2023-12-16T03:27:14.622227+0000","last_became_active":"2023-12-16T03:27:00.516403+0000","last_became_peered":"2023-12-16T03:27:00.516403+0000","last_unstale":"2023-12-16T03:27:14.622227+0000","last_undegraded":"2023-12-16T03:27:14.622227+0000","last_fullsized":"2023-12-16T03:27:14.622227+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:27.966699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342857+0000","last_change":"2023-12-16T03:27:14.608469+0000","last_active":"2023-12-16T03:27:16.342857+0000","last_peered":"2023-12-16T03:27:16.342857+0000","last_clean":"2023-12-16T03:27:16.342857+0000","last_became_active":"2023-12-16T03:27:14.608184+0000","last_became_peered":"2023-12-16T03:27:14.608184+0000","last_unstale":"2023-12-16T03:27:16.342857+0000","last_undegraded":"2023-12-16T03:27:16.342857+0000","last_fullsized":"2023-12-16T03:27:16.342857+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:32:23.985127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'6","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.638161+0000","last_change":"2023-12-16T03:27:13.585474+0000","last_active":"2023-12-16T03:27:14.638161+0000","last_peered":"2023-12-16T03:27:14.638161+0000","last_clean":"2023-12-16T03:27:14.638161+0000","last_became_active":"2023-12-16T03:27:13.585153+0000","last_became_peered":"2023-12-16T03:27:13.585153+0000","last_unstale":"2023-12-16T03:27:14.638161+0000","last_undegraded":"2023-12-16T03:27:14.638161+0000","last_fullsized":"2023-12-16T03:27:14.638161+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:23.772960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.622144+0000","last_change":"2023-12-16T03:27:01.526628+0000","last_active":"2023-12-16T03:27:14.622144+0000","last_peered":"2023-12-16T03:27:14.622144+0000","last_clean":"2023-12-16T03:27:14.622144+0000","last_became_active":"2023-12-16T03:27:01.526319+0000","last_became_peered":"2023-12-16T03:27:01.526319+0000","last_unstale":"2023-12-16T03:27:14.622144+0000","last_undegraded":"2023-12-16T03:27:14.622144+0000","last_fullsized":"2023-12-16T03:27:14.622144+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:32.633580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609704+0000","last_change":"2023-12-16T03:27:00.524203+0000","last_active":"2023-12-16T03:27:14.609704+0000","last_peered":"2023-12-16T03:27:14.609704+0000","last_clean":"2023-12-16T03:27:14.609704+0000","last_became_active":"2023-12-16T03:27:00.523807+0000","last_became_peered":"2023-12-16T03:27:00.523807+0000","last_unstale":"2023-12-16T03:27:14.609704+0000","last_undegraded":"2023-12-16T03:27:14.609704+0000","last_fullsized":"2023-12-16T03:27:14.609704+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:07:50.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.755420+0000","last_change":"2023-12-16T03:27:14.627844+0000","last_active":"2023-12-16T03:27:15.755420+0000","last_peered":"2023-12-16T03:27:15.755420+0000","last_clean":"2023-12-16T03:27:15.755420+0000","last_became_active":"2023-12-16T03:27:14.627585+0000","last_became_peered":"2023-12-16T03:27:14.627585+0000","last_unstale":"2023-12-16T03:27:15.755420+0000","last_undegraded":"2023-12-16T03:27:15.755420+0000","last_fullsized":"2023-12-16T03:27:15.755420+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:38:03.398274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602132+0000","last_change":"2023-12-16T03:27:13.597628+0000","last_active":"2023-12-16T03:27:14.602132+0000","last_peered":"2023-12-16T03:27:14.602132+0000","last_clean":"2023-12-16T03:27:14.602132+0000","last_became_active":"2023-12-16T03:27:13.597342+0000","last_became_peered":"2023-12-16T03:27:13.597342+0000","last_unstale":"2023-12-16T03:27:14.602132+0000","last_undegraded":"2023-12-16T03:27:14.602132+0000","last_fullsized":"2023-12-16T03:27:14.602132+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:44.703065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.594198+0000","last_change":"2023-12-16T03:27:01.533076+0000","last_active":"2023-12-16T03:27:14.594198+0000","last_peered":"2023-12-16T03:27:14.594198+0000","last_clean":"2023-12-16T03:27:14.594198+0000","last_became_active":"2023-12-16T03:27:01.532721+0000","last_became_peered":"2023-12-16T03:27:01.532721+0000","last_unstale":"2023-12-16T03:27:14.594198+0000","last_undegraded":"2023-12-16T03:27:14.594198+0000","last_fullsized":"2023-12-16T03:27:14.594198+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:37.842605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.620451+0000","last_change":"2023-12-16T03:27:00.521385+0000","last_active":"2023-12-16T03:27:14.620451+0000","last_peered":"2023-12-16T03:27:14.620451+0000","last_clean":"2023-12-16T03:27:14.620451+0000","last_became_active":"2023-12-16T03:27:00.521116+0000","last_became_peered":"2023-12-16T03:27:00.521116+0000","last_unstale":"2023-12-16T03:27:14.620451+0000","last_undegraded":"2023-12-16T03:27:14.620451+0000","last_fullsized":"2023-12-16T03:27:14.620451+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619569+0000","last_change":"2023-12-16T03:27:14.637360+0000","last_active":"2023-12-16T03:27:15.619569+0000","last_peered":"2023-12-16T03:27:15.619569+0000","last_clean":"2023-12-16T03:27:15.619569+0000","last_became_active":"2023-12-16T03:27:14.637061+0000","last_became_peered":"2023-12-16T03:27:14.637061+0000","last_unstale":"2023-12-16T03:27:15.619569+0000","last_undegraded":"2023-12-16T03:27:15.619569+0000","last_fullsized":"2023-12-16T03:27:15.619569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:21:05.227197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.613873+0000","last_change":"2023-12-16T03:27:13.596081+0000","last_active":"2023-12-16T03:27:14.613873+0000","last_peered":"2023-12-16T03:27:14.613873+0000","last_clean":"2023-12-16T03:27:14.613873+0000","last_became_active":"2023-12-16T03:27:13.595006+0000","last_became_peered":"2023-12-16T03:27:13.595006+0000","last_unstale":"2023-12-16T03:27:14.613873+0000","last_undegraded":"2023-12-16T03:27:14.613873+0000","last_fullsized":"2023-12-16T03:27:14.613873+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:44.703065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.620179+0000","last_change":"2023-12-16T03:27:01.522382+0000","last_active":"2023-12-16T03:27:14.620179+0000","last_peered":"2023-12-16T03:27:14.620179+0000","last_clean":"2023-12-16T03:27:14.620179+0000","last_became_active":"2023-12-16T03:27:01.522101+0000","last_became_peered":"2023-12-16T03:27:01.522101+0000","last_unstale":"2023-12-16T03:27:14.620179+0000","last_undegraded":"2023-12-16T03:27:14.620179+0000","last_fullsized":"2023-12-16T03:27:14.620179+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:29.951188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602145+0000","last_change":"2023-12-16T03:27:00.514824+0000","last_active":"2023-12-16T03:27:14.602145+0000","last_peered":"2023-12-16T03:27:14.602145+0000","last_clean":"2023-12-16T03:27:14.602145+0000","last_became_active":"2023-12-16T03:27:00.514574+0000","last_became_peered":"2023-12-16T03:27:00.514574+0000","last_unstale":"2023-12-16T03:27:14.602145+0000","last_undegraded":"2023-12-16T03:27:14.602145+0000","last_fullsized":"2023-12-16T03:27:14.602145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:49.770339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342276+0000","last_change":"2023-12-16T03:27:14.622718+0000","last_active":"2023-12-16T03:27:16.342276+0000","last_peered":"2023-12-16T03:27:16.342276+0000","last_clean":"2023-12-16T03:27:16.342276+0000","last_became_active":"2023-12-16T03:27:14.622364+0000","last_became_peered":"2023-12-16T03:27:14.622364+0000","last_unstale":"2023-12-16T03:27:16.342276+0000","last_undegraded":"2023-12-16T03:27:16.342276+0000","last_fullsized":"2023-12-16T03:27:16.342276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:37:24.906594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.596132+0000","last_change":"2023-12-16T03:27:13.587607+0000","last_active":"2023-12-16T03:27:14.596132+0000","last_peered":"2023-12-16T03:27:14.596132+0000","last_clean":"2023-12-16T03:27:14.596132+0000","last_became_active":"2023-12-16T03:27:13.586738+0000","last_became_peered":"2023-12-16T03:27:13.586738+0000","last_unstale":"2023-12-16T03:27:14.596132+0000","last_undegraded":"2023-12-16T03:27:14.596132+0000","last_fullsized":"2023-12-16T03:27:14.596132+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:59:49.103291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.596175+0000","last_change":"2023-12-16T03:27:01.523308+0000","last_active":"2023-12-16T03:27:14.596175+0000","last_peered":"2023-12-16T03:27:14.596175+0000","last_clean":"2023-12-16T03:27:14.596175+0000","last_became_active":"2023-12-16T03:27:01.522582+0000","last_became_peered":"2023-12-16T03:27:01.522582+0000","last_unstale":"2023-12-16T03:27:14.596175+0000","last_undegraded":"2023-12-16T03:27:14.596175+0000","last_fullsized":"2023-12-16T03:27:14.596175+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:44.457252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.608050+0000","last_change":"2023-12-16T03:27:00.524023+0000","last_active":"2023-12-16T03:27:14.608050+0000","last_peered":"2023-12-16T03:27:14.608050+0000","last_clean":"2023-12-16T03:27:14.608050+0000","last_became_active":"2023-12-16T03:27:00.523742+0000","last_became_peered":"2023-12-16T03:27:00.523742+0000","last_unstale":"2023-12-16T03:27:14.608050+0000","last_undegraded":"2023-12-16T03:27:14.608050+0000","last_fullsized":"2023-12-16T03:27:14.608050+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:09:52.558814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342339+0000","last_change":"2023-12-16T03:27:14.613690+0000","last_active":"2023-12-16T03:27:16.342339+0000","last_peered":"2023-12-16T03:27:16.342339+0000","last_clean":"2023-12-16T03:27:16.342339+0000","last_became_active":"2023-12-16T03:27:14.611536+0000","last_became_peered":"2023-12-16T03:27:14.611536+0000","last_unstale":"2023-12-16T03:27:16.342339+0000","last_undegraded":"2023-12-16T03:27:16.342339+0000","last_fullsized":"2023-12-16T03:27:16.342339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:49:12.367891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.641458+0000","last_change":"2023-12-16T03:27:13.595463+0000","last_active":"2023-12-16T03:27:14.641458+0000","last_peered":"2023-12-16T03:27:14.641458+0000","last_clean":"2023-12-16T03:27:14.641458+0000","last_became_active":"2023-12-16T03:27:13.595107+0000","last_became_peered":"2023-12-16T03:27:13.595107+0000","last_unstale":"2023-12-16T03:27:14.641458+0000","last_undegraded":"2023-12-16T03:27:14.641458+0000","last_fullsized":"2023-12-16T03:27:14.641458+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:53.791096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.615403+0000","last_change":"2023-12-16T03:27:01.519766+0000","last_active":"2023-12-16T03:27:14.615403+0000","last_peered":"2023-12-16T03:27:14.615403+0000","last_clean":"2023-12-16T03:27:14.615403+0000","last_became_active":"2023-12-16T03:27:01.519473+0000","last_became_peered":"2023-12-16T03:27:01.519473+0000","last_unstale":"2023-12-16T03:27:14.615403+0000","last_undegraded":"2023-12-16T03:27:14.615403+0000","last_fullsized":"2023-12-16T03:27:14.615403+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607581+0000","last_change":"2023-12-16T03:27:00.518062+0000","last_active":"2023-12-16T03:27:14.607581+0000","last_peered":"2023-12-16T03:27:14.607581+0000","last_clean":"2023-12-16T03:27:14.607581+0000","last_became_active":"2023-12-16T03:27:00.517664+0000","last_became_peered":"2023-12-16T03:27:00.517664+0000","last_unstale":"2023-12-16T03:27:14.607581+0000","last_undegraded":"2023-12-16T03:27:14.607581+0000","last_fullsized":"2023-12-16T03:27:14.607581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:47:04.667881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.618705+0000","last_change":"2023-12-16T03:27:14.620636+0000","last_active":"2023-12-16T03:27:15.618705+0000","last_peered":"2023-12-16T03:27:15.618705+0000","last_clean":"2023-12-16T03:27:15.618705+0000","last_became_active":"2023-12-16T03:27:14.620357+0000","last_became_peered":"2023-12-16T03:27:14.620357+0000","last_unstale":"2023-12-16T03:27:15.618705+0000","last_undegraded":"2023-12-16T03:27:15.618705+0000","last_fullsized":"2023-12-16T03:27:15.618705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:08.831942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.632175+0000","last_change":"2023-12-16T03:27:13.594025+0000","last_active":"2023-12-16T03:27:14.632175+0000","last_peered":"2023-12-16T03:27:14.632175+0000","last_clean":"2023-12-16T03:27:14.632175+0000","last_became_active":"2023-12-16T03:27:13.593861+0000","last_became_peered":"2023-12-16T03:27:13.593861+0000","last_unstale":"2023-12-16T03:27:14.632175+0000","last_undegraded":"2023-12-16T03:27:14.632175+0000","last_fullsized":"2023-12-16T03:27:14.632175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:30.733614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.597270+0000","last_change":"2023-12-16T03:27:01.514600+0000","last_active":"2023-12-16T03:27:14.597270+0000","last_peered":"2023-12-16T03:27:14.597270+0000","last_clean":"2023-12-16T03:27:14.597270+0000","last_became_active":"2023-12-16T03:27:01.514262+0000","last_became_peered":"2023-12-16T03:27:01.514262+0000","last_unstale":"2023-12-16T03:27:14.597270+0000","last_undegraded":"2023-12-16T03:27:14.597270+0000","last_fullsized":"2023-12-16T03:27:14.597270+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:28.975055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.596404+0000","last_change":"2023-12-16T03:27:00.514189+0000","last_active":"2023-12-16T03:27:14.596404+0000","last_peered":"2023-12-16T03:27:14.596404+0000","last_clean":"2023-12-16T03:27:14.596404+0000","last_became_active":"2023-12-16T03:27:00.513862+0000","last_became_peered":"2023-12-16T03:27:00.513862+0000","last_unstale":"2023-12-16T03:27:14.596404+0000","last_undegraded":"2023-12-16T03:27:14.596404+0000","last_fullsized":"2023-12-16T03:27:14.596404+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.755065+0000","last_change":"2023-12-16T03:27:14.614551+0000","last_active":"2023-12-16T03:27:15.755065+0000","last_peered":"2023-12-16T03:27:15.755065+0000","last_clean":"2023-12-16T03:27:15.755065+0000","last_became_active":"2023-12-16T03:27:14.614191+0000","last_became_peered":"2023-12-16T03:27:14.614191+0000","last_unstale":"2023-12-16T03:27:15.755065+0000","last_undegraded":"2023-12-16T03:27:15.755065+0000","last_fullsized":"2023-12-16T03:27:15.755065+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:59.863741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607201+0000","last_change":"2023-12-16T03:27:13.594572+0000","last_active":"2023-12-16T03:27:14.607201+0000","last_peered":"2023-12-16T03:27:14.607201+0000","last_clean":"2023-12-16T03:27:14.607201+0000","last_became_active":"2023-12-16T03:27:13.594021+0000","last_became_peered":"2023-12-16T03:27:13.594021+0000","last_unstale":"2023-12-16T03:27:14.607201+0000","last_undegraded":"2023-12-16T03:27:14.607201+0000","last_fullsized":"2023-12-16T03:27:14.607201+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:00.375282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.613120+0000","last_change":"2023-12-16T03:27:01.540186+0000","last_active":"2023-12-16T03:27:14.613120+0000","last_peered":"2023-12-16T03:27:14.613120+0000","last_clean":"2023-12-16T03:27:14.613120+0000","last_became_active":"2023-12-16T03:27:01.539206+0000","last_became_peered":"2023-12-16T03:27:01.539206+0000","last_unstale":"2023-12-16T03:27:14.613120+0000","last_undegraded":"2023-12-16T03:27:14.613120+0000","last_fullsized":"2023-12-16T03:27:14.613120+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.613415+0000","last_change":"2023-12-16T03:27:00.515681+0000","last_active":"2023-12-16T03:27:14.613415+0000","last_peered":"2023-12-16T03:27:14.613415+0000","last_clean":"2023-12-16T03:27:14.613415+0000","last_became_active":"2023-12-16T03:27:00.515413+0000","last_became_peered":"2023-12-16T03:27:00.515413+0000","last_unstale":"2023-12-16T03:27:14.613415+0000","last_undegraded":"2023-12-16T03:27:14.613415+0000","last_fullsized":"2023-12-16T03:27:14.613415+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.615521+0000","last_change":"2023-12-16T03:27:14.615962+0000","last_active":"2023-12-16T03:27:15.615521+0000","last_peered":"2023-12-16T03:27:15.615521+0000","last_clean":"2023-12-16T03:27:15.615521+0000","last_became_active":"2023-12-16T03:27:14.615652+0000","last_became_peered":"2023-12-16T03:27:14.615652+0000","last_unstale":"2023-12-16T03:27:15.615521+0000","last_undegraded":"2023-12-16T03:27:15.615521+0000","last_fullsized":"2023-12-16T03:27:15.615521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:01.382906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.632624+0000","last_change":"2023-12-16T03:27:13.599023+0000","last_active":"2023-12-16T03:27:14.632624+0000","last_peered":"2023-12-16T03:27:14.632624+0000","last_clean":"2023-12-16T03:27:14.632624+0000","last_became_active":"2023-12-16T03:27:13.597426+0000","last_became_peered":"2023-12-16T03:27:13.597426+0000","last_unstale":"2023-12-16T03:27:14.632624+0000","last_undegraded":"2023-12-16T03:27:14.632624+0000","last_fullsized":"2023-12-16T03:27:14.632624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:45.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.624222+0000","last_change":"2023-12-16T03:27:01.518997+0000","last_active":"2023-12-16T03:27:14.624222+0000","last_peered":"2023-12-16T03:27:14.624222+0000","last_clean":"2023-12-16T03:27:14.624222+0000","last_became_active":"2023-12-16T03:27:01.518606+0000","last_became_peered":"2023-12-16T03:27:01.518606+0000","last_unstale":"2023-12-16T03:27:14.624222+0000","last_undegraded":"2023-12-16T03:27:14.624222+0000","last_fullsized":"2023-12-16T03:27:14.624222+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:34.578819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.611415+0000","last_change":"2023-12-16T03:27:00.522719+0000","last_active":"2023-12-16T03:27:14.611415+0000","last_peered":"2023-12-16T03:27:14.611415+0000","last_clean":"2023-12-16T03:27:14.611415+0000","last_became_active":"2023-12-16T03:27:00.522485+0000","last_became_peered":"2023-12-16T03:27:00.522485+0000","last_unstale":"2023-12-16T03:27:14.611415+0000","last_undegraded":"2023-12-16T03:27:14.611415+0000","last_fullsized":"2023-12-16T03:27:14.611415+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:48:48.483240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343008+0000","last_change":"2023-12-16T03:27:14.620924+0000","last_active":"2023-12-16T03:27:16.343008+0000","last_peered":"2023-12-16T03:27:16.343008+0000","last_clean":"2023-12-16T03:27:16.343008+0000","last_became_active":"2023-12-16T03:27:14.620582+0000","last_became_peered":"2023-12-16T03:27:14.620582+0000","last_unstale":"2023-12-16T03:27:16.343008+0000","last_undegraded":"2023-12-16T03:27:16.343008+0000","last_fullsized":"2023-12-16T03:27:16.343008+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:42.052164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.615665+0000","last_change":"2023-12-16T03:27:13.600817+0000","last_active":"2023-12-16T03:27:14.615665+0000","last_peered":"2023-12-16T03:27:14.615665+0000","last_clean":"2023-12-16T03:27:14.615665+0000","last_became_active":"2023-12-16T03:27:13.600549+0000","last_became_peered":"2023-12-16T03:27:13.600549+0000","last_unstale":"2023-12-16T03:27:14.615665+0000","last_undegraded":"2023-12-16T03:27:14.615665+0000","last_fullsized":"2023-12-16T03:27:14.615665+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:05.702573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595564+0000","last_change":"2023-12-16T03:27:01.525968+0000","last_active":"2023-12-16T03:27:14.595564+0000","last_peered":"2023-12-16T03:27:14.595564+0000","last_clean":"2023-12-16T03:27:14.595564+0000","last_became_active":"2023-12-16T03:27:01.523176+0000","last_became_peered":"2023-12-16T03:27:01.523176+0000","last_unstale":"2023-12-16T03:27:14.595564+0000","last_undegraded":"2023-12-16T03:27:14.595564+0000","last_fullsized":"2023-12-16T03:27:14.595564+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603796+0000","last_change":"2023-12-16T03:27:00.514506+0000","last_active":"2023-12-16T03:27:14.603796+0000","last_peered":"2023-12-16T03:27:14.603796+0000","last_clean":"2023-12-16T03:27:14.603796+0000","last_became_active":"2023-12-16T03:27:00.514121+0000","last_became_peered":"2023-12-16T03:27:00.514121+0000","last_unstale":"2023-12-16T03:27:14.603796+0000","last_undegraded":"2023-12-16T03:27:14.603796+0000","last_fullsized":"2023-12-16T03:27:14.603796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:47:33.862583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343048+0000","last_change":"2023-12-16T03:27:14.608394+0000","last_active":"2023-12-16T03:27:16.343048+0000","last_peered":"2023-12-16T03:27:16.343048+0000","last_clean":"2023-12-16T03:27:16.343048+0000","last_became_active":"2023-12-16T03:27:14.608003+0000","last_became_peered":"2023-12-16T03:27:14.608003+0000","last_unstale":"2023-12-16T03:27:16.343048+0000","last_undegraded":"2023-12-16T03:27:16.343048+0000","last_fullsized":"2023-12-16T03:27:16.343048+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:55.459953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.633006+0000","last_change":"2023-12-16T03:27:13.598500+0000","last_active":"2023-12-16T03:27:14.633006+0000","last_peered":"2023-12-16T03:27:14.633006+0000","last_clean":"2023-12-16T03:27:14.633006+0000","last_became_active":"2023-12-16T03:27:13.598210+0000","last_became_peered":"2023-12-16T03:27:13.598210+0000","last_unstale":"2023-12-16T03:27:14.633006+0000","last_undegraded":"2023-12-16T03:27:14.633006+0000","last_fullsized":"2023-12-16T03:27:14.633006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:59.405661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.610034+0000","last_change":"2023-12-16T03:27:01.517329+0000","last_active":"2023-12-16T03:27:14.610034+0000","last_peered":"2023-12-16T03:27:14.610034+0000","last_clean":"2023-12-16T03:27:14.610034+0000","last_became_active":"2023-12-16T03:27:01.517020+0000","last_became_peered":"2023-12-16T03:27:01.517020+0000","last_unstale":"2023-12-16T03:27:14.610034+0000","last_undegraded":"2023-12-16T03:27:14.610034+0000","last_fullsized":"2023-12-16T03:27:14.610034+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:37:11.829485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595464+0000","last_change":"2023-12-16T03:27:00.514408+0000","last_active":"2023-12-16T03:27:14.595464+0000","last_peered":"2023-12-16T03:27:14.595464+0000","last_clean":"2023-12-16T03:27:14.595464+0000","last_became_active":"2023-12-16T03:27:00.514141+0000","last_became_peered":"2023-12-16T03:27:00.514141+0000","last_unstale":"2023-12-16T03:27:14.595464+0000","last_undegraded":"2023-12-16T03:27:14.595464+0000","last_fullsized":"2023-12-16T03:27:14.595464+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:10.695120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619704+0000","last_change":"2023-12-16T03:27:14.632060+0000","last_active":"2023-12-16T03:27:15.619704+0000","last_peered":"2023-12-16T03:27:15.619704+0000","last_clean":"2023-12-16T03:27:15.619704+0000","last_became_active":"2023-12-16T03:27:14.631777+0000","last_became_peered":"2023-12-16T03:27:14.631777+0000","last_unstale":"2023-12-16T03:27:15.619704+0000","last_undegraded":"2023-12-16T03:27:15.619704+0000","last_fullsized":"2023-12-16T03:27:15.619704+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:25:58.049623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.636680+0000","last_change":"2023-12-16T03:27:13.599906+0000","last_active":"2023-12-16T03:27:14.636680+0000","last_peered":"2023-12-16T03:27:14.636680+0000","last_clean":"2023-12-16T03:27:14.636680+0000","last_became_active":"2023-12-16T03:27:13.598582+0000","last_became_peered":"2023-12-16T03:27:13.598582+0000","last_unstale":"2023-12-16T03:27:14.636680+0000","last_undegraded":"2023-12-16T03:27:14.636680+0000","last_fullsized":"2023-12-16T03:27:14.636680+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:20:41.938352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.620253+0000","last_change":"2023-12-16T03:27:01.522466+0000","last_active":"2023-12-16T03:27:14.620253+0000","last_peered":"2023-12-16T03:27:14.620253+0000","last_clean":"2023-12-16T03:27:14.620253+0000","last_became_active":"2023-12-16T03:27:01.522111+0000","last_became_peered":"2023-12-16T03:27:01.522111+0000","last_unstale":"2023-12-16T03:27:14.620253+0000","last_undegraded":"2023-12-16T03:27:14.620253+0000","last_fullsized":"2023-12-16T03:27:14.620253+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:33.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.604520+0000","last_change":"2023-12-16T03:27:00.520371+0000","last_active":"2023-12-16T03:27:14.604520+0000","last_peered":"2023-12-16T03:27:14.604520+0000","last_clean":"2023-12-16T03:27:14.604520+0000","last_became_active":"2023-12-16T03:27:00.520097+0000","last_became_peered":"2023-12-16T03:27:00.520097+0000","last_unstale":"2023-12-16T03:27:14.604520+0000","last_undegraded":"2023-12-16T03:27:14.604520+0000","last_fullsized":"2023-12-16T03:27:14.604520+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:32:48.297921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931109+0000","last_change":"2023-12-16T03:27:14.622815+0000","last_active":"2023-12-16T03:27:15.931109+0000","last_peered":"2023-12-16T03:27:15.931109+0000","last_clean":"2023-12-16T03:27:15.931109+0000","last_became_active":"2023-12-16T03:27:14.622545+0000","last_became_peered":"2023-12-16T03:27:14.622545+0000","last_unstale":"2023-12-16T03:27:15.931109+0000","last_undegraded":"2023-12-16T03:27:15.931109+0000","last_fullsized":"2023-12-16T03:27:15.931109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:53:10.203830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595917+0000","last_change":"2023-12-16T03:27:13.586270+0000","last_active":"2023-12-16T03:27:14.595917+0000","last_peered":"2023-12-16T03:27:14.595917+0000","last_clean":"2023-12-16T03:27:14.595917+0000","last_became_active":"2023-12-16T03:27:13.585981+0000","last_became_peered":"2023-12-16T03:27:13.585981+0000","last_unstale":"2023-12-16T03:27:14.595917+0000","last_undegraded":"2023-12-16T03:27:14.595917+0000","last_fullsized":"2023-12-16T03:27:14.595917+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:54.452329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.596266+0000","last_change":"2023-12-16T03:27:01.521651+0000","last_active":"2023-12-16T03:27:14.596266+0000","last_peered":"2023-12-16T03:27:14.596266+0000","last_clean":"2023-12-16T03:27:14.596266+0000","last_became_active":"2023-12-16T03:27:01.521167+0000","last_became_peered":"2023-12-16T03:27:01.521167+0000","last_unstale":"2023-12-16T03:27:14.596266+0000","last_undegraded":"2023-12-16T03:27:14.596266+0000","last_fullsized":"2023-12-16T03:27:14.596266+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:42:00.543610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.608154+0000","last_change":"2023-12-16T03:27:00.521885+0000","last_active":"2023-12-16T03:27:14.608154+0000","last_peered":"2023-12-16T03:27:14.608154+0000","last_clean":"2023-12-16T03:27:14.608154+0000","last_became_active":"2023-12-16T03:27:00.521503+0000","last_became_peered":"2023-12-16T03:27:00.521503+0000","last_unstale":"2023-12-16T03:27:14.608154+0000","last_undegraded":"2023-12-16T03:27:14.608154+0000","last_fullsized":"2023-12-16T03:27:14.608154+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:47.207385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931024+0000","last_change":"2023-12-16T03:27:14.616521+0000","last_active":"2023-12-16T03:27:15.931024+0000","last_peered":"2023-12-16T03:27:15.931024+0000","last_clean":"2023-12-16T03:27:15.931024+0000","last_became_active":"2023-12-16T03:27:14.616153+0000","last_became_peered":"2023-12-16T03:27:14.616153+0000","last_unstale":"2023-12-16T03:27:15.931024+0000","last_undegraded":"2023-12-16T03:27:15.931024+0000","last_fullsized":"2023-12-16T03:27:15.931024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:08:16.636497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602628+0000","last_change":"2023-12-16T03:27:13.592700+0000","last_active":"2023-12-16T03:27:14.602628+0000","last_peered":"2023-12-16T03:27:14.602628+0000","last_clean":"2023-12-16T03:27:14.602628+0000","last_became_active":"2023-12-16T03:27:13.592434+0000","last_became_peered":"2023-12-16T03:27:13.592434+0000","last_unstale":"2023-12-16T03:27:14.602628+0000","last_undegraded":"2023-12-16T03:27:14.602628+0000","last_fullsized":"2023-12-16T03:27:14.602628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:59.977655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603391+0000","last_change":"2023-12-16T03:27:01.516489+0000","last_active":"2023-12-16T03:27:14.603391+0000","last_peered":"2023-12-16T03:27:14.603391+0000","last_clean":"2023-12-16T03:27:14.603391+0000","last_became_active":"2023-12-16T03:27:01.516199+0000","last_became_peered":"2023-12-16T03:27:01.516199+0000","last_unstale":"2023-12-16T03:27:14.603391+0000","last_undegraded":"2023-12-16T03:27:14.603391+0000","last_fullsized":"2023-12-16T03:27:14.603391+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:09.981763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.592258+0000","last_change":"2023-12-16T03:27:00.508945+0000","last_active":"2023-12-16T03:27:14.592258+0000","last_peered":"2023-12-16T03:27:14.592258+0000","last_clean":"2023-12-16T03:27:14.592258+0000","last_became_active":"2023-12-16T03:27:00.508638+0000","last_became_peered":"2023-12-16T03:27:00.508638+0000","last_unstale":"2023-12-16T03:27:14.592258+0000","last_undegraded":"2023-12-16T03:27:14.592258+0000","last_fullsized":"2023-12-16T03:27:14.592258+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931179+0000","last_change":"2023-12-16T03:27:14.606013+0000","last_active":"2023-12-16T03:27:15.931179+0000","last_peered":"2023-12-16T03:27:15.931179+0000","last_clean":"2023-12-16T03:27:15.931179+0000","last_became_active":"2023-12-16T03:27:14.605702+0000","last_became_peered":"2023-12-16T03:27:14.605702+0000","last_unstale":"2023-12-16T03:27:15.931179+0000","last_undegraded":"2023-12-16T03:27:15.931179+0000","last_fullsized":"2023-12-16T03:27:15.931179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:31.451715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607508+0000","last_change":"2023-12-16T03:27:13.593582+0000","last_active":"2023-12-16T03:27:14.607508+0000","last_peered":"2023-12-16T03:27:14.607508+0000","last_clean":"2023-12-16T03:27:14.607508+0000","last_became_active":"2023-12-16T03:27:13.593044+0000","last_became_peered":"2023-12-16T03:27:13.593044+0000","last_unstale":"2023-12-16T03:27:14.607508+0000","last_undegraded":"2023-12-16T03:27:14.607508+0000","last_fullsized":"2023-12-16T03:27:14.607508+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:58.979141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602623+0000","last_change":"2023-12-16T03:27:01.518954+0000","last_active":"2023-12-16T03:27:14.602623+0000","last_peered":"2023-12-16T03:27:14.602623+0000","last_clean":"2023-12-16T03:27:14.602623+0000","last_became_active":"2023-12-16T03:27:01.518665+0000","last_became_peered":"2023-12-16T03:27:01.518665+0000","last_unstale":"2023-12-16T03:27:14.602623+0000","last_undegraded":"2023-12-16T03:27:14.602623+0000","last_fullsized":"2023-12-16T03:27:14.602623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:32.633580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.594115+0000","last_change":"2023-12-16T03:27:00.519726+0000","last_active":"2023-12-16T03:27:14.594115+0000","last_peered":"2023-12-16T03:27:14.594115+0000","last_clean":"2023-12-16T03:27:14.594115+0000","last_became_active":"2023-12-16T03:27:00.519420+0000","last_became_peered":"2023-12-16T03:27:00.519420+0000","last_unstale":"2023-12-16T03:27:14.594115+0000","last_undegraded":"2023-12-16T03:27:14.594115+0000","last_fullsized":"2023-12-16T03:27:14.594115+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:07.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619116+0000","last_change":"2023-12-16T03:27:14.635936+0000","last_active":"2023-12-16T03:27:15.619116+0000","last_peered":"2023-12-16T03:27:15.619116+0000","last_clean":"2023-12-16T03:27:15.619116+0000","last_became_active":"2023-12-16T03:27:14.635646+0000","last_became_peered":"2023-12-16T03:27:14.635646+0000","last_unstale":"2023-12-16T03:27:15.619116+0000","last_undegraded":"2023-12-16T03:27:15.619116+0000","last_fullsized":"2023-12-16T03:27:15.619116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:01.673594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.610906+0000","last_change":"2023-12-16T03:27:13.593745+0000","last_active":"2023-12-16T03:27:14.610906+0000","last_peered":"2023-12-16T03:27:14.610906+0000","last_clean":"2023-12-16T03:27:14.610906+0000","last_became_active":"2023-12-16T03:27:13.593452+0000","last_became_peered":"2023-12-16T03:27:13.593452+0000","last_unstale":"2023-12-16T03:27:14.610906+0000","last_undegraded":"2023-12-16T03:27:14.610906+0000","last_fullsized":"2023-12-16T03:27:14.610906+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:59.479049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.598408+0000","last_change":"2023-12-16T03:27:01.531143+0000","last_active":"2023-12-16T03:27:14.598408+0000","last_peered":"2023-12-16T03:27:14.598408+0000","last_clean":"2023-12-16T03:27:14.598408+0000","last_became_active":"2023-12-16T03:27:01.530842+0000","last_became_peered":"2023-12-16T03:27:01.530842+0000","last_unstale":"2023-12-16T03:27:14.598408+0000","last_undegraded":"2023-12-16T03:27:14.598408+0000","last_fullsized":"2023-12-16T03:27:14.598408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.594032+0000","last_change":"2023-12-16T03:27:00.524413+0000","last_active":"2023-12-16T03:27:14.594032+0000","last_peered":"2023-12-16T03:27:14.594032+0000","last_clean":"2023-12-16T03:27:14.594032+0000","last_became_active":"2023-12-16T03:27:00.524142+0000","last_became_peered":"2023-12-16T03:27:00.524142+0000","last_unstale":"2023-12-16T03:27:14.594032+0000","last_undegraded":"2023-12-16T03:27:14.594032+0000","last_fullsized":"2023-12-16T03:27:14.594032+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619284+0000","last_change":"2023-12-16T03:27:14.634423+0000","last_active":"2023-12-16T03:27:15.619284+0000","last_peered":"2023-12-16T03:27:15.619284+0000","last_clean":"2023-12-16T03:27:15.619284+0000","last_became_active":"2023-12-16T03:27:14.634119+0000","last_became_peered":"2023-12-16T03:27:14.634119+0000","last_unstale":"2023-12-16T03:27:15.619284+0000","last_undegraded":"2023-12-16T03:27:15.619284+0000","last_fullsized":"2023-12-16T03:27:15.619284+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:48:31.136570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.604212+0000","last_change":"2023-12-16T03:27:13.590348+0000","last_active":"2023-12-16T03:27:14.604212+0000","last_peered":"2023-12-16T03:27:14.604212+0000","last_clean":"2023-12-16T03:27:14.604212+0000","last_became_active":"2023-12-16T03:27:13.590076+0000","last_became_peered":"2023-12-16T03:27:13.590076+0000","last_unstale":"2023-12-16T03:27:14.604212+0000","last_undegraded":"2023-12-16T03:27:14.604212+0000","last_fullsized":"2023-12-16T03:27:14.604212+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:03:07.455078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595649+0000","last_change":"2023-12-16T03:27:01.518068+0000","last_active":"2023-12-16T03:27:14.595649+0000","last_peered":"2023-12-16T03:27:14.595649+0000","last_clean":"2023-12-16T03:27:14.595649+0000","last_became_active":"2023-12-16T03:27:01.516800+0000","last_became_peered":"2023-12-16T03:27:01.516800+0000","last_unstale":"2023-12-16T03:27:14.595649+0000","last_undegraded":"2023-12-16T03:27:14.595649+0000","last_fullsized":"2023-12-16T03:27:14.595649+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603878+0000","last_change":"2023-12-16T03:27:00.515007+0000","last_active":"2023-12-16T03:27:14.603878+0000","last_peered":"2023-12-16T03:27:14.603878+0000","last_clean":"2023-12-16T03:27:14.603878+0000","last_became_active":"2023-12-16T03:27:00.514820+0000","last_became_peered":"2023-12-16T03:27:00.514820+0000","last_unstale":"2023-12-16T03:27:14.603878+0000","last_undegraded":"2023-12-16T03:27:14.603878+0000","last_fullsized":"2023-12-16T03:27:14.603878+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:03:53.754918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343844+0000","last_change":"2023-12-16T03:27:14.616123+0000","last_active":"2023-12-16T03:27:16.343844+0000","last_peered":"2023-12-16T03:27:16.343844+0000","last_clean":"2023-12-16T03:27:16.343844+0000","last_became_active":"2023-12-16T03:27:14.615872+0000","last_became_peered":"2023-12-16T03:27:14.615872+0000","last_unstale":"2023-12-16T03:27:16.343844+0000","last_undegraded":"2023-12-16T03:27:16.343844+0000","last_fullsized":"2023-12-16T03:27:16.343844+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:08.831942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.632873+0000","last_change":"2023-12-16T03:27:13.598174+0000","last_active":"2023-12-16T03:27:14.632873+0000","last_peered":"2023-12-16T03:27:14.632873+0000","last_clean":"2023-12-16T03:27:14.632873+0000","last_became_active":"2023-12-16T03:27:13.597804+0000","last_became_peered":"2023-12-16T03:27:13.597804+0000","last_unstale":"2023-12-16T03:27:14.632873+0000","last_undegraded":"2023-12-16T03:27:14.632873+0000","last_fullsized":"2023-12-16T03:27:14.632873+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:46.648303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.594283+0000","last_change":"2023-12-16T03:27:01.522052+0000","last_active":"2023-12-16T03:27:14.594283+0000","last_peered":"2023-12-16T03:27:14.594283+0000","last_clean":"2023-12-16T03:27:14.594283+0000","last_became_active":"2023-12-16T03:27:01.521669+0000","last_became_peered":"2023-12-16T03:27:01.521669+0000","last_unstale":"2023-12-16T03:27:14.594283+0000","last_undegraded":"2023-12-16T03:27:14.594283+0000","last_fullsized":"2023-12-16T03:27:14.594283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:05.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.614407+0000","last_change":"2023-12-16T03:27:00.516627+0000","last_active":"2023-12-16T03:27:14.614407+0000","last_peered":"2023-12-16T03:27:14.614407+0000","last_clean":"2023-12-16T03:27:14.614407+0000","last_became_active":"2023-12-16T03:27:00.516381+0000","last_became_peered":"2023-12-16T03:27:00.516381+0000","last_unstale":"2023-12-16T03:27:14.614407+0000","last_undegraded":"2023-12-16T03:27:14.614407+0000","last_fullsized":"2023-12-16T03:27:14.614407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.755288+0000","last_change":"2023-12-16T03:27:14.599553+0000","last_active":"2023-12-16T03:27:15.755288+0000","last_peered":"2023-12-16T03:27:15.755288+0000","last_clean":"2023-12-16T03:27:15.755288+0000","last_became_active":"2023-12-16T03:27:14.599255+0000","last_became_peered":"2023-12-16T03:27:14.599255+0000","last_unstale":"2023-12-16T03:27:15.755288+0000","last_undegraded":"2023-12-16T03:27:15.755288+0000","last_fullsized":"2023-12-16T03:27:15.755288+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:21.014337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.593882+0000","last_change":"2023-12-16T03:27:13.599085+0000","last_active":"2023-12-16T03:27:15.593882+0000","last_peered":"2023-12-16T03:27:15.593882+0000","last_clean":"2023-12-16T03:27:15.593882+0000","last_became_active":"2023-12-16T03:27:13.598028+0000","last_became_peered":"2023-12-16T03:27:13.598028+0000","last_unstale":"2023-12-16T03:27:15.593882+0000","last_undegraded":"2023-12-16T03:27:15.593882+0000","last_fullsized":"2023-12-16T03:27:15.593882+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:05.702573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607022+0000","last_change":"2023-12-16T03:27:01.522194+0000","last_active":"2023-12-16T03:27:14.607022+0000","last_peered":"2023-12-16T03:27:14.607022+0000","last_clean":"2023-12-16T03:27:14.607022+0000","last_became_active":"2023-12-16T03:27:01.521667+0000","last_became_peered":"2023-12-16T03:27:01.521667+0000","last_unstale":"2023-12-16T03:27:14.607022+0000","last_undegraded":"2023-12-16T03:27:14.607022+0000","last_fullsized":"2023-12-16T03:27:14.607022+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595350+0000","last_change":"2023-12-16T03:27:00.511361+0000","last_active":"2023-12-16T03:27:14.595350+0000","last_peered":"2023-12-16T03:27:14.595350+0000","last_clean":"2023-12-16T03:27:14.595350+0000","last_became_active":"2023-12-16T03:27:00.511033+0000","last_became_peered":"2023-12-16T03:27:00.511033+0000","last_unstale":"2023-12-16T03:27:14.595350+0000","last_undegraded":"2023-12-16T03:27:14.595350+0000","last_fullsized":"2023-12-16T03:27:14.595350+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:48.295530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.615090+0000","last_change":"2023-12-16T03:27:14.601659+0000","last_active":"2023-12-16T03:27:15.615090+0000","last_peered":"2023-12-16T03:27:15.615090+0000","last_clean":"2023-12-16T03:27:15.615090+0000","last_became_active":"2023-12-16T03:27:14.601360+0000","last_became_peered":"2023-12-16T03:27:14.601360+0000","last_unstale":"2023-12-16T03:27:15.615090+0000","last_undegraded":"2023-12-16T03:27:15.615090+0000","last_fullsized":"2023-12-16T03:27:15.615090+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:26.116955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.598612+0000","last_change":"2023-12-16T03:27:13.594888+0000","last_active":"2023-12-16T03:27:14.598612+0000","last_peered":"2023-12-16T03:27:14.598612+0000","last_clean":"2023-12-16T03:27:14.598612+0000","last_became_active":"2023-12-16T03:27:13.594575+0000","last_became_peered":"2023-12-16T03:27:13.594575+0000","last_unstale":"2023-12-16T03:27:14.598612+0000","last_undegraded":"2023-12-16T03:27:14.598612+0000","last_fullsized":"2023-12-16T03:27:14.598612+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:45.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607428+0000","last_change":"2023-12-16T03:27:01.524848+0000","last_active":"2023-12-16T03:27:14.607428+0000","last_peered":"2023-12-16T03:27:14.607428+0000","last_clean":"2023-12-16T03:27:14.607428+0000","last_became_active":"2023-12-16T03:27:01.524561+0000","last_became_peered":"2023-12-16T03:27:01.524561+0000","last_unstale":"2023-12-16T03:27:14.607428+0000","last_undegraded":"2023-12-16T03:27:14.607428+0000","last_fullsized":"2023-12-16T03:27:14.607428+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.908171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.592554+0000","last_change":"2023-12-16T03:27:00.513344+0000","last_active":"2023-12-16T03:27:14.592554+0000","last_peered":"2023-12-16T03:27:14.592554+0000","last_clean":"2023-12-16T03:27:14.592554+0000","last_became_active":"2023-12-16T03:27:00.513101+0000","last_became_peered":"2023-12-16T03:27:00.513101+0000","last_unstale":"2023-12-16T03:27:14.592554+0000","last_undegraded":"2023-12-16T03:27:14.592554+0000","last_fullsized":"2023-12-16T03:27:14.592554+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:34.745808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.616826+0000","last_change":"2023-12-16T03:27:14.609144+0000","last_active":"2023-12-16T03:27:15.616826+0000","last_peered":"2023-12-16T03:27:15.616826+0000","last_clean":"2023-12-16T03:27:15.616826+0000","last_became_active":"2023-12-16T03:27:14.608793+0000","last_became_peered":"2023-12-16T03:27:14.608793+0000","last_unstale":"2023-12-16T03:27:15.616826+0000","last_undegraded":"2023-12-16T03:27:15.616826+0000","last_fullsized":"2023-12-16T03:27:15.616826+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:20:42.945976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606017+0000","last_change":"2023-12-16T03:27:13.599455+0000","last_active":"2023-12-16T03:27:14.606017+0000","last_peered":"2023-12-16T03:27:14.606017+0000","last_clean":"2023-12-16T03:27:14.606017+0000","last_became_active":"2023-12-16T03:27:13.598440+0000","last_became_peered":"2023-12-16T03:27:13.598440+0000","last_unstale":"2023-12-16T03:27:14.606017+0000","last_undegraded":"2023-12-16T03:27:14.606017+0000","last_fullsized":"2023-12-16T03:27:14.606017+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:53.791096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.615484+0000","last_change":"2023-12-16T03:27:01.543099+0000","last_active":"2023-12-16T03:27:14.615484+0000","last_peered":"2023-12-16T03:27:14.615484+0000","last_clean":"2023-12-16T03:27:14.615484+0000","last_became_active":"2023-12-16T03:27:01.542711+0000","last_became_peered":"2023-12-16T03:27:01.542711+0000","last_unstale":"2023-12-16T03:27:14.615484+0000","last_undegraded":"2023-12-16T03:27:14.615484+0000","last_fullsized":"2023-12-16T03:27:14.615484+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:09.981763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.599178+0000","last_change":"2023-12-16T03:27:00.513164+0000","last_active":"2023-12-16T03:27:14.599178+0000","last_peered":"2023-12-16T03:27:14.599178+0000","last_clean":"2023-12-16T03:27:14.599178+0000","last_became_active":"2023-12-16T03:27:00.512912+0000","last_became_peered":"2023-12-16T03:27:00.512912+0000","last_unstale":"2023-12-16T03:27:14.599178+0000","last_undegraded":"2023-12-16T03:27:14.599178+0000","last_fullsized":"2023-12-16T03:27:14.599178+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342708+0000","last_change":"2023-12-16T03:27:14.616335+0000","last_active":"2023-12-16T03:27:16.342708+0000","last_peered":"2023-12-16T03:27:16.342708+0000","last_clean":"2023-12-16T03:27:16.342708+0000","last_became_active":"2023-12-16T03:27:14.613449+0000","last_became_peered":"2023-12-16T03:27:14.613449+0000","last_unstale":"2023-12-16T03:27:16.342708+0000","last_undegraded":"2023-12-16T03:27:16.342708+0000","last_fullsized":"2023-12-16T03:27:16.342708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:03.855804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609681+0000","last_change":"2023-12-16T03:27:13.595368+0000","last_active":"2023-12-16T03:27:14.609681+0000","last_peered":"2023-12-16T03:27:14.609681+0000","last_clean":"2023-12-16T03:27:14.609681+0000","last_became_active":"2023-12-16T03:27:13.595050+0000","last_became_peered":"2023-12-16T03:27:13.595050+0000","last_unstale":"2023-12-16T03:27:14.609681+0000","last_undegraded":"2023-12-16T03:27:14.609681+0000","last_fullsized":"2023-12-16T03:27:14.609681+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:43.745332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.592006+0000","last_change":"2023-12-16T03:27:01.521887+0000","last_active":"2023-12-16T03:27:14.592006+0000","last_peered":"2023-12-16T03:27:14.592006+0000","last_clean":"2023-12-16T03:27:14.592006+0000","last_became_active":"2023-12-16T03:27:01.521554+0000","last_became_peered":"2023-12-16T03:27:01.521554+0000","last_unstale":"2023-12-16T03:27:14.592006+0000","last_undegraded":"2023-12-16T03:27:14.592006+0000","last_fullsized":"2023-12-16T03:27:14.592006+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:47.409565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.591914+0000","last_change":"2023-12-16T03:27:00.512268+0000","last_active":"2023-12-16T03:27:14.591914+0000","last_peered":"2023-12-16T03:27:14.591914+0000","last_clean":"2023-12-16T03:27:14.591914+0000","last_became_active":"2023-12-16T03:27:00.511945+0000","last_became_peered":"2023-12-16T03:27:00.511945+0000","last_unstale":"2023-12-16T03:27:14.591914+0000","last_undegraded":"2023-12-16T03:27:14.591914+0000","last_fullsized":"2023-12-16T03:27:14.591914+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:49:40.657817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617185+0000","last_change":"2023-12-16T03:27:14.624672+0000","last_active":"2023-12-16T03:27:15.617185+0000","last_peered":"2023-12-16T03:27:15.617185+0000","last_clean":"2023-12-16T03:27:15.617185+0000","last_became_active":"2023-12-16T03:27:14.624121+0000","last_became_peered":"2023-12-16T03:27:14.624121+0000","last_unstale":"2023-12-16T03:27:15.617185+0000","last_undegraded":"2023-12-16T03:27:15.617185+0000","last_fullsized":"2023-12-16T03:27:15.617185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:56.130515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.592016+0000","last_change":"2023-12-16T03:27:13.591271+0000","last_active":"2023-12-16T03:27:14.592016+0000","last_peered":"2023-12-16T03:27:14.592016+0000","last_clean":"2023-12-16T03:27:14.592016+0000","last_became_active":"2023-12-16T03:27:13.590997+0000","last_became_peered":"2023-12-16T03:27:13.590997+0000","last_unstale":"2023-12-16T03:27:14.592016+0000","last_undegraded":"2023-12-16T03:27:14.592016+0000","last_fullsized":"2023-12-16T03:27:14.592016+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:33:01.375762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603078+0000","last_change":"2023-12-16T03:27:01.527192+0000","last_active":"2023-12-16T03:27:14.603078+0000","last_peered":"2023-12-16T03:27:14.603078+0000","last_clean":"2023-12-16T03:27:14.603078+0000","last_became_active":"2023-12-16T03:27:01.526892+0000","last_became_peered":"2023-12-16T03:27:01.526892+0000","last_unstale":"2023-12-16T03:27:14.603078+0000","last_undegraded":"2023-12-16T03:27:14.603078+0000","last_fullsized":"2023-12-16T03:27:14.603078+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:00.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.600643+0000","last_change":"2023-12-16T03:27:00.516056+0000","last_active":"2023-12-16T03:27:14.600643+0000","last_peered":"2023-12-16T03:27:14.600643+0000","last_clean":"2023-12-16T03:27:14.600643+0000","last_became_active":"2023-12-16T03:27:00.515763+0000","last_became_peered":"2023-12-16T03:27:00.515763+0000","last_unstale":"2023-12-16T03:27:14.600643+0000","last_undegraded":"2023-12-16T03:27:14.600643+0000","last_fullsized":"2023-12-16T03:27:14.600643+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:42.045050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931002+0000","last_change":"2023-12-16T03:27:14.622156+0000","last_active":"2023-12-16T03:27:15.931002+0000","last_peered":"2023-12-16T03:27:15.931002+0000","last_clean":"2023-12-16T03:27:15.931002+0000","last_became_active":"2023-12-16T03:27:14.621856+0000","last_became_peered":"2023-12-16T03:27:14.621856+0000","last_unstale":"2023-12-16T03:27:15.931002+0000","last_undegraded":"2023-12-16T03:27:15.931002+0000","last_fullsized":"2023-12-16T03:27:15.931002+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:31.990043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.630664+0000","last_change":"2023-12-16T03:27:13.601694+0000","last_active":"2023-12-16T03:27:14.630664+0000","last_peered":"2023-12-16T03:27:14.630664+0000","last_clean":"2023-12-16T03:27:14.630664+0000","last_became_active":"2023-12-16T03:27:13.601427+0000","last_became_peered":"2023-12-16T03:27:13.601427+0000","last_unstale":"2023-12-16T03:27:14.630664+0000","last_undegraded":"2023-12-16T03:27:14.630664+0000","last_fullsized":"2023-12-16T03:27:14.630664+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:10.832996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.600476+0000","last_change":"2023-12-16T03:27:01.520522+0000","last_active":"2023-12-16T03:27:14.600476+0000","last_peered":"2023-12-16T03:27:14.600476+0000","last_clean":"2023-12-16T03:27:14.600476+0000","last_became_active":"2023-12-16T03:27:01.520214+0000","last_became_peered":"2023-12-16T03:27:01.520214+0000","last_unstale":"2023-12-16T03:27:14.600476+0000","last_undegraded":"2023-12-16T03:27:14.600476+0000","last_fullsized":"2023-12-16T03:27:14.600476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:42.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607003+0000","last_change":"2023-12-16T03:27:00.514945+0000","last_active":"2023-12-16T03:27:14.607003+0000","last_peered":"2023-12-16T03:27:14.607003+0000","last_clean":"2023-12-16T03:27:14.607003+0000","last_became_active":"2023-12-16T03:27:00.514688+0000","last_became_peered":"2023-12-16T03:27:00.514688+0000","last_unstale":"2023-12-16T03:27:14.607003+0000","last_undegraded":"2023-12-16T03:27:14.607003+0000","last_fullsized":"2023-12-16T03:27:14.607003+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.613501+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:27:14.613501+0000","last_peered":"2023-12-16T03:27:14.613501+0000","last_clean":"2023-12-16T03:27:14.613501+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:27:14.613501+0000","last_undegraded":"2023-12-16T03:27:14.613501+0000","last_fullsized":"2023-12-16T03:27:14.613501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":871568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":1.155,"15min":1.155},"last":0.75},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90700000000000003,"5min":1.585,"15min":1.585},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88200000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.81299999999999994,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85099999999999998,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77300000000000002,"15min":0.79100000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.79600000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92700000000000005,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96299999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.62},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94399999999999995,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.72199999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81899999999999995,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.874,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66400000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.499},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.004,"15min":1.004},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.89300000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":280516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.437,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93400000000000005,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93799999999999994,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.83599999999999997}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82899999999999996,"15min":0.85499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95399999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":1.02,"15min":1.075},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96299999999999997,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.85699999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.98099999999999998,"15min":1.0289999999999999},"min":{"1min":0.51200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.042,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.069,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.752}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.87,"15min":0.89700000000000002},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":4.242,"15min":4.242},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.90300000000000002,"15min":0.93500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92600000000000005,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.90600000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88100000000000001,"5min":1.111,"15min":1.111},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.52300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":1.073,"15min":1.073},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.077,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.99099999999999999,"5min":1.246,"15min":1.246},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":281166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.60999999999999999},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1,"15min":1},"last":0.62}]},{"osd":2,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.72599999999999998}]},{"osd":3,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.78800000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74399999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.755,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64000000000000001,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73599999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.82399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.89100000000000001,"5min":1.105,"15min":1.105},"last":0.69999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":663552,"data_stored":283601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.78200000000000003,"15min":0.81000000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":4.194,"15min":4.194},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85299999999999998,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.505},{"interface":"front","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.60599999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.91500000000000004,"5min":1.288,"15min":1.288},"last":0.70599999999999996}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.93500000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84399999999999997,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.92500000000000004,"15min":0.96199999999999997},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86099999999999999,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.68700000000000006}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.92800000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.751,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.51400000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.44600000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96499999999999997,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88600000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88900000000000001,"5min":1.881,"15min":1.881},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.81999999999999995,"15min":0.83999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.65300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":663552,"data_stored":280592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.747,"15min":0.80400000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67700000000000005,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.80900000000000005,"15min":0.871},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.32400000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.66700000000000004,"15min":0.70499999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63500000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.66300000000000003,"15min":0.68400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.72999999999999998,"15min":0.76500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94999999999999996,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.016}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.048,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.89400000000000002,"15min":0.92200000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.89500000000000002,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.83699999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.86899999999999999,"15min":0.89100000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.006,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.92500000000000004,"15min":0.95299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97499999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.98399999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.93400000000000005,"15min":0.96399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94499999999999995,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.95299999999999996,"15min":0.97999999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0609999999999999,"5min":3.375,"15min":3.375},"last":0.96399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":667648,"data_stored":282092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48399999999999999,"15min":0.48499999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.875,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.503,"15min":0.498},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.45300000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.432},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.022},"last":0.51100000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77200000000000002,"15min":0.77700000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1060000000000001,"5min":1.587,"15min":1.587},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0609999999999999,"5min":1.913,"15min":1.913},"last":0.57299999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.498},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.179,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.623}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.04,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":671744,"data_stored":282742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.60999999999999999,"15min":0.64200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97199999999999998,"5min":4.476,"15min":4.476},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.80800000000000005,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73899999999999999,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.749,"15min":0.79300000000000004},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.70299999999999996,"15min":0.73399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.66700000000000004,"15min":0.70099999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.03,"15min":1.0820000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0840000000000001,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.93799999999999994,"15min":0.97199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.133,"5min":4.984,"15min":4.984},"last":0.753}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.90200000000000002,"15min":0.93999999999999995},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.996,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.745,"5min":1.089,"15min":1.147},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0209999999999999,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.70999999999999996}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.95199999999999996,"15min":0.98899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0880000000000001,"15min":1.147},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95299999999999996,"5min":7.681,"15min":7.681},"last":0.63600000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":1.0369999999999999,"15min":1.077},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.177,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.995,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.98199999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.83399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1257472,"data_stored":874481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.751,"15min":0.80900000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68200000000000005,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.89300000000000002,"15min":0.95899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70699999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.54500000000000004}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.93000000000000005,"15min":0.999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.028,"15min":1.1100000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82199999999999995,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.79200000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.92800000000000005,"15min":1.0109999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57399999999999995,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.78100000000000003,"15min":0.82599999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":3.254,"15min":3.254},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95099999999999996,"15min":0.98599999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.872}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.0900000000000001,"15min":1.151},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.98499999999999999,"15min":1.036},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97499999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.84199999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97899999999999998,"15min":1.0249999999999999},"min":{"1min":0.54700000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.171,"15min":1.2450000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94399999999999995,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.65100000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":1.181,"15min":1.2490000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95899999999999996,"5min":4.444,"15min":4.444},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0109999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.94899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:27:23.326 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:27:23.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f77274640 1 Processor -- start 2023-12-16T03:27:23.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f77274640 1 -- start start 2023-12-16T03:27:23.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f77274640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f70151cd0 0x7f0f700ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f77274640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f70154be0 0x7f0f7015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f77274640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f700c8160 con 0x7f0f700c7c50 2023-12-16T03:27:23.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f77274640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f70157b40 con 0x7f0f70154be0 2023-12-16T03:27:23.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f77274640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f70157e20 con 0x7f0f70151cd0 2023-12-16T03:27:23.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f76a73640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f70154be0 0x7f0f7015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f76272640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f70151cd0 0x7f0f700ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f76a73640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f70154be0 0x7f0f7015ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:43132/0 (socket says 172.21.15.28:43132) 2023-12-16T03:27:23.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f76a73640 1 -- 172.21.15.28:0/1879400754 learned_addr learned my addr 172.21.15.28:0/1879400754 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:23.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f75a71640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f0f700c7c50 0x7f0f701544d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:34248/0 (socket says 172.21.15.28:34248) 2023-12-16T03:27:23.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f76a73640 1 -- 172.21.15.28:0/1879400754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f70151cd0 msgr2=0x7f0f700ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:23.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f76a73640 1 --2- 172.21.15.28:0/1879400754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f70151cd0 0x7f0f700ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f76a73640 1 -- 172.21.15.28:0/1879400754 >> v1:172.21.15.134:6789/0 conn(0x7f0f700c7c50 legacy=0x7f0f701544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:23.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.476+0000 7f0f76a73640 1 -- 172.21.15.28:0/1879400754 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f70158100 con 0x7f0f70154be0 2023-12-16T03:27:23.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f76a73640 1 --2- 172.21.15.28:0/1879400754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70154be0 0x7f0f7015ee30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009e50 tx=0x7f0f6801c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a384c382347b0da server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:23.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f75270640 1 -- 172.21.15.28:0/1879400754 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680a58d0 con 0x7f0f70154be0 2023-12-16T03:27:23.482 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f75270640 1 -- 172.21.15.28:0/1879400754 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f680a5a30 con 0x7f0f70154be0 2023-12-16T03:27:23.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f75270640 1 -- 172.21.15.28:0/1879400754 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680a5dc0 con 0x7f0f70154be0 2023-12-16T03:27:23.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f77274640 1 -- 172.21.15.28:0/1879400754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70154be0 msgr2=0x7f0f7015ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:23.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f77274640 1 --2- 172.21.15.28:0/1879400754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70154be0 0x7f0f7015ee30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009e50 tx=0x7f0f6801c9e0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f77274640 1 -- 172.21.15.28:0/1879400754 shutdown_connections 2023-12-16T03:27:23.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f77274640 1 --2- 172.21.15.28:0/1879400754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70154be0 0x7f0f7015ee30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f77274640 1 --2- 172.21.15.28:0/1879400754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f70151cd0 0x7f0f700ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f77274640 1 -- 172.21.15.28:0/1879400754 >> 172.21.15.28:0/1879400754 conn(0x7f0f700abee0 msgr2=0x7f0f700c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:23.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f77274640 1 -- 172.21.15.28:0/1879400754 shutdown_connections 2023-12-16T03:27:23.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.480+0000 7f0f77274640 1 -- 172.21.15.28:0/1879400754 wait complete. 2023-12-16T03:27:23.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f77274640 1 Processor -- start 2023-12-16T03:27:23.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f77274640 1 -- start start 2023-12-16T03:27:23.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f77274640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f700c7c50 0x7f0f701ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f77274640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f70151cd0 0x7f0f70147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f77274640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70154be0 0x7f0f701f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f77274640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f701440d0 con 0x7f0f70151cd0 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f77274640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700c0e20 con 0x7f0f70154be0 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f77274640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700c3500 con 0x7f0f700c7c50 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f75a71640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f70151cd0 0x7f0f70147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f75a71640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f70151cd0 0x7f0f70147fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47220/0 (socket says 172.21.15.28:47220) 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f75a71640 1 -- 172.21.15.28:0/1987879554 learned_addr learned my addr 172.21.15.28:0/1987879554 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f76272640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f700c7c50 0x7f0f701ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f76a73640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70154be0 0x7f0f701f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f75a71640 1 -- 172.21.15.28:0/1987879554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f700c7c50 msgr2=0x7f0f701ed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f75a71640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f700c7c50 0x7f0f701ed6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f75a71640 1 -- 172.21.15.28:0/1987879554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70154be0 msgr2=0x7f0f701f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f75a71640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70154be0 0x7f0f701f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f75a71640 1 -- 172.21.15.28:0/1987879554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68009b30 con 0x7f0f70151cd0 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f75a71640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f70151cd0 0x7f0f70147fd0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000c490 tx=0x7f0f6000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:23.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f66ffd640 1 -- 172.21.15.28:0/1987879554 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60007480 con 0x7f0f70151cd0 2023-12-16T03:27:23.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f66ffd640 1 -- 172.21.15.28:0/1987879554 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f600075e0 con 0x7f0f70151cd0 2023-12-16T03:27:23.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f66ffd640 1 -- 172.21.15.28:0/1987879554 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60004a10 con 0x7f0f70151cd0 2023-12-16T03:27:23.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f77274640 1 -- 172.21.15.28:0/1987879554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f700c3220 con 0x7f0f70151cd0 2023-12-16T03:27:23.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f77274640 1 -- 172.21.15.28:0/1987879554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f701f04e0 con 0x7f0f70151cd0 2023-12-16T03:27:23.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.484+0000 7f0f77274640 1 -- 172.21.15.28:0/1987879554 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f701f0700 con 0x7f0f70151cd0 2023-12-16T03:27:23.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.488+0000 7f0f66ffd640 1 -- 172.21.15.28:0/1987879554 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0f60004b70 con 0x7f0f70151cd0 2023-12-16T03:27:23.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.488+0000 7f0f66ffd640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f540664a0 0x7f0f54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.488+0000 7f0f66ffd640 1 -- 172.21.15.28:0/1987879554 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0f60083210 con 0x7f0f70151cd0 2023-12-16T03:27:23.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.488+0000 7f0f76272640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f540664a0 0x7f0f54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.488+0000 7f0f76272640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f540664a0 0x7f0f54068960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0f700c0a90 tx=0x7f0f6c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:23.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.492+0000 7f0f66ffd640 1 -- 172.21.15.28:0/1987879554 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0f600503d0 con 0x7f0f70151cd0 2023-12-16T03:27:23.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.648+0000 7f0f77274640 1 -- 172.21.15.28:0/1987879554 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f700c83b0 con 0x7f0f540664a0 2023-12-16T03:27:23.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.660+0000 7f0f66ffd640 1 -- 172.21.15.28:0/1987879554 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528105 (secure 0 0 0) 0x7f0f6c011a60 con 0x7f0f540664a0 2023-12-16T03:27:23.672 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 -- 172.21.15.28:0/1987879554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f540664a0 msgr2=0x7f0f54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f540664a0 0x7f0f54068960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0f700c0a90 tx=0x7f0f6c009190 comp rx=0 tx=0).stop 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 -- 172.21.15.28:0/1987879554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f70151cd0 msgr2=0x7f0f70147fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f70151cd0 0x7f0f70147fd0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000c490 tx=0x7f0f6000c950 comp rx=0 tx=0).stop 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 -- 172.21.15.28:0/1987879554 shutdown_connections 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f70154be0 0x7f0f701f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f540664a0 0x7f0f54068960 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f70151cd0 0x7f0f70147fd0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 --2- 172.21.15.28:0/1987879554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f700c7c50 0x7f0f701ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 -- 172.21.15.28:0/1987879554 >> 172.21.15.28:0/1987879554 conn(0x7f0f700abee0 msgr2=0x7f0f701502c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:23.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 -- 172.21.15.28:0/1987879554 shutdown_connections 2023-12-16T03:27:23.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.668+0000 7f0f77274640 1 -- 172.21.15.28:0/1987879554 wait complete. 2023-12-16T03:27:23.689 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-12-16T03:27:21.823470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":361,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243352,"kb_used_data":6344,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731368,"statfs":{"total":773094113280,"available":772844920832,"internally_reserved":0,"allocated":6496256,"data_stored":3436758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001805"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931492+0000","last_change":"2023-12-16T03:27:14.618845+0000","last_active":"2023-12-16T03:27:15.931492+0000","last_peered":"2023-12-16T03:27:15.931492+0000","last_clean":"2023-12-16T03:27:15.931492+0000","last_became_active":"2023-12-16T03:27:14.615198+0000","last_became_peered":"2023-12-16T03:27:14.615198+0000","last_unstale":"2023-12-16T03:27:15.931492+0000","last_undegraded":"2023-12-16T03:27:15.931492+0000","last_fullsized":"2023-12-16T03:27:15.931492+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:25:46.749445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.612544+0000","last_change":"2023-12-16T03:27:01.537420+0000","last_active":"2023-12-16T03:27:14.612544+0000","last_peered":"2023-12-16T03:27:14.612544+0000","last_clean":"2023-12-16T03:27:14.612544+0000","last_became_active":"2023-12-16T03:27:01.537176+0000","last_became_peered":"2023-12-16T03:27:01.537176+0000","last_unstale":"2023-12-16T03:27:14.612544+0000","last_undegraded":"2023-12-16T03:27:14.612544+0000","last_fullsized":"2023-12-16T03:27:14.612544+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:23:26.860864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.615672+0000","last_change":"2023-12-16T03:27:14.629251+0000","last_active":"2023-12-16T03:27:15.615672+0000","last_peered":"2023-12-16T03:27:15.615672+0000","last_clean":"2023-12-16T03:27:15.615672+0000","last_became_active":"2023-12-16T03:27:14.628954+0000","last_became_peered":"2023-12-16T03:27:14.628954+0000","last_unstale":"2023-12-16T03:27:15.615672+0000","last_undegraded":"2023-12-16T03:27:15.615672+0000","last_fullsized":"2023-12-16T03:27:15.615672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:11.840620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609483+0000","last_change":"2023-12-16T03:27:01.534498+0000","last_active":"2023-12-16T03:27:14.609483+0000","last_peered":"2023-12-16T03:27:14.609483+0000","last_clean":"2023-12-16T03:27:14.609483+0000","last_became_active":"2023-12-16T03:27:01.533730+0000","last_became_peered":"2023-12-16T03:27:01.533730+0000","last_unstale":"2023-12-16T03:27:14.609483+0000","last_undegraded":"2023-12-16T03:27:14.609483+0000","last_fullsized":"2023-12-16T03:27:14.609483+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:07.937228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619460+0000","last_change":"2023-12-16T03:27:14.634383+0000","last_active":"2023-12-16T03:27:15.619460+0000","last_peered":"2023-12-16T03:27:15.619460+0000","last_clean":"2023-12-16T03:27:15.619460+0000","last_became_active":"2023-12-16T03:27:14.634078+0000","last_became_peered":"2023-12-16T03:27:14.634078+0000","last_unstale":"2023-12-16T03:27:15.619460+0000","last_undegraded":"2023-12-16T03:27:15.619460+0000","last_fullsized":"2023-12-16T03:27:15.619460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:05.173478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.626980+0000","last_change":"2023-12-16T03:27:01.518121+0000","last_active":"2023-12-16T03:27:14.626980+0000","last_peered":"2023-12-16T03:27:14.626980+0000","last_clean":"2023-12-16T03:27:14.626980+0000","last_became_active":"2023-12-16T03:27:01.517826+0000","last_became_peered":"2023-12-16T03:27:01.517826+0000","last_unstale":"2023-12-16T03:27:14.626980+0000","last_undegraded":"2023-12-16T03:27:14.626980+0000","last_fullsized":"2023-12-16T03:27:14.626980+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:46.909657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617911+0000","last_change":"2023-12-16T03:27:14.617065+0000","last_active":"2023-12-16T03:27:15.617911+0000","last_peered":"2023-12-16T03:27:15.617911+0000","last_clean":"2023-12-16T03:27:15.617911+0000","last_became_active":"2023-12-16T03:27:14.616588+0000","last_became_peered":"2023-12-16T03:27:14.616588+0000","last_unstale":"2023-12-16T03:27:15.617911+0000","last_undegraded":"2023-12-16T03:27:15.617911+0000","last_fullsized":"2023-12-16T03:27:15.617911+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:13.026993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595038+0000","last_change":"2023-12-16T03:27:01.531096+0000","last_active":"2023-12-16T03:27:14.595038+0000","last_peered":"2023-12-16T03:27:14.595038+0000","last_clean":"2023-12-16T03:27:14.595038+0000","last_became_active":"2023-12-16T03:27:01.530793+0000","last_became_peered":"2023-12-16T03:27:01.530793+0000","last_unstale":"2023-12-16T03:27:14.595038+0000","last_undegraded":"2023-12-16T03:27:14.595038+0000","last_fullsized":"2023-12-16T03:27:14.595038+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:59.366673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.754556+0000","last_change":"2023-12-16T03:27:14.600558+0000","last_active":"2023-12-16T03:27:15.754556+0000","last_peered":"2023-12-16T03:27:15.754556+0000","last_clean":"2023-12-16T03:27:15.754556+0000","last_became_active":"2023-12-16T03:27:14.600267+0000","last_became_peered":"2023-12-16T03:27:14.600267+0000","last_unstale":"2023-12-16T03:27:15.754556+0000","last_undegraded":"2023-12-16T03:27:15.754556+0000","last_fullsized":"2023-12-16T03:27:15.754556+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:20:24.493662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609848+0000","last_change":"2023-12-16T03:27:01.531904+0000","last_active":"2023-12-16T03:27:14.609848+0000","last_peered":"2023-12-16T03:27:14.609848+0000","last_clean":"2023-12-16T03:27:14.609848+0000","last_became_active":"2023-12-16T03:27:01.531705+0000","last_became_peered":"2023-12-16T03:27:01.531705+0000","last_unstale":"2023-12-16T03:27:14.609848+0000","last_undegraded":"2023-12-16T03:27:14.609848+0000","last_fullsized":"2023-12-16T03:27:14.609848+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:24:38.684552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617809+0000","last_change":"2023-12-16T03:27:14.614217+0000","last_active":"2023-12-16T03:27:15.617809+0000","last_peered":"2023-12-16T03:27:15.617809+0000","last_clean":"2023-12-16T03:27:15.617809+0000","last_became_active":"2023-12-16T03:27:14.613936+0000","last_became_peered":"2023-12-16T03:27:14.613936+0000","last_unstale":"2023-12-16T03:27:15.617809+0000","last_undegraded":"2023-12-16T03:27:15.617809+0000","last_fullsized":"2023-12-16T03:27:15.617809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:01.292849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602995+0000","last_change":"2023-12-16T03:27:01.537597+0000","last_active":"2023-12-16T03:27:14.602995+0000","last_peered":"2023-12-16T03:27:14.602995+0000","last_clean":"2023-12-16T03:27:14.602995+0000","last_became_active":"2023-12-16T03:27:01.537262+0000","last_became_peered":"2023-12-16T03:27:01.537262+0000","last_unstale":"2023-12-16T03:27:14.602995+0000","last_undegraded":"2023-12-16T03:27:14.602995+0000","last_fullsized":"2023-12-16T03:27:14.602995+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342653+0000","last_change":"2023-12-16T03:27:14.618241+0000","last_active":"2023-12-16T03:27:16.342653+0000","last_peered":"2023-12-16T03:27:16.342653+0000","last_clean":"2023-12-16T03:27:16.342653+0000","last_became_active":"2023-12-16T03:27:14.617805+0000","last_became_peered":"2023-12-16T03:27:14.617805+0000","last_unstale":"2023-12-16T03:27:16.342653+0000","last_undegraded":"2023-12-16T03:27:16.342653+0000","last_fullsized":"2023-12-16T03:27:16.342653+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:56.098012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.598695+0000","last_change":"2023-12-16T03:27:01.504710+0000","last_active":"2023-12-16T03:27:14.598695+0000","last_peered":"2023-12-16T03:27:14.598695+0000","last_clean":"2023-12-16T03:27:14.598695+0000","last_became_active":"2023-12-16T03:27:01.504412+0000","last_became_peered":"2023-12-16T03:27:01.504412+0000","last_unstale":"2023-12-16T03:27:14.598695+0000","last_undegraded":"2023-12-16T03:27:14.598695+0000","last_fullsized":"2023-12-16T03:27:14.598695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:09.298222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617182+0000","last_change":"2023-12-16T03:27:14.629585+0000","last_active":"2023-12-16T03:27:15.617182+0000","last_peered":"2023-12-16T03:27:15.617182+0000","last_clean":"2023-12-16T03:27:15.617182+0000","last_became_active":"2023-12-16T03:27:14.629299+0000","last_became_peered":"2023-12-16T03:27:14.629299+0000","last_unstale":"2023-12-16T03:27:15.617182+0000","last_undegraded":"2023-12-16T03:27:15.617182+0000","last_fullsized":"2023-12-16T03:27:15.617182+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:20:37.946431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.600353+0000","last_change":"2023-12-16T03:27:01.514585+0000","last_active":"2023-12-16T03:27:14.600353+0000","last_peered":"2023-12-16T03:27:14.600353+0000","last_clean":"2023-12-16T03:27:14.600353+0000","last_became_active":"2023-12-16T03:27:01.514304+0000","last_became_peered":"2023-12-16T03:27:01.514304+0000","last_unstale":"2023-12-16T03:27:14.600353+0000","last_undegraded":"2023-12-16T03:27:14.600353+0000","last_fullsized":"2023-12-16T03:27:14.600353+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:44:59.949884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619126+0000","last_change":"2023-12-16T03:27:14.630574+0000","last_active":"2023-12-16T03:27:15.619126+0000","last_peered":"2023-12-16T03:27:15.619126+0000","last_clean":"2023-12-16T03:27:15.619126+0000","last_became_active":"2023-12-16T03:27:14.629743+0000","last_became_peered":"2023-12-16T03:27:14.629743+0000","last_unstale":"2023-12-16T03:27:15.619126+0000","last_undegraded":"2023-12-16T03:27:15.619126+0000","last_fullsized":"2023-12-16T03:27:15.619126+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:12:52.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602211+0000","last_change":"2023-12-16T03:27:01.517287+0000","last_active":"2023-12-16T03:27:14.602211+0000","last_peered":"2023-12-16T03:27:14.602211+0000","last_clean":"2023-12-16T03:27:14.602211+0000","last_became_active":"2023-12-16T03:27:01.516865+0000","last_became_peered":"2023-12-16T03:27:01.516865+0000","last_unstale":"2023-12-16T03:27:14.602211+0000","last_undegraded":"2023-12-16T03:27:14.602211+0000","last_fullsized":"2023-12-16T03:27:14.602211+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:49.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.615366+0000","last_change":"2023-12-16T03:27:14.617508+0000","last_active":"2023-12-16T03:27:15.615366+0000","last_peered":"2023-12-16T03:27:15.615366+0000","last_clean":"2023-12-16T03:27:15.615366+0000","last_became_active":"2023-12-16T03:27:14.615609+0000","last_became_peered":"2023-12-16T03:27:14.615609+0000","last_unstale":"2023-12-16T03:27:15.615366+0000","last_undegraded":"2023-12-16T03:27:15.615366+0000","last_fullsized":"2023-12-16T03:27:15.615366+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:17.099834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.593637+0000","last_change":"2023-12-16T03:27:01.523610+0000","last_active":"2023-12-16T03:27:14.593637+0000","last_peered":"2023-12-16T03:27:14.593637+0000","last_clean":"2023-12-16T03:27:14.593637+0000","last_became_active":"2023-12-16T03:27:01.523269+0000","last_became_peered":"2023-12-16T03:27:01.523269+0000","last_unstale":"2023-12-16T03:27:14.593637+0000","last_undegraded":"2023-12-16T03:27:14.593637+0000","last_fullsized":"2023-12-16T03:27:14.593637+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:43.020903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343448+0000","last_change":"2023-12-16T03:27:14.625055+0000","last_active":"2023-12-16T03:27:16.343448+0000","last_peered":"2023-12-16T03:27:16.343448+0000","last_clean":"2023-12-16T03:27:16.343448+0000","last_became_active":"2023-12-16T03:27:14.624746+0000","last_became_peered":"2023-12-16T03:27:14.624746+0000","last_unstale":"2023-12-16T03:27:16.343448+0000","last_undegraded":"2023-12-16T03:27:16.343448+0000","last_fullsized":"2023-12-16T03:27:16.343448+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:45:22.375331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.593512+0000","last_change":"2023-12-16T03:27:01.534387+0000","last_active":"2023-12-16T03:27:14.593512+0000","last_peered":"2023-12-16T03:27:14.593512+0000","last_clean":"2023-12-16T03:27:14.593512+0000","last_became_active":"2023-12-16T03:27:01.534102+0000","last_became_peered":"2023-12-16T03:27:01.534102+0000","last_unstale":"2023-12-16T03:27:14.593512+0000","last_undegraded":"2023-12-16T03:27:14.593512+0000","last_fullsized":"2023-12-16T03:27:14.593512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:48:59.290783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342800+0000","last_change":"2023-12-16T03:27:14.616229+0000","last_active":"2023-12-16T03:27:16.342800+0000","last_peered":"2023-12-16T03:27:16.342800+0000","last_clean":"2023-12-16T03:27:16.342800+0000","last_became_active":"2023-12-16T03:27:14.615809+0000","last_became_peered":"2023-12-16T03:27:14.615809+0000","last_unstale":"2023-12-16T03:27:16.342800+0000","last_undegraded":"2023-12-16T03:27:16.342800+0000","last_fullsized":"2023-12-16T03:27:16.342800+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:01.292849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595141+0000","last_change":"2023-12-16T03:27:01.514907+0000","last_active":"2023-12-16T03:27:14.595141+0000","last_peered":"2023-12-16T03:27:14.595141+0000","last_clean":"2023-12-16T03:27:14.595141+0000","last_became_active":"2023-12-16T03:27:01.514396+0000","last_became_peered":"2023-12-16T03:27:01.514396+0000","last_unstale":"2023-12-16T03:27:14.595141+0000","last_undegraded":"2023-12-16T03:27:14.595141+0000","last_fullsized":"2023-12-16T03:27:14.595141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342428+0000","last_change":"2023-12-16T03:27:14.614822+0000","last_active":"2023-12-16T03:27:16.342428+0000","last_peered":"2023-12-16T03:27:16.342428+0000","last_clean":"2023-12-16T03:27:16.342428+0000","last_became_active":"2023-12-16T03:27:14.614472+0000","last_became_peered":"2023-12-16T03:27:14.614472+0000","last_unstale":"2023-12-16T03:27:16.342428+0000","last_undegraded":"2023-12-16T03:27:16.342428+0000","last_fullsized":"2023-12-16T03:27:16.342428+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:21.014337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.608453+0000","last_change":"2023-12-16T03:27:01.533053+0000","last_active":"2023-12-16T03:27:14.608453+0000","last_peered":"2023-12-16T03:27:14.608453+0000","last_clean":"2023-12-16T03:27:14.608453+0000","last_became_active":"2023-12-16T03:27:01.532852+0000","last_became_peered":"2023-12-16T03:27:01.532852+0000","last_unstale":"2023-12-16T03:27:14.608453+0000","last_undegraded":"2023-12-16T03:27:14.608453+0000","last_fullsized":"2023-12-16T03:27:14.608453+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:05.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342015+0000","last_change":"2023-12-16T03:27:14.625175+0000","last_active":"2023-12-16T03:27:16.342015+0000","last_peered":"2023-12-16T03:27:16.342015+0000","last_clean":"2023-12-16T03:27:16.342015+0000","last_became_active":"2023-12-16T03:27:14.624893+0000","last_became_peered":"2023-12-16T03:27:14.624893+0000","last_unstale":"2023-12-16T03:27:16.342015+0000","last_undegraded":"2023-12-16T03:27:16.342015+0000","last_fullsized":"2023-12-16T03:27:16.342015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:56.130515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.599097+0000","last_change":"2023-12-16T03:27:01.527464+0000","last_active":"2023-12-16T03:27:14.599097+0000","last_peered":"2023-12-16T03:27:14.599097+0000","last_clean":"2023-12-16T03:27:14.599097+0000","last_became_active":"2023-12-16T03:27:01.526439+0000","last_became_peered":"2023-12-16T03:27:01.526439+0000","last_unstale":"2023-12-16T03:27:14.599097+0000","last_undegraded":"2023-12-16T03:27:14.599097+0000","last_fullsized":"2023-12-16T03:27:14.599097+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:55.347747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343215+0000","last_change":"2023-12-16T03:27:14.623035+0000","last_active":"2023-12-16T03:27:16.343215+0000","last_peered":"2023-12-16T03:27:16.343215+0000","last_clean":"2023-12-16T03:27:16.343215+0000","last_became_active":"2023-12-16T03:27:14.622753+0000","last_became_peered":"2023-12-16T03:27:14.622753+0000","last_unstale":"2023-12-16T03:27:16.343215+0000","last_undegraded":"2023-12-16T03:27:16.343215+0000","last_fullsized":"2023-12-16T03:27:16.343215+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:38:03.398274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.598863+0000","last_change":"2023-12-16T03:27:01.523106+0000","last_active":"2023-12-16T03:27:14.598863+0000","last_peered":"2023-12-16T03:27:14.598863+0000","last_clean":"2023-12-16T03:27:14.598863+0000","last_became_active":"2023-12-16T03:27:01.522824+0000","last_became_peered":"2023-12-16T03:27:01.522824+0000","last_unstale":"2023-12-16T03:27:14.598863+0000","last_undegraded":"2023-12-16T03:27:14.598863+0000","last_fullsized":"2023-12-16T03:27:14.598863+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:04.563786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343002+0000","last_change":"2023-12-16T03:27:14.620549+0000","last_active":"2023-12-16T03:27:16.343002+0000","last_peered":"2023-12-16T03:27:16.343002+0000","last_clean":"2023-12-16T03:27:16.343002+0000","last_became_active":"2023-12-16T03:27:14.618707+0000","last_became_peered":"2023-12-16T03:27:14.618707+0000","last_unstale":"2023-12-16T03:27:16.343002+0000","last_undegraded":"2023-12-16T03:27:16.343002+0000","last_fullsized":"2023-12-16T03:27:16.343002+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:33.188009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602479+0000","last_change":"2023-12-16T03:27:01.513664+0000","last_active":"2023-12-16T03:27:14.602479+0000","last_peered":"2023-12-16T03:27:14.602479+0000","last_clean":"2023-12-16T03:27:14.602479+0000","last_became_active":"2023-12-16T03:27:01.513325+0000","last_became_peered":"2023-12-16T03:27:01.513325+0000","last_unstale":"2023-12-16T03:27:14.602479+0000","last_undegraded":"2023-12-16T03:27:14.602479+0000","last_fullsized":"2023-12-16T03:27:14.602479+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617256+0000","last_change":"2023-12-16T03:27:14.617146+0000","last_active":"2023-12-16T03:27:15.617256+0000","last_peered":"2023-12-16T03:27:15.617256+0000","last_clean":"2023-12-16T03:27:15.617256+0000","last_became_active":"2023-12-16T03:27:14.616808+0000","last_became_peered":"2023-12-16T03:27:14.616808+0000","last_unstale":"2023-12-16T03:27:15.617256+0000","last_undegraded":"2023-12-16T03:27:15.617256+0000","last_fullsized":"2023-12-16T03:27:15.617256+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:39:06.433314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.611208+0000","last_change":"2023-12-16T03:27:01.526203+0000","last_active":"2023-12-16T03:27:14.611208+0000","last_peered":"2023-12-16T03:27:14.611208+0000","last_clean":"2023-12-16T03:27:14.611208+0000","last_became_active":"2023-12-16T03:27:01.525873+0000","last_became_peered":"2023-12-16T03:27:01.525873+0000","last_unstale":"2023-12-16T03:27:14.611208+0000","last_undegraded":"2023-12-16T03:27:14.611208+0000","last_fullsized":"2023-12-16T03:27:14.611208+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:37:50.321166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343512+0000","last_change":"2023-12-16T03:27:14.617920+0000","last_active":"2023-12-16T03:27:16.343512+0000","last_peered":"2023-12-16T03:27:16.343512+0000","last_clean":"2023-12-16T03:27:16.343512+0000","last_became_active":"2023-12-16T03:27:14.616966+0000","last_became_peered":"2023-12-16T03:27:14.616966+0000","last_unstale":"2023-12-16T03:27:16.343512+0000","last_undegraded":"2023-12-16T03:27:16.343512+0000","last_fullsized":"2023-12-16T03:27:16.343512+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:06.139993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.624109+0000","last_change":"2023-12-16T03:27:01.529407+0000","last_active":"2023-12-16T03:27:14.624109+0000","last_peered":"2023-12-16T03:27:14.624109+0000","last_clean":"2023-12-16T03:27:14.624109+0000","last_became_active":"2023-12-16T03:27:01.529024+0000","last_became_peered":"2023-12-16T03:27:01.529024+0000","last_unstale":"2023-12-16T03:27:14.624109+0000","last_undegraded":"2023-12-16T03:27:14.624109+0000","last_fullsized":"2023-12-16T03:27:14.624109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343536+0000","last_change":"2023-12-16T03:27:14.620094+0000","last_active":"2023-12-16T03:27:16.343536+0000","last_peered":"2023-12-16T03:27:16.343536+0000","last_clean":"2023-12-16T03:27:16.343536+0000","last_became_active":"2023-12-16T03:27:14.619849+0000","last_became_peered":"2023-12-16T03:27:14.619849+0000","last_unstale":"2023-12-16T03:27:16.343536+0000","last_undegraded":"2023-12-16T03:27:16.343536+0000","last_fullsized":"2023-12-16T03:27:16.343536+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:17.640895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.610989+0000","last_change":"2023-12-16T03:27:01.538362+0000","last_active":"2023-12-16T03:27:14.610989+0000","last_peered":"2023-12-16T03:27:14.610989+0000","last_clean":"2023-12-16T03:27:14.610989+0000","last_became_active":"2023-12-16T03:27:01.538024+0000","last_became_peered":"2023-12-16T03:27:01.538024+0000","last_unstale":"2023-12-16T03:27:14.610989+0000","last_undegraded":"2023-12-16T03:27:14.610989+0000","last_fullsized":"2023-12-16T03:27:14.610989+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:19:44.941057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.615453+0000","last_change":"2023-12-16T03:27:14.623711+0000","last_active":"2023-12-16T03:27:15.615453+0000","last_peered":"2023-12-16T03:27:15.615453+0000","last_clean":"2023-12-16T03:27:15.615453+0000","last_became_active":"2023-12-16T03:27:14.623416+0000","last_became_peered":"2023-12-16T03:27:14.623416+0000","last_unstale":"2023-12-16T03:27:15.615453+0000","last_undegraded":"2023-12-16T03:27:15.615453+0000","last_fullsized":"2023-12-16T03:27:15.615453+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:54.798720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609950+0000","last_change":"2023-12-16T03:27:01.535927+0000","last_active":"2023-12-16T03:27:14.609950+0000","last_peered":"2023-12-16T03:27:14.609950+0000","last_clean":"2023-12-16T03:27:14.609950+0000","last_became_active":"2023-12-16T03:27:01.535618+0000","last_became_peered":"2023-12-16T03:27:01.535618+0000","last_unstale":"2023-12-16T03:27:14.609950+0000","last_undegraded":"2023-12-16T03:27:14.609950+0000","last_fullsized":"2023-12-16T03:27:14.609950+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:46.786632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.618644+0000","last_change":"2023-12-16T03:27:14.624537+0000","last_active":"2023-12-16T03:27:15.618644+0000","last_peered":"2023-12-16T03:27:15.618644+0000","last_clean":"2023-12-16T03:27:15.618644+0000","last_became_active":"2023-12-16T03:27:14.624252+0000","last_became_peered":"2023-12-16T03:27:14.624252+0000","last_unstale":"2023-12-16T03:27:15.618644+0000","last_undegraded":"2023-12-16T03:27:15.618644+0000","last_fullsized":"2023-12-16T03:27:15.618644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:06.139993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.615325+0000","last_change":"2023-12-16T03:27:01.520051+0000","last_active":"2023-12-16T03:27:14.615325+0000","last_peered":"2023-12-16T03:27:14.615325+0000","last_clean":"2023-12-16T03:27:14.615325+0000","last_became_active":"2023-12-16T03:27:01.519803+0000","last_became_peered":"2023-12-16T03:27:01.519803+0000","last_unstale":"2023-12-16T03:27:14.615325+0000","last_undegraded":"2023-12-16T03:27:14.615325+0000","last_fullsized":"2023-12-16T03:27:14.615325+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.618512+0000","last_change":"2023-12-16T03:27:14.636524+0000","last_active":"2023-12-16T03:27:15.618512+0000","last_peered":"2023-12-16T03:27:15.618512+0000","last_clean":"2023-12-16T03:27:15.618512+0000","last_became_active":"2023-12-16T03:27:14.635617+0000","last_became_peered":"2023-12-16T03:27:14.635617+0000","last_unstale":"2023-12-16T03:27:15.618512+0000","last_undegraded":"2023-12-16T03:27:15.618512+0000","last_fullsized":"2023-12-16T03:27:15.618512+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:38:03.398274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607262+0000","last_change":"2023-12-16T03:27:01.523786+0000","last_active":"2023-12-16T03:27:14.607262+0000","last_peered":"2023-12-16T03:27:14.607262+0000","last_clean":"2023-12-16T03:27:14.607262+0000","last_became_active":"2023-12-16T03:27:01.523435+0000","last_became_peered":"2023-12-16T03:27:01.523435+0000","last_unstale":"2023-12-16T03:27:14.607262+0000","last_undegraded":"2023-12-16T03:27:14.607262+0000","last_fullsized":"2023-12-16T03:27:14.607262+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:59:37.033807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342543+0000","last_change":"2023-12-16T03:27:14.611189+0000","last_active":"2023-12-16T03:27:16.342543+0000","last_peered":"2023-12-16T03:27:16.342543+0000","last_clean":"2023-12-16T03:27:16.342543+0000","last_became_active":"2023-12-16T03:27:14.610841+0000","last_became_peered":"2023-12-16T03:27:14.610841+0000","last_unstale":"2023-12-16T03:27:16.342543+0000","last_undegraded":"2023-12-16T03:27:16.342543+0000","last_fullsized":"2023-12-16T03:27:16.342543+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:08:04.940525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.612971+0000","last_change":"2023-12-16T03:27:01.539536+0000","last_active":"2023-12-16T03:27:14.612971+0000","last_peered":"2023-12-16T03:27:14.612971+0000","last_clean":"2023-12-16T03:27:14.612971+0000","last_became_active":"2023-12-16T03:27:01.539210+0000","last_became_peered":"2023-12-16T03:27:01.539210+0000","last_unstale":"2023-12-16T03:27:14.612971+0000","last_undegraded":"2023-12-16T03:27:14.612971+0000","last_fullsized":"2023-12-16T03:27:14.612971+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:13.039846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342283+0000","last_change":"2023-12-16T03:27:14.621328+0000","last_active":"2023-12-16T03:27:16.342283+0000","last_peered":"2023-12-16T03:27:16.342283+0000","last_clean":"2023-12-16T03:27:16.342283+0000","last_became_active":"2023-12-16T03:27:14.617909+0000","last_became_peered":"2023-12-16T03:27:14.617909+0000","last_unstale":"2023-12-16T03:27:16.342283+0000","last_undegraded":"2023-12-16T03:27:16.342283+0000","last_fullsized":"2023-12-16T03:27:16.342283+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:02.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606218+0000","last_change":"2023-12-16T03:27:01.521374+0000","last_active":"2023-12-16T03:27:14.606218+0000","last_peered":"2023-12-16T03:27:14.606218+0000","last_clean":"2023-12-16T03:27:14.606218+0000","last_became_active":"2023-12-16T03:27:01.521080+0000","last_became_peered":"2023-12-16T03:27:01.521080+0000","last_unstale":"2023-12-16T03:27:14.606218+0000","last_undegraded":"2023-12-16T03:27:14.606218+0000","last_fullsized":"2023-12-16T03:27:14.606218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:47.409565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931347+0000","last_change":"2023-12-16T03:27:14.625210+0000","last_active":"2023-12-16T03:27:15.931347+0000","last_peered":"2023-12-16T03:27:15.931347+0000","last_clean":"2023-12-16T03:27:15.931347+0000","last_became_active":"2023-12-16T03:27:14.624924+0000","last_became_peered":"2023-12-16T03:27:14.624924+0000","last_unstale":"2023-12-16T03:27:15.931347+0000","last_undegraded":"2023-12-16T03:27:15.931347+0000","last_fullsized":"2023-12-16T03:27:15.931347+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:52:58.531150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.612785+0000","last_change":"2023-12-16T03:27:01.537212+0000","last_active":"2023-12-16T03:27:14.612785+0000","last_peered":"2023-12-16T03:27:14.612785+0000","last_clean":"2023-12-16T03:27:14.612785+0000","last_became_active":"2023-12-16T03:27:01.536927+0000","last_became_peered":"2023-12-16T03:27:01.536927+0000","last_unstale":"2023-12-16T03:27:14.612785+0000","last_undegraded":"2023-12-16T03:27:14.612785+0000","last_fullsized":"2023-12-16T03:27:14.612785+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:59.764629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342620+0000","last_change":"2023-12-16T03:27:14.615707+0000","last_active":"2023-12-16T03:27:16.342620+0000","last_peered":"2023-12-16T03:27:16.342620+0000","last_clean":"2023-12-16T03:27:16.342620+0000","last_became_active":"2023-12-16T03:27:14.613062+0000","last_became_peered":"2023-12-16T03:27:14.613062+0000","last_unstale":"2023-12-16T03:27:16.342620+0000","last_undegraded":"2023-12-16T03:27:16.342620+0000","last_fullsized":"2023-12-16T03:27:16.342620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:10:06.644279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.598217+0000","last_change":"2023-12-16T03:27:01.506167+0000","last_active":"2023-12-16T03:27:14.598217+0000","last_peered":"2023-12-16T03:27:14.598217+0000","last_clean":"2023-12-16T03:27:14.598217+0000","last_became_active":"2023-12-16T03:27:01.505856+0000","last_became_peered":"2023-12-16T03:27:01.505856+0000","last_unstale":"2023-12-16T03:27:14.598217+0000","last_undegraded":"2023-12-16T03:27:14.598217+0000","last_fullsized":"2023-12-16T03:27:14.598217+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342859+0000","last_change":"2023-12-16T03:27:14.630309+0000","last_active":"2023-12-16T03:27:16.342859+0000","last_peered":"2023-12-16T03:27:16.342859+0000","last_clean":"2023-12-16T03:27:16.342859+0000","last_became_active":"2023-12-16T03:27:14.630023+0000","last_became_peered":"2023-12-16T03:27:14.630023+0000","last_unstale":"2023-12-16T03:27:16.342859+0000","last_undegraded":"2023-12-16T03:27:16.342859+0000","last_fullsized":"2023-12-16T03:27:16.342859+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:13.026993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606857+0000","last_change":"2023-12-16T03:27:01.514340+0000","last_active":"2023-12-16T03:27:14.606857+0000","last_peered":"2023-12-16T03:27:14.606857+0000","last_clean":"2023-12-16T03:27:14.606857+0000","last_became_active":"2023-12-16T03:27:01.514047+0000","last_became_peered":"2023-12-16T03:27:01.514047+0000","last_unstale":"2023-12-16T03:27:14.606857+0000","last_undegraded":"2023-12-16T03:27:14.606857+0000","last_fullsized":"2023-12-16T03:27:14.606857+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.755261+0000","last_change":"2023-12-16T03:27:14.622354+0000","last_active":"2023-12-16T03:27:15.755261+0000","last_peered":"2023-12-16T03:27:15.755261+0000","last_clean":"2023-12-16T03:27:15.755261+0000","last_became_active":"2023-12-16T03:27:14.622002+0000","last_became_peered":"2023-12-16T03:27:14.622002+0000","last_unstale":"2023-12-16T03:27:15.755261+0000","last_undegraded":"2023-12-16T03:27:15.755261+0000","last_fullsized":"2023-12-16T03:27:15.755261+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:37:24.906594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.610076+0000","last_change":"2023-12-16T03:27:01.531612+0000","last_active":"2023-12-16T03:27:14.610076+0000","last_peered":"2023-12-16T03:27:14.610076+0000","last_clean":"2023-12-16T03:27:14.610076+0000","last_became_active":"2023-12-16T03:27:01.531274+0000","last_became_peered":"2023-12-16T03:27:01.531274+0000","last_unstale":"2023-12-16T03:27:14.610076+0000","last_undegraded":"2023-12-16T03:27:14.610076+0000","last_fullsized":"2023-12-16T03:27:14.610076+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:39:58.878396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.754682+0000","last_change":"2023-12-16T03:27:14.604526+0000","last_active":"2023-12-16T03:27:15.754682+0000","last_peered":"2023-12-16T03:27:15.754682+0000","last_clean":"2023-12-16T03:27:15.754682+0000","last_became_active":"2023-12-16T03:27:14.604214+0000","last_became_peered":"2023-12-16T03:27:14.604214+0000","last_unstale":"2023-12-16T03:27:15.754682+0000","last_undegraded":"2023-12-16T03:27:15.754682+0000","last_fullsized":"2023-12-16T03:27:15.754682+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:22:24.851175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.608145+0000","last_change":"2023-12-16T03:27:01.527562+0000","last_active":"2023-12-16T03:27:14.608145+0000","last_peered":"2023-12-16T03:27:14.608145+0000","last_clean":"2023-12-16T03:27:14.608145+0000","last_became_active":"2023-12-16T03:27:01.525171+0000","last_became_peered":"2023-12-16T03:27:01.525171+0000","last_unstale":"2023-12-16T03:27:14.608145+0000","last_undegraded":"2023-12-16T03:27:14.608145+0000","last_fullsized":"2023-12-16T03:27:14.608145+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:02:55.385594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617661+0000","last_change":"2023-12-16T03:27:14.615113+0000","last_active":"2023-12-16T03:27:15.617661+0000","last_peered":"2023-12-16T03:27:15.617661+0000","last_clean":"2023-12-16T03:27:15.617661+0000","last_became_active":"2023-12-16T03:27:14.614825+0000","last_became_peered":"2023-12-16T03:27:14.614825+0000","last_unstale":"2023-12-16T03:27:15.617661+0000","last_undegraded":"2023-12-16T03:27:15.617661+0000","last_fullsized":"2023-12-16T03:27:15.617661+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:10:06.644279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.614973+0000","last_change":"2023-12-16T03:27:01.518371+0000","last_active":"2023-12-16T03:27:14.614973+0000","last_peered":"2023-12-16T03:27:14.614973+0000","last_clean":"2023-12-16T03:27:14.614973+0000","last_became_active":"2023-12-16T03:27:01.518088+0000","last_became_peered":"2023-12-16T03:27:01.518088+0000","last_unstale":"2023-12-16T03:27:14.614973+0000","last_undegraded":"2023-12-16T03:27:14.614973+0000","last_fullsized":"2023-12-16T03:27:14.614973+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931593+0000","last_change":"2023-12-16T03:27:14.617044+0000","last_active":"2023-12-16T03:27:15.931593+0000","last_peered":"2023-12-16T03:27:15.931593+0000","last_clean":"2023-12-16T03:27:15.931593+0000","last_became_active":"2023-12-16T03:27:14.616743+0000","last_became_peered":"2023-12-16T03:27:14.616743+0000","last_unstale":"2023-12-16T03:27:15.931593+0000","last_undegraded":"2023-12-16T03:27:15.931593+0000","last_fullsized":"2023-12-16T03:27:15.931593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:00:24.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606299+0000","last_change":"2023-12-16T03:27:01.532530+0000","last_active":"2023-12-16T03:27:14.606299+0000","last_peered":"2023-12-16T03:27:14.606299+0000","last_clean":"2023-12-16T03:27:14.606299+0000","last_became_active":"2023-12-16T03:27:01.532228+0000","last_became_peered":"2023-12-16T03:27:01.532228+0000","last_unstale":"2023-12-16T03:27:14.606299+0000","last_undegraded":"2023-12-16T03:27:14.606299+0000","last_fullsized":"2023-12-16T03:27:14.606299+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:51:37.578189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.754626+0000","last_change":"2023-12-16T03:27:14.621399+0000","last_active":"2023-12-16T03:27:15.754626+0000","last_peered":"2023-12-16T03:27:15.754626+0000","last_clean":"2023-12-16T03:27:15.754626+0000","last_became_active":"2023-12-16T03:27:14.621084+0000","last_became_peered":"2023-12-16T03:27:14.621084+0000","last_unstale":"2023-12-16T03:27:15.754626+0000","last_undegraded":"2023-12-16T03:27:15.754626+0000","last_fullsized":"2023-12-16T03:27:15.754626+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:17:00.985279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602718+0000","last_change":"2023-12-16T03:27:01.526590+0000","last_active":"2023-12-16T03:27:14.602718+0000","last_peered":"2023-12-16T03:27:14.602718+0000","last_clean":"2023-12-16T03:27:14.602718+0000","last_became_active":"2023-12-16T03:27:01.525400+0000","last_became_peered":"2023-12-16T03:27:01.525400+0000","last_unstale":"2023-12-16T03:27:14.602718+0000","last_undegraded":"2023-12-16T03:27:14.602718+0000","last_fullsized":"2023-12-16T03:27:14.602718+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:46.909657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617241+0000","last_change":"2023-12-16T03:27:14.628017+0000","last_active":"2023-12-16T03:27:15.617241+0000","last_peered":"2023-12-16T03:27:15.617241+0000","last_clean":"2023-12-16T03:27:15.617241+0000","last_became_active":"2023-12-16T03:27:14.627723+0000","last_became_peered":"2023-12-16T03:27:14.627723+0000","last_unstale":"2023-12-16T03:27:15.617241+0000","last_undegraded":"2023-12-16T03:27:15.617241+0000","last_fullsized":"2023-12-16T03:27:15.617241+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:02.568705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.639849+0000","last_change":"2023-12-16T03:27:13.596763+0000","last_active":"2023-12-16T03:27:14.639849+0000","last_peered":"2023-12-16T03:27:14.639849+0000","last_clean":"2023-12-16T03:27:14.639849+0000","last_became_active":"2023-12-16T03:27:13.596458+0000","last_became_peered":"2023-12-16T03:27:13.596458+0000","last_unstale":"2023-12-16T03:27:14.639849+0000","last_undegraded":"2023-12-16T03:27:14.639849+0000","last_fullsized":"2023-12-16T03:27:14.639849+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:46.648303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603706+0000","last_change":"2023-12-16T03:27:01.519301+0000","last_active":"2023-12-16T03:27:14.603706+0000","last_peered":"2023-12-16T03:27:14.603706+0000","last_clean":"2023-12-16T03:27:14.603706+0000","last_became_active":"2023-12-16T03:27:01.519011+0000","last_became_peered":"2023-12-16T03:27:01.519011+0000","last_unstale":"2023-12-16T03:27:14.603706+0000","last_undegraded":"2023-12-16T03:27:14.603706+0000","last_fullsized":"2023-12-16T03:27:14.603706+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:34.578819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603739+0000","last_change":"2023-12-16T03:27:00.515238+0000","last_active":"2023-12-16T03:27:14.603739+0000","last_peered":"2023-12-16T03:27:14.603739+0000","last_clean":"2023-12-16T03:27:14.603739+0000","last_became_active":"2023-12-16T03:27:00.514968+0000","last_became_peered":"2023-12-16T03:27:00.514968+0000","last_unstale":"2023-12-16T03:27:14.603739+0000","last_undegraded":"2023-12-16T03:27:14.603739+0000","last_fullsized":"2023-12-16T03:27:14.603739+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619231+0000","last_change":"2023-12-16T03:27:14.628020+0000","last_active":"2023-12-16T03:27:15.619231+0000","last_peered":"2023-12-16T03:27:15.619231+0000","last_clean":"2023-12-16T03:27:15.619231+0000","last_became_active":"2023-12-16T03:27:14.627709+0000","last_became_peered":"2023-12-16T03:27:14.627709+0000","last_unstale":"2023-12-16T03:27:15.619231+0000","last_undegraded":"2023-12-16T03:27:15.619231+0000","last_fullsized":"2023-12-16T03:27:15.619231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:18.325494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.633700+0000","last_change":"2023-12-16T03:27:13.602746+0000","last_active":"2023-12-16T03:27:14.633700+0000","last_peered":"2023-12-16T03:27:14.633700+0000","last_clean":"2023-12-16T03:27:14.633700+0000","last_became_active":"2023-12-16T03:27:13.602161+0000","last_became_peered":"2023-12-16T03:27:13.602161+0000","last_unstale":"2023-12-16T03:27:14.633700+0000","last_undegraded":"2023-12-16T03:27:14.633700+0000","last_fullsized":"2023-12-16T03:27:14.633700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:42.020672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.593946+0000","last_change":"2023-12-16T03:27:01.522872+0000","last_active":"2023-12-16T03:27:14.593946+0000","last_peered":"2023-12-16T03:27:14.593946+0000","last_clean":"2023-12-16T03:27:14.593946+0000","last_became_active":"2023-12-16T03:27:01.522260+0000","last_became_peered":"2023-12-16T03:27:01.522260+0000","last_unstale":"2023-12-16T03:27:14.593946+0000","last_undegraded":"2023-12-16T03:27:14.593946+0000","last_fullsized":"2023-12-16T03:27:14.593946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:50.778695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609606+0000","last_change":"2023-12-16T03:27:00.521097+0000","last_active":"2023-12-16T03:27:14.609606+0000","last_peered":"2023-12-16T03:27:14.609606+0000","last_clean":"2023-12-16T03:27:14.609606+0000","last_became_active":"2023-12-16T03:27:00.520800+0000","last_became_peered":"2023-12-16T03:27:00.520800+0000","last_unstale":"2023-12-16T03:27:14.609606+0000","last_undegraded":"2023-12-16T03:27:14.609606+0000","last_fullsized":"2023-12-16T03:27:14.609606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:38:52.347850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619382+0000","last_change":"2023-12-16T03:27:14.637583+0000","last_active":"2023-12-16T03:27:15.619382+0000","last_peered":"2023-12-16T03:27:15.619382+0000","last_clean":"2023-12-16T03:27:15.619382+0000","last_became_active":"2023-12-16T03:27:14.637059+0000","last_became_peered":"2023-12-16T03:27:14.637059+0000","last_unstale":"2023-12-16T03:27:15.619382+0000","last_undegraded":"2023-12-16T03:27:15.619382+0000","last_fullsized":"2023-12-16T03:27:15.619382+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:08:25.904235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.632060+0000","last_change":"2023-12-16T03:27:13.599946+0000","last_active":"2023-12-16T03:27:14.632060+0000","last_peered":"2023-12-16T03:27:14.632060+0000","last_clean":"2023-12-16T03:27:14.632060+0000","last_became_active":"2023-12-16T03:27:13.599547+0000","last_became_peered":"2023-12-16T03:27:13.599547+0000","last_unstale":"2023-12-16T03:27:14.632060+0000","last_undegraded":"2023-12-16T03:27:14.632060+0000","last_fullsized":"2023-12-16T03:27:14.632060+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:58.856116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.604369+0000","last_change":"2023-12-16T03:27:01.528475+0000","last_active":"2023-12-16T03:27:14.604369+0000","last_peered":"2023-12-16T03:27:14.604369+0000","last_clean":"2023-12-16T03:27:14.604369+0000","last_became_active":"2023-12-16T03:27:01.527985+0000","last_became_peered":"2023-12-16T03:27:01.527985+0000","last_unstale":"2023-12-16T03:27:14.604369+0000","last_undegraded":"2023-12-16T03:27:14.604369+0000","last_fullsized":"2023-12-16T03:27:14.604369+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:33.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607112+0000","last_change":"2023-12-16T03:27:00.516992+0000","last_active":"2023-12-16T03:27:14.607112+0000","last_peered":"2023-12-16T03:27:14.607112+0000","last_clean":"2023-12-16T03:27:14.607112+0000","last_became_active":"2023-12-16T03:27:00.515339+0000","last_became_peered":"2023-12-16T03:27:00.515339+0000","last_unstale":"2023-12-16T03:27:14.607112+0000","last_undegraded":"2023-12-16T03:27:14.607112+0000","last_fullsized":"2023-12-16T03:27:14.607112+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:17:58.358317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343683+0000","last_change":"2023-12-16T03:27:14.620464+0000","last_active":"2023-12-16T03:27:16.343683+0000","last_peered":"2023-12-16T03:27:16.343683+0000","last_clean":"2023-12-16T03:27:16.343683+0000","last_became_active":"2023-12-16T03:27:14.620144+0000","last_became_peered":"2023-12-16T03:27:14.620144+0000","last_unstale":"2023-12-16T03:27:16.343683+0000","last_undegraded":"2023-12-16T03:27:16.343683+0000","last_fullsized":"2023-12-16T03:27:16.343683+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:42:08.424856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.623186+0000","last_change":"2023-12-16T03:27:13.595171+0000","last_active":"2023-12-16T03:27:14.623186+0000","last_peered":"2023-12-16T03:27:14.623186+0000","last_clean":"2023-12-16T03:27:14.623186+0000","last_became_active":"2023-12-16T03:27:13.594431+0000","last_became_peered":"2023-12-16T03:27:13.594431+0000","last_unstale":"2023-12-16T03:27:14.623186+0000","last_undegraded":"2023-12-16T03:27:14.623186+0000","last_fullsized":"2023-12-16T03:27:14.623186+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:22:23.843551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606940+0000","last_change":"2023-12-16T03:27:01.522006+0000","last_active":"2023-12-16T03:27:14.606940+0000","last_peered":"2023-12-16T03:27:14.606940+0000","last_clean":"2023-12-16T03:27:14.606940+0000","last_became_active":"2023-12-16T03:27:01.520949+0000","last_became_peered":"2023-12-16T03:27:01.520949+0000","last_unstale":"2023-12-16T03:27:14.606940+0000","last_undegraded":"2023-12-16T03:27:14.606940+0000","last_fullsized":"2023-12-16T03:27:14.606940+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:29.951188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595252+0000","last_change":"2023-12-16T03:27:00.515665+0000","last_active":"2023-12-16T03:27:14.595252+0000","last_peered":"2023-12-16T03:27:14.595252+0000","last_clean":"2023-12-16T03:27:14.595252+0000","last_became_active":"2023-12-16T03:27:00.514766+0000","last_became_peered":"2023-12-16T03:27:00.514766+0000","last_unstale":"2023-12-16T03:27:14.595252+0000","last_undegraded":"2023-12-16T03:27:14.595252+0000","last_fullsized":"2023-12-16T03:27:14.595252+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:41:54.339391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342227+0000","last_change":"2023-12-16T03:27:14.610886+0000","last_active":"2023-12-16T03:27:16.342227+0000","last_peered":"2023-12-16T03:27:16.342227+0000","last_clean":"2023-12-16T03:27:16.342227+0000","last_became_active":"2023-12-16T03:27:14.610583+0000","last_became_peered":"2023-12-16T03:27:14.610583+0000","last_unstale":"2023-12-16T03:27:16.342227+0000","last_undegraded":"2023-12-16T03:27:16.342227+0000","last_fullsized":"2023-12-16T03:27:16.342227+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:18.192952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.591797+0000","last_change":"2023-12-16T03:27:13.596040+0000","last_active":"2023-12-16T03:27:14.591797+0000","last_peered":"2023-12-16T03:27:14.591797+0000","last_clean":"2023-12-16T03:27:14.591797+0000","last_became_active":"2023-12-16T03:27:13.595774+0000","last_became_peered":"2023-12-16T03:27:13.595774+0000","last_unstale":"2023-12-16T03:27:14.591797+0000","last_undegraded":"2023-12-16T03:27:14.591797+0000","last_fullsized":"2023-12-16T03:27:14.591797+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:29:01.373370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607346+0000","last_change":"2023-12-16T03:27:01.523755+0000","last_active":"2023-12-16T03:27:14.607346+0000","last_peered":"2023-12-16T03:27:14.607346+0000","last_clean":"2023-12-16T03:27:14.607346+0000","last_became_active":"2023-12-16T03:27:01.523179+0000","last_became_peered":"2023-12-16T03:27:01.523179+0000","last_unstale":"2023-12-16T03:27:14.607346+0000","last_undegraded":"2023-12-16T03:27:14.607346+0000","last_fullsized":"2023-12-16T03:27:14.607346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:20:11.416554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.601294+0000","last_change":"2023-12-16T03:27:00.512400+0000","last_active":"2023-12-16T03:27:14.601294+0000","last_peered":"2023-12-16T03:27:14.601294+0000","last_clean":"2023-12-16T03:27:14.601294+0000","last_became_active":"2023-12-16T03:27:00.512120+0000","last_became_peered":"2023-12-16T03:27:00.512120+0000","last_unstale":"2023-12-16T03:27:14.601294+0000","last_undegraded":"2023-12-16T03:27:14.601294+0000","last_fullsized":"2023-12-16T03:27:14.601294+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:32:09.899662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342225+0000","last_change":"2023-12-16T03:27:14.617225+0000","last_active":"2023-12-16T03:27:16.342225+0000","last_peered":"2023-12-16T03:27:16.342225+0000","last_clean":"2023-12-16T03:27:16.342225+0000","last_became_active":"2023-12-16T03:27:14.616913+0000","last_became_peered":"2023-12-16T03:27:14.616913+0000","last_unstale":"2023-12-16T03:27:16.342225+0000","last_undegraded":"2023-12-16T03:27:16.342225+0000","last_fullsized":"2023-12-16T03:27:16.342225+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:59.863741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606078+0000","last_change":"2023-12-16T03:27:13.587351+0000","last_active":"2023-12-16T03:27:14.606078+0000","last_peered":"2023-12-16T03:27:14.606078+0000","last_clean":"2023-12-16T03:27:14.606078+0000","last_became_active":"2023-12-16T03:27:13.585827+0000","last_became_peered":"2023-12-16T03:27:13.585827+0000","last_unstale":"2023-12-16T03:27:14.606078+0000","last_undegraded":"2023-12-16T03:27:14.606078+0000","last_fullsized":"2023-12-16T03:27:14.606078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:34.233642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607862+0000","last_change":"2023-12-16T03:27:01.536014+0000","last_active":"2023-12-16T03:27:14.607862+0000","last_peered":"2023-12-16T03:27:14.607862+0000","last_clean":"2023-12-16T03:27:14.607862+0000","last_became_active":"2023-12-16T03:27:01.535729+0000","last_became_peered":"2023-12-16T03:27:01.535729+0000","last_unstale":"2023-12-16T03:27:14.607862+0000","last_undegraded":"2023-12-16T03:27:14.607862+0000","last_fullsized":"2023-12-16T03:27:14.607862+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:22:11.774067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603142+0000","last_change":"2023-12-16T03:27:00.513060+0000","last_active":"2023-12-16T03:27:14.603142+0000","last_peered":"2023-12-16T03:27:14.603142+0000","last_clean":"2023-12-16T03:27:14.603142+0000","last_became_active":"2023-12-16T03:27:00.512780+0000","last_became_peered":"2023-12-16T03:27:00.512780+0000","last_unstale":"2023-12-16T03:27:14.603142+0000","last_undegraded":"2023-12-16T03:27:14.603142+0000","last_fullsized":"2023-12-16T03:27:14.603142+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:03.555430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.754758+0000","last_change":"2023-12-16T03:27:14.610295+0000","last_active":"2023-12-16T03:27:15.754758+0000","last_peered":"2023-12-16T03:27:15.754758+0000","last_clean":"2023-12-16T03:27:15.754758+0000","last_became_active":"2023-12-16T03:27:14.610001+0000","last_became_peered":"2023-12-16T03:27:14.610001+0000","last_unstale":"2023-12-16T03:27:15.754758+0000","last_undegraded":"2023-12-16T03:27:15.754758+0000","last_fullsized":"2023-12-16T03:27:15.754758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:03:08.462703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.634460+0000","last_change":"2023-12-16T03:27:13.597592+0000","last_active":"2023-12-16T03:27:14.634460+0000","last_peered":"2023-12-16T03:27:14.634460+0000","last_clean":"2023-12-16T03:27:14.634460+0000","last_became_active":"2023-12-16T03:27:13.596242+0000","last_became_peered":"2023-12-16T03:27:13.596242+0000","last_unstale":"2023-12-16T03:27:14.634460+0000","last_undegraded":"2023-12-16T03:27:14.634460+0000","last_fullsized":"2023-12-16T03:27:14.634460+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:39.607214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606233+0000","last_change":"2023-12-16T03:27:01.520984+0000","last_active":"2023-12-16T03:27:14.606233+0000","last_peered":"2023-12-16T03:27:14.606233+0000","last_clean":"2023-12-16T03:27:14.606233+0000","last_became_active":"2023-12-16T03:27:01.520045+0000","last_became_peered":"2023-12-16T03:27:01.520045+0000","last_unstale":"2023-12-16T03:27:14.606233+0000","last_undegraded":"2023-12-16T03:27:14.606233+0000","last_fullsized":"2023-12-16T03:27:14.606233+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:37.842605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.596316+0000","last_change":"2023-12-16T03:27:00.513568+0000","last_active":"2023-12-16T03:27:14.596316+0000","last_peered":"2023-12-16T03:27:14.596316+0000","last_clean":"2023-12-16T03:27:14.596316+0000","last_became_active":"2023-12-16T03:27:00.513294+0000","last_became_peered":"2023-12-16T03:27:00.513294+0000","last_unstale":"2023-12-16T03:27:14.596316+0000","last_undegraded":"2023-12-16T03:27:14.596316+0000","last_fullsized":"2023-12-16T03:27:14.596316+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342388+0000","last_change":"2023-12-16T03:27:14.628979+0000","last_active":"2023-12-16T03:27:16.342388+0000","last_peered":"2023-12-16T03:27:16.342388+0000","last_clean":"2023-12-16T03:27:16.342388+0000","last_became_active":"2023-12-16T03:27:14.618939+0000","last_became_peered":"2023-12-16T03:27:14.618939+0000","last_unstale":"2023-12-16T03:27:16.342388+0000","last_undegraded":"2023-12-16T03:27:16.342388+0000","last_fullsized":"2023-12-16T03:27:16.342388+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:39:06.433314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.623497+0000","last_change":"2023-12-16T03:27:13.599384+0000","last_active":"2023-12-16T03:27:14.623497+0000","last_peered":"2023-12-16T03:27:14.623497+0000","last_clean":"2023-12-16T03:27:14.623497+0000","last_became_active":"2023-12-16T03:27:13.599050+0000","last_became_peered":"2023-12-16T03:27:13.599050+0000","last_unstale":"2023-12-16T03:27:14.623497+0000","last_undegraded":"2023-12-16T03:27:14.623497+0000","last_fullsized":"2023-12-16T03:27:14.623497+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:22.051248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602990+0000","last_change":"2023-12-16T03:27:01.526843+0000","last_active":"2023-12-16T03:27:14.602990+0000","last_peered":"2023-12-16T03:27:14.602990+0000","last_clean":"2023-12-16T03:27:14.602990+0000","last_became_active":"2023-12-16T03:27:01.525795+0000","last_became_peered":"2023-12-16T03:27:01.525795+0000","last_unstale":"2023-12-16T03:27:14.602990+0000","last_undegraded":"2023-12-16T03:27:14.602990+0000","last_fullsized":"2023-12-16T03:27:14.602990+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:39:53.633088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.597359+0000","last_change":"2023-12-16T03:27:00.520498+0000","last_active":"2023-12-16T03:27:14.597359+0000","last_peered":"2023-12-16T03:27:14.597359+0000","last_clean":"2023-12-16T03:27:14.597359+0000","last_became_active":"2023-12-16T03:27:00.520179+0000","last_became_peered":"2023-12-16T03:27:00.520179+0000","last_unstale":"2023-12-16T03:27:14.597359+0000","last_undegraded":"2023-12-16T03:27:14.597359+0000","last_fullsized":"2023-12-16T03:27:14.597359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:36.834249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617539+0000","last_change":"2023-12-16T03:27:14.617976+0000","last_active":"2023-12-16T03:27:15.617539+0000","last_peered":"2023-12-16T03:27:15.617539+0000","last_clean":"2023-12-16T03:27:15.617539+0000","last_became_active":"2023-12-16T03:27:14.617637+0000","last_became_peered":"2023-12-16T03:27:14.617637+0000","last_unstale":"2023-12-16T03:27:15.617539+0000","last_undegraded":"2023-12-16T03:27:15.617539+0000","last_fullsized":"2023-12-16T03:27:15.617539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:08:04.940525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"53'3","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.631122+0000","last_change":"2023-12-16T03:27:13.597036+0000","last_active":"2023-12-16T03:27:14.631122+0000","last_peered":"2023-12-16T03:27:14.631122+0000","last_clean":"2023-12-16T03:27:14.631122+0000","last_became_active":"2023-12-16T03:27:13.596700+0000","last_became_peered":"2023-12-16T03:27:13.596700+0000","last_unstale":"2023-12-16T03:27:14.631122+0000","last_undegraded":"2023-12-16T03:27:14.631122+0000","last_fullsized":"2023-12-16T03:27:14.631122+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:25:22.549914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603619+0000","last_change":"2023-12-16T03:27:01.525335+0000","last_active":"2023-12-16T03:27:14.603619+0000","last_peered":"2023-12-16T03:27:14.603619+0000","last_clean":"2023-12-16T03:27:14.603619+0000","last_became_active":"2023-12-16T03:27:01.524994+0000","last_became_peered":"2023-12-16T03:27:01.524994+0000","last_unstale":"2023-12-16T03:27:14.603619+0000","last_undegraded":"2023-12-16T03:27:14.603619+0000","last_fullsized":"2023-12-16T03:27:14.603619+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:08.574639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.622227+0000","last_change":"2023-12-16T03:27:00.516706+0000","last_active":"2023-12-16T03:27:14.622227+0000","last_peered":"2023-12-16T03:27:14.622227+0000","last_clean":"2023-12-16T03:27:14.622227+0000","last_became_active":"2023-12-16T03:27:00.516403+0000","last_became_peered":"2023-12-16T03:27:00.516403+0000","last_unstale":"2023-12-16T03:27:14.622227+0000","last_undegraded":"2023-12-16T03:27:14.622227+0000","last_fullsized":"2023-12-16T03:27:14.622227+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:27.966699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342857+0000","last_change":"2023-12-16T03:27:14.608469+0000","last_active":"2023-12-16T03:27:16.342857+0000","last_peered":"2023-12-16T03:27:16.342857+0000","last_clean":"2023-12-16T03:27:16.342857+0000","last_became_active":"2023-12-16T03:27:14.608184+0000","last_became_peered":"2023-12-16T03:27:14.608184+0000","last_unstale":"2023-12-16T03:27:16.342857+0000","last_undegraded":"2023-12-16T03:27:16.342857+0000","last_fullsized":"2023-12-16T03:27:16.342857+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:32:23.985127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'6","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.638161+0000","last_change":"2023-12-16T03:27:13.585474+0000","last_active":"2023-12-16T03:27:14.638161+0000","last_peered":"2023-12-16T03:27:14.638161+0000","last_clean":"2023-12-16T03:27:14.638161+0000","last_became_active":"2023-12-16T03:27:13.585153+0000","last_became_peered":"2023-12-16T03:27:13.585153+0000","last_unstale":"2023-12-16T03:27:14.638161+0000","last_undegraded":"2023-12-16T03:27:14.638161+0000","last_fullsized":"2023-12-16T03:27:14.638161+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:23.772960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.622144+0000","last_change":"2023-12-16T03:27:01.526628+0000","last_active":"2023-12-16T03:27:14.622144+0000","last_peered":"2023-12-16T03:27:14.622144+0000","last_clean":"2023-12-16T03:27:14.622144+0000","last_became_active":"2023-12-16T03:27:01.526319+0000","last_became_peered":"2023-12-16T03:27:01.526319+0000","last_unstale":"2023-12-16T03:27:14.622144+0000","last_undegraded":"2023-12-16T03:27:14.622144+0000","last_fullsized":"2023-12-16T03:27:14.622144+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:32.633580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609704+0000","last_change":"2023-12-16T03:27:00.524203+0000","last_active":"2023-12-16T03:27:14.609704+0000","last_peered":"2023-12-16T03:27:14.609704+0000","last_clean":"2023-12-16T03:27:14.609704+0000","last_became_active":"2023-12-16T03:27:00.523807+0000","last_became_peered":"2023-12-16T03:27:00.523807+0000","last_unstale":"2023-12-16T03:27:14.609704+0000","last_undegraded":"2023-12-16T03:27:14.609704+0000","last_fullsized":"2023-12-16T03:27:14.609704+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:07:50.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.755420+0000","last_change":"2023-12-16T03:27:14.627844+0000","last_active":"2023-12-16T03:27:15.755420+0000","last_peered":"2023-12-16T03:27:15.755420+0000","last_clean":"2023-12-16T03:27:15.755420+0000","last_became_active":"2023-12-16T03:27:14.627585+0000","last_became_peered":"2023-12-16T03:27:14.627585+0000","last_unstale":"2023-12-16T03:27:15.755420+0000","last_undegraded":"2023-12-16T03:27:15.755420+0000","last_fullsized":"2023-12-16T03:27:15.755420+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:38:03.398274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602132+0000","last_change":"2023-12-16T03:27:13.597628+0000","last_active":"2023-12-16T03:27:14.602132+0000","last_peered":"2023-12-16T03:27:14.602132+0000","last_clean":"2023-12-16T03:27:14.602132+0000","last_became_active":"2023-12-16T03:27:13.597342+0000","last_became_peered":"2023-12-16T03:27:13.597342+0000","last_unstale":"2023-12-16T03:27:14.602132+0000","last_undegraded":"2023-12-16T03:27:14.602132+0000","last_fullsized":"2023-12-16T03:27:14.602132+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:44.703065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.594198+0000","last_change":"2023-12-16T03:27:01.533076+0000","last_active":"2023-12-16T03:27:14.594198+0000","last_peered":"2023-12-16T03:27:14.594198+0000","last_clean":"2023-12-16T03:27:14.594198+0000","last_became_active":"2023-12-16T03:27:01.532721+0000","last_became_peered":"2023-12-16T03:27:01.532721+0000","last_unstale":"2023-12-16T03:27:14.594198+0000","last_undegraded":"2023-12-16T03:27:14.594198+0000","last_fullsized":"2023-12-16T03:27:14.594198+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:15:37.842605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.620451+0000","last_change":"2023-12-16T03:27:00.521385+0000","last_active":"2023-12-16T03:27:14.620451+0000","last_peered":"2023-12-16T03:27:14.620451+0000","last_clean":"2023-12-16T03:27:14.620451+0000","last_became_active":"2023-12-16T03:27:00.521116+0000","last_became_peered":"2023-12-16T03:27:00.521116+0000","last_unstale":"2023-12-16T03:27:14.620451+0000","last_undegraded":"2023-12-16T03:27:14.620451+0000","last_fullsized":"2023-12-16T03:27:14.620451+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:21:53.163060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619569+0000","last_change":"2023-12-16T03:27:14.637360+0000","last_active":"2023-12-16T03:27:15.619569+0000","last_peered":"2023-12-16T03:27:15.619569+0000","last_clean":"2023-12-16T03:27:15.619569+0000","last_became_active":"2023-12-16T03:27:14.637061+0000","last_became_peered":"2023-12-16T03:27:14.637061+0000","last_unstale":"2023-12-16T03:27:15.619569+0000","last_undegraded":"2023-12-16T03:27:15.619569+0000","last_fullsized":"2023-12-16T03:27:15.619569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:21:05.227197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.613873+0000","last_change":"2023-12-16T03:27:13.596081+0000","last_active":"2023-12-16T03:27:14.613873+0000","last_peered":"2023-12-16T03:27:14.613873+0000","last_clean":"2023-12-16T03:27:14.613873+0000","last_became_active":"2023-12-16T03:27:13.595006+0000","last_became_peered":"2023-12-16T03:27:13.595006+0000","last_unstale":"2023-12-16T03:27:14.613873+0000","last_undegraded":"2023-12-16T03:27:14.613873+0000","last_fullsized":"2023-12-16T03:27:14.613873+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:44.703065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.620179+0000","last_change":"2023-12-16T03:27:01.522382+0000","last_active":"2023-12-16T03:27:14.620179+0000","last_peered":"2023-12-16T03:27:14.620179+0000","last_clean":"2023-12-16T03:27:14.620179+0000","last_became_active":"2023-12-16T03:27:01.522101+0000","last_became_peered":"2023-12-16T03:27:01.522101+0000","last_unstale":"2023-12-16T03:27:14.620179+0000","last_undegraded":"2023-12-16T03:27:14.620179+0000","last_fullsized":"2023-12-16T03:27:14.620179+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:29.951188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602145+0000","last_change":"2023-12-16T03:27:00.514824+0000","last_active":"2023-12-16T03:27:14.602145+0000","last_peered":"2023-12-16T03:27:14.602145+0000","last_clean":"2023-12-16T03:27:14.602145+0000","last_became_active":"2023-12-16T03:27:00.514574+0000","last_became_peered":"2023-12-16T03:27:00.514574+0000","last_unstale":"2023-12-16T03:27:14.602145+0000","last_undegraded":"2023-12-16T03:27:14.602145+0000","last_fullsized":"2023-12-16T03:27:14.602145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:49.770339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342276+0000","last_change":"2023-12-16T03:27:14.622718+0000","last_active":"2023-12-16T03:27:16.342276+0000","last_peered":"2023-12-16T03:27:16.342276+0000","last_clean":"2023-12-16T03:27:16.342276+0000","last_became_active":"2023-12-16T03:27:14.622364+0000","last_became_peered":"2023-12-16T03:27:14.622364+0000","last_unstale":"2023-12-16T03:27:16.342276+0000","last_undegraded":"2023-12-16T03:27:16.342276+0000","last_fullsized":"2023-12-16T03:27:16.342276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:37:24.906594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.596132+0000","last_change":"2023-12-16T03:27:13.587607+0000","last_active":"2023-12-16T03:27:14.596132+0000","last_peered":"2023-12-16T03:27:14.596132+0000","last_clean":"2023-12-16T03:27:14.596132+0000","last_became_active":"2023-12-16T03:27:13.586738+0000","last_became_peered":"2023-12-16T03:27:13.586738+0000","last_unstale":"2023-12-16T03:27:14.596132+0000","last_undegraded":"2023-12-16T03:27:14.596132+0000","last_fullsized":"2023-12-16T03:27:14.596132+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:59:49.103291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.596175+0000","last_change":"2023-12-16T03:27:01.523308+0000","last_active":"2023-12-16T03:27:14.596175+0000","last_peered":"2023-12-16T03:27:14.596175+0000","last_clean":"2023-12-16T03:27:14.596175+0000","last_became_active":"2023-12-16T03:27:01.522582+0000","last_became_peered":"2023-12-16T03:27:01.522582+0000","last_unstale":"2023-12-16T03:27:14.596175+0000","last_undegraded":"2023-12-16T03:27:14.596175+0000","last_fullsized":"2023-12-16T03:27:14.596175+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:44.457252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.608050+0000","last_change":"2023-12-16T03:27:00.524023+0000","last_active":"2023-12-16T03:27:14.608050+0000","last_peered":"2023-12-16T03:27:14.608050+0000","last_clean":"2023-12-16T03:27:14.608050+0000","last_became_active":"2023-12-16T03:27:00.523742+0000","last_became_peered":"2023-12-16T03:27:00.523742+0000","last_unstale":"2023-12-16T03:27:14.608050+0000","last_undegraded":"2023-12-16T03:27:14.608050+0000","last_fullsized":"2023-12-16T03:27:14.608050+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:09:52.558814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342339+0000","last_change":"2023-12-16T03:27:14.613690+0000","last_active":"2023-12-16T03:27:16.342339+0000","last_peered":"2023-12-16T03:27:16.342339+0000","last_clean":"2023-12-16T03:27:16.342339+0000","last_became_active":"2023-12-16T03:27:14.611536+0000","last_became_peered":"2023-12-16T03:27:14.611536+0000","last_unstale":"2023-12-16T03:27:16.342339+0000","last_undegraded":"2023-12-16T03:27:16.342339+0000","last_fullsized":"2023-12-16T03:27:16.342339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:49:12.367891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.641458+0000","last_change":"2023-12-16T03:27:13.595463+0000","last_active":"2023-12-16T03:27:14.641458+0000","last_peered":"2023-12-16T03:27:14.641458+0000","last_clean":"2023-12-16T03:27:14.641458+0000","last_became_active":"2023-12-16T03:27:13.595107+0000","last_became_peered":"2023-12-16T03:27:13.595107+0000","last_unstale":"2023-12-16T03:27:14.641458+0000","last_undegraded":"2023-12-16T03:27:14.641458+0000","last_fullsized":"2023-12-16T03:27:14.641458+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:53.791096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.615403+0000","last_change":"2023-12-16T03:27:01.519766+0000","last_active":"2023-12-16T03:27:14.615403+0000","last_peered":"2023-12-16T03:27:14.615403+0000","last_clean":"2023-12-16T03:27:14.615403+0000","last_became_active":"2023-12-16T03:27:01.519473+0000","last_became_peered":"2023-12-16T03:27:01.519473+0000","last_unstale":"2023-12-16T03:27:14.615403+0000","last_undegraded":"2023-12-16T03:27:14.615403+0000","last_fullsized":"2023-12-16T03:27:14.615403+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607581+0000","last_change":"2023-12-16T03:27:00.518062+0000","last_active":"2023-12-16T03:27:14.607581+0000","last_peered":"2023-12-16T03:27:14.607581+0000","last_clean":"2023-12-16T03:27:14.607581+0000","last_became_active":"2023-12-16T03:27:00.517664+0000","last_became_peered":"2023-12-16T03:27:00.517664+0000","last_unstale":"2023-12-16T03:27:14.607581+0000","last_undegraded":"2023-12-16T03:27:14.607581+0000","last_fullsized":"2023-12-16T03:27:14.607581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:47:04.667881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.618705+0000","last_change":"2023-12-16T03:27:14.620636+0000","last_active":"2023-12-16T03:27:15.618705+0000","last_peered":"2023-12-16T03:27:15.618705+0000","last_clean":"2023-12-16T03:27:15.618705+0000","last_became_active":"2023-12-16T03:27:14.620357+0000","last_became_peered":"2023-12-16T03:27:14.620357+0000","last_unstale":"2023-12-16T03:27:15.618705+0000","last_undegraded":"2023-12-16T03:27:15.618705+0000","last_fullsized":"2023-12-16T03:27:15.618705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:08.831942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.632175+0000","last_change":"2023-12-16T03:27:13.594025+0000","last_active":"2023-12-16T03:27:14.632175+0000","last_peered":"2023-12-16T03:27:14.632175+0000","last_clean":"2023-12-16T03:27:14.632175+0000","last_became_active":"2023-12-16T03:27:13.593861+0000","last_became_peered":"2023-12-16T03:27:13.593861+0000","last_unstale":"2023-12-16T03:27:14.632175+0000","last_undegraded":"2023-12-16T03:27:14.632175+0000","last_fullsized":"2023-12-16T03:27:14.632175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:30.733614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.597270+0000","last_change":"2023-12-16T03:27:01.514600+0000","last_active":"2023-12-16T03:27:14.597270+0000","last_peered":"2023-12-16T03:27:14.597270+0000","last_clean":"2023-12-16T03:27:14.597270+0000","last_became_active":"2023-12-16T03:27:01.514262+0000","last_became_peered":"2023-12-16T03:27:01.514262+0000","last_unstale":"2023-12-16T03:27:14.597270+0000","last_undegraded":"2023-12-16T03:27:14.597270+0000","last_fullsized":"2023-12-16T03:27:14.597270+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:28.975055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.596404+0000","last_change":"2023-12-16T03:27:00.514189+0000","last_active":"2023-12-16T03:27:14.596404+0000","last_peered":"2023-12-16T03:27:14.596404+0000","last_clean":"2023-12-16T03:27:14.596404+0000","last_became_active":"2023-12-16T03:27:00.513862+0000","last_became_peered":"2023-12-16T03:27:00.513862+0000","last_unstale":"2023-12-16T03:27:14.596404+0000","last_undegraded":"2023-12-16T03:27:14.596404+0000","last_fullsized":"2023-12-16T03:27:14.596404+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:17.655773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.755065+0000","last_change":"2023-12-16T03:27:14.614551+0000","last_active":"2023-12-16T03:27:15.755065+0000","last_peered":"2023-12-16T03:27:15.755065+0000","last_clean":"2023-12-16T03:27:15.755065+0000","last_became_active":"2023-12-16T03:27:14.614191+0000","last_became_peered":"2023-12-16T03:27:14.614191+0000","last_unstale":"2023-12-16T03:27:15.755065+0000","last_undegraded":"2023-12-16T03:27:15.755065+0000","last_fullsized":"2023-12-16T03:27:15.755065+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:07:59.863741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607201+0000","last_change":"2023-12-16T03:27:13.594572+0000","last_active":"2023-12-16T03:27:14.607201+0000","last_peered":"2023-12-16T03:27:14.607201+0000","last_clean":"2023-12-16T03:27:14.607201+0000","last_became_active":"2023-12-16T03:27:13.594021+0000","last_became_peered":"2023-12-16T03:27:13.594021+0000","last_unstale":"2023-12-16T03:27:14.607201+0000","last_undegraded":"2023-12-16T03:27:14.607201+0000","last_fullsized":"2023-12-16T03:27:14.607201+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:00.375282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.613120+0000","last_change":"2023-12-16T03:27:01.540186+0000","last_active":"2023-12-16T03:27:14.613120+0000","last_peered":"2023-12-16T03:27:14.613120+0000","last_clean":"2023-12-16T03:27:14.613120+0000","last_became_active":"2023-12-16T03:27:01.539206+0000","last_became_peered":"2023-12-16T03:27:01.539206+0000","last_unstale":"2023-12-16T03:27:14.613120+0000","last_undegraded":"2023-12-16T03:27:14.613120+0000","last_fullsized":"2023-12-16T03:27:14.613120+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:57:04.022726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.613415+0000","last_change":"2023-12-16T03:27:00.515681+0000","last_active":"2023-12-16T03:27:14.613415+0000","last_peered":"2023-12-16T03:27:14.613415+0000","last_clean":"2023-12-16T03:27:14.613415+0000","last_became_active":"2023-12-16T03:27:00.515413+0000","last_became_peered":"2023-12-16T03:27:00.515413+0000","last_unstale":"2023-12-16T03:27:14.613415+0000","last_undegraded":"2023-12-16T03:27:14.613415+0000","last_fullsized":"2023-12-16T03:27:14.613415+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.615521+0000","last_change":"2023-12-16T03:27:14.615962+0000","last_active":"2023-12-16T03:27:15.615521+0000","last_peered":"2023-12-16T03:27:15.615521+0000","last_clean":"2023-12-16T03:27:15.615521+0000","last_became_active":"2023-12-16T03:27:14.615652+0000","last_became_peered":"2023-12-16T03:27:14.615652+0000","last_unstale":"2023-12-16T03:27:15.615521+0000","last_undegraded":"2023-12-16T03:27:15.615521+0000","last_fullsized":"2023-12-16T03:27:15.615521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:54:01.382906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.632624+0000","last_change":"2023-12-16T03:27:13.599023+0000","last_active":"2023-12-16T03:27:14.632624+0000","last_peered":"2023-12-16T03:27:14.632624+0000","last_clean":"2023-12-16T03:27:14.632624+0000","last_became_active":"2023-12-16T03:27:13.597426+0000","last_became_peered":"2023-12-16T03:27:13.597426+0000","last_unstale":"2023-12-16T03:27:14.632624+0000","last_undegraded":"2023-12-16T03:27:14.632624+0000","last_fullsized":"2023-12-16T03:27:14.632624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:45.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.624222+0000","last_change":"2023-12-16T03:27:01.518997+0000","last_active":"2023-12-16T03:27:14.624222+0000","last_peered":"2023-12-16T03:27:14.624222+0000","last_clean":"2023-12-16T03:27:14.624222+0000","last_became_active":"2023-12-16T03:27:01.518606+0000","last_became_peered":"2023-12-16T03:27:01.518606+0000","last_unstale":"2023-12-16T03:27:14.624222+0000","last_undegraded":"2023-12-16T03:27:14.624222+0000","last_fullsized":"2023-12-16T03:27:14.624222+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:34.578819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.611415+0000","last_change":"2023-12-16T03:27:00.522719+0000","last_active":"2023-12-16T03:27:14.611415+0000","last_peered":"2023-12-16T03:27:14.611415+0000","last_clean":"2023-12-16T03:27:14.611415+0000","last_became_active":"2023-12-16T03:27:00.522485+0000","last_became_peered":"2023-12-16T03:27:00.522485+0000","last_unstale":"2023-12-16T03:27:14.611415+0000","last_undegraded":"2023-12-16T03:27:14.611415+0000","last_fullsized":"2023-12-16T03:27:14.611415+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:48:48.483240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343008+0000","last_change":"2023-12-16T03:27:14.620924+0000","last_active":"2023-12-16T03:27:16.343008+0000","last_peered":"2023-12-16T03:27:16.343008+0000","last_clean":"2023-12-16T03:27:16.343008+0000","last_became_active":"2023-12-16T03:27:14.620582+0000","last_became_peered":"2023-12-16T03:27:14.620582+0000","last_unstale":"2023-12-16T03:27:16.343008+0000","last_undegraded":"2023-12-16T03:27:16.343008+0000","last_fullsized":"2023-12-16T03:27:16.343008+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:45:42.052164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.615665+0000","last_change":"2023-12-16T03:27:13.600817+0000","last_active":"2023-12-16T03:27:14.615665+0000","last_peered":"2023-12-16T03:27:14.615665+0000","last_clean":"2023-12-16T03:27:14.615665+0000","last_became_active":"2023-12-16T03:27:13.600549+0000","last_became_peered":"2023-12-16T03:27:13.600549+0000","last_unstale":"2023-12-16T03:27:14.615665+0000","last_undegraded":"2023-12-16T03:27:14.615665+0000","last_fullsized":"2023-12-16T03:27:14.615665+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:05.702573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595564+0000","last_change":"2023-12-16T03:27:01.525968+0000","last_active":"2023-12-16T03:27:14.595564+0000","last_peered":"2023-12-16T03:27:14.595564+0000","last_clean":"2023-12-16T03:27:14.595564+0000","last_became_active":"2023-12-16T03:27:01.523176+0000","last_became_peered":"2023-12-16T03:27:01.523176+0000","last_unstale":"2023-12-16T03:27:14.595564+0000","last_undegraded":"2023-12-16T03:27:14.595564+0000","last_fullsized":"2023-12-16T03:27:14.595564+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:53:48.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603796+0000","last_change":"2023-12-16T03:27:00.514506+0000","last_active":"2023-12-16T03:27:14.603796+0000","last_peered":"2023-12-16T03:27:14.603796+0000","last_clean":"2023-12-16T03:27:14.603796+0000","last_became_active":"2023-12-16T03:27:00.514121+0000","last_became_peered":"2023-12-16T03:27:00.514121+0000","last_unstale":"2023-12-16T03:27:14.603796+0000","last_undegraded":"2023-12-16T03:27:14.603796+0000","last_fullsized":"2023-12-16T03:27:14.603796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:47:33.862583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343048+0000","last_change":"2023-12-16T03:27:14.608394+0000","last_active":"2023-12-16T03:27:16.343048+0000","last_peered":"2023-12-16T03:27:16.343048+0000","last_clean":"2023-12-16T03:27:16.343048+0000","last_became_active":"2023-12-16T03:27:14.608003+0000","last_became_peered":"2023-12-16T03:27:14.608003+0000","last_unstale":"2023-12-16T03:27:16.343048+0000","last_undegraded":"2023-12-16T03:27:16.343048+0000","last_fullsized":"2023-12-16T03:27:16.343048+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:55.459953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.633006+0000","last_change":"2023-12-16T03:27:13.598500+0000","last_active":"2023-12-16T03:27:14.633006+0000","last_peered":"2023-12-16T03:27:14.633006+0000","last_clean":"2023-12-16T03:27:14.633006+0000","last_became_active":"2023-12-16T03:27:13.598210+0000","last_became_peered":"2023-12-16T03:27:13.598210+0000","last_unstale":"2023-12-16T03:27:14.633006+0000","last_undegraded":"2023-12-16T03:27:14.633006+0000","last_fullsized":"2023-12-16T03:27:14.633006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:59.405661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.610034+0000","last_change":"2023-12-16T03:27:01.517329+0000","last_active":"2023-12-16T03:27:14.610034+0000","last_peered":"2023-12-16T03:27:14.610034+0000","last_clean":"2023-12-16T03:27:14.610034+0000","last_became_active":"2023-12-16T03:27:01.517020+0000","last_became_peered":"2023-12-16T03:27:01.517020+0000","last_unstale":"2023-12-16T03:27:14.610034+0000","last_undegraded":"2023-12-16T03:27:14.610034+0000","last_fullsized":"2023-12-16T03:27:14.610034+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:37:11.829485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595464+0000","last_change":"2023-12-16T03:27:00.514408+0000","last_active":"2023-12-16T03:27:14.595464+0000","last_peered":"2023-12-16T03:27:14.595464+0000","last_clean":"2023-12-16T03:27:14.595464+0000","last_became_active":"2023-12-16T03:27:00.514141+0000","last_became_peered":"2023-12-16T03:27:00.514141+0000","last_unstale":"2023-12-16T03:27:14.595464+0000","last_undegraded":"2023-12-16T03:27:14.595464+0000","last_fullsized":"2023-12-16T03:27:14.595464+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:48:10.695120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619704+0000","last_change":"2023-12-16T03:27:14.632060+0000","last_active":"2023-12-16T03:27:15.619704+0000","last_peered":"2023-12-16T03:27:15.619704+0000","last_clean":"2023-12-16T03:27:15.619704+0000","last_became_active":"2023-12-16T03:27:14.631777+0000","last_became_peered":"2023-12-16T03:27:14.631777+0000","last_unstale":"2023-12-16T03:27:15.619704+0000","last_undegraded":"2023-12-16T03:27:15.619704+0000","last_fullsized":"2023-12-16T03:27:15.619704+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:25:58.049623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.636680+0000","last_change":"2023-12-16T03:27:13.599906+0000","last_active":"2023-12-16T03:27:14.636680+0000","last_peered":"2023-12-16T03:27:14.636680+0000","last_clean":"2023-12-16T03:27:14.636680+0000","last_became_active":"2023-12-16T03:27:13.598582+0000","last_became_peered":"2023-12-16T03:27:13.598582+0000","last_unstale":"2023-12-16T03:27:14.636680+0000","last_undegraded":"2023-12-16T03:27:14.636680+0000","last_fullsized":"2023-12-16T03:27:14.636680+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:20:41.938352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.620253+0000","last_change":"2023-12-16T03:27:01.522466+0000","last_active":"2023-12-16T03:27:14.620253+0000","last_peered":"2023-12-16T03:27:14.620253+0000","last_clean":"2023-12-16T03:27:14.620253+0000","last_became_active":"2023-12-16T03:27:01.522111+0000","last_became_peered":"2023-12-16T03:27:01.522111+0000","last_unstale":"2023-12-16T03:27:14.620253+0000","last_undegraded":"2023-12-16T03:27:14.620253+0000","last_fullsized":"2023-12-16T03:27:14.620253+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:33.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.604520+0000","last_change":"2023-12-16T03:27:00.520371+0000","last_active":"2023-12-16T03:27:14.604520+0000","last_peered":"2023-12-16T03:27:14.604520+0000","last_clean":"2023-12-16T03:27:14.604520+0000","last_became_active":"2023-12-16T03:27:00.520097+0000","last_became_peered":"2023-12-16T03:27:00.520097+0000","last_unstale":"2023-12-16T03:27:14.604520+0000","last_undegraded":"2023-12-16T03:27:14.604520+0000","last_fullsized":"2023-12-16T03:27:14.604520+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:32:48.297921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931109+0000","last_change":"2023-12-16T03:27:14.622815+0000","last_active":"2023-12-16T03:27:15.931109+0000","last_peered":"2023-12-16T03:27:15.931109+0000","last_clean":"2023-12-16T03:27:15.931109+0000","last_became_active":"2023-12-16T03:27:14.622545+0000","last_became_peered":"2023-12-16T03:27:14.622545+0000","last_unstale":"2023-12-16T03:27:15.931109+0000","last_undegraded":"2023-12-16T03:27:15.931109+0000","last_fullsized":"2023-12-16T03:27:15.931109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:53:10.203830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595917+0000","last_change":"2023-12-16T03:27:13.586270+0000","last_active":"2023-12-16T03:27:14.595917+0000","last_peered":"2023-12-16T03:27:14.595917+0000","last_clean":"2023-12-16T03:27:14.595917+0000","last_became_active":"2023-12-16T03:27:13.585981+0000","last_became_peered":"2023-12-16T03:27:13.585981+0000","last_unstale":"2023-12-16T03:27:14.595917+0000","last_undegraded":"2023-12-16T03:27:14.595917+0000","last_fullsized":"2023-12-16T03:27:14.595917+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:54.452329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.596266+0000","last_change":"2023-12-16T03:27:01.521651+0000","last_active":"2023-12-16T03:27:14.596266+0000","last_peered":"2023-12-16T03:27:14.596266+0000","last_clean":"2023-12-16T03:27:14.596266+0000","last_became_active":"2023-12-16T03:27:01.521167+0000","last_became_peered":"2023-12-16T03:27:01.521167+0000","last_unstale":"2023-12-16T03:27:14.596266+0000","last_undegraded":"2023-12-16T03:27:14.596266+0000","last_fullsized":"2023-12-16T03:27:14.596266+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:42:00.543610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.608154+0000","last_change":"2023-12-16T03:27:00.521885+0000","last_active":"2023-12-16T03:27:14.608154+0000","last_peered":"2023-12-16T03:27:14.608154+0000","last_clean":"2023-12-16T03:27:14.608154+0000","last_became_active":"2023-12-16T03:27:00.521503+0000","last_became_peered":"2023-12-16T03:27:00.521503+0000","last_unstale":"2023-12-16T03:27:14.608154+0000","last_undegraded":"2023-12-16T03:27:14.608154+0000","last_fullsized":"2023-12-16T03:27:14.608154+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:47.207385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931024+0000","last_change":"2023-12-16T03:27:14.616521+0000","last_active":"2023-12-16T03:27:15.931024+0000","last_peered":"2023-12-16T03:27:15.931024+0000","last_clean":"2023-12-16T03:27:15.931024+0000","last_became_active":"2023-12-16T03:27:14.616153+0000","last_became_peered":"2023-12-16T03:27:14.616153+0000","last_unstale":"2023-12-16T03:27:15.931024+0000","last_undegraded":"2023-12-16T03:27:15.931024+0000","last_fullsized":"2023-12-16T03:27:15.931024+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:08:16.636497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602628+0000","last_change":"2023-12-16T03:27:13.592700+0000","last_active":"2023-12-16T03:27:14.602628+0000","last_peered":"2023-12-16T03:27:14.602628+0000","last_clean":"2023-12-16T03:27:14.602628+0000","last_became_active":"2023-12-16T03:27:13.592434+0000","last_became_peered":"2023-12-16T03:27:13.592434+0000","last_unstale":"2023-12-16T03:27:14.602628+0000","last_undegraded":"2023-12-16T03:27:14.602628+0000","last_fullsized":"2023-12-16T03:27:14.602628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:59.977655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603391+0000","last_change":"2023-12-16T03:27:01.516489+0000","last_active":"2023-12-16T03:27:14.603391+0000","last_peered":"2023-12-16T03:27:14.603391+0000","last_clean":"2023-12-16T03:27:14.603391+0000","last_became_active":"2023-12-16T03:27:01.516199+0000","last_became_peered":"2023-12-16T03:27:01.516199+0000","last_unstale":"2023-12-16T03:27:14.603391+0000","last_undegraded":"2023-12-16T03:27:14.603391+0000","last_fullsized":"2023-12-16T03:27:14.603391+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:09.981763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.592258+0000","last_change":"2023-12-16T03:27:00.508945+0000","last_active":"2023-12-16T03:27:14.592258+0000","last_peered":"2023-12-16T03:27:14.592258+0000","last_clean":"2023-12-16T03:27:14.592258+0000","last_became_active":"2023-12-16T03:27:00.508638+0000","last_became_peered":"2023-12-16T03:27:00.508638+0000","last_unstale":"2023-12-16T03:27:14.592258+0000","last_undegraded":"2023-12-16T03:27:14.592258+0000","last_fullsized":"2023-12-16T03:27:14.592258+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931179+0000","last_change":"2023-12-16T03:27:14.606013+0000","last_active":"2023-12-16T03:27:15.931179+0000","last_peered":"2023-12-16T03:27:15.931179+0000","last_clean":"2023-12-16T03:27:15.931179+0000","last_became_active":"2023-12-16T03:27:14.605702+0000","last_became_peered":"2023-12-16T03:27:14.605702+0000","last_unstale":"2023-12-16T03:27:15.931179+0000","last_undegraded":"2023-12-16T03:27:15.931179+0000","last_fullsized":"2023-12-16T03:27:15.931179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:47:31.451715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607508+0000","last_change":"2023-12-16T03:27:13.593582+0000","last_active":"2023-12-16T03:27:14.607508+0000","last_peered":"2023-12-16T03:27:14.607508+0000","last_clean":"2023-12-16T03:27:14.607508+0000","last_became_active":"2023-12-16T03:27:13.593044+0000","last_became_peered":"2023-12-16T03:27:13.593044+0000","last_unstale":"2023-12-16T03:27:14.607508+0000","last_undegraded":"2023-12-16T03:27:14.607508+0000","last_fullsized":"2023-12-16T03:27:14.607508+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:24:58.979141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.602623+0000","last_change":"2023-12-16T03:27:01.518954+0000","last_active":"2023-12-16T03:27:14.602623+0000","last_peered":"2023-12-16T03:27:14.602623+0000","last_clean":"2023-12-16T03:27:14.602623+0000","last_became_active":"2023-12-16T03:27:01.518665+0000","last_became_peered":"2023-12-16T03:27:01.518665+0000","last_unstale":"2023-12-16T03:27:14.602623+0000","last_undegraded":"2023-12-16T03:27:14.602623+0000","last_fullsized":"2023-12-16T03:27:14.602623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:44:32.633580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.594115+0000","last_change":"2023-12-16T03:27:00.519726+0000","last_active":"2023-12-16T03:27:14.594115+0000","last_peered":"2023-12-16T03:27:14.594115+0000","last_clean":"2023-12-16T03:27:14.594115+0000","last_became_active":"2023-12-16T03:27:00.519420+0000","last_became_peered":"2023-12-16T03:27:00.519420+0000","last_unstale":"2023-12-16T03:27:14.594115+0000","last_undegraded":"2023-12-16T03:27:14.594115+0000","last_fullsized":"2023-12-16T03:27:14.594115+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:04:07.566283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619116+0000","last_change":"2023-12-16T03:27:14.635936+0000","last_active":"2023-12-16T03:27:15.619116+0000","last_peered":"2023-12-16T03:27:15.619116+0000","last_clean":"2023-12-16T03:27:15.619116+0000","last_became_active":"2023-12-16T03:27:14.635646+0000","last_became_peered":"2023-12-16T03:27:14.635646+0000","last_unstale":"2023-12-16T03:27:15.619116+0000","last_undegraded":"2023-12-16T03:27:15.619116+0000","last_fullsized":"2023-12-16T03:27:15.619116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:01.673594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.610906+0000","last_change":"2023-12-16T03:27:13.593745+0000","last_active":"2023-12-16T03:27:14.610906+0000","last_peered":"2023-12-16T03:27:14.610906+0000","last_clean":"2023-12-16T03:27:14.610906+0000","last_became_active":"2023-12-16T03:27:13.593452+0000","last_became_peered":"2023-12-16T03:27:13.593452+0000","last_unstale":"2023-12-16T03:27:14.610906+0000","last_undegraded":"2023-12-16T03:27:14.610906+0000","last_fullsized":"2023-12-16T03:27:14.610906+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:59.479049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.598408+0000","last_change":"2023-12-16T03:27:01.531143+0000","last_active":"2023-12-16T03:27:14.598408+0000","last_peered":"2023-12-16T03:27:14.598408+0000","last_clean":"2023-12-16T03:27:14.598408+0000","last_became_active":"2023-12-16T03:27:01.530842+0000","last_became_peered":"2023-12-16T03:27:01.530842+0000","last_unstale":"2023-12-16T03:27:14.598408+0000","last_undegraded":"2023-12-16T03:27:14.598408+0000","last_fullsized":"2023-12-16T03:27:14.598408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:41.721611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.594032+0000","last_change":"2023-12-16T03:27:00.524413+0000","last_active":"2023-12-16T03:27:14.594032+0000","last_peered":"2023-12-16T03:27:14.594032+0000","last_clean":"2023-12-16T03:27:14.594032+0000","last_became_active":"2023-12-16T03:27:00.524142+0000","last_became_peered":"2023-12-16T03:27:00.524142+0000","last_unstale":"2023-12-16T03:27:14.594032+0000","last_undegraded":"2023-12-16T03:27:14.594032+0000","last_fullsized":"2023-12-16T03:27:14.594032+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.619284+0000","last_change":"2023-12-16T03:27:14.634423+0000","last_active":"2023-12-16T03:27:15.619284+0000","last_peered":"2023-12-16T03:27:15.619284+0000","last_clean":"2023-12-16T03:27:15.619284+0000","last_became_active":"2023-12-16T03:27:14.634119+0000","last_became_peered":"2023-12-16T03:27:14.634119+0000","last_unstale":"2023-12-16T03:27:15.619284+0000","last_undegraded":"2023-12-16T03:27:15.619284+0000","last_fullsized":"2023-12-16T03:27:15.619284+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:48:31.136570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.604212+0000","last_change":"2023-12-16T03:27:13.590348+0000","last_active":"2023-12-16T03:27:14.604212+0000","last_peered":"2023-12-16T03:27:14.604212+0000","last_clean":"2023-12-16T03:27:14.604212+0000","last_became_active":"2023-12-16T03:27:13.590076+0000","last_became_peered":"2023-12-16T03:27:13.590076+0000","last_unstale":"2023-12-16T03:27:14.604212+0000","last_undegraded":"2023-12-16T03:27:14.604212+0000","last_fullsized":"2023-12-16T03:27:14.604212+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:03:07.455078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595649+0000","last_change":"2023-12-16T03:27:01.518068+0000","last_active":"2023-12-16T03:27:14.595649+0000","last_peered":"2023-12-16T03:27:14.595649+0000","last_clean":"2023-12-16T03:27:14.595649+0000","last_became_active":"2023-12-16T03:27:01.516800+0000","last_became_peered":"2023-12-16T03:27:01.516800+0000","last_unstale":"2023-12-16T03:27:14.595649+0000","last_undegraded":"2023-12-16T03:27:14.595649+0000","last_fullsized":"2023-12-16T03:27:14.595649+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:58:58.763512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603878+0000","last_change":"2023-12-16T03:27:00.515007+0000","last_active":"2023-12-16T03:27:14.603878+0000","last_peered":"2023-12-16T03:27:14.603878+0000","last_clean":"2023-12-16T03:27:14.603878+0000","last_became_active":"2023-12-16T03:27:00.514820+0000","last_became_peered":"2023-12-16T03:27:00.514820+0000","last_unstale":"2023-12-16T03:27:14.603878+0000","last_undegraded":"2023-12-16T03:27:14.603878+0000","last_fullsized":"2023-12-16T03:27:14.603878+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:03:53.754918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.343844+0000","last_change":"2023-12-16T03:27:14.616123+0000","last_active":"2023-12-16T03:27:16.343844+0000","last_peered":"2023-12-16T03:27:16.343844+0000","last_clean":"2023-12-16T03:27:16.343844+0000","last_became_active":"2023-12-16T03:27:14.615872+0000","last_became_peered":"2023-12-16T03:27:14.615872+0000","last_unstale":"2023-12-16T03:27:16.343844+0000","last_undegraded":"2023-12-16T03:27:16.343844+0000","last_fullsized":"2023-12-16T03:27:16.343844+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:19:08.831942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.632873+0000","last_change":"2023-12-16T03:27:13.598174+0000","last_active":"2023-12-16T03:27:14.632873+0000","last_peered":"2023-12-16T03:27:14.632873+0000","last_clean":"2023-12-16T03:27:14.632873+0000","last_became_active":"2023-12-16T03:27:13.597804+0000","last_became_peered":"2023-12-16T03:27:13.597804+0000","last_unstale":"2023-12-16T03:27:14.632873+0000","last_undegraded":"2023-12-16T03:27:14.632873+0000","last_fullsized":"2023-12-16T03:27:14.632873+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:59:46.648303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.594283+0000","last_change":"2023-12-16T03:27:01.522052+0000","last_active":"2023-12-16T03:27:14.594283+0000","last_peered":"2023-12-16T03:27:14.594283+0000","last_clean":"2023-12-16T03:27:14.594283+0000","last_became_active":"2023-12-16T03:27:01.521669+0000","last_became_peered":"2023-12-16T03:27:01.521669+0000","last_unstale":"2023-12-16T03:27:14.594283+0000","last_undegraded":"2023-12-16T03:27:14.594283+0000","last_fullsized":"2023-12-16T03:27:14.594283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:05.115844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.614407+0000","last_change":"2023-12-16T03:27:00.516627+0000","last_active":"2023-12-16T03:27:14.614407+0000","last_peered":"2023-12-16T03:27:14.614407+0000","last_clean":"2023-12-16T03:27:14.614407+0000","last_became_active":"2023-12-16T03:27:00.516381+0000","last_became_peered":"2023-12-16T03:27:00.516381+0000","last_unstale":"2023-12-16T03:27:14.614407+0000","last_undegraded":"2023-12-16T03:27:14.614407+0000","last_fullsized":"2023-12-16T03:27:14.614407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.155801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.755288+0000","last_change":"2023-12-16T03:27:14.599553+0000","last_active":"2023-12-16T03:27:15.755288+0000","last_peered":"2023-12-16T03:27:15.755288+0000","last_clean":"2023-12-16T03:27:15.755288+0000","last_became_active":"2023-12-16T03:27:14.599255+0000","last_became_peered":"2023-12-16T03:27:14.599255+0000","last_unstale":"2023-12-16T03:27:15.755288+0000","last_undegraded":"2023-12-16T03:27:15.755288+0000","last_fullsized":"2023-12-16T03:27:15.755288+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:52:21.014337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.593882+0000","last_change":"2023-12-16T03:27:13.599085+0000","last_active":"2023-12-16T03:27:15.593882+0000","last_peered":"2023-12-16T03:27:15.593882+0000","last_clean":"2023-12-16T03:27:15.593882+0000","last_became_active":"2023-12-16T03:27:13.598028+0000","last_became_peered":"2023-12-16T03:27:13.598028+0000","last_unstale":"2023-12-16T03:27:15.593882+0000","last_undegraded":"2023-12-16T03:27:15.593882+0000","last_fullsized":"2023-12-16T03:27:15.593882+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:05.702573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607022+0000","last_change":"2023-12-16T03:27:01.522194+0000","last_active":"2023-12-16T03:27:14.607022+0000","last_peered":"2023-12-16T03:27:14.607022+0000","last_clean":"2023-12-16T03:27:14.607022+0000","last_became_active":"2023-12-16T03:27:01.521667+0000","last_became_peered":"2023-12-16T03:27:01.521667+0000","last_unstale":"2023-12-16T03:27:14.607022+0000","last_undegraded":"2023-12-16T03:27:14.607022+0000","last_fullsized":"2023-12-16T03:27:14.607022+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.595350+0000","last_change":"2023-12-16T03:27:00.511361+0000","last_active":"2023-12-16T03:27:14.595350+0000","last_peered":"2023-12-16T03:27:14.595350+0000","last_clean":"2023-12-16T03:27:14.595350+0000","last_became_active":"2023-12-16T03:27:00.511033+0000","last_became_peered":"2023-12-16T03:27:00.511033+0000","last_unstale":"2023-12-16T03:27:14.595350+0000","last_undegraded":"2023-12-16T03:27:14.595350+0000","last_fullsized":"2023-12-16T03:27:14.595350+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:28:48.295530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.615090+0000","last_change":"2023-12-16T03:27:14.601659+0000","last_active":"2023-12-16T03:27:15.615090+0000","last_peered":"2023-12-16T03:27:15.615090+0000","last_clean":"2023-12-16T03:27:15.615090+0000","last_became_active":"2023-12-16T03:27:14.601360+0000","last_became_peered":"2023-12-16T03:27:14.601360+0000","last_unstale":"2023-12-16T03:27:15.615090+0000","last_undegraded":"2023-12-16T03:27:15.615090+0000","last_fullsized":"2023-12-16T03:27:15.615090+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:16:26.116955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.598612+0000","last_change":"2023-12-16T03:27:13.594888+0000","last_active":"2023-12-16T03:27:14.598612+0000","last_peered":"2023-12-16T03:27:14.598612+0000","last_clean":"2023-12-16T03:27:14.598612+0000","last_became_active":"2023-12-16T03:27:13.594575+0000","last_became_peered":"2023-12-16T03:27:13.594575+0000","last_unstale":"2023-12-16T03:27:14.598612+0000","last_undegraded":"2023-12-16T03:27:14.598612+0000","last_fullsized":"2023-12-16T03:27:14.598612+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:45.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607428+0000","last_change":"2023-12-16T03:27:01.524848+0000","last_active":"2023-12-16T03:27:14.607428+0000","last_peered":"2023-12-16T03:27:14.607428+0000","last_clean":"2023-12-16T03:27:14.607428+0000","last_became_active":"2023-12-16T03:27:01.524561+0000","last_became_peered":"2023-12-16T03:27:01.524561+0000","last_unstale":"2023-12-16T03:27:14.607428+0000","last_undegraded":"2023-12-16T03:27:14.607428+0000","last_fullsized":"2023-12-16T03:27:14.607428+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:16:47.908171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.592554+0000","last_change":"2023-12-16T03:27:00.513344+0000","last_active":"2023-12-16T03:27:14.592554+0000","last_peered":"2023-12-16T03:27:14.592554+0000","last_clean":"2023-12-16T03:27:14.592554+0000","last_became_active":"2023-12-16T03:27:00.513101+0000","last_became_peered":"2023-12-16T03:27:00.513101+0000","last_unstale":"2023-12-16T03:27:14.592554+0000","last_undegraded":"2023-12-16T03:27:14.592554+0000","last_fullsized":"2023-12-16T03:27:14.592554+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:34.745808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.616826+0000","last_change":"2023-12-16T03:27:14.609144+0000","last_active":"2023-12-16T03:27:15.616826+0000","last_peered":"2023-12-16T03:27:15.616826+0000","last_clean":"2023-12-16T03:27:15.616826+0000","last_became_active":"2023-12-16T03:27:14.608793+0000","last_became_peered":"2023-12-16T03:27:14.608793+0000","last_unstale":"2023-12-16T03:27:15.616826+0000","last_undegraded":"2023-12-16T03:27:15.616826+0000","last_fullsized":"2023-12-16T03:27:15.616826+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:20:42.945976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.606017+0000","last_change":"2023-12-16T03:27:13.599455+0000","last_active":"2023-12-16T03:27:14.606017+0000","last_peered":"2023-12-16T03:27:14.606017+0000","last_clean":"2023-12-16T03:27:14.606017+0000","last_became_active":"2023-12-16T03:27:13.598440+0000","last_became_peered":"2023-12-16T03:27:13.598440+0000","last_unstale":"2023-12-16T03:27:14.606017+0000","last_undegraded":"2023-12-16T03:27:14.606017+0000","last_fullsized":"2023-12-16T03:27:14.606017+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:53.791096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.615484+0000","last_change":"2023-12-16T03:27:01.543099+0000","last_active":"2023-12-16T03:27:14.615484+0000","last_peered":"2023-12-16T03:27:14.615484+0000","last_clean":"2023-12-16T03:27:14.615484+0000","last_became_active":"2023-12-16T03:27:01.542711+0000","last_became_peered":"2023-12-16T03:27:01.542711+0000","last_unstale":"2023-12-16T03:27:14.615484+0000","last_undegraded":"2023-12-16T03:27:14.615484+0000","last_fullsized":"2023-12-16T03:27:14.615484+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:28:09.981763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.599178+0000","last_change":"2023-12-16T03:27:00.513164+0000","last_active":"2023-12-16T03:27:14.599178+0000","last_peered":"2023-12-16T03:27:14.599178+0000","last_clean":"2023-12-16T03:27:14.599178+0000","last_became_active":"2023-12-16T03:27:00.512912+0000","last_became_peered":"2023-12-16T03:27:00.512912+0000","last_unstale":"2023-12-16T03:27:14.599178+0000","last_undegraded":"2023-12-16T03:27:14.599178+0000","last_fullsized":"2023-12-16T03:27:14.599178+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:55:19.102544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:16.342708+0000","last_change":"2023-12-16T03:27:14.616335+0000","last_active":"2023-12-16T03:27:16.342708+0000","last_peered":"2023-12-16T03:27:16.342708+0000","last_clean":"2023-12-16T03:27:16.342708+0000","last_became_active":"2023-12-16T03:27:14.613449+0000","last_became_peered":"2023-12-16T03:27:14.613449+0000","last_unstale":"2023-12-16T03:27:16.342708+0000","last_undegraded":"2023-12-16T03:27:16.342708+0000","last_fullsized":"2023-12-16T03:27:16.342708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:03.855804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.609681+0000","last_change":"2023-12-16T03:27:13.595368+0000","last_active":"2023-12-16T03:27:14.609681+0000","last_peered":"2023-12-16T03:27:14.609681+0000","last_clean":"2023-12-16T03:27:14.609681+0000","last_became_active":"2023-12-16T03:27:13.595050+0000","last_became_peered":"2023-12-16T03:27:13.595050+0000","last_unstale":"2023-12-16T03:27:14.609681+0000","last_undegraded":"2023-12-16T03:27:14.609681+0000","last_fullsized":"2023-12-16T03:27:14.609681+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:33:43.745332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.592006+0000","last_change":"2023-12-16T03:27:01.521887+0000","last_active":"2023-12-16T03:27:14.592006+0000","last_peered":"2023-12-16T03:27:14.592006+0000","last_clean":"2023-12-16T03:27:14.592006+0000","last_became_active":"2023-12-16T03:27:01.521554+0000","last_became_peered":"2023-12-16T03:27:01.521554+0000","last_unstale":"2023-12-16T03:27:14.592006+0000","last_undegraded":"2023-12-16T03:27:14.592006+0000","last_fullsized":"2023-12-16T03:27:14.592006+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:24:47.409565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.591914+0000","last_change":"2023-12-16T03:27:00.512268+0000","last_active":"2023-12-16T03:27:14.591914+0000","last_peered":"2023-12-16T03:27:14.591914+0000","last_clean":"2023-12-16T03:27:14.591914+0000","last_became_active":"2023-12-16T03:27:00.511945+0000","last_became_peered":"2023-12-16T03:27:00.511945+0000","last_unstale":"2023-12-16T03:27:14.591914+0000","last_undegraded":"2023-12-16T03:27:14.591914+0000","last_fullsized":"2023-12-16T03:27:14.591914+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:49:40.657817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.617185+0000","last_change":"2023-12-16T03:27:14.624672+0000","last_active":"2023-12-16T03:27:15.617185+0000","last_peered":"2023-12-16T03:27:15.617185+0000","last_clean":"2023-12-16T03:27:15.617185+0000","last_became_active":"2023-12-16T03:27:14.624121+0000","last_became_peered":"2023-12-16T03:27:14.624121+0000","last_unstale":"2023-12-16T03:27:15.617185+0000","last_undegraded":"2023-12-16T03:27:15.617185+0000","last_fullsized":"2023-12-16T03:27:15.617185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:56.130515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.592016+0000","last_change":"2023-12-16T03:27:13.591271+0000","last_active":"2023-12-16T03:27:14.592016+0000","last_peered":"2023-12-16T03:27:14.592016+0000","last_clean":"2023-12-16T03:27:14.592016+0000","last_became_active":"2023-12-16T03:27:13.590997+0000","last_became_peered":"2023-12-16T03:27:13.590997+0000","last_unstale":"2023-12-16T03:27:14.592016+0000","last_undegraded":"2023-12-16T03:27:14.592016+0000","last_fullsized":"2023-12-16T03:27:14.592016+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:33:01.375762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.603078+0000","last_change":"2023-12-16T03:27:01.527192+0000","last_active":"2023-12-16T03:27:14.603078+0000","last_peered":"2023-12-16T03:27:14.603078+0000","last_clean":"2023-12-16T03:27:14.603078+0000","last_became_active":"2023-12-16T03:27:01.526892+0000","last_became_peered":"2023-12-16T03:27:01.526892+0000","last_unstale":"2023-12-16T03:27:14.603078+0000","last_undegraded":"2023-12-16T03:27:14.603078+0000","last_fullsized":"2023-12-16T03:27:14.603078+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:00.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.600643+0000","last_change":"2023-12-16T03:27:00.516056+0000","last_active":"2023-12-16T03:27:14.600643+0000","last_peered":"2023-12-16T03:27:14.600643+0000","last_clean":"2023-12-16T03:27:14.600643+0000","last_became_active":"2023-12-16T03:27:00.515763+0000","last_became_peered":"2023-12-16T03:27:00.515763+0000","last_unstale":"2023-12-16T03:27:14.600643+0000","last_undegraded":"2023-12-16T03:27:14.600643+0000","last_fullsized":"2023-12-16T03:27:14.600643+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:42.045050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-16T03:27:15.931002+0000","last_change":"2023-12-16T03:27:14.622156+0000","last_active":"2023-12-16T03:27:15.931002+0000","last_peered":"2023-12-16T03:27:15.931002+0000","last_clean":"2023-12-16T03:27:15.931002+0000","last_became_active":"2023-12-16T03:27:14.621856+0000","last_became_peered":"2023-12-16T03:27:14.621856+0000","last_unstale":"2023-12-16T03:27:15.931002+0000","last_undegraded":"2023-12-16T03:27:15.931002+0000","last_fullsized":"2023-12-16T03:27:15.931002+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:13.565300+0000","last_clean_scrub_stamp":"2023-12-16T03:27:13.565300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:31.990043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.630664+0000","last_change":"2023-12-16T03:27:13.601694+0000","last_active":"2023-12-16T03:27:14.630664+0000","last_peered":"2023-12-16T03:27:14.630664+0000","last_clean":"2023-12-16T03:27:14.630664+0000","last_became_active":"2023-12-16T03:27:13.601427+0000","last_became_peered":"2023-12-16T03:27:13.601427+0000","last_unstale":"2023-12-16T03:27:14.630664+0000","last_undegraded":"2023-12-16T03:27:14.630664+0000","last_fullsized":"2023-12-16T03:27:14.630664+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:12.557676+0000","last_clean_scrub_stamp":"2023-12-16T03:27:12.557676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:59:10.832996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.600476+0000","last_change":"2023-12-16T03:27:01.520522+0000","last_active":"2023-12-16T03:27:14.600476+0000","last_peered":"2023-12-16T03:27:14.600476+0000","last_clean":"2023-12-16T03:27:14.600476+0000","last_became_active":"2023-12-16T03:27:01.520214+0000","last_became_peered":"2023-12-16T03:27:01.520214+0000","last_unstale":"2023-12-16T03:27:14.600476+0000","last_undegraded":"2023-12-16T03:27:14.600476+0000","last_fullsized":"2023-12-16T03:27:14.600476+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:00.488192+0000","last_clean_scrub_stamp":"2023-12-16T03:27:00.488192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:11:42.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.607003+0000","last_change":"2023-12-16T03:27:00.514945+0000","last_active":"2023-12-16T03:27:14.607003+0000","last_peered":"2023-12-16T03:27:14.607003+0000","last_clean":"2023-12-16T03:27:14.607003+0000","last_became_active":"2023-12-16T03:27:00.514688+0000","last_became_peered":"2023-12-16T03:27:00.514688+0000","last_unstale":"2023-12-16T03:27:14.607003+0000","last_undegraded":"2023-12-16T03:27:14.607003+0000","last_fullsized":"2023-12-16T03:27:14.607003+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:26:59.479836+0000","last_clean_scrub_stamp":"2023-12-16T03:26:59.479836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:28:54.220622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-16T03:27:14.613501+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:27:14.613501+0000","last_peered":"2023-12-16T03:27:14.613501+0000","last_clean":"2023-12-16T03:27:14.613501+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:27:14.613501+0000","last_undegraded":"2023-12-16T03:27:14.613501+0000","last_fullsized":"2023-12-16T03:27:14.613501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":871568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":1.155,"15min":1.155},"last":0.75},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90700000000000003,"5min":1.585,"15min":1.585},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88200000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.81299999999999994,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85099999999999998,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77300000000000002,"15min":0.79100000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.79600000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92700000000000005,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96299999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.62},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94399999999999995,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.72199999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81899999999999995,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.874,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66400000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.499},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.004,"15min":1.004},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.89300000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":280516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.437,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93400000000000005,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93799999999999994,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.83599999999999997}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82899999999999996,"15min":0.85499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95399999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":1.02,"15min":1.075},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96299999999999997,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.85699999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.98099999999999998,"15min":1.0289999999999999},"min":{"1min":0.51200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.042,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.069,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.752}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.87,"15min":0.89700000000000002},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":4.242,"15min":4.242},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.90300000000000002,"15min":0.93500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92600000000000005,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.90600000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88100000000000001,"5min":1.111,"15min":1.111},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.52300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":1.073,"15min":1.073},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.077,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.99099999999999999,"5min":1.246,"15min":1.246},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":659456,"data_stored":281166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.60999999999999999},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1,"15min":1},"last":0.62}]},{"osd":2,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.72599999999999998}]},{"osd":3,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.78800000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74399999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.755,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64000000000000001,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73599999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.82399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.89100000000000001,"5min":1.105,"15min":1.105},"last":0.69999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":663552,"data_stored":283601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.78200000000000003,"15min":0.81000000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":4.194,"15min":4.194},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.74199999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85299999999999998,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.505},{"interface":"front","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.60599999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.91500000000000004,"5min":1.288,"15min":1.288},"last":0.70599999999999996}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.93500000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84399999999999997,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.92500000000000004,"15min":0.96199999999999997},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86099999999999999,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.68700000000000006}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.92800000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.751,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.51400000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.44600000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96499999999999997,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88600000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88900000000000001,"5min":1.881,"15min":1.881},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.81999999999999995,"15min":0.83999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.65300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":663552,"data_stored":280592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.747,"15min":0.80400000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67700000000000005,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.80900000000000005,"15min":0.871},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.32400000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.66700000000000004,"15min":0.70499999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63500000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.66300000000000003,"15min":0.68400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.72999999999999998,"15min":0.76500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94999999999999996,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.016}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.048,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.89400000000000002,"15min":0.92200000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.89500000000000002,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.83699999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.86899999999999999,"15min":0.89100000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.006,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.92500000000000004,"15min":0.95299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97499999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.98399999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.93400000000000005,"15min":0.96399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94499999999999995,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.95299999999999996,"15min":0.97999999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0609999999999999,"5min":3.375,"15min":3.375},"last":0.96399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":667648,"data_stored":282092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48399999999999999,"15min":0.48499999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.875,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.503,"15min":0.498},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.45300000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.432},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.022},"last":0.51100000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77200000000000002,"15min":0.77700000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1060000000000001,"5min":1.587,"15min":1.587},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0609999999999999,"5min":1.913,"15min":1.913},"last":0.57299999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.498},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.179,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.623}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.04,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":671744,"data_stored":282742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.60999999999999999,"15min":0.64200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97199999999999998,"5min":4.476,"15min":4.476},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.80800000000000005,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73899999999999999,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.749,"15min":0.79300000000000004},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.70299999999999996,"15min":0.73399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.66700000000000004,"15min":0.70099999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.03,"15min":1.0820000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0840000000000001,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.93799999999999994,"15min":0.97199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.133,"5min":4.984,"15min":4.984},"last":0.753}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.90200000000000002,"15min":0.93999999999999995},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.996,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.745,"5min":1.089,"15min":1.147},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0209999999999999,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.70999999999999996}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.95199999999999996,"15min":0.98899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0880000000000001,"15min":1.147},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95299999999999996,"5min":7.681,"15min":7.681},"last":0.63600000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":1.0369999999999999,"15min":1.077},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.177,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.995,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.98199999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.83399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1257472,"data_stored":874481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.751,"15min":0.80900000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68200000000000005,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.89300000000000002,"15min":0.95899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70699999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.54500000000000004}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.93000000000000005,"15min":0.999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.028,"15min":1.1100000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82199999999999995,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.79200000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.92800000000000005,"15min":1.0109999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57399999999999995,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.78100000000000003,"15min":0.82599999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":3.254,"15min":3.254},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95099999999999996,"15min":0.98599999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.872}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.0900000000000001,"15min":1.151},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.98499999999999999,"15min":1.036},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97499999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.84199999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97899999999999998,"15min":1.0249999999999999},"min":{"1min":0.54700000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.171,"15min":1.2450000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94399999999999995,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.65100000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":1.181,"15min":1.2490000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95899999999999996,"5min":4.444,"15min":4.444},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0109999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.94899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:27:23.698 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-16T03:27:23.699 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-16T03:27:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f991b2fe640 1 Processor -- start 2023-12-16T03:27:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f991b2fe640 1 -- start start 2023-12-16T03:27:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f991b2fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f99140c7ea0 0x7f991406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f991b2fe640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991406c860 con 0x7f9914151e90 2023-12-16T03:27:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f991b2fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9914154930 con 0x7f991406b9e0 2023-12-16T03:27:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f991b2fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99140c8750 con 0x7f99140c7ea0 2023-12-16T03:27:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f991909a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9914151e90 0x7f99140c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44938/0 (socket says 172.21.15.28:44938) 2023-12-16T03:27:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f991909a640 1 -- 172.21.15.28:0/3128997624 learned_addr learned my addr 172.21.15.28:0/3128997624 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f9918899640 1 --2- 172.21.15.28:0/3128997624 >> v2:172.21.15.134:3300/0 conn(0x7f99140c7ea0 0x7f991406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250420399 0 0) 0x7f991406c860 con 0x7f9914151e90 2023-12-16T03:27:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9900003530 con 0x7f9914151e90 2023-12-16T03:27:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833615918 0 0) 0x7f9914154930 con 0x7f991406b9e0 2023-12-16T03:27:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f991406c860 con 0x7f991406b9e0 2023-12-16T03:27:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1144746927 0 0) 0x7f9900003530 con 0x7f9914151e90 2023-12-16T03:27:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 >> v2:172.21.15.134:3300/0 conn(0x7f99140c7ea0 msgr2=0x7f991406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 --2- 172.21.15.28:0/3128997624 >> v2:172.21.15.134:3300/0 conn(0x7f99140c7ea0 0x7f991406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 >> v1:172.21.15.134:6789/0 conn(0x7f991406b9e0 legacy=0x7f991415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914154c10 con 0x7f9914151e90 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f9910001680 con 0x7f9914151e90 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 >> v1:172.21.15.28:6789/0 conn(0x7f9914151e90 legacy=0x7f99140c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 --2- 172.21.15.28:0/3128997624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9900003b10 0x7f9900003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 --2- 172.21.15.28:0/3128997624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99000047d0 0x7f9900004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 --2- 172.21.15.28:0/3128997624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 0x7f990000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99140c8750 con 0x7f9900005200 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990000c160 con 0x7f99000047d0 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.880+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990000c320 con 0x7f9900003b10 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f991989b640 1 --2- 172.21.15.28:0/3128997624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 0x7f990000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f991909a640 1 --2- 172.21.15.28:0/3128997624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9900003b10 0x7f9900003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f9918899640 1 --2- 172.21.15.28:0/3128997624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99000047d0 0x7f9900004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f991989b640 1 -- 172.21.15.28:0/3128997624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9900003b10 msgr2=0x7f9900003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f991989b640 1 --2- 172.21.15.28:0/3128997624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9900003b10 0x7f9900003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f991989b640 1 -- 172.21.15.28:0/3128997624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99000047d0 msgr2=0x7f9900004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f991989b640 1 --2- 172.21.15.28:0/3128997624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99000047d0 0x7f9900004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f991989b640 1 -- 172.21.15.28:0/3128997624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9900003530 con 0x7f9900005200 2023-12-16T03:27:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f991989b640 1 -- 172.21.15.28:0/3128997624 reap_dead start 2023-12-16T03:27:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f991989b640 1 --2- 172.21.15.28:0/3128997624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 0x7f990000b990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f990c001fd0 tx=0x7f990c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea2e1353456eed3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c003b80 con 0x7f9900005200 2023-12-16T03:27:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c003ce0 con 0x7f9900005200 2023-12-16T03:27:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.884+0000 7f990bfff640 1 -- 172.21.15.28:0/3128997624 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c005310 con 0x7f9900005200 2023-12-16T03:27:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 -- 172.21.15.28:0/3128997624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 msgr2=0x7f990000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 --2- 172.21.15.28:0/3128997624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 0x7f990000b990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f990c001fd0 tx=0x7f990c01c8e0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 -- 172.21.15.28:0/3128997624 shutdown_connections 2023-12-16T03:27:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 --2- 172.21.15.28:0/3128997624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 0x7f990000b990 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 -- 172.21.15.28:0/3128997624 >> 172.21.15.28:0/3128997624 conn(0x7f99140ca170 msgr2=0x7f99140ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 -- 172.21.15.28:0/3128997624 shutdown_connections 2023-12-16T03:27:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 -- 172.21.15.28:0/3128997624 wait complete. 2023-12-16T03:27:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 Processor -- start 2023-12-16T03:27:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 -- start start 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 0x7f99140c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99141eda10 0x7f99140ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9914145e30 0x7f991414e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99141552d0 con 0x7f9900005200 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99140c1310 con 0x7f9914145e30 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991b2fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99141442f0 con 0x7f99141eda10 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991909a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 0x7f99140c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991909a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 0x7f99140c3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47234/0 (socket says 172.21.15.28:47234) 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991909a640 1 -- 172.21.15.28:0/1686141577 learned_addr learned my addr 172.21.15.28:0/1686141577 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991989b640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9914145e30 0x7f991414e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f9918899640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99141eda10 0x7f99140ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991909a640 1 -- 172.21.15.28:0/1686141577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99141eda10 msgr2=0x7f99140ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991909a640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99141eda10 0x7f99140ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991909a640 1 -- 172.21.15.28:0/1686141577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9914145e30 msgr2=0x7f991414e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991909a640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9914145e30 0x7f991414e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.888+0000 7f991909a640 1 -- 172.21.15.28:0/1686141577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99140c85c0 con 0x7f9900005200 2023-12-16T03:27:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.892+0000 7f991909a640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 0x7f99140c3c10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9910004f50 tx=0x7f9910007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.892+0000 7f9909ffb640 1 -- 172.21.15.28:0/1686141577 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991000f730 con 0x7f9900005200 2023-12-16T03:27:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.892+0000 7f9909ffb640 1 -- 172.21.15.28:0/1686141577 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991000f8d0 con 0x7f9900005200 2023-12-16T03:27:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.892+0000 7f991b2fe640 1 -- 172.21.15.28:0/1686141577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99141eded0 con 0x7f9900005200 2023-12-16T03:27:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.892+0000 7f9909ffb640 1 -- 172.21.15.28:0/1686141577 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991000fc80 con 0x7f9900005200 2023-12-16T03:27:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.892+0000 7f991b2fe640 1 -- 172.21.15.28:0/1686141577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99141465b0 con 0x7f9900005200 2023-12-16T03:27:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.892+0000 7f991b2fe640 1 -- 172.21.15.28:0/1686141577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9914068400 con 0x7f9900005200 2023-12-16T03:27:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.892+0000 7f9909ffb640 1 -- 172.21.15.28:0/1686141577 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f991001d460 con 0x7f9900005200 2023-12-16T03:27:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.892+0000 7f9909ffb640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f98f80664a0 0x7f98f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.892+0000 7f9909ffb640 1 -- 172.21.15.28:0/1686141577 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9910084150 con 0x7f9900005200 2023-12-16T03:27:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.892+0000 7f9918899640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f98f80664a0 0x7f98f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.896+0000 7f9918899640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f98f80664a0 0x7f98f8068960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99141464c0 tx=0x7f9904009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:23.896+0000 7f9909ffb640 1 -- 172.21.15.28:0/1686141577 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9910051260 con 0x7f9900005200 2023-12-16T03:27:24.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.112+0000 7f991b2fe640 1 -- 172.21.15.28:0/1686141577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f991406ca50 con 0x7f9900005200 2023-12-16T03:27:24.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.112+0000 7f9909ffb640 1 -- 172.21.15.28:0/1686141577 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v16) v1 ==== 185+0+142 (secure 0 0 0) 0x7f9910054880 con 0x7f9900005200 2023-12-16T03:27:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:[client.1] 2023-12-16T03:27:24.117 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1lgMMbKBAACWizLH1wqYLfSHVjCwyqHQ== 2023-12-16T03:27:24.117 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2023-12-16T03:27:24.117 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2023-12-16T03:27:24.117 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-16T03:27:24.117 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.1 2023-12-16T03:27:24.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 -- 172.21.15.28:0/1686141577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f98f80664a0 msgr2=0x7f98f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f98f80664a0 0x7f98f8068960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99141464c0 tx=0x7f9904009190 comp rx=0 tx=0).stop 2023-12-16T03:27:24.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 -- 172.21.15.28:0/1686141577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 msgr2=0x7f99140c3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 0x7f99140c3c10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9910004f50 tx=0x7f9910007430 comp rx=0 tx=0).stop 2023-12-16T03:27:24.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 -- 172.21.15.28:0/1686141577 shutdown_connections 2023-12-16T03:27:24.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9914145e30 0x7f991414e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99141eda10 0x7f99140ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f98f80664a0 0x7f98f8068960 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 --2- 172.21.15.28:0/1686141577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9900005200 0x7f99140c3c10 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 -- 172.21.15.28:0/1686141577 >> 172.21.15.28:0/1686141577 conn(0x7f99140ca170 msgr2=0x7f99140ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:24.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 -- 172.21.15.28:0/1686141577 shutdown_connections 2023-12-16T03:27:24.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.116+0000 7f991b2fe640 1 -- 172.21.15.28:0/1686141577 wait complete. 2023-12-16T03:27:24.138 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:27:24.138 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:24.148 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:27:24.149 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:24.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:24.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.344+0000 7f9faa6ea640 1 Processor -- start 2023-12-16T03:27:24.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.344+0000 7f9faa6ea640 1 -- start start 2023-12-16T03:27:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9faa6ea640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9fa40c5640 0x7f9fa40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9faa6ea640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa40c2580 con 0x7f9fa40c60f0 2023-12-16T03:27:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9faa6ea640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa40c1a00 con 0x7f9fa40c5260 2023-12-16T03:27:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9faa6ea640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa4153510 con 0x7f9fa40c5640 2023-12-16T03:27:24.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9fa37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9fa40c5640 0x7f9fa40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:24.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9fa37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9fa40c5640 0x7f9fa40c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47242/0 (socket says 172.21.15.28:47242) 2023-12-16T03:27:24.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9fa37fe640 1 -- 172.21.15.28:0/3874858615 learned_addr learned my addr 172.21.15.28:0/3874858615 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:24.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9fa8c87640 1 --1- 172.21.15.28:0/3874858615 >> v1:172.21.15.28:6789/0 conn(0x7f9fa40c60f0 0x7f9fa4155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44954/0 (socket says 172.21.15.28:44954) 2023-12-16T03:27:24.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9fa37fe640 1 -- 172.21.15.28:0/3874858615 >> v1:172.21.15.134:6789/0 conn(0x7f9fa40c5260 legacy=0x7f9fa406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9fa37fe640 1 -- 172.21.15.28:0/3874858615 >> v1:172.21.15.28:6789/0 conn(0x7f9fa40c60f0 legacy=0x7f9fa4155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9fa37fe640 1 -- 172.21.15.28:0/3874858615 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa40c1ce0 con 0x7f9fa40c5640 2023-12-16T03:27:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9fa37fe640 1 --2- 172.21.15.28:0/3874858615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fa40c5640 0x7f9fa40c5bb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009870 tx=0x7f9f9801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e10295d95f3f71 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.348+0000 7f9fa2ffd640 1 -- 172.21.15.28:0/3874858615 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980ab600 con 0x7f9fa40c5640 2023-12-16T03:27:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9fa2ffd640 1 -- 172.21.15.28:0/3874858615 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f980a7050 con 0x7f9fa40c5640 2023-12-16T03:27:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9fa2ffd640 1 -- 172.21.15.28:0/3874858615 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980ab980 con 0x7f9fa40c5640 2023-12-16T03:27:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 -- 172.21.15.28:0/3874858615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fa40c5640 msgr2=0x7f9fa40c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 --2- 172.21.15.28:0/3874858615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fa40c5640 0x7f9fa40c5bb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009870 tx=0x7f9f9801c4b0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 -- 172.21.15.28:0/3874858615 shutdown_connections 2023-12-16T03:27:24.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 --2- 172.21.15.28:0/3874858615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fa40c5640 0x7f9fa40c5bb0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 -- 172.21.15.28:0/3874858615 >> 172.21.15.28:0/3874858615 conn(0x7f9fa406a5b0 msgr2=0x7f9fa406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:24.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 -- 172.21.15.28:0/3874858615 shutdown_connections 2023-12-16T03:27:24.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 -- 172.21.15.28:0/3874858615 wait complete. 2023-12-16T03:27:24.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 Processor -- start 2023-12-16T03:27:24.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 -- start start 2023-12-16T03:27:24.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fa40c5260 0x7f9fa4152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:24.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa40c5640 0x7f9fa4152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:24.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa40c60f0 0x7f9fa41f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:24.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa414fa00 con 0x7f9fa40c5260 2023-12-16T03:27:24.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa414e990 con 0x7f9fa40c5640 2023-12-16T03:27:24.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9faa6ea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa414f440 con 0x7f9fa40c60f0 2023-12-16T03:27:24.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9fa3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fa40c5260 0x7f9fa4152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9fa3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fa40c5260 0x7f9fa4152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47244/0 (socket says 172.21.15.28:47244) 2023-12-16T03:27:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9fa3fff640 1 -- 172.21.15.28:0/2033502838 learned_addr learned my addr 172.21.15.28:0/2033502838 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9fa37fe640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa40c5640 0x7f9fa4152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.352+0000 7f9fa8c87640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa40c60f0 0x7f9fa41f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9fa3fff640 1 -- 172.21.15.28:0/2033502838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa40c60f0 msgr2=0x7f9fa41f4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9fa3fff640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa40c60f0 0x7f9fa41f4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9fa3fff640 1 -- 172.21.15.28:0/2033502838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa40c5640 msgr2=0x7f9fa4152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9fa3fff640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa40c5640 0x7f9fa4152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9fa3fff640 1 -- 172.21.15.28:0/2033502838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980094d0 con 0x7f9fa40c5260 2023-12-16T03:27:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9fa8c87640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa40c60f0 0x7f9fa41f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9fa3fff640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fa40c5260 0x7f9fa4152910 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400c3f0 tx=0x7f9f9400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9fa0ff9640 1 -- 172.21.15.28:0/2033502838 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f940052d0 con 0x7f9fa40c5260 2023-12-16T03:27:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9fa0ff9640 1 -- 172.21.15.28:0/2033502838 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f94005430 con 0x7f9fa40c5260 2023-12-16T03:27:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9fa0ff9640 1 -- 172.21.15.28:0/2033502838 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94003840 con 0x7f9fa40c5260 2023-12-16T03:27:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9faa6ea640 1 -- 172.21.15.28:0/2033502838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa414f720 con 0x7f9fa40c5260 2023-12-16T03:27:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9faa6ea640 1 -- 172.21.15.28:0/2033502838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa41eefe0 con 0x7f9fa40c5260 2023-12-16T03:27:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9faa6ea640 1 -- 172.21.15.28:0/2033502838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa414e480 con 0x7f9fa40c5260 2023-12-16T03:27:24.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.356+0000 7f9fa0ff9640 1 -- 172.21.15.28:0/2033502838 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9f940039a0 con 0x7f9fa40c5260 2023-12-16T03:27:24.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.360+0000 7f9fa0ff9640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f900664a0 0x7f9f90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:24.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.360+0000 7f9fa0ff9640 1 -- 172.21.15.28:0/2033502838 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9f94083760 con 0x7f9fa40c5260 2023-12-16T03:27:24.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.360+0000 7f9fa37fe640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f900664a0 0x7f9f90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.360+0000 7f9fa37fe640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f900664a0 0x7f9f90068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f980ad000 tx=0x7f9f98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:24.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.364+0000 7f9fa0ff9640 1 -- 172.21.15.28:0/2033502838 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9fa414e480 con 0x7f9fa40c5260 2023-12-16T03:27:24.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.520+0000 7f9faa6ea640 1 -- 172.21.15.28:0/2033502838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fa414e7f0 con 0x7f9fa40c5260 2023-12-16T03:27:24.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.520+0000 7f9fa0ff9640 1 -- 172.21.15.28:0/2033502838 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20280 (secure 0 0 0) 0x7f9fa414e7f0 con 0x7f9fa40c5260 2023-12-16T03:27:24.524 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:24.525 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":54,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:15.600556+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 -- 172.21.15.28:0/2033502838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f900664a0 msgr2=0x7f9f90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f900664a0 0x7f9f90068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f980ad000 tx=0x7f9f98008040 comp rx=0 tx=0).stop 2023-12-16T03:27:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 -- 172.21.15.28:0/2033502838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fa40c5260 msgr2=0x7f9fa4152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fa40c5260 0x7f9fa4152910 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400c3f0 tx=0x7f9f9400c8b0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 -- 172.21.15.28:0/2033502838 shutdown_connections 2023-12-16T03:27:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fa40c60f0 0x7f9fa41f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa40c5640 0x7f9fa4152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f900664a0 0x7f9f90068960 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 --2- 172.21.15.28:0/2033502838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fa40c5260 0x7f9fa4152910 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 -- 172.21.15.28:0/2033502838 >> 172.21.15.28:0/2033502838 conn(0x7f9fa406a5b0 msgr2=0x7f9fa406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:24.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 -- 172.21.15.28:0/2033502838 shutdown_connections 2023-12-16T03:27:24.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.524+0000 7f9faa6ea640 1 -- 172.21.15.28:0/2033502838 wait complete. 2023-12-16T03:27:24.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:26:58.698173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:26:59.897067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:27:12.042891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:27:12.972488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:27:24.547 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:27:24.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082e479640 1 Processor -- start 2023-12-16T03:27:24.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082e479640 1 -- start start 2023-12-16T03:27:24.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082e479640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f082806b270 0x7f0828155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:24.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082e479640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08280c8540 0x7f0828151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:24.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082e479640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08280c56d0 con 0x7f08280c6310 2023-12-16T03:27:24.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082e479640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08280c9d30 con 0x7f082806b270 2023-12-16T03:27:24.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082e479640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280c4da0 con 0x7f08280c8540 2023-12-16T03:27:24.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082ca16640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08280c8540 0x7f0828151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:24.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f0827fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f082806b270 0x7f0828155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:24.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f08277fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f08280c6310 0x7f08280c7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:34282/0 (socket says 172.21.15.28:34282) 2023-12-16T03:27:24.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f08277fe640 1 -- 172.21.15.28:0/155018550 learned_addr learned my addr 172.21.15.28:0/155018550 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:24.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082ca16640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08280c8540 0x7f0828151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:35966/0 (socket says 172.21.15.28:35966) 2023-12-16T03:27:24.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f0826ffd640 1 -- 172.21.15.28:0/155018550 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104092742 0 0) 0x7f08280c56d0 con 0x7f08280c6310 2023-12-16T03:27:24.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f0826ffd640 1 -- 172.21.15.28:0/155018550 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0810003530 con 0x7f08280c6310 2023-12-16T03:27:24.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082ca16640 1 -- 172.21.15.28:0/155018550 >> v2:172.21.15.134:3300/0 conn(0x7f082806b270 msgr2=0x7f0828155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:24.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082ca16640 1 --2- 172.21.15.28:0/155018550 >> v2:172.21.15.134:3300/0 conn(0x7f082806b270 0x7f0828155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082ca16640 1 -- 172.21.15.28:0/155018550 >> v1:172.21.15.134:6789/0 conn(0x7f08280c6310 legacy=0x7f08280c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f082ca16640 1 -- 172.21.15.28:0/155018550 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280c5080 con 0x7f08280c8540 2023-12-16T03:27:24.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.692+0000 7f0827fff640 1 --2- 172.21.15.28:0/155018550 >> v2:172.21.15.134:3300/0 conn(0x7f082806b270 0x7f0828155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:24.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f082ca16640 1 --2- 172.21.15.28:0/155018550 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08280c8540 0x7f0828151610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0820009d90 tx=0x7f082001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2f7b9e5dfbfe7c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:24.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f0826ffd640 1 -- 172.21.15.28:0/155018550 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08200a5890 con 0x7f08280c8540 2023-12-16T03:27:24.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f0826ffd640 1 -- 172.21.15.28:0/155018550 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08200a59f0 con 0x7f08280c8540 2023-12-16T03:27:24.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f0826ffd640 1 -- 172.21.15.28:0/155018550 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08200a5d60 con 0x7f08280c8540 2023-12-16T03:27:24.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f082e479640 1 -- 172.21.15.28:0/155018550 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08280c8540 msgr2=0x7f0828151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f082e479640 1 --2- 172.21.15.28:0/155018550 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08280c8540 0x7f0828151610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0820009d90 tx=0x7f082001c8c0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f082e479640 1 -- 172.21.15.28:0/155018550 shutdown_connections 2023-12-16T03:27:24.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f082e479640 1 --2- 172.21.15.28:0/155018550 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f08280c8540 0x7f0828151610 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f082e479640 1 --2- 172.21.15.28:0/155018550 >> v2:172.21.15.134:3300/0 conn(0x7f082806b270 0x7f0828155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f082e479640 1 -- 172.21.15.28:0/155018550 >> 172.21.15.28:0/155018550 conn(0x7f08280ca100 msgr2=0x7f08280ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:24.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f082e479640 1 -- 172.21.15.28:0/155018550 shutdown_connections 2023-12-16T03:27:24.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.696+0000 7f082e479640 1 -- 172.21.15.28:0/155018550 wait complete. 2023-12-16T03:27:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f082e479640 1 Processor -- start 2023-12-16T03:27:24.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f082e479640 1 -- start start 2023-12-16T03:27:24.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f082e479640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f082806b270 0x7f08280ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:24.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f082e479640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08280c6310 0x7f082814cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:24.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f082e479640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08280c8540 0x7f0828146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:24.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f082e479640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082814fcd0 con 0x7f08280c8540 2023-12-16T03:27:24.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f082e479640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08280afa20 con 0x7f08280c6310 2023-12-16T03:27:24.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f082e479640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280aff30 con 0x7f082806b270 2023-12-16T03:27:24.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f082ca16640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08280c8540 0x7f0828146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:24.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f0827fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f082806b270 0x7f08280ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:24.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f08277fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08280c6310 0x7f082814cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:24.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f082ca16640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08280c8540 0x7f0828146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47246/0 (socket says 172.21.15.28:47246) 2023-12-16T03:27:24.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f082ca16640 1 -- 172.21.15.28:0/1949370185 learned_addr learned my addr 172.21.15.28:0/1949370185 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:24.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f0827fff640 1 -- 172.21.15.28:0/1949370185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08280c6310 msgr2=0x7f082814cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f0827fff640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08280c6310 0x7f082814cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f0827fff640 1 -- 172.21.15.28:0/1949370185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08280c8540 msgr2=0x7f0828146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f0827fff640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08280c8540 0x7f0828146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f0827fff640 1 -- 172.21.15.28:0/1949370185 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0818009420 con 0x7f082806b270 2023-12-16T03:27:24.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f0827fff640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f082806b270 0x7f08280ade50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f081800e9e0 tx=0x7f081800eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:24.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f0824ff9640 1 -- 172.21.15.28:0/1949370185 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800c9d0 con 0x7f082806b270 2023-12-16T03:27:24.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f0824ff9640 1 -- 172.21.15.28:0/1949370185 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081800cb30 con 0x7f082806b270 2023-12-16T03:27:24.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.700+0000 7f0824ff9640 1 -- 172.21.15.28:0/1949370185 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800cee0 con 0x7f082806b270 2023-12-16T03:27:24.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.704+0000 7f082e479640 1 -- 172.21.15.28:0/1949370185 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0820009a70 con 0x7f082806b270 2023-12-16T03:27:24.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.704+0000 7f082e479640 1 -- 172.21.15.28:0/1949370185 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0828150d80 con 0x7f082806b270 2023-12-16T03:27:24.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.704+0000 7f082e479640 1 -- 172.21.15.28:0/1949370185 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082814ff40 con 0x7f082806b270 2023-12-16T03:27:24.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.704+0000 7f0824ff9640 1 -- 172.21.15.28:0/1949370185 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0818013470 con 0x7f082806b270 2023-12-16T03:27:24.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.704+0000 7f0824ff9640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08140664a0 0x7f0814068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:24.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.704+0000 7f0824ff9640 1 -- 172.21.15.28:0/1949370185 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0818084320 con 0x7f082806b270 2023-12-16T03:27:24.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.704+0000 7f08277fe640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08140664a0 0x7f0814068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:24.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.704+0000 7f08277fe640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08140664a0 0x7f0814068960 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f081c007fd0 tx=0x7f081c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:24.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.708+0000 7f0824ff9640 1 -- 172.21.15.28:0/1949370185 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f08180514e0 con 0x7f082806b270 2023-12-16T03:27:24.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.868+0000 7f082e479640 1 -- 172.21.15.28:0/1949370185 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f082804e850 con 0x7f082806b270 2023-12-16T03:27:24.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.868+0000 7f0824ff9640 1 -- 172.21.15.28:0/1949370185 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0818054b00 con 0x7f082806b270 2023-12-16T03:27:24.872 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:27:24.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 -- 172.21.15.28:0/1949370185 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08140664a0 msgr2=0x7f0814068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08140664a0 0x7f0814068960 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f081c007fd0 tx=0x7f081c009040 comp rx=0 tx=0).stop 2023-12-16T03:27:24.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 -- 172.21.15.28:0/1949370185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f082806b270 msgr2=0x7f08280ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:24.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f082806b270 0x7f08280ade50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f081800e9e0 tx=0x7f081800eea0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 -- 172.21.15.28:0/1949370185 shutdown_connections 2023-12-16T03:27:24.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08140664a0 0x7f0814068960 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08280c8540 0x7f0828146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08280c6310 0x7f082814cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 --2- 172.21.15.28:0/1949370185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f082806b270 0x7f08280ade50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:24.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 -- 172.21.15.28:0/1949370185 >> 172.21.15.28:0/1949370185 conn(0x7f08280ca100 msgr2=0x7f0828153e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:24.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 -- 172.21.15.28:0/1949370185 shutdown_connections 2023-12-16T03:27:24.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:24.872+0000 7f082e479640 1 -- 172.21.15.28:0/1949370185 wait complete. 2023-12-16T03:27:24.893 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:27:25.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdac2bdf640 1 Processor -- start 2023-12-16T03:27:25.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdac2bdf640 1 -- start start 2023-12-16T03:27:25.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdac2bdf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdabc072090 0x7fdabc150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdac2bdf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc0725c0 0x7fdabc1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdac2bdf640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc0c2760 con 0x7fdabc0a5370 2023-12-16T03:27:25.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdac2bdf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc0c3070 con 0x7fdabc072090 2023-12-16T03:27:25.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdac2bdf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0a5750 con 0x7fdabc0725c0 2023-12-16T03:27:25.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdac117c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc0725c0 0x7fdabc1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdac097b640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fdabc0a5370 0x7fdabc0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:34294/0 (socket says 172.21.15.28:34294) 2023-12-16T03:27:25.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdabbfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdabc072090 0x7fdabc150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdac117c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc0725c0 0x7fdabc1514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:35980/0 (socket says 172.21.15.28:35980) 2023-12-16T03:27:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.036+0000 7fdac097b640 1 -- 172.21.15.28:0/486622434 learned_addr learned my addr 172.21.15.28:0/486622434 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.040+0000 7fdac117c640 1 -- 172.21.15.28:0/486622434 >> v2:172.21.15.134:3300/0 conn(0x7fdabc072090 msgr2=0x7fdabc150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.040+0000 7fdac117c640 1 --2- 172.21.15.28:0/486622434 >> v2:172.21.15.134:3300/0 conn(0x7fdabc072090 0x7fdabc150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.040+0000 7fdac117c640 1 -- 172.21.15.28:0/486622434 >> v1:172.21.15.134:6789/0 conn(0x7fdabc0a5370 legacy=0x7fdabc0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.040+0000 7fdac117c640 1 -- 172.21.15.28:0/486622434 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc0aad20 con 0x7fdabc0725c0 2023-12-16T03:27:25.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.040+0000 7fdac117c640 1 --2- 172.21.15.28:0/486622434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc0725c0 0x7fdabc1514e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009d90 tx=0x7fdab401c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d4038db11a98414 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:25.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.040+0000 7fdabb7fe640 1 -- 172.21.15.28:0/486622434 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab40a5860 con 0x7fdabc0725c0 2023-12-16T03:27:25.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.040+0000 7fdabb7fe640 1 -- 172.21.15.28:0/486622434 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab40a59c0 con 0x7fdabc0725c0 2023-12-16T03:27:25.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.040+0000 7fdabb7fe640 1 -- 172.21.15.28:0/486622434 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab40a5d50 con 0x7fdabc0725c0 2023-12-16T03:27:25.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 -- 172.21.15.28:0/486622434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc0725c0 msgr2=0x7fdabc1514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 --2- 172.21.15.28:0/486622434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc0725c0 0x7fdabc1514e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009d90 tx=0x7fdab401c800 comp rx=0 tx=0).stop 2023-12-16T03:27:25.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 -- 172.21.15.28:0/486622434 shutdown_connections 2023-12-16T03:27:25.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 --2- 172.21.15.28:0/486622434 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc0725c0 0x7fdabc1514e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 --2- 172.21.15.28:0/486622434 >> v2:172.21.15.134:3300/0 conn(0x7fdabc072090 0x7fdabc150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 -- 172.21.15.28:0/486622434 >> 172.21.15.28:0/486622434 conn(0x7fdabc06a5b0 msgr2=0x7fdabc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:25.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 -- 172.21.15.28:0/486622434 shutdown_connections 2023-12-16T03:27:25.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 -- 172.21.15.28:0/486622434 wait complete. 2023-12-16T03:27:25.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 Processor -- start 2023-12-16T03:27:25.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 -- start start 2023-12-16T03:27:25.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc072090 0x7fdabc0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdabc0725c0 0x7fdabc0a6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdabc0a5370 0x7fdabc138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0a5bd0 con 0x7fdabc0725c0 2023-12-16T03:27:25.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0a5960 con 0x7fdabc0a5370 2023-12-16T03:27:25.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac2bdf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0a73a0 con 0x7fdabc072090 2023-12-16T03:27:25.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdabbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdabc0725c0 0x7fdabc0a6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdabbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdabc0725c0 0x7fdabc0a6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47256/0 (socket says 172.21.15.28:47256) 2023-12-16T03:27:25.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdabbfff640 1 -- 172.21.15.28:0/3116915288 learned_addr learned my addr 172.21.15.28:0/3116915288 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:25.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac097b640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc072090 0x7fdabc0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdac117c640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdabc0a5370 0x7fdabc138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdabbfff640 1 -- 172.21.15.28:0/3116915288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc072090 msgr2=0x7fdabc0bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdabbfff640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc072090 0x7fdabc0bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdabbfff640 1 -- 172.21.15.28:0/3116915288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdabc0a5370 msgr2=0x7fdabc138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdabbfff640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdabc0a5370 0x7fdabc138e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.044+0000 7fdabbfff640 1 -- 172.21.15.28:0/3116915288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4009a70 con 0x7fdabc0725c0 2023-12-16T03:27:25.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.048+0000 7fdabbfff640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdabc0725c0 0x7fdabc0a6660 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800e960 tx=0x7fdaa800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:25.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.048+0000 7fdab97fa640 1 -- 172.21.15.28:0/3116915288 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8009690 con 0x7fdabc0725c0 2023-12-16T03:27:25.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.048+0000 7fdab97fa640 1 -- 172.21.15.28:0/3116915288 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa800ca00 con 0x7fdabc0725c0 2023-12-16T03:27:25.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.048+0000 7fdac2bdf640 1 -- 172.21.15.28:0/3116915288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc0a7680 con 0x7fdabc0725c0 2023-12-16T03:27:25.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.048+0000 7fdab97fa640 1 -- 172.21.15.28:0/3116915288 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800cd70 con 0x7fdabc0725c0 2023-12-16T03:27:25.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.048+0000 7fdac2bdf640 1 -- 172.21.15.28:0/3116915288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc0bf8a0 con 0x7fdabc0725c0 2023-12-16T03:27:25.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.048+0000 7fdac2bdf640 1 -- 172.21.15.28:0/3116915288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdabc0a71e0 con 0x7fdabc0725c0 2023-12-16T03:27:25.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.048+0000 7fdab97fa640 1 -- 172.21.15.28:0/3116915288 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdaa8013470 con 0x7fdabc0725c0 2023-12-16T03:27:25.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.048+0000 7fdab97fa640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdaa0066470 0x7fdaa0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.048+0000 7fdab97fa640 1 -- 172.21.15.28:0/3116915288 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdaa8084360 con 0x7fdabc0725c0 2023-12-16T03:27:25.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.052+0000 7fdac097b640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdaa0066470 0x7fdaa0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.052+0000 7fdac097b640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdaa0066470 0x7fdaa0068930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdab0005890 tx=0x7fdab0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:25.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.052+0000 7fdab97fa640 1 -- 172.21.15.28:0/3116915288 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdaa8051520 con 0x7fdabc0725c0 2023-12-16T03:27:25.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.208+0000 7fdac2bdf640 1 -- 172.21.15.28:0/3116915288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdabc068400 con 0x7fdabc0725c0 2023-12-16T03:27:25.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.208+0000 7fdab97fa640 1 -- 172.21.15.28:0/3116915288 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdaa8054b40 con 0x7fdabc0725c0 2023-12-16T03:27:25.213 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:27:25.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 -- 172.21.15.28:0/3116915288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdaa0066470 msgr2=0x7fdaa0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdaa0066470 0x7fdaa0068930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdab0005890 tx=0x7fdab0009040 comp rx=0 tx=0).stop 2023-12-16T03:27:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 -- 172.21.15.28:0/3116915288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdabc0725c0 msgr2=0x7fdabc0a6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdabc0725c0 0x7fdabc0a6660 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800e960 tx=0x7fdaa800ee20 comp rx=0 tx=0).stop 2023-12-16T03:27:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 -- 172.21.15.28:0/3116915288 shutdown_connections 2023-12-16T03:27:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdabc0a5370 0x7fdabc138e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdaa0066470 0x7fdaa0068930 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdabc0725c0 0x7fdabc0a6660 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 --2- 172.21.15.28:0/3116915288 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdabc072090 0x7fdabc0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 -- 172.21.15.28:0/3116915288 >> 172.21.15.28:0/3116915288 conn(0x7fdabc06a5b0 msgr2=0x7fdabc0c05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 -- 172.21.15.28:0/3116915288 shutdown_connections 2023-12-16T03:27:25.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.212+0000 7fdac2bdf640 1 -- 172.21.15.28:0/3116915288 wait complete. 2023-12-16T03:27:25.234 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:27:25.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.376+0000 7f8d2e4fe640 1 Processor -- start 2023-12-16T03:27:25.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.376+0000 7f8d2e4fe640 1 -- start start 2023-12-16T03:27:25.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.376+0000 7f8d2e4fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 0x7f8d28070d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.376+0000 7f8d2e4fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8d2806b6c0 0x7f8d28071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.376+0000 7f8d2e4fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d28151ed0 con 0x7f8d2814ea30 2023-12-16T03:27:25.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.376+0000 7f8d2e4fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d28152400 con 0x7f8d2806b6c0 2023-12-16T03:27:25.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.376+0000 7f8d2e4fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d280738b0 con 0x7f8d2806bc10 2023-12-16T03:27:25.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d277fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 0x7f8d28070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d277fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 0x7f8d28070d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:36010/0 (socket says 172.21.15.28:36010) 2023-12-16T03:27:25.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d277fe640 1 -- 172.21.15.28:0/2488101260 learned_addr learned my addr 172.21.15.28:0/2488101260 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:25.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d27fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8d2814ea30 0x7f8d280abe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:34304/0 (socket says 172.21.15.28:34304) 2023-12-16T03:27:25.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d2ca9b640 1 --2- 172.21.15.28:0/2488101260 >> v2:172.21.15.134:3300/0 conn(0x7f8d2806b6c0 0x7f8d28071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d277fe640 1 -- 172.21.15.28:0/2488101260 >> v2:172.21.15.134:3300/0 conn(0x7f8d2806b6c0 msgr2=0x7f8d28071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:25.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d277fe640 1 --2- 172.21.15.28:0/2488101260 >> v2:172.21.15.134:3300/0 conn(0x7f8d2806b6c0 0x7f8d28071280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d277fe640 1 -- 172.21.15.28:0/2488101260 >> v1:172.21.15.134:6789/0 conn(0x7f8d2814ea30 legacy=0x7f8d280abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d277fe640 1 -- 172.21.15.28:0/2488101260 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d28152120 con 0x7f8d2806bc10 2023-12-16T03:27:25.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d277fe640 1 --2- 172.21.15.28:0/2488101260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 0x7f8d28070d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c009870 tx=0x7f8d1c01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0ccec2e381b35f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:25.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d26ffd640 1 -- 172.21.15.28:0/2488101260 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0ab600 con 0x7f8d2806bc10 2023-12-16T03:27:25.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d26ffd640 1 -- 172.21.15.28:0/2488101260 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c0ab760 con 0x7f8d2806bc10 2023-12-16T03:27:25.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.380+0000 7f8d26ffd640 1 -- 172.21.15.28:0/2488101260 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0abaf0 con 0x7f8d2806bc10 2023-12-16T03:27:25.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/2488101260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 msgr2=0x7f8d28070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 --2- 172.21.15.28:0/2488101260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 0x7f8d28070d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c009870 tx=0x7f8d1c01c420 comp rx=0 tx=0).stop 2023-12-16T03:27:25.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/2488101260 shutdown_connections 2023-12-16T03:27:25.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 --2- 172.21.15.28:0/2488101260 >> v2:172.21.15.134:3300/0 conn(0x7f8d2806b6c0 0x7f8d28071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 --2- 172.21.15.28:0/2488101260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 0x7f8d28070d40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/2488101260 >> 172.21.15.28:0/2488101260 conn(0x7f8d280c30c0 msgr2=0x7f8d280c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:25.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/2488101260 shutdown_connections 2023-12-16T03:27:25.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/2488101260 wait complete. 2023-12-16T03:27:25.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 Processor -- start 2023-12-16T03:27:25.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 -- start start 2023-12-16T03:27:25.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d2806b6c0 0x7f8d280c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 0x7f8d280bb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d2814ea30 0x7f8d2814bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d280c58e0 con 0x7f8d2806b6c0 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d281ecb40 con 0x7f8d2814ea30 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2e4fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d281ece20 con 0x7f8d2806bc10 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d2806b6c0 0x7f8d280c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d2806b6c0 0x7f8d280c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47268/0 (socket says 172.21.15.28:47268) 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d27fff640 1 -- 172.21.15.28:0/1894270221 learned_addr learned my addr 172.21.15.28:0/1894270221 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d2ca9b640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d2814ea30 0x7f8d2814bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d277fe640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 0x7f8d280bb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.384+0000 7f8d27fff640 1 -- 172.21.15.28:0/1894270221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 msgr2=0x7f8d280bb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d27fff640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 0x7f8d280bb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d27fff640 1 -- 172.21.15.28:0/1894270221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d2814ea30 msgr2=0x7f8d2814bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d27fff640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d2814ea30 0x7f8d2814bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d27fff640 1 -- 172.21.15.28:0/1894270221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c0094d0 con 0x7f8d2806b6c0 2023-12-16T03:27:25.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d27fff640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d2806b6c0 0x7f8d280c53a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c490 tx=0x7f8d1800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:25.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d24ff9640 1 -- 172.21.15.28:0/1894270221 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18007480 con 0x7f8d2806b6c0 2023-12-16T03:27:25.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d24ff9640 1 -- 172.21.15.28:0/1894270221 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d180075e0 con 0x7f8d2806b6c0 2023-12-16T03:27:25.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/1894270221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d281ed100 con 0x7f8d2806b6c0 2023-12-16T03:27:25.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d24ff9640 1 -- 172.21.15.28:0/1894270221 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18004a10 con 0x7f8d2806b6c0 2023-12-16T03:27:25.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/1894270221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d280bbe30 con 0x7f8d2806b6c0 2023-12-16T03:27:25.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/1894270221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d28068400 con 0x7f8d2806b6c0 2023-12-16T03:27:25.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d24ff9640 1 -- 172.21.15.28:0/1894270221 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8d18004b70 con 0x7f8d2806b6c0 2023-12-16T03:27:25.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d24ff9640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d14066470 0x7f8d14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d24ff9640 1 -- 172.21.15.28:0/1894270221 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8d180835f0 con 0x7f8d2806b6c0 2023-12-16T03:27:25.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.388+0000 7f8d277fe640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d14066470 0x7f8d14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.392+0000 7f8d277fe640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d14066470 0x7f8d14068930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0af000 tx=0x7f8d1c0b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:25.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.392+0000 7f8d24ff9640 1 -- 172.21.15.28:0/1894270221 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8d180507b0 con 0x7f8d2806b6c0 2023-12-16T03:27:25.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/1894270221 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d280c2d20 con 0x7f8d2806b6c0 2023-12-16T03:27:25.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d24ff9640 1 -- 172.21.15.28:0/1894270221 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d18053dd0 con 0x7f8d2806b6c0 2023-12-16T03:27:25.559 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:27:25.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/1894270221 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d14066470 msgr2=0x7f8d14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d14066470 0x7f8d14068930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0af000 tx=0x7f8d1c0b6040 comp rx=0 tx=0).stop 2023-12-16T03:27:25.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/1894270221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d2806b6c0 msgr2=0x7f8d280c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d2806b6c0 0x7f8d280c53a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c490 tx=0x7f8d1800c950 comp rx=0 tx=0).stop 2023-12-16T03:27:25.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/1894270221 shutdown_connections 2023-12-16T03:27:25.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d2814ea30 0x7f8d2814bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d2806bc10 0x7f8d280bb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d14066470 0x7f8d14068930 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 --2- 172.21.15.28:0/1894270221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d2806b6c0 0x7f8d280c53a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/1894270221 >> 172.21.15.28:0/1894270221 conn(0x7f8d280c30c0 msgr2=0x7f8d2814e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/1894270221 shutdown_connections 2023-12-16T03:27:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.556+0000 7f8d2e4fe640 1 -- 172.21.15.28:0/1894270221 wait complete. 2023-12-16T03:27:25.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:27:25.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.724+0000 7feef2a6b640 1 Processor -- start 2023-12-16T03:27:25.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.724+0000 7feef2a6b640 1 -- start start 2023-12-16T03:27:25.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.724+0000 7feef2a6b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feeec151e90 0x7feeec0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.724+0000 7feef2a6b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feeec0c7ea0 0x7feeec06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.724+0000 7feef2a6b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec06c860 con 0x7feeec0c4e60 2023-12-16T03:27:25.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.724+0000 7feef2a6b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec0c8750 con 0x7feeec151e90 2023-12-16T03:27:25.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.724+0000 7feef2a6b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec1552d0 con 0x7feeec0c7ea0 2023-12-16T03:27:25.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.724+0000 7feef0807640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feeec151e90 0x7feeec0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.728+0000 7feef0807640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7feeec151e90 0x7feeec0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47280/0 (socket says 172.21.15.28:47280) 2023-12-16T03:27:25.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.728+0000 7feef0807640 1 -- 172.21.15.28:0/4011229085 learned_addr learned my addr 172.21.15.28:0/4011229085 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:25.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.728+0000 7feeebfff640 1 --2- 172.21.15.28:0/4011229085 >> v2:172.21.15.134:3300/0 conn(0x7feeec0c7ea0 0x7feeec06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.728+0000 7feef0807640 1 -- 172.21.15.28:0/4011229085 >> v2:172.21.15.134:3300/0 conn(0x7feeec0c7ea0 msgr2=0x7feeec06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:25.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.728+0000 7feef0807640 1 --2- 172.21.15.28:0/4011229085 >> v2:172.21.15.134:3300/0 conn(0x7feeec0c7ea0 0x7feeec06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.728+0000 7feef0807640 1 -- 172.21.15.28:0/4011229085 >> v1:172.21.15.134:6789/0 conn(0x7feeec0c4e60 legacy=0x7feeec06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.728+0000 7feef0807640 1 -- 172.21.15.28:0/4011229085 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec154930 con 0x7feeec151e90 2023-12-16T03:27:25.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.728+0000 7feef0807640 1 --2- 172.21.15.28:0/4011229085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeec151e90 0x7feeec0c4920 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7feeec0a9a70 tx=0x7feee001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97324c3471c1a8d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:25.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.728+0000 7feeeb7fe640 1 -- 172.21.15.28:0/4011229085 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00ab600 con 0x7feeec151e90 2023-12-16T03:27:25.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.728+0000 7feeeb7fe640 1 -- 172.21.15.28:0/4011229085 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee00a7050 con 0x7feeec151e90 2023-12-16T03:27:25.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.728+0000 7feeeb7fe640 1 -- 172.21.15.28:0/4011229085 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00ab980 con 0x7feeec151e90 2023-12-16T03:27:25.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 -- 172.21.15.28:0/4011229085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeec151e90 msgr2=0x7feeec0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 --2- 172.21.15.28:0/4011229085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeec151e90 0x7feeec0c4920 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7feeec0a9a70 tx=0x7feee001c3e0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 -- 172.21.15.28:0/4011229085 shutdown_connections 2023-12-16T03:27:25.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 --2- 172.21.15.28:0/4011229085 >> v2:172.21.15.134:3300/0 conn(0x7feeec0c7ea0 0x7feeec06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 --2- 172.21.15.28:0/4011229085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeec151e90 0x7feeec0c4920 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 -- 172.21.15.28:0/4011229085 >> 172.21.15.28:0/4011229085 conn(0x7feeec0ca170 msgr2=0x7feeec0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:25.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 -- 172.21.15.28:0/4011229085 shutdown_connections 2023-12-16T03:27:25.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 -- 172.21.15.28:0/4011229085 wait complete. 2023-12-16T03:27:25.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 Processor -- start 2023-12-16T03:27:25.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 -- start start 2023-12-16T03:27:25.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeec0c4e60 0x7feeec0adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeec0c7ea0 0x7feeec0bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeec151e90 0x7feeec0c1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec150b50 con 0x7feeec0c4e60 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0c0190 con 0x7feeec151e90 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef2a6b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec1edac0 con 0x7feeec0c7ea0 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef0807640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeec0c4e60 0x7feeec0adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef0807640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeec0c4e60 0x7feeec0adc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47284/0 (socket says 172.21.15.28:47284) 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef0807640 1 -- 172.21.15.28:0/1842229112 learned_addr learned my addr 172.21.15.28:0/1842229112 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feeebfff640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeec0c7ea0 0x7feeec0bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef1008640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeec151e90 0x7feeec0c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef0807640 1 -- 172.21.15.28:0/1842229112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeec0c7ea0 msgr2=0x7feeec0bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef0807640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeec0c7ea0 0x7feeec0bf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef0807640 1 -- 172.21.15.28:0/1842229112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeec151e90 msgr2=0x7feeec0c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef0807640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeec151e90 0x7feeec0c1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.732+0000 7feef0807640 1 -- 172.21.15.28:0/1842229112 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee00094d0 con 0x7feeec0c4e60 2023-12-16T03:27:25.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.736+0000 7feef0807640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeec0c4e60 0x7feeec0adc30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7feee001a010 tx=0x7feee001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:25.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.736+0000 7feee97fa640 1 -- 172.21.15.28:0/1842229112 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00b6420 con 0x7feeec0c4e60 2023-12-16T03:27:25.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.736+0000 7feee97fa640 1 -- 172.21.15.28:0/1842229112 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee00b6580 con 0x7feeec0c4e60 2023-12-16T03:27:25.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.736+0000 7feee97fa640 1 -- 172.21.15.28:0/1842229112 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00b6930 con 0x7feeec0c4e60 2023-12-16T03:27:25.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.736+0000 7feef2a6b640 1 -- 172.21.15.28:0/1842229112 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec150870 con 0x7feeec0c4e60 2023-12-16T03:27:25.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.736+0000 7feef2a6b640 1 -- 172.21.15.28:0/1842229112 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec0bdc50 con 0x7feeec0c4e60 2023-12-16T03:27:25.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.736+0000 7feef2a6b640 1 -- 172.21.15.28:0/1842229112 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec068400 con 0x7feeec0c4e60 2023-12-16T03:27:25.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.736+0000 7feee97fa640 1 -- 172.21.15.28:0/1842229112 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7feee00b2040 con 0x7feeec0c4e60 2023-12-16T03:27:25.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.736+0000 7feee97fa640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feed0066470 0x7feed0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:25.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.736+0000 7feee97fa640 1 -- 172.21.15.28:0/1842229112 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7feee011e5a0 con 0x7feeec0c4e60 2023-12-16T03:27:25.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.736+0000 7feeebfff640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feed0066470 0x7feed0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:25.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.740+0000 7feeebfff640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feed0066470 0x7feed0068930 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feeec0ab8a0 tx=0x7feed8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:25.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.740+0000 7feee97fa640 1 -- 172.21.15.28:0/1842229112 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7feee00eb760 con 0x7feeec0c4e60 2023-12-16T03:27:25.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.904+0000 7feef2a6b640 1 -- 172.21.15.28:0/1842229112 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7feeec0ca8f0 con 0x7feeec0c4e60 2023-12-16T03:27:25.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.904+0000 7feee97fa640 1 -- 172.21.15.28:0/1842229112 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7feee00eed80 con 0x7feeec0c4e60 2023-12-16T03:27:25.908 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:27:25.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 -- 172.21.15.28:0/1842229112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feed0066470 msgr2=0x7feed0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feed0066470 0x7feed0068930 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feeec0ab8a0 tx=0x7feed8009190 comp rx=0 tx=0).stop 2023-12-16T03:27:25.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 -- 172.21.15.28:0/1842229112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeec0c4e60 msgr2=0x7feeec0adc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:25.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeec0c4e60 0x7feeec0adc30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7feee001a010 tx=0x7feee001ac20 comp rx=0 tx=0).stop 2023-12-16T03:27:25.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 -- 172.21.15.28:0/1842229112 shutdown_connections 2023-12-16T03:27:25.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeec151e90 0x7feeec0c1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feeec0c7ea0 0x7feeec0bf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7feed0066470 0x7feed0068930 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 --2- 172.21.15.28:0/1842229112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7feeec0c4e60 0x7feeec0adc30 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:25.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 -- 172.21.15.28:0/1842229112 >> 172.21.15.28:0/1842229112 conn(0x7feeec0ca170 msgr2=0x7feeec157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:25.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 -- 172.21.15.28:0/1842229112 shutdown_connections 2023-12-16T03:27:25.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:25.908+0000 7feef2a6b640 1 -- 172.21.15.28:0/1842229112 wait complete. 2023-12-16T03:27:25.929 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:27:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9ea5d1640 1 Processor -- start 2023-12-16T03:27:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9ea5d1640 1 -- start start 2023-12-16T03:27:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9ea5d1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb9e40c2bb0 0x7fb9e40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9ea5d1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40c31c0 con 0x7fb9e40c4100 2023-12-16T03:27:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9ea5d1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40c34a0 con 0x7fb9e40c63c0 2023-12-16T03:27:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9ea5d1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e40c1030 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9e37fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb9e40c4100 0x7fb9e40a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44964/0 (socket says 172.21.15.28:44964) 2023-12-16T03:27:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9e37fe640 1 -- 172.21.15.28:0/1211167023 learned_addr learned my addr 172.21.15.28:0/1211167023 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9e8b6e640 1 --2- 172.21.15.28:0/1211167023 >> v2:172.21.15.134:3300/0 conn(0x7fb9e40c2bb0 0x7fb9e40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9e2ffd640 1 -- 172.21.15.28:0/1211167023 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883610629 0 0) 0x7fb9e40c31c0 con 0x7fb9e40c4100 2023-12-16T03:27:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9e2ffd640 1 -- 172.21.15.28:0/1211167023 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9cc003530 con 0x7fb9e40c4100 2023-12-16T03:27:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9e2ffd640 1 -- 172.21.15.28:0/1211167023 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881262859 0 0) 0x7fb9e40c34a0 con 0x7fb9e40c63c0 2023-12-16T03:27:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9e2ffd640 1 -- 172.21.15.28:0/1211167023 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e40c31c0 con 0x7fb9e40c63c0 2023-12-16T03:27:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9e8b6e640 1 -- 172.21.15.28:0/1211167023 >> v1:172.21.15.134:6789/0 conn(0x7fb9e40c63c0 legacy=0x7fb9e40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9e8b6e640 1 -- 172.21.15.28:0/1211167023 >> v1:172.21.15.28:6789/0 conn(0x7fb9e40c4100 legacy=0x7fb9e40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.072+0000 7fb9e8b6e640 1 -- 172.21.15.28:0/1211167023 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40c1310 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.076+0000 7fb9e8b6e640 1 --2- 172.21.15.28:0/1211167023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e40c2bb0 0x7fb9e40c06d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009d90 tx=0x7fb9dc01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=646e632a04a8d767 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:26.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.076+0000 7fb9e2ffd640 1 -- 172.21.15.28:0/1211167023 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0a5910 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.076+0000 7fb9e2ffd640 1 -- 172.21.15.28:0/1211167023 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc0a5a70 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.076+0000 7fb9e2ffd640 1 -- 172.21.15.28:0/1211167023 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0a5e00 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.076+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/1211167023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e40c2bb0 msgr2=0x7fb9e40c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.076+0000 7fb9ea5d1640 1 --2- 172.21.15.28:0/1211167023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e40c2bb0 0x7fb9e40c06d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009d90 tx=0x7fb9dc01c830 comp rx=0 tx=0).stop 2023-12-16T03:27:26.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.076+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/1211167023 shutdown_connections 2023-12-16T03:27:26.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.076+0000 7fb9ea5d1640 1 --2- 172.21.15.28:0/1211167023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e40c2bb0 0x7fb9e40c06d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.076+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/1211167023 >> 172.21.15.28:0/1211167023 conn(0x7fb9e406a5b0 msgr2=0x7fb9e406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:26.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.076+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/1211167023 shutdown_connections 2023-12-16T03:27:26.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.076+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/1211167023 wait complete. 2023-12-16T03:27:26.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9ea5d1640 1 Processor -- start 2023-12-16T03:27:26.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9ea5d1640 1 -- start start 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9ea5d1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9e40c2bb0 0x7fb9e4157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9ea5d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e40c4100 0x7fb9e4143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9ea5d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9e40c63c0 0x7fb9e4144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9ea5d1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e415b140 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9ea5d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4155ee0 con 0x7fb9e40c4100 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9ea5d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e415c220 con 0x7fb9e40c63c0 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9e40c2bb0 0x7fb9e4157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9e40c2bb0 0x7fb9e4157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47286/0 (socket says 172.21.15.28:47286) 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e3fff640 1 -- 172.21.15.28:0/2292309329 learned_addr learned my addr 172.21.15.28:0/2292309329 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e37fe640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e40c4100 0x7fb9e4143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e8b6e640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9e40c63c0 0x7fb9e4144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e3fff640 1 -- 172.21.15.28:0/2292309329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9e40c63c0 msgr2=0x7fb9e4144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e3fff640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9e40c63c0 0x7fb9e4144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e3fff640 1 -- 172.21.15.28:0/2292309329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e40c4100 msgr2=0x7fb9e4143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e3fff640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e40c4100 0x7fb9e4143c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e3fff640 1 -- 172.21.15.28:0/2292309329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc009a70 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e8b6e640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9e40c63c0 0x7fb9e4144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:26.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e37fe640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e40c4100 0x7fb9e4143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:26.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e3fff640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9e40c2bb0 0x7fb9e4157f40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400c430 tx=0x7fb9d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:26.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e0ff9640 1 -- 172.21.15.28:0/2292309329 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40052d0 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e0ff9640 1 -- 172.21.15.28:0/2292309329 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d4005450 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9e0ff9640 1 -- 172.21.15.28:0/2292309329 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4003840 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/2292309329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e41edcd0 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.080+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/2292309329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e4158480 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.084+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/2292309329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e4068400 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.084+0000 7fb9e0ff9640 1 -- 172.21.15.28:0/2292309329 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb9d40039a0 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.084+0000 7fb9e0ff9640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d00664a0 0x7fb9d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.084+0000 7fb9e0ff9640 1 -- 172.21.15.28:0/2292309329 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb9d40838a0 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.084+0000 7fb9e37fe640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d00664a0 0x7fb9d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.084+0000 7fb9e37fe640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d00664a0 0x7fb9d0068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4157a50 tx=0x7fb9d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:26.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.088+0000 7fb9e0ff9640 1 -- 172.21.15.28:0/2292309329 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb9d4050920 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.244+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/2292309329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb9e40c3e70 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.244+0000 7fb9e0ff9640 1 -- 172.21.15.28:0/2292309329 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb9d4017020 con 0x7fb9e40c2bb0 2023-12-16T03:27:26.248 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:27:26.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/2292309329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d00664a0 msgr2=0x7fb9d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d00664a0 0x7fb9d0068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4157a50 tx=0x7fb9d8009040 comp rx=0 tx=0).stop 2023-12-16T03:27:26.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/2292309329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9e40c2bb0 msgr2=0x7fb9e4157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9e40c2bb0 0x7fb9e4157f40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400c430 tx=0x7fb9d400c8f0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/2292309329 shutdown_connections 2023-12-16T03:27:26.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb9e40c63c0 0x7fb9e4144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9e40c4100 0x7fb9e4143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb9d00664a0 0x7fb9d0068960 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 --2- 172.21.15.28:0/2292309329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9e40c2bb0 0x7fb9e4157f40 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/2292309329 >> 172.21.15.28:0/2292309329 conn(0x7fb9e406a5b0 msgr2=0x7fb9e4155210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:26.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/2292309329 shutdown_connections 2023-12-16T03:27:26.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.248+0000 7fb9ea5d1640 1 -- 172.21.15.28:0/2292309329 wait complete. 2023-12-16T03:27:26.270 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:27:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95aaff8640 1 Processor -- start 2023-12-16T03:27:26.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95aaff8640 1 -- start start 2023-12-16T03:27:26.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95aaff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a41555c0 0x7f95a40a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95aaff8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f95a40c61e0 0x7f95a40c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95aaff8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f95a40c6c70 0x7f95a40c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95aaff8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a40c3680 con 0x7f95a40c6c70 2023-12-16T03:27:26.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95aaff8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a40c28e0 con 0x7f95a40c61e0 2023-12-16T03:27:26.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95aaff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40c2b80 con 0x7f95a41555c0 2023-12-16T03:27:26.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95a9595640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f95a40c6c70 0x7f95a40c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95a9595640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f95a40c6c70 0x7f95a40c1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47300/0 (socket says 172.21.15.28:47300) 2023-12-16T03:27:26.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95a9595640 1 -- 172.21.15.28:0/8788101 learned_addr learned my addr 172.21.15.28:0/8788101 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:26.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95a8d94640 1 --2- 172.21.15.28:0/8788101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a41555c0 0x7f95a40a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95a3fff640 1 --2- 172.21.15.28:0/8788101 >> v2:172.21.15.134:3300/0 conn(0x7f95a40c61e0 0x7f95a40c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95a9595640 1 -- 172.21.15.28:0/8788101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a41555c0 msgr2=0x7f95a40a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:26.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95a9595640 1 --2- 172.21.15.28:0/8788101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a41555c0 0x7f95a40a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95a9595640 1 -- 172.21.15.28:0/8788101 >> v2:172.21.15.134:3300/0 conn(0x7f95a40c61e0 msgr2=0x7f95a40c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:26.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95a9595640 1 --2- 172.21.15.28:0/8788101 >> v2:172.21.15.134:3300/0 conn(0x7f95a40c61e0 0x7f95a40c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.412+0000 7f95a9595640 1 -- 172.21.15.28:0/8788101 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40c32a0 con 0x7f95a40c6c70 2023-12-16T03:27:26.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95a9595640 1 --2- 172.21.15.28:0/8788101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95a40c6c70 0x7f95a40c1270 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f95a40c2710 tx=0x7f959c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a561b20ecc5d9a85 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:26.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95a37fe640 1 -- 172.21.15.28:0/8788101 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0a5680 con 0x7f95a40c6c70 2023-12-16T03:27:26.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95a37fe640 1 -- 172.21.15.28:0/8788101 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c0a57e0 con 0x7f95a40c6c70 2023-12-16T03:27:26.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95a37fe640 1 -- 172.21.15.28:0/8788101 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0a5b70 con 0x7f95a40c6c70 2023-12-16T03:27:26.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95aaff8640 1 -- 172.21.15.28:0/8788101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95a40c6c70 msgr2=0x7f95a40c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95aaff8640 1 --2- 172.21.15.28:0/8788101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95a40c6c70 0x7f95a40c1270 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f95a40c2710 tx=0x7f959c01c9d0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95aaff8640 1 -- 172.21.15.28:0/8788101 shutdown_connections 2023-12-16T03:27:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95aaff8640 1 --2- 172.21.15.28:0/8788101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95a40c6c70 0x7f95a40c1270 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95aaff8640 1 --2- 172.21.15.28:0/8788101 >> v2:172.21.15.134:3300/0 conn(0x7f95a40c61e0 0x7f95a40c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95aaff8640 1 --2- 172.21.15.28:0/8788101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a41555c0 0x7f95a40a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95aaff8640 1 -- 172.21.15.28:0/8788101 >> 172.21.15.28:0/8788101 conn(0x7f95a40c7e40 msgr2=0x7f95a40c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95aaff8640 1 -- 172.21.15.28:0/8788101 shutdown_connections 2023-12-16T03:27:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95aaff8640 1 -- 172.21.15.28:0/8788101 wait complete. 2023-12-16T03:27:26.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.416+0000 7f95aaff8640 1 Processor -- start 2023-12-16T03:27:26.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95aaff8640 1 -- start start 2023-12-16T03:27:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95aaff8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a40c61e0 0x7f95a414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95aaff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a40c6c70 0x7f95a41ee740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95aaff8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95a41555c0 0x7f95a41f0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95aaff8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a41f1780 con 0x7f95a41555c0 2023-12-16T03:27:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95aaff8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a415a7f0 con 0x7f95a40c61e0 2023-12-16T03:27:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95aaff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a414d8f0 con 0x7f95a40c6c70 2023-12-16T03:27:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a9595640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95a41555c0 0x7f95a41f0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a9595640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95a41555c0 0x7f95a41f0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47316/0 (socket says 172.21.15.28:47316) 2023-12-16T03:27:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a9595640 1 -- 172.21.15.28:0/760113788 learned_addr learned my addr 172.21.15.28:0/760113788 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a8d94640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a40c61e0 0x7f95a414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a3fff640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a40c6c70 0x7f95a41ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a9595640 1 -- 172.21.15.28:0/760113788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a40c6c70 msgr2=0x7f95a41ee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a9595640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a40c6c70 0x7f95a41ee740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a9595640 1 -- 172.21.15.28:0/760113788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a40c61e0 msgr2=0x7f95a414d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a9595640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a40c61e0 0x7f95a414d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a9595640 1 -- 172.21.15.28:0/760113788 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c009b30 con 0x7f95a41555c0 2023-12-16T03:27:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a9595640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95a41555c0 0x7f95a41f0aa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f959c0af040 tx=0x7f959c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a17fa640 1 -- 172.21.15.28:0/760113788 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0a5680 con 0x7f95a41555c0 2023-12-16T03:27:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a17fa640 1 -- 172.21.15.28:0/760113788 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c0b8690 con 0x7f95a41555c0 2023-12-16T03:27:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95a17fa640 1 -- 172.21.15.28:0/760113788 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0b8a40 con 0x7f95a41555c0 2023-12-16T03:27:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95aaff8640 1 -- 172.21.15.28:0/760113788 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a41f14a0 con 0x7f95a41555c0 2023-12-16T03:27:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95aaff8640 1 -- 172.21.15.28:0/760113788 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a414ce90 con 0x7f95a41555c0 2023-12-16T03:27:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.420+0000 7f95aaff8640 1 -- 172.21.15.28:0/760113788 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a414d080 con 0x7f95a41555c0 2023-12-16T03:27:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.424+0000 7f95a17fa640 1 -- 172.21.15.28:0/760113788 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f959c0b8ba0 con 0x7f95a41555c0 2023-12-16T03:27:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.424+0000 7f95a17fa640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95880664a0 0x7f9588068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.424+0000 7f95a17fa640 1 -- 172.21.15.28:0/760113788 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f959c11f670 con 0x7f95a41555c0 2023-12-16T03:27:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.424+0000 7f95a8d94640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95880664a0 0x7f9588068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.424+0000 7f95a8d94640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95880664a0 0x7f9588068960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f95a4152380 tx=0x7f9598008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:26.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.428+0000 7f95a17fa640 1 -- 172.21.15.28:0/760113788 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f959c0ec7b0 con 0x7f95a41555c0 2023-12-16T03:27:26.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.596+0000 7f95aaff8640 1 -- 172.21.15.28:0/760113788 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f95a4068400 con 0x7f95a41555c0 2023-12-16T03:27:26.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.596+0000 7f95a17fa640 1 -- 172.21.15.28:0/760113788 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f959c0efdd0 con 0x7f95a41555c0 2023-12-16T03:27:26.600 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:27:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 -- 172.21.15.28:0/760113788 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95880664a0 msgr2=0x7f9588068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95880664a0 0x7f9588068960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f95a4152380 tx=0x7f9598008040 comp rx=0 tx=0).stop 2023-12-16T03:27:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 -- 172.21.15.28:0/760113788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95a41555c0 msgr2=0x7f95a41f0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95a41555c0 0x7f95a41f0aa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f959c0af040 tx=0x7f959c019770 comp rx=0 tx=0).stop 2023-12-16T03:27:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 -- 172.21.15.28:0/760113788 shutdown_connections 2023-12-16T03:27:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95880664a0 0x7f9588068960 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95a41555c0 0x7f95a41f0aa0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95a40c6c70 0x7f95a41ee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 --2- 172.21.15.28:0/760113788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95a40c61e0 0x7f95a414d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 -- 172.21.15.28:0/760113788 >> 172.21.15.28:0/760113788 conn(0x7f95a40c7e40 msgr2=0x7f95a4158580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:26.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 -- 172.21.15.28:0/760113788 shutdown_connections 2023-12-16T03:27:26.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.600+0000 7f95aaff8640 1 -- 172.21.15.28:0/760113788 wait complete. 2023-12-16T03:27:26.622 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-16T03:27:26.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:26.622 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-16T03:27:26.652 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:27:26.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:26.653 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T03:27:26.710 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:27:26.710 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:26.772 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-16T03:27:26.772 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:27:26.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffaa312a640 1 Processor -- start 2023-12-16T03:27:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffaa312a640 1 -- start start 2023-12-16T03:27:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffaa312a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c072090 0x7ffa9c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffaa312a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffa9c0725c0 0x7ffa9c1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffaa312a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9c0c2760 con 0x7ffa9c0a5370 2023-12-16T03:27:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffaa312a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9c0c3070 con 0x7ffa9c0725c0 2023-12-16T03:27:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffaa312a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0a5750 con 0x7ffa9c072090 2023-12-16T03:27:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffaa0ec6640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ffa9c0a5370 0x7ffa9c0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44968/0 (socket says 172.21.15.28:44968) 2023-12-16T03:27:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffaa0ec6640 1 -- 172.21.15.28:0/3601474205 learned_addr learned my addr 172.21.15.28:0/3601474205 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffaa16c7640 1 --2- 172.21.15.28:0/3601474205 >> v2:172.21.15.134:3300/0 conn(0x7ffa9c0725c0 0x7ffa9c1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffa9bfff640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c072090 0x7ffa9c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856628014 0 0) 0x7ffa9c0c2760 con 0x7ffa9c0a5370 2023-12-16T03:27:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa8c003530 con 0x7ffa9c0a5370 2023-12-16T03:27:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.920+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2531392018 0 0) 0x7ffa8c003530 con 0x7ffa9c0a5370 2023-12-16T03:27:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c072090 msgr2=0x7ffa9c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c072090 0x7ffa9c150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 >> v2:172.21.15.134:3300/0 conn(0x7ffa9c0725c0 msgr2=0x7ffa9c1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 --2- 172.21.15.28:0/3601474205 >> v2:172.21.15.134:3300/0 conn(0x7ffa9c0725c0 0x7ffa9c1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c0aad20 con 0x7ffa9c0a5370 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7ffa90001680 con 0x7ffa9c0a5370 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 >> v1:172.21.15.28:6789/0 conn(0x7ffa9c0a5370 legacy=0x7ffa9c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c072090 0x7ffa8c003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa8c0040d0 0x7ffa8c00a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa8c00aea0 0x7ffa8c00d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0c3070 con 0x7ffa8c0040d0 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c0a5750 con 0x7ffa8c00aea0 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c00dc90 con 0x7ffa9c072090 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffaa0ec6640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c072090 0x7ffa8c003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9bfff640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa8c0040d0 0x7ffa8c00a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffaa16c7640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa8c00aea0 0x7ffa8c00d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9bfff640 1 -- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c072090 msgr2=0x7ffa8c003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:26.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9bfff640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c072090 0x7ffa8c003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9bfff640 1 -- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa8c00aea0 msgr2=0x7ffa8c00d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:26.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9bfff640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa8c00aea0 0x7ffa8c00d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9bfff640 1 -- 172.21.15.28:0/3601474205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c003530 con 0x7ffa8c0040d0 2023-12-16T03:27:26.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffaa0ec6640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c072090 0x7ffa8c003b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:26.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.924+0000 7ffa9bfff640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa8c0040d0 0x7ffa8c00a790 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009ae0 tx=0x7ffa8801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8b04afb7962e54 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:26.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880a5590 con 0x7ffa8c0040d0 2023-12-16T03:27:26.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa880a56f0 con 0x7ffa8c0040d0 2023-12-16T03:27:26.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffa9b7fe640 1 -- 172.21.15.28:0/3601474205 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880a5aa0 con 0x7ffa8c0040d0 2023-12-16T03:27:26.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 -- 172.21.15.28:0/3601474205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa8c0040d0 msgr2=0x7ffa8c00a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 --2- 172.21.15.28:0/3601474205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa8c0040d0 0x7ffa8c00a790 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009ae0 tx=0x7ffa8801ca20 comp rx=0 tx=0).stop 2023-12-16T03:27:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa16c7640 1 -- 172.21.15.28:0/3601474205 reap_dead start 2023-12-16T03:27:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 -- 172.21.15.28:0/3601474205 shutdown_connections 2023-12-16T03:27:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 -- 172.21.15.28:0/3601474205 >> 172.21.15.28:0/3601474205 conn(0x7ffa9c06a5b0 msgr2=0x7ffa9c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 -- 172.21.15.28:0/3601474205 shutdown_connections 2023-12-16T03:27:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 -- 172.21.15.28:0/3601474205 wait complete. 2023-12-16T03:27:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 Processor -- start 2023-12-16T03:27:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 -- start start 2023-12-16T03:27:26.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa8c0040d0 0x7ffa9c14b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c1434a0 0x7ffa9c143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa9c1e8890 0x7ffa9c1e8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c071ce0 con 0x7ffa9c1e8890 2023-12-16T03:27:26.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c1ecd60 con 0x7ffa8c0040d0 2023-12-16T03:27:26.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa312a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c143e60 con 0x7ffa9c1434a0 2023-12-16T03:27:26.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa16c7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa9c1e8890 0x7ffa9c1e8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa16c7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa9c1e8890 0x7ffa9c1e8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47344/0 (socket says 172.21.15.28:47344) 2023-12-16T03:27:26.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa16c7640 1 -- 172.21.15.28:0/1529107829 learned_addr learned my addr 172.21.15.28:0/1529107829 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:26.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffa9bfff640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c1434a0 0x7ffa9c143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.928+0000 7ffaa0ec6640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa8c0040d0 0x7ffa9c14b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffaa16c7640 1 -- 172.21.15.28:0/1529107829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c1434a0 msgr2=0x7ffa9c143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffaa16c7640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c1434a0 0x7ffa9c143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffaa16c7640 1 -- 172.21.15.28:0/1529107829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa8c0040d0 msgr2=0x7ffa9c14b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:26.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffaa16c7640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa8c0040d0 0x7ffa9c14b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:26.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffaa16c7640 1 -- 172.21.15.28:0/1529107829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c1ebfa0 con 0x7ffa9c1e8890 2023-12-16T03:27:26.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffaa0ec6640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa8c0040d0 0x7ffa9c14b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffaa16c7640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa9c1e8890 0x7ffa9c1e8d10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0c0500 tx=0x7ffa9400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffa997fa640 1 -- 172.21.15.28:0/1529107829 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400e040 con 0x7ffa9c1e8890 2023-12-16T03:27:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffa997fa640 1 -- 172.21.15.28:0/1529107829 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9400f040 con 0x7ffa9c1e8890 2023-12-16T03:27:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffaa312a640 1 -- 172.21.15.28:0/1529107829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9c1ec280 con 0x7ffa9c1e8890 2023-12-16T03:27:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffa997fa640 1 -- 172.21.15.28:0/1529107829 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94015430 con 0x7ffa9c1e8890 2023-12-16T03:27:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffaa312a640 1 -- 172.21.15.28:0/1529107829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c1ec840 con 0x7ffa9c1e8890 2023-12-16T03:27:26.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffaa312a640 1 -- 172.21.15.28:0/1529107829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9c068400 con 0x7ffa9c1e8890 2023-12-16T03:27:26.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffa997fa640 1 -- 172.21.15.28:0/1529107829 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ffa94015590 con 0x7ffa9c1e8890 2023-12-16T03:27:26.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffa997fa640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa80066490 0x7ffa80068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:26.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.932+0000 7ffa997fa640 1 -- 172.21.15.28:0/1529107829 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffa94084810 con 0x7ffa9c1e8890 2023-12-16T03:27:26.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.936+0000 7ffaa0ec6640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa80066490 0x7ffa80068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:26.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.936+0000 7ffaa0ec6640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa80066490 0x7ffa80068950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffa90001ec0 tx=0x7ffa90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:26.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:26.936+0000 7ffa997fa640 1 -- 172.21.15.28:0/1529107829 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ffa94051890 con 0x7ffa9c1e8890 2023-12-16T03:27:27.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 -- 172.21.15.28:0/1529107829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffa9c0c6780 con 0x7ffa9c1e8890 2023-12-16T03:27:27.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffa997fa640 1 -- 172.21.15.28:0/1529107829 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+149 (secure 0 0 0) 0x7ffa94054eb0 con 0x7ffa9c1e8890 2023-12-16T03:27:27.134 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:27:27.134 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-16T03:27:27.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 -- 172.21.15.28:0/1529107829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa80066490 msgr2=0x7ffa80068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:27.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa80066490 0x7ffa80068950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffa90001ec0 tx=0x7ffa90009040 comp rx=0 tx=0).stop 2023-12-16T03:27:27.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 -- 172.21.15.28:0/1529107829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa9c1e8890 msgr2=0x7ffa9c1e8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:27.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa9c1e8890 0x7ffa9c1e8d10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0c0500 tx=0x7ffa9400f580 comp rx=0 tx=0).stop 2023-12-16T03:27:27.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 -- 172.21.15.28:0/1529107829 shutdown_connections 2023-12-16T03:27:27.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffa80066490 0x7ffa80068950 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:27.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa9c1e8890 0x7ffa9c1e8d10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:27.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffa9c1434a0 0x7ffa9c143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:27.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 --2- 172.21.15.28:0/1529107829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa8c0040d0 0x7ffa9c14b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:27.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 -- 172.21.15.28:0/1529107829 >> 172.21.15.28:0/1529107829 conn(0x7ffa9c06a5b0 msgr2=0x7ffa9c148ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:27.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 -- 172.21.15.28:0/1529107829 shutdown_connections 2023-12-16T03:27:27.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.132+0000 7ffaa312a640 1 -- 172.21.15.28:0/1529107829 wait complete. 2023-12-16T03:27:27.155 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-16T03:27:27.155 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:27:27.155 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-12-16T03:27:27.155 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-16T03:27:27.155 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:27:27.156 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-16T03:27:27.156 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:27:27.156 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:27:27.156 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:27:27.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:27.156 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-12-16T03:27:27.166 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:27:27.166 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:27:27.166 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:27:27.166 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:27.166 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-16T03:27:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42293sec preferred_lft 42293sec 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 02:42:8f:0f:48:af brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T03:27:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:27:27.169 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:27.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:27.170 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:27:27.233 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-12-16T03:27:27.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:27.236 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-12-16T03:27:27.288 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-12-16T03:27:27.288 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:27:27.288 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-16T03:27:27.289 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T03:27:27.289 INFO:teuthology.orchestra.run.smithi134.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:27:27.289 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T03:27:27.289 INFO:teuthology.orchestra.run.smithi134.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:27:27.289 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:27:27.289 INFO:teuthology.orchestra.run.smithi134.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:27:27.289 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:27:27.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:27.289 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:27:27.290 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:27:27.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T03:27:27.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T03:27:27.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T03:27:27.290 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:27:27.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:27.388 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-16T03:27:27.397 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T03:27:27.398 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:27:27.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:27.398 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-12-16T03:27:27.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:27:27.466 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T03:27:27.521 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:27:27.521 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:27:27.521 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:27:27.572 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-16T03:27:27.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:27.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:27.669 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:27.669 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:27:27.681 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:27.681 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:27:27.682 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:27:27.682 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: 1@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs2=/ 2023-12-16T03:27:27.682 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:27:27.685 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:27:27.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:27.685 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:27:27.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:27.707 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:27:27.770 INFO:teuthology.orchestra.run.smithi134.stdout:client6010 2023-12-16T03:27:27.770 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:27:27.770 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:27.825 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-12-16T03:27:27.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f80ad640 1 Processor -- start 2023-12-16T03:27:27.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f80ad640 1 -- start start 2023-12-16T03:27:27.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f80ad640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f04f00a5370 0x7f04f00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:27.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f80ad640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00c4110 0x7f04f0150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:27.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f80ad640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f00c2760 con 0x7f04f0072090 2023-12-16T03:27:27.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f80ad640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f00c3070 con 0x7f04f00a5370 2023-12-16T03:27:27.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f80ad640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0151bf0 con 0x7f04f00c4110 2023-12-16T03:27:27.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f5648640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00c4110 0x7f04f0150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:27.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f664a640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f04f0072090 0x7f04f01514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:34338/0 (socket says 172.21.15.28:34338) 2023-12-16T03:27:27.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f664a640 1 -- 172.21.15.28:0/1977985489 learned_addr learned my addr 172.21.15.28:0/1977985489 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:27.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f5e49640 1 --2- 172.21.15.28:0/1977985489 >> v2:172.21.15.134:3300/0 conn(0x7f04f00a5370 0x7f04f00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:27.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f5648640 1 -- 172.21.15.28:0/1977985489 >> v2:172.21.15.134:3300/0 conn(0x7f04f00a5370 msgr2=0x7f04f00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:27.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f5648640 1 --2- 172.21.15.28:0/1977985489 >> v2:172.21.15.134:3300/0 conn(0x7f04f00a5370 0x7f04f00c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:27.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f5648640 1 -- 172.21.15.28:0/1977985489 >> v1:172.21.15.134:6789/0 conn(0x7f04f0072090 legacy=0x7f04f01514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:27.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.980+0000 7f04f5648640 1 -- 172.21.15.28:0/1977985489 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f00a5750 con 0x7f04f00c4110 2023-12-16T03:27:27.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f5648640 1 --2- 172.21.15.28:0/1977985489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00c4110 0x7f04f0150fa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f04e00097c0 tx=0x7f04e001e550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f61800536b29667 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:27.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f4e47640 1 -- 172.21.15.28:0/1977985489 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e00ac640 con 0x7f04f00c4110 2023-12-16T03:27:27.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f4e47640 1 -- 172.21.15.28:0/1977985489 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e00ac7a0 con 0x7f04f00c4110 2023-12-16T03:27:27.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f4e47640 1 -- 172.21.15.28:0/1977985489 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e00acb30 con 0x7f04f00c4110 2023-12-16T03:27:27.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f80ad640 1 -- 172.21.15.28:0/1977985489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00c4110 msgr2=0x7f04f0150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:27.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f80ad640 1 --2- 172.21.15.28:0/1977985489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00c4110 0x7f04f0150fa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f04e00097c0 tx=0x7f04e001e550 comp rx=0 tx=0).stop 2023-12-16T03:27:27.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f80ad640 1 -- 172.21.15.28:0/1977985489 shutdown_connections 2023-12-16T03:27:27.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f80ad640 1 --2- 172.21.15.28:0/1977985489 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00c4110 0x7f04f0150fa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:27.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f80ad640 1 --2- 172.21.15.28:0/1977985489 >> v2:172.21.15.134:3300/0 conn(0x7f04f00a5370 0x7f04f00c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:27.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f80ad640 1 -- 172.21.15.28:0/1977985489 >> 172.21.15.28:0/1977985489 conn(0x7f04f006a5b0 msgr2=0x7f04f006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:27.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f80ad640 1 -- 172.21.15.28:0/1977985489 shutdown_connections 2023-12-16T03:27:27.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.984+0000 7f04f80ad640 1 -- 172.21.15.28:0/1977985489 wait complete. 2023-12-16T03:27:27.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f80ad640 1 Processor -- start 2023-12-16T03:27:27.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f80ad640 1 -- start start 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f80ad640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0072090 0x7f04f0150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f80ad640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00a5370 0x7f04f01527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f80ad640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00c4110 0x7f04f01f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f80ad640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f01547d0 con 0x7f04f00c4110 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f80ad640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f01f4a10 con 0x7f04f0072090 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f80ad640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f01f1f60 con 0x7f04f00a5370 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f664a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00c4110 0x7f04f01f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f5e49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0072090 0x7f04f0150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f5648640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00a5370 0x7f04f01527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f5e49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0072090 0x7f04f0150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:43356/0 (socket says 172.21.15.28:43356) 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f5e49640 1 -- 172.21.15.28:0/909906217 learned_addr learned my addr 172.21.15.28:0/909906217 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:27.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f5648640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00a5370 0x7f04f01527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:36142/0 (socket says 172.21.15.28:36142) 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f5e49640 1 -- 172.21.15.28:0/909906217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00a5370 msgr2=0x7f04f01527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f5e49640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00a5370 0x7f04f01527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f5e49640 1 -- 172.21.15.28:0/909906217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00c4110 msgr2=0x7f04f01f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f5e49640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00c4110 0x7f04f01f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f5e49640 1 -- 172.21.15.28:0/909906217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0009420 con 0x7f04f0072090 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f664a640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00c4110 0x7f04f01f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f5e49640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0072090 0x7f04f0150420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00e930 tx=0x7f04ec00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04e67fc640 1 -- 172.21.15.28:0/909906217 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec009690 con 0x7f04f0072090 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04e67fc640 1 -- 172.21.15.28:0/909906217 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec00ca00 con 0x7f04f0072090 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04e67fc640 1 -- 172.21.15.28:0/909906217 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00cd70 con 0x7f04f0072090 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f80ad640 1 -- 172.21.15.28:0/909906217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f01f19a0 con 0x7f04f0072090 2023-12-16T03:27:27.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f80ad640 1 -- 172.21.15.28:0/909906217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f01f46a0 con 0x7f04f0072090 2023-12-16T03:27:27.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.988+0000 7f04f80ad640 1 -- 172.21.15.28:0/909906217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f0068400 con 0x7f04f0072090 2023-12-16T03:27:27.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.992+0000 7f04e67fc640 1 -- 172.21.15.28:0/909906217 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f04ec0059a0 con 0x7f04f0072090 2023-12-16T03:27:27.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.992+0000 7f04e67fc640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04d4066470 0x7f04d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:27.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.992+0000 7f04e67fc640 1 -- 172.21.15.28:0/909906217 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f04ec084ec0 con 0x7f04f0072090 2023-12-16T03:27:27.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.992+0000 7f04f5648640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04d4066470 0x7f04d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:27.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.992+0000 7f04f5648640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04d4066470 0x7f04d4068930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f04e00097c0 tx=0x7f04e00a9000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:27.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:27.996+0000 7f04e67fc640 1 -- 172.21.15.28:0/909906217 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f04ec0521c0 con 0x7f04f0072090 2023-12-16T03:27:28.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.207+0000 7f04f80ad640 1 -- 172.21.15.28:0/909906217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f04f00c6780 con 0x7f04f0072090 2023-12-16T03:27:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04e67fc640 1 -- 172.21.15.28:0/909906217 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v17) v1 ==== 291+0+0 (secure 0 0 0) 0x7f04ec017140 con 0x7f04f0072090 2023-12-16T03:27:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:added key for client.testuser 2023-12-16T03:27:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 -- 172.21.15.28:0/909906217 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04d4066470 msgr2=0x7f04d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04d4066470 0x7f04d4068930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f04e00097c0 tx=0x7f04e00a9000 comp rx=0 tx=0).stop 2023-12-16T03:27:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 -- 172.21.15.28:0/909906217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0072090 msgr2=0x7f04f0150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0072090 0x7f04f0150420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00e930 tx=0x7f04ec00edf0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 -- 172.21.15.28:0/909906217 shutdown_connections 2023-12-16T03:27:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f04d4066470 0x7f04d4068930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f04f00c4110 0x7f04f01f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04f00a5370 0x7f04f01527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 --2- 172.21.15.28:0/909906217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0072090 0x7f04f0150420 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 -- 172.21.15.28:0/909906217 >> 172.21.15.28:0/909906217 conn(0x7f04f006a5b0 msgr2=0x7f04f0150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 -- 172.21.15.28:0/909906217 shutdown_connections 2023-12-16T03:27:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.215+0000 7f04f80ad640 1 -- 172.21.15.28:0/909906217 wait complete. 2023-12-16T03:27:28.239 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-16T03:27:28.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.379+0000 7fb329617640 1 Processor -- start 2023-12-16T03:27:28.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.379+0000 7fb329617640 1 -- start start 2023-12-16T03:27:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.379+0000 7fb329617640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3240c6050 0x7fb3240c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.379+0000 7fb329617640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb324155730 0x7fb3240c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb329617640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3240c6bc0 con 0x7fb3240c31c0 2023-12-16T03:27:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb329617640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3240c8d90 con 0x7fb3240c6050 2023-12-16T03:27:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb329617640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240c3c80 con 0x7fb324155730 2023-12-16T03:27:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb322ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3240c6050 0x7fb3240c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb3227fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb3240c31c0 0x7fb324155020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44972/0 (socket says 172.21.15.28:44972) 2023-12-16T03:27:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb322ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3240c6050 0x7fb3240c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47360/0 (socket says 172.21.15.28:47360) 2023-12-16T03:27:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb3227fc640 1 -- 172.21.15.28:0/686582353 learned_addr learned my addr 172.21.15.28:0/686582353 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb3237fe640 1 --2- 172.21.15.28:0/686582353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb324155730 0x7fb3240c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb322ffd640 1 -- 172.21.15.28:0/686582353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb324155730 msgr2=0x7fb3240c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb322ffd640 1 --2- 172.21.15.28:0/686582353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb324155730 0x7fb3240c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb322ffd640 1 -- 172.21.15.28:0/686582353 >> v1:172.21.15.28:6789/0 conn(0x7fb3240c31c0 legacy=0x7fb324155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb322ffd640 1 -- 172.21.15.28:0/686582353 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3240c6970 con 0x7fb3240c6050 2023-12-16T03:27:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb322ffd640 1 --2- 172.21.15.28:0/686582353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3240c6050 0x7fb3240c6430 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb3140097c0 tx=0x7fb31401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560674c6aba0f55d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb321ffb640 1 -- 172.21.15.28:0/686582353 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3240c8390 con 0x7fb3240c6050 2023-12-16T03:27:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb321ffb640 1 -- 172.21.15.28:0/686582353 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3140a7050 con 0x7fb3240c6050 2023-12-16T03:27:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.383+0000 7fb321ffb640 1 -- 172.21.15.28:0/686582353 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3140ab820 con 0x7fb3240c6050 2023-12-16T03:27:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 -- 172.21.15.28:0/686582353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3240c6050 msgr2=0x7fb3240c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 --2- 172.21.15.28:0/686582353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3240c6050 0x7fb3240c6430 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb3140097c0 tx=0x7fb31401c330 comp rx=0 tx=0).stop 2023-12-16T03:27:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 -- 172.21.15.28:0/686582353 shutdown_connections 2023-12-16T03:27:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 --2- 172.21.15.28:0/686582353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb324155730 0x7fb3240c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 --2- 172.21.15.28:0/686582353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3240c6050 0x7fb3240c6430 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 -- 172.21.15.28:0/686582353 >> 172.21.15.28:0/686582353 conn(0x7fb3240a9b80 msgr2=0x7fb3240a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 -- 172.21.15.28:0/686582353 shutdown_connections 2023-12-16T03:27:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 -- 172.21.15.28:0/686582353 wait complete. 2023-12-16T03:27:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 Processor -- start 2023-12-16T03:27:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 -- start start 2023-12-16T03:27:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240c31c0 0x7fb3241f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3240c6050 0x7fb32414c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb324155730 0x7fb32414da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3241f1110 con 0x7fb324155730 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb324152510 con 0x7fb3240c6050 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb329617640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb324152d40 con 0x7fb3240c31c0 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb324155730 0x7fb32414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb322ffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240c31c0 0x7fb3241f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb3237fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb324155730 0x7fb32414da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47366/0 (socket says 172.21.15.28:47366) 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb3237fe640 1 -- 172.21.15.28:0/1065014068 learned_addr learned my addr 172.21.15.28:0/1065014068 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb3227fc640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3240c6050 0x7fb32414c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb3237fe640 1 -- 172.21.15.28:0/1065014068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240c31c0 msgr2=0x7fb3241f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.387+0000 7fb3237fe640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240c31c0 0x7fb3241f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb3237fe640 1 -- 172.21.15.28:0/1065014068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3240c6050 msgr2=0x7fb32414c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb3237fe640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3240c6050 0x7fb32414c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb3237fe640 1 -- 172.21.15.28:0/1065014068 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314009420 con 0x7fb324155730 2023-12-16T03:27:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb322ffd640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240c31c0 0x7fb3241f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb3237fe640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb324155730 0x7fb32414da80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb31c007e40 tx=0x7fb31c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb30b7fe640 1 -- 172.21.15.28:0/1065014068 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c014620 con 0x7fb324155730 2023-12-16T03:27:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb30b7fe640 1 -- 172.21.15.28:0/1065014068 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c00ee90 con 0x7fb324155730 2023-12-16T03:27:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb30b7fe640 1 -- 172.21.15.28:0/1065014068 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0149e0 con 0x7fb324155730 2023-12-16T03:27:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb329617640 1 -- 172.21.15.28:0/1065014068 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb324152780 con 0x7fb324155730 2023-12-16T03:27:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb329617640 1 -- 172.21.15.28:0/1065014068 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32414d560 con 0x7fb324155730 2023-12-16T03:27:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb329617640 1 -- 172.21.15.28:0/1065014068 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb324068400 con 0x7fb324155730 2023-12-16T03:27:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb30b7fe640 1 -- 172.21.15.28:0/1065014068 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb31c014b40 con 0x7fb324155730 2023-12-16T03:27:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb30b7fe640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 0x7fb310068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb30b7fe640 1 -- 172.21.15.28:0/1065014068 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb31c084ac0 con 0x7fb324155730 2023-12-16T03:27:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.391+0000 7fb322ffd640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 0x7fb310068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.395+0000 7fb322ffd640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 0x7fb310068930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb3140ad000 tx=0x7fb314008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.395+0000 7fb30b7fe640 1 -- 172.21.15.28:0/1065014068 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb31c051bf0 con 0x7fb324155730 2023-12-16T03:27:28.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.607+0000 7fb329617640 1 -- 172.21.15.28:0/1065014068 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7fb3240674e0 con 0x7fb324155730 2023-12-16T03:27:28.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.607+0000 7fb30b7fe640 1 -- 172.21.15.28:0/1065014068 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v17) v1 ==== 85+0+245 (secure 0 0 0) 0x7fb31c055210 con 0x7fb324155730 2023-12-16T03:27:28.612 INFO:teuthology.orchestra.run.smithi028.stdout:[client.testuser] 2023-12-16T03:27:28.612 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAgGX1lNrO2DBAATx/zd0pwltJi3o+CyyJKeQ== 2023-12-16T03:27:28.612 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-16T03:27:28.612 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-12-16T03:27:28.612 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 -- 172.21.15.28:0/1065014068 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 msgr2=0x7fb310068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 0x7fb310068930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb3140ad000 tx=0x7fb314008040 comp rx=0 tx=0).stop 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 -- 172.21.15.28:0/1065014068 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb324155730 msgr2=0x7fb32414da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb324155730 0x7fb32414da80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb31c007e40 tx=0x7fb31c00e4b0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 -- 172.21.15.28:0/1065014068 shutdown_connections 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb310066470 0x7fb310068930 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb324155730 0x7fb32414da80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3240c6050 0x7fb32414c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 --2- 172.21.15.28:0/1065014068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb3240c31c0 0x7fb3241f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 -- 172.21.15.28:0/1065014068 >> 172.21.15.28:0/1065014068 conn(0x7fb3240a9b80 msgr2=0x7fb324066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 -- 172.21.15.28:0/1065014068 shutdown_connections 2023-12-16T03:27:28.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.611+0000 7fb329617640 1 -- 172.21.15.28:0/1065014068 wait complete. 2023-12-16T03:27:28.633 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2023-12-16T03:27:28.642 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.RcLg5tiJMp 2023-12-16T03:27:28.642 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:27:28.642 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/tmp/tmp.RcLg5tiJMp 2023-12-16T03:27:28.693 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:27:28.693 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:28.749 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:27:28.749 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:28.801 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:28.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0362ff8640 1 Processor -- start 2023-12-16T03:27:28.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0362ff8640 1 -- start start 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0362ff8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f035c0c5260 0x7f035c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0362ff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f035c155de0 0x7f035c156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0362ff8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035c0c2580 con 0x7f035c0c5640 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0362ff8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035c153510 con 0x7f035c0c5260 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0362ff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0c17f0 con 0x7f035c155de0 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0360d94640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f035c0c5260 0x7f035c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0360d94640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f035c0c5260 0x7f035c06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47372/0 (socket says 172.21.15.28:47372) 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0360d94640 1 -- 172.21.15.28:0/1571537582 learned_addr learned my addr 172.21.15.28:0/1571537582 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f035bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f035c0c5640 0x7f035c0c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44984/0 (socket says 172.21.15.28:44984) 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0361595640 1 --2- 172.21.15.28:0/1571537582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f035c155de0 0x7f035c156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0360d94640 1 -- 172.21.15.28:0/1571537582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f035c155de0 msgr2=0x7f035c156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0360d94640 1 --2- 172.21.15.28:0/1571537582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f035c155de0 0x7f035c156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0360d94640 1 -- 172.21.15.28:0/1571537582 >> v1:172.21.15.28:6789/0 conn(0x7f035c0c5640 legacy=0x7f035c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.983+0000 7f0360d94640 1 -- 172.21.15.28:0/1571537582 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c0c1a00 con 0x7f035c0c5260 2023-12-16T03:27:28.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f0361595640 1 --2- 172.21.15.28:0/1571537582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f035c155de0 0x7f035c156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:28.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f0360d94640 1 --2- 172.21.15.28:0/1571537582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f035c0c5260 0x7f035c06d5b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f035c0c1930 tx=0x7f035001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4e402e3976b7a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:28.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f035b7fe640 1 -- 172.21.15.28:0/1571537582 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500ab660 con 0x7f035c0c5260 2023-12-16T03:27:28.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f035b7fe640 1 -- 172.21.15.28:0/1571537582 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03500ab7c0 con 0x7f035c0c5260 2023-12-16T03:27:28.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f035b7fe640 1 -- 172.21.15.28:0/1571537582 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500abb50 con 0x7f035c0c5260 2023-12-16T03:27:28.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f0362ff8640 1 -- 172.21.15.28:0/1571537582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f035c0c5260 msgr2=0x7f035c06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f0362ff8640 1 --2- 172.21.15.28:0/1571537582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f035c0c5260 0x7f035c06d5b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f035c0c1930 tx=0x7f035001c460 comp rx=0 tx=0).stop 2023-12-16T03:27:28.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f0362ff8640 1 -- 172.21.15.28:0/1571537582 shutdown_connections 2023-12-16T03:27:28.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f0362ff8640 1 --2- 172.21.15.28:0/1571537582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f035c155de0 0x7f035c156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f0362ff8640 1 --2- 172.21.15.28:0/1571537582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f035c0c5260 0x7f035c06d5b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f0362ff8640 1 -- 172.21.15.28:0/1571537582 >> 172.21.15.28:0/1571537582 conn(0x7f035c06a5b0 msgr2=0x7f035c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:28.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f0362ff8640 1 -- 172.21.15.28:0/1571537582 shutdown_connections 2023-12-16T03:27:28.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.987+0000 7f0362ff8640 1 -- 172.21.15.28:0/1571537582 wait complete. 2023-12-16T03:27:28.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0362ff8640 1 Processor -- start 2023-12-16T03:27:28.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0362ff8640 1 -- start start 2023-12-16T03:27:28.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0362ff8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f035c0c5260 0x7f035c0bb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0362ff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f035c0c5640 0x7f035c070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0362ff8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035c155de0 0x7f035c071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0362ff8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c070990 con 0x7f035c0c5260 2023-12-16T03:27:28.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0362ff8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c15cae0 con 0x7f035c155de0 2023-12-16T03:27:28.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0362ff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0bef20 con 0x7f035c0c5640 2023-12-16T03:27:28.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0360d94640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f035c0c5260 0x7f035c0bb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:28.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0360d94640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f035c0c5260 0x7f035c0bb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47382/0 (socket says 172.21.15.28:47382) 2023-12-16T03:27:28.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0360d94640 1 -- 172.21.15.28:0/3028465073 learned_addr learned my addr 172.21.15.28:0/3028465073 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:28.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f035bfff640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f035c0c5640 0x7f035c070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:28.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0361595640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035c155de0 0x7f035c071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:28.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0360d94640 1 -- 172.21.15.28:0/3028465073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f035c0c5640 msgr2=0x7f035c070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0360d94640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f035c0c5640 0x7f035c070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0360d94640 1 -- 172.21.15.28:0/3028465073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035c155de0 msgr2=0x7f035c071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:28.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0360d94640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035c155de0 0x7f035c071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:28.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0360d94640 1 -- 172.21.15.28:0/3028465073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500094d0 con 0x7f035c0c5260 2023-12-16T03:27:28.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0361595640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035c155de0 0x7f035c071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:28.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0360d94640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f035c0c5260 0x7f035c0bb6c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f03500ad040 tx=0x7f035001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f03597fa640 1 -- 172.21.15.28:0/3028465073 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500b4800 con 0x7f035c0c5260 2023-12-16T03:27:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f03597fa640 1 -- 172.21.15.28:0/3028465073 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03500b4960 con 0x7f035c0c5260 2023-12-16T03:27:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0362ff8640 1 -- 172.21.15.28:0/3028465073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035c15c800 con 0x7f035c0c5260 2023-12-16T03:27:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f03597fa640 1 -- 172.21.15.28:0/3028465073 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500b4d10 con 0x7f035c0c5260 2023-12-16T03:27:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.991+0000 7f0362ff8640 1 -- 172.21.15.28:0/3028465073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035c0bfa50 con 0x7f035c0c5260 2023-12-16T03:27:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.995+0000 7f0362ff8640 1 -- 172.21.15.28:0/3028465073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035c156990 con 0x7f035c0c5260 2023-12-16T03:27:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.995+0000 7f03597fa640 1 -- 172.21.15.28:0/3028465073 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f03500a9070 con 0x7f035c0c5260 2023-12-16T03:27:28.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.995+0000 7f03597fa640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0340066470 0x7f0340068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:28.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.995+0000 7f03597fa640 1 -- 172.21.15.28:0/3028465073 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f035011ecb0 con 0x7f035c0c5260 2023-12-16T03:27:28.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.995+0000 7f035bfff640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0340066470 0x7f0340068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.995+0000 7f035bfff640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0340066470 0x7f0340068930 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f035c156890 tx=0x7f0348007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:29.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:28.999+0000 7f03597fa640 1 -- 172.21.15.28:0/3028465073 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f03500ebe50 con 0x7f035c0c5260 2023-12-16T03:27:29.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.159+0000 7f0362ff8640 1 -- 172.21.15.28:0/3028465073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f035c068400 con 0x7f035c0c5260 2023-12-16T03:27:29.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.159+0000 7f03597fa640 1 -- 172.21.15.28:0/3028465073 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20280 (secure 0 0 0) 0x7f03500ef470 con 0x7f035c0c5260 2023-12-16T03:27:29.163 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:29.163 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":54,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:15.600556+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:29.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.159+0000 7f0362ff8640 1 -- 172.21.15.28:0/3028465073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0340066470 msgr2=0x7f0340068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.159+0000 7f0362ff8640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0340066470 0x7f0340068930 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f035c156890 tx=0x7f0348007c90 comp rx=0 tx=0).stop 2023-12-16T03:27:29.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.159+0000 7f0362ff8640 1 -- 172.21.15.28:0/3028465073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f035c0c5260 msgr2=0x7f035c0bb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.159+0000 7f0362ff8640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f035c0c5260 0x7f035c0bb6c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f03500ad040 tx=0x7f035001aca0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.163+0000 7f0362ff8640 1 -- 172.21.15.28:0/3028465073 shutdown_connections 2023-12-16T03:27:29.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.163+0000 7f0362ff8640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f035c155de0 0x7f035c071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.163+0000 7f0362ff8640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f035c0c5640 0x7f035c070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.163+0000 7f0362ff8640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0340066470 0x7f0340068930 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.163+0000 7f0362ff8640 1 --2- 172.21.15.28:0/3028465073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f035c0c5260 0x7f035c0bb6c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.163+0000 7f0362ff8640 1 -- 172.21.15.28:0/3028465073 >> 172.21.15.28:0/3028465073 conn(0x7f035c06a5b0 msgr2=0x7f035c0a6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:29.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.163+0000 7f0362ff8640 1 -- 172.21.15.28:0/3028465073 shutdown_connections 2023-12-16T03:27:29.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.163+0000 7f0362ff8640 1 -- 172.21.15.28:0/3028465073 wait complete. 2023-12-16T03:27:29.185 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:26:58.698173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:26:59.897067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:27:12.042891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:27:12.972488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:27:29.185 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:27:29.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.327+0000 7f412c032640 1 Processor -- start 2023-12-16T03:27:29.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.327+0000 7f412c032640 1 -- start start 2023-12-16T03:27:29.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.327+0000 7f412c032640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f41240c5260 0x7f412406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.327+0000 7f412c032640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f41240c5640 0x7f41240c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.327+0000 7f412c032640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41240c2580 con 0x7f41240c60f0 2023-12-16T03:27:29.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.327+0000 7f412c032640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4124153510 con 0x7f41240c5640 2023-12-16T03:27:29.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.327+0000 7f412c032640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41240c17f0 con 0x7f41240c5260 2023-12-16T03:27:29.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.327+0000 7f41295cd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f41240c5640 0x7f41240c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f41295cd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f41240c5640 0x7f41240c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47392/0 (socket says 172.21.15.28:47392) 2023-12-16T03:27:29.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f412a5cf640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f41240c60f0 0x7f4124155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44996/0 (socket says 172.21.15.28:44996) 2023-12-16T03:27:29.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f41295cd640 1 -- 172.21.15.28:0/4063205329 learned_addr learned my addr 172.21.15.28:0/4063205329 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:29.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f4129dce640 1 --2- 172.21.15.28:0/4063205329 >> v2:172.21.15.134:3300/0 conn(0x7f41240c5260 0x7f412406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f41295cd640 1 -- 172.21.15.28:0/4063205329 >> v2:172.21.15.134:3300/0 conn(0x7f41240c5260 msgr2=0x7f412406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:29.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f41295cd640 1 --2- 172.21.15.28:0/4063205329 >> v2:172.21.15.134:3300/0 conn(0x7f41240c5260 0x7f412406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f41295cd640 1 -- 172.21.15.28:0/4063205329 >> v1:172.21.15.28:6789/0 conn(0x7f41240c60f0 legacy=0x7f4124155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f41295cd640 1 -- 172.21.15.28:0/4063205329 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41240c1a00 con 0x7f41240c5640 2023-12-16T03:27:29.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f41295cd640 1 --2- 172.21.15.28:0/4063205329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41240c5640 0x7f41240c5bb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f41240c6920 tx=0x7f411401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6054ef1d4fe00a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:29.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f4128dcc640 1 -- 172.21.15.28:0/4063205329 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114004230 con 0x7f41240c5640 2023-12-16T03:27:29.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f4128dcc640 1 -- 172.21.15.28:0/4063205329 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41140a7050 con 0x7f41240c5640 2023-12-16T03:27:29.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.331+0000 7f4128dcc640 1 -- 172.21.15.28:0/4063205329 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114003620 con 0x7f41240c5640 2023-12-16T03:27:29.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 -- 172.21.15.28:0/4063205329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41240c5640 msgr2=0x7f41240c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 --2- 172.21.15.28:0/4063205329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41240c5640 0x7f41240c5bb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f41240c6920 tx=0x7f411401c440 comp rx=0 tx=0).stop 2023-12-16T03:27:29.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 -- 172.21.15.28:0/4063205329 shutdown_connections 2023-12-16T03:27:29.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 --2- 172.21.15.28:0/4063205329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41240c5640 0x7f41240c5bb0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 --2- 172.21.15.28:0/4063205329 >> v2:172.21.15.134:3300/0 conn(0x7f41240c5260 0x7f412406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 -- 172.21.15.28:0/4063205329 >> 172.21.15.28:0/4063205329 conn(0x7f412406a5b0 msgr2=0x7f412406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:29.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 -- 172.21.15.28:0/4063205329 shutdown_connections 2023-12-16T03:27:29.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 -- 172.21.15.28:0/4063205329 wait complete. 2023-12-16T03:27:29.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 Processor -- start 2023-12-16T03:27:29.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 -- start start 2023-12-16T03:27:29.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41240c5260 0x7f41241f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41240c5640 0x7f412414f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41240c60f0 0x7f4124149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412414d5d0 con 0x7f41240c60f0 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41241f1010 con 0x7f41240c5260 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412c032640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4124070c50 con 0x7f41240c5640 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412a5cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41240c60f0 0x7f4124149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412a5cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41240c60f0 0x7f4124149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47398/0 (socket says 172.21.15.28:47398) 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412a5cf640 1 -- 172.21.15.28:0/1543564884 learned_addr learned my addr 172.21.15.28:0/1543564884 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f41295cd640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41240c5640 0x7f412414f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f4129dce640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41240c5260 0x7f41241f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412a5cf640 1 -- 172.21.15.28:0/1543564884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41240c5640 msgr2=0x7f412414f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412a5cf640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41240c5640 0x7f412414f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412a5cf640 1 -- 172.21.15.28:0/1543564884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41240c5260 msgr2=0x7f41241f0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412a5cf640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41240c5260 0x7f41241f0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.335+0000 7f412a5cf640 1 -- 172.21.15.28:0/1543564884 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41140094d0 con 0x7f41240c60f0 2023-12-16T03:27:29.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.339+0000 7f412a5cf640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41240c60f0 0x7f4124149dc0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f411c00c7a0 tx=0x7f411c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:29.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.339+0000 7f411a7fc640 1 -- 172.21.15.28:0/1543564884 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c00a640 con 0x7f41240c60f0 2023-12-16T03:27:29.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.339+0000 7f411a7fc640 1 -- 172.21.15.28:0/1543564884 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c00a7a0 con 0x7f41240c60f0 2023-12-16T03:27:29.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.339+0000 7f411a7fc640 1 -- 172.21.15.28:0/1543564884 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c00ab10 con 0x7f41240c60f0 2023-12-16T03:27:29.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.339+0000 7f412c032640 1 -- 172.21.15.28:0/1543564884 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41240a82d0 con 0x7f41240c60f0 2023-12-16T03:27:29.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.339+0000 7f412c032640 1 -- 172.21.15.28:0/1543564884 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41240708e0 con 0x7f41240c60f0 2023-12-16T03:27:29.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.339+0000 7f412c032640 1 -- 172.21.15.28:0/1543564884 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41240a87f0 con 0x7f41240c60f0 2023-12-16T03:27:29.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.339+0000 7f411a7fc640 1 -- 172.21.15.28:0/1543564884 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f411c00ac70 con 0x7f41240c60f0 2023-12-16T03:27:29.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.339+0000 7f411a7fc640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4108066470 0x7f4108068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.339+0000 7f411a7fc640 1 -- 172.21.15.28:0/1543564884 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f411c083940 con 0x7f41240c60f0 2023-12-16T03:27:29.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.339+0000 7f4129dce640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4108066470 0x7f4108068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.343+0000 7f4129dce640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4108066470 0x7f4108068930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f41200079c0 tx=0x7f4120008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:29.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.343+0000 7f411a7fc640 1 -- 172.21.15.28:0/1543564884 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f411c050b00 con 0x7f41240c60f0 2023-12-16T03:27:29.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.499+0000 7f412c032640 1 -- 172.21.15.28:0/1543564884 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4124068400 con 0x7f41240c60f0 2023-12-16T03:27:29.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.499+0000 7f411a7fc640 1 -- 172.21.15.28:0/1543564884 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f411c0170a0 con 0x7f41240c60f0 2023-12-16T03:27:29.505 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:27:29.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 -- 172.21.15.28:0/1543564884 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4108066470 msgr2=0x7f4108068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4108066470 0x7f4108068930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f41200079c0 tx=0x7f4120008040 comp rx=0 tx=0).stop 2023-12-16T03:27:29.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 -- 172.21.15.28:0/1543564884 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41240c60f0 msgr2=0x7f4124149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41240c60f0 0x7f4124149dc0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f411c00c7a0 tx=0x7f411c00cc60 comp rx=0 tx=0).stop 2023-12-16T03:27:29.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 -- 172.21.15.28:0/1543564884 shutdown_connections 2023-12-16T03:27:29.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4108066470 0x7f4108068930 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41240c60f0 0x7f4124149dc0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41240c5640 0x7f412414f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 --2- 172.21.15.28:0/1543564884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41240c5260 0x7f41241f0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 -- 172.21.15.28:0/1543564884 >> 172.21.15.28:0/1543564884 conn(0x7f412406a5b0 msgr2=0x7f412406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:29.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 -- 172.21.15.28:0/1543564884 shutdown_connections 2023-12-16T03:27:29.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.503+0000 7f412c032640 1 -- 172.21.15.28:0/1543564884 wait complete. 2023-12-16T03:27:29.525 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:27:29.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f05245c1640 1 Processor -- start 2023-12-16T03:27:29.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f05245c1640 1 -- start start 2023-12-16T03:27:29.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f05245c1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 0x7f051c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f05245c1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f051c0c60f0 0x7f051c155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f05245c1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f051c0c2580 con 0x7f051c0c5260 2023-12-16T03:27:29.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f05245c1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051c153510 con 0x7f051c0c60f0 2023-12-16T03:27:29.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f05245c1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0c17f0 con 0x7f051c0c5640 2023-12-16T03:27:29.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f0521b5c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 0x7f051c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f0522b5e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f051c0c60f0 0x7f051c155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f0521b5c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 0x7f051c0c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:46504/0 (socket says 172.21.15.28:46504) 2023-12-16T03:27:29.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f0521b5c640 1 -- 172.21.15.28:0/243808082 learned_addr learned my addr 172.21.15.28:0/243808082 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:29.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f0521b5c640 1 -- 172.21.15.28:0/243808082 >> v2:172.21.15.134:3300/0 conn(0x7f051c0c60f0 msgr2=0x7f051c155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:29.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f0521b5c640 1 --2- 172.21.15.28:0/243808082 >> v2:172.21.15.134:3300/0 conn(0x7f051c0c60f0 0x7f051c155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f0521b5c640 1 -- 172.21.15.28:0/243808082 >> v1:172.21.15.134:6789/0 conn(0x7f051c0c5260 legacy=0x7f051c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.671+0000 7f0521b5c640 1 -- 172.21.15.28:0/243808082 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c0c1a00 con 0x7f051c0c5640 2023-12-16T03:27:29.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.675+0000 7f0521b5c640 1 --2- 172.21.15.28:0/243808082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 0x7f051c0c5bb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f051c0c1930 tx=0x7f050c01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17987ee65b04fbfc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:29.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f052135b640 1 -- 172.21.15.28:0/243808082 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c0ab600 con 0x7f051c0c5640 2023-12-16T03:27:29.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f052135b640 1 -- 172.21.15.28:0/243808082 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c0a7050 con 0x7f051c0c5640 2023-12-16T03:27:29.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f052135b640 1 -- 172.21.15.28:0/243808082 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c0ab980 con 0x7f051c0c5640 2023-12-16T03:27:29.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 -- 172.21.15.28:0/243808082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 msgr2=0x7f051c0c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 --2- 172.21.15.28:0/243808082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 0x7f051c0c5bb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f051c0c1930 tx=0x7f050c01c460 comp rx=0 tx=0).stop 2023-12-16T03:27:29.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 -- 172.21.15.28:0/243808082 shutdown_connections 2023-12-16T03:27:29.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 --2- 172.21.15.28:0/243808082 >> v2:172.21.15.134:3300/0 conn(0x7f051c0c60f0 0x7f051c155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 --2- 172.21.15.28:0/243808082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 0x7f051c0c5bb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 -- 172.21.15.28:0/243808082 >> 172.21.15.28:0/243808082 conn(0x7f051c06a5b0 msgr2=0x7f051c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:29.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 -- 172.21.15.28:0/243808082 shutdown_connections 2023-12-16T03:27:29.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 -- 172.21.15.28:0/243808082 wait complete. 2023-12-16T03:27:29.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 Processor -- start 2023-12-16T03:27:29.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 -- start start 2023-12-16T03:27:29.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f051c0c5260 0x7f051c0c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 0x7f051c15bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f051c0c60f0 0x7f051c15c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0bb100 con 0x7f051c0c60f0 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c1eaf20 con 0x7f051c0c5260 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.679+0000 7f05245c1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051c14f810 con 0x7f051c0c5640 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0522b5e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f051c0c60f0 0x7f051c15c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0521b5c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 0x7f051c15bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0522b5e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f051c0c60f0 0x7f051c15c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38824/0 (socket says 172.21.15.28:38824) 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f052235d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f051c0c5260 0x7f051c0c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0522b5e640 1 -- 172.21.15.28:0/3811544192 learned_addr learned my addr 172.21.15.28:0/3811544192 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0522b5e640 1 -- 172.21.15.28:0/3811544192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 msgr2=0x7f051c15bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0522b5e640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 0x7f051c15bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0522b5e640 1 -- 172.21.15.28:0/3811544192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f051c0c5260 msgr2=0x7f051c0c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0522b5e640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f051c0c5260 0x7f051c0c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0522b5e640 1 -- 172.21.15.28:0/3811544192 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c0094d0 con 0x7f051c0c60f0 2023-12-16T03:27:29.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0522b5e640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f051c0c60f0 0x7f051c15c530 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f051400efc0 tx=0x7f051400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:29.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0512ffd640 1 -- 172.21.15.28:0/3811544192 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514014480 con 0x7f051c0c60f0 2023-12-16T03:27:29.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0512ffd640 1 -- 172.21.15.28:0/3811544192 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051400f040 con 0x7f051c0c60f0 2023-12-16T03:27:29.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0512ffd640 1 -- 172.21.15.28:0/3811544192 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514014820 con 0x7f051c0c60f0 2023-12-16T03:27:29.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f05245c1640 1 -- 172.21.15.28:0/3811544192 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051c0bad90 con 0x7f051c0c60f0 2023-12-16T03:27:29.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f05245c1640 1 -- 172.21.15.28:0/3811544192 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051c0c4060 con 0x7f051c0c60f0 2023-12-16T03:27:29.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f05245c1640 1 -- 172.21.15.28:0/3811544192 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051c0baf20 con 0x7f051c0c60f0 2023-12-16T03:27:29.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.683+0000 7f0512ffd640 1 -- 172.21.15.28:0/3811544192 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0514014980 con 0x7f051c0c60f0 2023-12-16T03:27:29.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.687+0000 7f0512ffd640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0500066470 0x7f0500068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:29.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.687+0000 7f0512ffd640 1 -- 172.21.15.28:0/3811544192 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0514084c30 con 0x7f051c0c60f0 2023-12-16T03:27:29.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.687+0000 7f052235d640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0500066470 0x7f0500068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:29.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.687+0000 7f052235d640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0500066470 0x7f0500068930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0518007fd0 tx=0x7f0518009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:29.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.691+0000 7f0512ffd640 1 -- 172.21.15.28:0/3811544192 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0514051e90 con 0x7f051c0c60f0 2023-12-16T03:27:29.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 -- 172.21.15.28:0/3811544192 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f051c068400 con 0x7f051c0c60f0 2023-12-16T03:27:29.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f0512ffd640 1 -- 172.21.15.28:0/3811544192 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0514018020 con 0x7f051c0c60f0 2023-12-16T03:27:29.850 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:27:29.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 -- 172.21.15.28:0/3811544192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0500066470 msgr2=0x7f0500068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0500066470 0x7f0500068930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0518007fd0 tx=0x7f0518009040 comp rx=0 tx=0).stop 2023-12-16T03:27:29.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 -- 172.21.15.28:0/3811544192 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f051c0c60f0 msgr2=0x7f051c15c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:29.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f051c0c60f0 0x7f051c15c530 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f051400efc0 tx=0x7f051400c490 comp rx=0 tx=0).stop 2023-12-16T03:27:29.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 -- 172.21.15.28:0/3811544192 shutdown_connections 2023-12-16T03:27:29.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0500066470 0x7f0500068930 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f051c0c60f0 0x7f051c15c530 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f051c0c5640 0x7f051c15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 --2- 172.21.15.28:0/3811544192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f051c0c5260 0x7f051c0c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:29.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 -- 172.21.15.28:0/3811544192 >> 172.21.15.28:0/3811544192 conn(0x7f051c06a5b0 msgr2=0x7f051c06d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:29.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 -- 172.21.15.28:0/3811544192 shutdown_connections 2023-12-16T03:27:29.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:29.847+0000 7f05245c1640 1 -- 172.21.15.28:0/3811544192 wait complete. 2023-12-16T03:27:29.871 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:27:30.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.011+0000 7fc98169c640 1 Processor -- start 2023-12-16T03:27:30.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.011+0000 7fc98169c640 1 -- start start 2023-12-16T03:27:30.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc98169c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c151cd0 0x7fc97c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc98169c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c0c8160 con 0x7fc97c0c7c50 2023-12-16T03:27:30.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc98169c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c157b40 con 0x7fc97c154be0 2023-12-16T03:27:30.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc98169c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c157e20 con 0x7fc97c151cd0 2023-12-16T03:27:30.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc97b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc97c0c7c50 0x7fc97c1544d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40548/0 (socket says 172.21.15.28:40548) 2023-12-16T03:27:30.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc97b7fe640 1 -- 172.21.15.28:0/294079910 learned_addr learned my addr 172.21.15.28:0/294079910 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:30.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc97bfff640 1 --2- 172.21.15.28:0/294079910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c151cd0 0x7fc97c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc97affd640 1 -- 172.21.15.28:0/294079910 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109876290 0 0) 0x7fc97c0c8160 con 0x7fc97c0c7c50 2023-12-16T03:27:30.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc97affd640 1 -- 172.21.15.28:0/294079910 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc964003530 con 0x7fc97c0c7c50 2023-12-16T03:27:30.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc97affd640 1 -- 172.21.15.28:0/294079910 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358737527 0 0) 0x7fc97c157b40 con 0x7fc97c154be0 2023-12-16T03:27:30.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc97affd640 1 -- 172.21.15.28:0/294079910 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc97c0c8160 con 0x7fc97c154be0 2023-12-16T03:27:30.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc97affd640 1 -- 172.21.15.28:0/294079910 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3404688784 0 0) 0x7fc964003530 con 0x7fc97c0c7c50 2023-12-16T03:27:30.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc97bfff640 1 -- 172.21.15.28:0/294079910 >> v1:172.21.15.134:6789/0 conn(0x7fc97c154be0 legacy=0x7fc97c15ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc97bfff640 1 -- 172.21.15.28:0/294079910 >> v1:172.21.15.28:6789/0 conn(0x7fc97c0c7c50 legacy=0x7fc97c1544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.015+0000 7fc97bfff640 1 -- 172.21.15.28:0/294079910 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c158100 con 0x7fc97c151cd0 2023-12-16T03:27:30.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc97bfff640 1 --2- 172.21.15.28:0/294079910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c151cd0 0x7fc97c0ca460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0097f0 tx=0x7fc96c01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54cd83202d82e67b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:30.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc97affd640 1 -- 172.21.15.28:0/294079910 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970001680 con 0x7fc97c151cd0 2023-12-16T03:27:30.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc97affd640 1 -- 172.21.15.28:0/294079910 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c0a7050 con 0x7fc97c151cd0 2023-12-16T03:27:30.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc97affd640 1 -- 172.21.15.28:0/294079910 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c004250 con 0x7fc97c151cd0 2023-12-16T03:27:30.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc98169c640 1 -- 172.21.15.28:0/294079910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c151cd0 msgr2=0x7fc97c0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc98169c640 1 --2- 172.21.15.28:0/294079910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c151cd0 0x7fc97c0ca460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0097f0 tx=0x7fc96c01c3b0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc98169c640 1 -- 172.21.15.28:0/294079910 shutdown_connections 2023-12-16T03:27:30.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc98169c640 1 --2- 172.21.15.28:0/294079910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c151cd0 0x7fc97c0ca460 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc98169c640 1 -- 172.21.15.28:0/294079910 >> 172.21.15.28:0/294079910 conn(0x7fc97c0abee0 msgr2=0x7fc97c0c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:30.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc98169c640 1 -- 172.21.15.28:0/294079910 shutdown_connections 2023-12-16T03:27:30.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc98169c640 1 -- 172.21.15.28:0/294079910 wait complete. 2023-12-16T03:27:30.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc98169c640 1 Processor -- start 2023-12-16T03:27:30.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.019+0000 7fc98169c640 1 -- start start 2023-12-16T03:27:30.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc98169c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc97c0c7c50 0x7fc97c147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc98169c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c151cd0 0x7fc97c143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc98169c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc97c154be0 0x7fc97c14cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc98169c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c145eb0 con 0x7fc97c0c7c50 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc98169c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c1f0f40 con 0x7fc97c154be0 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc98169c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c145860 con 0x7fc97c151cd0 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc97bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc97c0c7c50 0x7fc97c147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc97bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc97c0c7c50 0x7fc97c147580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38830/0 (socket says 172.21.15.28:38830) 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc97bfff640 1 -- 172.21.15.28:0/1316417021 learned_addr learned my addr 172.21.15.28:0/1316417021 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc97b7fe640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c151cd0 0x7fc97c143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc980e9b640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc97c154be0 0x7fc97c14cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc97bfff640 1 -- 172.21.15.28:0/1316417021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c151cd0 msgr2=0x7fc97c143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc97bfff640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c151cd0 0x7fc97c143ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc97bfff640 1 -- 172.21.15.28:0/1316417021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc97c154be0 msgr2=0x7fc97c14cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc97bfff640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc97c154be0 0x7fc97c14cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc97bfff640 1 -- 172.21.15.28:0/1316417021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c009420 con 0x7fc97c0c7c50 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc980e9b640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc97c154be0 0x7fc97c14cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:30.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc97bfff640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc97c0c7c50 0x7fc97c147580 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0097f0 tx=0x7fc96c019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:30.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc978ff9640 1 -- 172.21.15.28:0/1316417021 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c003af0 con 0x7fc97c0c7c50 2023-12-16T03:27:30.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc978ff9640 1 -- 172.21.15.28:0/1316417021 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c003c50 con 0x7fc97c0c7c50 2023-12-16T03:27:30.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc978ff9640 1 -- 172.21.15.28:0/1316417021 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0ab440 con 0x7fc97c0c7c50 2023-12-16T03:27:30.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc98169c640 1 -- 172.21.15.28:0/1316417021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c145b40 con 0x7fc97c0c7c50 2023-12-16T03:27:30.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc98169c640 1 -- 172.21.15.28:0/1316417021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c0c39f0 con 0x7fc97c0c7c50 2023-12-16T03:27:30.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc98169c640 1 -- 172.21.15.28:0/1316417021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c066be0 con 0x7fc97c0c7c50 2023-12-16T03:27:30.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.023+0000 7fc978ff9640 1 -- 172.21.15.28:0/1316417021 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc96c0b2050 con 0x7fc97c0c7c50 2023-12-16T03:27:30.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.027+0000 7fc978ff9640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9680664a0 0x7fc968068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.027+0000 7fc978ff9640 1 -- 172.21.15.28:0/1316417021 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc96c11e540 con 0x7fc97c0c7c50 2023-12-16T03:27:30.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.027+0000 7fc97b7fe640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9680664a0 0x7fc968068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.027+0000 7fc97b7fe640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9680664a0 0x7fc968068960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc97c146800 tx=0x7fc97000f5a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:30.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.031+0000 7fc978ff9640 1 -- 172.21.15.28:0/1316417021 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc96c0eb650 con 0x7fc97c0c7c50 2023-12-16T03:27:30.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 -- 172.21.15.28:0/1316417021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc97c04e850 con 0x7fc97c0c7c50 2023-12-16T03:27:30.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc978ff9640 1 -- 172.21.15.28:0/1316417021 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc96c0eec70 con 0x7fc97c0c7c50 2023-12-16T03:27:30.190 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:27:30.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 -- 172.21.15.28:0/1316417021 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9680664a0 msgr2=0x7fc968068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9680664a0 0x7fc968068960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc97c146800 tx=0x7fc97000f5a0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 -- 172.21.15.28:0/1316417021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc97c0c7c50 msgr2=0x7fc97c147580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc97c0c7c50 0x7fc97c147580 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0097f0 tx=0x7fc96c019150 comp rx=0 tx=0).stop 2023-12-16T03:27:30.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 -- 172.21.15.28:0/1316417021 shutdown_connections 2023-12-16T03:27:30.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc97c154be0 0x7fc97c14cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c151cd0 0x7fc97c143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9680664a0 0x7fc968068960 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 --2- 172.21.15.28:0/1316417021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc97c0c7c50 0x7fc97c147580 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 -- 172.21.15.28:0/1316417021 >> 172.21.15.28:0/1316417021 conn(0x7fc97c0abee0 msgr2=0x7fc97c14fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:30.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 -- 172.21.15.28:0/1316417021 shutdown_connections 2023-12-16T03:27:30.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.187+0000 7fc98169c640 1 -- 172.21.15.28:0/1316417021 wait complete. 2023-12-16T03:27:30.211 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:27:30.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0b6701640 1 Processor -- start 2023-12-16T03:27:30.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0b6701640 1 -- start start 2023-12-16T03:27:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0b6701640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb0b00c5260 0x7fb0b006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0b6701640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b00c2580 con 0x7fb0b00c5640 2023-12-16T03:27:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0b6701640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b0156940 con 0x7fb0b0155de0 2023-12-16T03:27:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0b6701640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b0153510 con 0x7fb0b00c5260 2023-12-16T03:27:30.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0affff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb0b00c5260 0x7fb0b006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0affff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb0b00c5260 0x7fb0b006d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38846/0 (socket says 172.21.15.28:38846) 2023-12-16T03:27:30.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0affff640 1 -- 172.21.15.28:0/4011855146 learned_addr learned my addr 172.21.15.28:0/4011855146 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:30.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0affff640 1 -- 172.21.15.28:0/4011855146 >> v1:172.21.15.134:6789/0 conn(0x7fb0b0155de0 legacy=0x7fb0b0156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:30.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0affff640 1 -- 172.21.15.28:0/4011855146 >> v1:172.21.15.28:6789/0 conn(0x7fb0b00c5640 legacy=0x7fb0b00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0affff640 1 -- 172.21.15.28:0/4011855146 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00c1a00 con 0x7fb0b00c5260 2023-12-16T03:27:30.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.355+0000 7fb0aeffd640 1 -- 172.21.15.28:0/4011855146 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950481357 0 0) 0x7fb0b00c2580 con 0x7fb0b00c5640 2023-12-16T03:27:30.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.359+0000 7fb0affff640 1 --2- 172.21.15.28:0/4011855146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0b00c5260 0x7fb0b006d5b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009870 tx=0x7fb0a001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf80d5b6689d8f97 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:30.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.359+0000 7fb0aeffd640 1 -- 172.21.15.28:0/4011855146 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a00ad660 con 0x7fb0b00c5260 2023-12-16T03:27:30.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.359+0000 7fb0aeffd640 1 -- 172.21.15.28:0/4011855146 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a00ad7c0 con 0x7fb0b00c5260 2023-12-16T03:27:30.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.359+0000 7fb0aeffd640 1 -- 172.21.15.28:0/4011855146 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a00adb50 con 0x7fb0b00c5260 2023-12-16T03:27:30.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.359+0000 7fb0b6701640 1 -- 172.21.15.28:0/4011855146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0b00c5260 msgr2=0x7fb0b006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.359+0000 7fb0b6701640 1 --2- 172.21.15.28:0/4011855146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0b00c5260 0x7fb0b006d5b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009870 tx=0x7fb0a001c470 comp rx=0 tx=0).stop 2023-12-16T03:27:30.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.359+0000 7fb0b6701640 1 -- 172.21.15.28:0/4011855146 shutdown_connections 2023-12-16T03:27:30.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.359+0000 7fb0b6701640 1 --2- 172.21.15.28:0/4011855146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0b00c5260 0x7fb0b006d5b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.359+0000 7fb0b6701640 1 -- 172.21.15.28:0/4011855146 >> 172.21.15.28:0/4011855146 conn(0x7fb0b006a5b0 msgr2=0x7fb0b006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:30.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.359+0000 7fb0b6701640 1 -- 172.21.15.28:0/4011855146 shutdown_connections 2023-12-16T03:27:30.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.359+0000 7fb0b6701640 1 -- 172.21.15.28:0/4011855146 wait complete. 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b6701640 1 Processor -- start 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b6701640 1 -- start start 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b6701640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0b00c5260 0x7fb0b0151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b6701640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0b00c5640 0x7fb0b01505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b6701640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0b0155de0 0x7fb0b014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b6701640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0151ed0 con 0x7fb0b0155de0 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b6701640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0152630 con 0x7fb0b00c5260 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b6701640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0152910 con 0x7fb0b00c5640 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b4c9e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0b0155de0 0x7fb0b014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b4c9e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0b0155de0 0x7fb0b014d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38856/0 (socket says 172.21.15.28:38856) 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b4c9e640 1 -- 172.21.15.28:0/1941099344 learned_addr learned my addr 172.21.15.28:0/1941099344 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0affff640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0b00c5260 0x7fb0b0151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0af7fe640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0b00c5640 0x7fb0b01505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b4c9e640 1 -- 172.21.15.28:0/1941099344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0b00c5640 msgr2=0x7fb0b01505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b4c9e640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0b00c5640 0x7fb0b01505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b4c9e640 1 -- 172.21.15.28:0/1941099344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0b00c5260 msgr2=0x7fb0b0151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b4c9e640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0b00c5260 0x7fb0b0151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b4c9e640 1 -- 172.21.15.28:0/1941099344 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a00094d0 con 0x7fb0b0155de0 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0af7fe640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0b00c5640 0x7fb0b01505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b4c9e640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0b0155de0 0x7fb0b014d550 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c780 tx=0x7fb0a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0acff9640 1 -- 172.21.15.28:0/1941099344 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8004b70 con 0x7fb0b0155de0 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0acff9640 1 -- 172.21.15.28:0/1941099344 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a800ce90 con 0x7fb0b0155de0 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0acff9640 1 -- 172.21.15.28:0/1941099344 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800a850 con 0x7fb0b0155de0 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b6701640 1 -- 172.21.15.28:0/1941099344 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b0152bf0 con 0x7fb0b0155de0 2023-12-16T03:27:30.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b6701640 1 -- 172.21.15.28:0/1941099344 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b0150b10 con 0x7fb0b0155de0 2023-12-16T03:27:30.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.363+0000 7fb0b6701640 1 -- 172.21.15.28:0/1941099344 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b0153110 con 0x7fb0b0155de0 2023-12-16T03:27:30.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.367+0000 7fb0acff9640 1 -- 172.21.15.28:0/1941099344 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb0a800a9b0 con 0x7fb0b0155de0 2023-12-16T03:27:30.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.367+0000 7fb0acff9640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb09c066470 0x7fb09c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.367+0000 7fb0acff9640 1 -- 172.21.15.28:0/1941099344 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb0a8084370 con 0x7fb0b0155de0 2023-12-16T03:27:30.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.367+0000 7fb0affff640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb09c066470 0x7fb09c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.367+0000 7fb0affff640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb09c066470 0x7fb09c068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00af000 tx=0x7fb0a00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:30.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.371+0000 7fb0acff9640 1 -- 172.21.15.28:0/1941099344 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb0b0153110 con 0x7fb0b0155de0 2023-12-16T03:27:30.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 -- 172.21.15.28:0/1941099344 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0b0153110 con 0x7fb0b0155de0 2023-12-16T03:27:30.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0acff9640 1 -- 172.21.15.28:0/1941099344 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7fb0b0153110 con 0x7fb0b0155de0 2023-12-16T03:27:30.533 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:27:30.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 -- 172.21.15.28:0/1941099344 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb09c066470 msgr2=0x7fb09c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb09c066470 0x7fb09c068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00af000 tx=0x7fb0a00a7000 comp rx=0 tx=0).stop 2023-12-16T03:27:30.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 -- 172.21.15.28:0/1941099344 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0b0155de0 msgr2=0x7fb0b014d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0b0155de0 0x7fb0b014d550 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c780 tx=0x7fb0a800cc40 comp rx=0 tx=0).stop 2023-12-16T03:27:30.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 -- 172.21.15.28:0/1941099344 shutdown_connections 2023-12-16T03:27:30.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb09c066470 0x7fb09c068930 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0b0155de0 0x7fb0b014d550 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0b00c5640 0x7fb0b01505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 --2- 172.21.15.28:0/1941099344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0b00c5260 0x7fb0b0151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 -- 172.21.15.28:0/1941099344 >> 172.21.15.28:0/1941099344 conn(0x7fb0b006a5b0 msgr2=0x7fb0b00a65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:30.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 -- 172.21.15.28:0/1941099344 shutdown_connections 2023-12-16T03:27:30.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.531+0000 7fb0b6701640 1 -- 172.21.15.28:0/1941099344 wait complete. 2023-12-16T03:27:30.555 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:27:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.703+0000 7fa33525a640 1 Processor -- start 2023-12-16T03:27:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.703+0000 7fa33525a640 1 -- start start 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.703+0000 7fa33525a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa330072090 0x7fa330150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.703+0000 7fa33525a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa3300725c0 0x7fa3301514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.703+0000 7fa33525a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3300c2760 con 0x7fa3300a5370 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.703+0000 7fa33525a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3300c3070 con 0x7fa3300725c0 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.703+0000 7fa33525a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3300a5750 con 0x7fa330072090 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.703+0000 7fa32ed9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa3300a5370 0x7fa3300c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40558/0 (socket says 172.21.15.28:40558) 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.703+0000 7fa32ed9d640 1 -- 172.21.15.28:0/1448167251 learned_addr learned my addr 172.21.15.28:0/1448167251 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.703+0000 7fa32f59e640 1 --2- 172.21.15.28:0/1448167251 >> v2:172.21.15.28:3300/0 conn(0x7fa3300725c0 0x7fa3301514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.703+0000 7fa327fff640 1 --2- 172.21.15.28:0/1448167251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa330072090 0x7fa330150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa32e59c640 1 -- 172.21.15.28:0/1448167251 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149908090 0 0) 0x7fa3300c2760 con 0x7fa3300a5370 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa32e59c640 1 -- 172.21.15.28:0/1448167251 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa31c003530 con 0x7fa3300a5370 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa32f59e640 1 -- 172.21.15.28:0/1448167251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa330072090 msgr2=0x7fa330150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa32f59e640 1 --2- 172.21.15.28:0/1448167251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa330072090 0x7fa330150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa32f59e640 1 -- 172.21.15.28:0/1448167251 >> v1:172.21.15.28:6789/0 conn(0x7fa3300a5370 legacy=0x7fa3300c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa32f59e640 1 -- 172.21.15.28:0/1448167251 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3300aad20 con 0x7fa3300725c0 2023-12-16T03:27:30.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa32f59e640 1 --2- 172.21.15.28:0/1448167251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3300725c0 0x7fa3301514e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa328009dc0 tx=0x7fa32801c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a70dadc249fdf14 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:30.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa32e59c640 1 -- 172.21.15.28:0/1448167251 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280a5730 con 0x7fa3300725c0 2023-12-16T03:27:30.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa32e59c640 1 -- 172.21.15.28:0/1448167251 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3280a5890 con 0x7fa3300725c0 2023-12-16T03:27:30.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa32e59c640 1 -- 172.21.15.28:0/1448167251 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280a5c20 con 0x7fa3300725c0 2023-12-16T03:27:30.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa33525a640 1 -- 172.21.15.28:0/1448167251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3300725c0 msgr2=0x7fa3301514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.707+0000 7fa33525a640 1 --2- 172.21.15.28:0/1448167251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3300725c0 0x7fa3301514e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa328009dc0 tx=0x7fa32801c7e0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 -- 172.21.15.28:0/1448167251 shutdown_connections 2023-12-16T03:27:30.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 --2- 172.21.15.28:0/1448167251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3300725c0 0x7fa3301514e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 --2- 172.21.15.28:0/1448167251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa330072090 0x7fa330150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 -- 172.21.15.28:0/1448167251 >> 172.21.15.28:0/1448167251 conn(0x7fa33006a5b0 msgr2=0x7fa33006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:30.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 -- 172.21.15.28:0/1448167251 shutdown_connections 2023-12-16T03:27:30.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 -- 172.21.15.28:0/1448167251 wait complete. 2023-12-16T03:27:30.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 Processor -- start 2023-12-16T03:27:30.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 -- start start 2023-12-16T03:27:30.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa330072090 0x7fa33014c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3300725c0 0x7fa3301ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3300a5370 0x7fa3301ed900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33014e970 con 0x7fa3300725c0 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33014e0d0 con 0x7fa3300a5370 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa33525a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33014e3b0 con 0x7fa330072090 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa327fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3300725c0 0x7fa3301ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa327fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3300725c0 0x7fa3301ed3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38882/0 (socket says 172.21.15.28:38882) 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa327fff640 1 -- 172.21.15.28:0/1038743547 learned_addr learned my addr 172.21.15.28:0/1038743547 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa32ed9d640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa330072090 0x7fa33014c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa32f59e640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3300a5370 0x7fa3301ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa327fff640 1 -- 172.21.15.28:0/1038743547 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa330072090 msgr2=0x7fa33014c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa327fff640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa330072090 0x7fa33014c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa327fff640 1 -- 172.21.15.28:0/1038743547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3300a5370 msgr2=0x7fa3301ed900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa327fff640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3300a5370 0x7fa3301ed900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa327fff640 1 -- 172.21.15.28:0/1038743547 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328009a70 con 0x7fa3300725c0 2023-12-16T03:27:30.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.711+0000 7fa327fff640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3300725c0 0x7fa3301ed3c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa31800e870 tx=0x7fa31800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:30.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.715+0000 7fa3277fe640 1 -- 172.21.15.28:0/1038743547 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318009510 con 0x7fa3300725c0 2023-12-16T03:27:30.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.715+0000 7fa3277fe640 1 -- 172.21.15.28:0/1038743547 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800eec0 con 0x7fa3300725c0 2023-12-16T03:27:30.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.715+0000 7fa3277fe640 1 -- 172.21.15.28:0/1038743547 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800cb40 con 0x7fa3300725c0 2023-12-16T03:27:30.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.715+0000 7fa33525a640 1 -- 172.21.15.28:0/1038743547 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33014e690 con 0x7fa3300725c0 2023-12-16T03:27:30.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.715+0000 7fa33525a640 1 -- 172.21.15.28:0/1038743547 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33014c6d0 con 0x7fa3300725c0 2023-12-16T03:27:30.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.715+0000 7fa33525a640 1 -- 172.21.15.28:0/1038743547 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa330068400 con 0x7fa3300725c0 2023-12-16T03:27:30.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.715+0000 7fa3277fe640 1 -- 172.21.15.28:0/1038743547 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa31800cca0 con 0x7fa3300725c0 2023-12-16T03:27:30.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.715+0000 7fa3277fe640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa310066470 0x7fa310068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:30.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.715+0000 7fa3277fe640 1 -- 172.21.15.28:0/1038743547 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa318084320 con 0x7fa3300725c0 2023-12-16T03:27:30.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.715+0000 7fa32ed9d640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa310066470 0x7fa310068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:30.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.715+0000 7fa32ed9d640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa310066470 0x7fa310068930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa3200011f0 tx=0x7fa320009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:30.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.719+0000 7fa3277fe640 1 -- 172.21.15.28:0/1038743547 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa318051430 con 0x7fa3300725c0 2023-12-16T03:27:30.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.875+0000 7fa33525a640 1 -- 172.21.15.28:0/1038743547 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa3300aa730 con 0x7fa3300725c0 2023-12-16T03:27:30.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa3277fe640 1 -- 172.21.15.28:0/1038743547 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa318054a50 con 0x7fa3300725c0 2023-12-16T03:27:30.881 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:27:30.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 -- 172.21.15.28:0/1038743547 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa310066470 msgr2=0x7fa310068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa310066470 0x7fa310068930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa3200011f0 tx=0x7fa320009040 comp rx=0 tx=0).stop 2023-12-16T03:27:30.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 -- 172.21.15.28:0/1038743547 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3300725c0 msgr2=0x7fa3301ed3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:30.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3300725c0 0x7fa3301ed3c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa31800e870 tx=0x7fa31800ec70 comp rx=0 tx=0).stop 2023-12-16T03:27:30.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 -- 172.21.15.28:0/1038743547 shutdown_connections 2023-12-16T03:27:30.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3300a5370 0x7fa3301ed900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa310066470 0x7fa310068930 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3300725c0 0x7fa3301ed3c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 --2- 172.21.15.28:0/1038743547 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa330072090 0x7fa33014c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:30.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 -- 172.21.15.28:0/1038743547 >> 172.21.15.28:0/1038743547 conn(0x7fa33006a5b0 msgr2=0x7fa33014d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:30.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 -- 172.21.15.28:0/1038743547 shutdown_connections 2023-12-16T03:27:30.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:30.879+0000 7fa33525a640 1 -- 172.21.15.28:0/1038743547 wait complete. 2023-12-16T03:27:30.903 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:27:31.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.043+0000 7fb6fc565640 1 Processor -- start 2023-12-16T03:27:31.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.043+0000 7fb6fc565640 1 -- start start 2023-12-16T03:27:31.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.043+0000 7fb6fc565640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6f40c4100 0x7fb6f40c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.043+0000 7fb6fc565640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb6f40c06d0 0x7fb6f40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.043+0000 7fb6fc565640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f40c31c0 con 0x7fb6f40c63c0 2023-12-16T03:27:31.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.043+0000 7fb6fc565640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f40c34a0 con 0x7fb6f40c06d0 2023-12-16T03:27:31.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.043+0000 7fb6fc565640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40c1030 con 0x7fb6f40c4100 2023-12-16T03:27:31.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6fa301640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb6f40c63c0 0x7fb6f40c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40560/0 (socket says 172.21.15.28:40560) 2023-12-16T03:27:31.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6fa301640 1 -- 172.21.15.28:0/1689424790 learned_addr learned my addr 172.21.15.28:0/1689424790 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:31.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6f9b00640 1 --2- 172.21.15.28:0/1689424790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6f40c4100 0x7fb6f40c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6fab02640 1 --2- 172.21.15.28:0/1689424790 >> v2:172.21.15.134:3300/0 conn(0x7fb6f40c06d0 0x7fb6f40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6f92ff640 1 -- 172.21.15.28:0/1689424790 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081748816 0 0) 0x7fb6f40c31c0 con 0x7fb6f40c63c0 2023-12-16T03:27:31.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6f92ff640 1 -- 172.21.15.28:0/1689424790 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e0003530 con 0x7fb6f40c63c0 2023-12-16T03:27:31.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6f9b00640 1 -- 172.21.15.28:0/1689424790 >> v2:172.21.15.134:3300/0 conn(0x7fb6f40c06d0 msgr2=0x7fb6f40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:31.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6f9b00640 1 --2- 172.21.15.28:0/1689424790 >> v2:172.21.15.134:3300/0 conn(0x7fb6f40c06d0 0x7fb6f40a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6f9b00640 1 -- 172.21.15.28:0/1689424790 >> v1:172.21.15.28:6789/0 conn(0x7fb6f40c63c0 legacy=0x7fb6f40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6f92ff640 1 -- 172.21.15.28:0/1689424790 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939218349 0 0) 0x7fb6e0003530 con 0x7fb6f40c63c0 2023-12-16T03:27:31.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6f9b00640 1 -- 172.21.15.28:0/1689424790 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40c1310 con 0x7fb6f40c4100 2023-12-16T03:27:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.047+0000 7fb6f9b00640 1 --2- 172.21.15.28:0/1689424790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6f40c4100 0x7fb6f40c2bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40097c0 tx=0x7fb6e401c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=171a21250c83dd0b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6f92ff640 1 -- 172.21.15.28:0/1689424790 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f40aa3d0 con 0x7fb6f40c4100 2023-12-16T03:27:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6f92ff640 1 -- 172.21.15.28:0/1689424790 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e40a7050 con 0x7fb6f40c4100 2023-12-16T03:27:31.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6f92ff640 1 -- 172.21.15.28:0/1689424790 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0001680 con 0x7fb6f40c4100 2023-12-16T03:27:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 -- 172.21.15.28:0/1689424790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6f40c4100 msgr2=0x7fb6f40c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 --2- 172.21.15.28:0/1689424790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6f40c4100 0x7fb6f40c2bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40097c0 tx=0x7fb6e401c280 comp rx=0 tx=0).stop 2023-12-16T03:27:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 -- 172.21.15.28:0/1689424790 shutdown_connections 2023-12-16T03:27:31.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 --2- 172.21.15.28:0/1689424790 >> v2:172.21.15.134:3300/0 conn(0x7fb6f40c06d0 0x7fb6f40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 --2- 172.21.15.28:0/1689424790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6f40c4100 0x7fb6f40c2bb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 -- 172.21.15.28:0/1689424790 >> 172.21.15.28:0/1689424790 conn(0x7fb6f406a5b0 msgr2=0x7fb6f406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:31.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 -- 172.21.15.28:0/1689424790 shutdown_connections 2023-12-16T03:27:31.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 -- 172.21.15.28:0/1689424790 wait complete. 2023-12-16T03:27:31.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 Processor -- start 2023-12-16T03:27:31.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 -- start start 2023-12-16T03:27:31.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f40c06d0 0x7fb6f40bd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6f40c4100 0x7fb6f415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6f40c63c0 0x7fb6f40bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40be6d0 con 0x7fb6f40c4100 2023-12-16T03:27:31.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40be3f0 con 0x7fb6f40c06d0 2023-12-16T03:27:31.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6fc565640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f41ec800 con 0x7fb6f40c63c0 2023-12-16T03:27:31.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6f9b00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6f40c4100 0x7fb6f415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.051+0000 7fb6f9b00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6f40c4100 0x7fb6f415a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38888/0 (socket says 172.21.15.28:38888) 2023-12-16T03:27:31.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6f9b00640 1 -- 172.21.15.28:0/1037211189 learned_addr learned my addr 172.21.15.28:0/1037211189 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:31.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6fa301640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f40c06d0 0x7fb6f40bd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6fab02640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6f40c63c0 0x7fb6f40bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6f9b00640 1 -- 172.21.15.28:0/1037211189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6f40c63c0 msgr2=0x7fb6f40bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6f9b00640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6f40c63c0 0x7fb6f40bbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6f9b00640 1 -- 172.21.15.28:0/1037211189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f40c06d0 msgr2=0x7fb6f40bd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6f9b00640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f40c06d0 0x7fb6f40bd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6f9b00640 1 -- 172.21.15.28:0/1037211189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e4009420 con 0x7fb6f40c4100 2023-12-16T03:27:31.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6f9b00640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6f40c4100 0x7fb6f415a1c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40ae040 tx=0x7fb6e401aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:31.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6eaffd640 1 -- 172.21.15.28:0/1037211189 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40b7450 con 0x7fb6f40c4100 2023-12-16T03:27:31.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6eaffd640 1 -- 172.21.15.28:0/1037211189 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e40b75d0 con 0x7fb6f40c4100 2023-12-16T03:27:31.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6eaffd640 1 -- 172.21.15.28:0/1037211189 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40b7980 con 0x7fb6f40c4100 2023-12-16T03:27:31.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6fc565640 1 -- 172.21.15.28:0/1037211189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f41ecae0 con 0x7fb6f40c4100 2023-12-16T03:27:31.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6fc565640 1 -- 172.21.15.28:0/1037211189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f40bdf20 con 0x7fb6f40c4100 2023-12-16T03:27:31.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6fc565640 1 -- 172.21.15.28:0/1037211189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f41ec660 con 0x7fb6f40c4100 2023-12-16T03:27:31.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6eaffd640 1 -- 172.21.15.28:0/1037211189 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb6e40b7ae0 con 0x7fb6f40c4100 2023-12-16T03:27:31.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.055+0000 7fb6eaffd640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb6d8066470 0x7fb6d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.059+0000 7fb6eaffd640 1 -- 172.21.15.28:0/1037211189 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb6e411e910 con 0x7fb6f40c4100 2023-12-16T03:27:31.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.059+0000 7fb6fa301640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb6d8066470 0x7fb6d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.059+0000 7fb6fa301640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb6d8066470 0x7fb6d8068930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00017b0 tx=0x7fb6f00015c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:31.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.063+0000 7fb6eaffd640 1 -- 172.21.15.28:0/1037211189 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb6f41ec660 con 0x7fb6f40c4100 2023-12-16T03:27:31.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.227+0000 7fb6fc565640 1 -- 172.21.15.28:0/1037211189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb6f41ec660 con 0x7fb6f40c4100 2023-12-16T03:27:31.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6eaffd640 1 -- 172.21.15.28:0/1037211189 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb6f41ec660 con 0x7fb6f40c4100 2023-12-16T03:27:31.233 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:27:31.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 -- 172.21.15.28:0/1037211189 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb6d8066470 msgr2=0x7fb6d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb6d8066470 0x7fb6d8068930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb6f00017b0 tx=0x7fb6f00015c0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 -- 172.21.15.28:0/1037211189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6f40c4100 msgr2=0x7fb6f415a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6f40c4100 0x7fb6f415a1c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40ae040 tx=0x7fb6e401aac0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 -- 172.21.15.28:0/1037211189 shutdown_connections 2023-12-16T03:27:31.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb6f40c63c0 0x7fb6f40bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb6d8066470 0x7fb6d8068930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6f40c4100 0x7fb6f415a1c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 --2- 172.21.15.28:0/1037211189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6f40c06d0 0x7fb6f40bd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 -- 172.21.15.28:0/1037211189 >> 172.21.15.28:0/1037211189 conn(0x7fb6f406a5b0 msgr2=0x7fb6f406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:31.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 -- 172.21.15.28:0/1037211189 shutdown_connections 2023-12-16T03:27:31.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.231+0000 7fb6fc565640 1 -- 172.21.15.28:0/1037211189 wait complete. 2023-12-16T03:27:31.254 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-16T03:27:31.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:31.255 DEBUG:teuthology.orchestra.run.smithi028:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-16T03:27:31.283 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:27:31.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:31.283 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-16T03:27:31.334 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:27:31.334 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:31.385 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7208 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-16T03:27:31.386 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:27:31.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfff65640 1 Processor -- start 2023-12-16T03:27:31.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfff65640 1 -- start start 2023-12-16T03:27:31.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfff65640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4cf806bbb0 0x7f4cf81600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfff65640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf806c860 con 0x7f4cf80c7ea0 2023-12-16T03:27:31.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfff65640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf806c000 con 0x7f4cf8151e90 2023-12-16T03:27:31.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfff65640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf80c8750 con 0x7f4cf806bbb0 2023-12-16T03:27:31.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfd500640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4cf80c7ea0 0x7f4cf806b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40576/0 (socket says 172.21.15.28:40576) 2023-12-16T03:27:31.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfd500640 1 -- 172.21.15.28:0/637472592 learned_addr learned my addr 172.21.15.28:0/637472592 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:31.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfe502640 1 --2- 172.21.15.28:0/637472592 >> v2:172.21.15.134:3300/0 conn(0x7f4cf806bbb0 0x7f4cf81600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106538758 0 0) 0x7f4cf806c860 con 0x7f4cf80c7ea0 2023-12-16T03:27:31.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce4003530 con 0x7f4cf80c7ea0 2023-12-16T03:27:31.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3568757399 0 0) 0x7f4ce4003530 con 0x7f4cf80c7ea0 2023-12-16T03:27:31.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 >> v2:172.21.15.134:3300/0 conn(0x7f4cf806bbb0 msgr2=0x7f4cf81600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:31.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfccff640 1 --2- 172.21.15.28:0/637472592 >> v2:172.21.15.134:3300/0 conn(0x7f4cf806bbb0 0x7f4cf81600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.571+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 >> v1:172.21.15.134:6789/0 conn(0x7f4cf8151e90 legacy=0x7f4cf80c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8154930 con 0x7f4cf80c7ea0 2023-12-16T03:27:31.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f4ce8001680 con 0x7f4cf80c7ea0 2023-12-16T03:27:31.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 >> v1:172.21.15.28:6789/0 conn(0x7f4cf80c7ea0 legacy=0x7f4cf806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce4003980 0x7f4ce4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 0x7f4ce4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce4005190 0x7f4ce400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf80c8750 con 0x7f4ce40047d0 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce400c0e0 con 0x7f4ce4005190 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce400c2a0 con 0x7f4ce4003980 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfd500640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 0x7f4ce4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfe502640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce4005190 0x7f4ce400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfdd01640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce4003980 0x7f4ce4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfd500640 1 -- 172.21.15.28:0/637472592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce4003980 msgr2=0x7f4ce4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfd500640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ce4003980 0x7f4ce4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfd500640 1 -- 172.21.15.28:0/637472592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce4005190 msgr2=0x7f4ce400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfd500640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce4005190 0x7f4ce400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfd500640 1 -- 172.21.15.28:0/637472592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4003530 con 0x7f4ce40047d0 2023-12-16T03:27:31.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfe502640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce4005190 0x7f4ce400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:31.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfe502640 1 -- 172.21.15.28:0/637472592 reap_dead start 2023-12-16T03:27:31.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfd500640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 0x7f4ce4004c50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800c210 tx=0x7f4ce801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60b4d39e7cccf48 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:31.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80058e0 con 0x7f4ce40047d0 2023-12-16T03:27:31.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8005a60 con 0x7f4ce40047d0 2023-12-16T03:27:31.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.575+0000 7f4cfccff640 1 -- 172.21.15.28:0/637472592 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8005e50 con 0x7f4ce40047d0 2023-12-16T03:27:31.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 -- 172.21.15.28:0/637472592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 msgr2=0x7f4ce4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 0x7f4ce4004c50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800c210 tx=0x7f4ce801cc00 comp rx=0 tx=0).stop 2023-12-16T03:27:31.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 -- 172.21.15.28:0/637472592 shutdown_connections 2023-12-16T03:27:31.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 --2- 172.21.15.28:0/637472592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 0x7f4ce4004c50 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 -- 172.21.15.28:0/637472592 >> 172.21.15.28:0/637472592 conn(0x7f4cf80ca170 msgr2=0x7f4cf80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:31.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 -- 172.21.15.28:0/637472592 shutdown_connections 2023-12-16T03:27:31.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 -- 172.21.15.28:0/637472592 wait complete. 2023-12-16T03:27:31.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 Processor -- start 2023-12-16T03:27:31.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 -- start start 2023-12-16T03:27:31.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 0x7f4cf814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4cf81ed880 0x7f4cf80c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cf81f0c90 0x7f4cf81e9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf81552d0 con 0x7f4ce40047d0 2023-12-16T03:27:31.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf81f0870 con 0x7f4cf81f0c90 2023-12-16T03:27:31.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfff65640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf814f460 con 0x7f4cf81ed880 2023-12-16T03:27:31.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfdd01640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 0x7f4cf814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfdd01640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 0x7f4cf814c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38904/0 (socket says 172.21.15.28:38904) 2023-12-16T03:27:31.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfdd01640 1 -- 172.21.15.28:0/2085012810 learned_addr learned my addr 172.21.15.28:0/2085012810 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:31.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfe502640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cf81f0c90 0x7f4cf81e9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfd500640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4cf81ed880 0x7f4cf80c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfdd01640 1 -- 172.21.15.28:0/2085012810 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4cf81ed880 msgr2=0x7f4cf80c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfdd01640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4cf81ed880 0x7f4cf80c3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfdd01640 1 -- 172.21.15.28:0/2085012810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cf81f0c90 msgr2=0x7f4cf81e9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfdd01640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cf81f0c90 0x7f4cf81e9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfdd01640 1 -- 172.21.15.28:0/2085012810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf814eea0 con 0x7f4ce40047d0 2023-12-16T03:27:31.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfd500640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4cf81ed880 0x7f4cf80c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:31.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.579+0000 7f4cfe502640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cf81f0c90 0x7f4cf81e9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:31.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.583+0000 7f4cfdd01640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 0x7f4cf814c4e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400e550 tx=0x7f4cf400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:31.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.583+0000 7f4cee7fc640 1 -- 172.21.15.28:0/2085012810 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40052e0 con 0x7f4ce40047d0 2023-12-16T03:27:31.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.583+0000 7f4cee7fc640 1 -- 172.21.15.28:0/2085012810 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4005460 con 0x7f4ce40047d0 2023-12-16T03:27:31.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.583+0000 7f4cee7fc640 1 -- 172.21.15.28:0/2085012810 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4003840 con 0x7f4ce40047d0 2023-12-16T03:27:31.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.583+0000 7f4cfff65640 1 -- 172.21.15.28:0/2085012810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf814f180 con 0x7f4ce40047d0 2023-12-16T03:27:31.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.583+0000 7f4cfff65640 1 -- 172.21.15.28:0/2085012810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf814aa40 con 0x7f4ce40047d0 2023-12-16T03:27:31.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.583+0000 7f4cfff65640 1 -- 172.21.15.28:0/2085012810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf8068400 con 0x7f4ce40047d0 2023-12-16T03:27:31.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.583+0000 7f4cee7fc640 1 -- 172.21.15.28:0/2085012810 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4cf40039a0 con 0x7f4ce40047d0 2023-12-16T03:27:31.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.583+0000 7f4cee7fc640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4cdc066470 0x7f4cdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:31.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.583+0000 7f4cee7fc640 1 -- 172.21.15.28:0/2085012810 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4cf4083f90 con 0x7f4ce40047d0 2023-12-16T03:27:31.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.583+0000 7f4cfd500640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4cdc066470 0x7f4cdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:31.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.587+0000 7f4cfd500640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4cdc066470 0x7f4cdc068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80ab000 tx=0x7f4ce80a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:31.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.587+0000 7f4cee7fc640 1 -- 172.21.15.28:0/2085012810 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4cf40b5290 con 0x7f4ce40047d0 2023-12-16T03:27:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.783+0000 7f4cfff65640 1 -- 172.21.15.28:0/2085012810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4cf80ca5f0 con 0x7f4ce40047d0 2023-12-16T03:27:31.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.783+0000 7f4cee7fc640 1 -- 172.21.15.28:0/2085012810 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+149 (secure 0 0 0) 0x7f4cf4051170 con 0x7f4ce40047d0 2023-12-16T03:27:31.788 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:27:31.788 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-16T03:27:31.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 -- 172.21.15.28:0/2085012810 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4cdc066470 msgr2=0x7f4cdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4cdc066470 0x7f4cdc068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80ab000 tx=0x7f4ce80a7070 comp rx=0 tx=0).stop 2023-12-16T03:27:31.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 -- 172.21.15.28:0/2085012810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 msgr2=0x7f4cf814c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:31.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 0x7f4cf814c4e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400e550 tx=0x7f4cf400ea10 comp rx=0 tx=0).stop 2023-12-16T03:27:31.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 -- 172.21.15.28:0/2085012810 shutdown_connections 2023-12-16T03:27:31.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cf81f0c90 0x7f4cf81e9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4cf81ed880 0x7f4cf80c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4cdc066470 0x7f4cdc068930 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 --2- 172.21.15.28:0/2085012810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ce40047d0 0x7f4cf814c4e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:31.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 -- 172.21.15.28:0/2085012810 >> 172.21.15.28:0/2085012810 conn(0x7f4cf80ca170 msgr2=0x7f4cf8150020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:31.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 -- 172.21.15.28:0/2085012810 shutdown_connections 2023-12-16T03:27:31.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:31.787+0000 7f4cfff65640 1 -- 172.21.15.28:0/2085012810 wait complete. 2023-12-16T03:27:31.809 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-16T03:27:31.809 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:27:31.810 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2023-12-16T03:27:31.810 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-16T03:27:31.810 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T03:27:31.810 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-16T03:27:31.810 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:27:31.810 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.RcLg5tiJMp 2023-12-16T03:27:31.810 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2023-12-16T03:27:31.820 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.kLddMqsToL 2023-12-16T03:27:31.820 DEBUG:teuthology.orchestra.run.smithi028:> sudo cp /tmp/tmp.RcLg5tiJMp /tmp/tmp.kLddMqsToL 2023-12-16T03:27:31.885 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.kLddMqsToL 2023-12-16T03:27:32.006 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.kLddMqsToL is 245B 2023-12-16T03:27:32.024 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.kLddMqsToL 2023-12-16T03:27:32.034 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAgGX1lNrO2DBAATx/zd0pwltJi3o+CyyJKeQ== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-16T03:27:32.034 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:27:32.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:32.034 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2023-12-16T03:27:32.089 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:27:32.089 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:27:32.089 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:27:32.089 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:32.089 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42254sec preferred_lft 42254sec 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2023-12-16T03:27:32.090 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:9f:0c:41:28 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:27:32.091 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:32.092 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:27:32.092 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T03:27:32.092 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:27:32.092 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:27:32.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:32.093 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:27:32.160 INFO:teuthology.orchestra.run.smithi028.stdout:1 2023-12-16T03:27:32.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:32.162 DEBUG:teuthology.orchestra.run.smithi028:> route 2023-12-16T03:27:32.215 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2023-12-16T03:27:32.215 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:27:32.215 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-16T03:27:32.215 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:27:32.215 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-16T03:27:32.215 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:27:32.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:32.215 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec bash -c ' 2023-12-16T03:27:32.215 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2023-12-16T03:27:32.215 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-16T03:27:32.216 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-16T03:27:32.216 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-16T03:27:32.216 DEBUG:teuthology.orchestra.run.smithi028:> ') 2023-12-16T03:27:32.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:32.314 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2023-12-16T03:27:32.323 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T03:27:32.324 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:27:32.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:32.324 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2023-12-16T03:27:32.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:27:32.386 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T03:27:32.437 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:27:32.437 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:27:32.437 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:27:32.489 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:27:32.489 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/tmp/tmp.RcLg5tiJMp of=/dev/stdout 2023-12-16T03:27:32.541 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-16T03:27:32.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:32.541 DEBUG:teuthology.orchestra.run.smithi028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQAgGX1lNrO2DBAATx/zd0pwltJi3o+CyyJKeQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:32.640 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,secret=AQAgGX1lNrO2DBAATx/zd0pwltJi3o+CyyJKeQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:32.640 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:27:32.640 INFO:teuthology.orchestra.run.smithi028.stdout:keyring.get_secret failed 2023-12-16T03:27:32.651 INFO:teuthology.orchestra.run.smithi028.stderr:mount.ceph: kernel BUG! 2023-12-16T03:27:32.651 INFO:teuthology.orchestra.run.smithi028.stderr:mount error 13 = Permission denied 2023-12-16T03:27:32.652 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,secret=AQAgGX1lNrO2DBAATx/zd0pwltJi3o+CyyJKeQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:27:32.652 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:27:32.652 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:27:32.652 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: trying mount with new device syntax: testuser@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs2=/ 2023-12-16T03:27:32.652 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:27:32.655 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-16T03:27:32.656 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-16T03:27:32.656 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-16T03:27:32.656 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:27:32.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:27:32.776 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-16T03:27:32.776 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:27:32.776 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:32.785 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7208 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-16T03:27:32.785 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:27:32.785 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:32.829 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:27:32.830 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:32.881 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:33.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.019+0000 7f6a0351d640 1 Processor -- start 2023-12-16T03:27:33.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.019+0000 7f6a0351d640 1 -- start start 2023-12-16T03:27:33.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f6a0351d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 0x7f69fc0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f6a0351d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc0c31c0 con 0x7f69fc0c4100 2023-12-16T03:27:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f6a0351d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc0c34a0 con 0x7f69fc0c63c0 2023-12-16T03:27:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f6a0351d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0c1030 con 0x7f69fc0c2bb0 2023-12-16T03:27:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f6a00ab8640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f69fc0c4100 0x7f69fc0a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40586/0 (socket says 172.21.15.28:40586) 2023-12-16T03:27:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f6a00ab8640 1 -- 172.21.15.28:0/2878006045 learned_addr learned my addr 172.21.15.28:0/2878006045 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:33.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f6a01aba640 1 --2- 172.21.15.28:0/2878006045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 0x7f69fc0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f69f3fff640 1 -- 172.21.15.28:0/2878006045 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515352087 0 0) 0x7f69fc0c31c0 con 0x7f69fc0c4100 2023-12-16T03:27:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f69f3fff640 1 -- 172.21.15.28:0/2878006045 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e8003530 con 0x7f69fc0c4100 2023-12-16T03:27:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f69f3fff640 1 -- 172.21.15.28:0/2878006045 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446250199 0 0) 0x7f69fc0c34a0 con 0x7f69fc0c63c0 2023-12-16T03:27:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f69f3fff640 1 -- 172.21.15.28:0/2878006045 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69fc0c31c0 con 0x7f69fc0c63c0 2023-12-16T03:27:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f69f3fff640 1 -- 172.21.15.28:0/2878006045 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548910384 0 0) 0x7f69e8003530 con 0x7f69fc0c4100 2023-12-16T03:27:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f6a01aba640 1 -- 172.21.15.28:0/2878006045 >> v1:172.21.15.134:6789/0 conn(0x7f69fc0c63c0 legacy=0x7f69fc0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f6a01aba640 1 -- 172.21.15.28:0/2878006045 >> v1:172.21.15.28:6789/0 conn(0x7f69fc0c4100 legacy=0x7f69fc0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.023+0000 7f6a01aba640 1 -- 172.21.15.28:0/2878006045 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0c1310 con 0x7f69fc0c2bb0 2023-12-16T03:27:33.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f6a01aba640 1 --2- 172.21.15.28:0/2878006045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 0x7f69fc0c06d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009dc0 tx=0x7f69f401c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e95eff68922c0f39 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:33.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f69f3fff640 1 -- 172.21.15.28:0/2878006045 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec001680 con 0x7f69fc0c2bb0 2023-12-16T03:27:33.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f69f3fff640 1 -- 172.21.15.28:0/2878006045 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f40a64b0 con 0x7f69fc0c2bb0 2023-12-16T03:27:33.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f69f3fff640 1 -- 172.21.15.28:0/2878006045 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f40a6840 con 0x7f69fc0c2bb0 2023-12-16T03:27:33.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f6a0351d640 1 -- 172.21.15.28:0/2878006045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 msgr2=0x7f69fc0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f6a0351d640 1 --2- 172.21.15.28:0/2878006045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 0x7f69fc0c06d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009dc0 tx=0x7f69f401c740 comp rx=0 tx=0).stop 2023-12-16T03:27:33.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f6a0351d640 1 -- 172.21.15.28:0/2878006045 shutdown_connections 2023-12-16T03:27:33.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f6a0351d640 1 --2- 172.21.15.28:0/2878006045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 0x7f69fc0c06d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f6a0351d640 1 -- 172.21.15.28:0/2878006045 >> 172.21.15.28:0/2878006045 conn(0x7f69fc06a5b0 msgr2=0x7f69fc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:33.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f6a0351d640 1 -- 172.21.15.28:0/2878006045 shutdown_connections 2023-12-16T03:27:33.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f6a0351d640 1 -- 172.21.15.28:0/2878006045 wait complete. 2023-12-16T03:27:33.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f6a0351d640 1 Processor -- start 2023-12-16T03:27:33.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.027+0000 7f6a0351d640 1 -- start start 2023-12-16T03:27:33.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a0351d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 0x7f69fc0a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a0351d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f69fc0c4100 0x7f69fc1ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a0351d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69fc0c63c0 0x7f69fc1ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a0351d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc15b630 con 0x7f69fc0c4100 2023-12-16T03:27:33.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a0351d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc1f15b0 con 0x7f69fc0c63c0 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a0351d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc1edc20 con 0x7f69fc0c2bb0 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a00ab8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f69fc0c4100 0x7f69fc1ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a00ab8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f69fc0c4100 0x7f69fc1ed1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38912/0 (socket says 172.21.15.28:38912) 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a00ab8640 1 -- 172.21.15.28:0/1403530358 learned_addr learned my addr 172.21.15.28:0/1403530358 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a012b9640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 0x7f69fc0a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a01aba640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69fc0c63c0 0x7f69fc1ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a00ab8640 1 -- 172.21.15.28:0/1403530358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 msgr2=0x7f69fc0a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a00ab8640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 0x7f69fc0a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a00ab8640 1 -- 172.21.15.28:0/1403530358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69fc0c63c0 msgr2=0x7f69fc1ed6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a00ab8640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69fc0c63c0 0x7f69fc1ed6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a00ab8640 1 -- 172.21.15.28:0/1403530358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009a70 con 0x7f69fc0c4100 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a012b9640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 0x7f69fc0a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a00ab8640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f69fc0c4100 0x7f69fc1ed1a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00c750 tx=0x7f69ec00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:33.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f69f1ffb640 1 -- 172.21.15.28:0/1403530358 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec005af0 con 0x7f69fc0c4100 2023-12-16T03:27:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f69f1ffb640 1 -- 172.21.15.28:0/1403530358 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec005c50 con 0x7f69fc0c4100 2023-12-16T03:27:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f69f1ffb640 1 -- 172.21.15.28:0/1403530358 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec007070 con 0x7f69fc0c4100 2023-12-16T03:27:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a0351d640 1 -- 172.21.15.28:0/1403530358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc09a400 con 0x7f69fc0c4100 2023-12-16T03:27:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a0351d640 1 -- 172.21.15.28:0/1403530358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc15b880 con 0x7f69fc0c4100 2023-12-16T03:27:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f6a0351d640 1 -- 172.21.15.28:0/1403530358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc15baa0 con 0x7f69fc0c4100 2023-12-16T03:27:33.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.031+0000 7f69f1ffb640 1 -- 172.21.15.28:0/1403530358 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f69ec0071d0 con 0x7f69fc0c4100 2023-12-16T03:27:33.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.035+0000 7f69f1ffb640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f69e0066470 0x7f69e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.035+0000 7f69f1ffb640 1 -- 172.21.15.28:0/1403530358 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f69ec083fa0 con 0x7f69fc0c4100 2023-12-16T03:27:33.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.035+0000 7f6a012b9640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f69e0066470 0x7f69e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.035+0000 7f6a012b9640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f69e0066470 0x7f69e0068930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f69f80011f0 tx=0x7f69f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:33.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.039+0000 7f69f1ffb640 1 -- 172.21.15.28:0/1403530358 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f69ec0510b0 con 0x7f69fc0c4100 2023-12-16T03:27:33.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.195+0000 7f6a0351d640 1 -- 172.21.15.28:0/1403530358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69fc068400 con 0x7f69fc0c4100 2023-12-16T03:27:33.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f69f1ffb640 1 -- 172.21.15.28:0/1403530358 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20280 (secure 0 0 0) 0x7f69ec0546d0 con 0x7f69fc0c4100 2023-12-16T03:27:33.202 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:33.202 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":54,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:15.600556+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:33.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 -- 172.21.15.28:0/1403530358 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f69e0066470 msgr2=0x7f69e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f69e0066470 0x7f69e0068930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f69f80011f0 tx=0x7f69f8009040 comp rx=0 tx=0).stop 2023-12-16T03:27:33.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 -- 172.21.15.28:0/1403530358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f69fc0c4100 msgr2=0x7f69fc1ed1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f69fc0c4100 0x7f69fc1ed1a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00c750 tx=0x7f69ec00cc10 comp rx=0 tx=0).stop 2023-12-16T03:27:33.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 -- 172.21.15.28:0/1403530358 shutdown_connections 2023-12-16T03:27:33.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69fc0c63c0 0x7f69fc1ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f69e0066470 0x7f69e0068930 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f69fc0c4100 0x7f69fc1ed1a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 --2- 172.21.15.28:0/1403530358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69fc0c2bb0 0x7f69fc0a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 -- 172.21.15.28:0/1403530358 >> 172.21.15.28:0/1403530358 conn(0x7f69fc06a5b0 msgr2=0x7f69fc0c2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:33.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 -- 172.21.15.28:0/1403530358 shutdown_connections 2023-12-16T03:27:33.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.199+0000 7f6a0351d640 1 -- 172.21.15.28:0/1403530358 wait complete. 2023-12-16T03:27:33.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:26:58.698173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:26:59.897067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:27:12.042891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:27:12.972488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:27:33.223 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:27:33.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfd1d0f640 1 Processor -- start 2023-12-16T03:27:33.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfd1d0f640 1 -- start start 2023-12-16T03:27:33.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfd1d0f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc151dc0 0x7fdfcc0c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfd1d0f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdfcc0bd660 0x7fdfcc154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfd1d0f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc0ac4f0 con 0x7fdfcc0c7ed0 2023-12-16T03:27:33.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfd1d0f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc158780 con 0x7fdfcc0bd660 2023-12-16T03:27:33.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfd1d0f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc158a60 con 0x7fdfcc151dc0 2023-12-16T03:27:33.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfcbfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdfcc0bd660 0x7fdfcc154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfcb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc151dc0 0x7fdfcc0c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfcaffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fdfcc0c7ed0 0x7fdfcc154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:38116/0 (socket says 172.21.15.28:38116) 2023-12-16T03:27:33.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfcb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc151dc0 0x7fdfcc0c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:46620/0 (socket says 172.21.15.28:46620) 2023-12-16T03:27:33.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfcbfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdfcc0bd660 0x7fdfcc154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:38228/0 (socket says 172.21.15.28:38228) 2023-12-16T03:27:33.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfcaffd640 1 -- 172.21.15.28:0/130035315 learned_addr learned my addr 172.21.15.28:0/130035315 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:33.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfcb7fe640 1 -- 172.21.15.28:0/130035315 >> v2:172.21.15.134:3300/0 conn(0x7fdfcc0bd660 msgr2=0x7fdfcc154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:33.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfcb7fe640 1 --2- 172.21.15.28:0/130035315 >> v2:172.21.15.134:3300/0 conn(0x7fdfcc0bd660 0x7fdfcc154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfcb7fe640 1 -- 172.21.15.28:0/130035315 >> v1:172.21.15.134:6789/0 conn(0x7fdfcc0c7ed0 legacy=0x7fdfcc154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfcb7fe640 1 -- 172.21.15.28:0/130035315 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0ac180 con 0x7fdfcc151dc0 2023-12-16T03:27:33.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfcbfff640 1 --2- 172.21.15.28:0/130035315 >> v2:172.21.15.134:3300/0 conn(0x7fdfcc0bd660 0x7fdfcc154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:33.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.367+0000 7fdfca7fc640 1 -- 172.21.15.28:0/130035315 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001167903 0 0) 0x7fdfcc0ac4f0 con 0x7fdfcc0c7ed0 2023-12-16T03:27:33.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfcb7fe640 1 --2- 172.21.15.28:0/130035315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc151dc0 0x7fdfcc0c4950 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0097c0 tx=0x7fdfbc01c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f0d3588bc39034b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:33.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfca7fc640 1 -- 172.21.15.28:0/130035315 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0ab600 con 0x7fdfcc151dc0 2023-12-16T03:27:33.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfca7fc640 1 -- 172.21.15.28:0/130035315 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0a7050 con 0x7fdfcc151dc0 2023-12-16T03:27:33.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfca7fc640 1 -- 172.21.15.28:0/130035315 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0ab980 con 0x7fdfcc151dc0 2023-12-16T03:27:33.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/130035315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc151dc0 msgr2=0x7fdfcc0c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfd1d0f640 1 --2- 172.21.15.28:0/130035315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc151dc0 0x7fdfcc0c4950 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0097c0 tx=0x7fdfbc01c360 comp rx=0 tx=0).stop 2023-12-16T03:27:33.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/130035315 shutdown_connections 2023-12-16T03:27:33.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfd1d0f640 1 --2- 172.21.15.28:0/130035315 >> v2:172.21.15.134:3300/0 conn(0x7fdfcc0bd660 0x7fdfcc154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfd1d0f640 1 --2- 172.21.15.28:0/130035315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc151dc0 0x7fdfcc0c4950 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/130035315 >> 172.21.15.28:0/130035315 conn(0x7fdfcc071eb0 msgr2=0x7fdfcc0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:33.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/130035315 shutdown_connections 2023-12-16T03:27:33.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.371+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/130035315 wait complete. 2023-12-16T03:27:33.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfd1d0f640 1 Processor -- start 2023-12-16T03:27:33.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfd1d0f640 1 -- start start 2023-12-16T03:27:33.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfd1d0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfcc0bd660 0x7fdfcc0c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfd1d0f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc0c7ed0 0x7fdfcc14ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfd1d0f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfcc151dc0 0x7fdfcc1f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfd1d0f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0bf8d0 con 0x7fdfcc151dc0 2023-12-16T03:27:33.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfd1d0f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc1f0420 con 0x7fdfcc0bd660 2023-12-16T03:27:33.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfd1d0f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0c4110 con 0x7fdfcc0c7ed0 2023-12-16T03:27:33.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfcbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfcc151dc0 0x7fdfcc1f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfcbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfcc151dc0 0x7fdfcc1f0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38928/0 (socket says 172.21.15.28:38928) 2023-12-16T03:27:33.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfcbfff640 1 -- 172.21.15.28:0/2763510256 learned_addr learned my addr 172.21.15.28:0/2763510256 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:33.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfcb7fe640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfcc0bd660 0x7fdfcc0c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfcaffd640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc0c7ed0 0x7fdfcc14ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfcbfff640 1 -- 172.21.15.28:0/2763510256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc0c7ed0 msgr2=0x7fdfcc14ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfcbfff640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc0c7ed0 0x7fdfcc14ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfcbfff640 1 -- 172.21.15.28:0/2763510256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfcc0bd660 msgr2=0x7fdfcc0c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfcbfff640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfcc0bd660 0x7fdfcc0c03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfcbfff640 1 -- 172.21.15.28:0/2763510256 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4009a70 con 0x7fdfcc151dc0 2023-12-16T03:27:33.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfcbfff640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfcc151dc0 0x7fdfcc1f0870 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400efb0 tx=0x7fdfc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:33.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfb3fff640 1 -- 172.21.15.28:0/2763510256 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4014480 con 0x7fdfcc151dc0 2023-12-16T03:27:33.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfb3fff640 1 -- 172.21.15.28:0/2763510256 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc400f040 con 0x7fdfcc151dc0 2023-12-16T03:27:33.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfb3fff640 1 -- 172.21.15.28:0/2763510256 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4014800 con 0x7fdfcc151dc0 2023-12-16T03:27:33.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.375+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/2763510256 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc009420 con 0x7fdfcc151dc0 2023-12-16T03:27:33.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.379+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/2763510256 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc0be9d0 con 0x7fdfcc151dc0 2023-12-16T03:27:33.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.379+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/2763510256 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc1f0590 con 0x7fdfcc151dc0 2023-12-16T03:27:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.379+0000 7fdfb3fff640 1 -- 172.21.15.28:0/2763510256 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdfc4014960 con 0x7fdfcc151dc0 2023-12-16T03:27:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.379+0000 7fdfb3fff640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfb8066470 0x7fdfb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.379+0000 7fdfb3fff640 1 -- 172.21.15.28:0/2763510256 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdfc4084fe0 con 0x7fdfcc151dc0 2023-12-16T03:27:33.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.379+0000 7fdfcb7fe640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfb8066470 0x7fdfb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.379+0000 7fdfcb7fe640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfb8066470 0x7fdfb8068930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0ad000 tx=0x7fdfbc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:33.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.383+0000 7fdfb3fff640 1 -- 172.21.15.28:0/2763510256 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdfcc1f0590 con 0x7fdfcc151dc0 2023-12-16T03:27:33.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.547+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/2763510256 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdfcc1f0590 con 0x7fdfcc151dc0 2023-12-16T03:27:33.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.547+0000 7fdfb3fff640 1 -- 172.21.15.28:0/2763510256 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdfc4018020 con 0x7fdfcc151dc0 2023-12-16T03:27:33.551 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:27:33.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.547+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/2763510256 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfb8066470 msgr2=0x7fdfb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.547+0000 7fdfd1d0f640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfb8066470 0x7fdfb8068930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0ad000 tx=0x7fdfbc0a6000 comp rx=0 tx=0).stop 2023-12-16T03:27:33.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.547+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/2763510256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfcc151dc0 msgr2=0x7fdfcc1f0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.547+0000 7fdfd1d0f640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfcc151dc0 0x7fdfcc1f0870 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400efb0 tx=0x7fdfc400c490 comp rx=0 tx=0).stop 2023-12-16T03:27:33.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.551+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/2763510256 shutdown_connections 2023-12-16T03:27:33.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.551+0000 7fdfd1d0f640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdfb8066470 0x7fdfb8068930 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.551+0000 7fdfd1d0f640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfcc151dc0 0x7fdfcc1f0870 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.551+0000 7fdfd1d0f640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfcc0c7ed0 0x7fdfcc14ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.551+0000 7fdfd1d0f640 1 --2- 172.21.15.28:0/2763510256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfcc0bd660 0x7fdfcc0c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.551+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/2763510256 >> 172.21.15.28:0/2763510256 conn(0x7fdfcc071eb0 msgr2=0x7fdfcc1547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:33.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.551+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/2763510256 shutdown_connections 2023-12-16T03:27:33.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.551+0000 7fdfd1d0f640 1 -- 172.21.15.28:0/2763510256 wait complete. 2023-12-16T03:27:33.572 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:27:33.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca7572640 1 Processor -- start 2023-12-16T03:27:33.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca7572640 1 -- start start 2023-12-16T03:27:33.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca7572640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ca00c4100 0x7f6ca00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca7572640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6ca00c06d0 0x7f6ca00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca7572640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca00c31c0 con 0x7f6ca00c63c0 2023-12-16T03:27:33.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca7572640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca00c34a0 con 0x7f6ca00c06d0 2023-12-16T03:27:33.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca7572640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00c1030 con 0x7f6ca00c4100 2023-12-16T03:27:33.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca530e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6ca00c63c0 0x7f6ca00c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40600/0 (socket says 172.21.15.28:40600) 2023-12-16T03:27:33.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca530e640 1 -- 172.21.15.28:0/1043673971 learned_addr learned my addr 172.21.15.28:0/1043673971 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:33.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca5b0f640 1 --2- 172.21.15.28:0/1043673971 >> v2:172.21.15.28:3300/0 conn(0x7f6ca00c06d0 0x7f6ca00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca4b0d640 1 --2- 172.21.15.28:0/1043673971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ca00c4100 0x7f6ca00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca5b0f640 1 -- 172.21.15.28:0/1043673971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ca00c4100 msgr2=0x7f6ca00c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:33.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca5b0f640 1 --2- 172.21.15.28:0/1043673971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ca00c4100 0x7f6ca00c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca5b0f640 1 -- 172.21.15.28:0/1043673971 >> v1:172.21.15.28:6789/0 conn(0x7f6ca00c63c0 legacy=0x7f6ca00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca5b0f640 1 -- 172.21.15.28:0/1043673971 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00c1310 con 0x7f6ca00c06d0 2023-12-16T03:27:33.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6c97fff640 1 -- 172.21.15.28:0/1043673971 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222482820 0 0) 0x7f6ca00c31c0 con 0x7f6ca00c63c0 2023-12-16T03:27:33.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.715+0000 7f6ca4b0d640 1 --2- 172.21.15.28:0/1043673971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ca00c4100 0x7f6ca00c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:33.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6ca5b0f640 1 --2- 172.21.15.28:0/1043673971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ca00c06d0 0x7f6ca00a9680 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009d90 tx=0x7f6c9801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1f4cf7656fa703 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:33.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6c97fff640 1 -- 172.21.15.28:0/1043673971 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca00aa3d0 con 0x7f6ca00c06d0 2023-12-16T03:27:33.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6c97fff640 1 -- 172.21.15.28:0/1043673971 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c980a5800 con 0x7f6ca00c06d0 2023-12-16T03:27:33.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6c97fff640 1 -- 172.21.15.28:0/1043673971 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c980a5b90 con 0x7f6ca00c06d0 2023-12-16T03:27:33.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6ca7572640 1 -- 172.21.15.28:0/1043673971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ca00c06d0 msgr2=0x7f6ca00a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6ca7572640 1 --2- 172.21.15.28:0/1043673971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ca00c06d0 0x7f6ca00a9680 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009d90 tx=0x7f6c9801c830 comp rx=0 tx=0).stop 2023-12-16T03:27:33.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6ca7572640 1 -- 172.21.15.28:0/1043673971 shutdown_connections 2023-12-16T03:27:33.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6ca7572640 1 --2- 172.21.15.28:0/1043673971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ca00c06d0 0x7f6ca00a9680 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6ca7572640 1 --2- 172.21.15.28:0/1043673971 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ca00c4100 0x7f6ca00c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6ca7572640 1 -- 172.21.15.28:0/1043673971 >> 172.21.15.28:0/1043673971 conn(0x7f6ca006a5b0 msgr2=0x7f6ca006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:33.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6ca7572640 1 -- 172.21.15.28:0/1043673971 shutdown_connections 2023-12-16T03:27:33.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.719+0000 7f6ca7572640 1 -- 172.21.15.28:0/1043673971 wait complete. 2023-12-16T03:27:33.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca7572640 1 Processor -- start 2023-12-16T03:27:33.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca7572640 1 -- start start 2023-12-16T03:27:33.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca7572640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ca00c06d0 0x7f6ca0157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca7572640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ca00c4100 0x7f6ca01575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca7572640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca00c63c0 0x7f6ca0155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca7572640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca014e160 con 0x7f6ca00c06d0 2023-12-16T03:27:33.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca7572640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0157ec0 con 0x7f6ca00c63c0 2023-12-16T03:27:33.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca7572640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca014f4b0 con 0x7f6ca00c4100 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca530e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ca00c06d0 0x7f6ca0157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca530e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ca00c06d0 0x7f6ca0157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38938/0 (socket says 172.21.15.28:38938) 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca530e640 1 -- 172.21.15.28:0/1219709614 learned_addr learned my addr 172.21.15.28:0/1219709614 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca530e640 1 -- 172.21.15.28:0/1219709614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ca00c4100 msgr2=0x7f6ca01575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca530e640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ca00c4100 0x7f6ca01575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca530e640 1 -- 172.21.15.28:0/1219709614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca00c63c0 msgr2=0x7f6ca0155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca530e640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca00c63c0 0x7f6ca0155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca530e640 1 -- 172.21.15.28:0/1219709614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c98009a70 con 0x7f6ca00c06d0 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca530e640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ca00c06d0 0x7f6ca0157070 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c480 tx=0x7f6c9c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6c95ffb640 1 -- 172.21.15.28:0/1219709614 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c0074e0 con 0x7f6ca00c06d0 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6c95ffb640 1 -- 172.21.15.28:0/1219709614 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c007660 con 0x7f6ca00c06d0 2023-12-16T03:27:33.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6c95ffb640 1 -- 172.21.15.28:0/1219709614 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c004a30 con 0x7f6ca00c06d0 2023-12-16T03:27:33.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca7572640 1 -- 172.21.15.28:0/1219709614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca0157be0 con 0x7f6ca00c06d0 2023-12-16T03:27:33.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca7572640 1 -- 172.21.15.28:0/1219709614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca014f140 con 0x7f6ca00c06d0 2023-12-16T03:27:33.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.723+0000 7f6ca7572640 1 -- 172.21.15.28:0/1219709614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca0068400 con 0x7f6ca00c06d0 2023-12-16T03:27:33.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.727+0000 7f6c95ffb640 1 -- 172.21.15.28:0/1219709614 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6c9c004b90 con 0x7f6ca00c06d0 2023-12-16T03:27:33.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.727+0000 7f6c95ffb640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c84066470 0x7f6c84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:33.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.727+0000 7f6c95ffb640 1 -- 172.21.15.28:0/1219709614 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6c9c0833e0 con 0x7f6ca00c06d0 2023-12-16T03:27:33.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.727+0000 7f6ca4b0d640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c84066470 0x7f6c84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:33.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.727+0000 7f6ca4b0d640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c84066470 0x7f6c84068930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6ca01e8680 tx=0x7f6c90008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:33.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.731+0000 7f6c95ffb640 1 -- 172.21.15.28:0/1219709614 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6c9c0504f0 con 0x7f6ca00c06d0 2023-12-16T03:27:33.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.887+0000 7f6ca7572640 1 -- 172.21.15.28:0/1219709614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ca00c3e70 con 0x7f6ca00c06d0 2023-12-16T03:27:33.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.887+0000 7f6c95ffb640 1 -- 172.21.15.28:0/1219709614 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c9c053b10 con 0x7f6ca00c06d0 2023-12-16T03:27:33.892 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 -- 172.21.15.28:0/1219709614 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c84066470 msgr2=0x7f6c84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c84066470 0x7f6c84068930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6ca01e8680 tx=0x7f6c90008040 comp rx=0 tx=0).stop 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 -- 172.21.15.28:0/1219709614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ca00c06d0 msgr2=0x7f6ca0157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ca00c06d0 0x7f6ca0157070 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c00c480 tx=0x7f6c9c00c940 comp rx=0 tx=0).stop 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 -- 172.21.15.28:0/1219709614 shutdown_connections 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca00c63c0 0x7f6ca0155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ca00c4100 0x7f6ca01575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6c84066470 0x7f6c84068930 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 --2- 172.21.15.28:0/1219709614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ca00c06d0 0x7f6ca0157070 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 -- 172.21.15.28:0/1219709614 >> 172.21.15.28:0/1219709614 conn(0x7f6ca006a5b0 msgr2=0x7f6ca006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 -- 172.21.15.28:0/1219709614 shutdown_connections 2023-12-16T03:27:33.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:33.891+0000 7f6ca7572640 1 -- 172.21.15.28:0/1219709614 wait complete. 2023-12-16T03:27:33.913 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:27:34.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f7a6b640 1 Processor -- start 2023-12-16T03:27:34.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f7a6b640 1 -- start start 2023-12-16T03:27:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f7a6b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1f00c63c0 0x7fa1f00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f7a6b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa1f00c4100 0x7fa1f00c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f7a6b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00c31c0 con 0x7fa1f00c29e0 2023-12-16T03:27:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f7a6b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f00c34a0 con 0x7fa1f00c4100 2023-12-16T03:27:34.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f7a6b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00c1030 con 0x7fa1f00c63c0 2023-12-16T03:27:34.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f5006640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa1f00c4100 0x7fa1f00c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f6008640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa1f00c29e0 0x7fa1f00a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:38120/0 (socket says 172.21.15.28:38120) 2023-12-16T03:27:34.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f6008640 1 -- 172.21.15.28:0/2641243800 learned_addr learned my addr 172.21.15.28:0/2641243800 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:34.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f5807640 1 --2- 172.21.15.28:0/2641243800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1f00c63c0 0x7fa1f00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f4805640 1 -- 172.21.15.28:0/2641243800 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940068812 0 0) 0x7fa1f00c31c0 con 0x7fa1f00c29e0 2023-12-16T03:27:34.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f4805640 1 -- 172.21.15.28:0/2641243800 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1dc003530 con 0x7fa1f00c29e0 2023-12-16T03:27:34.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f5006640 1 -- 172.21.15.28:0/2641243800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1f00c63c0 msgr2=0x7fa1f00c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:34.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f5006640 1 --2- 172.21.15.28:0/2641243800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1f00c63c0 0x7fa1f00c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f5006640 1 -- 172.21.15.28:0/2641243800 >> v1:172.21.15.134:6789/0 conn(0x7fa1f00c29e0 legacy=0x7fa1f00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.055+0000 7fa1f5006640 1 -- 172.21.15.28:0/2641243800 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00c1310 con 0x7fa1f00c4100 2023-12-16T03:27:34.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f5807640 1 --2- 172.21.15.28:0/2641243800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1f00c63c0 0x7fa1f00c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:34.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f5006640 1 --2- 172.21.15.28:0/2641243800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f00c4100 0x7fa1f00c24a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00097c0 tx=0x7fa1e001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fae0a3caf8c40d27 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:34.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f4805640 1 -- 172.21.15.28:0/2641243800 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00ab600 con 0x7fa1f00c4100 2023-12-16T03:27:34.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f4805640 1 -- 172.21.15.28:0/2641243800 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e00a7050 con 0x7fa1f00c4100 2023-12-16T03:27:34.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f4805640 1 -- 172.21.15.28:0/2641243800 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00ab960 con 0x7fa1f00c4100 2023-12-16T03:27:34.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/2641243800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f00c4100 msgr2=0x7fa1f00c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f7a6b640 1 --2- 172.21.15.28:0/2641243800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f00c4100 0x7fa1f00c24a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00097c0 tx=0x7fa1e001c330 comp rx=0 tx=0).stop 2023-12-16T03:27:34.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/2641243800 shutdown_connections 2023-12-16T03:27:34.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f7a6b640 1 --2- 172.21.15.28:0/2641243800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f00c4100 0x7fa1f00c24a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f7a6b640 1 --2- 172.21.15.28:0/2641243800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1f00c63c0 0x7fa1f00c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/2641243800 >> 172.21.15.28:0/2641243800 conn(0x7fa1f006a5b0 msgr2=0x7fa1f006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:34.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/2641243800 shutdown_connections 2023-12-16T03:27:34.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.059+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/2641243800 wait complete. 2023-12-16T03:27:34.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f7a6b640 1 Processor -- start 2023-12-16T03:27:34.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f7a6b640 1 -- start start 2023-12-16T03:27:34.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f7a6b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1f00c29e0 0x7fa1f015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f7a6b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f00c4100 0x7fa1f00bcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f7a6b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1f00c63c0 0x7fa1f00bd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f7a6b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00be6e0 con 0x7fa1f00c29e0 2023-12-16T03:27:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f7a6b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00a4d70 con 0x7fa1f00c4100 2023-12-16T03:27:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f7a6b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00bf6d0 con 0x7fa1f00c63c0 2023-12-16T03:27:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f5807640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1f00c29e0 0x7fa1f015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f5807640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1f00c29e0 0x7fa1f015a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38948/0 (socket says 172.21.15.28:38948) 2023-12-16T03:27:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f5807640 1 -- 172.21.15.28:0/3017104469 learned_addr learned my addr 172.21.15.28:0/3017104469 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f5006640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f00c4100 0x7fa1f00bcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f6008640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1f00c63c0 0x7fa1f00bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f5807640 1 -- 172.21.15.28:0/3017104469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1f00c63c0 msgr2=0x7fa1f00bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f5807640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1f00c63c0 0x7fa1f00bd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f5807640 1 -- 172.21.15.28:0/3017104469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f00c4100 msgr2=0x7fa1f00bcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f5807640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f00c4100 0x7fa1f00bcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f5807640 1 -- 172.21.15.28:0/3017104469 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec00ba70 con 0x7fa1f00c29e0 2023-12-16T03:27:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f5807640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1f00c29e0 0x7fa1f015a1f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0089e0 tx=0x7fa1ec009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1e67fc640 1 -- 172.21.15.28:0/3017104469 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec010040 con 0x7fa1f00c29e0 2023-12-16T03:27:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1e67fc640 1 -- 172.21.15.28:0/3017104469 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec004230 con 0x7fa1f00c29e0 2023-12-16T03:27:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/3017104469 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e0009420 con 0x7fa1f00c29e0 2023-12-16T03:27:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.063+0000 7fa1e67fc640 1 -- 172.21.15.28:0/3017104469 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec009e10 con 0x7fa1f00c29e0 2023-12-16T03:27:34.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.067+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/3017104469 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f0071c90 con 0x7fa1f00c29e0 2023-12-16T03:27:34.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.067+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/3017104469 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f00a52b0 con 0x7fa1f00c29e0 2023-12-16T03:27:34.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.067+0000 7fa1e67fc640 1 -- 172.21.15.28:0/3017104469 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa1ec003620 con 0x7fa1f00c29e0 2023-12-16T03:27:34.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.067+0000 7fa1e67fc640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa1d4066470 0x7fa1d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.067+0000 7fa1e67fc640 1 -- 172.21.15.28:0/3017104469 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa1ec0843b0 con 0x7fa1f00c29e0 2023-12-16T03:27:34.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.067+0000 7fa1f5006640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa1d4066470 0x7fa1d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.067+0000 7fa1f5006640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa1d4066470 0x7fa1d4068930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00ad000 tx=0x7fa1e00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:34.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.071+0000 7fa1e67fc640 1 -- 172.21.15.28:0/3017104469 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa1ec051570 con 0x7fa1f00c29e0 2023-12-16T03:27:34.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.227+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/3017104469 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1f0068400 con 0x7fa1f00c29e0 2023-12-16T03:27:34.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.227+0000 7fa1e67fc640 1 -- 172.21.15.28:0/3017104469 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa1ec01b020 con 0x7fa1f00c29e0 2023-12-16T03:27:34.232 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:27:34.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/3017104469 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa1d4066470 msgr2=0x7fa1d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa1d4066470 0x7fa1d4068930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00ad000 tx=0x7fa1e00a6000 comp rx=0 tx=0).stop 2023-12-16T03:27:34.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/3017104469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1f00c29e0 msgr2=0x7fa1f015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1f00c29e0 0x7fa1f015a1f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0089e0 tx=0x7fa1ec009700 comp rx=0 tx=0).stop 2023-12-16T03:27:34.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/3017104469 shutdown_connections 2023-12-16T03:27:34.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa1f00c63c0 0x7fa1f00bd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f00c4100 0x7fa1f00bcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa1d4066470 0x7fa1d4068930 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 --2- 172.21.15.28:0/3017104469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa1f00c29e0 0x7fa1f015a1f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/3017104469 >> 172.21.15.28:0/3017104469 conn(0x7fa1f006a5b0 msgr2=0x7fa1f00a5790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:34.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/3017104469 shutdown_connections 2023-12-16T03:27:34.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.231+0000 7fa1f7a6b640 1 -- 172.21.15.28:0/3017104469 wait complete. 2023-12-16T03:27:34.253 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:27:34.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.395+0000 7f4c79e09640 1 Processor -- start 2023-12-16T03:27:34.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.395+0000 7f4c79e09640 1 -- start start 2023-12-16T03:27:34.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.395+0000 7f4c79e09640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c740c63c0 0x7f4c740c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c79e09640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4c740c2bb0 0x7f4c740a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c79e09640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c740c31c0 con 0x7f4c740c4100 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c79e09640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c740c34a0 con 0x7f4c740c2bb0 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c79e09640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740c1030 con 0x7f4c740c63c0 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c73fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4c740c2bb0 0x7f4c740a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c72ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4c740c4100 0x7f4c740c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40612/0 (socket says 172.21.15.28:40612) 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c73fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4c740c2bb0 0x7f4c740a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38950/0 (socket says 172.21.15.28:38950) 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c72ffd640 1 -- 172.21.15.28:0/1681696893 learned_addr learned my addr 172.21.15.28:0/1681696893 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c737fe640 1 --2- 172.21.15.28:0/1681696893 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c740c63c0 0x7f4c740c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c73fff640 1 -- 172.21.15.28:0/1681696893 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c740c63c0 msgr2=0x7f4c740c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c73fff640 1 --2- 172.21.15.28:0/1681696893 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c740c63c0 0x7f4c740c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c73fff640 1 -- 172.21.15.28:0/1681696893 >> v1:172.21.15.28:6789/0 conn(0x7f4c740c4100 legacy=0x7f4c740c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c73fff640 1 -- 172.21.15.28:0/1681696893 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c740c1310 con 0x7f4c740c2bb0 2023-12-16T03:27:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c73fff640 1 --2- 172.21.15.28:0/1681696893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c740c2bb0 0x7f4c740a9680 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009d90 tx=0x7f4c6c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8ac41622764c10 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:34.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c727fc640 1 -- 172.21.15.28:0/1681696893 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c740aa3d0 con 0x7f4c740c2bb0 2023-12-16T03:27:34.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c727fc640 1 -- 172.21.15.28:0/1681696893 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c0a58e0 con 0x7f4c740c2bb0 2023-12-16T03:27:34.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.399+0000 7f4c727fc640 1 -- 172.21.15.28:0/1681696893 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0a5c70 con 0x7f4c740c2bb0 2023-12-16T03:27:34.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 -- 172.21.15.28:0/1681696893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c740c2bb0 msgr2=0x7f4c740a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 --2- 172.21.15.28:0/1681696893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c740c2bb0 0x7f4c740a9680 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009d90 tx=0x7f4c6c01c800 comp rx=0 tx=0).stop 2023-12-16T03:27:34.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 -- 172.21.15.28:0/1681696893 shutdown_connections 2023-12-16T03:27:34.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 --2- 172.21.15.28:0/1681696893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c740c2bb0 0x7f4c740a9680 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 --2- 172.21.15.28:0/1681696893 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c740c63c0 0x7f4c740c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 -- 172.21.15.28:0/1681696893 >> 172.21.15.28:0/1681696893 conn(0x7f4c7406a5b0 msgr2=0x7f4c7406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:34.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 -- 172.21.15.28:0/1681696893 shutdown_connections 2023-12-16T03:27:34.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 -- 172.21.15.28:0/1681696893 wait complete. 2023-12-16T03:27:34.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 Processor -- start 2023-12-16T03:27:34.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 -- start start 2023-12-16T03:27:34.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c740c2bb0 0x7f4c74070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c740c4100 0x7f4c7414dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c740c63c0 0x7f4c7414e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c74158ab0 con 0x7f4c740c4100 2023-12-16T03:27:34.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c74159140 con 0x7f4c740c2bb0 2023-12-16T03:27:34.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c79e09640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c74155570 con 0x7f4c740c63c0 2023-12-16T03:27:34.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c72ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c740c4100 0x7f4c7414dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c72ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c740c4100 0x7f4c7414dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38960/0 (socket says 172.21.15.28:38960) 2023-12-16T03:27:34.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c72ffd640 1 -- 172.21.15.28:0/2402750053 learned_addr learned my addr 172.21.15.28:0/2402750053 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:34.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.403+0000 7f4c73fff640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c740c63c0 0x7f4c7414e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c737fe640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c740c2bb0 0x7f4c74070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c72ffd640 1 -- 172.21.15.28:0/2402750053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c740c63c0 msgr2=0x7f4c7414e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c72ffd640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c740c63c0 0x7f4c7414e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c72ffd640 1 -- 172.21.15.28:0/2402750053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c740c2bb0 msgr2=0x7f4c74070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c72ffd640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c740c2bb0 0x7f4c74070d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c72ffd640 1 -- 172.21.15.28:0/2402750053 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c009a70 con 0x7f4c740c4100 2023-12-16T03:27:34.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c737fe640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c740c2bb0 0x7f4c74070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:34.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c72ffd640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c740c4100 0x7f4c7414dd70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800c500 tx=0x7f4c6800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c5bfff640 1 -- 172.21.15.28:0/2402750053 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68005cf0 con 0x7f4c740c4100 2023-12-16T03:27:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c5bfff640 1 -- 172.21.15.28:0/2402750053 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c68005e50 con 0x7f4c740c4100 2023-12-16T03:27:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c5bfff640 1 -- 172.21.15.28:0/2402750053 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c680072f0 con 0x7f4c740c4100 2023-12-16T03:27:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c79e09640 1 -- 172.21.15.28:0/2402750053 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c74155850 con 0x7f4c740c4100 2023-12-16T03:27:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c79e09640 1 -- 172.21.15.28:0/2402750053 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c741ecb00 con 0x7f4c740c4100 2023-12-16T03:27:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c79e09640 1 -- 172.21.15.28:0/2402750053 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c74159310 con 0x7f4c740c4100 2023-12-16T03:27:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.407+0000 7f4c5bfff640 1 -- 172.21.15.28:0/2402750053 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4c68007450 con 0x7f4c740c4100 2023-12-16T03:27:34.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.411+0000 7f4c5bfff640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c60066470 0x7f4c60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.411+0000 7f4c5bfff640 1 -- 172.21.15.28:0/2402750053 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4c680836b0 con 0x7f4c740c4100 2023-12-16T03:27:34.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.411+0000 7f4c737fe640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c60066470 0x7f4c60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.411+0000 7f4c737fe640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c60066470 0x7f4c60068930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4c640097a0 tx=0x7f4c64008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:34.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.415+0000 7f4c5bfff640 1 -- 172.21.15.28:0/2402750053 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4c74159310 con 0x7f4c740c4100 2023-12-16T03:27:34.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 -- 172.21.15.28:0/2402750053 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c74159310 con 0x7f4c740c4100 2023-12-16T03:27:34.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c5bfff640 1 -- 172.21.15.28:0/2402750053 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4c74159310 con 0x7f4c740c4100 2023-12-16T03:27:34.573 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:27:34.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 -- 172.21.15.28:0/2402750053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c60066470 msgr2=0x7f4c60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c60066470 0x7f4c60068930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4c640097a0 tx=0x7f4c64008040 comp rx=0 tx=0).stop 2023-12-16T03:27:34.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 -- 172.21.15.28:0/2402750053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c740c4100 msgr2=0x7f4c7414dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c740c4100 0x7f4c7414dd70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800c500 tx=0x7f4c6800c9c0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 -- 172.21.15.28:0/2402750053 shutdown_connections 2023-12-16T03:27:34.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c740c63c0 0x7f4c7414e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c60066470 0x7f4c60068930 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c740c4100 0x7f4c7414dd70 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 --2- 172.21.15.28:0/2402750053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c740c2bb0 0x7f4c74070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 -- 172.21.15.28:0/2402750053 >> 172.21.15.28:0/2402750053 conn(0x7f4c7406a5b0 msgr2=0x7f4c7415b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:34.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 -- 172.21.15.28:0/2402750053 shutdown_connections 2023-12-16T03:27:34.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.571+0000 7f4c79e09640 1 -- 172.21.15.28:0/2402750053 wait complete. 2023-12-16T03:27:34.594 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:27:34.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df7f1d640 1 Processor -- start 2023-12-16T03:27:34.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df7f1d640 1 -- start start 2023-12-16T03:27:34.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df7f1d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6df014b010 0x7f6df00bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df7f1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0157c20 0x7f6df01580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df7f1d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df006a5b0 con 0x7f6df0073a70 2023-12-16T03:27:34.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df7f1d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df006b710 con 0x7f6df014b010 2023-12-16T03:27:34.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df7f1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00c1d60 con 0x7f6df0157c20 2023-12-16T03:27:34.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df5cb9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6df014b010 0x7f6df00bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df5cb9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6df014b010 0x7f6df00bf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38972/0 (socket says 172.21.15.28:38972) 2023-12-16T03:27:34.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df5cb9640 1 -- 172.21.15.28:0/1805010461 learned_addr learned my addr 172.21.15.28:0/1805010461 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:34.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df64ba640 1 --2- 172.21.15.28:0/1805010461 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0157c20 0x7f6df01580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df5cb9640 1 -- 172.21.15.28:0/1805010461 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0157c20 msgr2=0x7f6df01580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:34.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df5cb9640 1 --2- 172.21.15.28:0/1805010461 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0157c20 0x7f6df01580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df5cb9640 1 -- 172.21.15.28:0/1805010461 >> v1:172.21.15.134:6789/0 conn(0x7f6df0073a70 legacy=0x7f6df006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.739+0000 7f6df5cb9640 1 -- 172.21.15.28:0/1805010461 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df00c2040 con 0x7f6df014b010 2023-12-16T03:27:34.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df5cb9640 1 --2- 172.21.15.28:0/1805010461 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df014b010 0x7f6df00bf9f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009870 tx=0x7f6dec01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39a639f6b9e3006 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:34.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df4cb7640 1 -- 172.21.15.28:0/1805010461 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0a8a30 con 0x7f6df014b010 2023-12-16T03:27:34.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df4cb7640 1 -- 172.21.15.28:0/1805010461 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec0a8b90 con 0x7f6df014b010 2023-12-16T03:27:34.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df4cb7640 1 -- 172.21.15.28:0/1805010461 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0b0440 con 0x7f6df014b010 2023-12-16T03:27:34.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1805010461 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df014b010 msgr2=0x7f6df00bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df7f1d640 1 --2- 172.21.15.28:0/1805010461 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df014b010 0x7f6df00bf9f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009870 tx=0x7f6dec01ed30 comp rx=0 tx=0).stop 2023-12-16T03:27:34.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1805010461 shutdown_connections 2023-12-16T03:27:34.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df7f1d640 1 --2- 172.21.15.28:0/1805010461 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0157c20 0x7f6df01580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df7f1d640 1 --2- 172.21.15.28:0/1805010461 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df014b010 0x7f6df00bf9f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1805010461 >> 172.21.15.28:0/1805010461 conn(0x7f6df00c30c0 msgr2=0x7f6df00c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:34.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1805010461 shutdown_connections 2023-12-16T03:27:34.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.743+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1805010461 wait complete. 2023-12-16T03:27:34.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df7f1d640 1 Processor -- start 2023-12-16T03:27:34.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df7f1d640 1 -- start start 2023-12-16T03:27:34.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df7f1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0073a70 0x7f6df0156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df7f1d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df014b010 0x7f6df01e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df7f1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df0157c20 0x7f6df01e7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df7f1d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00c5dd0 con 0x7f6df014b010 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df7f1d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00c5af0 con 0x7f6df0157c20 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df7f1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df01ede30 con 0x7f6df0073a70 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df54b8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df014b010 0x7f6df01e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df54b8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df014b010 0x7f6df01e6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38986/0 (socket says 172.21.15.28:38986) 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df54b8640 1 -- 172.21.15.28:0/1369347058 learned_addr learned my addr 172.21.15.28:0/1369347058 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df64ba640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df0157c20 0x7f6df01e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df5cb9640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0073a70 0x7f6df0156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df54b8640 1 -- 172.21.15.28:0/1369347058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0073a70 msgr2=0x7f6df0156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df54b8640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0073a70 0x7f6df0156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df54b8640 1 -- 172.21.15.28:0/1369347058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df0157c20 msgr2=0x7f6df01e7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df54b8640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df0157c20 0x7f6df01e7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df54b8640 1 -- 172.21.15.28:0/1369347058 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec0094d0 con 0x7f6df014b010 2023-12-16T03:27:34.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df54b8640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df014b010 0x7f6df01e6d50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6de000c500 tx=0x7f6de000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:34.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6de67fc640 1 -- 172.21.15.28:0/1369347058 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0005220 con 0x7f6df014b010 2023-12-16T03:27:34.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6de67fc640 1 -- 172.21.15.28:0/1369347058 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de0005380 con 0x7f6df014b010 2023-12-16T03:27:34.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1369347058 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df01ee110 con 0x7f6df014b010 2023-12-16T03:27:34.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6de67fc640 1 -- 172.21.15.28:0/1369347058 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0007270 con 0x7f6df014b010 2023-12-16T03:27:34.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1369347058 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df01570c0 con 0x7f6df014b010 2023-12-16T03:27:34.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.747+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1369347058 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df01edc90 con 0x7f6df014b010 2023-12-16T03:27:34.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.751+0000 7f6de67fc640 1 -- 172.21.15.28:0/1369347058 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6de00073d0 con 0x7f6df014b010 2023-12-16T03:27:34.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.751+0000 7f6de67fc640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dd4066470 0x7f6dd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:34.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.751+0000 7f6de67fc640 1 -- 172.21.15.28:0/1369347058 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6de00839f0 con 0x7f6df014b010 2023-12-16T03:27:34.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.751+0000 7f6df5cb9640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dd4066470 0x7f6dd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:34.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.751+0000 7f6df5cb9640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dd4066470 0x7f6dd4068930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0b2000 tx=0x7f6dec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:34.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.755+0000 7f6de67fc640 1 -- 172.21.15.28:0/1369347058 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6df01edc90 con 0x7f6df014b010 2023-12-16T03:27:34.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1369347058 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f6df00a9cb0 con 0x7f6df014b010 2023-12-16T03:27:34.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6de67fc640 1 -- 172.21.15.28:0/1369347058 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6df00a9cb0 con 0x7f6df014b010 2023-12-16T03:27:34.914 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:27:34.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1369347058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dd4066470 msgr2=0x7f6dd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dd4066470 0x7f6dd4068930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0b2000 tx=0x7f6dec009040 comp rx=0 tx=0).stop 2023-12-16T03:27:34.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1369347058 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df014b010 msgr2=0x7f6df01e6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:34.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df014b010 0x7f6df01e6d50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6de000c500 tx=0x7f6de000c9c0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1369347058 shutdown_connections 2023-12-16T03:27:34.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6df0157c20 0x7f6df01e7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6dd4066470 0x7f6dd4068930 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6df014b010 0x7f6df01e6d50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 --2- 172.21.15.28:0/1369347058 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6df0073a70 0x7f6df0156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:34.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1369347058 >> 172.21.15.28:0/1369347058 conn(0x7f6df00c30c0 msgr2=0x7f6df00bf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:34.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1369347058 shutdown_connections 2023-12-16T03:27:34.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:34.911+0000 7f6df7f1d640 1 -- 172.21.15.28:0/1369347058 wait complete. 2023-12-16T03:27:34.935 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:27:35.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.075+0000 7fec8c3f8640 1 Processor -- start 2023-12-16T03:27:35.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.075+0000 7fec8c3f8640 1 -- start start 2023-12-16T03:27:35.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.075+0000 7fec8c3f8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fec840c4100 0x7fec840c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.075+0000 7fec8c3f8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec840c31c0 con 0x7fec840c06d0 2023-12-16T03:27:35.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.075+0000 7fec8c3f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec840c34a0 con 0x7fec840c63c0 2023-12-16T03:27:35.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.075+0000 7fec8c3f8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec840c1030 con 0x7fec840c4100 2023-12-16T03:27:35.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.075+0000 7fec89993640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fec840c4100 0x7fec840c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.079+0000 7fec89993640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fec840c4100 0x7fec840c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38994/0 (socket says 172.21.15.28:38994) 2023-12-16T03:27:35.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.079+0000 7fec89993640 1 -- 172.21.15.28:0/3567538405 learned_addr learned my addr 172.21.15.28:0/3567538405 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:35.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.079+0000 7fec89993640 1 -- 172.21.15.28:0/3567538405 >> v1:172.21.15.134:6789/0 conn(0x7fec840c63c0 legacy=0x7fec840c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.079+0000 7fec89993640 1 -- 172.21.15.28:0/3567538405 >> v1:172.21.15.28:6789/0 conn(0x7fec840c06d0 legacy=0x7fec840a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.079+0000 7fec89993640 1 -- 172.21.15.28:0/3567538405 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec840c1310 con 0x7fec840c4100 2023-12-16T03:27:35.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.079+0000 7fec89192640 1 -- 172.21.15.28:0/3567538405 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100631752 0 0) 0x7fec840c31c0 con 0x7fec840c06d0 2023-12-16T03:27:35.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.079+0000 7fec89993640 1 --2- 172.21.15.28:0/3567538405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec840c4100 0x7fec840c2bb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fec7400bb10 tx=0x7fec7401eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19533f29eb631bc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:35.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.079+0000 7fec89192640 1 -- 172.21.15.28:0/3567538405 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec740a79d0 con 0x7fec840c4100 2023-12-16T03:27:35.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.079+0000 7fec89192640 1 -- 172.21.15.28:0/3567538405 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec740a7b30 con 0x7fec840c4100 2023-12-16T03:27:35.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.079+0000 7fec89192640 1 -- 172.21.15.28:0/3567538405 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec740af440 con 0x7fec840c4100 2023-12-16T03:27:35.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3567538405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec840c4100 msgr2=0x7fec840c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 --2- 172.21.15.28:0/3567538405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec840c4100 0x7fec840c2bb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fec7400bb10 tx=0x7fec7401eaf0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3567538405 shutdown_connections 2023-12-16T03:27:35.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 --2- 172.21.15.28:0/3567538405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec840c4100 0x7fec840c2bb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3567538405 >> 172.21.15.28:0/3567538405 conn(0x7fec8406a5b0 msgr2=0x7fec8406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:35.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3567538405 shutdown_connections 2023-12-16T03:27:35.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3567538405 wait complete. 2023-12-16T03:27:35.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 Processor -- start 2023-12-16T03:27:35.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 -- start start 2023-12-16T03:27:35.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec840c06d0 0x7fec841e9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec840c4100 0x7fec840718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec840c63c0 0x7fec840bea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec840c04a0 con 0x7fec840c06d0 2023-12-16T03:27:35.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec840bd720 con 0x7fec840c4100 2023-12-16T03:27:35.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8c3f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec840724b0 con 0x7fec840c63c0 2023-12-16T03:27:35.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8a194640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec840c06d0 0x7fec841e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8a194640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec840c06d0 0x7fec841e9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39010/0 (socket says 172.21.15.28:39010) 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8a194640 1 -- 172.21.15.28:0/3573289716 learned_addr learned my addr 172.21.15.28:0/3573289716 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec89993640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec840c4100 0x7fec840718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8a995640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec840c63c0 0x7fec840bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8a194640 1 -- 172.21.15.28:0/3573289716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec840c63c0 msgr2=0x7fec840bea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8a194640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec840c63c0 0x7fec840bea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8a194640 1 -- 172.21.15.28:0/3573289716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec840c4100 msgr2=0x7fec840718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8a194640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec840c4100 0x7fec840718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec8a194640 1 -- 172.21.15.28:0/3573289716 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7400b770 con 0x7fec840c06d0 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.083+0000 7fec89993640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec840c4100 0x7fec840718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.087+0000 7fec8a194640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec840c06d0 0x7fec841e9980 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fec8000c3f0 tx=0x7fec8000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.087+0000 7fec7affd640 1 -- 172.21.15.28:0/3573289716 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800052d0 con 0x7fec840c06d0 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.087+0000 7fec7affd640 1 -- 172.21.15.28:0/3573289716 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec80005430 con 0x7fec840c06d0 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.087+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3573289716 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec840c69b0 con 0x7fec840c06d0 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.087+0000 7fec7affd640 1 -- 172.21.15.28:0/3573289716 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80003840 con 0x7fec840c06d0 2023-12-16T03:27:35.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.087+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3573289716 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec840c01c0 con 0x7fec840c06d0 2023-12-16T03:27:35.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.087+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3573289716 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec84068400 con 0x7fec840c06d0 2023-12-16T03:27:35.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.087+0000 7fec7affd640 1 -- 172.21.15.28:0/3573289716 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fec800039a0 con 0x7fec840c06d0 2023-12-16T03:27:35.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.087+0000 7fec7affd640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fec680664a0 0x7fec68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.087+0000 7fec7affd640 1 -- 172.21.15.28:0/3573289716 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fec80083610 con 0x7fec840c06d0 2023-12-16T03:27:35.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.087+0000 7fec89993640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fec680664a0 0x7fec68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.091+0000 7fec89993640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fec680664a0 0x7fec68068960 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fec740b1000 tx=0x7fec740a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:35.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.091+0000 7fec7affd640 1 -- 172.21.15.28:0/3573289716 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fec80050870 con 0x7fec840c06d0 2023-12-16T03:27:35.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.263+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3573289716 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fec840c3e70 con 0x7fec840c06d0 2023-12-16T03:27:35.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.263+0000 7fec7affd640 1 -- 172.21.15.28:0/3573289716 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7fec80053e90 con 0x7fec840c06d0 2023-12-16T03:27:35.268 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3573289716 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fec680664a0 msgr2=0x7fec68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fec680664a0 0x7fec68068960 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fec740b1000 tx=0x7fec740a9070 comp rx=0 tx=0).stop 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3573289716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec840c06d0 msgr2=0x7fec841e9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec840c06d0 0x7fec841e9980 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fec8000c3f0 tx=0x7fec8000c8b0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3573289716 shutdown_connections 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec840c63c0 0x7fec840bea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec840c4100 0x7fec840718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fec680664a0 0x7fec68068960 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 --2- 172.21.15.28:0/3573289716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec840c06d0 0x7fec841e9980 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3573289716 >> 172.21.15.28:0/3573289716 conn(0x7fec8406a5b0 msgr2=0x7fec840c4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3573289716 shutdown_connections 2023-12-16T03:27:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.267+0000 7fec8c3f8640 1 -- 172.21.15.28:0/3573289716 wait complete. 2023-12-16T03:27:35.289 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-16T03:27:35.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:35.289 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-16T03:27:35.319 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:27:35.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:27:35.319 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T03:27:35.374 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:27:35.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f4973bdf640 1 Processor -- start 2023-12-16T03:27:35.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f4973bdf640 1 -- start start 2023-12-16T03:27:35.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f4973bdf640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f496c151e90 0x7f496c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f4973bdf640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f496c0c7ea0 0x7f496c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f4973bdf640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c06c860 con 0x7f496c0c4e60 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f4973bdf640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496c0c8750 con 0x7f496c0c7ea0 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f4973bdf640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496c1552d0 con 0x7f496c151e90 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f497117a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f496c0c7ea0 0x7f496c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f497217c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f496c0c4e60 0x7f496c06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40632/0 (socket says 172.21.15.28:40632) 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f497217c640 1 -- 172.21.15.28:0/998846485 learned_addr learned my addr 172.21.15.28:0/998846485 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f497197b640 1 --2- 172.21.15.28:0/998846485 >> v2:172.21.15.134:3300/0 conn(0x7f496c151e90 0x7f496c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f497117a640 1 -- 172.21.15.28:0/998846485 >> v2:172.21.15.134:3300/0 conn(0x7f496c151e90 msgr2=0x7f496c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f497117a640 1 --2- 172.21.15.28:0/998846485 >> v2:172.21.15.134:3300/0 conn(0x7f496c151e90 0x7f496c0c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f497117a640 1 -- 172.21.15.28:0/998846485 >> v1:172.21.15.28:6789/0 conn(0x7f496c0c4e60 legacy=0x7f496c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f497117a640 1 -- 172.21.15.28:0/998846485 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c154930 con 0x7f496c0c7ea0 2023-12-16T03:27:35.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.515+0000 7f4970979640 1 -- 172.21.15.28:0/998846485 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059753642 0 0) 0x7f496c06c860 con 0x7f496c0c4e60 2023-12-16T03:27:35.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f497117a640 1 --2- 172.21.15.28:0/998846485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f496c0c7ea0 0x7f496c06b4a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f496c08b410 tx=0x7f495c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b93de4323839e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:35.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f4970979640 1 -- 172.21.15.28:0/998846485 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c0ab600 con 0x7f496c0c7ea0 2023-12-16T03:27:35.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f4970979640 1 -- 172.21.15.28:0/998846485 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c0a7050 con 0x7f496c0c7ea0 2023-12-16T03:27:35.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f4970979640 1 -- 172.21.15.28:0/998846485 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c0ab980 con 0x7f496c0c7ea0 2023-12-16T03:27:35.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f4973bdf640 1 -- 172.21.15.28:0/998846485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f496c0c7ea0 msgr2=0x7f496c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f4973bdf640 1 --2- 172.21.15.28:0/998846485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f496c0c7ea0 0x7f496c06b4a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f496c08b410 tx=0x7f495c01c340 comp rx=0 tx=0).stop 2023-12-16T03:27:35.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f4973bdf640 1 -- 172.21.15.28:0/998846485 shutdown_connections 2023-12-16T03:27:35.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f4973bdf640 1 --2- 172.21.15.28:0/998846485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f496c0c7ea0 0x7f496c06b4a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f4973bdf640 1 --2- 172.21.15.28:0/998846485 >> v2:172.21.15.134:3300/0 conn(0x7f496c151e90 0x7f496c0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f4973bdf640 1 -- 172.21.15.28:0/998846485 >> 172.21.15.28:0/998846485 conn(0x7f496c0ca170 msgr2=0x7f496c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:35.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f4973bdf640 1 -- 172.21.15.28:0/998846485 shutdown_connections 2023-12-16T03:27:35.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.519+0000 7f4973bdf640 1 -- 172.21.15.28:0/998846485 wait complete. 2023-12-16T03:27:35.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f4973bdf640 1 Processor -- start 2023-12-16T03:27:35.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f4973bdf640 1 -- start start 2023-12-16T03:27:35.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f4973bdf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c0c4e60 0x7f496c0aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f4973bdf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f496c0c7ea0 0x7f496c1ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f4973bdf640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f496c151e90 0x7f496c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f4973bdf640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0bd520 con 0x7f496c0c7ea0 2023-12-16T03:27:35.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f4973bdf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c1ed060 con 0x7f496c0c4e60 2023-12-16T03:27:35.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f4973bdf640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0aa150 con 0x7f496c151e90 2023-12-16T03:27:35.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f497117a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f496c0c7ea0 0x7f496c1ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f497117a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f496c0c7ea0 0x7f496c1ee0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39030/0 (socket says 172.21.15.28:39030) 2023-12-16T03:27:35.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f497117a640 1 -- 172.21.15.28:0/641952099 learned_addr learned my addr 172.21.15.28:0/641952099 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:35.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f497197b640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c0c4e60 0x7f496c0aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f497217c640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f496c151e90 0x7f496c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f497117a640 1 -- 172.21.15.28:0/641952099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f496c151e90 msgr2=0x7f496c06ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f497117a640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f496c151e90 0x7f496c06ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f497117a640 1 -- 172.21.15.28:0/641952099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c0c4e60 msgr2=0x7f496c0aa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f497117a640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c0c4e60 0x7f496c0aa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f497117a640 1 -- 172.21.15.28:0/641952099 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c009420 con 0x7f496c0c7ea0 2023-12-16T03:27:35.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f497117a640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f496c0c7ea0 0x7f496c1ee0e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f495c0ae040 tx=0x7f495c01ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:35.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f49627fc640 1 -- 172.21.15.28:0/641952099 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c0b7650 con 0x7f496c0c7ea0 2023-12-16T03:27:35.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f49627fc640 1 -- 172.21.15.28:0/641952099 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c0b77b0 con 0x7f496c0c7ea0 2023-12-16T03:27:35.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f4973bdf640 1 -- 172.21.15.28:0/641952099 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496c1ecd80 con 0x7f496c0c7ea0 2023-12-16T03:27:35.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f49627fc640 1 -- 172.21.15.28:0/641952099 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c0b7b60 con 0x7f496c0c7ea0 2023-12-16T03:27:35.529 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.523+0000 7f4973bdf640 1 -- 172.21.15.28:0/641952099 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c0a9de0 con 0x7f496c0c7ea0 2023-12-16T03:27:35.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.527+0000 7f4973bdf640 1 -- 172.21.15.28:0/641952099 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496c0a9960 con 0x7f496c0c7ea0 2023-12-16T03:27:35.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.527+0000 7f49627fc640 1 -- 172.21.15.28:0/641952099 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f495c0b7cc0 con 0x7f496c0c7ea0 2023-12-16T03:27:35.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.527+0000 7f49627fc640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49500664a0 0x7f4950068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.527+0000 7f49627fc640 1 -- 172.21.15.28:0/641952099 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f495c11e8e0 con 0x7f496c0c7ea0 2023-12-16T03:27:35.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.527+0000 7f497197b640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49500664a0 0x7f4950068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.527+0000 7f497197b640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49500664a0 0x7f4950068960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4968006aa0 tx=0x7f4968008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:35.535 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.531+0000 7f49627fc640 1 -- 172.21.15.28:0/641952099 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f496c0a9960 con 0x7f496c0c7ea0 2023-12-16T03:27:35.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.719+0000 7f4973bdf640 1 -- 172.21.15.28:0/641952099 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f496c06d590 con 0x7f496c0c7ea0 2023-12-16T03:27:35.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.719+0000 7f49627fc640 1 -- 172.21.15.28:0/641952099 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6188 (secure 0 0 0) 0x7f495c0bb090 con 0x7f496c0c7ea0 2023-12-16T03:27:35.725 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:35.725 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3665146461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":3665146461},{"type":"v1","addr":"172.21.15.28:6837","nonce":3665146461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1938417336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1938417336},{"type":"v1","addr":"172.21.15.134:6835","nonce":1938417336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:00.888034+0000","modified":"2023-12-16T03:27:03.912013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/3717643902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3717643902},{"type":"v1","addr":"172.21.15.28:6836","nonce":3717643902}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:13.968886+0000","modified":"2023-12-16T03:27:17.002993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6834/4009894510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4009894510},{"type":"v1","addr":"172.21.15.134:6834","nonce":4009894510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-16T03:27:35.725 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 36 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 -- 172.21.15.28:0/641952099 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49500664a0 msgr2=0x7f4950068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49500664a0 0x7f4950068960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4968006aa0 tx=0x7f4968008040 comp rx=0 tx=0).stop 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 -- 172.21.15.28:0/641952099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f496c0c7ea0 msgr2=0x7f496c1ee0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f496c0c7ea0 0x7f496c1ee0e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f495c0ae040 tx=0x7f495c01ab80 comp rx=0 tx=0).stop 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 -- 172.21.15.28:0/641952099 shutdown_connections 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f496c151e90 0x7f496c06ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f49500664a0 0x7f4950068960 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f496c0c7ea0 0x7f496c1ee0e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 --2- 172.21.15.28:0/641952099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c0c4e60 0x7f496c0aa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 -- 172.21.15.28:0/641952099 >> 172.21.15.28:0/641952099 conn(0x7f496c0ca170 msgr2=0x7f496c0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 -- 172.21.15.28:0/641952099 shutdown_connections 2023-12-16T03:27:35.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.723+0000 7f4973bdf640 1 -- 172.21.15.28:0/641952099 wait complete. 2023-12-16T03:27:35.746 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:35.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.883+0000 7fc5a0e5a640 1 Processor -- start 2023-12-16T03:27:35.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.883+0000 7fc5a0e5a640 1 -- start start 2023-12-16T03:27:35.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc5a0e5a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc59c072090 0x7fc59c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc5a0e5a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c0c2760 con 0x7fc59c0a5370 2023-12-16T03:27:35.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc5a0e5a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c0a5750 con 0x7fc59c0725c0 2023-12-16T03:27:35.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc5a0e5a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0c3070 con 0x7fc59c072090 2023-12-16T03:27:35.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc59a59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc59c0a5370 0x7fc59c0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40642/0 (socket says 172.21.15.28:40642) 2023-12-16T03:27:35.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc59a59c640 1 -- 172.21.15.28:0/3350342110 learned_addr learned my addr 172.21.15.28:0/3350342110 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:35.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc593fff640 1 --2- 172.21.15.28:0/3350342110 >> v2:172.21.15.134:3300/0 conn(0x7fc59c072090 0x7fc59c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577231968 0 0) 0x7fc59c0c2760 con 0x7fc59c0a5370 2023-12-16T03:27:35.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc588003450 con 0x7fc59c0a5370 2023-12-16T03:27:35.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550134057 0 0) 0x7fc59c0a5750 con 0x7fc59c0725c0 2023-12-16T03:27:35.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc59c0c2760 con 0x7fc59c0725c0 2023-12-16T03:27:35.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869143513 0 0) 0x7fc588003450 con 0x7fc59c0a5370 2023-12-16T03:27:35.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 >> v2:172.21.15.134:3300/0 conn(0x7fc59c072090 msgr2=0x7fc59c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:35.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 --2- 172.21.15.28:0/3350342110 >> v2:172.21.15.134:3300/0 conn(0x7fc59c072090 0x7fc59c150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 >> v1:172.21.15.134:6789/0 conn(0x7fc59c0725c0 legacy=0x7fc59c1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c0aad20 con 0x7fc59c0a5370 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fc58c001680 con 0x7fc59c0a5370 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc593fff640 1 --2- 172.21.15.28:0/3350342110 >> v2:172.21.15.134:3300/0 conn(0x7fc59c072090 0x7fc59c150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 >> v1:172.21.15.28:6789/0 conn(0x7fc59c0a5370 legacy=0x7fc59c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 0x7fc588008860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc588008da0 0x7fc58800b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58800b6d0 0x7fc58800dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0c3070 con 0x7fc588003c50 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58800e3a0 con 0x7fc58800b6d0 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58800e560 con 0x7fc588008da0 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc59a59c640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 0x7fc588008860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc593fff640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc588008da0 0x7fc58800b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc59ad9d640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58800b6d0 0x7fc58800dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc59a59c640 1 -- 172.21.15.28:0/3350342110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc588008da0 msgr2=0x7fc58800b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:35.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc59a59c640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc588008da0 0x7fc58800b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc59a59c640 1 -- 172.21.15.28:0/3350342110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58800b6d0 msgr2=0x7fc58800dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:35.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc59a59c640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58800b6d0 0x7fc58800dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc59a59c640 1 -- 172.21.15.28:0/3350342110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588003450 con 0x7fc588003c50 2023-12-16T03:27:35.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc59ad9d640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58800b6d0 0x7fc58800dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:35.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.887+0000 7fc59ad9d640 1 -- 172.21.15.28:0/3350342110 reap_dead start 2023-12-16T03:27:35.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.891+0000 7fc59a59c640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 0x7fc588008860 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc58c007fa0 tx=0x7fc58c01cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e30730364dd6050 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:35.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.891+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c005ae0 con 0x7fc588003c50 2023-12-16T03:27:35.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.891+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c005c40 con 0x7fc588003c50 2023-12-16T03:27:35.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.891+0000 7fc599d9b640 1 -- 172.21.15.28:0/3350342110 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c007290 con 0x7fc588003c50 2023-12-16T03:27:35.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.891+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/3350342110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 msgr2=0x7fc588008860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.891+0000 7fc5a0e5a640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 0x7fc588008860 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc58c007fa0 tx=0x7fc58c01cad0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.891+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/3350342110 shutdown_connections 2023-12-16T03:27:35.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.891+0000 7fc5a0e5a640 1 --2- 172.21.15.28:0/3350342110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 0x7fc588008860 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.891+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/3350342110 >> 172.21.15.28:0/3350342110 conn(0x7fc59c06a5b0 msgr2=0x7fc59c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:35.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.891+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/3350342110 shutdown_connections 2023-12-16T03:27:35.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.891+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/3350342110 wait complete. 2023-12-16T03:27:35.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc5a0e5a640 1 Processor -- start 2023-12-16T03:27:35.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc5a0e5a640 1 -- start start 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc5a0e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 0x7fc59c1ebc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc5a0e5a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc59c14ccc0 0x7fc59c14a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc5a0e5a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc59c1dfbf0 0x7fc59c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc5a0e5a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c151fc0 con 0x7fc588003c50 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc5a0e5a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c06fe50 con 0x7fc59c14ccc0 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc5a0e5a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c070130 con 0x7fc59c1dfbf0 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc59a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 0x7fc59c1ebc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc59a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 0x7fc59c1ebc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39042/0 (socket says 172.21.15.28:39042) 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc59a59c640 1 -- 172.21.15.28:0/2054079970 learned_addr learned my addr 172.21.15.28:0/2054079970 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc593fff640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc59c14ccc0 0x7fc59c14a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc59ad9d640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc59c1dfbf0 0x7fc59c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc59a59c640 1 -- 172.21.15.28:0/2054079970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc59c1dfbf0 msgr2=0x7fc59c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc59a59c640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc59c1dfbf0 0x7fc59c0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc59a59c640 1 -- 172.21.15.28:0/2054079970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc59c14ccc0 msgr2=0x7fc59c14a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:35.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc59a59c640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc59c14ccc0 0x7fc59c14a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:35.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc59a59c640 1 -- 172.21.15.28:0/2054079970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c14a6b0 con 0x7fc588003c50 2023-12-16T03:27:35.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc59a59c640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 0x7fc59c1ebc70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc58c01c900 tx=0x7fc588003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:35.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc592ffd640 1 -- 172.21.15.28:0/2054079970 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0b4070 con 0x7fc588003c50 2023-12-16T03:27:35.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc592ffd640 1 -- 172.21.15.28:0/2054079970 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c0047f0 con 0x7fc588003c50 2023-12-16T03:27:35.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc592ffd640 1 -- 172.21.15.28:0/2054079970 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c004b80 con 0x7fc588003c50 2023-12-16T03:27:35.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/2054079970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c152210 con 0x7fc588003c50 2023-12-16T03:27:35.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/2054079970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c1527d0 con 0x7fc588003c50 2023-12-16T03:27:35.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.895+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/2054079970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c068400 con 0x7fc588003c50 2023-12-16T03:27:35.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.899+0000 7fc592ffd640 1 -- 172.21.15.28:0/2054079970 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc58c004ce0 con 0x7fc588003c50 2023-12-16T03:27:35.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.899+0000 7fc592ffd640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc57c0664a0 0x7fc57c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:35.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.899+0000 7fc592ffd640 1 -- 172.21.15.28:0/2054079970 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc58c11d630 con 0x7fc588003c50 2023-12-16T03:27:35.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.899+0000 7fc593fff640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc57c0664a0 0x7fc57c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:35.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.899+0000 7fc593fff640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc57c0664a0 0x7fc57c068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0c4cb0 tx=0x7fc584008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:35.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:35.903+0000 7fc592ffd640 1 -- 172.21.15.28:0/2054079970 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc58c0ea590 con 0x7fc588003c50 2023-12-16T03:27:36.017 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:27:36.022 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:27:36.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.063+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/2054079970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc59c0c6780 con 0x7fc588003c50 2023-12-16T03:27:36.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc592ffd640 1 -- 172.21.15.28:0/2054079970 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20280 (secure 0 0 0) 0x7fc58c0ec4c0 con 0x7fc588003c50 2023-12-16T03:27:36.070 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:36.071 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":54,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:15.600556+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/2054079970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc57c0664a0 msgr2=0x7fc57c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc57c0664a0 0x7fc57c068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0c4cb0 tx=0x7fc584008040 comp rx=0 tx=0).stop 2023-12-16T03:27:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/2054079970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 msgr2=0x7fc59c1ebc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 0x7fc59c1ebc70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc58c01c900 tx=0x7fc588003700 comp rx=0 tx=0).stop 2023-12-16T03:27:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/2054079970 shutdown_connections 2023-12-16T03:27:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc59c1dfbf0 0x7fc59c0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc59c14ccc0 0x7fc59c14a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc57c0664a0 0x7fc57c068960 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 --2- 172.21.15.28:0/2054079970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc588003c50 0x7fc59c1ebc70 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/2054079970 >> 172.21.15.28:0/2054079970 conn(0x7fc59c06a5b0 msgr2=0x7fc59c06d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:36.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/2054079970 shutdown_connections 2023-12-16T03:27:36.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.067+0000 7fc5a0e5a640 1 -- 172.21.15.28:0/2054079970 wait complete. 2023-12-16T03:27:36.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:26:58.698173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:26:59.897067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:27:12.042891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:27:12.972488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:27:36.092 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:27:36.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f3050e32640 1 Processor -- start 2023-12-16T03:27:36.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f3050e32640 1 -- start start 2023-12-16T03:27:36.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f3050e32640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f304c0c63c0 0x7f304c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f3050e32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f3050e32640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0c31c0 con 0x7f304c0c4100 2023-12-16T03:27:36.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f3050e32640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0c34a0 con 0x7f304c0c63c0 2023-12-16T03:27:36.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f3050e32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0c1030 con 0x7f304c0c2bb0 2023-12-16T03:27:36.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f304a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f304c0c63c0 0x7f304c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f304a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f304c0c63c0 0x7f304c0c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39054/0 (socket says 172.21.15.28:39054) 2023-12-16T03:27:36.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f304a59c640 1 -- 172.21.15.28:0/3500813389 learned_addr learned my addr 172.21.15.28:0/3500813389 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:36.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f304ad9d640 1 --2- 172.21.15.28:0/3500813389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f304a59c640 1 -- 172.21.15.28:0/3500813389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 msgr2=0x7f304c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:36.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f304a59c640 1 --2- 172.21.15.28:0/3500813389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f304a59c640 1 -- 172.21.15.28:0/3500813389 >> v1:172.21.15.28:6789/0 conn(0x7f304c0c4100 legacy=0x7f304c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f304a59c640 1 -- 172.21.15.28:0/3500813389 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0c1310 con 0x7f304c0c63c0 2023-12-16T03:27:36.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f304ad9d640 1 --2- 172.21.15.28:0/3500813389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:36.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.275+0000 7f3049d9b640 1 -- 172.21.15.28:0/3500813389 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437811602 0 0) 0x7f304c0c31c0 con 0x7f304c0c4100 2023-12-16T03:27:36.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f304a59c640 1 --2- 172.21.15.28:0/3500813389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c0c63c0 0x7f304c0c06d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f303c009870 tx=0x7f303c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20506bd07e6b3e91 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:36.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f3049d9b640 1 -- 172.21.15.28:0/3500813389 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0aa3d0 con 0x7f304c0c63c0 2023-12-16T03:27:36.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f3049d9b640 1 -- 172.21.15.28:0/3500813389 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c0a7050 con 0x7f304c0c63c0 2023-12-16T03:27:36.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f3049d9b640 1 -- 172.21.15.28:0/3500813389 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0ab820 con 0x7f304c0c63c0 2023-12-16T03:27:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f3050e32640 1 -- 172.21.15.28:0/3500813389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c0c63c0 msgr2=0x7f304c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f3050e32640 1 --2- 172.21.15.28:0/3500813389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c0c63c0 0x7f304c0c06d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f303c009870 tx=0x7f303c01c3f0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f3050e32640 1 -- 172.21.15.28:0/3500813389 shutdown_connections 2023-12-16T03:27:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f3050e32640 1 --2- 172.21.15.28:0/3500813389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f3050e32640 1 --2- 172.21.15.28:0/3500813389 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c0c63c0 0x7f304c0c06d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f3050e32640 1 -- 172.21.15.28:0/3500813389 >> 172.21.15.28:0/3500813389 conn(0x7f304c06a5b0 msgr2=0x7f304c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f3050e32640 1 -- 172.21.15.28:0/3500813389 shutdown_connections 2023-12-16T03:27:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.279+0000 7f3050e32640 1 -- 172.21.15.28:0/3500813389 wait complete. 2023-12-16T03:27:36.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3050e32640 1 Processor -- start 2023-12-16T03:27:36.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3050e32640 1 -- start start 2023-12-16T03:27:36.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3050e32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3050e32640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f304c0c4100 0x7f304c151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3050e32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c0c63c0 0x7f304c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3050e32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0c0520 con 0x7f304c0c63c0 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3050e32640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c151f70 con 0x7f304c0c4100 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3050e32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c1ebbc0 con 0x7f304c0c2bb0 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f304ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c0c63c0 0x7f304c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f304ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c0c63c0 0x7f304c1539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39066/0 (socket says 172.21.15.28:39066) 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f304ad9d640 1 -- 172.21.15.28:0/919923259 learned_addr learned my addr 172.21.15.28:0/919923259 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f304a59c640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3043fff640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f304c0c4100 0x7f304c151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f304ad9d640 1 -- 172.21.15.28:0/919923259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 msgr2=0x7f304c0bffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f304ad9d640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0bffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f304ad9d640 1 -- 172.21.15.28:0/919923259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f304c0c4100 msgr2=0x7f304c151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f304ad9d640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f304c0c4100 0x7f304c151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f304ad9d640 1 -- 172.21.15.28:0/919923259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0094d0 con 0x7f304c0c63c0 2023-12-16T03:27:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3043fff640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f304c0c4100 0x7f304c151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f304ad9d640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c0c63c0 0x7f304c1539f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f3044007f20 tx=0x7f304400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3042ffd640 1 -- 172.21.15.28:0/919923259 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400dee0 con 0x7f304c0c63c0 2023-12-16T03:27:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3042ffd640 1 -- 172.21.15.28:0/919923259 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400f040 con 0x7f304c0c63c0 2023-12-16T03:27:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3042ffd640 1 -- 172.21.15.28:0/919923259 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044003de0 con 0x7f304c0c63c0 2023-12-16T03:27:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3050e32640 1 -- 172.21.15.28:0/919923259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c0c69b0 con 0x7f304c0c63c0 2023-12-16T03:27:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3050e32640 1 -- 172.21.15.28:0/919923259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c1ec140 con 0x7f304c0c63c0 2023-12-16T03:27:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.283+0000 7f3050e32640 1 -- 172.21.15.28:0/919923259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c1ec940 con 0x7f304c0c63c0 2023-12-16T03:27:36.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.287+0000 7f3042ffd640 1 -- 172.21.15.28:0/919923259 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3044004030 con 0x7f304c0c63c0 2023-12-16T03:27:36.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.287+0000 7f3042ffd640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c066470 0x7f302c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.287+0000 7f3042ffd640 1 -- 172.21.15.28:0/919923259 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3044084580 con 0x7f304c0c63c0 2023-12-16T03:27:36.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.287+0000 7f304a59c640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c066470 0x7f302c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.287+0000 7f304a59c640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c066470 0x7f302c068930 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f303c0ad000 tx=0x7f303c0a4f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:36.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.291+0000 7f3042ffd640 1 -- 172.21.15.28:0/919923259 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f304c1ec940 con 0x7f304c0c63c0 2023-12-16T03:27:36.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.447+0000 7f3050e32640 1 -- 172.21.15.28:0/919923259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f304c1ec940 con 0x7f304c0c63c0 2023-12-16T03:27:36.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.447+0000 7f3042ffd640 1 -- 172.21.15.28:0/919923259 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f304c1ec940 con 0x7f304c0c63c0 2023-12-16T03:27:36.452 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:27:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 -- 172.21.15.28:0/919923259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c066470 msgr2=0x7f302c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c066470 0x7f302c068930 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f303c0ad000 tx=0x7f303c0a4f90 comp rx=0 tx=0).stop 2023-12-16T03:27:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 -- 172.21.15.28:0/919923259 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c0c63c0 msgr2=0x7f304c1539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c0c63c0 0x7f304c1539f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f3044007f20 tx=0x7f304400d560 comp rx=0 tx=0).stop 2023-12-16T03:27:36.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 -- 172.21.15.28:0/919923259 shutdown_connections 2023-12-16T03:27:36.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f302c066470 0x7f302c068930 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f304c0c63c0 0x7f304c1539f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f304c0c4100 0x7f304c151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 --2- 172.21.15.28:0/919923259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f304c0c2bb0 0x7f304c0bffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 -- 172.21.15.28:0/919923259 >> 172.21.15.28:0/919923259 conn(0x7f304c06a5b0 msgr2=0x7f304c0a6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:36.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 -- 172.21.15.28:0/919923259 shutdown_connections 2023-12-16T03:27:36.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.451+0000 7f3050e32640 1 -- 172.21.15.28:0/919923259 wait complete. 2023-12-16T03:27:36.474 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:27:36.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.615+0000 7fd2c7a9a640 1 Processor -- start 2023-12-16T03:27:36.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.615+0000 7fd2c7a9a640 1 -- start start 2023-12-16T03:27:36.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c7a9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c00c4100 0x7fd2c00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c7a9a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd2c00c06d0 0x7fd2c00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c7a9a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c00c31c0 con 0x7fd2c00c63c0 2023-12-16T03:27:36.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c7a9a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c00c34a0 con 0x7fd2c00c06d0 2023-12-16T03:27:36.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c7a9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00c1030 con 0x7fd2c00c4100 2023-12-16T03:27:36.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c5836640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd2c00c63c0 0x7fd2c00c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40666/0 (socket says 172.21.15.28:40666) 2023-12-16T03:27:36.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c5836640 1 -- 172.21.15.28:0/2596989234 learned_addr learned my addr 172.21.15.28:0/2596989234 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:36.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c6037640 1 --2- 172.21.15.28:0/2596989234 >> v2:172.21.15.28:3300/0 conn(0x7fd2c00c06d0 0x7fd2c00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c5035640 1 --2- 172.21.15.28:0/2596989234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c00c4100 0x7fd2c00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c6037640 1 -- 172.21.15.28:0/2596989234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c00c4100 msgr2=0x7fd2c00c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:36.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c6037640 1 --2- 172.21.15.28:0/2596989234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c00c4100 0x7fd2c00c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c6037640 1 -- 172.21.15.28:0/2596989234 >> v1:172.21.15.28:6789/0 conn(0x7fd2c00c63c0 legacy=0x7fd2c00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c6037640 1 -- 172.21.15.28:0/2596989234 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c00c1310 con 0x7fd2c00c06d0 2023-12-16T03:27:36.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.619+0000 7fd2c4834640 1 -- 172.21.15.28:0/2596989234 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409599974 0 0) 0x7fd2c00c31c0 con 0x7fd2c00c63c0 2023-12-16T03:27:36.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c6037640 1 --2- 172.21.15.28:0/2596989234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2c00c06d0 0x7fd2c00a9680 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009d90 tx=0x7fd2b801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a779289568ccf4b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:36.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c4834640 1 -- 172.21.15.28:0/2596989234 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c00aa3d0 con 0x7fd2c00c06d0 2023-12-16T03:27:36.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c4834640 1 -- 172.21.15.28:0/2596989234 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b80a5800 con 0x7fd2c00c06d0 2023-12-16T03:27:36.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c4834640 1 -- 172.21.15.28:0/2596989234 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b80a5b90 con 0x7fd2c00c06d0 2023-12-16T03:27:36.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2596989234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2c00c06d0 msgr2=0x7fd2c00a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 --2- 172.21.15.28:0/2596989234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2c00c06d0 0x7fd2c00a9680 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009d90 tx=0x7fd2b801c830 comp rx=0 tx=0).stop 2023-12-16T03:27:36.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2596989234 shutdown_connections 2023-12-16T03:27:36.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 --2- 172.21.15.28:0/2596989234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2c00c06d0 0x7fd2c00a9680 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 --2- 172.21.15.28:0/2596989234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c00c4100 0x7fd2c00c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2596989234 >> 172.21.15.28:0/2596989234 conn(0x7fd2c006a5b0 msgr2=0x7fd2c006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:36.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2596989234 shutdown_connections 2023-12-16T03:27:36.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2596989234 wait complete. 2023-12-16T03:27:36.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 Processor -- start 2023-12-16T03:27:36.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 -- start start 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2c00c06d0 0x7fd2c01ed220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c00c4100 0x7fd2c015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2c00c63c0 0x7fd2c00bc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c01ed850 con 0x7fd2c00c06d0 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00bbfa0 con 0x7fd2c00c63c0 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c7a9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00bda70 con 0x7fd2c00c4100 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.623+0000 7fd2c5836640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2c00c06d0 0x7fd2c01ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c5836640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2c00c06d0 0x7fd2c01ed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39088/0 (socket says 172.21.15.28:39088) 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c5836640 1 -- 172.21.15.28:0/2553409114 learned_addr learned my addr 172.21.15.28:0/2553409114 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c5035640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c00c4100 0x7fd2c015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c5836640 1 -- 172.21.15.28:0/2553409114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c00c4100 msgr2=0x7fd2c015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c5836640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c00c4100 0x7fd2c015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c5836640 1 -- 172.21.15.28:0/2553409114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2c00c63c0 msgr2=0x7fd2c00bc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c6037640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2c00c63c0 0x7fd2c00bc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c5836640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2c00c63c0 0x7fd2c00bc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c5836640 1 -- 172.21.15.28:0/2553409114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8009a70 con 0x7fd2c00c06d0 2023-12-16T03:27:36.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c5035640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c00c4100 0x7fd2c015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:36.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c6037640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2c00c63c0 0x7fd2c00bc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:36.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c5836640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2c00c06d0 0x7fd2c01ed220 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00c480 tx=0x7fd2bc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:36.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2b67fc640 1 -- 172.21.15.28:0/2553409114 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0074e0 con 0x7fd2c00c06d0 2023-12-16T03:27:36.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2b67fc640 1 -- 172.21.15.28:0/2553409114 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc007660 con 0x7fd2c00c06d0 2023-12-16T03:27:36.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2553409114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c00bdd50 con 0x7fd2c00c06d0 2023-12-16T03:27:36.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2b67fc640 1 -- 172.21.15.28:0/2553409114 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc004a30 con 0x7fd2c00c06d0 2023-12-16T03:27:36.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2553409114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c00be8c0 con 0x7fd2c00c06d0 2023-12-16T03:27:36.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2553409114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c0068400 con 0x7fd2c00c06d0 2023-12-16T03:27:36.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.627+0000 7fd2b67fc640 1 -- 172.21.15.28:0/2553409114 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd2bc004b90 con 0x7fd2c00c06d0 2023-12-16T03:27:36.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.631+0000 7fd2b67fc640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd2a4066470 0x7fd2a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.631+0000 7fd2b67fc640 1 -- 172.21.15.28:0/2553409114 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd2bc083310 con 0x7fd2c00c06d0 2023-12-16T03:27:36.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.631+0000 7fd2c5035640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd2a4066470 0x7fd2a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.631+0000 7fd2c5035640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd2a4066470 0x7fd2a4068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00c30f0 tx=0x7fd2b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:36.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.635+0000 7fd2b67fc640 1 -- 172.21.15.28:0/2553409114 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd2bc053f50 con 0x7fd2c00c06d0 2023-12-16T03:27:36.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.791+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2553409114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2c00c3e70 con 0x7fd2c00c06d0 2023-12-16T03:27:36.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.791+0000 7fd2b67fc640 1 -- 172.21.15.28:0/2553409114 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd2bc053ae0 con 0x7fd2c00c06d0 2023-12-16T03:27:36.795 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:27:36.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2553409114 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd2a4066470 msgr2=0x7fd2a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd2a4066470 0x7fd2a4068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00c30f0 tx=0x7fd2b0008040 comp rx=0 tx=0).stop 2023-12-16T03:27:36.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2553409114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2c00c06d0 msgr2=0x7fd2c01ed220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2c00c06d0 0x7fd2c01ed220 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00c480 tx=0x7fd2bc00c940 comp rx=0 tx=0).stop 2023-12-16T03:27:36.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2553409114 shutdown_connections 2023-12-16T03:27:36.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2c00c63c0 0x7fd2c00bc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c00c4100 0x7fd2c015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd2a4066470 0x7fd2a4068930 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 --2- 172.21.15.28:0/2553409114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2c00c06d0 0x7fd2c01ed220 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2553409114 >> 172.21.15.28:0/2553409114 conn(0x7fd2c006a5b0 msgr2=0x7fd2c01551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:36.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2553409114 shutdown_connections 2023-12-16T03:27:36.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.795+0000 7fd2c7a9a640 1 -- 172.21.15.28:0/2553409114 wait complete. 2023-12-16T03:27:36.817 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:27:36.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.959+0000 7f14314fe640 1 Processor -- start 2023-12-16T03:27:36.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.959+0000 7f14314fe640 1 -- start start 2023-12-16T03:27:36.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.959+0000 7f14314fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f142c0c4100 0x7f142c0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.959+0000 7f14314fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f142c0c06d0 0x7f142c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.959+0000 7f14314fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c0c31c0 con 0x7f142c0c63c0 2023-12-16T03:27:36.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.959+0000 7f14314fe640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142c0c34a0 con 0x7f142c0c06d0 2023-12-16T03:27:36.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.959+0000 7f14314fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142c0c1030 con 0x7f142c0c4100 2023-12-16T03:27:36.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.959+0000 7f142b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f142c0c06d0 0x7f142c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.959+0000 7f142b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f142c0c06d0 0x7f142c0a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39104/0 (socket says 172.21.15.28:39104) 2023-12-16T03:27:36.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.959+0000 7f142b7fe640 1 -- 172.21.15.28:0/3006991845 learned_addr learned my addr 172.21.15.28:0/3006991845 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:36.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.963+0000 7f142a7fc640 1 --2- 172.21.15.28:0/3006991845 >> v2:172.21.15.134:3300/0 conn(0x7f142c0c4100 0x7f142c0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.963+0000 7f142b7fe640 1 -- 172.21.15.28:0/3006991845 >> v2:172.21.15.134:3300/0 conn(0x7f142c0c4100 msgr2=0x7f142c0c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:36.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.963+0000 7f142b7fe640 1 --2- 172.21.15.28:0/3006991845 >> v2:172.21.15.134:3300/0 conn(0x7f142c0c4100 0x7f142c0c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.963+0000 7f142b7fe640 1 -- 172.21.15.28:0/3006991845 >> v1:172.21.15.134:6789/0 conn(0x7f142c0c63c0 legacy=0x7f142c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.963+0000 7f142b7fe640 1 -- 172.21.15.28:0/3006991845 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c0c1310 con 0x7f142c0c06d0 2023-12-16T03:27:36.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.963+0000 7f142b7fe640 1 --2- 172.21.15.28:0/3006991845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f142c0c06d0 0x7f142c0a9680 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f142c0a8b40 tx=0x7f142401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e4ca6d71bc5b8a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:36.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.963+0000 7f1429ffb640 1 -- 172.21.15.28:0/3006991845 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0aa3d0 con 0x7f142c0c06d0 2023-12-16T03:27:36.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.963+0000 7f1429ffb640 1 -- 172.21.15.28:0/3006991845 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14240a5680 con 0x7f142c0c06d0 2023-12-16T03:27:36.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.963+0000 7f1429ffb640 1 -- 172.21.15.28:0/3006991845 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14240a5a10 con 0x7f142c0c06d0 2023-12-16T03:27:36.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 -- 172.21.15.28:0/3006991845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f142c0c06d0 msgr2=0x7f142c0a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 --2- 172.21.15.28:0/3006991845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f142c0c06d0 0x7f142c0a9680 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f142c0a8b40 tx=0x7f142401c8b0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 -- 172.21.15.28:0/3006991845 shutdown_connections 2023-12-16T03:27:36.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 --2- 172.21.15.28:0/3006991845 >> v2:172.21.15.134:3300/0 conn(0x7f142c0c4100 0x7f142c0c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 --2- 172.21.15.28:0/3006991845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f142c0c06d0 0x7f142c0a9680 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 -- 172.21.15.28:0/3006991845 >> 172.21.15.28:0/3006991845 conn(0x7f142c06a5b0 msgr2=0x7f142c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:36.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 -- 172.21.15.28:0/3006991845 shutdown_connections 2023-12-16T03:27:36.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 -- 172.21.15.28:0/3006991845 wait complete. 2023-12-16T03:27:36.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 Processor -- start 2023-12-16T03:27:36.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 -- start start 2023-12-16T03:27:36.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f142c0c06d0 0x7f142c157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c0c4100 0x7f142c159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142c0c63c0 0x7f142c15b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0a52d0 con 0x7f142c0c06d0 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c1ed3b0 con 0x7f142c0c4100 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f14314fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0a4ff0 con 0x7f142c0c63c0 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f142c0c06d0 0x7f142c157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f142c0c06d0 0x7f142c157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39108/0 (socket says 172.21.15.28:39108) 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142affd640 1 -- 172.21.15.28:0/2837109666 learned_addr learned my addr 172.21.15.28:0/2837109666 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142a7fc640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c0c4100 0x7f142c159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142b7fe640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142c0c63c0 0x7f142c15b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142affd640 1 -- 172.21.15.28:0/2837109666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142c0c63c0 msgr2=0x7f142c15b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142affd640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142c0c63c0 0x7f142c15b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142affd640 1 -- 172.21.15.28:0/2837109666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c0c4100 msgr2=0x7f142c159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142affd640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c0c4100 0x7f142c159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142affd640 1 -- 172.21.15.28:0/2837109666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1424009b30 con 0x7f142c0c06d0 2023-12-16T03:27:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142b7fe640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142c0c63c0 0x7f142c15b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:36.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142a7fc640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c0c4100 0x7f142c159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:36.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.967+0000 7f142affd640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f142c0c06d0 0x7f142c157dc0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f141c00c3a0 tx=0x7f141c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:36.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.971+0000 7f14137fe640 1 -- 172.21.15.28:0/2837109666 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0052d0 con 0x7f142c0c06d0 2023-12-16T03:27:36.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.971+0000 7f14137fe640 1 -- 172.21.15.28:0/2837109666 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c005450 con 0x7f142c0c06d0 2023-12-16T03:27:36.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.971+0000 7f14137fe640 1 -- 172.21.15.28:0/2837109666 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c003860 con 0x7f142c0c06d0 2023-12-16T03:27:36.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.971+0000 7f14314fe640 1 -- 172.21.15.28:0/2837109666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c1ecd60 con 0x7f142c0c06d0 2023-12-16T03:27:36.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.971+0000 7f14314fe640 1 -- 172.21.15.28:0/2837109666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c06d8f0 con 0x7f142c0c06d0 2023-12-16T03:27:36.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.971+0000 7f14314fe640 1 -- 172.21.15.28:0/2837109666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142c1ecbc0 con 0x7f142c0c06d0 2023-12-16T03:27:36.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.971+0000 7f14137fe640 1 -- 172.21.15.28:0/2837109666 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f141c0039c0 con 0x7f142c0c06d0 2023-12-16T03:27:36.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.971+0000 7f14137fe640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1418066470 0x7f1418068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:36.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.971+0000 7f14137fe640 1 -- 172.21.15.28:0/2837109666 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f141c083720 con 0x7f142c0c06d0 2023-12-16T03:27:36.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.971+0000 7f142a7fc640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1418066470 0x7f1418068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:36.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.971+0000 7f142a7fc640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1418066470 0x7f1418068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f142c1edcf0 tx=0x7f1420008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:36.975+0000 7f14137fe640 1 -- 172.21.15.28:0/2837109666 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f142c1ecbc0 con 0x7f142c0c06d0 2023-12-16T03:27:37.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.131+0000 7f14314fe640 1 -- 172.21.15.28:0/2837109666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f142c1ecbc0 con 0x7f142c0c06d0 2023-12-16T03:27:37.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.131+0000 7f14137fe640 1 -- 172.21.15.28:0/2837109666 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f142c1ecbc0 con 0x7f142c0c06d0 2023-12-16T03:27:37.135 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:27:37.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.131+0000 7f14314fe640 1 -- 172.21.15.28:0/2837109666 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1418066470 msgr2=0x7f1418068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.131+0000 7f14314fe640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1418066470 0x7f1418068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f142c1edcf0 tx=0x7f1420008040 comp rx=0 tx=0).stop 2023-12-16T03:27:37.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.131+0000 7f14314fe640 1 -- 172.21.15.28:0/2837109666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f142c0c06d0 msgr2=0x7f142c157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.131+0000 7f14314fe640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f142c0c06d0 0x7f142c157dc0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f141c00c3a0 tx=0x7f141c00c860 comp rx=0 tx=0).stop 2023-12-16T03:27:37.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.131+0000 7f14314fe640 1 -- 172.21.15.28:0/2837109666 shutdown_connections 2023-12-16T03:27:37.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.131+0000 7f14314fe640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142c0c63c0 0x7f142c15b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.131+0000 7f14314fe640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c0c4100 0x7f142c159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.135+0000 7f14314fe640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1418066470 0x7f1418068930 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.135+0000 7f14314fe640 1 --2- 172.21.15.28:0/2837109666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f142c0c06d0 0x7f142c157dc0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.135+0000 7f14314fe640 1 -- 172.21.15.28:0/2837109666 >> 172.21.15.28:0/2837109666 conn(0x7f142c06a5b0 msgr2=0x7f142c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:37.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.135+0000 7f14314fe640 1 -- 172.21.15.28:0/2837109666 shutdown_connections 2023-12-16T03:27:37.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.135+0000 7f14314fe640 1 -- 172.21.15.28:0/2837109666 wait complete. 2023-12-16T03:27:37.156 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:27:37.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7fd2e3640 1 Processor -- start 2023-12-16T03:27:37.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7fd2e3640 1 -- start start 2023-12-16T03:27:37.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7fd2e3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe7f806bbb0 0x7fe7f81600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7fd2e3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f806c860 con 0x7fe7f8151e90 2023-12-16T03:27:37.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7fd2e3640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f806c000 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7fd2e3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f80c8750 con 0x7fe7f806bbb0 2023-12-16T03:27:37.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7f6ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe7f8151e90 0x7fe7f80c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40672/0 (socket says 172.21.15.28:40672) 2023-12-16T03:27:37.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7f6ffd640 1 -- 172.21.15.28:0/4065368194 learned_addr learned my addr 172.21.15.28:0/4065368194 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:37.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7f77fe640 1 --2- 172.21.15.28:0/4065368194 >> v2:172.21.15.134:3300/0 conn(0x7fe7f806bbb0 0x7fe7f81600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7f5ffb640 1 -- 172.21.15.28:0/4065368194 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214604537 0 0) 0x7fe7f806c860 con 0x7fe7f8151e90 2023-12-16T03:27:37.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7f5ffb640 1 -- 172.21.15.28:0/4065368194 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e0003530 con 0x7fe7f8151e90 2023-12-16T03:27:37.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7f77fe640 1 -- 172.21.15.28:0/4065368194 >> v1:172.21.15.134:6789/0 conn(0x7fe7f80c7ea0 legacy=0x7fe7f806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7f5ffb640 1 -- 172.21.15.28:0/4065368194 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1991568321 0 0) 0x7fe7e0003530 con 0x7fe7f8151e90 2023-12-16T03:27:37.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7f77fe640 1 -- 172.21.15.28:0/4065368194 >> v1:172.21.15.28:6789/0 conn(0x7fe7f8151e90 legacy=0x7fe7f80c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.299+0000 7fe7f77fe640 1 -- 172.21.15.28:0/4065368194 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f8154930 con 0x7fe7f806bbb0 2023-12-16T03:27:37.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.303+0000 7fe7f77fe640 1 --2- 172.21.15.28:0/4065368194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f806bbb0 0x7fe7f81600b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009d90 tx=0x7fe7f001c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15038fcee59f17c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:37.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.303+0000 7fe7f5ffb640 1 -- 172.21.15.28:0/4065368194 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8001680 con 0x7fe7f806bbb0 2023-12-16T03:27:37.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.303+0000 7fe7f5ffb640 1 -- 172.21.15.28:0/4065368194 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f00b0400 con 0x7fe7f806bbb0 2023-12-16T03:27:37.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.303+0000 7fe7f5ffb640 1 -- 172.21.15.28:0/4065368194 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00b0770 con 0x7fe7f806bbb0 2023-12-16T03:27:37.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.303+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/4065368194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f806bbb0 msgr2=0x7fe7f81600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.303+0000 7fe7fd2e3640 1 --2- 172.21.15.28:0/4065368194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f806bbb0 0x7fe7f81600b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009d90 tx=0x7fe7f001c750 comp rx=0 tx=0).stop 2023-12-16T03:27:37.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.303+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/4065368194 shutdown_connections 2023-12-16T03:27:37.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.303+0000 7fe7fd2e3640 1 --2- 172.21.15.28:0/4065368194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f806bbb0 0x7fe7f81600b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.303+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/4065368194 >> 172.21.15.28:0/4065368194 conn(0x7fe7f80ca170 msgr2=0x7fe7f80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:37.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.303+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/4065368194 shutdown_connections 2023-12-16T03:27:37.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.303+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/4065368194 wait complete. 2023-12-16T03:27:37.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7fd2e3640 1 Processor -- start 2023-12-16T03:27:37.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7fd2e3640 1 -- start start 2023-12-16T03:27:37.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7fd2e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f806bbb0 0x7fe7f8153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7fd2e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7f80c7ea0 0x7fe7f81ee150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7fd2e3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7f8151e90 0x7fe7f81ee690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7fd2e3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f81552d0 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7fd2e3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f81eebd0 con 0x7fe7f806bbb0 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7fd2e3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80ad6f0 con 0x7fe7f8151e90 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f67fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7f80c7ea0 0x7fe7f81ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f67fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7f80c7ea0 0x7fe7f81ee150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39120/0 (socket says 172.21.15.28:39120) 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f67fc640 1 -- 172.21.15.28:0/1722269817 learned_addr learned my addr 172.21.15.28:0/1722269817 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f6ffd640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f806bbb0 0x7fe7f8153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f77fe640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7f8151e90 0x7fe7f81ee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f67fc640 1 -- 172.21.15.28:0/1722269817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7f8151e90 msgr2=0x7fe7f81ee690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f67fc640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7f8151e90 0x7fe7f81ee690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f67fc640 1 -- 172.21.15.28:0/1722269817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f806bbb0 msgr2=0x7fe7f8153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f67fc640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f806bbb0 0x7fe7f8153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f67fc640 1 -- 172.21.15.28:0/1722269817 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f0009a70 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f6ffd640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f806bbb0 0x7fe7f8153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:37.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f77fe640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7f8151e90 0x7fe7f81ee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:37.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7f67fc640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7f80c7ea0 0x7fe7f81ee150 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c530 tx=0x7fe7ec00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:37.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7df7fe640 1 -- 172.21.15.28:0/1722269817 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec005220 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7df7fe640 1 -- 172.21.15.28:0/1722269817 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec005380 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/1722269817 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f814eeb0 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7df7fe640 1 -- 172.21.15.28:0/1722269817 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec007270 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.307+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/1722269817 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f80c25f0 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.311+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/1722269817 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f80c20c0 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.311+0000 7fe7df7fe640 1 -- 172.21.15.28:0/1722269817 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe7ec0073d0 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.311+0000 7fe7df7fe640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe7e40664a0 0x7fe7e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.311+0000 7fe7df7fe640 1 -- 172.21.15.28:0/1722269817 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe7ec083a50 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.311+0000 7fe7f6ffd640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe7e40664a0 0x7fe7e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.311+0000 7fe7f6ffd640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe7e40664a0 0x7fe7e4068960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8005890 tx=0x7fe7e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:37.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.315+0000 7fe7df7fe640 1 -- 172.21.15.28:0/1722269817 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe7ec050c00 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/1722269817 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7f8068400 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7df7fe640 1 -- 172.21.15.28:0/1722269817 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe7ec054220 con 0x7fe7f80c7ea0 2023-12-16T03:27:37.478 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:27:37.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/1722269817 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe7e40664a0 msgr2=0x7fe7e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe7e40664a0 0x7fe7e4068960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8005890 tx=0x7fe7e8009040 comp rx=0 tx=0).stop 2023-12-16T03:27:37.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/1722269817 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7f80c7ea0 msgr2=0x7fe7f81ee150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7f80c7ea0 0x7fe7f81ee150 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c530 tx=0x7fe7ec00c9f0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/1722269817 shutdown_connections 2023-12-16T03:27:37.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe7f8151e90 0x7fe7f81ee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe7e40664a0 0x7fe7e4068960 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7f80c7ea0 0x7fe7f81ee150 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 --2- 172.21.15.28:0/1722269817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7f806bbb0 0x7fe7f8153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/1722269817 >> 172.21.15.28:0/1722269817 conn(0x7fe7f80ca170 msgr2=0x7fe7f8150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:37.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/1722269817 shutdown_connections 2023-12-16T03:27:37.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.475+0000 7fe7fd2e3640 1 -- 172.21.15.28:0/1722269817 wait complete. 2023-12-16T03:27:37.499 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:27:37.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac7c9c640 1 Processor -- start 2023-12-16T03:27:37.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac7c9c640 1 -- start start 2023-12-16T03:27:37.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac7c9c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 0x7faac015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac7c9c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faac006d520 0x7faac0159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac7c9c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac015c600 con 0x7faac00bffc0 2023-12-16T03:27:37.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac7c9c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac01594e0 con 0x7faac006d520 2023-12-16T03:27:37.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac7c9c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac01597c0 con 0x7faac01560e0 2023-12-16T03:27:37.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac5a38640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 0x7faac015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac5237640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faac006d520 0x7faac0159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac5a38640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 0x7faac015ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:46834/0 (socket says 172.21.15.28:46834) 2023-12-16T03:27:37.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac5a38640 1 -- 172.21.15.28:0/1601783045 learned_addr learned my addr 172.21.15.28:0/1601783045 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:37.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac4a36640 1 -- 172.21.15.28:0/1601783045 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895187780 0 0) 0x7faac015c600 con 0x7faac00bffc0 2023-12-16T03:27:37.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac4a36640 1 -- 172.21.15.28:0/1601783045 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaac003530 con 0x7faac00bffc0 2023-12-16T03:27:37.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac5237640 1 -- 172.21.15.28:0/1601783045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 msgr2=0x7faac015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:37.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac5237640 1 --2- 172.21.15.28:0/1601783045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 0x7faac015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac5237640 1 -- 172.21.15.28:0/1601783045 >> v1:172.21.15.134:6789/0 conn(0x7faac00bffc0 legacy=0x7faac00c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac5237640 1 -- 172.21.15.28:0/1601783045 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac015bfb0 con 0x7faac006d520 2023-12-16T03:27:37.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.643+0000 7faac5a38640 1 --2- 172.21.15.28:0/1601783045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 0x7faac015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:37.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac5237640 1 --2- 172.21.15.28:0/1601783045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac006d520 0x7faac0159eb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faab00097c0 tx=0x7faab001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=912d364d99ddbb5c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:37.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac4a36640 1 -- 172.21.15.28:0/1601783045 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac01566d0 con 0x7faac006d520 2023-12-16T03:27:37.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac4a36640 1 -- 172.21.15.28:0/1601783045 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab00ab670 con 0x7faac006d520 2023-12-16T03:27:37.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac4a36640 1 -- 172.21.15.28:0/1601783045 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00aba00 con 0x7faac006d520 2023-12-16T03:27:37.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac7c9c640 1 -- 172.21.15.28:0/1601783045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac006d520 msgr2=0x7faac0159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac7c9c640 1 --2- 172.21.15.28:0/1601783045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac006d520 0x7faac0159eb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faab00097c0 tx=0x7faab001c450 comp rx=0 tx=0).stop 2023-12-16T03:27:37.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac7c9c640 1 -- 172.21.15.28:0/1601783045 shutdown_connections 2023-12-16T03:27:37.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac7c9c640 1 --2- 172.21.15.28:0/1601783045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac006d520 0x7faac0159eb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac7c9c640 1 --2- 172.21.15.28:0/1601783045 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 0x7faac015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac7c9c640 1 -- 172.21.15.28:0/1601783045 >> 172.21.15.28:0/1601783045 conn(0x7faac006a5b0 msgr2=0x7faac006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:37.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac7c9c640 1 -- 172.21.15.28:0/1601783045 shutdown_connections 2023-12-16T03:27:37.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.647+0000 7faac7c9c640 1 -- 172.21.15.28:0/1601783045 wait complete. 2023-12-16T03:27:37.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac7c9c640 1 Processor -- start 2023-12-16T03:27:37.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac7c9c640 1 -- start start 2023-12-16T03:27:37.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac7c9c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac006d520 0x7faac0152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac7c9c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac00bffc0 0x7faac01f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac7c9c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 0x7faac01f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac7c9c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac0153e60 con 0x7faac00bffc0 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac7c9c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac0154ba0 con 0x7faac006d520 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac7c9c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac0154f50 con 0x7faac01560e0 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac5237640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac00bffc0 0x7faac01f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac5237640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac00bffc0 0x7faac01f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39128/0 (socket says 172.21.15.28:39128) 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac5237640 1 -- 172.21.15.28:0/2154610089 learned_addr learned my addr 172.21.15.28:0/2154610089 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac5a38640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac006d520 0x7faac0152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac6239640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 0x7faac01f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac5237640 1 -- 172.21.15.28:0/2154610089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 msgr2=0x7faac01f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac5237640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 0x7faac01f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac5237640 1 -- 172.21.15.28:0/2154610089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac006d520 msgr2=0x7faac0152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac5237640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac006d520 0x7faac0152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac5237640 1 -- 172.21.15.28:0/2154610089 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc0094d0 con 0x7faac00bffc0 2023-12-16T03:27:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac6239640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 0x7faac01f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:37.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac5237640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac00bffc0 0x7faac01f43f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faab00ad040 tx=0x7faab001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:37.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faab67fc640 1 -- 172.21.15.28:0/2154610089 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00b5610 con 0x7faac00bffc0 2023-12-16T03:27:37.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faab67fc640 1 -- 172.21.15.28:0/2154610089 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab00b57b0 con 0x7faac00bffc0 2023-12-16T03:27:37.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faab67fc640 1 -- 172.21.15.28:0/2154610089 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00b5b60 con 0x7faac00bffc0 2023-12-16T03:27:37.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac7c9c640 1 -- 172.21.15.28:0/2154610089 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab0009420 con 0x7faac00bffc0 2023-12-16T03:27:37.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.651+0000 7faac7c9c640 1 -- 172.21.15.28:0/2154610089 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac01f4e70 con 0x7faac00bffc0 2023-12-16T03:27:37.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.655+0000 7faac7c9c640 1 -- 172.21.15.28:0/2154610089 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac0068400 con 0x7faac00bffc0 2023-12-16T03:27:37.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.655+0000 7faab67fc640 1 -- 172.21.15.28:0/2154610089 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7faab00b5cc0 con 0x7faac00bffc0 2023-12-16T03:27:37.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.655+0000 7faab67fc640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faaa4066470 0x7faaa4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.655+0000 7faab67fc640 1 -- 172.21.15.28:0/2154610089 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faab011e9e0 con 0x7faac00bffc0 2023-12-16T03:27:37.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.655+0000 7faac5a38640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faaa4066470 0x7faaa4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.655+0000 7faac5a38640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faaa4066470 0x7faaa4068930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faac00ab0c0 tx=0x7faabc009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:37.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.659+0000 7faab67fc640 1 -- 172.21.15.28:0/2154610089 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7faab00ebb10 con 0x7faac00bffc0 2023-12-16T03:27:37.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.819+0000 7faac7c9c640 1 -- 172.21.15.28:0/2154610089 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7faac0164130 con 0x7faac00bffc0 2023-12-16T03:27:37.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.819+0000 7faab67fc640 1 -- 172.21.15.28:0/2154610089 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7faab00ef130 con 0x7faac00bffc0 2023-12-16T03:27:37.824 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 -- 172.21.15.28:0/2154610089 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faaa4066470 msgr2=0x7faaa4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faaa4066470 0x7faaa4068930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faac00ab0c0 tx=0x7faabc009240 comp rx=0 tx=0).stop 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 -- 172.21.15.28:0/2154610089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac00bffc0 msgr2=0x7faac01f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac00bffc0 0x7faac01f43f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faab00ad040 tx=0x7faab001ac90 comp rx=0 tx=0).stop 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 -- 172.21.15.28:0/2154610089 shutdown_connections 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faac01560e0 0x7faac01f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faaa4066470 0x7faaa4068930 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac00bffc0 0x7faac01f43f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 --2- 172.21.15.28:0/2154610089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faac006d520 0x7faac0152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 -- 172.21.15.28:0/2154610089 >> 172.21.15.28:0/2154610089 conn(0x7faac006a5b0 msgr2=0x7faac0158600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 -- 172.21.15.28:0/2154610089 shutdown_connections 2023-12-16T03:27:37.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.823+0000 7faac7c9c640 1 -- 172.21.15.28:0/2154610089 wait complete. 2023-12-16T03:27:37.846 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:27:37.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc70f1d640 1 Processor -- start 2023-12-16T03:27:37.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc70f1d640 1 -- start start 2023-12-16T03:27:37.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc70f1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 0x7efc6c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc70f1d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc6c0c76a0 0x7efc6c06f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc70f1d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efc6c06fcb0 0x7efc6c1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc70f1d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c06ec40 con 0x7efc6c06fcb0 2023-12-16T03:27:37.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc70f1d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c156820 con 0x7efc6c0c76a0 2023-12-16T03:27:37.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc70f1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0a7830 con 0x7efc6c0a7450 2023-12-16T03:27:37.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc6ad9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efc6c06fcb0 0x7efc6c1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc6ad9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efc6c06fcb0 0x7efc6c1526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39134/0 (socket says 172.21.15.28:39134) 2023-12-16T03:27:37.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc6ad9d640 1 -- 172.21.15.28:0/1079652978 learned_addr learned my addr 172.21.15.28:0/1079652978 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:37.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc6a59c640 1 --2- 172.21.15.28:0/1079652978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 0x7efc6c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc63fff640 1 --2- 172.21.15.28:0/1079652978 >> v2:172.21.15.134:3300/0 conn(0x7efc6c0c76a0 0x7efc6c06f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc6ad9d640 1 -- 172.21.15.28:0/1079652978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 msgr2=0x7efc6c06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:37.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc6ad9d640 1 --2- 172.21.15.28:0/1079652978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 0x7efc6c06dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc6ad9d640 1 -- 172.21.15.28:0/1079652978 >> v2:172.21.15.134:3300/0 conn(0x7efc6c0c76a0 msgr2=0x7efc6c06f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:37.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc6ad9d640 1 --2- 172.21.15.28:0/1079652978 >> v2:172.21.15.134:3300/0 conn(0x7efc6c0c76a0 0x7efc6c06f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc6ad9d640 1 -- 172.21.15.28:0/1079652978 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c06e1b0 con 0x7efc6c06fcb0 2023-12-16T03:27:37.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc6a59c640 1 --2- 172.21.15.28:0/1079652978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 0x7efc6c06dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:37.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.987+0000 7efc63fff640 1 --2- 172.21.15.28:0/1079652978 >> v2:172.21.15.134:3300/0 conn(0x7efc6c0c76a0 0x7efc6c06f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:37.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc6ad9d640 1 --2- 172.21.15.28:0/1079652978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc6c06fcb0 0x7efc6c1526e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0aac50 tx=0x7efc6401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beccc62f709e6922 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:37.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc69d9b640 1 -- 172.21.15.28:0/1079652978 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c153430 con 0x7efc6c06fcb0 2023-12-16T03:27:37.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc69d9b640 1 -- 172.21.15.28:0/1079652978 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640a5790 con 0x7efc6c06fcb0 2023-12-16T03:27:37.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc69d9b640 1 -- 172.21.15.28:0/1079652978 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640a5b20 con 0x7efc6c06fcb0 2023-12-16T03:27:37.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc70f1d640 1 -- 172.21.15.28:0/1079652978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc6c06fcb0 msgr2=0x7efc6c1526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc70f1d640 1 --2- 172.21.15.28:0/1079652978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc6c06fcb0 0x7efc6c1526e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0aac50 tx=0x7efc6401c910 comp rx=0 tx=0).stop 2023-12-16T03:27:37.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc70f1d640 1 -- 172.21.15.28:0/1079652978 shutdown_connections 2023-12-16T03:27:37.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc70f1d640 1 --2- 172.21.15.28:0/1079652978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc6c06fcb0 0x7efc6c1526e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc70f1d640 1 --2- 172.21.15.28:0/1079652978 >> v2:172.21.15.134:3300/0 conn(0x7efc6c0c76a0 0x7efc6c06f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc70f1d640 1 --2- 172.21.15.28:0/1079652978 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 0x7efc6c06dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc70f1d640 1 -- 172.21.15.28:0/1079652978 >> 172.21.15.28:0/1079652978 conn(0x7efc6c0c7e40 msgr2=0x7efc6c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:37.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc70f1d640 1 -- 172.21.15.28:0/1079652978 shutdown_connections 2023-12-16T03:27:37.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc70f1d640 1 -- 172.21.15.28:0/1079652978 wait complete. 2023-12-16T03:27:37.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc70f1d640 1 Processor -- start 2023-12-16T03:27:37.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.991+0000 7efc70f1d640 1 -- start start 2023-12-16T03:27:37.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc70f1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc6c06fcb0 0x7efc6c0c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc70f1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 0x7efc6c145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc70f1d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc6c0c76a0 0x7efc6c0abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc70f1d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c1efd80 con 0x7efc6c0c76a0 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc70f1d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c14bd70 con 0x7efc6c06fcb0 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc70f1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c1effd0 con 0x7efc6c0a7450 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc6ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc6c0c76a0 0x7efc6c0abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc6ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc6c0c76a0 0x7efc6c0abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39150/0 (socket says 172.21.15.28:39150) 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc6ad9d640 1 -- 172.21.15.28:0/1122039826 learned_addr learned my addr 172.21.15.28:0/1122039826 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc63fff640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 0x7efc6c145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc6a59c640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc6c06fcb0 0x7efc6c0c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc6ad9d640 1 -- 172.21.15.28:0/1122039826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 msgr2=0x7efc6c145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc6ad9d640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 0x7efc6c145b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc6ad9d640 1 -- 172.21.15.28:0/1122039826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc6c06fcb0 msgr2=0x7efc6c0c3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:37.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc6ad9d640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc6c06fcb0 0x7efc6c0c3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc6ad9d640 1 -- 172.21.15.28:0/1122039826 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64009b30 con 0x7efc6c0c76a0 2023-12-16T03:27:38.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc63fff640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 0x7efc6c145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:38.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc6a59c640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc6c06fcb0 0x7efc6c0c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:38.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc6ad9d640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc6c0c76a0 0x7efc6c0abc80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7efc640af040 tx=0x7efc640196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:38.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc62ffd640 1 -- 172.21.15.28:0/1122039826 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640b8670 con 0x7efc6c0c76a0 2023-12-16T03:27:38.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc62ffd640 1 -- 172.21.15.28:0/1122039826 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640b87d0 con 0x7efc6c0c76a0 2023-12-16T03:27:38.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc70f1d640 1 -- 172.21.15.28:0/1122039826 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c1f02b0 con 0x7efc6c0c76a0 2023-12-16T03:27:38.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc62ffd640 1 -- 172.21.15.28:0/1122039826 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640b8b80 con 0x7efc6c0c76a0 2023-12-16T03:27:38.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc70f1d640 1 -- 172.21.15.28:0/1122039826 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c1f0870 con 0x7efc6c0c76a0 2023-12-16T03:27:38.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.995+0000 7efc70f1d640 1 -- 172.21.15.28:0/1122039826 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c0ac980 con 0x7efc6c0c76a0 2023-12-16T03:27:38.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.999+0000 7efc62ffd640 1 -- 172.21.15.28:0/1122039826 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7efc640b8ce0 con 0x7efc6c0c76a0 2023-12-16T03:27:38.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.999+0000 7efc62ffd640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc4c066470 0x7efc4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.999+0000 7efc62ffd640 1 -- 172.21.15.28:0/1122039826 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efc6411f8d0 con 0x7efc6c0c76a0 2023-12-16T03:27:38.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.999+0000 7efc6a59c640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc4c066470 0x7efc4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:37.999+0000 7efc6a59c640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc4c066470 0x7efc4c068930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efc5c006fd0 tx=0x7efc5c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:38.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.003+0000 7efc62ffd640 1 -- 172.21.15.28:0/1122039826 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7efc640ecb00 con 0x7efc6c0c76a0 2023-12-16T03:27:38.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.195+0000 7efc70f1d640 1 -- 172.21.15.28:0/1122039826 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc6c068400 con 0x7efc6c0c76a0 2023-12-16T03:27:38.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.195+0000 7efc62ffd640 1 -- 172.21.15.28:0/1122039826 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6188 (secure 0 0 0) 0x7efc640f0120 con 0x7efc6c0c76a0 2023-12-16T03:27:38.200 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:38.200 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3665146461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":3665146461},{"type":"v1","addr":"172.21.15.28:6837","nonce":3665146461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1938417336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1938417336},{"type":"v1","addr":"172.21.15.134:6835","nonce":1938417336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:00.888034+0000","modified":"2023-12-16T03:27:03.912013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/3717643902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3717643902},{"type":"v1","addr":"172.21.15.28:6836","nonce":3717643902}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:13.968886+0000","modified":"2023-12-16T03:27:17.002993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6834/4009894510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4009894510},{"type":"v1","addr":"172.21.15.134:6834","nonce":4009894510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-16T03:27:38.200 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 36 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 -- 172.21.15.28:0/1122039826 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc4c066470 msgr2=0x7efc4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc4c066470 0x7efc4c068930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efc5c006fd0 tx=0x7efc5c008040 comp rx=0 tx=0).stop 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 -- 172.21.15.28:0/1122039826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc6c0c76a0 msgr2=0x7efc6c0abc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc6c0c76a0 0x7efc6c0abc80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7efc640af040 tx=0x7efc640196b0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 -- 172.21.15.28:0/1122039826 shutdown_connections 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc4c066470 0x7efc4c068930 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc6c0c76a0 0x7efc6c0abc80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc6c0a7450 0x7efc6c145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 --2- 172.21.15.28:0/1122039826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc6c06fcb0 0x7efc6c0c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 -- 172.21.15.28:0/1122039826 >> 172.21.15.28:0/1122039826 conn(0x7efc6c0c7e40 msgr2=0x7efc6c0c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 -- 172.21.15.28:0/1122039826 shutdown_connections 2023-12-16T03:27:38.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.199+0000 7efc70f1d640 1 -- 172.21.15.28:0/1122039826 wait complete. 2023-12-16T03:27:38.221 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:38.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.359+0000 7f0df998d640 1 Processor -- start 2023-12-16T03:27:38.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.359+0000 7f0df998d640 1 -- start start 2023-12-16T03:27:38.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.359+0000 7f0df998d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0df4072090 0x7f0df4150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.359+0000 7f0df998d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df40c2760 con 0x7f0df40725c0 2023-12-16T03:27:38.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.359+0000 7f0df998d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df40a5750 con 0x7f0df40a5370 2023-12-16T03:27:38.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.359+0000 7f0df998d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40c3070 con 0x7f0df4072090 2023-12-16T03:27:38.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.363+0000 7f0df37fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0df40725c0 0x7f0df41514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40678/0 (socket says 172.21.15.28:40678) 2023-12-16T03:27:38.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.363+0000 7f0df37fe640 1 -- 172.21.15.28:0/4170341135 learned_addr learned my addr 172.21.15.28:0/4170341135 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:38.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.363+0000 7f0debfff640 1 --2- 172.21.15.28:0/4170341135 >> v2:172.21.15.134:3300/0 conn(0x7f0df4072090 0x7f0df4150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.363+0000 7f0df27fc640 1 -- 172.21.15.28:0/4170341135 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220350166 0 0) 0x7f0df40c2760 con 0x7f0df40725c0 2023-12-16T03:27:38.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.363+0000 7f0df27fc640 1 -- 172.21.15.28:0/4170341135 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de0003530 con 0x7f0df40725c0 2023-12-16T03:27:38.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.363+0000 7f0debfff640 1 -- 172.21.15.28:0/4170341135 >> v1:172.21.15.134:6789/0 conn(0x7f0df40a5370 legacy=0x7f0df40c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.363+0000 7f0debfff640 1 -- 172.21.15.28:0/4170341135 >> v1:172.21.15.28:6789/0 conn(0x7f0df40725c0 legacy=0x7f0df41514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.363+0000 7f0debfff640 1 -- 172.21.15.28:0/4170341135 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40aad20 con 0x7f0df4072090 2023-12-16T03:27:38.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.363+0000 7f0debfff640 1 --2- 172.21.15.28:0/4170341135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4072090 0x7f0df4150fa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0097c0 tx=0x7f0ddc01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3709ccd46ca6aeae server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:38.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df27fc640 1 -- 172.21.15.28:0/4170341135 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0ab600 con 0x7f0df4072090 2023-12-16T03:27:38.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df27fc640 1 -- 172.21.15.28:0/4170341135 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc0a7050 con 0x7f0df4072090 2023-12-16T03:27:38.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df27fc640 1 -- 172.21.15.28:0/4170341135 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0ab980 con 0x7f0df4072090 2023-12-16T03:27:38.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 -- 172.21.15.28:0/4170341135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4072090 msgr2=0x7f0df4150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 --2- 172.21.15.28:0/4170341135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4072090 0x7f0df4150fa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0097c0 tx=0x7f0ddc01c360 comp rx=0 tx=0).stop 2023-12-16T03:27:38.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 -- 172.21.15.28:0/4170341135 shutdown_connections 2023-12-16T03:27:38.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 --2- 172.21.15.28:0/4170341135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df4072090 0x7f0df4150fa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 -- 172.21.15.28:0/4170341135 >> 172.21.15.28:0/4170341135 conn(0x7f0df406a5b0 msgr2=0x7f0df406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:38.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 -- 172.21.15.28:0/4170341135 shutdown_connections 2023-12-16T03:27:38.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 -- 172.21.15.28:0/4170341135 wait complete. 2023-12-16T03:27:38.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 Processor -- start 2023-12-16T03:27:38.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 -- start start 2023-12-16T03:27:38.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0df4072090 0x7f0df41ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0df40725c0 0x7f0df4154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df40a5370 0x7f0df414bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41ece70 con 0x7f0df40725c0 2023-12-16T03:27:38.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df414e410 con 0x7f0df40a5370 2023-12-16T03:27:38.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df998d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df414e6f0 con 0x7f0df4072090 2023-12-16T03:27:38.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0debfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0df40725c0 0x7f0df4154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0debfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0df40725c0 0x7f0df4154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39156/0 (socket says 172.21.15.28:39156) 2023-12-16T03:27:38.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0debfff640 1 -- 172.21.15.28:0/4096564928 learned_addr learned my addr 172.21.15.28:0/4096564928 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:38.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df2ffd640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0df4072090 0x7f0df41ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.367+0000 7f0df37fe640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df40a5370 0x7f0df414bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0debfff640 1 -- 172.21.15.28:0/4096564928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0df4072090 msgr2=0x7f0df41ed930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0debfff640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0df4072090 0x7f0df41ed930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0debfff640 1 -- 172.21.15.28:0/4096564928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df40a5370 msgr2=0x7f0df414bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0debfff640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df40a5370 0x7f0df414bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0debfff640 1 -- 172.21.15.28:0/4096564928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc009420 con 0x7f0df40725c0 2023-12-16T03:27:38.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0debfff640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0df40725c0 0x7f0df4154a50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0ae040 tx=0x7f0ddc019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:38.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0df0ff9640 1 -- 172.21.15.28:0/4096564928 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0b4430 con 0x7f0df40725c0 2023-12-16T03:27:38.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0df0ff9640 1 -- 172.21.15.28:0/4096564928 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc0b4590 con 0x7f0df40725c0 2023-12-16T03:27:38.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0df0ff9640 1 -- 172.21.15.28:0/4096564928 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0b4940 con 0x7f0df40725c0 2023-12-16T03:27:38.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0df998d640 1 -- 172.21.15.28:0/4096564928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df41ed130 con 0x7f0df40725c0 2023-12-16T03:27:38.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0df998d640 1 -- 172.21.15.28:0/4096564928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df4154f90 con 0x7f0df40725c0 2023-12-16T03:27:38.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0df998d640 1 -- 172.21.15.28:0/4096564928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df4068400 con 0x7f0df40725c0 2023-12-16T03:27:38.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0df0ff9640 1 -- 172.21.15.28:0/4096564928 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0ddc0b2040 con 0x7f0df40725c0 2023-12-16T03:27:38.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.371+0000 7f0df0ff9640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0dd4066470 0x7f0dd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.375+0000 7f0df0ff9640 1 -- 172.21.15.28:0/4096564928 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0ddc11df80 con 0x7f0df40725c0 2023-12-16T03:27:38.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.375+0000 7f0df2ffd640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0dd4066470 0x7f0dd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.375+0000 7f0df2ffd640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0dd4066470 0x7f0dd4068930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0de4000f70 tx=0x7f0de4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:38.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.379+0000 7f0df0ff9640 1 -- 172.21.15.28:0/4096564928 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0ddc0eb090 con 0x7f0df40725c0 2023-12-16T03:27:38.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.539+0000 7f0df998d640 1 -- 172.21.15.28:0/4096564928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0df40c6780 con 0x7f0df40725c0 2023-12-16T03:27:38.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.539+0000 7f0df0ff9640 1 -- 172.21.15.28:0/4096564928 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20280 (secure 0 0 0) 0x7f0ddc0ee6b0 con 0x7f0df40725c0 2023-12-16T03:27:38.543 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:38.543 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":54,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:15.600556+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:38.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 -- 172.21.15.28:0/4096564928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0dd4066470 msgr2=0x7f0dd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0dd4066470 0x7f0dd4068930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0de4000f70 tx=0x7f0de4009040 comp rx=0 tx=0).stop 2023-12-16T03:27:38.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 -- 172.21.15.28:0/4096564928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0df40725c0 msgr2=0x7f0df4154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0df40725c0 0x7f0df4154a50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0ae040 tx=0x7f0ddc019100 comp rx=0 tx=0).stop 2023-12-16T03:27:38.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 -- 172.21.15.28:0/4096564928 shutdown_connections 2023-12-16T03:27:38.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0df40a5370 0x7f0df414bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0dd4066470 0x7f0dd4068930 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0df40725c0 0x7f0df4154a50 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 --2- 172.21.15.28:0/4096564928 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0df4072090 0x7f0df41ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 -- 172.21.15.28:0/4096564928 >> 172.21.15.28:0/4096564928 conn(0x7f0df406a5b0 msgr2=0x7f0df40c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:38.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 -- 172.21.15.28:0/4096564928 shutdown_connections 2023-12-16T03:27:38.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.543+0000 7f0df998d640 1 -- 172.21.15.28:0/4096564928 wait complete. 2023-12-16T03:27:38.565 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-16T03:27:38.565 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:27:38.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4684468640 1 Processor -- start 2023-12-16T03:27:38.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4684468640 1 -- start start 2023-12-16T03:27:38.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4684468640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f467c0c7ea0 0x7f467c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4684468640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f467c06b9e0 0x7f467c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4684468640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c06c860 con 0x7f467c151e90 2023-12-16T03:27:38.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4684468640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c0c8750 con 0x7f467c06b9e0 2023-12-16T03:27:38.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4684468640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c1552d0 con 0x7f467c0c7ea0 2023-12-16T03:27:38.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4682a05640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f467c06b9e0 0x7f467c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4682a05640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f467c06b9e0 0x7f467c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39168/0 (socket says 172.21.15.28:39168) 2023-12-16T03:27:38.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4682a05640 1 -- 172.21.15.28:0/1409900667 learned_addr learned my addr 172.21.15.28:0/1409900667 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:38.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4682204640 1 --1- 172.21.15.28:0/1409900667 >> v1:172.21.15.28:6789/0 conn(0x7f467c151e90 0x7f467c0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40690/0 (socket says 172.21.15.28:40690) 2023-12-16T03:27:38.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.707+0000 7f4681a03640 1 --2- 172.21.15.28:0/1409900667 >> v2:172.21.15.134:3300/0 conn(0x7f467c0c7ea0 0x7f467c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.711+0000 7f4682a05640 1 -- 172.21.15.28:0/1409900667 >> v2:172.21.15.134:3300/0 conn(0x7f467c0c7ea0 msgr2=0x7f467c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:38.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.711+0000 7f4682a05640 1 --2- 172.21.15.28:0/1409900667 >> v2:172.21.15.134:3300/0 conn(0x7f467c0c7ea0 0x7f467c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.711+0000 7f4682a05640 1 -- 172.21.15.28:0/1409900667 >> v1:172.21.15.28:6789/0 conn(0x7f467c151e90 legacy=0x7f467c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.711+0000 7f4682a05640 1 -- 172.21.15.28:0/1409900667 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c154930 con 0x7f467c06b9e0 2023-12-16T03:27:38.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.711+0000 7f4681a03640 1 --2- 172.21.15.28:0/1409900667 >> v2:172.21.15.134:3300/0 conn(0x7f467c0c7ea0 0x7f467c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:38.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.711+0000 7f4682a05640 1 --2- 172.21.15.28:0/1409900667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f467c06b9e0 0x7f467c15f0a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f467c0a9a70 tx=0x7f467401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc308e7a3ef4ad23 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:38.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.711+0000 7f4681202640 1 -- 172.21.15.28:0/1409900667 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740a5570 con 0x7f467c06b9e0 2023-12-16T03:27:38.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.711+0000 7f4681202640 1 -- 172.21.15.28:0/1409900667 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46740a56d0 con 0x7f467c06b9e0 2023-12-16T03:27:38.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.711+0000 7f4681202640 1 -- 172.21.15.28:0/1409900667 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740a5a60 con 0x7f467c06b9e0 2023-12-16T03:27:38.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 -- 172.21.15.28:0/1409900667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f467c06b9e0 msgr2=0x7f467c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 --2- 172.21.15.28:0/1409900667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f467c06b9e0 0x7f467c15f0a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f467c0a9a70 tx=0x7f467401c8b0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 -- 172.21.15.28:0/1409900667 shutdown_connections 2023-12-16T03:27:38.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 --2- 172.21.15.28:0/1409900667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f467c06b9e0 0x7f467c15f0a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 --2- 172.21.15.28:0/1409900667 >> v2:172.21.15.134:3300/0 conn(0x7f467c0c7ea0 0x7f467c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 -- 172.21.15.28:0/1409900667 >> 172.21.15.28:0/1409900667 conn(0x7f467c0ca170 msgr2=0x7f467c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:38.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 -- 172.21.15.28:0/1409900667 shutdown_connections 2023-12-16T03:27:38.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 -- 172.21.15.28:0/1409900667 wait complete. 2023-12-16T03:27:38.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 Processor -- start 2023-12-16T03:27:38.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 -- start start 2023-12-16T03:27:38.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f467c06b9e0 0x7f467c1ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f467c0c7ea0 0x7f467c1ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f467c151e90 0x7f467c14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c156200 con 0x7f467c151e90 2023-12-16T03:27:38.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c1ed3b0 con 0x7f467c06b9e0 2023-12-16T03:27:38.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4684468640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c1f0da0 con 0x7f467c0c7ea0 2023-12-16T03:27:38.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4682a05640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f467c151e90 0x7f467c14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4682a05640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f467c151e90 0x7f467c14b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39182/0 (socket says 172.21.15.28:39182) 2023-12-16T03:27:38.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4682a05640 1 -- 172.21.15.28:0/944610861 learned_addr learned my addr 172.21.15.28:0/944610861 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:38.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4682204640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f467c06b9e0 0x7f467c1ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4681a03640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f467c0c7ea0 0x7f467c1ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4682a05640 1 -- 172.21.15.28:0/944610861 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f467c0c7ea0 msgr2=0x7f467c1ee1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4682a05640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f467c0c7ea0 0x7f467c1ee1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4682a05640 1 -- 172.21.15.28:0/944610861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f467c06b9e0 msgr2=0x7f467c1ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4682a05640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f467c06b9e0 0x7f467c1ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.715+0000 7f4682a05640 1 -- 172.21.15.28:0/944610861 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4674009b30 con 0x7f467c151e90 2023-12-16T03:27:38.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.719+0000 7f4682a05640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f467c151e90 0x7f467c14b2a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f46740194c0 tx=0x7f4674019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:38.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.719+0000 7f4672ffd640 1 -- 172.21.15.28:0/944610861 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740a5570 con 0x7f467c151e90 2023-12-16T03:27:38.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.719+0000 7f4672ffd640 1 -- 172.21.15.28:0/944610861 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46740b8690 con 0x7f467c151e90 2023-12-16T03:27:38.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.719+0000 7f4672ffd640 1 -- 172.21.15.28:0/944610861 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740b8a40 con 0x7f467c151e90 2023-12-16T03:27:38.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.719+0000 7f4684468640 1 -- 172.21.15.28:0/944610861 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c1f1080 con 0x7f467c151e90 2023-12-16T03:27:38.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.719+0000 7f4684468640 1 -- 172.21.15.28:0/944610861 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c1ecd40 con 0x7f467c151e90 2023-12-16T03:27:38.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.719+0000 7f4684468640 1 -- 172.21.15.28:0/944610861 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c068400 con 0x7f467c151e90 2023-12-16T03:27:38.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.719+0000 7f4672ffd640 1 -- 172.21.15.28:0/944610861 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f46740b8ba0 con 0x7f467c151e90 2023-12-16T03:27:38.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.719+0000 7f4672ffd640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4660066470 0x7f4660068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:38.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.719+0000 7f4672ffd640 1 -- 172.21.15.28:0/944610861 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f467411f400 con 0x7f467c151e90 2023-12-16T03:27:38.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.719+0000 7f4682204640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4660066470 0x7f4660068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:38.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.723+0000 7f4682204640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4660066470 0x7f4660068930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4678000f70 tx=0x7f4678007e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:38.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.723+0000 7f4672ffd640 1 -- 172.21.15.28:0/944610861 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f46740ec5c0 con 0x7f467c151e90 2023-12-16T03:27:38.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.915+0000 7f4684468640 1 -- 172.21.15.28:0/944610861 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f467c1ed4f0 con 0x7f467c151e90 2023-12-16T03:27:38.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.915+0000 7f4672ffd640 1 -- 172.21.15.28:0/944610861 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6188 (secure 0 0 0) 0x7f4674009510 con 0x7f467c151e90 2023-12-16T03:27:38.919 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:38.919 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3665146461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":3665146461},{"type":"v1","addr":"172.21.15.28:6837","nonce":3665146461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1938417336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1938417336},{"type":"v1","addr":"172.21.15.134:6835","nonce":1938417336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:00.888034+0000","modified":"2023-12-16T03:27:03.912013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/3717643902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3717643902},{"type":"v1","addr":"172.21.15.28:6836","nonce":3717643902}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:13.968886+0000","modified":"2023-12-16T03:27:17.002993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6834/4009894510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4009894510},{"type":"v1","addr":"172.21.15.134:6834","nonce":4009894510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-16T03:27:38.919 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 36 2023-12-16T03:27:38.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 -- 172.21.15.28:0/944610861 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4660066470 msgr2=0x7f4660068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4660066470 0x7f4660068930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4678000f70 tx=0x7f4678007e50 comp rx=0 tx=0).stop 2023-12-16T03:27:38.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 -- 172.21.15.28:0/944610861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f467c151e90 msgr2=0x7f467c14b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:38.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f467c151e90 0x7f467c14b2a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f46740194c0 tx=0x7f4674019650 comp rx=0 tx=0).stop 2023-12-16T03:27:38.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 -- 172.21.15.28:0/944610861 shutdown_connections 2023-12-16T03:27:38.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4660066470 0x7f4660068930 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f467c151e90 0x7f467c14b2a0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f467c0c7ea0 0x7f467c1ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 --2- 172.21.15.28:0/944610861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f467c06b9e0 0x7f467c1ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:38.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 -- 172.21.15.28:0/944610861 >> 172.21.15.28:0/944610861 conn(0x7f467c0ca170 msgr2=0x7f467c150630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:38.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 -- 172.21.15.28:0/944610861 shutdown_connections 2023-12-16T03:27:38.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:38.919+0000 7f4684468640 1 -- 172.21.15.28:0/944610861 wait complete. 2023-12-16T03:27:38.940 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:27:39.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.079+0000 7fa3a5baa640 1 Processor -- start 2023-12-16T03:27:39.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.079+0000 7fa3a5baa640 1 -- start start 2023-12-16T03:27:39.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.079+0000 7fa3a5baa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa3a00c4100 0x7fa3a00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.079+0000 7fa3a5baa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 0x7fa3a00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.079+0000 7fa3a5baa640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a00c31c0 con 0x7fa3a00c63c0 2023-12-16T03:27:39.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.079+0000 7fa3a5baa640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a00c34a0 con 0x7fa3a00c4100 2023-12-16T03:27:39.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.079+0000 7fa3a5baa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00c1030 con 0x7fa3a00c06d0 2023-12-16T03:27:39.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.083+0000 7fa39ffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 0x7fa3a00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.083+0000 7fa39effd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa3a00c4100 0x7fa3a00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.083+0000 7fa39ffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 0x7fa3a00a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:46874/0 (socket says 172.21.15.28:46874) 2023-12-16T03:27:39.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.083+0000 7fa39ffff640 1 -- 172.21.15.28:0/4253999306 learned_addr learned my addr 172.21.15.28:0/4253999306 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:39.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.083+0000 7fa39ffff640 1 -- 172.21.15.28:0/4253999306 >> v2:172.21.15.134:3300/0 conn(0x7fa3a00c4100 msgr2=0x7fa3a00c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:39.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.083+0000 7fa39ffff640 1 --2- 172.21.15.28:0/4253999306 >> v2:172.21.15.134:3300/0 conn(0x7fa3a00c4100 0x7fa3a00c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.083+0000 7fa39ffff640 1 -- 172.21.15.28:0/4253999306 >> v1:172.21.15.134:6789/0 conn(0x7fa3a00c63c0 legacy=0x7fa3a00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.083+0000 7fa39ffff640 1 -- 172.21.15.28:0/4253999306 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a00c1310 con 0x7fa3a00c06d0 2023-12-16T03:27:39.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.083+0000 7fa39ffff640 1 --2- 172.21.15.28:0/4253999306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 0x7fa3a00a9680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa398009e50 tx=0x7fa39801eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b82dd22cafde786 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:39.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.083+0000 7fa39e7fc640 1 -- 172.21.15.28:0/4253999306 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a00aa3d0 con 0x7fa3a00c06d0 2023-12-16T03:27:39.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa39e7fc640 1 -- 172.21.15.28:0/4253999306 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3980a78e0 con 0x7fa3a00c06d0 2023-12-16T03:27:39.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa39e7fc640 1 -- 172.21.15.28:0/4253999306 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980a7c70 con 0x7fa3a00c06d0 2023-12-16T03:27:39.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 -- 172.21.15.28:0/4253999306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 msgr2=0x7fa3a00a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 --2- 172.21.15.28:0/4253999306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 0x7fa3a00a9680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa398009e50 tx=0x7fa39801eb00 comp rx=0 tx=0).stop 2023-12-16T03:27:39.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 -- 172.21.15.28:0/4253999306 shutdown_connections 2023-12-16T03:27:39.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 --2- 172.21.15.28:0/4253999306 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 0x7fa3a00a9680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 --2- 172.21.15.28:0/4253999306 >> v2:172.21.15.134:3300/0 conn(0x7fa3a00c4100 0x7fa3a00c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 -- 172.21.15.28:0/4253999306 >> 172.21.15.28:0/4253999306 conn(0x7fa3a006a5b0 msgr2=0x7fa3a006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:39.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 -- 172.21.15.28:0/4253999306 shutdown_connections 2023-12-16T03:27:39.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 -- 172.21.15.28:0/4253999306 wait complete. 2023-12-16T03:27:39.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 Processor -- start 2023-12-16T03:27:39.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 -- start start 2023-12-16T03:27:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 0x7fa3a00a2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c4100 0x7fa3a01f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a00c63c0 0x7fa3a01f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00bcce0 con 0x7fa3a00c4100 2023-12-16T03:27:39.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00bb570 con 0x7fa3a00c63c0 2023-12-16T03:27:39.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa3a5baa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00a3b40 con 0x7fa3a00c06d0 2023-12-16T03:27:39.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa39effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c4100 0x7fa3a01f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa39effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c4100 0x7fa3a01f12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39192/0 (socket says 172.21.15.28:39192) 2023-12-16T03:27:39.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa39f7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 0x7fa3a00a2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa39effd640 1 -- 172.21.15.28:0/3903477286 learned_addr learned my addr 172.21.15.28:0/3903477286 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:39.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.087+0000 7fa39ffff640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a00c63c0 0x7fa3a01f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa39effd640 1 -- 172.21.15.28:0/3903477286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 msgr2=0x7fa3a00a2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa39effd640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 0x7fa3a00a2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa39effd640 1 -- 172.21.15.28:0/3903477286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a00c63c0 msgr2=0x7fa3a01f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa39effd640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a00c63c0 0x7fa3a01f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa39effd640 1 -- 172.21.15.28:0/3903477286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa398009b30 con 0x7fa3a00c4100 2023-12-16T03:27:39.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa39ffff640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a00c63c0 0x7fa3a01f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:39.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa39effd640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c4100 0x7fa3a01f12e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa39400e900 tx=0x7fa39400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:39.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa387fff640 1 -- 172.21.15.28:0/3903477286 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394009690 con 0x7fa3a00c4100 2023-12-16T03:27:39.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa387fff640 1 -- 172.21.15.28:0/3903477286 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39400ca00 con 0x7fa3a00c4100 2023-12-16T03:27:39.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa3a5baa640 1 -- 172.21.15.28:0/3903477286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a00bb780 con 0x7fa3a00c4100 2023-12-16T03:27:39.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa387fff640 1 -- 172.21.15.28:0/3903477286 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400cd90 con 0x7fa3a00c4100 2023-12-16T03:27:39.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa3a5baa640 1 -- 172.21.15.28:0/3903477286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a01f0dc0 con 0x7fa3a00c4100 2023-12-16T03:27:39.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa3a5baa640 1 -- 172.21.15.28:0/3903477286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a0068400 con 0x7fa3a00c4100 2023-12-16T03:27:39.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa387fff640 1 -- 172.21.15.28:0/3903477286 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa394013470 con 0x7fa3a00c4100 2023-12-16T03:27:39.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa387fff640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa38c066470 0x7fa38c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa387fff640 1 -- 172.21.15.28:0/3903477286 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa394084380 con 0x7fa3a00c4100 2023-12-16T03:27:39.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.091+0000 7fa39f7fe640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa38c066470 0x7fa38c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.095+0000 7fa39f7fe640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa38c066470 0x7fa38c068930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa390007fd0 tx=0x7fa390009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:39.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.095+0000 7fa387fff640 1 -- 172.21.15.28:0/3903477286 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa394051530 con 0x7fa3a00c4100 2023-12-16T03:27:39.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.287+0000 7fa3a5baa640 1 -- 172.21.15.28:0/3903477286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3a00c3e70 con 0x7fa3a00c4100 2023-12-16T03:27:39.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.287+0000 7fa387fff640 1 -- 172.21.15.28:0/3903477286 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6188 (secure 0 0 0) 0x7fa394054b50 con 0x7fa3a00c4100 2023-12-16T03:27:39.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:39.291 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3665146461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":3665146461},{"type":"v1","addr":"172.21.15.28:6837","nonce":3665146461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1938417336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1938417336},{"type":"v1","addr":"172.21.15.134:6835","nonce":1938417336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:00.888034+0000","modified":"2023-12-16T03:27:03.912013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/3717643902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3717643902},{"type":"v1","addr":"172.21.15.28:6836","nonce":3717643902}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:13.968886+0000","modified":"2023-12-16T03:27:17.002993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6834/4009894510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4009894510},{"type":"v1","addr":"172.21.15.134:6834","nonce":4009894510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-16T03:27:39.291 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 36 2023-12-16T03:27:39.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 -- 172.21.15.28:0/3903477286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa38c066470 msgr2=0x7fa38c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa38c066470 0x7fa38c068930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa390007fd0 tx=0x7fa390009040 comp rx=0 tx=0).stop 2023-12-16T03:27:39.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 -- 172.21.15.28:0/3903477286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c4100 msgr2=0x7fa3a01f12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c4100 0x7fa3a01f12e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa39400e900 tx=0x7fa39400edc0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 -- 172.21.15.28:0/3903477286 shutdown_connections 2023-12-16T03:27:39.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a00c63c0 0x7fa3a01f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa38c066470 0x7fa38c068930 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3a00c4100 0x7fa3a01f12e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 --2- 172.21.15.28:0/3903477286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a00c06d0 0x7fa3a00a2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 -- 172.21.15.28:0/3903477286 >> 172.21.15.28:0/3903477286 conn(0x7fa3a006a5b0 msgr2=0x7fa3a006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:39.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 -- 172.21.15.28:0/3903477286 shutdown_connections 2023-12-16T03:27:39.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.291+0000 7fa3a5baa640 1 -- 172.21.15.28:0/3903477286 wait complete. 2023-12-16T03:27:39.313 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:39.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.451+0000 7f50cd7c4640 1 Processor -- start 2023-12-16T03:27:39.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.451+0000 7f50cd7c4640 1 -- start start 2023-12-16T03:27:39.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50cd7c4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50c80c5640 0x7f50c80c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50cd7c4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f50c80c60f0 0x7f50c8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50cd7c4640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c80c2580 con 0x7f50c80c5260 2023-12-16T03:27:39.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50cd7c4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c8153510 con 0x7f50c80c60f0 2023-12-16T03:27:39.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50cd7c4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c80c17f0 con 0x7f50c80c5640 2023-12-16T03:27:39.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50c6ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f50c80c5260 0x7f50c806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40700/0 (socket says 172.21.15.28:40700) 2023-12-16T03:27:39.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50c6ffd640 1 -- 172.21.15.28:0/802662433 learned_addr learned my addr 172.21.15.28:0/802662433 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:39.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50c77fe640 1 --2- 172.21.15.28:0/802662433 >> v2:172.21.15.28:3300/0 conn(0x7f50c80c60f0 0x7f50c8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50c67fc640 1 --2- 172.21.15.28:0/802662433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50c80c5640 0x7f50c80c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50c77fe640 1 -- 172.21.15.28:0/802662433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50c80c5640 msgr2=0x7f50c80c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:39.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50c77fe640 1 --2- 172.21.15.28:0/802662433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50c80c5640 0x7f50c80c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50c77fe640 1 -- 172.21.15.28:0/802662433 >> v1:172.21.15.28:6789/0 conn(0x7f50c80c5260 legacy=0x7f50c806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50c77fe640 1 -- 172.21.15.28:0/802662433 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c80c1a00 con 0x7f50c80c60f0 2023-12-16T03:27:39.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50c67fc640 1 --2- 172.21.15.28:0/802662433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50c80c5640 0x7f50c80c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:39.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.455+0000 7f50c5ffb640 1 -- 172.21.15.28:0/802662433 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835626434 0 0) 0x7f50c80c2580 con 0x7f50c80c5260 2023-12-16T03:27:39.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50c77fe640 1 --2- 172.21.15.28:0/802662433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50c80c60f0 0x7f50c8155de0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f50c80c1930 tx=0x7f50c001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f69cab9578db88 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:39.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50c5ffb640 1 -- 172.21.15.28:0/802662433 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c00a5930 con 0x7f50c80c60f0 2023-12-16T03:27:39.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50c5ffb640 1 -- 172.21.15.28:0/802662433 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c00a5a90 con 0x7f50c80c60f0 2023-12-16T03:27:39.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50c5ffb640 1 -- 172.21.15.28:0/802662433 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c00a5e20 con 0x7f50c80c60f0 2023-12-16T03:27:39.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50cd7c4640 1 -- 172.21.15.28:0/802662433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50c80c60f0 msgr2=0x7f50c8155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50cd7c4640 1 --2- 172.21.15.28:0/802662433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50c80c60f0 0x7f50c8155de0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f50c80c1930 tx=0x7f50c001c870 comp rx=0 tx=0).stop 2023-12-16T03:27:39.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50cd7c4640 1 -- 172.21.15.28:0/802662433 shutdown_connections 2023-12-16T03:27:39.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50cd7c4640 1 --2- 172.21.15.28:0/802662433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50c80c60f0 0x7f50c8155de0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50cd7c4640 1 --2- 172.21.15.28:0/802662433 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50c80c5640 0x7f50c80c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50cd7c4640 1 -- 172.21.15.28:0/802662433 >> 172.21.15.28:0/802662433 conn(0x7f50c806a5b0 msgr2=0x7f50c806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:39.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50cd7c4640 1 -- 172.21.15.28:0/802662433 shutdown_connections 2023-12-16T03:27:39.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50cd7c4640 1 -- 172.21.15.28:0/802662433 wait complete. 2023-12-16T03:27:39.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50cd7c4640 1 Processor -- start 2023-12-16T03:27:39.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.459+0000 7f50cd7c4640 1 -- start start 2023-12-16T03:27:39.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50cd7c4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50c80c5260 0x7f50c81513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50cd7c4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50c80c5640 0x7f50c814cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50cd7c4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50c80c60f0 0x7f50c81ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50cd7c4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c8070b70 con 0x7f50c80c60f0 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50cd7c4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c80711b0 con 0x7f50c80c5260 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50cd7c4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c80c0370 con 0x7f50c80c5640 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50c77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50c80c60f0 0x7f50c81ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50c77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50c80c60f0 0x7f50c81ed3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39206/0 (socket says 172.21.15.28:39206) 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50c77fe640 1 -- 172.21.15.28:0/2124195757 learned_addr learned my addr 172.21.15.28:0/2124195757 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50c67fc640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50c80c5640 0x7f50c814cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50c6ffd640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50c80c5260 0x7f50c81513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50c77fe640 1 -- 172.21.15.28:0/2124195757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50c80c5640 msgr2=0x7f50c814cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50c77fe640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50c80c5640 0x7f50c814cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50c77fe640 1 -- 172.21.15.28:0/2124195757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50c80c5260 msgr2=0x7f50c81513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50c77fe640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50c80c5260 0x7f50c81513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50c77fe640 1 -- 172.21.15.28:0/2124195757 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c0009a70 con 0x7f50c80c60f0 2023-12-16T03:27:39.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50c77fe640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50c80c60f0 0x7f50c81ed3c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f50c00b0040 tx=0x7f50c0019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50af7fe640 1 -- 172.21.15.28:0/2124195757 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c00ade20 con 0x7f50c80c60f0 2023-12-16T03:27:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50af7fe640 1 -- 172.21.15.28:0/2124195757 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c0009450 con 0x7f50c80c60f0 2023-12-16T03:27:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50af7fe640 1 -- 172.21.15.28:0/2124195757 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c00b9690 con 0x7f50c80c60f0 2023-12-16T03:27:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50cd7c4640 1 -- 172.21.15.28:0/2124195757 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c8070890 con 0x7f50c80c60f0 2023-12-16T03:27:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50cd7c4640 1 -- 172.21.15.28:0/2124195757 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c81f11d0 con 0x7f50c80c60f0 2023-12-16T03:27:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50cd7c4640 1 -- 172.21.15.28:0/2124195757 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c81ecd50 con 0x7f50c80c60f0 2023-12-16T03:27:39.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.463+0000 7f50af7fe640 1 -- 172.21.15.28:0/2124195757 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f50c00b97f0 con 0x7f50c80c60f0 2023-12-16T03:27:39.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.467+0000 7f50af7fe640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b4066470 0x7f50b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.467+0000 7f50af7fe640 1 -- 172.21.15.28:0/2124195757 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f50c011f9a0 con 0x7f50c80c60f0 2023-12-16T03:27:39.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.467+0000 7f50c6ffd640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b4066470 0x7f50b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.467+0000 7f50c6ffd640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b4066470 0x7f50b4068930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f50b8000f70 tx=0x7f50b8007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:39.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.471+0000 7f50af7fe640 1 -- 172.21.15.28:0/2124195757 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f50c00ecb50 con 0x7f50c80c60f0 2023-12-16T03:27:39.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.627+0000 7f50cd7c4640 1 -- 172.21.15.28:0/2124195757 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50c81f0d50 con 0x7f50c80c60f0 2023-12-16T03:27:39.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50af7fe640 1 -- 172.21.15.28:0/2124195757 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20280 (secure 0 0 0) 0x7f50c81f0d50 con 0x7f50c80c60f0 2023-12-16T03:27:39.633 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:39.633 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":54,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:15.600556+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:26:58.698173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-16T03:26:59.897067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:39.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 -- 172.21.15.28:0/2124195757 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b4066470 msgr2=0x7f50b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b4066470 0x7f50b4068930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f50b8000f70 tx=0x7f50b8007c10 comp rx=0 tx=0).stop 2023-12-16T03:27:39.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 -- 172.21.15.28:0/2124195757 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50c80c60f0 msgr2=0x7f50c81ed3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50c80c60f0 0x7f50c81ed3c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f50c00b0040 tx=0x7f50c0019610 comp rx=0 tx=0).stop 2023-12-16T03:27:39.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 -- 172.21.15.28:0/2124195757 shutdown_connections 2023-12-16T03:27:39.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f50b4066470 0x7f50b4068930 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f50c80c60f0 0x7f50c81ed3c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f50c80c5640 0x7f50c814cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 --2- 172.21.15.28:0/2124195757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50c80c5260 0x7f50c81513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 -- 172.21.15.28:0/2124195757 >> 172.21.15.28:0/2124195757 conn(0x7f50c806a5b0 msgr2=0x7f50c806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:39.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 -- 172.21.15.28:0/2124195757 shutdown_connections 2023-12-16T03:27:39.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.631+0000 7f50cd7c4640 1 -- 172.21.15.28:0/2124195757 wait complete. 2023-12-16T03:27:39.656 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-16T03:27:39.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.795+0000 7fb8fb3c1640 1 Processor -- start 2023-12-16T03:27:39.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.795+0000 7fb8fb3c1640 1 -- start start 2023-12-16T03:27:39.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8fb3c1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb8f40c63c0 0x7fb8f40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8fb3c1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb8f40c4100 0x7fb8f40c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8fb3c1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f40c31c0 con 0x7fb8f40c29e0 2023-12-16T03:27:39.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8fb3c1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f40c34a0 con 0x7fb8f40c4100 2023-12-16T03:27:39.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8fb3c1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f40c1030 con 0x7fb8f40c63c0 2023-12-16T03:27:39.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8f895c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb8f40c4100 0x7fb8f40c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8f895c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb8f40c4100 0x7fb8f40c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54922/0 (socket says 172.21.15.28:54922) 2023-12-16T03:27:39.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8f895c640 1 -- 172.21.15.28:0/1457402671 learned_addr learned my addr 172.21.15.28:0/1457402671 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:39.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8f915d640 1 --2- 172.21.15.28:0/1457402671 >> v2:172.21.15.134:3300/0 conn(0x7fb8f40c63c0 0x7fb8f40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8f895c640 1 -- 172.21.15.28:0/1457402671 >> v2:172.21.15.134:3300/0 conn(0x7fb8f40c63c0 msgr2=0x7fb8f40c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:39.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8f895c640 1 --2- 172.21.15.28:0/1457402671 >> v2:172.21.15.134:3300/0 conn(0x7fb8f40c63c0 0x7fb8f40c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8f895c640 1 -- 172.21.15.28:0/1457402671 >> v1:172.21.15.134:6789/0 conn(0x7fb8f40c29e0 legacy=0x7fb8f40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:39.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.799+0000 7fb8f895c640 1 -- 172.21.15.28:0/1457402671 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f40c1310 con 0x7fb8f40c4100 2023-12-16T03:27:39.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8f895c640 1 --2- 172.21.15.28:0/1457402671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8f40c4100 0x7fb8f40c24a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb8f406e000 tx=0x7fb8e401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f04ba03828e430a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:39.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8ebfff640 1 -- 172.21.15.28:0/1457402671 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40ad640 con 0x7fb8f40c4100 2023-12-16T03:27:39.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8ebfff640 1 -- 172.21.15.28:0/1457402671 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e40ad7a0 con 0x7fb8f40c4100 2023-12-16T03:27:39.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8ebfff640 1 -- 172.21.15.28:0/1457402671 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40adb30 con 0x7fb8f40c4100 2023-12-16T03:27:39.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/1457402671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8f40c4100 msgr2=0x7fb8f40c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 --2- 172.21.15.28:0/1457402671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8f40c4100 0x7fb8f40c24a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb8f406e000 tx=0x7fb8e401c370 comp rx=0 tx=0).stop 2023-12-16T03:27:39.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/1457402671 shutdown_connections 2023-12-16T03:27:39.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 --2- 172.21.15.28:0/1457402671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8f40c4100 0x7fb8f40c24a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 --2- 172.21.15.28:0/1457402671 >> v2:172.21.15.134:3300/0 conn(0x7fb8f40c63c0 0x7fb8f40c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/1457402671 >> 172.21.15.28:0/1457402671 conn(0x7fb8f406a5b0 msgr2=0x7fb8f406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:39.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/1457402671 shutdown_connections 2023-12-16T03:27:39.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/1457402671 wait complete. 2023-12-16T03:27:39.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 Processor -- start 2023-12-16T03:27:39.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 -- start start 2023-12-16T03:27:39.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f40c29e0 0x7fb8f4071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8f40c4100 0x7fb8f41edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f40c63c0 0x7fb8f4153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4158780 con 0x7fb8f40c4100 2023-12-16T03:27:39.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f41f0630 con 0x7fb8f40c29e0 2023-12-16T03:27:39.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8fb3c1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f41ee080 con 0x7fb8f40c63c0 2023-12-16T03:27:39.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8f895c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8f40c4100 0x7fb8f41edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.803+0000 7fb8f895c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8f40c4100 0x7fb8f41edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54938/0 (socket says 172.21.15.28:54938) 2023-12-16T03:27:39.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8f895c640 1 -- 172.21.15.28:0/788223635 learned_addr learned my addr 172.21.15.28:0/788223635 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:39.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8f915d640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f40c29e0 0x7fb8f4071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8f995e640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f40c63c0 0x7fb8f4153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8f895c640 1 -- 172.21.15.28:0/788223635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f40c63c0 msgr2=0x7fb8f4153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8f895c640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f40c63c0 0x7fb8f4153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8f895c640 1 -- 172.21.15.28:0/788223635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f40c29e0 msgr2=0x7fb8f4071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:39.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8f895c640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f40c29e0 0x7fb8f4071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:39.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8f895c640 1 -- 172.21.15.28:0/788223635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e40094d0 con 0x7fb8f40c4100 2023-12-16T03:27:39.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8f895c640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8f40c4100 0x7fb8f41edb40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4019fa0 tx=0x7fb8e4019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:39.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8e9ffb640 1 -- 172.21.15.28:0/788223635 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40b77f0 con 0x7fb8f40c4100 2023-12-16T03:27:39.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8e9ffb640 1 -- 172.21.15.28:0/788223635 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e40a6040 con 0x7fb8f40c4100 2023-12-16T03:27:39.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8e9ffb640 1 -- 172.21.15.28:0/788223635 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40b7b90 con 0x7fb8f40c4100 2023-12-16T03:27:39.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/788223635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f41f0e90 con 0x7fb8f40c4100 2023-12-16T03:27:39.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/788223635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f41f0840 con 0x7fb8f40c4100 2023-12-16T03:27:39.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/788223635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f41f1020 con 0x7fb8f40c4100 2023-12-16T03:27:39.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.807+0000 7fb8e9ffb640 1 -- 172.21.15.28:0/788223635 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb8e40b7cf0 con 0x7fb8f40c4100 2023-12-16T03:27:39.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.811+0000 7fb8e9ffb640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8d80664a0 0x7fb8d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:39.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.811+0000 7fb8e9ffb640 1 -- 172.21.15.28:0/788223635 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb8e411ee10 con 0x7fb8f40c4100 2023-12-16T03:27:39.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.811+0000 7fb8f915d640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8d80664a0 0x7fb8d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:39.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.811+0000 7fb8f915d640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8d80664a0 0x7fb8d8068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0007a40 tx=0x7fb8f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:39.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:39.811+0000 7fb8e9ffb640 1 -- 172.21.15.28:0/788223635 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb8e4122030 con 0x7fb8f40c4100 2023-12-16T03:27:40.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.007+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/788223635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb8f41f1020 con 0x7fb8f40c4100 2023-12-16T03:27:40.013 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-12-16T03:27:40.011+0000 7f6a9e376640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T03:27:40.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.011+0000 7fb8e9ffb640 1 -- 172.21.15.28:0/788223635 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb8e40b2020 con 0x7fb8f40c4100 2023-12-16T03:27:40.015 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-16T03:27:40.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/788223635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8d80664a0 msgr2=0x7fb8d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:40.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8d80664a0 0x7fb8d8068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0007a40 tx=0x7fb8f0008040 comp rx=0 tx=0).stop 2023-12-16T03:27:40.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/788223635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8f40c4100 msgr2=0x7fb8f41edb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:40.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8f40c4100 0x7fb8f41edb40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4019fa0 tx=0x7fb8e4019110 comp rx=0 tx=0).stop 2023-12-16T03:27:40.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/788223635 shutdown_connections 2023-12-16T03:27:40.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8f40c63c0 0x7fb8f4153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:40.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8d80664a0 0x7fb8d8068960 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:40.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8f40c4100 0x7fb8f41edb40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:40.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 --2- 172.21.15.28:0/788223635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8f40c29e0 0x7fb8f4071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:40.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/788223635 >> 172.21.15.28:0/788223635 conn(0x7fb8f406a5b0 msgr2=0x7fb8f415b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:40.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/788223635 shutdown_connections 2023-12-16T03:27:40.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.015+0000 7fb8fb3c1640 1 -- 172.21.15.28:0/788223635 wait complete. 2023-12-16T03:27:40.039 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-16T03:27:40.074 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2023-12-16T03:27:40.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf32dd1640 1 Processor -- start 2023-12-16T03:27:40.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf32dd1640 1 -- start start 2023-12-16T03:27:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf32dd1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcf2c0c2bb0 0x7fcf2c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf32dd1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c0c31c0 con 0x7fcf2c0c4100 2023-12-16T03:27:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf32dd1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c0c34a0 con 0x7fcf2c0c63c0 2023-12-16T03:27:40.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf32dd1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c0c1030 con 0x7fcf2c0c2bb0 2023-12-16T03:27:40.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcf2c0c4100 0x7fcf2c0a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41602/0 (socket says 172.21.15.28:41602) 2023-12-16T03:27:40.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2bfff640 1 -- 172.21.15.28:0/4145840000 learned_addr learned my addr 172.21.15.28:0/4145840000 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:40.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf3136e640 1 --2- 172.21.15.28:0/4145840000 >> v2:172.21.15.134:3300/0 conn(0x7fcf2c0c2bb0 0x7fcf2c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:40.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258992648 0 0) 0x7fcf2c0c31c0 con 0x7fcf2c0c4100 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf1c005740 con 0x7fcf2c0c4100 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4129705144 0 0) 0x7fcf1c005740 con 0x7fcf2c0c4100 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 >> v2:172.21.15.134:3300/0 conn(0x7fcf2c0c2bb0 msgr2=0x7fcf2c0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 --2- 172.21.15.28:0/4145840000 >> v2:172.21.15.134:3300/0 conn(0x7fcf2c0c2bb0 0x7fcf2c0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 >> v1:172.21.15.134:6789/0 conn(0x7fcf2c0c63c0 legacy=0x7fcf2c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0c1310 con 0x7fcf2c0c4100 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fcf18001680 con 0x7fcf2c0c4100 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 >> v1:172.21.15.28:6789/0 conn(0x7fcf2c0c4100 legacy=0x7fcf2c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf1c005be0 0x7fcf1c006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 0x7fcf1c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf1c0074c0 0x7fcf1c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0c1030 con 0x7fcf1c0069e0 2023-12-16T03:27:40.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c00e3c0 con 0x7fcf1c0074c0 2023-12-16T03:27:40.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c00e580 con 0x7fcf1c005be0 2023-12-16T03:27:40.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 0x7fcf1c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:40.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf3136e640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf1c0074c0 0x7fcf1c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:40.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf30b6d640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf1c005be0 0x7fcf1c006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:40.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2bfff640 1 -- 172.21.15.28:0/4145840000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf1c005be0 msgr2=0x7fcf1c006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:40.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf1c005be0 0x7fcf1c006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:40.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2bfff640 1 -- 172.21.15.28:0/4145840000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf1c0074c0 msgr2=0x7fcf1c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:40.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf1c0074c0 0x7fcf1c00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:40.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf2bfff640 1 -- 172.21.15.28:0/4145840000 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c005740 con 0x7fcf1c0069e0 2023-12-16T03:27:40.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf3136e640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf1c0074c0 0x7fcf1c00dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:40.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.183+0000 7fcf3136e640 1 -- 172.21.15.28:0/4145840000 reap_dead start 2023-12-16T03:27:40.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.187+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 0x7fcf1c006e60 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800c0e0 tx=0x7fcf1801cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123e3b871e739e63 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:40.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.187+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18005ae0 con 0x7fcf1c0069e0 2023-12-16T03:27:40.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.187+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf18005c40 con 0x7fcf1c0069e0 2023-12-16T03:27:40.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.187+0000 7fcf2b7fe640 1 -- 172.21.15.28:0/4145840000 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180072b0 con 0x7fcf1c0069e0 2023-12-16T03:27:40.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.187+0000 7fcf32dd1640 1 -- 172.21.15.28:0/4145840000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 msgr2=0x7fcf1c006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:40.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.187+0000 7fcf32dd1640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 0x7fcf1c006e60 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800c0e0 tx=0x7fcf1801cae0 comp rx=0 tx=0).stop 2023-12-16T03:27:40.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.187+0000 7fcf32dd1640 1 -- 172.21.15.28:0/4145840000 shutdown_connections 2023-12-16T03:27:40.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.187+0000 7fcf32dd1640 1 --2- 172.21.15.28:0/4145840000 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 0x7fcf1c006e60 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:40.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.187+0000 7fcf32dd1640 1 -- 172.21.15.28:0/4145840000 >> 172.21.15.28:0/4145840000 conn(0x7fcf2c06a5b0 msgr2=0x7fcf2c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:40.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.187+0000 7fcf32dd1640 1 -- 172.21.15.28:0/4145840000 shutdown_connections 2023-12-16T03:27:40.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.187+0000 7fcf32dd1640 1 -- 172.21.15.28:0/4145840000 wait complete. 2023-12-16T03:27:40.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf32dd1640 1 Processor -- start 2023-12-16T03:27:40.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf32dd1640 1 -- start start 2023-12-16T03:27:40.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf32dd1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 0x7fcf2c154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:40.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf32dd1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf2c1df630 0x7fcf2c1e8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf32dd1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf2c1e94a0 0x7fcf2c1e9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf32dd1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0bdc30 con 0x7fcf1c0069e0 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf32dd1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c1dedb0 con 0x7fcf2c1df630 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf32dd1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c1ecee0 con 0x7fcf2c1e94a0 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf30b6d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 0x7fcf2c154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf30b6d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 0x7fcf2c154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54970/0 (socket says 172.21.15.28:54970) 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf30b6d640 1 -- 172.21.15.28:0/3655533834 learned_addr learned my addr 172.21.15.28:0/3655533834 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf2c1df630 0x7fcf2c1e8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf3136e640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf2c1e94a0 0x7fcf2c1e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf30b6d640 1 -- 172.21.15.28:0/3655533834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf2c1e94a0 msgr2=0x7fcf2c1e9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf30b6d640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf2c1e94a0 0x7fcf2c1e9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf30b6d640 1 -- 172.21.15.28:0/3655533834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf2c1df630 msgr2=0x7fcf2c1e8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf30b6d640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf2c1df630 0x7fcf2c1e8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:40.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf30b6d640 1 -- 172.21.15.28:0/3655533834 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0c69b0 con 0x7fcf1c0069e0 2023-12-16T03:27:40.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf30b6d640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 0x7fcf2c154480 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000f5b0 tx=0x7fcf2000fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:40.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf297fa640 1 -- 172.21.15.28:0/3655533834 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf200053a0 con 0x7fcf1c0069e0 2023-12-16T03:27:40.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf297fa640 1 -- 172.21.15.28:0/3655533834 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20003600 con 0x7fcf1c0069e0 2023-12-16T03:27:40.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf297fa640 1 -- 172.21.15.28:0/3655533834 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf200039b0 con 0x7fcf1c0069e0 2023-12-16T03:27:40.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf32dd1640 1 -- 172.21.15.28:0/3655533834 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c1ed1c0 con 0x7fcf1c0069e0 2023-12-16T03:27:40.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.191+0000 7fcf32dd1640 1 -- 172.21.15.28:0/3655533834 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c1549c0 con 0x7fcf1c0069e0 2023-12-16T03:27:40.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.195+0000 7fcf32dd1640 1 -- 172.21.15.28:0/3655533834 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c1ed3b0 con 0x7fcf1c0069e0 2023-12-16T03:27:40.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.195+0000 7fcf297fa640 1 -- 172.21.15.28:0/3655533834 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcf20003b10 con 0x7fcf1c0069e0 2023-12-16T03:27:40.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.195+0000 7fcf297fa640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf10066470 0x7fcf10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:40.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.195+0000 7fcf297fa640 1 -- 172.21.15.28:0/3655533834 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fcf20083f50 con 0x7fcf1c0069e0 2023-12-16T03:27:40.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.195+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf10066470 0x7fcf10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:40.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.195+0000 7fcf2bfff640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf10066470 0x7fcf10068930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcf180ab000 tx=0x7fcf180b1040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:40.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.199+0000 7fcf297fa640 1 -- 172.21.15.28:0/3655533834 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcf20051140 con 0x7fcf1c0069e0 2023-12-16T03:27:40.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:40.391+0000 7fcf32dd1640 1 -- 172.21.15.28:0/3655533834 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcf2c068400 con 0x7fcf1c0069e0 2023-12-16T03:27:41.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf297fa640 1 -- 172.21.15.28:0/3655533834 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcf20054760 con 0x7fcf1c0069e0 2023-12-16T03:27:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 -- 172.21.15.28:0/3655533834 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf10066470 msgr2=0x7fcf10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf10066470 0x7fcf10068930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcf180ab000 tx=0x7fcf180b1040 comp rx=0 tx=0).stop 2023-12-16T03:27:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 -- 172.21.15.28:0/3655533834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 msgr2=0x7fcf2c154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 0x7fcf2c154480 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000f5b0 tx=0x7fcf2000fa70 comp rx=0 tx=0).stop 2023-12-16T03:27:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 -- 172.21.15.28:0/3655533834 shutdown_connections 2023-12-16T03:27:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcf2c1e94a0 0x7fcf2c1e9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf2c1df630 0x7fcf2c1e8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcf10066470 0x7fcf10068930 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 --2- 172.21.15.28:0/3655533834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf1c0069e0 0x7fcf2c154480 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 -- 172.21.15.28:0/3655533834 >> 172.21.15.28:0/3655533834 conn(0x7fcf2c06a5b0 msgr2=0x7fcf2c0a6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 -- 172.21.15.28:0/3655533834 shutdown_connections 2023-12-16T03:27:41.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.015+0000 7fcf32dd1640 1 -- 172.21.15.28:0/3655533834 wait complete. 2023-12-16T03:27:41.043 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-16T03:27:41.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa7549d0640 1 Processor -- start 2023-12-16T03:27:41.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa7549d0640 1 -- start start 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa7549d0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa7500c6820 0x7fa7500c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa7549d0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa750154f80 0x7fa7500c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa7549d0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7501553e0 con 0x7fa7500c8530 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa7549d0640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7500ad290 con 0x7fa750154f80 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa7549d0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7500aec70 con 0x7fa7500c6820 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa74effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa750154f80 0x7fa7500c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa74effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa750154f80 0x7fa7500c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54984/0 (socket says 172.21.15.28:54984) 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa74effd640 1 -- 172.21.15.28:0/1804266473 learned_addr learned my addr 172.21.15.28:0/1804266473 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa74f7fe640 1 --2- 172.21.15.28:0/1804266473 >> v2:172.21.15.134:3300/0 conn(0x7fa7500c6820 0x7fa7500c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa74effd640 1 -- 172.21.15.28:0/1804266473 >> v2:172.21.15.134:3300/0 conn(0x7fa7500c6820 msgr2=0x7fa7500c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa74effd640 1 --2- 172.21.15.28:0/1804266473 >> v2:172.21.15.134:3300/0 conn(0x7fa7500c6820 0x7fa7500c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:41.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa74effd640 1 -- 172.21.15.28:0/1804266473 >> v1:172.21.15.134:6789/0 conn(0x7fa7500c8530 legacy=0x7fa750157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa74effd640 1 -- 172.21.15.28:0/1804266473 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7500aef50 con 0x7fa750154f80 2023-12-16T03:27:41.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.231+0000 7fa74f7fe640 1 --2- 172.21.15.28:0/1804266473 >> v2:172.21.15.134:3300/0 conn(0x7fa7500c6820 0x7fa7500c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa74effd640 1 --2- 172.21.15.28:0/1804266473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa750154f80 0x7fa7500c7ff0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa7500c8eb0 tx=0x7fa74401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ad9097e12ba4e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa74e7fc640 1 -- 172.21.15.28:0/1804266473 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440aa640 con 0x7fa750154f80 2023-12-16T03:27:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa74e7fc640 1 -- 172.21.15.28:0/1804266473 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7440aa7a0 con 0x7fa750154f80 2023-12-16T03:27:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa74e7fc640 1 -- 172.21.15.28:0/1804266473 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440aab30 con 0x7fa750154f80 2023-12-16T03:27:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa7549d0640 1 -- 172.21.15.28:0/1804266473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa750154f80 msgr2=0x7fa7500c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa7549d0640 1 --2- 172.21.15.28:0/1804266473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa750154f80 0x7fa7500c7ff0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa7500c8eb0 tx=0x7fa74401c4c0 comp rx=0 tx=0).stop 2023-12-16T03:27:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa7549d0640 1 -- 172.21.15.28:0/1804266473 shutdown_connections 2023-12-16T03:27:41.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa7549d0640 1 --2- 172.21.15.28:0/1804266473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa750154f80 0x7fa7500c7ff0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa7549d0640 1 --2- 172.21.15.28:0/1804266473 >> v2:172.21.15.134:3300/0 conn(0x7fa7500c6820 0x7fa7500c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa7549d0640 1 -- 172.21.15.28:0/1804266473 >> 172.21.15.28:0/1804266473 conn(0x7fa7500728b0 msgr2=0x7fa7500abb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa7549d0640 1 -- 172.21.15.28:0/1804266473 shutdown_connections 2023-12-16T03:27:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa7549d0640 1 -- 172.21.15.28:0/1804266473 wait complete. 2023-12-16T03:27:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa7549d0640 1 Processor -- start 2023-12-16T03:27:41.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.235+0000 7fa7549d0640 1 -- start start 2023-12-16T03:27:41.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa7549d0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7500c6820 0x7fa7501570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:41.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa7549d0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7500c8530 0x7fa7500c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:41.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa7549d0640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa750154f80 0x7fa7501ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa7549d0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7500bf300 con 0x7fa7500c6820 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa7549d0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75006caa0 con 0x7fa7500c8530 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa7549d0640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7501ed050 con 0x7fa750154f80 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7500c6820 0x7fa7501570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7500c6820 0x7fa7501570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54988/0 (socket says 172.21.15.28:54988) 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74f7fe640 1 -- 172.21.15.28:0/2412116533 learned_addr learned my addr 172.21.15.28:0/2412116533 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74effd640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7500c8530 0x7fa7500c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74ffff640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa750154f80 0x7fa7501ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74f7fe640 1 -- 172.21.15.28:0/2412116533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa750154f80 msgr2=0x7fa7501ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74f7fe640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa750154f80 0x7fa7501ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74f7fe640 1 -- 172.21.15.28:0/2412116533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7500c8530 msgr2=0x7fa7500c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74f7fe640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7500c8530 0x7fa7500c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74f7fe640 1 -- 172.21.15.28:0/2412116533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7440094d0 con 0x7fa7500c6820 2023-12-16T03:27:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74ffff640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa750154f80 0x7fa7501ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:41.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa74f7fe640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7500c6820 0x7fa7501570d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c7c0 tx=0x7fa74000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:41.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa737fff640 1 -- 172.21.15.28:0/2412116533 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740007a30 con 0x7fa7500c6820 2023-12-16T03:27:41.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa737fff640 1 -- 172.21.15.28:0/2412116533 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa740007b90 con 0x7fa7500c6820 2023-12-16T03:27:41.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa737fff640 1 -- 172.21.15.28:0/2412116533 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74000ce70 con 0x7fa7500c6820 2023-12-16T03:27:41.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa7549d0640 1 -- 172.21.15.28:0/2412116533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7501f1150 con 0x7fa7500c6820 2023-12-16T03:27:41.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa7549d0640 1 -- 172.21.15.28:0/2412116533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7500aa750 con 0x7fa7500c6820 2023-12-16T03:27:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.239+0000 7fa7549d0640 1 -- 172.21.15.28:0/2412116533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7501ed270 con 0x7fa7500c6820 2023-12-16T03:27:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.243+0000 7fa737fff640 1 -- 172.21.15.28:0/2412116533 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa7400113f0 con 0x7fa7500c6820 2023-12-16T03:27:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.243+0000 7fa737fff640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa73c0664a0 0x7fa73c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.243+0000 7fa737fff640 1 -- 172.21.15.28:0/2412116533 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fa740084650 con 0x7fa7500c6820 2023-12-16T03:27:41.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.243+0000 7fa74effd640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa73c0664a0 0x7fa73c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:41.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.243+0000 7fa74effd640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa73c0664a0 0x7fa73c068960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa7440ae000 tx=0x7fa7440b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:41.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.247+0000 7fa737fff640 1 -- 172.21.15.28:0/2412116533 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa7400517c0 con 0x7fa7500c6820 2023-12-16T03:27:41.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:41.403+0000 7fa7549d0640 1 -- 172.21.15.28:0/2412116533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa75004e850 con 0x7fa7500c6820 2023-12-16T03:27:42.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.015+0000 7fa737fff640 1 -- 172.21.15.28:0/2412116533 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa740054de0 con 0x7fa7500c6820 2023-12-16T03:27:42.020 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2023-12-16T03:27:42.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 -- 172.21.15.28:0/2412116533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa73c0664a0 msgr2=0x7fa73c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:42.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa73c0664a0 0x7fa73c068960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa7440ae000 tx=0x7fa7440b5040 comp rx=0 tx=0).stop 2023-12-16T03:27:42.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 -- 172.21.15.28:0/2412116533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7500c6820 msgr2=0x7fa7501570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:42.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7500c6820 0x7fa7501570d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c7c0 tx=0x7fa74000cc80 comp rx=0 tx=0).stop 2023-12-16T03:27:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 -- 172.21.15.28:0/2412116533 shutdown_connections 2023-12-16T03:27:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa750154f80 0x7fa7501ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7500c8530 0x7fa7500c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa73c0664a0 0x7fa73c068960 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 --2- 172.21.15.28:0/2412116533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7500c6820 0x7fa7501570d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 -- 172.21.15.28:0/2412116533 >> 172.21.15.28:0/2412116533 conn(0x7fa7500728b0 msgr2=0x7fa75014f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 -- 172.21.15.28:0/2412116533 shutdown_connections 2023-12-16T03:27:42.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.019+0000 7fa7549d0640 1 -- 172.21.15.28:0/2412116533 wait complete. 2023-12-16T03:27:42.047 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-16T03:27:42.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.191+0000 7f12c5a32640 1 Processor -- start 2023-12-16T03:27:42.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.191+0000 7f12c5a32640 1 -- start start 2023-12-16T03:27:42.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.191+0000 7f12c5a32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12c006fec0 0x7f12c0158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:42.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.191+0000 7f12c5a32640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c0072800 con 0x7f12c00c0aa0 2023-12-16T03:27:42.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.191+0000 7f12c5a32640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c0072ae0 con 0x7f12c00c1250 2023-12-16T03:27:42.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.191+0000 7f12c5a32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00a9fc0 con 0x7f12c006fec0 2023-12-16T03:27:42.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.191+0000 7f12bf7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f12c00c0aa0 0x7f12c015b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41616/0 (socket says 172.21.15.28:41616) 2023-12-16T03:27:42.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.191+0000 7f12bf7fe640 1 -- 172.21.15.28:0/2745707648 learned_addr learned my addr 172.21.15.28:0/2745707648 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:42.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.191+0000 7f12b7fff640 1 --2- 172.21.15.28:0/2745707648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12c006fec0 0x7f12c0158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:42.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.195+0000 7f12be7fc640 1 -- 172.21.15.28:0/2745707648 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903050117 0 0) 0x7f12c0072800 con 0x7f12c00c0aa0 2023-12-16T03:27:42.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.195+0000 7f12be7fc640 1 -- 172.21.15.28:0/2745707648 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ac004640 con 0x7f12c00c0aa0 2023-12-16T03:27:42.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.195+0000 7f12b7fff640 1 -- 172.21.15.28:0/2745707648 >> v1:172.21.15.134:6789/0 conn(0x7f12c00c1250 legacy=0x7f12c00c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:42.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.195+0000 7f12b7fff640 1 -- 172.21.15.28:0/2745707648 >> v1:172.21.15.28:6789/0 conn(0x7f12c00c0aa0 legacy=0x7f12c015b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:42.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.195+0000 7f12b7fff640 1 -- 172.21.15.28:0/2745707648 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00a9900 con 0x7f12c006fec0 2023-12-16T03:27:42.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.195+0000 7f12b7fff640 1 --2- 172.21.15.28:0/2745707648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12c006fec0 0x7f12c0158bb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12a80097f0 tx=0x7f12a801e580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a5a2d28e32db798 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:42.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.195+0000 7f12be7fc640 1 -- 172.21.15.28:0/2745707648 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a80ab670 con 0x7f12c006fec0 2023-12-16T03:27:42.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.195+0000 7f12be7fc640 1 -- 172.21.15.28:0/2745707648 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a80ab7d0 con 0x7f12c006fec0 2023-12-16T03:27:42.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.195+0000 7f12be7fc640 1 -- 172.21.15.28:0/2745707648 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a80abb40 con 0x7f12c006fec0 2023-12-16T03:27:42.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 -- 172.21.15.28:0/2745707648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12c006fec0 msgr2=0x7f12c0158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:42.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 --2- 172.21.15.28:0/2745707648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12c006fec0 0x7f12c0158bb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12a80097f0 tx=0x7f12a801e580 comp rx=0 tx=0).stop 2023-12-16T03:27:42.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 -- 172.21.15.28:0/2745707648 shutdown_connections 2023-12-16T03:27:42.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 --2- 172.21.15.28:0/2745707648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12c006fec0 0x7f12c0158bb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:42.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 -- 172.21.15.28:0/2745707648 >> 172.21.15.28:0/2745707648 conn(0x7f12c00c5d40 msgr2=0x7f12c00c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:42.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 -- 172.21.15.28:0/2745707648 shutdown_connections 2023-12-16T03:27:42.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 -- 172.21.15.28:0/2745707648 wait complete. 2023-12-16T03:27:42.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 Processor -- start 2023-12-16T03:27:42.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 -- start start 2023-12-16T03:27:42.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c006fec0 0x7f12c01f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:42.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12c00c0aa0 0x7f12c01558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:42.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12c00c1250 0x7f12c00a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:42.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c0157160 con 0x7f12c00c1250 2023-12-16T03:27:42.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c0159f60 con 0x7f12c006fec0 2023-12-16T03:27:42.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12c5a32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c01f0fa0 con 0x7f12c00c0aa0 2023-12-16T03:27:42.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12bf7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12c00c1250 0x7f12c00a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12bf7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12c00c1250 0x7f12c00a62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54998/0 (socket says 172.21.15.28:54998) 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12bf7fe640 1 -- 172.21.15.28:0/2952610055 learned_addr learned my addr 172.21.15.28:0/2952610055 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12b7fff640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12c00c0aa0 0x7f12c01558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12beffd640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c006fec0 0x7f12c01f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12bf7fe640 1 -- 172.21.15.28:0/2952610055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12c00c0aa0 msgr2=0x7f12c01558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12bf7fe640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12c00c0aa0 0x7f12c01558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12bf7fe640 1 -- 172.21.15.28:0/2952610055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c006fec0 msgr2=0x7f12c01f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12bf7fe640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c006fec0 0x7f12c01f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.199+0000 7f12bf7fe640 1 -- 172.21.15.28:0/2952610055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8009420 con 0x7f12c00c1250 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.203+0000 7f12bf7fe640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12c00c1250 0x7f12c00a62a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f12b800cb70 tx=0x7f12b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.203+0000 7f12bcff9640 1 -- 172.21.15.28:0/2952610055 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800ad40 con 0x7f12c00c1250 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.203+0000 7f12bcff9640 1 -- 172.21.15.28:0/2952610055 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b8012400 con 0x7f12c00c1250 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.203+0000 7f12bcff9640 1 -- 172.21.15.28:0/2952610055 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800aea0 con 0x7f12c00c1250 2023-12-16T03:27:42.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.203+0000 7f12c5a32640 1 -- 172.21.15.28:0/2952610055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c015b7d0 con 0x7f12c00c1250 2023-12-16T03:27:42.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.203+0000 7f12c5a32640 1 -- 172.21.15.28:0/2952610055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c015a490 con 0x7f12c00c1250 2023-12-16T03:27:42.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.203+0000 7f12c5a32640 1 -- 172.21.15.28:0/2952610055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c00a5920 con 0x7f12c00c1250 2023-12-16T03:27:42.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.203+0000 7f12bcff9640 1 -- 172.21.15.28:0/2952610055 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f12b8007070 con 0x7f12c00c1250 2023-12-16T03:27:42.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.203+0000 7f12bcff9640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f12a0066470 0x7f12a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:42.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.203+0000 7f12bcff9640 1 -- 172.21.15.28:0/2952610055 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f12b8083ff0 con 0x7f12c00c1250 2023-12-16T03:27:42.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.203+0000 7f12beffd640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f12a0066470 0x7f12a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:42.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.207+0000 7f12beffd640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f12a0066470 0x7f12a0068930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f12b0001810 tx=0x7f12b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:42.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.207+0000 7f12bcff9640 1 -- 172.21.15.28:0/2952610055 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f12b8051310 con 0x7f12c00c1250 2023-12-16T03:27:42.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:42.367+0000 7f12c5a32640 1 -- 172.21.15.28:0/2952610055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f12c0068400 con 0x7f12c00c1250 2023-12-16T03:27:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.023+0000 7f12bcff9640 1 -- 172.21.15.28:0/2952610055 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7f12b80170d0 con 0x7f12c00c1250 2023-12-16T03:27:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2023-12-16T03:27:43.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 -- 172.21.15.28:0/2952610055 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f12a0066470 msgr2=0x7f12a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f12a0066470 0x7f12a0068930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f12b0001810 tx=0x7f12b0009040 comp rx=0 tx=0).stop 2023-12-16T03:27:43.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 -- 172.21.15.28:0/2952610055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12c00c1250 msgr2=0x7f12c00a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12c00c1250 0x7f12c00a62a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f12b800cb70 tx=0x7f12b800a430 comp rx=0 tx=0).stop 2023-12-16T03:27:43.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 -- 172.21.15.28:0/2952610055 shutdown_connections 2023-12-16T03:27:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f12a0066470 0x7f12a0068930 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12c00c1250 0x7f12c00a62a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12c00c0aa0 0x7f12c01558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 --2- 172.21.15.28:0/2952610055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12c006fec0 0x7f12c01f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 -- 172.21.15.28:0/2952610055 >> 172.21.15.28:0/2952610055 conn(0x7f12c00c5d40 msgr2=0x7f12c00c6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 -- 172.21.15.28:0/2952610055 shutdown_connections 2023-12-16T03:27:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.027+0000 7f12c5a32640 1 -- 172.21.15.28:0/2952610055 wait complete. 2023-12-16T03:27:43.060 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efeda409640 1 Processor -- start 2023-12-16T03:27:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efeda409640 1 -- start start 2023-12-16T03:27:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efeda409640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efed406bbb0 0x7efed41600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efeda409640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed406c860 con 0x7efed4151e90 2023-12-16T03:27:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efeda409640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed406c000 con 0x7efed40c7ea0 2023-12-16T03:27:43.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efeda409640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed40c8750 con 0x7efed406bbb0 2023-12-16T03:27:43.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed3fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efed4151e90 0x7efed40c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41622/0 (socket says 172.21.15.28:41622) 2023-12-16T03:27:43.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed3fff640 1 -- 172.21.15.28:0/603595754 learned_addr learned my addr 172.21.15.28:0/603595754 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:43.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed89a6640 1 --2- 172.21.15.28:0/603595754 >> v2:172.21.15.134:3300/0 conn(0x7efed406bbb0 0x7efed41600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297152505 0 0) 0x7efed406c860 con 0x7efed4151e90 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efebc003530 con 0x7efed4151e90 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4229864059 0 0) 0x7efebc003530 con 0x7efed4151e90 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 >> v2:172.21.15.134:3300/0 conn(0x7efed406bbb0 msgr2=0x7efed41600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 --2- 172.21.15.28:0/603595754 >> v2:172.21.15.134:3300/0 conn(0x7efed406bbb0 0x7efed41600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 >> v1:172.21.15.134:6789/0 conn(0x7efed40c7ea0 legacy=0x7efed406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed4154930 con 0x7efed4151e90 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7efec4001680 con 0x7efed4151e90 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 >> v1:172.21.15.28:6789/0 conn(0x7efed4151e90 legacy=0x7efed40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 --2- 172.21.15.28:0/603595754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efebc003980 0x7efebc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 --2- 172.21.15.28:0/603595754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efebc0047d0 0x7efebc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 --2- 172.21.15.28:0/603595754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc005190 0x7efebc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed40c8750 con 0x7efebc0047d0 2023-12-16T03:27:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc00c0e0 con 0x7efebc005190 2023-12-16T03:27:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc00c2a0 con 0x7efebc003980 2023-12-16T03:27:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.203+0000 7efed37fe640 1 --2- 172.21.15.28:0/603595754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efebc0047d0 0x7efebc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed3fff640 1 --2- 172.21.15.28:0/603595754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efebc003980 0x7efebc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed89a6640 1 --2- 172.21.15.28:0/603595754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc005190 0x7efebc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed37fe640 1 -- 172.21.15.28:0/603595754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efebc003980 msgr2=0x7efebc003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed37fe640 1 --2- 172.21.15.28:0/603595754 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efebc003980 0x7efebc003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed37fe640 1 -- 172.21.15.28:0/603595754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc005190 msgr2=0x7efebc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed37fe640 1 --2- 172.21.15.28:0/603595754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efebc005190 0x7efebc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed37fe640 1 -- 172.21.15.28:0/603595754 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc003530 con 0x7efebc0047d0 2023-12-16T03:27:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed89a6640 1 -- 172.21.15.28:0/603595754 reap_dead start 2023-12-16T03:27:43.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed37fe640 1 --2- 172.21.15.28:0/603595754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efebc0047d0 0x7efebc004c50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efec8001860 tx=0x7efec801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3904444caa2fe30b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:43.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80ab400 con 0x7efebc0047d0 2023-12-16T03:27:43.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec80a7050 con 0x7efebc0047d0 2023-12-16T03:27:43.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efed2ffd640 1 -- 172.21.15.28:0/603595754 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80ab7e0 con 0x7efebc0047d0 2023-12-16T03:27:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efeda409640 1 -- 172.21.15.28:0/603595754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efebc0047d0 msgr2=0x7efebc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efeda409640 1 --2- 172.21.15.28:0/603595754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efebc0047d0 0x7efebc004c50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efec8001860 tx=0x7efec801c4c0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efeda409640 1 -- 172.21.15.28:0/603595754 shutdown_connections 2023-12-16T03:27:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efeda409640 1 --2- 172.21.15.28:0/603595754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efebc0047d0 0x7efebc004c50 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.207+0000 7efeda409640 1 -- 172.21.15.28:0/603595754 >> 172.21.15.28:0/603595754 conn(0x7efed40ca170 msgr2=0x7efed40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efeda409640 1 -- 172.21.15.28:0/603595754 shutdown_connections 2023-12-16T03:27:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efeda409640 1 -- 172.21.15.28:0/603595754 wait complete. 2023-12-16T03:27:43.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efeda409640 1 Processor -- start 2023-12-16T03:27:43.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efeda409640 1 -- start start 2023-12-16T03:27:43.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efeda409640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efebc0047d0 0x7efed4153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efeda409640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efed41f0b70 0x7efed41f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efeda409640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed40bfe70 0x7efed40c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efeda409640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed41552d0 con 0x7efed41f0b70 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efeda409640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed414e780 con 0x7efed40bfe70 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efeda409640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed414a120 con 0x7efebc0047d0 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efed37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efed41f0b70 0x7efed41f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efed37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efed41f0b70 0x7efed41f0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55012/0 (socket says 172.21.15.28:55012) 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efed37fe640 1 -- 172.21.15.28:0/4053346956 learned_addr learned my addr 172.21.15.28:0/4053346956 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efed3fff640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efebc0047d0 0x7efed4153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efed89a6640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed40bfe70 0x7efed40c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efed37fe640 1 -- 172.21.15.28:0/4053346956 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efebc0047d0 msgr2=0x7efed4153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efed37fe640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efebc0047d0 0x7efed4153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efed37fe640 1 -- 172.21.15.28:0/4053346956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed40bfe70 msgr2=0x7efed40c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efed37fe640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed40bfe70 0x7efed40c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efed37fe640 1 -- 172.21.15.28:0/4053346956 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed41f06e0 con 0x7efed41f0b70 2023-12-16T03:27:43.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.211+0000 7efed37fe640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efed41f0b70 0x7efed41f0ff0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efec80ae040 tx=0x7efebc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:43.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.215+0000 7efed0ff9640 1 -- 172.21.15.28:0/4053346956 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8007240 con 0x7efed41f0b70 2023-12-16T03:27:43.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.215+0000 7efed0ff9640 1 -- 172.21.15.28:0/4053346956 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec80073c0 con 0x7efed41f0b70 2023-12-16T03:27:43.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.215+0000 7efeda409640 1 -- 172.21.15.28:0/4053346956 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed41f1530 con 0x7efed41f0b70 2023-12-16T03:27:43.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.215+0000 7efed0ff9640 1 -- 172.21.15.28:0/4053346956 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80b4400 con 0x7efed41f0b70 2023-12-16T03:27:43.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.215+0000 7efeda409640 1 -- 172.21.15.28:0/4053346956 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed4157ee0 con 0x7efed41f0b70 2023-12-16T03:27:43.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.215+0000 7efeda409640 1 -- 172.21.15.28:0/4053346956 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed41f0870 con 0x7efed41f0b70 2023-12-16T03:27:43.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.215+0000 7efed0ff9640 1 -- 172.21.15.28:0/4053346956 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7efec80b2040 con 0x7efed41f0b70 2023-12-16T03:27:43.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.215+0000 7efed0ff9640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efec0066470 0x7efec0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.215+0000 7efed0ff9640 1 -- 172.21.15.28:0/4053346956 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7efec811d8a0 con 0x7efed41f0b70 2023-12-16T03:27:43.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.215+0000 7efed3fff640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efec0066470 0x7efec0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.219+0000 7efed3fff640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efec0066470 0x7efec0068930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efed40bd3e0 tx=0x7efec4000ff0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:43.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.219+0000 7efed0ff9640 1 -- 172.21.15.28:0/4053346956 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7efec80eae00 con 0x7efed41f0b70 2023-12-16T03:27:43.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.387+0000 7efeda409640 1 -- 172.21.15.28:0/4053346956 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efed4068400 con 0x7efed41f0b70 2023-12-16T03:27:43.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.387+0000 7efed0ff9640 1 -- 172.21.15.28:0/4053346956 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16701 (secure 0 0 0) 0x7efec80ee420 con 0x7efed41f0b70 2023-12-16T03:27:43.391 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:43.391 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":57,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:43.020486+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6836/3717643902":"2023-12-17T03:27:40.012876+0000","172.21.15.28:6834/3717643902":"2023-12-17T03:27:40.012876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:43.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.387+0000 7efeda409640 1 -- 172.21.15.28:0/4053346956 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efec0066470 msgr2=0x7efec0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.387+0000 7efeda409640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efec0066470 0x7efec0068930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efed40bd3e0 tx=0x7efec4000ff0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.387+0000 7efeda409640 1 -- 172.21.15.28:0/4053346956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efed41f0b70 msgr2=0x7efed41f0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.387+0000 7efeda409640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efed41f0b70 0x7efed41f0ff0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efec80ae040 tx=0x7efebc005800 comp rx=0 tx=0).stop 2023-12-16T03:27:43.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.391+0000 7efeda409640 1 -- 172.21.15.28:0/4053346956 shutdown_connections 2023-12-16T03:27:43.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.391+0000 7efeda409640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efed40bfe70 0x7efed40c02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.391+0000 7efeda409640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efec0066470 0x7efec0068930 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.391+0000 7efeda409640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efed41f0b70 0x7efed41f0ff0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.391+0000 7efeda409640 1 --2- 172.21.15.28:0/4053346956 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efebc0047d0 0x7efed4153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.391+0000 7efeda409640 1 -- 172.21.15.28:0/4053346956 >> 172.21.15.28:0/4053346956 conn(0x7efed40ca170 msgr2=0x7efed4150020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:43.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.391+0000 7efeda409640 1 -- 172.21.15.28:0/4053346956 shutdown_connections 2023-12-16T03:27:43.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.391+0000 7efeda409640 1 -- 172.21.15.28:0/4053346956 wait complete. 2023-12-16T03:27:43.413 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:27:12.042891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:27:12.972488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:27:43.413 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:27:43.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.555+0000 7f29cbd65640 1 Processor -- start 2023-12-16T03:27:43.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.555+0000 7f29cbd65640 1 -- start start 2023-12-16T03:27:43.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.555+0000 7f29cbd65640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29c4152030 0x7f29c40c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.555+0000 7f29cbd65640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c4154b60 con 0x7f29c406c470 2023-12-16T03:27:43.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.555+0000 7f29cbd65640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c4158120 con 0x7f29c4157c90 2023-12-16T03:27:43.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.555+0000 7f29cbd65640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4152410 con 0x7f29c4152030 2023-12-16T03:27:43.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.555+0000 7f29c9300640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f29c406c470 0x7f29c4154ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41628/0 (socket says 172.21.15.28:41628) 2023-12-16T03:27:43.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.555+0000 7f29c9300640 1 -- 172.21.15.28:0/1248889650 learned_addr learned my addr 172.21.15.28:0/1248889650 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:43.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.555+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951485160 0 0) 0x7f29c4154b60 con 0x7f29c406c470 2023-12-16T03:27:43.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.555+0000 7f29c9b01640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29c4152030 0x7f29c40c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.555+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b0003530 con 0x7f29c406c470 2023-12-16T03:27:43.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3820093930 0 0) 0x7f29b0003530 con 0x7f29c406c470 2023-12-16T03:27:43.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29c4152030 msgr2=0x7f29c40c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29c4152030 0x7f29c40c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 >> v1:172.21.15.134:6789/0 conn(0x7f29c4157c90 legacy=0x7f29c40c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c40c1820 con 0x7f29c406c470 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f29b4001680 con 0x7f29c406c470 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 >> v1:172.21.15.28:6789/0 conn(0x7f29c406c470 legacy=0x7f29c4154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b00039b0 0x7f29b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b00047d0 0x7f29b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29c4152030 0x7f29b0005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4152410 con 0x7f29b00047d0 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b000bb20 con 0x7f29b00039b0 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b000bce0 con 0x7f29c4152030 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c9300640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b00047d0 0x7f29b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c9b01640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b00039b0 0x7f29b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29ca302640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29c4152030 0x7f29b0005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c9300640 1 -- 172.21.15.28:0/1248889650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29c4152030 msgr2=0x7f29b0005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:43.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c9300640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29c4152030 0x7f29b0005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c9300640 1 -- 172.21.15.28:0/1248889650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b00039b0 msgr2=0x7f29b0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:43.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c9300640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29b00039b0 0x7f29b0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c9300640 1 -- 172.21.15.28:0/1248889650 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b0003530 con 0x7f29b00047d0 2023-12-16T03:27:43.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.559+0000 7f29c9300640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b00047d0 0x7f29b0004c50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f29b400c0e0 tx=0x7f29b401cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec1a273ba1d2264 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:43.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4005ae0 con 0x7f29b00047d0 2023-12-16T03:27:43.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4005c40 con 0x7f29b00047d0 2023-12-16T03:27:43.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29c8aff640 1 -- 172.21.15.28:0/1248889650 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4007070 con 0x7f29b00047d0 2023-12-16T03:27:43.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 -- 172.21.15.28:0/1248889650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b00047d0 msgr2=0x7f29b0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 --2- 172.21.15.28:0/1248889650 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b00047d0 0x7f29b0004c50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f29b400c0e0 tx=0x7f29b401cb30 comp rx=0 tx=0).stop 2023-12-16T03:27:43.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29ca302640 1 -- 172.21.15.28:0/1248889650 reap_dead start 2023-12-16T03:27:43.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 -- 172.21.15.28:0/1248889650 shutdown_connections 2023-12-16T03:27:43.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 -- 172.21.15.28:0/1248889650 >> 172.21.15.28:0/1248889650 conn(0x7f29c406a5b0 msgr2=0x7f29c406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:43.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 -- 172.21.15.28:0/1248889650 shutdown_connections 2023-12-16T03:27:43.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 -- 172.21.15.28:0/1248889650 wait complete. 2023-12-16T03:27:43.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 Processor -- start 2023-12-16T03:27:43.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 -- start start 2023-12-16T03:27:43.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29b00047d0 0x7f29c40c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29c4071db0 0x7f29c4072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c40c5e70 0x7f29c40c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4155700 con 0x7f29c4071db0 2023-12-16T03:27:43.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4155840 con 0x7f29c40c5e70 2023-12-16T03:27:43.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29cbd65640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4070a70 con 0x7f29b00047d0 2023-12-16T03:27:43.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29c9300640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29c4071db0 0x7f29c4072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29c9300640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29c4071db0 0x7f29c4072230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55022/0 (socket says 172.21.15.28:55022) 2023-12-16T03:27:43.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29c9300640 1 -- 172.21.15.28:0/2233839224 learned_addr learned my addr 172.21.15.28:0/2233839224 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:43.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29c9b01640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29b00047d0 0x7f29c40c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.563+0000 7f29ca302640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c40c5e70 0x7f29c40c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29c9300640 1 -- 172.21.15.28:0/2233839224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29b00047d0 msgr2=0x7f29c40c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29c9300640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29b00047d0 0x7f29c40c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29c9300640 1 -- 172.21.15.28:0/2233839224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c40c5e70 msgr2=0x7f29c40c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29c9300640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c40c5e70 0x7f29c40c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29c9300640 1 -- 172.21.15.28:0/2233839224 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c40c42d0 con 0x7f29c4071db0 2023-12-16T03:27:43.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29c9300640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29c4071db0 0x7f29c4072230 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f29b401c5a0 tx=0x7f29b0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:43.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29ba7fc640 1 -- 172.21.15.28:0/2233839224 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40b4070 con 0x7f29c4071db0 2023-12-16T03:27:43.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29ba7fc640 1 -- 172.21.15.28:0/2233839224 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b40013c0 con 0x7f29c4071db0 2023-12-16T03:27:43.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29ba7fc640 1 -- 172.21.15.28:0/2233839224 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4001730 con 0x7f29c4071db0 2023-12-16T03:27:43.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29cbd65640 1 -- 172.21.15.28:0/2233839224 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c40704f0 con 0x7f29c4071db0 2023-12-16T03:27:43.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29cbd65640 1 -- 172.21.15.28:0/2233839224 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c40c3f60 con 0x7f29c4071db0 2023-12-16T03:27:43.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29cbd65640 1 -- 172.21.15.28:0/2233839224 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c40c4460 con 0x7f29c4071db0 2023-12-16T03:27:43.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29ba7fc640 1 -- 172.21.15.28:0/2233839224 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f29b4007080 con 0x7f29c4071db0 2023-12-16T03:27:43.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29ba7fc640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f29a80664a0 0x7f29a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.567+0000 7f29ba7fc640 1 -- 172.21.15.28:0/2233839224 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f29b411d4c0 con 0x7f29c4071db0 2023-12-16T03:27:43.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.571+0000 7f29c9b01640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f29a80664a0 0x7f29a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.571+0000 7f29c9b01640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f29a80664a0 0x7f29a8068960 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009be0 tx=0x7f29c0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:43.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.571+0000 7f29ba7fc640 1 -- 172.21.15.28:0/2233839224 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f29b40eaa20 con 0x7f29c4071db0 2023-12-16T03:27:43.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.731+0000 7f29cbd65640 1 -- 172.21.15.28:0/2233839224 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29c4068400 con 0x7f29c4071db0 2023-12-16T03:27:43.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.731+0000 7f29ba7fc640 1 -- 172.21.15.28:0/2233839224 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29b40ee040 con 0x7f29c4071db0 2023-12-16T03:27:43.735 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:27:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.731+0000 7f29cbd65640 1 -- 172.21.15.28:0/2233839224 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f29a80664a0 msgr2=0x7f29a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.731+0000 7f29cbd65640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f29a80664a0 0x7f29a8068960 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009be0 tx=0x7f29c0009190 comp rx=0 tx=0).stop 2023-12-16T03:27:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.735+0000 7f29cbd65640 1 -- 172.21.15.28:0/2233839224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29c4071db0 msgr2=0x7f29c4072230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.735+0000 7f29cbd65640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29c4071db0 0x7f29c4072230 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f29b401c5a0 tx=0x7f29b0005800 comp rx=0 tx=0).stop 2023-12-16T03:27:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.735+0000 7f29cbd65640 1 -- 172.21.15.28:0/2233839224 shutdown_connections 2023-12-16T03:27:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.735+0000 7f29cbd65640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c40c5e70 0x7f29c40c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.735+0000 7f29cbd65640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f29a80664a0 0x7f29a8068960 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.735+0000 7f29cbd65640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29c4071db0 0x7f29c4072230 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.735+0000 7f29cbd65640 1 --2- 172.21.15.28:0/2233839224 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f29b00047d0 0x7f29c40c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.735+0000 7f29cbd65640 1 -- 172.21.15.28:0/2233839224 >> 172.21.15.28:0/2233839224 conn(0x7f29c406a5b0 msgr2=0x7f29c415f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:43.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.735+0000 7f29cbd65640 1 -- 172.21.15.28:0/2233839224 shutdown_connections 2023-12-16T03:27:43.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.735+0000 7f29cbd65640 1 -- 172.21.15.28:0/2233839224 wait complete. 2023-12-16T03:27:43.756 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:27:43.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.899+0000 7f286249c640 1 Processor -- start 2023-12-16T03:27:43.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.899+0000 7f286249c640 1 -- start start 2023-12-16T03:27:43.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.903+0000 7f286249c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f285c155de0 0x7f285c156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.903+0000 7f286249c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c0c2580 con 0x7f285c0c5640 2023-12-16T03:27:43.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.903+0000 7f286249c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c0c1a00 con 0x7f285c0c5260 2023-12-16T03:27:43.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.903+0000 7f286249c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c153510 con 0x7f285c155de0 2023-12-16T03:27:43.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.903+0000 7f285b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f285c0c5640 0x7f285c0c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41644/0 (socket says 172.21.15.28:41644) 2023-12-16T03:27:43.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.903+0000 7f285b7fe640 1 -- 172.21.15.28:0/3165834098 learned_addr learned my addr 172.21.15.28:0/3165834098 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:43.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.903+0000 7f2860a39640 1 --2- 172.21.15.28:0/3165834098 >> v2:172.21.15.28:3300/0 conn(0x7f285c155de0 0x7f285c156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.903+0000 7f2860a39640 1 -- 172.21.15.28:0/3165834098 >> v1:172.21.15.134:6789/0 conn(0x7f285c0c5260 legacy=0x7f285c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:43.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.903+0000 7f2860a39640 1 -- 172.21.15.28:0/3165834098 >> v1:172.21.15.28:6789/0 conn(0x7f285c0c5640 legacy=0x7f285c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.903+0000 7f2860a39640 1 -- 172.21.15.28:0/3165834098 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c0c1ce0 con 0x7f285c155de0 2023-12-16T03:27:43.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.903+0000 7f285affd640 1 -- 172.21.15.28:0/3165834098 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366285060 0 0) 0x7f285c0c2580 con 0x7f285c0c5640 2023-12-16T03:27:43.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.907+0000 7f2860a39640 1 --2- 172.21.15.28:0/3165834098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f285c155de0 0x7f285c156230 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2854009d90 tx=0x7f285401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ba6b7196e0db85 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:43.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.907+0000 7f285affd640 1 -- 172.21.15.28:0/3165834098 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540a5870 con 0x7f285c155de0 2023-12-16T03:27:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.907+0000 7f285affd640 1 -- 172.21.15.28:0/3165834098 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28540a59d0 con 0x7f285c155de0 2023-12-16T03:27:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.907+0000 7f285affd640 1 -- 172.21.15.28:0/3165834098 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540a5d60 con 0x7f285c155de0 2023-12-16T03:27:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.907+0000 7f286249c640 1 -- 172.21.15.28:0/3165834098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f285c155de0 msgr2=0x7f285c156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.907+0000 7f286249c640 1 --2- 172.21.15.28:0/3165834098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f285c155de0 0x7f285c156230 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2854009d90 tx=0x7f285401c8c0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.907+0000 7f286249c640 1 -- 172.21.15.28:0/3165834098 shutdown_connections 2023-12-16T03:27:43.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.907+0000 7f286249c640 1 --2- 172.21.15.28:0/3165834098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f285c155de0 0x7f285c156230 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.907+0000 7f286249c640 1 -- 172.21.15.28:0/3165834098 >> 172.21.15.28:0/3165834098 conn(0x7f285c06a5b0 msgr2=0x7f285c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:43.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.907+0000 7f286249c640 1 -- 172.21.15.28:0/3165834098 shutdown_connections 2023-12-16T03:27:43.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.907+0000 7f286249c640 1 -- 172.21.15.28:0/3165834098 wait complete. 2023-12-16T03:27:43.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.911+0000 7f286249c640 1 Processor -- start 2023-12-16T03:27:43.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.911+0000 7f286249c640 1 -- start start 2023-12-16T03:27:43.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f286249c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285c0c5260 0x7f285c1ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f286249c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f285c0c5640 0x7f285c14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f286249c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f285c155de0 0x7f285c14f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f286249c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c1f0cd0 con 0x7f285c0c5640 2023-12-16T03:27:43.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f286249c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c1558a0 con 0x7f285c155de0 2023-12-16T03:27:43.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f286249c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0bf100 con 0x7f285c0c5260 2023-12-16T03:27:43.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f285bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285c0c5260 0x7f285c1ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f285bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285c0c5260 0x7f285c1ecee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:35338/0 (socket says 172.21.15.28:35338) 2023-12-16T03:27:43.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f285bfff640 1 -- 172.21.15.28:0/4076793452 learned_addr learned my addr 172.21.15.28:0/4076793452 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:43.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f285bfff640 1 -- 172.21.15.28:0/4076793452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f285c155de0 msgr2=0x7f285c14f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f285bfff640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f285c155de0 0x7f285c14f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f285bfff640 1 -- 172.21.15.28:0/4076793452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f285c0c5640 msgr2=0x7f285c14c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:43.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f285bfff640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f285c0c5640 0x7f285c14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:43.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f285bfff640 1 -- 172.21.15.28:0/4076793452 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2854009a70 con 0x7f285c0c5260 2023-12-16T03:27:43.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f285bfff640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285c0c5260 0x7f285c1ecee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f284c00c3c0 tx=0x7f284c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:43.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f2858ff9640 1 -- 172.21.15.28:0/4076793452 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c0052d0 con 0x7f285c0c5260 2023-12-16T03:27:43.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f2858ff9640 1 -- 172.21.15.28:0/4076793452 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c005430 con 0x7f285c0c5260 2023-12-16T03:27:43.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f286249c640 1 -- 172.21.15.28:0/4076793452 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c1f0730 con 0x7f285c0c5260 2023-12-16T03:27:43.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f2858ff9640 1 -- 172.21.15.28:0/4076793452 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c003840 con 0x7f285c0c5260 2023-12-16T03:27:43.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.915+0000 7f286249c640 1 -- 172.21.15.28:0/4076793452 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c1f09f0 con 0x7f285c0c5260 2023-12-16T03:27:43.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.919+0000 7f286249c640 1 -- 172.21.15.28:0/4076793452 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c068400 con 0x7f285c0c5260 2023-12-16T03:27:43.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.919+0000 7f2858ff9640 1 -- 172.21.15.28:0/4076793452 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f284c0039a0 con 0x7f285c0c5260 2023-12-16T03:27:43.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.923+0000 7f2858ff9640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 0x7f2848068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:43.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.923+0000 7f2858ff9640 1 -- 172.21.15.28:0/4076793452 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f284c083480 con 0x7f285c0c5260 2023-12-16T03:27:43.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.923+0000 7f285b7fe640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 0x7f2848068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:43.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.923+0000 7f285b7fe640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 0x7f2848068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2850000c10 tx=0x7f28500079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:43.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:43.927+0000 7f2858ff9640 1 -- 172.21.15.28:0/4076793452 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f284c050890 con 0x7f285c0c5260 2023-12-16T03:27:44.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.087+0000 7f286249c640 1 -- 172.21.15.28:0/4076793452 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f285c06d390 con 0x7f285c0c5260 2023-12-16T03:27:44.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.087+0000 7f2858ff9640 1 -- 172.21.15.28:0/4076793452 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v57) v1 ==== 105+0+11 (secure 0 0 0) 0x7f284c053eb0 con 0x7f285c0c5260 2023-12-16T03:27:44.092 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:27:44.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 -- 172.21.15.28:0/4076793452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 msgr2=0x7f2848068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 0x7f2848068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2850000c10 tx=0x7f28500079d0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 -- 172.21.15.28:0/4076793452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285c0c5260 msgr2=0x7f285c1ecee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285c0c5260 0x7f285c1ecee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f284c00c3c0 tx=0x7f284c00c880 comp rx=0 tx=0).stop 2023-12-16T03:27:44.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 -- 172.21.15.28:0/4076793452 shutdown_connections 2023-12-16T03:27:44.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f285c155de0 0x7f285c14f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2848066470 0x7f2848068930 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f285c0c5640 0x7f285c14c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 --2- 172.21.15.28:0/4076793452 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f285c0c5260 0x7f285c1ecee0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 -- 172.21.15.28:0/4076793452 >> 172.21.15.28:0/4076793452 conn(0x7f285c06a5b0 msgr2=0x7f285c0c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:44.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 -- 172.21.15.28:0/4076793452 shutdown_connections 2023-12-16T03:27:44.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.091+0000 7f286249c640 1 -- 172.21.15.28:0/4076793452 wait complete. 2023-12-16T03:27:44.113 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:27:44.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.255+0000 7f1825f1d640 1 Processor -- start 2023-12-16T03:27:44.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.255+0000 7f1825f1d640 1 -- start start 2023-12-16T03:27:44.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.255+0000 7f1825f1d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f18200c63c0 0x7f18200c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f1825f1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18200c2bb0 0x7f18200a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f1825f1d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18200c31c0 con 0x7f18200c4100 2023-12-16T03:27:44.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f1825f1d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18200c34a0 con 0x7f18200c63c0 2023-12-16T03:27:44.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f1825f1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18200c1030 con 0x7f18200c2bb0 2023-12-16T03:27:44.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f18200c63c0 0x7f18200c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181effd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f18200c4100 0x7f18200c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41660/0 (socket says 172.21.15.28:41660) 2023-12-16T03:27:44.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181effd640 1 -- 172.21.15.28:0/70581065 learned_addr learned my addr 172.21.15.28:0/70581065 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:44.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181ffff640 1 --2- 172.21.15.28:0/70581065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18200c2bb0 0x7f18200a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181f7fe640 1 -- 172.21.15.28:0/70581065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18200c2bb0 msgr2=0x7f18200a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:44.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181f7fe640 1 --2- 172.21.15.28:0/70581065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18200c2bb0 0x7f18200a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181f7fe640 1 -- 172.21.15.28:0/70581065 >> v1:172.21.15.28:6789/0 conn(0x7f18200c4100 legacy=0x7f18200c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181f7fe640 1 -- 172.21.15.28:0/70581065 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200c1310 con 0x7f18200c63c0 2023-12-16T03:27:44.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181e7fc640 1 -- 172.21.15.28:0/70581065 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722903527 0 0) 0x7f18200c31c0 con 0x7f18200c4100 2023-12-16T03:27:44.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181ffff640 1 --2- 172.21.15.28:0/70581065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18200c2bb0 0x7f18200a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:44.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181f7fe640 1 --2- 172.21.15.28:0/70581065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f18200c63c0 0x7f18200c06d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f18100097c0 tx=0x7f181001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73ed3d5fe937d32 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:44.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181e7fc640 1 -- 172.21.15.28:0/70581065 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18200aa3d0 con 0x7f18200c63c0 2023-12-16T03:27:44.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181e7fc640 1 -- 172.21.15.28:0/70581065 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18100a7050 con 0x7f18200c63c0 2023-12-16T03:27:44.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.259+0000 7f181e7fc640 1 -- 172.21.15.28:0/70581065 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18100ab820 con 0x7f18200c63c0 2023-12-16T03:27:44.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 -- 172.21.15.28:0/70581065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f18200c63c0 msgr2=0x7f18200c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 --2- 172.21.15.28:0/70581065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f18200c63c0 0x7f18200c06d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f18100097c0 tx=0x7f181001c330 comp rx=0 tx=0).stop 2023-12-16T03:27:44.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 -- 172.21.15.28:0/70581065 shutdown_connections 2023-12-16T03:27:44.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 --2- 172.21.15.28:0/70581065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18200c2bb0 0x7f18200a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 --2- 172.21.15.28:0/70581065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f18200c63c0 0x7f18200c06d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 -- 172.21.15.28:0/70581065 >> 172.21.15.28:0/70581065 conn(0x7f182006a5b0 msgr2=0x7f182006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:44.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 -- 172.21.15.28:0/70581065 shutdown_connections 2023-12-16T03:27:44.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 -- 172.21.15.28:0/70581065 wait complete. 2023-12-16T03:27:44.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 Processor -- start 2023-12-16T03:27:44.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 -- start start 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18200c2bb0 0x7f18200a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18200c4100 0x7f18201efed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f18200c63c0 0x7f18201f0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18201f0950 con 0x7f18200c63c0 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1820157d00 con 0x7f18200c2bb0 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f1825f1d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18201537e0 con 0x7f18200c4100 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f181ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f18200c63c0 0x7f18201f0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f181ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f18200c63c0 0x7f18201f0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55052/0 (socket says 172.21.15.28:55052) 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f181ffff640 1 -- 172.21.15.28:0/1473144521 learned_addr learned my addr 172.21.15.28:0/1473144521 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f181f7fe640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18200c2bb0 0x7f18200a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.263+0000 7f181effd640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18200c4100 0x7f18201efed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f181ffff640 1 -- 172.21.15.28:0/1473144521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18200c4100 msgr2=0x7f18201efed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f181ffff640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18200c4100 0x7f18201efed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f181ffff640 1 -- 172.21.15.28:0/1473144521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18200c2bb0 msgr2=0x7f18200a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f181ffff640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18200c2bb0 0x7f18200a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f181ffff640 1 -- 172.21.15.28:0/1473144521 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1810009420 con 0x7f18200c63c0 2023-12-16T03:27:44.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f181ffff640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f18200c63c0 0x7f18201f0410 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f181800cef0 tx=0x7f181800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:44.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f1807fff640 1 -- 172.21.15.28:0/1473144521 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800d840 con 0x7f18200c63c0 2023-12-16T03:27:44.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f1807fff640 1 -- 172.21.15.28:0/1473144521 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181800d9c0 con 0x7f18200c63c0 2023-12-16T03:27:44.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f1825f1d640 1 -- 172.21.15.28:0/1473144521 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18200c69b0 con 0x7f18200c63c0 2023-12-16T03:27:44.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f1807fff640 1 -- 172.21.15.28:0/1473144521 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800dd70 con 0x7f18200c63c0 2023-12-16T03:27:44.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f1825f1d640 1 -- 172.21.15.28:0/1473144521 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18201eccf0 con 0x7f18200c63c0 2023-12-16T03:27:44.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f1825f1d640 1 -- 172.21.15.28:0/1473144521 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1820068400 con 0x7f18200c63c0 2023-12-16T03:27:44.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f1807fff640 1 -- 172.21.15.28:0/1473144521 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f181801e3b0 con 0x7f18200c63c0 2023-12-16T03:27:44.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f1807fff640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f180c066470 0x7f180c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f1807fff640 1 -- 172.21.15.28:0/1473144521 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f1818084810 con 0x7f18200c63c0 2023-12-16T03:27:44.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.267+0000 7f181f7fe640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f180c066470 0x7f180c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.271+0000 7f181f7fe640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f180c066470 0x7f180c068930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f18100ad000 tx=0x7f18100a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:44.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.271+0000 7f1807fff640 1 -- 172.21.15.28:0/1473144521 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1818051e30 con 0x7f18200c63c0 2023-12-16T03:27:44.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.427+0000 7f1825f1d640 1 -- 172.21.15.28:0/1473144521 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f18200c09c0 con 0x7f18200c63c0 2023-12-16T03:27:44.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.427+0000 7f1807fff640 1 -- 172.21.15.28:0/1473144521 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v57) v1 ==== 101+0+11 (secure 0 0 0) 0x7f181801a020 con 0x7f18200c63c0 2023-12-16T03:27:44.432 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:27:44.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 -- 172.21.15.28:0/1473144521 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f180c066470 msgr2=0x7f180c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f180c066470 0x7f180c068930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f18100ad000 tx=0x7f18100a6000 comp rx=0 tx=0).stop 2023-12-16T03:27:44.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 -- 172.21.15.28:0/1473144521 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f18200c63c0 msgr2=0x7f18201f0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f18200c63c0 0x7f18201f0410 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f181800cef0 tx=0x7f181800a710 comp rx=0 tx=0).stop 2023-12-16T03:27:44.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 -- 172.21.15.28:0/1473144521 shutdown_connections 2023-12-16T03:27:44.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f180c066470 0x7f180c068930 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f18200c63c0 0x7f18201f0410 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18200c4100 0x7f18201efed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 --2- 172.21.15.28:0/1473144521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18200c2bb0 0x7f18200a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 -- 172.21.15.28:0/1473144521 >> 172.21.15.28:0/1473144521 conn(0x7f182006a5b0 msgr2=0x7f182006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:44.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 -- 172.21.15.28:0/1473144521 shutdown_connections 2023-12-16T03:27:44.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.431+0000 7f1825f1d640 1 -- 172.21.15.28:0/1473144521 wait complete. 2023-12-16T03:27:44.453 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:27:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.591+0000 7fa6af7d1640 1 Processor -- start 2023-12-16T03:27:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.591+0000 7fa6af7d1640 1 -- start start 2023-12-16T03:27:44.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6af7d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa6a81560e0 0x7fa6a815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6af7d1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa6a806d520 0x7fa6a8159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6af7d1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6a80bffc0 0x7fa6a80c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6af7d1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a815c600 con 0x7fa6a806d520 2023-12-16T03:27:44.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6af7d1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a81594e0 con 0x7fa6a80bffc0 2023-12-16T03:27:44.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6af7d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81597c0 con 0x7fa6a81560e0 2023-12-16T03:27:44.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6acd6c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa6a806d520 0x7fa6a8159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6acd6c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa6a806d520 0x7fa6a8159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55054/0 (socket says 172.21.15.28:55054) 2023-12-16T03:27:44.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6acd6c640 1 -- 172.21.15.28:0/799211096 learned_addr learned my addr 172.21.15.28:0/799211096 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:44.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6ad56d640 1 --2- 172.21.15.28:0/799211096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa6a81560e0 0x7fa6a815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6acd6c640 1 -- 172.21.15.28:0/799211096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa6a81560e0 msgr2=0x7fa6a815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:44.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6acd6c640 1 --2- 172.21.15.28:0/799211096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa6a81560e0 0x7fa6a815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6add6e640 1 --2- 172.21.15.28:0/799211096 >> v2:172.21.15.134:3300/0 conn(0x7fa6a80bffc0 0x7fa6a80c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6acd6c640 1 -- 172.21.15.28:0/799211096 >> v2:172.21.15.134:3300/0 conn(0x7fa6a80bffc0 msgr2=0x7fa6a80c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:44.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6acd6c640 1 --2- 172.21.15.28:0/799211096 >> v2:172.21.15.134:3300/0 conn(0x7fa6a80bffc0 0x7fa6a80c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6acd6c640 1 -- 172.21.15.28:0/799211096 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a815bfb0 con 0x7fa6a806d520 2023-12-16T03:27:44.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6ad56d640 1 --2- 172.21.15.28:0/799211096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa6a81560e0 0x7fa6a815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:44.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.595+0000 7fa6add6e640 1 --2- 172.21.15.28:0/799211096 >> v2:172.21.15.134:3300/0 conn(0x7fa6a80bffc0 0x7fa6a80c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:44.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6acd6c640 1 --2- 172.21.15.28:0/799211096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6a806d520 0x7fa6a8159eb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80c66a0 tx=0x7fa69801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c69fea5b3f34f41 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:44.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa69ffff640 1 -- 172.21.15.28:0/799211096 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980ac600 con 0x7fa6a806d520 2023-12-16T03:27:44.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa69ffff640 1 -- 172.21.15.28:0/799211096 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6980a8050 con 0x7fa6a806d520 2023-12-16T03:27:44.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa69ffff640 1 -- 172.21.15.28:0/799211096 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980ac980 con 0x7fa6a806d520 2023-12-16T03:27:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 -- 172.21.15.28:0/799211096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6a806d520 msgr2=0x7fa6a8159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 --2- 172.21.15.28:0/799211096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6a806d520 0x7fa6a8159eb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80c66a0 tx=0x7fa69801c4d0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 -- 172.21.15.28:0/799211096 shutdown_connections 2023-12-16T03:27:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 --2- 172.21.15.28:0/799211096 >> v2:172.21.15.134:3300/0 conn(0x7fa6a80bffc0 0x7fa6a80c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 --2- 172.21.15.28:0/799211096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6a806d520 0x7fa6a8159eb0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 --2- 172.21.15.28:0/799211096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa6a81560e0 0x7fa6a815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 -- 172.21.15.28:0/799211096 >> 172.21.15.28:0/799211096 conn(0x7fa6a806a5b0 msgr2=0x7fa6a806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 -- 172.21.15.28:0/799211096 shutdown_connections 2023-12-16T03:27:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 -- 172.21.15.28:0/799211096 wait complete. 2023-12-16T03:27:44.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 Processor -- start 2023-12-16T03:27:44.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 -- start start 2023-12-16T03:27:44.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6a806d520 0x7fa6a80c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa6a80bffc0 0x7fa6a80a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6a81560e0 0x7fa6a80aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a80706f0 con 0x7fa6a806d520 2023-12-16T03:27:44.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a80aa850 con 0x7fa6a81560e0 2023-12-16T03:27:44.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6af7d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a8157350 con 0x7fa6a80bffc0 2023-12-16T03:27:44.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6ad56d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6a806d520 0x7fa6a80c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6ad56d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6a806d520 0x7fa6a80c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55068/0 (socket says 172.21.15.28:55068) 2023-12-16T03:27:44.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6ad56d640 1 -- 172.21.15.28:0/1872726964 learned_addr learned my addr 172.21.15.28:0/1872726964 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:44.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6acd6c640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa6a80bffc0 0x7fa6a80a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.599+0000 7fa6add6e640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6a81560e0 0x7fa6a80aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa6ad56d640 1 -- 172.21.15.28:0/1872726964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa6a80bffc0 msgr2=0x7fa6a80a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa6ad56d640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa6a80bffc0 0x7fa6a80a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa6ad56d640 1 -- 172.21.15.28:0/1872726964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6a81560e0 msgr2=0x7fa6a80aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa6ad56d640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6a81560e0 0x7fa6a80aa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa6ad56d640 1 -- 172.21.15.28:0/1872726964 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6980094d0 con 0x7fa6a806d520 2023-12-16T03:27:44.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa6ad56d640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6a806d520 0x7fa6a80c5850 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400c7c0 tx=0x7fa6a400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:44.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa69dffb640 1 -- 172.21.15.28:0/1872726964 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4007a30 con 0x7fa6a806d520 2023-12-16T03:27:44.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa69dffb640 1 -- 172.21.15.28:0/1872726964 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a4007b90 con 0x7fa6a806d520 2023-12-16T03:27:44.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa69dffb640 1 -- 172.21.15.28:0/1872726964 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a400ce70 con 0x7fa6a806d520 2023-12-16T03:27:44.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa6af7d1640 1 -- 172.21.15.28:0/1872726964 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a8070be0 con 0x7fa6a806d520 2023-12-16T03:27:44.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa6af7d1640 1 -- 172.21.15.28:0/1872726964 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a8070900 con 0x7fa6a806d520 2023-12-16T03:27:44.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa6af7d1640 1 -- 172.21.15.28:0/1872726964 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a8068400 con 0x7fa6a806d520 2023-12-16T03:27:44.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa69dffb640 1 -- 172.21.15.28:0/1872726964 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa6a40113f0 con 0x7fa6a806d520 2023-12-16T03:27:44.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.603+0000 7fa69dffb640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa68c0664a0 0x7fa68c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.607+0000 7fa69dffb640 1 -- 172.21.15.28:0/1872726964 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fa6a4084290 con 0x7fa6a806d520 2023-12-16T03:27:44.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.607+0000 7fa6acd6c640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa68c0664a0 0x7fa68c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.607+0000 7fa6acd6c640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa68c0664a0 0x7fa68c068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa6980ae000 tx=0x7fa6980a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:44.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.607+0000 7fa69dffb640 1 -- 172.21.15.28:0/1872726964 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa6a4051750 con 0x7fa6a806d520 2023-12-16T03:27:44.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.803+0000 7fa6af7d1640 1 -- 172.21.15.28:0/1872726964 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6a8164130 con 0x7fa6a806d520 2023-12-16T03:27:44.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.803+0000 7fa69dffb640 1 -- 172.21.15.28:0/1872726964 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4948 (secure 0 0 0) 0x7fa6a4054d70 con 0x7fa6a806d520 2023-12-16T03:27:44.807 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:44.807 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3665146461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":3665146461},{"type":"v1","addr":"172.21.15.28:6837","nonce":3665146461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1938417336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1938417336},{"type":"v1","addr":"172.21.15.134:6835","nonce":1938417336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6318,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/3684375189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3684375189},{"type":"v1","addr":"172.21.15.28:6836","nonce":3684375189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:13.968886+0000","modified":"2023-12-16T03:27:17.002993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6834/4009894510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4009894510},{"type":"v1","addr":"172.21.15.134:6834","nonce":4009894510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-16T03:27:44.807 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 38 2023-12-16T03:27:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 -- 172.21.15.28:0/1872726964 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa68c0664a0 msgr2=0x7fa68c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa68c0664a0 0x7fa68c068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa6980ae000 tx=0x7fa6980a7000 comp rx=0 tx=0).stop 2023-12-16T03:27:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 -- 172.21.15.28:0/1872726964 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6a806d520 msgr2=0x7fa6a80c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6a806d520 0x7fa6a80c5850 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400c7c0 tx=0x7fa6a400cc80 comp rx=0 tx=0).stop 2023-12-16T03:27:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 -- 172.21.15.28:0/1872726964 shutdown_connections 2023-12-16T03:27:44.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6a81560e0 0x7fa6a80aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa6a80bffc0 0x7fa6a80a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa68c0664a0 0x7fa68c068960 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 --2- 172.21.15.28:0/1872726964 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6a806d520 0x7fa6a80c5850 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 -- 172.21.15.28:0/1872726964 >> 172.21.15.28:0/1872726964 conn(0x7fa6a806a5b0 msgr2=0x7fa6a806fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:44.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 -- 172.21.15.28:0/1872726964 shutdown_connections 2023-12-16T03:27:44.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.807+0000 7fa6af7d1640 1 -- 172.21.15.28:0/1872726964 wait complete. 2023-12-16T03:27:44.828 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:44.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.967+0000 7fd51a09c640 1 Processor -- start 2023-12-16T03:27:44.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.967+0000 7fd51a09c640 1 -- start start 2023-12-16T03:27:44.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.967+0000 7fd51a09c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd514151e90 0x7fd5140c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.967+0000 7fd51a09c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd5140c4e60 0x7fd51406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.967+0000 7fd51a09c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51406c860 con 0x7fd5140c7ea0 2023-12-16T03:27:44.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.967+0000 7fd51a09c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5140c8750 con 0x7fd5140c4e60 2023-12-16T03:27:44.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.967+0000 7fd51a09c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5141552d0 con 0x7fd514151e90 2023-12-16T03:27:44.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.967+0000 7fd513fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd5140c4e60 0x7fd51406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.967+0000 7fd513fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd5140c4e60 0x7fd51406bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55078/0 (socket says 172.21.15.28:55078) 2023-12-16T03:27:44.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.967+0000 7fd513fff640 1 -- 172.21.15.28:0/2066800494 learned_addr learned my addr 172.21.15.28:0/2066800494 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:44.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.971+0000 7fd5137fe640 1 --2- 172.21.15.28:0/2066800494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd514151e90 0x7fd5140c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.971+0000 7fd513fff640 1 -- 172.21.15.28:0/2066800494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd514151e90 msgr2=0x7fd5140c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.971+0000 7fd513fff640 1 --2- 172.21.15.28:0/2066800494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd514151e90 0x7fd5140c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.971+0000 7fd513fff640 1 -- 172.21.15.28:0/2066800494 >> v1:172.21.15.134:6789/0 conn(0x7fd5140c7ea0 legacy=0x7fd51406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.971+0000 7fd513fff640 1 -- 172.21.15.28:0/2066800494 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd514154930 con 0x7fd5140c4e60 2023-12-16T03:27:44.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.971+0000 7fd5137fe640 1 --2- 172.21.15.28:0/2066800494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd514151e90 0x7fd5140c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:44.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.971+0000 7fd513fff640 1 --2- 172.21.15.28:0/2066800494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5140c4e60 0x7fd51406bbb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009e50 tx=0x7fd50c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f0c26df51a3cd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:44.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.971+0000 7fd5127fc640 1 -- 172.21.15.28:0/2066800494 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0a5530 con 0x7fd5140c4e60 2023-12-16T03:27:44.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.971+0000 7fd5127fc640 1 -- 172.21.15.28:0/2066800494 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c0a5690 con 0x7fd5140c4e60 2023-12-16T03:27:44.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.971+0000 7fd5127fc640 1 -- 172.21.15.28:0/2066800494 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0a5a20 con 0x7fd5140c4e60 2023-12-16T03:27:44.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 -- 172.21.15.28:0/2066800494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5140c4e60 msgr2=0x7fd51406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 --2- 172.21.15.28:0/2066800494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5140c4e60 0x7fd51406bbb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009e50 tx=0x7fd50c01c8b0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 -- 172.21.15.28:0/2066800494 shutdown_connections 2023-12-16T03:27:44.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 --2- 172.21.15.28:0/2066800494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5140c4e60 0x7fd51406bbb0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 --2- 172.21.15.28:0/2066800494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd514151e90 0x7fd5140c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 -- 172.21.15.28:0/2066800494 >> 172.21.15.28:0/2066800494 conn(0x7fd5140ca170 msgr2=0x7fd5140ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:44.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 -- 172.21.15.28:0/2066800494 shutdown_connections 2023-12-16T03:27:44.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 -- 172.21.15.28:0/2066800494 wait complete. 2023-12-16T03:27:44.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 Processor -- start 2023-12-16T03:27:44.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 -- start start 2023-12-16T03:27:44.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5140c4e60 0x7fd5140c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5140c7ea0 0x7fd514152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514151e90 0x7fd514146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51414c390 con 0x7fd5140c4e60 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5140af7a0 con 0x7fd514151e90 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd51a09c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5140af1e0 con 0x7fd5140c7ea0 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd5137fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5140c4e60 0x7fd5140c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd5137fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5140c4e60 0x7fd5140c2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55096/0 (socket says 172.21.15.28:55096) 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd5137fe640 1 -- 172.21.15.28:0/4015934645 learned_addr learned my addr 172.21.15.28:0/4015934645 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd513fff640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514151e90 0x7fd514146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd512ffd640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5140c7ea0 0x7fd514152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd5137fe640 1 -- 172.21.15.28:0/4015934645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5140c7ea0 msgr2=0x7fd514152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd5137fe640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5140c7ea0 0x7fd514152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd5137fe640 1 -- 172.21.15.28:0/4015934645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514151e90 msgr2=0x7fd514146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd5137fe640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514151e90 0x7fd514146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd5137fe640 1 -- 172.21.15.28:0/4015934645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c009b30 con 0x7fd5140c4e60 2023-12-16T03:27:44.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd512ffd640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5140c7ea0 0x7fd514152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:44.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.975+0000 7fd5137fe640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5140c4e60 0x7fd5140c2ad0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c7c0 tx=0x7fd50400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:44.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.979+0000 7fd4fbfff640 1 -- 172.21.15.28:0/4015934645 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504007a30 con 0x7fd5140c4e60 2023-12-16T03:27:44.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.979+0000 7fd4fbfff640 1 -- 172.21.15.28:0/4015934645 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504007b90 con 0x7fd5140c4e60 2023-12-16T03:27:44.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.979+0000 7fd4fbfff640 1 -- 172.21.15.28:0/4015934645 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50400ce70 con 0x7fd5140c4e60 2023-12-16T03:27:44.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.979+0000 7fd51a09c640 1 -- 172.21.15.28:0/4015934645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5140af4c0 con 0x7fd5140c4e60 2023-12-16T03:27:44.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.979+0000 7fd51a09c640 1 -- 172.21.15.28:0/4015934645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5141ee7e0 con 0x7fd5140c4e60 2023-12-16T03:27:44.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.979+0000 7fd51a09c640 1 -- 172.21.15.28:0/4015934645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5141ee360 con 0x7fd5140c4e60 2023-12-16T03:27:44.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.979+0000 7fd4fbfff640 1 -- 172.21.15.28:0/4015934645 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd5040113f0 con 0x7fd5140c4e60 2023-12-16T03:27:44.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.979+0000 7fd4fbfff640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd500066470 0x7fd500068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:44.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.979+0000 7fd4fbfff640 1 -- 172.21.15.28:0/4015934645 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fd504084350 con 0x7fd5140c4e60 2023-12-16T03:27:44.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.979+0000 7fd512ffd640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd500066470 0x7fd500068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:44.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.979+0000 7fd512ffd640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd500066470 0x7fd500068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd5140c0c90 tx=0x7fd508009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:44.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:44.983+0000 7fd4fbfff640 1 -- 172.21.15.28:0/4015934645 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd5141ee360 con 0x7fd5140c4e60 2023-12-16T03:27:45.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.143+0000 7fd51a09c640 1 -- 172.21.15.28:0/4015934645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5141ee360 con 0x7fd5140c4e60 2023-12-16T03:27:45.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd4fbfff640 1 -- 172.21.15.28:0/4015934645 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16701 (secure 0 0 0) 0x7fd5141ee360 con 0x7fd5140c4e60 2023-12-16T03:27:45.149 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:45.149 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":57,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:43.020486+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6836/3717643902":"2023-12-17T03:27:40.012876+0000","172.21.15.28:6834/3717643902":"2023-12-17T03:27:40.012876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:45.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 -- 172.21.15.28:0/4015934645 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd500066470 msgr2=0x7fd500068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd500066470 0x7fd500068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd5140c0c90 tx=0x7fd508009040 comp rx=0 tx=0).stop 2023-12-16T03:27:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 -- 172.21.15.28:0/4015934645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5140c4e60 msgr2=0x7fd5140c2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5140c4e60 0x7fd5140c2ad0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c7c0 tx=0x7fd50400cc80 comp rx=0 tx=0).stop 2023-12-16T03:27:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 -- 172.21.15.28:0/4015934645 shutdown_connections 2023-12-16T03:27:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd514151e90 0x7fd514146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd5140c7ea0 0x7fd514152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd500066470 0x7fd500068930 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 --2- 172.21.15.28:0/4015934645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5140c4e60 0x7fd5140c2ad0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 -- 172.21.15.28:0/4015934645 >> 172.21.15.28:0/4015934645 conn(0x7fd5140ca170 msgr2=0x7fd5140c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 -- 172.21.15.28:0/4015934645 shutdown_connections 2023-12-16T03:27:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.147+0000 7fd51a09c640 1 -- 172.21.15.28:0/4015934645 wait complete. 2023-12-16T03:27:45.171 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-16T03:27:45.171 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:27:45.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbc9ec9640 1 Processor -- start 2023-12-16T03:27:45.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbc9ec9640 1 -- start start 2023-12-16T03:27:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbc9ec9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdbc4072090 0x7fdbc4150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbc9ec9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdbc40725c0 0x7fdbc41514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbc9ec9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc40c2760 con 0x7fdbc40a5370 2023-12-16T03:27:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbc9ec9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc40c3070 con 0x7fdbc4072090 2023-12-16T03:27:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbc9ec9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40a5750 con 0x7fdbc40725c0 2023-12-16T03:27:45.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbbbfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdbc4072090 0x7fdbc4150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbbbfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdbc4072090 0x7fdbc4150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55104/0 (socket says 172.21.15.28:55104) 2023-12-16T03:27:45.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbbbfff640 1 -- 172.21.15.28:0/4065434242 learned_addr learned my addr 172.21.15.28:0/4065434242 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:45.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbc3fff640 1 --2- 172.21.15.28:0/4065434242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdbc40725c0 0x7fdbc41514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbbbfff640 1 -- 172.21.15.28:0/4065434242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdbc40725c0 msgr2=0x7fdbc41514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:45.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbbbfff640 1 --2- 172.21.15.28:0/4065434242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdbc40725c0 0x7fdbc41514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbbbfff640 1 -- 172.21.15.28:0/4065434242 >> v1:172.21.15.134:6789/0 conn(0x7fdbc40a5370 legacy=0x7fdbc40c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.311+0000 7fdbbbfff640 1 -- 172.21.15.28:0/4065434242 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc40aad20 con 0x7fdbc4072090 2023-12-16T03:27:45.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbbbfff640 1 --2- 172.21.15.28:0/4065434242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc4072090 0x7fdbc4150fa0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009870 tx=0x7fdbac01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4528d7dbe4a2a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:45.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbc2ffd640 1 -- 172.21.15.28:0/4065434242 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0ab600 con 0x7fdbc4072090 2023-12-16T03:27:45.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbc2ffd640 1 -- 172.21.15.28:0/4065434242 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac0a7050 con 0x7fdbc4072090 2023-12-16T03:27:45.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbc2ffd640 1 -- 172.21.15.28:0/4065434242 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0ab980 con 0x7fdbc4072090 2023-12-16T03:27:45.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/4065434242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc4072090 msgr2=0x7fdbc4150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbc9ec9640 1 --2- 172.21.15.28:0/4065434242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc4072090 0x7fdbc4150fa0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009870 tx=0x7fdbac01c3f0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/4065434242 shutdown_connections 2023-12-16T03:27:45.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbc9ec9640 1 --2- 172.21.15.28:0/4065434242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdbc40725c0 0x7fdbc41514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbc9ec9640 1 --2- 172.21.15.28:0/4065434242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc4072090 0x7fdbc4150fa0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/4065434242 >> 172.21.15.28:0/4065434242 conn(0x7fdbc406a5b0 msgr2=0x7fdbc406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:45.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/4065434242 shutdown_connections 2023-12-16T03:27:45.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.315+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/4065434242 wait complete. 2023-12-16T03:27:45.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc9ec9640 1 Processor -- start 2023-12-16T03:27:45.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc9ec9640 1 -- start start 2023-12-16T03:27:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc9ec9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdbc4072090 0x7fdbc4150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc9ec9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc40725c0 0x7fdbc4146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc9ec9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbc40a5370 0x7fdbc4148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc9ec9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc4152f10 con 0x7fdbc40725c0 2023-12-16T03:27:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc9ec9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40a7150 con 0x7fdbc40a5370 2023-12-16T03:27:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc9ec9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc4146690 con 0x7fdbc4072090 2023-12-16T03:27:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbbbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc40725c0 0x7fdbc4146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbbbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc40725c0 0x7fdbc4146150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55110/0 (socket says 172.21.15.28:55110) 2023-12-16T03:27:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbbbfff640 1 -- 172.21.15.28:0/2428238380 learned_addr learned my addr 172.21.15.28:0/2428238380 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc37fe640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdbc4072090 0x7fdbc4150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc3fff640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbc40a5370 0x7fdbc4148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbbbfff640 1 -- 172.21.15.28:0/2428238380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdbc4072090 msgr2=0x7fdbc4150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbbbfff640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdbc4072090 0x7fdbc4150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbbbfff640 1 -- 172.21.15.28:0/2428238380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbc40a5370 msgr2=0x7fdbc4148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbbbfff640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbc40a5370 0x7fdbc4148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbbbfff640 1 -- 172.21.15.28:0/2428238380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0094d0 con 0x7fdbc40725c0 2023-12-16T03:27:45.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbbbfff640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc40725c0 0x7fdbc4146150 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0ae040 tx=0x7fdbac019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:45.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc0ff9640 1 -- 172.21.15.28:0/2428238380 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0b4420 con 0x7fdbc40725c0 2023-12-16T03:27:45.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc0ff9640 1 -- 172.21.15.28:0/2428238380 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac0b4580 con 0x7fdbc40725c0 2023-12-16T03:27:45.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc0ff9640 1 -- 172.21.15.28:0/2428238380 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0b4930 con 0x7fdbc40725c0 2023-12-16T03:27:45.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/2428238380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc41547c0 con 0x7fdbc40725c0 2023-12-16T03:27:45.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/2428238380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc4152420 con 0x7fdbc40725c0 2023-12-16T03:27:45.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.319+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/2428238380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc40a72c0 con 0x7fdbc40725c0 2023-12-16T03:27:45.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.323+0000 7fdbc0ff9640 1 -- 172.21.15.28:0/2428238380 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdbac0b2070 con 0x7fdbc40725c0 2023-12-16T03:27:45.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.323+0000 7fdbc0ff9640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdba4066470 0x7fdba4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.323+0000 7fdbc0ff9640 1 -- 172.21.15.28:0/2428238380 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fdbac11da80 con 0x7fdbc40725c0 2023-12-16T03:27:45.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.323+0000 7fdbc37fe640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdba4066470 0x7fdba4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.323+0000 7fdbc37fe640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdba4066470 0x7fdba4068930 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4007fd0 tx=0x7fdbb4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:45.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.327+0000 7fdbc0ff9640 1 -- 172.21.15.28:0/2428238380 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdbac0eae90 con 0x7fdbc40725c0 2023-12-16T03:27:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/2428238380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbc4068400 con 0x7fdbc40725c0 2023-12-16T03:27:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc0ff9640 1 -- 172.21.15.28:0/2428238380 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4948 (secure 0 0 0) 0x7fdbac0ee4b0 con 0x7fdbc40725c0 2023-12-16T03:27:45.518 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:45.519 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3665146461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":3665146461},{"type":"v1","addr":"172.21.15.28:6837","nonce":3665146461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1938417336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1938417336},{"type":"v1","addr":"172.21.15.134:6835","nonce":1938417336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6318,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/3684375189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3684375189},{"type":"v1","addr":"172.21.15.28:6836","nonce":3684375189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:13.968886+0000","modified":"2023-12-16T03:27:17.002993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6834/4009894510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4009894510},{"type":"v1","addr":"172.21.15.134:6834","nonce":4009894510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-16T03:27:45.519 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 38 2023-12-16T03:27:45.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/2428238380 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdba4066470 msgr2=0x7fdba4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdba4066470 0x7fdba4068930 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4007fd0 tx=0x7fdbb4009040 comp rx=0 tx=0).stop 2023-12-16T03:27:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/2428238380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc40725c0 msgr2=0x7fdbc4146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc40725c0 0x7fdbc4146150 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0ae040 tx=0x7fdbac019190 comp rx=0 tx=0).stop 2023-12-16T03:27:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/2428238380 shutdown_connections 2023-12-16T03:27:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbc40a5370 0x7fdbc4148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdba4066470 0x7fdba4068930 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc40725c0 0x7fdbc4146150 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 --2- 172.21.15.28:0/2428238380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdbc4072090 0x7fdbc4150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/2428238380 >> 172.21.15.28:0/2428238380 conn(0x7fdbc406a5b0 msgr2=0x7fdbc40c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.515+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/2428238380 shutdown_connections 2023-12-16T03:27:45.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.519+0000 7fdbc9ec9640 1 -- 172.21.15.28:0/2428238380 wait complete. 2023-12-16T03:27:45.540 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:27:45.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.679+0000 7f88be032640 1 Processor -- start 2023-12-16T03:27:45.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.679+0000 7f88be032640 1 -- start start 2023-12-16T03:27:45.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88be032640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88b80c5260 0x7f88b806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88be032640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f88b80c5640 0x7f88b80c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88be032640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b80c2580 con 0x7f88b80c60f0 2023-12-16T03:27:45.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88be032640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b8153510 con 0x7f88b80c5640 2023-12-16T03:27:45.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88be032640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b80c17f0 con 0x7f88b80c5260 2023-12-16T03:27:45.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88b6ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f88b80c5640 0x7f88b80c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88b7fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f88b80c60f0 0x7f88b8155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41664/0 (socket says 172.21.15.28:41664) 2023-12-16T03:27:45.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88b7fff640 1 -- 172.21.15.28:0/1026919291 learned_addr learned my addr 172.21.15.28:0/1026919291 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:45.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88b77fe640 1 --2- 172.21.15.28:0/1026919291 >> v2:172.21.15.134:3300/0 conn(0x7f88b80c5260 0x7f88b806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88b6ffd640 1 -- 172.21.15.28:0/1026919291 >> v2:172.21.15.134:3300/0 conn(0x7f88b80c5260 msgr2=0x7f88b806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:45.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88b6ffd640 1 --2- 172.21.15.28:0/1026919291 >> v2:172.21.15.134:3300/0 conn(0x7f88b80c5260 0x7f88b806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88b6ffd640 1 -- 172.21.15.28:0/1026919291 >> v1:172.21.15.28:6789/0 conn(0x7f88b80c60f0 legacy=0x7f88b8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88b6ffd640 1 -- 172.21.15.28:0/1026919291 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80c1a00 con 0x7f88b80c5640 2023-12-16T03:27:45.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.683+0000 7f88b67fc640 1 -- 172.21.15.28:0/1026919291 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652342978 0 0) 0x7f88b80c2580 con 0x7f88b80c60f0 2023-12-16T03:27:45.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88b6ffd640 1 --2- 172.21.15.28:0/1026919291 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88b80c5640 0x7f88b80c5bb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f88b80c6920 tx=0x7f88ac01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762f62ec6953e2b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:45.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88b67fc640 1 -- 172.21.15.28:0/1026919291 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0ab600 con 0x7f88b80c5640 2023-12-16T03:27:45.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88b67fc640 1 -- 172.21.15.28:0/1026919291 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac0a7050 con 0x7f88b80c5640 2023-12-16T03:27:45.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88b67fc640 1 -- 172.21.15.28:0/1026919291 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0ab980 con 0x7f88b80c5640 2023-12-16T03:27:45.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88be032640 1 -- 172.21.15.28:0/1026919291 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88b80c5640 msgr2=0x7f88b80c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88be032640 1 --2- 172.21.15.28:0/1026919291 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88b80c5640 0x7f88b80c5bb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f88b80c6920 tx=0x7f88ac01c3a0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88be032640 1 -- 172.21.15.28:0/1026919291 shutdown_connections 2023-12-16T03:27:45.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88be032640 1 --2- 172.21.15.28:0/1026919291 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88b80c5640 0x7f88b80c5bb0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88be032640 1 --2- 172.21.15.28:0/1026919291 >> v2:172.21.15.134:3300/0 conn(0x7f88b80c5260 0x7f88b806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88be032640 1 -- 172.21.15.28:0/1026919291 >> 172.21.15.28:0/1026919291 conn(0x7f88b806a5b0 msgr2=0x7f88b806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:45.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88be032640 1 -- 172.21.15.28:0/1026919291 shutdown_connections 2023-12-16T03:27:45.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88be032640 1 -- 172.21.15.28:0/1026919291 wait complete. 2023-12-16T03:27:45.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88be032640 1 Processor -- start 2023-12-16T03:27:45.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.687+0000 7f88be032640 1 -- start start 2023-12-16T03:27:45.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88be032640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88b80c5260 0x7f88b814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88be032640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b80c5640 0x7f88b80bc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88be032640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88b80c60f0 0x7f88b81eb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88be032640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b81ead10 con 0x7f88b80c60f0 2023-12-16T03:27:45.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88be032640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b81ee7b0 con 0x7f88b80c5640 2023-12-16T03:27:45.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88be032640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b81eea90 con 0x7f88b80c5260 2023-12-16T03:27:45.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88b7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88b80c60f0 0x7f88b81eb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88b7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88b80c60f0 0x7f88b81eb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55124/0 (socket says 172.21.15.28:55124) 2023-12-16T03:27:45.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88b7fff640 1 -- 172.21.15.28:0/4222647518 learned_addr learned my addr 172.21.15.28:0/4222647518 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:45.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88b6ffd640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b80c5640 0x7f88b80bc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88b77fe640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88b80c5260 0x7f88b814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88b7fff640 1 -- 172.21.15.28:0/4222647518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88b80c5260 msgr2=0x7f88b814f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88b7fff640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88b80c5260 0x7f88b814f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88b7fff640 1 -- 172.21.15.28:0/4222647518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b80c5640 msgr2=0x7f88b80bc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88b7fff640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b80c5640 0x7f88b80bc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88b7fff640 1 -- 172.21.15.28:0/4222647518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac009420 con 0x7f88b80c60f0 2023-12-16T03:27:45.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88b7fff640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88b80c60f0 0x7f88b81eb240 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f88b0001570 tx=0x7f88b000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:45.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f889ffff640 1 -- 172.21.15.28:0/4222647518 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b000a640 con 0x7f88b80c60f0 2023-12-16T03:27:45.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f889ffff640 1 -- 172.21.15.28:0/4222647518 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b000a7c0 con 0x7f88b80c60f0 2023-12-16T03:27:45.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f889ffff640 1 -- 172.21.15.28:0/4222647518 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b000ab70 con 0x7f88b80c60f0 2023-12-16T03:27:45.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88be032640 1 -- 172.21.15.28:0/4222647518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b81eed70 con 0x7f88b80c60f0 2023-12-16T03:27:45.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88be032640 1 -- 172.21.15.28:0/4222647518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b80bd020 con 0x7f88b80c60f0 2023-12-16T03:27:45.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f88be032640 1 -- 172.21.15.28:0/4222647518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b81eaf60 con 0x7f88b80c60f0 2023-12-16T03:27:45.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.691+0000 7f889ffff640 1 -- 172.21.15.28:0/4222647518 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f88b000acd0 con 0x7f88b80c60f0 2023-12-16T03:27:45.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.695+0000 7f889ffff640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88a40664a0 0x7f88a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:45.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.695+0000 7f889ffff640 1 -- 172.21.15.28:0/4222647518 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f88b00832a0 con 0x7f88b80c60f0 2023-12-16T03:27:45.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.695+0000 7f88b77fe640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88a40664a0 0x7f88a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:45.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.695+0000 7f88b77fe640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88a40664a0 0x7f88a4068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f88b814f9a0 tx=0x7f88a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:45.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.699+0000 7f889ffff640 1 -- 172.21.15.28:0/4222647518 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f88b81eaf60 con 0x7f88b80c60f0 2023-12-16T03:27:45.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.887+0000 7f88be032640 1 -- 172.21.15.28:0/4222647518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88b81eaf60 con 0x7f88b80c60f0 2023-12-16T03:27:45.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.887+0000 7f889ffff640 1 -- 172.21.15.28:0/4222647518 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f88b81eaf60 con 0x7f88b80c60f0 2023-12-16T03:27:45.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:45.891 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3665146461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":3665146461},{"type":"v1","addr":"172.21.15.28:6837","nonce":3665146461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1938417336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1938417336},{"type":"v1","addr":"172.21.15.134:6835","nonce":1938417336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6318,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/3684375189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3684375189},{"type":"v1","addr":"172.21.15.28:6836","nonce":3684375189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:13.968886+0000","modified":"2023-12-16T03:27:17.002993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5641":{"gid":5641,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6834/4009894510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4009894510},{"type":"v1","addr":"172.21.15.134:6834","nonce":4009894510}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-16T03:27:45.892 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 38 2023-12-16T03:27:45.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 -- 172.21.15.28:0/4222647518 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88a40664a0 msgr2=0x7f88a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88a40664a0 0x7f88a4068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f88b814f9a0 tx=0x7f88a8008040 comp rx=0 tx=0).stop 2023-12-16T03:27:45.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 -- 172.21.15.28:0/4222647518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88b80c60f0 msgr2=0x7f88b81eb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:45.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88b80c60f0 0x7f88b81eb240 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f88b0001570 tx=0x7f88b000cca0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 -- 172.21.15.28:0/4222647518 shutdown_connections 2023-12-16T03:27:45.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f88a40664a0 0x7f88a4068960 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88b80c60f0 0x7f88b81eb240 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88b80c5640 0x7f88b80bc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 --2- 172.21.15.28:0/4222647518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88b80c5260 0x7f88b814f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:45.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 -- 172.21.15.28:0/4222647518 >> 172.21.15.28:0/4222647518 conn(0x7f88b806a5b0 msgr2=0x7f88b81543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:45.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 -- 172.21.15.28:0/4222647518 shutdown_connections 2023-12-16T03:27:45.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:45.891+0000 7f88be032640 1 -- 172.21.15.28:0/4222647518 wait complete. 2023-12-16T03:27:45.913 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.051+0000 7f245e7d1640 1 Processor -- start 2023-12-16T03:27:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.051+0000 7f245e7d1640 1 -- start start 2023-12-16T03:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f245e7d1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f24580c63c0 0x7f24580c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f245e7d1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f24580c2bb0 0x7f24580a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f245e7d1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24580c31c0 con 0x7f24580c4100 2023-12-16T03:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f245e7d1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580c34a0 con 0x7f24580c63c0 2023-12-16T03:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f245e7d1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580c1030 con 0x7f24580c2bb0 2023-12-16T03:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f2457fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f24580c63c0 0x7f24580c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f24577fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f24580c4100 0x7f24580c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41678/0 (socket says 172.21.15.28:41678) 2023-12-16T03:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f24577fe640 1 -- 172.21.15.28:0/34579570 learned_addr learned my addr 172.21.15.28:0/34579570 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f245cd6e640 1 --2- 172.21.15.28:0/34579570 >> v2:172.21.15.134:3300/0 conn(0x7f24580c2bb0 0x7f24580a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f2457fff640 1 -- 172.21.15.28:0/34579570 >> v2:172.21.15.134:3300/0 conn(0x7f24580c2bb0 msgr2=0x7f24580a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f2457fff640 1 --2- 172.21.15.28:0/34579570 >> v2:172.21.15.134:3300/0 conn(0x7f24580c2bb0 0x7f24580a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f2457fff640 1 -- 172.21.15.28:0/34579570 >> v1:172.21.15.28:6789/0 conn(0x7f24580c4100 legacy=0x7f24580c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f2457fff640 1 -- 172.21.15.28:0/34579570 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24580c1310 con 0x7f24580c63c0 2023-12-16T03:27:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f2456ffd640 1 -- 172.21.15.28:0/34579570 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935164244 0 0) 0x7f24580c31c0 con 0x7f24580c4100 2023-12-16T03:27:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.055+0000 7f245cd6e640 1 --2- 172.21.15.28:0/34579570 >> v2:172.21.15.134:3300/0 conn(0x7f24580c2bb0 0x7f24580a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:46.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f2457fff640 1 --2- 172.21.15.28:0/34579570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24580c63c0 0x7f24580c06d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f24580c4550 tx=0x7f244801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6ceaefdfb829ea server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:46.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f2456ffd640 1 -- 172.21.15.28:0/34579570 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24580aa3d0 con 0x7f24580c63c0 2023-12-16T03:27:46.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f2456ffd640 1 -- 172.21.15.28:0/34579570 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24480ad660 con 0x7f24580c63c0 2023-12-16T03:27:46.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f2456ffd640 1 -- 172.21.15.28:0/34579570 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480ad9f0 con 0x7f24580c63c0 2023-12-16T03:27:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f245e7d1640 1 -- 172.21.15.28:0/34579570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24580c63c0 msgr2=0x7f24580c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f245e7d1640 1 --2- 172.21.15.28:0/34579570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24580c63c0 0x7f24580c06d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f24580c4550 tx=0x7f244801c340 comp rx=0 tx=0).stop 2023-12-16T03:27:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f245e7d1640 1 -- 172.21.15.28:0/34579570 shutdown_connections 2023-12-16T03:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f245e7d1640 1 --2- 172.21.15.28:0/34579570 >> v2:172.21.15.134:3300/0 conn(0x7f24580c2bb0 0x7f24580a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f245e7d1640 1 --2- 172.21.15.28:0/34579570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24580c63c0 0x7f24580c06d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f245e7d1640 1 -- 172.21.15.28:0/34579570 >> 172.21.15.28:0/34579570 conn(0x7f245806a5b0 msgr2=0x7f245806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f245e7d1640 1 -- 172.21.15.28:0/34579570 shutdown_connections 2023-12-16T03:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f245e7d1640 1 -- 172.21.15.28:0/34579570 wait complete. 2023-12-16T03:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f245e7d1640 1 Processor -- start 2023-12-16T03:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.059+0000 7f245e7d1640 1 -- start start 2023-12-16T03:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f245e7d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24580c2bb0 0x7f24580a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f245e7d1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24580c4100 0x7f2458156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f245e7d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24580c63c0 0x7f2458157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f245e7d1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245815a1a0 con 0x7f24580c4100 2023-12-16T03:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f245e7d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245814cb30 con 0x7f24580c63c0 2023-12-16T03:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f245e7d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2458157a70 con 0x7f24580c2bb0 2023-12-16T03:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f24577fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24580c4100 0x7f2458156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f24577fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24580c4100 0x7f2458156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55142/0 (socket says 172.21.15.28:55142) 2023-12-16T03:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f24577fe640 1 -- 172.21.15.28:0/1181553970 learned_addr learned my addr 172.21.15.28:0/1181553970 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f245cd6e640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24580c63c0 0x7f2458157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f2457fff640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24580c2bb0 0x7f24580a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f24577fe640 1 -- 172.21.15.28:0/1181553970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24580c2bb0 msgr2=0x7f24580a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f24577fe640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24580c2bb0 0x7f24580a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f24577fe640 1 -- 172.21.15.28:0/1181553970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24580c63c0 msgr2=0x7f2458157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f24577fe640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24580c63c0 0x7f2458157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f24577fe640 1 -- 172.21.15.28:0/1181553970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448009420 con 0x7f24580c4100 2023-12-16T03:27:46.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f24577fe640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24580c4100 0x7f2458156ff0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f244c00c520 tx=0x7f244c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:46.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f2454ff9640 1 -- 172.21.15.28:0/1181553970 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0074e0 con 0x7f24580c4100 2023-12-16T03:27:46.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f2454ff9640 1 -- 172.21.15.28:0/1181553970 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c007640 con 0x7f24580c4100 2023-12-16T03:27:46.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f245e7d1640 1 -- 172.21.15.28:0/1181553970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2458158260 con 0x7f24580c4100 2023-12-16T03:27:46.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f2454ff9640 1 -- 172.21.15.28:0/1181553970 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0049f0 con 0x7f24580c4100 2023-12-16T03:27:46.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f245e7d1640 1 -- 172.21.15.28:0/1181553970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24581ed480 con 0x7f24580c4100 2023-12-16T03:27:46.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f245e7d1640 1 -- 172.21.15.28:0/1181553970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24581ed670 con 0x7f24580c4100 2023-12-16T03:27:46.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.063+0000 7f2454ff9640 1 -- 172.21.15.28:0/1181553970 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f244c004b50 con 0x7f24580c4100 2023-12-16T03:27:46.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.067+0000 7f2454ff9640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2444066470 0x7f2444068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.067+0000 7f2454ff9640 1 -- 172.21.15.28:0/1181553970 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f244c0834b0 con 0x7f24580c4100 2023-12-16T03:27:46.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.067+0000 7f2457fff640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2444066470 0x7f2444068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.067+0000 7f2457fff640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2444066470 0x7f2444068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f24480af000 tx=0x7f24480a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:46.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.071+0000 7f2454ff9640 1 -- 172.21.15.28:0/1181553970 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f244c050970 con 0x7f24580c4100 2023-12-16T03:27:46.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 -- 172.21.15.28:0/1181553970 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2458068400 con 0x7f24580c4100 2023-12-16T03:27:46.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f2454ff9640 1 -- 172.21.15.28:0/1181553970 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16701 (secure 0 0 0) 0x7f244c053f90 con 0x7f24580c4100 2023-12-16T03:27:46.234 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:46.235 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":57,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:43.020486+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:27:12.042891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:27:12.972488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6836/3717643902":"2023-12-17T03:27:40.012876+0000","172.21.15.28:6834/3717643902":"2023-12-17T03:27:40.012876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:46.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 -- 172.21.15.28:0/1181553970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2444066470 msgr2=0x7f2444068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2444066470 0x7f2444068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f24480af000 tx=0x7f24480a7000 comp rx=0 tx=0).stop 2023-12-16T03:27:46.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 -- 172.21.15.28:0/1181553970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24580c4100 msgr2=0x7f2458156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24580c4100 0x7f2458156ff0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f244c00c520 tx=0x7f244c00c9e0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 -- 172.21.15.28:0/1181553970 shutdown_connections 2023-12-16T03:27:46.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24580c63c0 0x7f2458157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2444066470 0x7f2444068930 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24580c4100 0x7f2458156ff0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 --2- 172.21.15.28:0/1181553970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24580c2bb0 0x7f24580a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 -- 172.21.15.28:0/1181553970 >> 172.21.15.28:0/1181553970 conn(0x7f245806a5b0 msgr2=0x7f24580a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:46.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 -- 172.21.15.28:0/1181553970 shutdown_connections 2023-12-16T03:27:46.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.231+0000 7f245e7d1640 1 -- 172.21.15.28:0/1181553970 wait complete. 2023-12-16T03:27:46.256 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-16T03:27:46.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.395+0000 7f9899faa640 1 Processor -- start 2023-12-16T03:27:46.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.395+0000 7f9899faa640 1 -- start start 2023-12-16T03:27:46.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9899faa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98940c63c0 0x7f98940c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9899faa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f98940c2bb0 0x7f98940a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9899faa640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98940c31c0 con 0x7f98940c4100 2023-12-16T03:27:46.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9899faa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98940c34a0 con 0x7f98940c2bb0 2023-12-16T03:27:46.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9899faa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98940c1030 con 0x7f98940c63c0 2023-12-16T03:27:46.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9893fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f98940c2bb0 0x7f98940a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9893fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f98940c2bb0 0x7f98940a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55158/0 (socket says 172.21.15.28:55158) 2023-12-16T03:27:46.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9893fff640 1 -- 172.21.15.28:0/4093498944 learned_addr learned my addr 172.21.15.28:0/4093498944 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:46.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f98937fe640 1 --2- 172.21.15.28:0/4093498944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98940c63c0 0x7f98940c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9893fff640 1 -- 172.21.15.28:0/4093498944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98940c63c0 msgr2=0x7f98940c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:46.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9893fff640 1 --2- 172.21.15.28:0/4093498944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98940c63c0 0x7f98940c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9893fff640 1 -- 172.21.15.28:0/4093498944 >> v1:172.21.15.134:6789/0 conn(0x7f98940c4100 legacy=0x7f98940c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9893fff640 1 -- 172.21.15.28:0/4093498944 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98940c1310 con 0x7f98940c2bb0 2023-12-16T03:27:46.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.399+0000 7f9893fff640 1 --2- 172.21.15.28:0/4093498944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98940c2bb0 0x7f98940a9680 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f988c009e50 tx=0x7f988c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a877d0bd0275c7a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:46.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f98927fc640 1 -- 172.21.15.28:0/4093498944 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98940aa3d0 con 0x7f98940c2bb0 2023-12-16T03:27:46.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f98927fc640 1 -- 172.21.15.28:0/4093498944 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c0a57a0 con 0x7f98940c2bb0 2023-12-16T03:27:46.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f98927fc640 1 -- 172.21.15.28:0/4093498944 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c0a5b30 con 0x7f98940c2bb0 2023-12-16T03:27:46.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 -- 172.21.15.28:0/4093498944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98940c2bb0 msgr2=0x7f98940a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 --2- 172.21.15.28:0/4093498944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98940c2bb0 0x7f98940a9680 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f988c009e50 tx=0x7f988c01c8c0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 -- 172.21.15.28:0/4093498944 shutdown_connections 2023-12-16T03:27:46.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 --2- 172.21.15.28:0/4093498944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98940c2bb0 0x7f98940a9680 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 --2- 172.21.15.28:0/4093498944 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98940c63c0 0x7f98940c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 -- 172.21.15.28:0/4093498944 >> 172.21.15.28:0/4093498944 conn(0x7f989406a5b0 msgr2=0x7f989406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:46.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 -- 172.21.15.28:0/4093498944 shutdown_connections 2023-12-16T03:27:46.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 -- 172.21.15.28:0/4093498944 wait complete. 2023-12-16T03:27:46.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 Processor -- start 2023-12-16T03:27:46.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 -- start start 2023-12-16T03:27:46.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98940c2bb0 0x7f98941f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98940c4100 0x7f9894153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98940c63c0 0x7f9894153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9894072520 con 0x7f98940c4100 2023-12-16T03:27:46.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989406aa40 con 0x7f98940c63c0 2023-12-16T03:27:46.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9899faa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9894153ab0 con 0x7f98940c2bb0 2023-12-16T03:27:46.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.403+0000 7f9892ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98940c4100 0x7f9894153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9892ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98940c4100 0x7f9894153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55166/0 (socket says 172.21.15.28:55166) 2023-12-16T03:27:46.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9892ffd640 1 -- 172.21.15.28:0/2618496204 learned_addr learned my addr 172.21.15.28:0/2618496204 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:46.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9893fff640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98940c63c0 0x7f9894153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f98937fe640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98940c2bb0 0x7f98941f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9892ffd640 1 -- 172.21.15.28:0/2618496204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98940c2bb0 msgr2=0x7f98941f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9892ffd640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98940c2bb0 0x7f98941f04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9892ffd640 1 -- 172.21.15.28:0/2618496204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98940c63c0 msgr2=0x7f9894153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9892ffd640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98940c63c0 0x7f9894153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9892ffd640 1 -- 172.21.15.28:0/2618496204 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c009b30 con 0x7f98940c4100 2023-12-16T03:27:46.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9892ffd640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98940c4100 0x7f9894153030 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f988800c560 tx=0x7f988800ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:46.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f987bfff640 1 -- 172.21.15.28:0/2618496204 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888005220 con 0x7f98940c4100 2023-12-16T03:27:46.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f987bfff640 1 -- 172.21.15.28:0/2618496204 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9888005380 con 0x7f98940c4100 2023-12-16T03:27:46.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f987bfff640 1 -- 172.21.15.28:0/2618496204 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888007270 con 0x7f98940c4100 2023-12-16T03:27:46.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9899faa640 1 -- 172.21.15.28:0/2618496204 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989406ac90 con 0x7f98940c4100 2023-12-16T03:27:46.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9899faa640 1 -- 172.21.15.28:0/2618496204 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989415ac90 con 0x7f98940c4100 2023-12-16T03:27:46.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f9899faa640 1 -- 172.21.15.28:0/2618496204 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9894099c50 con 0x7f98940c4100 2023-12-16T03:27:46.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f987bfff640 1 -- 172.21.15.28:0/2618496204 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f98880073d0 con 0x7f98940c4100 2023-12-16T03:27:46.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f987bfff640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9880066470 0x7f9880068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.407+0000 7f987bfff640 1 -- 172.21.15.28:0/2618496204 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9888083600 con 0x7f98940c4100 2023-12-16T03:27:46.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.411+0000 7f98937fe640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9880066470 0x7f9880068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.411+0000 7f98937fe640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9880066470 0x7f9880068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9884009ac0 tx=0x7f9884009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:46.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.415+0000 7f987bfff640 1 -- 172.21.15.28:0/2618496204 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9894099c50 con 0x7f98940c4100 2023-12-16T03:27:46.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.607+0000 7f9899faa640 1 -- 172.21.15.28:0/2618496204 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f9894156850 con 0x7f98940c4100 2023-12-16T03:27:46.610 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-12-16T03:27:46.607+0000 7f6a9e376640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T03:27:46.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.607+0000 7f987bfff640 1 -- 172.21.15.28:0/2618496204 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 163+0+0 (secure 0 0 0) 0x7f9894156850 con 0x7f98940c4100 2023-12-16T03:27:46.612 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-16T03:27:46.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 -- 172.21.15.28:0/2618496204 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9880066470 msgr2=0x7f9880068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9880066470 0x7f9880068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9884009ac0 tx=0x7f9884009190 comp rx=0 tx=0).stop 2023-12-16T03:27:46.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 -- 172.21.15.28:0/2618496204 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98940c4100 msgr2=0x7f9894153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98940c4100 0x7f9894153030 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f988800c560 tx=0x7f988800ca20 comp rx=0 tx=0).stop 2023-12-16T03:27:46.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 -- 172.21.15.28:0/2618496204 shutdown_connections 2023-12-16T03:27:46.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98940c63c0 0x7f9894153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9880066470 0x7f9880068930 secure :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9884009ac0 tx=0x7f9884009190 comp rx=0 tx=0).stop 2023-12-16T03:27:46.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98940c4100 0x7f9894153030 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 --2- 172.21.15.28:0/2618496204 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98940c2bb0 0x7f98941f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 -- 172.21.15.28:0/2618496204 >> 172.21.15.28:0/2618496204 conn(0x7f989406a5b0 msgr2=0x7f98940bf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:46.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 -- 172.21.15.28:0/2618496204 shutdown_connections 2023-12-16T03:27:46.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.611+0000 7f9899faa640 1 -- 172.21.15.28:0/2618496204 wait complete. 2023-12-16T03:27:46.625 INFO:tasks.ceph.mds.b.smithi134.stderr: -2174> 2023-12-16T03:27:17.476+0000 7f137d005640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:27:46.637 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-16T03:27:46.672 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-12-16T03:27:46.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.779+0000 7fa141365640 1 Processor -- start 2023-12-16T03:27:46.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.779+0000 7fa141365640 1 -- start start 2023-12-16T03:27:46.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa141365640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa13c0a4d30 0x7fa13c0a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa141365640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa13c0c0f70 0x7fa13c0c1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa141365640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13c0c3c00 con 0x7fa13c06dba0 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa141365640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13c06df80 con 0x7fa13c0a4d30 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa141365640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13c0c0560 con 0x7fa13c0c0f70 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa133fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa13c0a4d30 0x7fa13c0a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa133fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa13c0a4d30 0x7fa13c0a51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55172/0 (socket says 172.21.15.28:55172) 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa133fff640 1 -- 172.21.15.28:0/836848337 learned_addr learned my addr 172.21.15.28:0/836848337 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa13b7fe640 1 --2- 172.21.15.28:0/836848337 >> v2:172.21.15.134:3300/0 conn(0x7fa13c0c0f70 0x7fa13c0c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa133fff640 1 -- 172.21.15.28:0/836848337 >> v2:172.21.15.134:3300/0 conn(0x7fa13c0c0f70 msgr2=0x7fa13c0c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa133fff640 1 --2- 172.21.15.28:0/836848337 >> v2:172.21.15.134:3300/0 conn(0x7fa13c0c0f70 0x7fa13c0c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa133fff640 1 -- 172.21.15.28:0/836848337 >> v1:172.21.15.134:6789/0 conn(0x7fa13c06dba0 legacy=0x7fa13c151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa133fff640 1 -- 172.21.15.28:0/836848337 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c0c3ee0 con 0x7fa13c0a4d30 2023-12-16T03:27:46.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa13b7fe640 1 --2- 172.21.15.28:0/836848337 >> v2:172.21.15.134:3300/0 conn(0x7fa13c0c0f70 0x7fa13c0c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:46.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.783+0000 7fa133fff640 1 --2- 172.21.15.28:0/836848337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa13c0a4d30 0x7fa13c0a51e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0c23e0 tx=0x7fa12401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebda2770cf41bc14 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:46.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa13a7fc640 1 -- 172.21.15.28:0/836848337 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1240ab600 con 0x7fa13c0a4d30 2023-12-16T03:27:46.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa13a7fc640 1 -- 172.21.15.28:0/836848337 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1240a7050 con 0x7fa13c0a4d30 2023-12-16T03:27:46.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa13a7fc640 1 -- 172.21.15.28:0/836848337 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1240ab980 con 0x7fa13c0a4d30 2023-12-16T03:27:46.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 -- 172.21.15.28:0/836848337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa13c0a4d30 msgr2=0x7fa13c0a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 --2- 172.21.15.28:0/836848337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa13c0a4d30 0x7fa13c0a51e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0c23e0 tx=0x7fa12401c430 comp rx=0 tx=0).stop 2023-12-16T03:27:46.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 -- 172.21.15.28:0/836848337 shutdown_connections 2023-12-16T03:27:46.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 --2- 172.21.15.28:0/836848337 >> v2:172.21.15.134:3300/0 conn(0x7fa13c0c0f70 0x7fa13c0c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 --2- 172.21.15.28:0/836848337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa13c0a4d30 0x7fa13c0a51e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 -- 172.21.15.28:0/836848337 >> 172.21.15.28:0/836848337 conn(0x7fa13c0a7910 msgr2=0x7fa13c0a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:46.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 -- 172.21.15.28:0/836848337 shutdown_connections 2023-12-16T03:27:46.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 -- 172.21.15.28:0/836848337 wait complete. 2023-12-16T03:27:46.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 Processor -- start 2023-12-16T03:27:46.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 -- start start 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c06dba0 0x7fa13c1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa13c0a4d30 0x7fa13c152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa13c0c0f70 0x7fa13c1ed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c1ecb10 con 0x7fa13c0c0f70 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c154aa0 con 0x7fa13c06dba0 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa141365640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c154d80 con 0x7fa13c0a4d30 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa13b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa13c0c0f70 0x7fa13c1ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa13b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa13c0c0f70 0x7fa13c1ed240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55182/0 (socket says 172.21.15.28:55182) 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.787+0000 7fa13b7fe640 1 -- 172.21.15.28:0/3373532579 learned_addr learned my addr 172.21.15.28:0/3373532579 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa133fff640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa13c0a4d30 0x7fa13c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa13affd640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c06dba0 0x7fa13c1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa13b7fe640 1 -- 172.21.15.28:0/3373532579 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa13c0a4d30 msgr2=0x7fa13c152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa13b7fe640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa13c0a4d30 0x7fa13c152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa13b7fe640 1 -- 172.21.15.28:0/3373532579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c06dba0 msgr2=0x7fa13c1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:46.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa13b7fe640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c06dba0 0x7fa13c1544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:46.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa13b7fe640 1 -- 172.21.15.28:0/3373532579 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1240094d0 con 0x7fa13c0c0f70 2023-12-16T03:27:46.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa13b7fe640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa13c0c0f70 0x7fa13c1ed240 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa13400cd50 tx=0x7fa13400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:46.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa1337fe640 1 -- 172.21.15.28:0/3373532579 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13400f680 con 0x7fa13c0c0f70 2023-12-16T03:27:46.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa1337fe640 1 -- 172.21.15.28:0/3373532579 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13400f800 con 0x7fa13c0c0f70 2023-12-16T03:27:46.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa141365640 1 -- 172.21.15.28:0/3373532579 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13c155060 con 0x7fa13c0c0f70 2023-12-16T03:27:46.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa1337fe640 1 -- 172.21.15.28:0/3373532579 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13400fbb0 con 0x7fa13c0c0f70 2023-12-16T03:27:46.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa141365640 1 -- 172.21.15.28:0/3373532579 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13c152d60 con 0x7fa13c0c0f70 2023-12-16T03:27:46.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa141365640 1 -- 172.21.15.28:0/3373532579 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13c1ecf60 con 0x7fa13c0c0f70 2023-12-16T03:27:46.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa1337fe640 1 -- 172.21.15.28:0/3373532579 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa13400b040 con 0x7fa13c0c0f70 2023-12-16T03:27:46.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa1337fe640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa11c066470 0x7fa11c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:46.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa1337fe640 1 -- 172.21.15.28:0/3373532579 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fa134084990 con 0x7fa13c0c0f70 2023-12-16T03:27:46.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.791+0000 7fa13affd640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa11c066470 0x7fa11c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:46.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.795+0000 7fa13affd640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa11c066470 0x7fa11c068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa12c004e30 tx=0x7fa12c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:46.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.795+0000 7fa1337fe640 1 -- 172.21.15.28:0/3373532579 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa13c1ecf60 con 0x7fa13c0c0f70 2023-12-16T03:27:46.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:46.987+0000 7fa141365640 1 -- 172.21.15.28:0/3373532579 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa13c1ecf60 con 0x7fa13c0c0f70 2023-12-16T03:27:47.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.611+0000 7fa1337fe640 1 -- 172.21.15.28:0/3373532579 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 105+0+0 (secure 0 0 0) 0x7fa13c1ecf60 con 0x7fa13c0c0f70 2023-12-16T03:27:47.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 -- 172.21.15.28:0/3373532579 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa11c066470 msgr2=0x7fa11c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:47.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa11c066470 0x7fa11c068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa12c004e30 tx=0x7fa12c009040 comp rx=0 tx=0).stop 2023-12-16T03:27:47.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 -- 172.21.15.28:0/3373532579 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa13c0c0f70 msgr2=0x7fa13c1ed240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:47.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa13c0c0f70 0x7fa13c1ed240 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa13400cd50 tx=0x7fa13400a650 comp rx=0 tx=0).stop 2023-12-16T03:27:47.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 -- 172.21.15.28:0/3373532579 shutdown_connections 2023-12-16T03:27:47.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa11c066470 0x7fa11c068930 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:47.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa13c0c0f70 0x7fa13c1ed240 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:47.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa13c0a4d30 0x7fa13c152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:47.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 --2- 172.21.15.28:0/3373532579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13c06dba0 0x7fa13c1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:47.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 -- 172.21.15.28:0/3373532579 >> 172.21.15.28:0/3373532579 conn(0x7fa13c0a7910 msgr2=0x7fa13c14a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:47.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 -- 172.21.15.28:0/3373532579 shutdown_connections 2023-12-16T03:27:47.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.615+0000 7fa141365640 1 -- 172.21.15.28:0/3373532579 wait complete. 2023-12-16T03:27:47.641 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-16T03:27:47.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f396acdd640 1 Processor -- start 2023-12-16T03:27:47.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f396acdd640 1 -- start start 2023-12-16T03:27:47.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f396acdd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3964151e00 0x7f3964158580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:47.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f396acdd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39640c07f0 0x7f39640c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:47.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f396acdd640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3964073b70 con 0x7f39640c0370 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f396acdd640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39640c0c80 con 0x7f3964151e00 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f396acdd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3964158ac0 con 0x7f39640c07f0 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f3968a79640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3964151e00 0x7f3964158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f3968a79640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3964151e00 0x7f3964158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55198/0 (socket says 172.21.15.28:55198) 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f3968a79640 1 -- 172.21.15.28:0/3201382558 learned_addr learned my addr 172.21.15.28:0/3201382558 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f3963fff640 1 --1- 172.21.15.28:0/3201382558 >> v1:172.21.15.28:6789/0 conn(0x7f39640c0370 0x7f39640c12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41686/0 (socket says 172.21.15.28:41686) 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f396927a640 1 --2- 172.21.15.28:0/3201382558 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39640c07f0 0x7f39640c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f3968a79640 1 -- 172.21.15.28:0/3201382558 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39640c07f0 msgr2=0x7f39640c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f3968a79640 1 --2- 172.21.15.28:0/3201382558 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39640c07f0 0x7f39640c19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f3968a79640 1 -- 172.21.15.28:0/3201382558 >> v1:172.21.15.28:6789/0 conn(0x7f39640c0370 legacy=0x7f39640c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f3968a79640 1 -- 172.21.15.28:0/3201382558 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640735b0 con 0x7f3964151e00 2023-12-16T03:27:47.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.791+0000 7f39637fe640 1 -- 172.21.15.28:0/3201382558 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363626807 0 0) 0x7f3964073b70 con 0x7f39640c0370 2023-12-16T03:27:47.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f3968a79640 1 --2- 172.21.15.28:0/3201382558 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3964151e00 0x7f3964158580 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3958009870 tx=0x7f395801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1637dac901552b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f39637fe640 1 -- 172.21.15.28:0/3201382558 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580ab600 con 0x7f3964151e00 2023-12-16T03:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f39637fe640 1 -- 172.21.15.28:0/3201382558 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39580a7050 con 0x7f3964151e00 2023-12-16T03:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f39637fe640 1 -- 172.21.15.28:0/3201382558 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580ab980 con 0x7f3964151e00 2023-12-16T03:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f396acdd640 1 -- 172.21.15.28:0/3201382558 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3964151e00 msgr2=0x7f3964158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f396acdd640 1 --2- 172.21.15.28:0/3201382558 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3964151e00 0x7f3964158580 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3958009870 tx=0x7f395801c420 comp rx=0 tx=0).stop 2023-12-16T03:27:47.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f396acdd640 1 -- 172.21.15.28:0/3201382558 shutdown_connections 2023-12-16T03:27:47.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f396acdd640 1 --2- 172.21.15.28:0/3201382558 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39640c07f0 0x7f39640c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:47.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f396acdd640 1 --2- 172.21.15.28:0/3201382558 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3964151e00 0x7f3964158580 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:47.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f396acdd640 1 -- 172.21.15.28:0/3201382558 >> 172.21.15.28:0/3201382558 conn(0x7f39640c31a0 msgr2=0x7f39640c35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:47.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f396acdd640 1 -- 172.21.15.28:0/3201382558 shutdown_connections 2023-12-16T03:27:47.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f396acdd640 1 -- 172.21.15.28:0/3201382558 wait complete. 2023-12-16T03:27:47.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f396acdd640 1 Processor -- start 2023-12-16T03:27:47.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.795+0000 7f396acdd640 1 -- start start 2023-12-16T03:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f396acdd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39640c0370 0x7f3964156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f396acdd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39640c07f0 0x7f39640a9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f396acdd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3964151e00 0x7f396413f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f396acdd640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640ab170 con 0x7f39640c0370 2023-12-16T03:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f396acdd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640abf70 con 0x7f3964151e00 2023-12-16T03:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f396acdd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39640c5c60 con 0x7f39640c07f0 2023-12-16T03:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f3968a79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39640c0370 0x7f3964156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f3968a79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39640c0370 0x7f3964156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55210/0 (socket says 172.21.15.28:55210) 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f3968a79640 1 -- 172.21.15.28:0/3593851937 learned_addr learned my addr 172.21.15.28:0/3593851937 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f3963fff640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39640c07f0 0x7f39640a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f396927a640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3964151e00 0x7f396413f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f3968a79640 1 -- 172.21.15.28:0/3593851937 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39640c07f0 msgr2=0x7f39640a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f3968a79640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39640c07f0 0x7f39640a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f3968a79640 1 -- 172.21.15.28:0/3593851937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3964151e00 msgr2=0x7f396413f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f3968a79640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3964151e00 0x7f396413f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f3968a79640 1 -- 172.21.15.28:0/3593851937 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39580094d0 con 0x7f39640c0370 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f396927a640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3964151e00 0x7f396413f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f3968a79640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39640c0370 0x7f3964156c70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f39580ae040 tx=0x7f395801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f39617fa640 1 -- 172.21.15.28:0/3593851937 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580b6620 con 0x7f39640c0370 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f39617fa640 1 -- 172.21.15.28:0/3593851937 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39580b67a0 con 0x7f39640c0370 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f39617fa640 1 -- 172.21.15.28:0/3593851937 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580b6b50 con 0x7f39640c0370 2023-12-16T03:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f396acdd640 1 -- 172.21.15.28:0/3593851937 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39641ed250 con 0x7f39640c0370 2023-12-16T03:27:47.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f396acdd640 1 -- 172.21.15.28:0/3593851937 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39641ed780 con 0x7f39640c0370 2023-12-16T03:27:47.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f396acdd640 1 -- 172.21.15.28:0/3593851937 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3964066b70 con 0x7f39640c0370 2023-12-16T03:27:47.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.799+0000 7f39617fa640 1 -- 172.21.15.28:0/3593851937 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f39580b2040 con 0x7f39640c0370 2023-12-16T03:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.803+0000 7f39617fa640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3948066470 0x7f3948068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.803+0000 7f39617fa640 1 -- 172.21.15.28:0/3593851937 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f395811e2b0 con 0x7f39640c0370 2023-12-16T03:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.803+0000 7f3963fff640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3948066470 0x7f3948068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.803+0000 7f3963fff640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3948066470 0x7f3948068930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f39640678f0 tx=0x7f3950007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:47.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.807+0000 7f39617fa640 1 -- 172.21.15.28:0/3593851937 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f39580eb790 con 0x7f39640c0370 2023-12-16T03:27:47.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:47.967+0000 7f396acdd640 1 -- 172.21.15.28:0/3593851937 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3964068400 con 0x7f39640c0370 2023-12-16T03:27:48.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.619+0000 7f39617fa640 1 -- 172.21.15.28:0/3593851937 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v59) v1 ==== 184+0+0 (secure 0 0 0) 0x7f39580eedb0 con 0x7f39640c0370 2023-12-16T03:27:48.624 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_metadata' removed 2023-12-16T03:27:48.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 -- 172.21.15.28:0/3593851937 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3948066470 msgr2=0x7f3948068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:48.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3948066470 0x7f3948068930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f39640678f0 tx=0x7f3950007c10 comp rx=0 tx=0).stop 2023-12-16T03:27:48.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 -- 172.21.15.28:0/3593851937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39640c0370 msgr2=0x7f3964156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:48.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39640c0370 0x7f3964156c70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f39580ae040 tx=0x7f395801ac60 comp rx=0 tx=0).stop 2023-12-16T03:27:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 -- 172.21.15.28:0/3593851937 shutdown_connections 2023-12-16T03:27:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3964151e00 0x7f396413f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39640c07f0 0x7f39640a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3948066470 0x7f3948068930 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 --2- 172.21.15.28:0/3593851937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f39640c0370 0x7f3964156c70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 -- 172.21.15.28:0/3593851937 >> 172.21.15.28:0/3593851937 conn(0x7f39640c31a0 msgr2=0x7f39640716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 -- 172.21.15.28:0/3593851937 shutdown_connections 2023-12-16T03:27:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.623+0000 7f396acdd640 1 -- 172.21.15.28:0/3593851937 wait complete. 2023-12-16T03:27:48.649 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-16T03:27:48.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.791+0000 7f0f56aad640 1 Processor -- start 2023-12-16T03:27:48.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f56aad640 1 -- start start 2023-12-16T03:27:48.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f56aad640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f500a4fc0 0x7f0f500a5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:48.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f56aad640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f500c42b0 0x7f0f501582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:48.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f56aad640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f500c28e0 con 0x7f0f500c13b0 2023-12-16T03:27:48.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f56aad640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f500c2bc0 con 0x7f0f500c42b0 2023-12-16T03:27:48.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f56aad640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500c2ea0 con 0x7f0f500a4fc0 2023-12-16T03:27:48.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f54849640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0f500c13b0 0x7f0f500a9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41700/0 (socket says 172.21.15.28:41700) 2023-12-16T03:27:48.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f54849640 1 -- 172.21.15.28:0/243470181 learned_addr learned my addr 172.21.15.28:0/243470181 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f5504a640 1 --2- 172.21.15.28:0/243470181 >> v2:172.21.15.134:3300/0 conn(0x7f0f500c42b0 0x7f0f501582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4ffff640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f500a4fc0 0x7f0f500a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195341703 0 0) 0x7f0f500c28e0 con 0x7f0f500c13b0 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f40003530 con 0x7f0f500c13b0 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3286674025 0 0) 0x7f0f40003530 con 0x7f0f500c13b0 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f500a4fc0 msgr2=0x7f0f500a5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f500a4fc0 0x7f0f500a5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 >> v2:172.21.15.134:3300/0 conn(0x7f0f500c42b0 msgr2=0x7f0f501582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 --2- 172.21.15.28:0/243470181 >> v2:172.21.15.134:3300/0 conn(0x7f0f500c42b0 0x7f0f501582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f500c3180 con 0x7f0f500c13b0 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f0f44001680 con 0x7f0f500c13b0 2023-12-16T03:27:48.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 >> v1:172.21.15.28:6789/0 conn(0x7f0f500c13b0 legacy=0x7f0f500a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 0x7f0f40003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f500a4fc0 0x7f0f400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40004d10 0x7f0f40005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500c2bc0 con 0x7f0f40003980 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500c2ea0 con 0x7f0f40004d10 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4000ba10 con 0x7f0f500a4fc0 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f54849640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 0x7f0f40003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f4ffff640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f500a4fc0 0x7f0f400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f5504a640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40004d10 0x7f0f40005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f54849640 1 -- 172.21.15.28:0/243470181 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f500a4fc0 msgr2=0x7f0f400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f54849640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f500a4fc0 0x7f0f400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f54849640 1 -- 172.21.15.28:0/243470181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40004d10 msgr2=0x7f0f40005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:48.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f54849640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40004d10 0x7f0f40005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:48.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.795+0000 7f0f54849640 1 -- 172.21.15.28:0/243470181 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f40003530 con 0x7f0f40003980 2023-12-16T03:27:48.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.799+0000 7f0f54849640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 0x7f0f40003da0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c160 tx=0x7f0f4401cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33718016f35b83b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:48.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.799+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f440058e0 con 0x7f0f40003980 2023-12-16T03:27:48.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.799+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f44005a40 con 0x7f0f40003980 2023-12-16T03:27:48.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.799+0000 7f0f4f7fe640 1 -- 172.21.15.28:0/243470181 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44005df0 con 0x7f0f40003980 2023-12-16T03:27:48.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.799+0000 7f0f56aad640 1 -- 172.21.15.28:0/243470181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 msgr2=0x7f0f40003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:48.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.799+0000 7f0f56aad640 1 --2- 172.21.15.28:0/243470181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 0x7f0f40003da0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c160 tx=0x7f0f4401cb50 comp rx=0 tx=0).stop 2023-12-16T03:27:48.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.799+0000 7f0f5504a640 1 -- 172.21.15.28:0/243470181 reap_dead start 2023-12-16T03:27:48.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.799+0000 7f0f56aad640 1 -- 172.21.15.28:0/243470181 shutdown_connections 2023-12-16T03:27:48.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.799+0000 7f0f56aad640 1 -- 172.21.15.28:0/243470181 >> 172.21.15.28:0/243470181 conn(0x7f0f500c5d40 msgr2=0x7f0f500c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:48.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.799+0000 7f0f56aad640 1 -- 172.21.15.28:0/243470181 shutdown_connections 2023-12-16T03:27:48.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.799+0000 7f0f56aad640 1 -- 172.21.15.28:0/243470181 wait complete. 2023-12-16T03:27:48.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f56aad640 1 Processor -- start 2023-12-16T03:27:48.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f56aad640 1 -- start start 2023-12-16T03:27:48.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f56aad640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 0x7f0f5006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:48.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f56aad640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f500a4990 0x7f0f501f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:48.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f56aad640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f50072510 0x7f0f501f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:48.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f56aad640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f50154bf0 con 0x7f0f40003980 2023-12-16T03:27:48.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f56aad640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f50155140 con 0x7f0f500a4990 2023-12-16T03:27:48.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f56aad640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f50154e60 con 0x7f0f50072510 2023-12-16T03:27:48.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f54849640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 0x7f0f5006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:48.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f54849640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 0x7f0f5006d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55232/0 (socket says 172.21.15.28:55232) 2023-12-16T03:27:48.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f54849640 1 -- 172.21.15.28:0/1316915281 learned_addr learned my addr 172.21.15.28:0/1316915281 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:48.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f4ffff640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f500a4990 0x7f0f501f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:48.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f5504a640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f50072510 0x7f0f501f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:48.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f54849640 1 -- 172.21.15.28:0/1316915281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f50072510 msgr2=0x7f0f501f0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:48.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f54849640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f50072510 0x7f0f501f0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:48.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f54849640 1 -- 172.21.15.28:0/1316915281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f500a4990 msgr2=0x7f0f501f04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:48.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f54849640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f500a4990 0x7f0f501f04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:48.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f54849640 1 -- 172.21.15.28:0/1316915281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f50071ff0 con 0x7f0f40003980 2023-12-16T03:27:48.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f54849640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 0x7f0f5006d180 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f0f4401c980 tx=0x7f0f40005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:48.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f4d7fa640 1 -- 172.21.15.28:0/1316915281 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f440016a0 con 0x7f0f40003980 2023-12-16T03:27:48.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f4d7fa640 1 -- 172.21.15.28:0/1316915281 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f440047f0 con 0x7f0f40003980 2023-12-16T03:27:48.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f4d7fa640 1 -- 172.21.15.28:0/1316915281 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44004ba0 con 0x7f0f40003980 2023-12-16T03:27:48.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f56aad640 1 -- 172.21.15.28:0/1316915281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5006d6c0 con 0x7f0f40003980 2023-12-16T03:27:48.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f56aad640 1 -- 172.21.15.28:0/1316915281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f501edd50 con 0x7f0f40003980 2023-12-16T03:27:48.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.803+0000 7f0f56aad640 1 -- 172.21.15.28:0/1316915281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f50072180 con 0x7f0f40003980 2023-12-16T03:27:48.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.807+0000 7f0f4d7fa640 1 -- 172.21.15.28:0/1316915281 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0f44004d00 con 0x7f0f40003980 2023-12-16T03:27:48.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.807+0000 7f0f4d7fa640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f34066470 0x7f0f34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:48.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.807+0000 7f0f4d7fa640 1 -- 172.21.15.28:0/1316915281 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f0f4411d290 con 0x7f0f40003980 2023-12-16T03:27:48.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.807+0000 7f0f4ffff640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f34066470 0x7f0f34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:48.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.807+0000 7f0f4ffff640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f34066470 0x7f0f34068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0f5015dec0 tx=0x7f0f3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:48.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.811+0000 7f0f4d7fa640 1 -- 172.21.15.28:0/1316915281 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0f440ea770 con 0x7f0f40003980 2023-12-16T03:27:48.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:48.967+0000 7f0f56aad640 1 -- 172.21.15.28:0/1316915281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0f50154fa0 con 0x7f0f40003980 2023-12-16T03:27:49.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.623+0000 7f0f4d7fa640 1 -- 172.21.15.28:0/1316915281 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v60) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0f50154fa0 con 0x7f0f40003980 2023-12-16T03:27:49.626 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_data' removed 2023-12-16T03:27:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 -- 172.21.15.28:0/1316915281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f34066470 msgr2=0x7f0f34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f34066470 0x7f0f34068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0f5015dec0 tx=0x7f0f3c008040 comp rx=0 tx=0).stop 2023-12-16T03:27:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 -- 172.21.15.28:0/1316915281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 msgr2=0x7f0f5006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 0x7f0f5006d180 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f0f4401c980 tx=0x7f0f40005800 comp rx=0 tx=0).stop 2023-12-16T03:27:49.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 -- 172.21.15.28:0/1316915281 shutdown_connections 2023-12-16T03:27:49.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f50072510 0x7f0f501f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:49.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f500a4990 0x7f0f501f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:49.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0f34066470 0x7f0f34068930 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:49.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 --2- 172.21.15.28:0/1316915281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0f40003980 0x7f0f5006d180 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:49.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 -- 172.21.15.28:0/1316915281 >> 172.21.15.28:0/1316915281 conn(0x7f0f500c5d40 msgr2=0x7f0f500a9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:49.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 -- 172.21.15.28:0/1316915281 shutdown_connections 2023-12-16T03:27:49.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.627+0000 7f0f56aad640 1 -- 172.21.15.28:0/1316915281 wait complete. 2023-12-16T03:27:49.660 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-16T03:27:49.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbccb0dd640 1 Processor -- start 2023-12-16T03:27:49.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbccb0dd640 1 -- start start 2023-12-16T03:27:49.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbccb0dd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcc406a5b0 0x7fbcc406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:49.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbccb0dd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbcc406dfe0 0x7fbcc40c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:49.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbccb0dd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbcc406b1e0 0x7fbcc40c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:49.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbccb0dd640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc406ef50 con 0x7fbcc406dfe0 2023-12-16T03:27:49.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbccb0dd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc40720b0 con 0x7fbcc406b1e0 2023-12-16T03:27:49.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbccb0dd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc4072500 con 0x7fbcc406a5b0 2023-12-16T03:27:49.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbcc3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbcc406dfe0 0x7fbcc40c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:49.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbcc3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbcc406dfe0 0x7fbcc40c2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38384/0 (socket says 172.21.15.28:38384) 2023-12-16T03:27:49.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbcc3fff640 1 -- 172.21.15.28:0/633979470 learned_addr learned my addr 172.21.15.28:0/633979470 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:49.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbcc8e79640 1 --2- 172.21.15.28:0/633979470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcc406a5b0 0x7fbcc406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:49.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbcc967a640 1 --2- 172.21.15.28:0/633979470 >> v2:172.21.15.134:3300/0 conn(0x7fbcc406b1e0 0x7fbcc40c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:49.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbcc3fff640 1 -- 172.21.15.28:0/633979470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcc406a5b0 msgr2=0x7fbcc406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:49.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbcc3fff640 1 --2- 172.21.15.28:0/633979470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcc406a5b0 0x7fbcc406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:49.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbcc3fff640 1 -- 172.21.15.28:0/633979470 >> v2:172.21.15.134:3300/0 conn(0x7fbcc406b1e0 msgr2=0x7fbcc40c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:49.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbcc3fff640 1 --2- 172.21.15.28:0/633979470 >> v2:172.21.15.134:3300/0 conn(0x7fbcc406b1e0 0x7fbcc40c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:49.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.807+0000 7fbcc3fff640 1 -- 172.21.15.28:0/633979470 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc4070f60 con 0x7fbcc406dfe0 2023-12-16T03:27:49.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbcc3fff640 1 --2- 172.21.15.28:0/633979470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcc406dfe0 0x7fbcc40c2090 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40c7aa0 tx=0x7fbcb001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc52efac20ddbff server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:49.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbcc37fe640 1 -- 172.21.15.28:0/633979470 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00ab600 con 0x7fbcc406dfe0 2023-12-16T03:27:49.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbcc37fe640 1 -- 172.21.15.28:0/633979470 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb00a7050 con 0x7fbcc406dfe0 2023-12-16T03:27:49.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbcc37fe640 1 -- 172.21.15.28:0/633979470 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00ab980 con 0x7fbcc406dfe0 2023-12-16T03:27:49.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbccb0dd640 1 -- 172.21.15.28:0/633979470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcc406dfe0 msgr2=0x7fbcc40c2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:49.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbccb0dd640 1 --2- 172.21.15.28:0/633979470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcc406dfe0 0x7fbcc40c2090 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40c7aa0 tx=0x7fbcb001c470 comp rx=0 tx=0).stop 2023-12-16T03:27:49.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbccb0dd640 1 -- 172.21.15.28:0/633979470 shutdown_connections 2023-12-16T03:27:49.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbccb0dd640 1 --2- 172.21.15.28:0/633979470 >> v2:172.21.15.134:3300/0 conn(0x7fbcc406b1e0 0x7fbcc40c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:49.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbccb0dd640 1 --2- 172.21.15.28:0/633979470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcc406dfe0 0x7fbcc40c2090 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:49.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbccb0dd640 1 --2- 172.21.15.28:0/633979470 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcc406a5b0 0x7fbcc406a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:49.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbccb0dd640 1 -- 172.21.15.28:0/633979470 >> 172.21.15.28:0/633979470 conn(0x7fbcc40c6ef0 msgr2=0x7fbcc40c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:49.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbccb0dd640 1 -- 172.21.15.28:0/633979470 shutdown_connections 2023-12-16T03:27:49.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.811+0000 7fbccb0dd640 1 -- 172.21.15.28:0/633979470 wait complete. 2023-12-16T03:27:49.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbccb0dd640 1 Processor -- start 2023-12-16T03:27:49.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbccb0dd640 1 -- start start 2023-12-16T03:27:49.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbccb0dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcc406a5b0 0x7fbcc41edd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:49.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbccb0dd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcc406b1e0 0x7fbcc41518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:49.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbccb0dd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcc406dfe0 0x7fbcc4156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:49.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbccb0dd640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc414c1b0 con 0x7fbcc406dfe0 2023-12-16T03:27:49.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbccb0dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc41418a0 con 0x7fbcc406a5b0 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbccb0dd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc41f0910 con 0x7fbcc406b1e0 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc967a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcc406dfe0 0x7fbcc4156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc967a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcc406dfe0 0x7fbcc4156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38400/0 (socket says 172.21.15.28:38400) 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc967a640 1 -- 172.21.15.28:0/248918901 learned_addr learned my addr 172.21.15.28:0/248918901 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc8e79640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcc406a5b0 0x7fbcc41edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc3fff640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcc406b1e0 0x7fbcc41518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc967a640 1 -- 172.21.15.28:0/248918901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcc406b1e0 msgr2=0x7fbcc41518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc967a640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcc406b1e0 0x7fbcc41518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc967a640 1 -- 172.21.15.28:0/248918901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcc406a5b0 msgr2=0x7fbcc41edd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc967a640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcc406a5b0 0x7fbcc41edd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc967a640 1 -- 172.21.15.28:0/248918901 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb00094d0 con 0x7fbcc406dfe0 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc967a640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcc406dfe0 0x7fbcc4156810 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc007e40 tx=0x7fbcbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc17fa640 1 -- 172.21.15.28:0/248918901 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc014620 con 0x7fbcc406dfe0 2023-12-16T03:27:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc17fa640 1 -- 172.21.15.28:0/248918901 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc00ee90 con 0x7fbcc406dfe0 2023-12-16T03:27:49.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbcc17fa640 1 -- 172.21.15.28:0/248918901 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0149e0 con 0x7fbcc406dfe0 2023-12-16T03:27:49.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbccb0dd640 1 -- 172.21.15.28:0/248918901 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc4148390 con 0x7fbcc406dfe0 2023-12-16T03:27:49.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.815+0000 7fbccb0dd640 1 -- 172.21.15.28:0/248918901 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc4148930 con 0x7fbcc406dfe0 2023-12-16T03:27:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.819+0000 7fbccb0dd640 1 -- 172.21.15.28:0/248918901 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc4068400 con 0x7fbcc406dfe0 2023-12-16T03:27:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.819+0000 7fbcc17fa640 1 -- 172.21.15.28:0/248918901 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbcbc014b40 con 0x7fbcc406dfe0 2023-12-16T03:27:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.819+0000 7fbcc17fa640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbca80664a0 0x7fbca8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.819+0000 7fbcc17fa640 1 -- 172.21.15.28:0/248918901 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbcbc0843e0 con 0x7fbcc406dfe0 2023-12-16T03:27:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.819+0000 7fbcc8e79640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbca80664a0 0x7fbca8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.819+0000 7fbcc8e79640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbca80664a0 0x7fbca8068960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8007a60 tx=0x7fbcb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:49.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.827+0000 7fbcc17fa640 1 -- 172.21.15.28:0/248918901 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fbcbc051ba0 con 0x7fbcc406dfe0 2023-12-16T03:27:49.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.991+0000 7fbccb0dd640 1 -- 172.21.15.28:0/248918901 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbcc40c7cb0 con 0x7fbcc406dfe0 2023-12-16T03:27:49.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbcc17fa640 1 -- 172.21.15.28:0/248918901 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbcbc0551c0 con 0x7fbcc406dfe0 2023-12-16T03:27:50.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 -- 172.21.15.28:0/248918901 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbca80664a0 msgr2=0x7fbca8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbca80664a0 0x7fbca8068960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8007a60 tx=0x7fbcb8008040 comp rx=0 tx=0).stop 2023-12-16T03:27:50.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 -- 172.21.15.28:0/248918901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcc406dfe0 msgr2=0x7fbcc4156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcc406dfe0 0x7fbcc4156810 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc007e40 tx=0x7fbcbc00e4b0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 -- 172.21.15.28:0/248918901 shutdown_connections 2023-12-16T03:27:50.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbca80664a0 0x7fbca8068960 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbcc406dfe0 0x7fbcc4156810 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcc406b1e0 0x7fbcc41518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 --2- 172.21.15.28:0/248918901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcc406a5b0 0x7fbcc41edd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 -- 172.21.15.28:0/248918901 >> 172.21.15.28:0/248918901 conn(0x7fbcc40c6ef0 msgr2=0x7fbcc414e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:50.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 -- 172.21.15.28:0/248918901 shutdown_connections 2023-12-16T03:27:50.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:49.995+0000 7fbccb0dd640 1 -- 172.21.15.28:0/248918901 wait complete. 2023-12-16T03:27:50.019 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-16T03:27:50.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.163+0000 7f2df8fb8640 1 Processor -- start 2023-12-16T03:27:50.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.163+0000 7f2df8fb8640 1 -- start start 2023-12-16T03:27:50.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.163+0000 7f2df8fb8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2df40c2bb0 0x7f2df40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:50.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.163+0000 7f2df8fb8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df40c31c0 con 0x7f2df40c63c0 2023-12-16T03:27:50.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.163+0000 7f2df8fb8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df40c34a0 con 0x7f2df40c4100 2023-12-16T03:27:50.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.163+0000 7f2df8fb8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df40c1030 con 0x7f2df40c2bb0 2023-12-16T03:27:50.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df259c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2df40c63c0 0x7f2df40c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48754/0 (socket says 172.21.15.28:48754) 2023-12-16T03:27:50.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df259c640 1 -- 172.21.15.28:0/2598634626 learned_addr learned my addr 172.21.15.28:0/2598634626 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:50.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df2d9d640 1 --2- 172.21.15.28:0/2598634626 >> v2:172.21.15.28:3300/0 conn(0x7f2df40c2bb0 0x7f2df40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:50.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df159a640 1 -- 172.21.15.28:0/2598634626 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399400421 0 0) 0x7f2df40c31c0 con 0x7f2df40c63c0 2023-12-16T03:27:50.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df159a640 1 -- 172.21.15.28:0/2598634626 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ddc003530 con 0x7f2df40c63c0 2023-12-16T03:27:50.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df2d9d640 1 -- 172.21.15.28:0/2598634626 >> v1:172.21.15.134:6789/0 conn(0x7f2df40c4100 legacy=0x7f2df40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:50.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df2d9d640 1 -- 172.21.15.28:0/2598634626 >> v1:172.21.15.28:6789/0 conn(0x7f2df40c63c0 legacy=0x7f2df40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df2d9d640 1 -- 172.21.15.28:0/2598634626 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df40c1310 con 0x7f2df40c2bb0 2023-12-16T03:27:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df2d9d640 1 --2- 172.21.15.28:0/2598634626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c2bb0 0x7f2df40c06d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009d90 tx=0x7f2dec01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c494930f5a368977 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df159a640 1 -- 172.21.15.28:0/2598634626 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0a5910 con 0x7f2df40c2bb0 2023-12-16T03:27:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df159a640 1 -- 172.21.15.28:0/2598634626 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec0a5a70 con 0x7f2df40c2bb0 2023-12-16T03:27:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.167+0000 7f2df159a640 1 -- 172.21.15.28:0/2598634626 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0a5e00 con 0x7f2df40c2bb0 2023-12-16T03:27:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2598634626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c2bb0 msgr2=0x7f2df40c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 --2- 172.21.15.28:0/2598634626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c2bb0 0x7f2df40c06d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009d90 tx=0x7f2dec01c830 comp rx=0 tx=0).stop 2023-12-16T03:27:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2598634626 shutdown_connections 2023-12-16T03:27:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 --2- 172.21.15.28:0/2598634626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c2bb0 0x7f2df40c06d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2598634626 >> 172.21.15.28:0/2598634626 conn(0x7f2df406a5b0 msgr2=0x7f2df406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2598634626 shutdown_connections 2023-12-16T03:27:50.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2598634626 wait complete. 2023-12-16T03:27:50.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 Processor -- start 2023-12-16T03:27:50.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 -- start start 2023-12-16T03:27:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40c2bb0 0x7f2df40bf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df415f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c63c0 0x7f2df414ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df41ede50 con 0x7f2df40c4100 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df41ed910 con 0x7f2df40c2bb0 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df8fb8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40bfb80 con 0x7f2df40c63c0 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df1d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df415f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df1d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df415f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38408/0 (socket says 172.21.15.28:38408) 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df1d9b640 1 -- 172.21.15.28:0/2866222869 learned_addr learned my addr 172.21.15.28:0/2866222869 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df259c640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40c2bb0 0x7f2df40bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df2d9d640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c63c0 0x7f2df414ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df1d9b640 1 -- 172.21.15.28:0/2866222869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c63c0 msgr2=0x7f2df414ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df1d9b640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c63c0 0x7f2df414ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df1d9b640 1 -- 172.21.15.28:0/2866222869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40c2bb0 msgr2=0x7f2df40bf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df1d9b640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40c2bb0 0x7f2df40bf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.171+0000 7f2df1d9b640 1 -- 172.21.15.28:0/2866222869 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec009a70 con 0x7f2df40c4100 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.175+0000 7f2df1d9b640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df415f610 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c500 tx=0x7f2de800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.175+0000 7f2de2ffd640 1 -- 172.21.15.28:0/2866222869 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8005220 con 0x7f2df40c4100 2023-12-16T03:27:50.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.175+0000 7f2de2ffd640 1 -- 172.21.15.28:0/2866222869 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de8005380 con 0x7f2df40c4100 2023-12-16T03:27:50.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.175+0000 7f2de2ffd640 1 -- 172.21.15.28:0/2866222869 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8007270 con 0x7f2df40c4100 2023-12-16T03:27:50.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.175+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2866222869 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df41edb70 con 0x7f2df40c4100 2023-12-16T03:27:50.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.175+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2866222869 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df41556f0 con 0x7f2df40c4100 2023-12-16T03:27:50.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.175+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2866222869 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df4155270 con 0x7f2df40c4100 2023-12-16T03:27:50.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.175+0000 7f2de2ffd640 1 -- 172.21.15.28:0/2866222869 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2de80073d0 con 0x7f2df40c4100 2023-12-16T03:27:50.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.175+0000 7f2de2ffd640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd4066470 0x7f2dd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:50.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.175+0000 7f2de2ffd640 1 -- 172.21.15.28:0/2866222869 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2de8082fa0 con 0x7f2df40c4100 2023-12-16T03:27:50.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.175+0000 7f2df259c640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd4066470 0x7f2dd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:50.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.179+0000 7f2df259c640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd4066470 0x7f2dd4068930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2de40011f0 tx=0x7f2de4007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:50.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.179+0000 7f2de2ffd640 1 -- 172.21.15.28:0/2866222869 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2df4155270 con 0x7f2df40c4100 2023-12-16T03:27:50.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.391+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2866222869 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f2df4155270 con 0x7f2df40c4100 2023-12-16T03:27:50.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2de2ffd640 1 -- 172.21.15.28:0/2866222869 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v172) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2df4155270 con 0x7f2df40c4100 2023-12-16T03:27:50.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2866222869 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd4066470 msgr2=0x7f2dd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd4066470 0x7f2dd4068930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2de40011f0 tx=0x7f2de4007d40 comp rx=0 tx=0).stop 2023-12-16T03:27:50.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2866222869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 msgr2=0x7f2df415f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df415f610 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c500 tx=0x7f2de800c9c0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2866222869 shutdown_connections 2023-12-16T03:27:50.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40c63c0 0x7f2df414ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2dd4066470 0x7f2dd4068930 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2df40c4100 0x7f2df415f610 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 --2- 172.21.15.28:0/2866222869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40c2bb0 0x7f2df40bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2866222869 >> 172.21.15.28:0/2866222869 conn(0x7f2df406a5b0 msgr2=0x7f2df406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:50.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2866222869 shutdown_connections 2023-12-16T03:27:50.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.639+0000 7f2df8fb8640 1 -- 172.21.15.28:0/2866222869 wait complete. 2023-12-16T03:27:50.665 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-16T03:27:50.665 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-16T03:27:50.665 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:50.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff359e640 1 Processor -- start 2023-12-16T03:27:50.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff359e640 1 -- start start 2023-12-16T03:27:50.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff359e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7ff40c7c50 0x7f7ff41544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:50.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff4154a10 0x7f7ff415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff359e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff40c8160 con 0x7f7ff4151cd0 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff359e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff4157b40 con 0x7f7ff40c7c50 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff359e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4157e20 con 0x7f7ff4154a10 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff259c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7ff4151cd0 0x7f7ff40ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48768/0 (socket says 172.21.15.28:48768) 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff259c640 1 -- 172.21.15.28:0/3697485250 learned_addr learned my addr 172.21.15.28:0/3697485250 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff1d9b640 1 --2- 172.21.15.28:0/3697485250 >> v2:172.21.15.134:3300/0 conn(0x7f7ff40c7c50 0x7f7ff41544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff2d9d640 1 --2- 172.21.15.28:0/3697485250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff4154a10 0x7f7ff415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff159a640 1 -- 172.21.15.28:0/3697485250 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357029305 0 0) 0x7f7ff40c8160 con 0x7f7ff4151cd0 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.811+0000 7f7ff159a640 1 -- 172.21.15.28:0/3697485250 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fdc003530 con 0x7f7ff4151cd0 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.815+0000 7f7ff2d9d640 1 -- 172.21.15.28:0/3697485250 >> v2:172.21.15.134:3300/0 conn(0x7f7ff40c7c50 msgr2=0x7f7ff41544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.815+0000 7f7ff2d9d640 1 --2- 172.21.15.28:0/3697485250 >> v2:172.21.15.134:3300/0 conn(0x7f7ff40c7c50 0x7f7ff41544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.815+0000 7f7ff2d9d640 1 -- 172.21.15.28:0/3697485250 >> v1:172.21.15.28:6789/0 conn(0x7f7ff4151cd0 legacy=0x7f7ff40ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.815+0000 7f7ff2d9d640 1 -- 172.21.15.28:0/3697485250 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4158100 con 0x7f7ff4154a10 2023-12-16T03:27:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.815+0000 7f7ff2d9d640 1 --2- 172.21.15.28:0/3697485250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff4154a10 0x7f7ff415ee30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009d90 tx=0x7f7fec01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=168e9e29802c612 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:50.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.815+0000 7f7ff159a640 1 -- 172.21.15.28:0/3697485250 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0a59e0 con 0x7f7ff4154a10 2023-12-16T03:27:50.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.815+0000 7f7ff159a640 1 -- 172.21.15.28:0/3697485250 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec0a5b40 con 0x7f7ff4154a10 2023-12-16T03:27:50.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.815+0000 7f7ff159a640 1 -- 172.21.15.28:0/3697485250 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0ad440 con 0x7f7ff4154a10 2023-12-16T03:27:50.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.815+0000 7f7ff359e640 1 -- 172.21.15.28:0/3697485250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff4154a10 msgr2=0x7f7ff415ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.815+0000 7f7ff359e640 1 --2- 172.21.15.28:0/3697485250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff4154a10 0x7f7ff415ee30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009d90 tx=0x7f7fec01c920 comp rx=0 tx=0).stop 2023-12-16T03:27:50.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 -- 172.21.15.28:0/3697485250 shutdown_connections 2023-12-16T03:27:50.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 --2- 172.21.15.28:0/3697485250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff4154a10 0x7f7ff415ee30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 --2- 172.21.15.28:0/3697485250 >> v2:172.21.15.134:3300/0 conn(0x7f7ff40c7c50 0x7f7ff41544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 -- 172.21.15.28:0/3697485250 >> 172.21.15.28:0/3697485250 conn(0x7f7ff40abee0 msgr2=0x7f7ff40c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:50.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 -- 172.21.15.28:0/3697485250 shutdown_connections 2023-12-16T03:27:50.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 -- 172.21.15.28:0/3697485250 wait complete. 2023-12-16T03:27:50.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 Processor -- start 2023-12-16T03:27:50.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 -- start start 2023-12-16T03:27:50.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff40c7c50 0x7f7ff41f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:50.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff4151cd0 0x7f7ff414d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:50.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ff4154a10 0x7f7ff41ec900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:50.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff414bbe0 con 0x7f7ff4154a10 2023-12-16T03:27:50.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff41420b0 con 0x7f7ff4151cd0 2023-12-16T03:27:50.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff359e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4142290 con 0x7f7ff40c7c50 2023-12-16T03:27:50.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff2d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ff4154a10 0x7f7ff41ec900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:50.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff2d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ff4154a10 0x7f7ff41ec900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38420/0 (socket says 172.21.15.28:38420) 2023-12-16T03:27:50.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff1d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff4151cd0 0x7f7ff414d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:50.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff2d9d640 1 -- 172.21.15.28:0/1334740577 learned_addr learned my addr 172.21.15.28:0/1334740577 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:50.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff259c640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff40c7c50 0x7f7ff41f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:50.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff2d9d640 1 -- 172.21.15.28:0/1334740577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff40c7c50 msgr2=0x7f7ff41f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff2d9d640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff40c7c50 0x7f7ff41f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff2d9d640 1 -- 172.21.15.28:0/1334740577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff4151cd0 msgr2=0x7f7ff414d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff2d9d640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff4151cd0 0x7f7ff414d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff2d9d640 1 -- 172.21.15.28:0/1334740577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec009a70 con 0x7f7ff4154a10 2023-12-16T03:27:50.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.819+0000 7f7ff2d9d640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ff4154a10 0x7f7ff41ec900 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7fec0b0040 tx=0x7f7fec0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:50.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.823+0000 7f7fe2ffd640 1 -- 172.21.15.28:0/1334740577 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0adce0 con 0x7f7ff4154a10 2023-12-16T03:27:50.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.823+0000 7f7fe2ffd640 1 -- 172.21.15.28:0/1334740577 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec0ade40 con 0x7f7ff4154a10 2023-12-16T03:27:50.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.823+0000 7f7fe2ffd640 1 -- 172.21.15.28:0/1334740577 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0b9690 con 0x7f7ff4154a10 2023-12-16T03:27:50.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.823+0000 7f7ff359e640 1 -- 172.21.15.28:0/1334740577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff4142550 con 0x7f7ff4154a10 2023-12-16T03:27:50.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.823+0000 7f7ff359e640 1 -- 172.21.15.28:0/1334740577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff41f01f0 con 0x7f7ff4154a10 2023-12-16T03:27:50.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.823+0000 7f7ff359e640 1 -- 172.21.15.28:0/1334740577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff40c6140 con 0x7f7ff4154a10 2023-12-16T03:27:50.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.823+0000 7f7fe2ffd640 1 -- 172.21.15.28:0/1334740577 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7fec0b97f0 con 0x7f7ff4154a10 2023-12-16T03:27:50.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.823+0000 7f7fe2ffd640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fd4066470 0x7f7fd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:50.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.823+0000 7f7fe2ffd640 1 -- 172.21.15.28:0/1334740577 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7fec11f090 con 0x7f7ff4154a10 2023-12-16T03:27:50.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.823+0000 7f7ff259c640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fd4066470 0x7f7fd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:50.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.827+0000 7f7ff259c640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fd4066470 0x7f7fd4068930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40011f0 tx=0x7f7fe4007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:50.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.827+0000 7f7fe2ffd640 1 -- 172.21.15.28:0/1334740577 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7fec0eca10 con 0x7f7ff4154a10 2023-12-16T03:27:50.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.987+0000 7f7ff359e640 1 -- 172.21.15.28:0/1334740577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ff404e850 con 0x7f7ff4154a10 2023-12-16T03:27:50.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.987+0000 7f7fe2ffd640 1 -- 172.21.15.28:0/1334740577 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13119 (secure 0 0 0) 0x7f7fec009450 con 0x7f7ff4154a10 2023-12-16T03:27:50.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:50.991 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":60,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:49.623740+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6834/4009894510":"2023-12-17T03:27:46.609985+0000","172.21.15.134:6832/4009894510":"2023-12-17T03:27:46.609985+0000","172.21.15.28:6836/3717643902":"2023-12-17T03:27:40.012876+0000","172.21.15.28:6834/3717643902":"2023-12-17T03:27:40.012876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:50.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 -- 172.21.15.28:0/1334740577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fd4066470 msgr2=0x7f7fd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fd4066470 0x7f7fd4068930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40011f0 tx=0x7f7fe4007d40 comp rx=0 tx=0).stop 2023-12-16T03:27:50.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 -- 172.21.15.28:0/1334740577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ff4154a10 msgr2=0x7f7ff41ec900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:50.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ff4154a10 0x7f7ff41ec900 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7fec0b0040 tx=0x7f7fec0196c0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 -- 172.21.15.28:0/1334740577 shutdown_connections 2023-12-16T03:27:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7fd4066470 0x7f7fd4068930 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ff4154a10 0x7f7ff41ec900 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff4151cd0 0x7f7ff414d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 --2- 172.21.15.28:0/1334740577 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff40c7c50 0x7f7ff41f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 -- 172.21.15.28:0/1334740577 >> 172.21.15.28:0/1334740577 conn(0x7f7ff40abee0 msgr2=0x7f7ff414f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 -- 172.21.15.28:0/1334740577 shutdown_connections 2023-12-16T03:27:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:50.991+0000 7f7ff359e640 1 -- 172.21.15.28:0/1334740577 wait complete. 2023-12-16T03:27:51.012 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:27:51.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:27:51.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.155+0000 7f42f5ff8640 1 Processor -- start 2023-12-16T03:27:51.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.155+0000 7f42f5ff8640 1 -- start start 2023-12-16T03:27:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.155+0000 7f42f5ff8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f42f00a5240 0x7f42f00bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.155+0000 7f42f5ff8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f42f01561f0 0x7f42f0156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.155+0000 7f42f5ff8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f00c3bd0 con 0x7f42f00c01c0 2023-12-16T03:27:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.155+0000 7f42f5ff8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f00bf1e0 con 0x7f42f01561f0 2023-12-16T03:27:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.155+0000 7f42f5ff8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f00c3e20 con 0x7f42f00a5240 2023-12-16T03:27:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.155+0000 7f42effff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f42f01561f0 0x7f42f0156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42eeffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f42f00c01c0 0x7f42f00c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48780/0 (socket says 172.21.15.28:48780) 2023-12-16T03:27:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42effff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f42f01561f0 0x7f42f0156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38430/0 (socket says 172.21.15.28:38430) 2023-12-16T03:27:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42eeffd640 1 -- 172.21.15.28:0/2328927622 learned_addr learned my addr 172.21.15.28:0/2328927622 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42ef7fe640 1 --2- 172.21.15.28:0/2328927622 >> v2:172.21.15.134:3300/0 conn(0x7f42f00a5240 0x7f42f00bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42effff640 1 -- 172.21.15.28:0/2328927622 >> v2:172.21.15.134:3300/0 conn(0x7f42f00a5240 msgr2=0x7f42f00bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42effff640 1 --2- 172.21.15.28:0/2328927622 >> v2:172.21.15.134:3300/0 conn(0x7f42f00a5240 0x7f42f00bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42effff640 1 -- 172.21.15.28:0/2328927622 >> v1:172.21.15.28:6789/0 conn(0x7f42f00c01c0 legacy=0x7f42f00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42effff640 1 -- 172.21.15.28:0/2328927622 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f00c4100 con 0x7f42f01561f0 2023-12-16T03:27:51.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42effff640 1 --2- 172.21.15.28:0/2328927622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42f01561f0 0x7f42f0156640 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f42f00bf530 tx=0x7f42e801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36af063ddeca4350 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42ee7fc640 1 -- 172.21.15.28:0/2328927622 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e80a5820 con 0x7f42f01561f0 2023-12-16T03:27:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42ee7fc640 1 -- 172.21.15.28:0/2328927622 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e80a5980 con 0x7f42f01561f0 2023-12-16T03:27:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.159+0000 7f42ee7fc640 1 -- 172.21.15.28:0/2328927622 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e80a5d10 con 0x7f42f01561f0 2023-12-16T03:27:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2328927622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42f01561f0 msgr2=0x7f42f0156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 --2- 172.21.15.28:0/2328927622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42f01561f0 0x7f42f0156640 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f42f00bf530 tx=0x7f42e801c850 comp rx=0 tx=0).stop 2023-12-16T03:27:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2328927622 shutdown_connections 2023-12-16T03:27:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 --2- 172.21.15.28:0/2328927622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42f01561f0 0x7f42f0156640 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 --2- 172.21.15.28:0/2328927622 >> v2:172.21.15.134:3300/0 conn(0x7f42f00a5240 0x7f42f00bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2328927622 >> 172.21.15.28:0/2328927622 conn(0x7f42f006a5b0 msgr2=0x7f42f006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2328927622 shutdown_connections 2023-12-16T03:27:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2328927622 wait complete. 2023-12-16T03:27:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 Processor -- start 2023-12-16T03:27:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 -- start start 2023-12-16T03:27:51.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42f00a5240 0x7f42f014cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42f00c01c0 0x7f42f01551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f01561f0 0x7f42f01ed020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f014d640 con 0x7f42f00a5240 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f01f13d0 con 0x7f42f01561f0 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42f5ff8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f014d900 con 0x7f42f00c01c0 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42f00a5240 0x7f42f014cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42f00a5240 0x7f42f014cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38444/0 (socket says 172.21.15.28:38444) 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42ef7fe640 1 -- 172.21.15.28:0/2382051738 learned_addr learned my addr 172.21.15.28:0/2382051738 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42effff640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f01561f0 0x7f42f01ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42eeffd640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42f00c01c0 0x7f42f01551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42ef7fe640 1 -- 172.21.15.28:0/2382051738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42f00c01c0 msgr2=0x7f42f01551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42ef7fe640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42f00c01c0 0x7f42f01551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42ef7fe640 1 -- 172.21.15.28:0/2382051738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f01561f0 msgr2=0x7f42f01ed020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42ef7fe640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f01561f0 0x7f42f01ed020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42ef7fe640 1 -- 172.21.15.28:0/2382051738 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e8009a70 con 0x7f42f00a5240 2023-12-16T03:27:51.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.163+0000 7f42effff640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f01561f0 0x7f42f01ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:51.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.167+0000 7f42ef7fe640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42f00a5240 0x7f42f014cc30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f42e000d5f0 tx=0x7f42e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:51.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.167+0000 7f42d7fff640 1 -- 172.21.15.28:0/2382051738 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00125f0 con 0x7f42f00a5240 2023-12-16T03:27:51.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.167+0000 7f42d7fff640 1 -- 172.21.15.28:0/2382051738 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e0012750 con 0x7f42f00a5240 2023-12-16T03:27:51.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.167+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2382051738 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f014dbe0 con 0x7f42f00a5240 2023-12-16T03:27:51.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.167+0000 7f42d7fff640 1 -- 172.21.15.28:0/2382051738 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0012ae0 con 0x7f42f00a5240 2023-12-16T03:27:51.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.167+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2382051738 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f0155710 con 0x7f42f00a5240 2023-12-16T03:27:51.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.167+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2382051738 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f00c52c0 con 0x7f42f00a5240 2023-12-16T03:27:51.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.167+0000 7f42d7fff640 1 -- 172.21.15.28:0/2382051738 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f42e0012c40 con 0x7f42f00a5240 2023-12-16T03:27:51.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.167+0000 7f42d7fff640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f42dc0664a0 0x7f42dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.167+0000 7f42d7fff640 1 -- 172.21.15.28:0/2382051738 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f42e00840c0 con 0x7f42f00a5240 2023-12-16T03:27:51.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.167+0000 7f42eeffd640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f42dc0664a0 0x7f42dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.171+0000 7f42eeffd640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f42dc0664a0 0x7f42dc068960 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f42f00c0040 tx=0x7f42e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:51.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.171+0000 7f42d7fff640 1 -- 172.21.15.28:0/2382051738 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f42e00517d0 con 0x7f42f00a5240 2023-12-16T03:27:51.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.327+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2382051738 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42f0068400 con 0x7f42f00a5240 2023-12-16T03:27:51.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42d7fff640 1 -- 172.21.15.28:0/2382051738 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42e0007380 con 0x7f42f00a5240 2023-12-16T03:27:51.333 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2382051738 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f42dc0664a0 msgr2=0x7f42dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f42dc0664a0 0x7f42dc068960 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f42f00c0040 tx=0x7f42e4009040 comp rx=0 tx=0).stop 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2382051738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42f00a5240 msgr2=0x7f42f014cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42f00a5240 0x7f42f014cc30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f42e000d5f0 tx=0x7f42e000dab0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2382051738 shutdown_connections 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42f01561f0 0x7f42f01ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42f00c01c0 0x7f42f01551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f42dc0664a0 0x7f42dc068960 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 --2- 172.21.15.28:0/2382051738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42f00a5240 0x7f42f014cc30 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2382051738 >> 172.21.15.28:0/2382051738 conn(0x7f42f006a5b0 msgr2=0x7f42f006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2382051738 shutdown_connections 2023-12-16T03:27:51.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.331+0000 7f42f5ff8640 1 -- 172.21.15.28:0/2382051738 wait complete. 2023-12-16T03:27:51.354 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-16T03:27:51.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1020a79640 1 Processor -- start 2023-12-16T03:27:51.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1020a79640 1 -- start start 2023-12-16T03:27:51.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1020a79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f101c151e90 0x7f101c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1020a79640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f101c0c7ea0 0x7f101c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1020a79640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f101c0c4e60 0x7f101c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1020a79640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c0c8750 con 0x7f101c0c7ea0 2023-12-16T03:27:51.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1020a79640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c1552d0 con 0x7f101c0c4e60 2023-12-16T03:27:51.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1020a79640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0c5c60 con 0x7f101c151e90 2023-12-16T03:27:51.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1013fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f101c0c7ea0 0x7f101c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1013fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f101c0c7ea0 0x7f101c06b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38458/0 (socket says 172.21.15.28:38458) 2023-12-16T03:27:51.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1013fff640 1 -- 172.21.15.28:0/2119786885 learned_addr learned my addr 172.21.15.28:0/2119786885 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:51.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f101a59c640 1 --2- 172.21.15.28:0/2119786885 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f101c151e90 0x7f101c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f101ad9d640 1 --2- 172.21.15.28:0/2119786885 >> v2:172.21.15.134:3300/0 conn(0x7f101c0c4e60 0x7f101c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1013fff640 1 -- 172.21.15.28:0/2119786885 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f101c151e90 msgr2=0x7f101c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:51.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1013fff640 1 --2- 172.21.15.28:0/2119786885 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f101c151e90 0x7f101c0c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1013fff640 1 -- 172.21.15.28:0/2119786885 >> v2:172.21.15.134:3300/0 conn(0x7f101c0c4e60 msgr2=0x7f101c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:51.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1013fff640 1 --2- 172.21.15.28:0/2119786885 >> v2:172.21.15.134:3300/0 conn(0x7f101c0c4e60 0x7f101c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f1013fff640 1 -- 172.21.15.28:0/2119786885 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c06c860 con 0x7f101c0c7ea0 2023-12-16T03:27:51.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.495+0000 7f101ad9d640 1 --2- 172.21.15.28:0/2119786885 >> v2:172.21.15.134:3300/0 conn(0x7f101c0c4e60 0x7f101c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:27:51.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1013fff640 1 --2- 172.21.15.28:0/2119786885 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f101c0c7ea0 0x7f101c06b4a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f101c0bd660 tx=0x7f100401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b29c6863aab174 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:51.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1019d9b640 1 -- 172.21.15.28:0/2119786885 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10040ab600 con 0x7f101c0c7ea0 2023-12-16T03:27:51.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1019d9b640 1 -- 172.21.15.28:0/2119786885 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10040a7050 con 0x7f101c0c7ea0 2023-12-16T03:27:51.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1019d9b640 1 -- 172.21.15.28:0/2119786885 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10040ab980 con 0x7f101c0c7ea0 2023-12-16T03:27:51.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1020a79640 1 -- 172.21.15.28:0/2119786885 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f101c0c7ea0 msgr2=0x7f101c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:51.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1020a79640 1 --2- 172.21.15.28:0/2119786885 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f101c0c7ea0 0x7f101c06b4a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f101c0bd660 tx=0x7f100401c3e0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1020a79640 1 -- 172.21.15.28:0/2119786885 shutdown_connections 2023-12-16T03:27:51.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1020a79640 1 --2- 172.21.15.28:0/2119786885 >> v2:172.21.15.134:3300/0 conn(0x7f101c0c4e60 0x7f101c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1020a79640 1 --2- 172.21.15.28:0/2119786885 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f101c0c7ea0 0x7f101c06b4a0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1020a79640 1 --2- 172.21.15.28:0/2119786885 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f101c151e90 0x7f101c0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1020a79640 1 -- 172.21.15.28:0/2119786885 >> 172.21.15.28:0/2119786885 conn(0x7f101c0ca170 msgr2=0x7f101c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:51.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1020a79640 1 -- 172.21.15.28:0/2119786885 shutdown_connections 2023-12-16T03:27:51.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.499+0000 7f1020a79640 1 -- 172.21.15.28:0/2119786885 wait complete. 2023-12-16T03:27:51.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1020a79640 1 Processor -- start 2023-12-16T03:27:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1020a79640 1 -- start start 2023-12-16T03:27:51.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1020a79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f101c0c4e60 0x7f101c14b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1020a79640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f101c0c7ea0 0x7f101c1f0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1020a79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f101c151e90 0x7f101c156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1020a79640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c1f0e90 con 0x7f101c0c4e60 2023-12-16T03:27:51.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1020a79640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0aba20 con 0x7f101c0c7ea0 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1020a79640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0abd00 con 0x7f101c151e90 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f101a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f101c0c4e60 0x7f101c14b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f101a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f101c0c4e60 0x7f101c14b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38470/0 (socket says 172.21.15.28:38470) 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f101a59c640 1 -- 172.21.15.28:0/4157514582 learned_addr learned my addr 172.21.15.28:0/4157514582 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1013fff640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f101c0c7ea0 0x7f101c1f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f101ad9d640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f101c151e90 0x7f101c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f101a59c640 1 -- 172.21.15.28:0/4157514582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f101c151e90 msgr2=0x7f101c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f101a59c640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f101c151e90 0x7f101c156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f101a59c640 1 -- 172.21.15.28:0/4157514582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f101c0c7ea0 msgr2=0x7f101c1f0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f101a59c640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f101c0c7ea0 0x7f101c1f0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f101a59c640 1 -- 172.21.15.28:0/4157514582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10040094d0 con 0x7f101c0c4e60 2023-12-16T03:27:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f101a59c640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f101c0c4e60 0x7f101c14b2d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f100c00e930 tx=0x7f100c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1012ffd640 1 -- 172.21.15.28:0/4157514582 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c009690 con 0x7f101c0c4e60 2023-12-16T03:27:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1012ffd640 1 -- 172.21.15.28:0/4157514582 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c00ca00 con 0x7f101c0c4e60 2023-12-16T03:27:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1012ffd640 1 -- 172.21.15.28:0/4157514582 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00cd70 con 0x7f101c0c4e60 2023-12-16T03:27:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1020a79640 1 -- 172.21.15.28:0/4157514582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101c0abfe0 con 0x7f101c0c4e60 2023-12-16T03:27:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.503+0000 7f1020a79640 1 -- 172.21.15.28:0/4157514582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101c0ac5a0 con 0x7f101c0c4e60 2023-12-16T03:27:51.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.507+0000 7f1020a79640 1 -- 172.21.15.28:0/4157514582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101c068400 con 0x7f101c0c4e60 2023-12-16T03:27:51.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.507+0000 7f1012ffd640 1 -- 172.21.15.28:0/4157514582 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f100c013470 con 0x7f101c0c4e60 2023-12-16T03:27:51.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.507+0000 7f1012ffd640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0ffc066470 0x7f0ffc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:51.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.507+0000 7f1012ffd640 1 -- 172.21.15.28:0/4157514582 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f100c083d10 con 0x7f101c0c4e60 2023-12-16T03:27:51.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.507+0000 7f1013fff640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0ffc066470 0x7f0ffc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:51.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.507+0000 7f1013fff640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0ffc066470 0x7f0ffc068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f10040ad000 tx=0x7f10040a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:51.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.511+0000 7f1012ffd640 1 -- 172.21.15.28:0/4157514582 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f100c051610 con 0x7f101c0c4e60 2023-12-16T03:27:51.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:51.727+0000 7f1020a79640 1 -- 172.21.15.28:0/4157514582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f101c06ca50 con 0x7f101c0c4e60 2023-12-16T03:27:52.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.647+0000 7f1012ffd640 1 -- 172.21.15.28:0/4157514582 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v174) v1 ==== 162+0+0 (secure 0 0 0) 0x7f100c0170e0 con 0x7f101c0c4e60 2023-12-16T03:27:52.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 -- 172.21.15.28:0/4157514582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0ffc066470 msgr2=0x7f0ffc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:52.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0ffc066470 0x7f0ffc068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f10040ad000 tx=0x7f10040a6000 comp rx=0 tx=0).stop 2023-12-16T03:27:52.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 -- 172.21.15.28:0/4157514582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f101c0c4e60 msgr2=0x7f101c14b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:52.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f101c0c4e60 0x7f101c14b2d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f100c00e930 tx=0x7f100c00edf0 comp rx=0 tx=0).stop 2023-12-16T03:27:52.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 -- 172.21.15.28:0/4157514582 shutdown_connections 2023-12-16T03:27:52.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f101c151e90 0x7f101c156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:52.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f101c0c7ea0 0x7f101c1f0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:52.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0ffc066470 0x7f0ffc068930 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:52.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 --2- 172.21.15.28:0/4157514582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f101c0c4e60 0x7f101c14b2d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:52.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 -- 172.21.15.28:0/4157514582 >> 172.21.15.28:0/4157514582 conn(0x7f101c0ca170 msgr2=0x7f101c06b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:52.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 -- 172.21.15.28:0/4157514582 shutdown_connections 2023-12-16T03:27:52.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.651+0000 7f1020a79640 1 -- 172.21.15.28:0/4157514582 wait complete. 2023-12-16T03:27:52.679 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-16T03:27:52.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f980d617640 1 Processor -- start 2023-12-16T03:27:52.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f980d617640 1 -- start start 2023-12-16T03:27:52.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f980d617640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f98080bd660 0x7f9808154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:52.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f980d617640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98080ac4f0 con 0x7f98080c7ed0 2023-12-16T03:27:52.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f980d617640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9808158780 con 0x7f9808151dc0 2023-12-16T03:27:52.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f980d617640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9808158a60 con 0x7f98080bd660 2023-12-16T03:27:52.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f98067fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f98080c7ed0 0x7f9808154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48784/0 (socket says 172.21.15.28:48784) 2023-12-16T03:27:52.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f98067fc640 1 -- 172.21.15.28:0/2568971579 learned_addr learned my addr 172.21.15.28:0/2568971579 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f98077fe640 1 --2- 172.21.15.28:0/2568971579 >> v2:172.21.15.134:3300/0 conn(0x7f98080bd660 0x7f9808154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f9805ffb640 1 -- 172.21.15.28:0/2568971579 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881249924 0 0) 0x7f98080ac4f0 con 0x7f98080c7ed0 2023-12-16T03:27:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f9805ffb640 1 -- 172.21.15.28:0/2568971579 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f0003530 con 0x7f98080c7ed0 2023-12-16T03:27:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f98077fe640 1 -- 172.21.15.28:0/2568971579 >> v1:172.21.15.134:6789/0 conn(0x7f9808151dc0 legacy=0x7f98080c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:52.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f9805ffb640 1 -- 172.21.15.28:0/2568971579 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4122901499 0 0) 0x7f97f0003530 con 0x7f98080c7ed0 2023-12-16T03:27:52.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f98077fe640 1 -- 172.21.15.28:0/2568971579 >> v1:172.21.15.28:6789/0 conn(0x7f98080c7ed0 legacy=0x7f9808154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:52.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.831+0000 7f98077fe640 1 -- 172.21.15.28:0/2568971579 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080ac180 con 0x7f98080bd660 2023-12-16T03:27:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.835+0000 7f98077fe640 1 --2- 172.21.15.28:0/2568971579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98080bd660 0x7f9808154d60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9800009dc0 tx=0x7f980001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f639961ea49daf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:52.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.835+0000 7f9805ffb640 1 -- 172.21.15.28:0/2568971579 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc001680 con 0x7f98080bd660 2023-12-16T03:27:52.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.835+0000 7f9805ffb640 1 -- 172.21.15.28:0/2568971579 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98000a4820 con 0x7f98080bd660 2023-12-16T03:27:52.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.835+0000 7f9805ffb640 1 -- 172.21.15.28:0/2568971579 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98000a4b90 con 0x7f98080bd660 2023-12-16T03:27:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.835+0000 7f980d617640 1 -- 172.21.15.28:0/2568971579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98080bd660 msgr2=0x7f9808154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.835+0000 7f980d617640 1 --2- 172.21.15.28:0/2568971579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98080bd660 0x7f9808154d60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9800009dc0 tx=0x7f980001c390 comp rx=0 tx=0).stop 2023-12-16T03:27:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.835+0000 7f980d617640 1 -- 172.21.15.28:0/2568971579 shutdown_connections 2023-12-16T03:27:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.835+0000 7f980d617640 1 --2- 172.21.15.28:0/2568971579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98080bd660 0x7f9808154d60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.835+0000 7f980d617640 1 -- 172.21.15.28:0/2568971579 >> 172.21.15.28:0/2568971579 conn(0x7f9808071eb0 msgr2=0x7f98080722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.835+0000 7f980d617640 1 -- 172.21.15.28:0/2568971579 shutdown_connections 2023-12-16T03:27:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.835+0000 7f980d617640 1 -- 172.21.15.28:0/2568971579 wait complete. 2023-12-16T03:27:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f980d617640 1 Processor -- start 2023-12-16T03:27:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f980d617640 1 -- start start 2023-12-16T03:27:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f980d617640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98080bd660 0x7f98080c0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f980d617640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98080c7ed0 0x7f98080be380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f980d617640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9808151dc0 0x7f98081f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f980d617640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98080bfd60 con 0x7f98080bd660 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f980d617640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98080c0110 con 0x7f9808151dc0 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f980d617640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98081f1cd0 con 0x7f98080c7ed0 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f9806ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98080bd660 0x7f98080c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f9806ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98080bd660 0x7f98080c0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38482/0 (socket says 172.21.15.28:38482) 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f9806ffd640 1 -- 172.21.15.28:0/1732022582 learned_addr learned my addr 172.21.15.28:0/1732022582 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f98067fc640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98080c7ed0 0x7f98080be380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f98077fe640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9808151dc0 0x7f98081f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f9806ffd640 1 -- 172.21.15.28:0/1732022582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98080c7ed0 msgr2=0x7f98080be380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f9806ffd640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98080c7ed0 0x7f98080be380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f9806ffd640 1 -- 172.21.15.28:0/1732022582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9808151dc0 msgr2=0x7f98081f0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f9806ffd640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9808151dc0 0x7f98081f0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f9806ffd640 1 -- 172.21.15.28:0/1732022582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800009a70 con 0x7f98080bd660 2023-12-16T03:27:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f9806ffd640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98080bd660 0x7f98080c0560 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f97f800c780 tx=0x7f97f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f97ef7fe640 1 -- 172.21.15.28:0/1732022582 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8005270 con 0x7f98080bd660 2023-12-16T03:27:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f97ef7fe640 1 -- 172.21.15.28:0/1732022582 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f80053d0 con 0x7f98080bd660 2023-12-16T03:27:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f97ef7fe640 1 -- 172.21.15.28:0/1732022582 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f800a880 con 0x7f98080bd660 2023-12-16T03:27:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f980d617640 1 -- 172.21.15.28:0/1732022582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98081f19f0 con 0x7f98080bd660 2023-12-16T03:27:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.839+0000 7f980d617640 1 -- 172.21.15.28:0/1732022582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9808154a80 con 0x7f98080bd660 2023-12-16T03:27:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.843+0000 7f980d617640 1 -- 172.21.15.28:0/1732022582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98080c0280 con 0x7f98080bd660 2023-12-16T03:27:52.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.843+0000 7f97ef7fe640 1 -- 172.21.15.28:0/1732022582 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f97f800a9e0 con 0x7f98080bd660 2023-12-16T03:27:52.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.843+0000 7f97ef7fe640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97f4066470 0x7f97f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:52.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.843+0000 7f97ef7fe640 1 -- 172.21.15.28:0/1732022582 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f97f80832d0 con 0x7f98080bd660 2023-12-16T03:27:52.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.843+0000 7f98067fc640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97f4066470 0x7f97f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:52.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.843+0000 7f98067fc640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97f4066470 0x7f97f4068930 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0017b0 tx=0x7f97fc001620 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:52.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:52.847+0000 7f97ef7fe640 1 -- 172.21.15.28:0/1732022582 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f98080c0280 con 0x7f98080bd660 2023-12-16T03:27:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.007+0000 7f980d617640 1 -- 172.21.15.28:0/1732022582 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f98080c0280 con 0x7f98080bd660 2023-12-16T03:27:53.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f97ef7fe640 1 -- 172.21.15.28:0/1732022582 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f98080c0280 con 0x7f98080bd660 2023-12-16T03:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 -- 172.21.15.28:0/1732022582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97f4066470 msgr2=0x7f97f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97f4066470 0x7f97f4068930 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0017b0 tx=0x7f97fc001620 comp rx=0 tx=0).stop 2023-12-16T03:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 -- 172.21.15.28:0/1732022582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98080bd660 msgr2=0x7f98080c0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98080bd660 0x7f98080c0560 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f97f800c780 tx=0x7f97f800cc40 comp rx=0 tx=0).stop 2023-12-16T03:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 -- 172.21.15.28:0/1732022582 shutdown_connections 2023-12-16T03:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9808151dc0 0x7f98081f0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f98080c7ed0 0x7f98080be380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97f4066470 0x7f97f4068930 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 --2- 172.21.15.28:0/1732022582 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98080bd660 0x7f98080c0560 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 -- 172.21.15.28:0/1732022582 >> 172.21.15.28:0/1732022582 conn(0x7f9808071eb0 msgr2=0x7f9808072290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:53.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 -- 172.21.15.28:0/1732022582 shutdown_connections 2023-12-16T03:27:53.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.011+0000 7f980d617640 1 -- 172.21.15.28:0/1732022582 wait complete. 2023-12-16T03:27:53.036 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-16T03:27:53.036 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:27:53.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:27:53.183 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-16T03:27:53.183 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:27:53.184 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:53.193 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7208 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-16T03:27:53.193 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:27:53.193 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:27:53.203 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-16T03:27:53.203 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-16T03:27:53.203 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:27:53.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.375+0000 7f5d05780640 1 Processor -- start 2023-12-16T03:27:53.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.375+0000 7f5d05780640 1 -- start start 2023-12-16T03:27:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.375+0000 7f5d05780640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d000c5c60 0x7f5d000c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.375+0000 7f5d05780640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d000c3bd0 con 0x7f5d001561f0 2023-12-16T03:27:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.375+0000 7f5d05780640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d000bf1e0 con 0x7f5d000a5240 2023-12-16T03:27:53.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.375+0000 7f5d05780640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000c3e20 con 0x7f5d000c5c60 2023-12-16T03:27:53.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.375+0000 7f5cff7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5d001561f0 0x7f5d00156680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48798/0 (socket says 172.21.15.28:48798) 2023-12-16T03:27:53.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.375+0000 7f5cff7fe640 1 -- 172.21.15.28:0/3396963758 learned_addr learned my addr 172.21.15.28:0/3396963758 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:53.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cf7fff640 1 --2- 172.21.15.28:0/3396963758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d000c5c60 0x7f5d000c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:53.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cfe7fc640 1 -- 172.21.15.28:0/3396963758 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476673645 0 0) 0x7f5d000c3bd0 con 0x7f5d001561f0 2023-12-16T03:27:53.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cfe7fc640 1 -- 172.21.15.28:0/3396963758 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cec003530 con 0x7f5d001561f0 2023-12-16T03:27:53.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cfe7fc640 1 -- 172.21.15.28:0/3396963758 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256157667 0 0) 0x7f5d000bf1e0 con 0x7f5d000a5240 2023-12-16T03:27:53.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cfe7fc640 1 -- 172.21.15.28:0/3396963758 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d000c3bd0 con 0x7f5d000a5240 2023-12-16T03:27:53.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cf7fff640 1 -- 172.21.15.28:0/3396963758 >> v1:172.21.15.134:6789/0 conn(0x7f5d000a5240 legacy=0x7f5d000bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cf7fff640 1 -- 172.21.15.28:0/3396963758 >> v1:172.21.15.28:6789/0 conn(0x7f5d001561f0 legacy=0x7f5d00156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cfe7fc640 1 -- 172.21.15.28:0/3396963758 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1811998498 0 0) 0x7f5cec003530 con 0x7f5d001561f0 2023-12-16T03:27:53.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cf7fff640 1 -- 172.21.15.28:0/3396963758 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d000c4100 con 0x7f5d000c5c60 2023-12-16T03:27:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cf7fff640 1 --2- 172.21.15.28:0/3396963758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d000c5c60 0x7f5d000c60a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009820 tx=0x7f5ce801c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ee04fe375ba4ca6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cfe7fc640 1 -- 172.21.15.28:0/3396963758 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8001a00 con 0x7f5d000c5c60 2023-12-16T03:27:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cfe7fc640 1 -- 172.21.15.28:0/3396963758 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce80a7050 con 0x7f5d000c5c60 2023-12-16T03:27:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.379+0000 7f5cfe7fc640 1 -- 172.21.15.28:0/3396963758 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80ab620 con 0x7f5d000c5c60 2023-12-16T03:27:53.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 -- 172.21.15.28:0/3396963758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d000c5c60 msgr2=0x7f5d000c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 --2- 172.21.15.28:0/3396963758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d000c5c60 0x7f5d000c60a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009820 tx=0x7f5ce801c270 comp rx=0 tx=0).stop 2023-12-16T03:27:53.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 -- 172.21.15.28:0/3396963758 shutdown_connections 2023-12-16T03:27:53.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 --2- 172.21.15.28:0/3396963758 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d000c5c60 0x7f5d000c60a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 -- 172.21.15.28:0/3396963758 >> 172.21.15.28:0/3396963758 conn(0x7f5d0006a5b0 msgr2=0x7f5d0006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:53.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 -- 172.21.15.28:0/3396963758 shutdown_connections 2023-12-16T03:27:53.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 -- 172.21.15.28:0/3396963758 wait complete. 2023-12-16T03:27:53.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 Processor -- start 2023-12-16T03:27:53.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 -- start start 2023-12-16T03:27:53.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d000a5240 0x7f5d00153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:53.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d000c5c60 0x7f5d000a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:53.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d001561f0 0x7f5d001f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:53.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0015a4c0 con 0x7f5d001561f0 2023-12-16T03:27:53.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0015b4b0 con 0x7f5d000a5240 2023-12-16T03:27:53.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5d05780640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d001f04e0 con 0x7f5d000c5c60 2023-12-16T03:27:53.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5cff7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d001561f0 0x7f5d001f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:53.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5cff7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d001561f0 0x7f5d001f0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38490/0 (socket says 172.21.15.28:38490) 2023-12-16T03:27:53.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5cff7fe640 1 -- 172.21.15.28:0/3300214943 learned_addr learned my addr 172.21.15.28:0/3300214943 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:53.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5cfeffd640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d000a5240 0x7f5d00153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:53.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5cf7fff640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d000c5c60 0x7f5d000a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:53.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5cff7fe640 1 -- 172.21.15.28:0/3300214943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d000c5c60 msgr2=0x7f5d000a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5cff7fe640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d000c5c60 0x7f5d000a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5cff7fe640 1 -- 172.21.15.28:0/3300214943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d000a5240 msgr2=0x7f5d00153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5cff7fe640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d000a5240 0x7f5d00153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.383+0000 7f5cff7fe640 1 -- 172.21.15.28:0/3300214943 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce8009420 con 0x7f5d001561f0 2023-12-16T03:27:53.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.387+0000 7f5cff7fe640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d001561f0 0x7f5d001f0970 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800cca0 tx=0x7f5cf800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:53.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.387+0000 7f5cf77fe640 1 -- 172.21.15.28:0/3300214943 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8012400 con 0x7f5d001561f0 2023-12-16T03:27:53.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.387+0000 7f5cf77fe640 1 -- 172.21.15.28:0/3300214943 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8012560 con 0x7f5d001561f0 2023-12-16T03:27:53.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.387+0000 7f5cf77fe640 1 -- 172.21.15.28:0/3300214943 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8012910 con 0x7f5d001561f0 2023-12-16T03:27:53.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.387+0000 7f5d05780640 1 -- 172.21.15.28:0/3300214943 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d00156f10 con 0x7f5d001561f0 2023-12-16T03:27:53.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.387+0000 7f5d05780640 1 -- 172.21.15.28:0/3300214943 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d00159160 con 0x7f5d001561f0 2023-12-16T03:27:53.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.387+0000 7f5d05780640 1 -- 172.21.15.28:0/3300214943 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0006d1e0 con 0x7f5d001561f0 2023-12-16T03:27:53.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.387+0000 7f5cf77fe640 1 -- 172.21.15.28:0/3300214943 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5cf8007070 con 0x7f5d001561f0 2023-12-16T03:27:53.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.387+0000 7f5cf77fe640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5ce00664a0 0x7f5ce0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:53.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.387+0000 7f5cf77fe640 1 -- 172.21.15.28:0/3300214943 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5cf8083ca0 con 0x7f5d001561f0 2023-12-16T03:27:53.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.387+0000 7f5cfeffd640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5ce00664a0 0x7f5ce0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:53.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.391+0000 7f5cfeffd640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5ce00664a0 0x7f5ce0068960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00011f0 tx=0x7f5cf0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:53.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.391+0000 7f5cf77fe640 1 -- 172.21.15.28:0/3300214943 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5cf8051460 con 0x7f5d001561f0 2023-12-16T03:27:53.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.583+0000 7f5d05780640 1 -- 172.21.15.28:0/3300214943 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d00068400 con 0x7f5d001561f0 2023-12-16T03:27:53.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.583+0000 7f5cf77fe640 1 -- 172.21.15.28:0/3300214943 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f5cf8017090 con 0x7f5d001561f0 2023-12-16T03:27:53.587 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:53.588 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5213,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/3665146461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":3665146461},{"type":"v1","addr":"172.21.15.28:6837","nonce":3665146461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5219,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1938417336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1938417336},{"type":"v1","addr":"172.21.15.134:6835","nonce":1938417336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/2275464566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2275464566},{"type":"v1","addr":"172.21.15.134:6834","nonce":2275464566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6318,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/3684375189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3684375189},{"type":"v1","addr":"172.21.15.28:6836","nonce":3684375189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[]} 2023-12-16T03:27:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 40 2023-12-16T03:27:53.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 -- 172.21.15.28:0/3300214943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5ce00664a0 msgr2=0x7f5ce0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5ce00664a0 0x7f5ce0068960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00011f0 tx=0x7f5cf0009040 comp rx=0 tx=0).stop 2023-12-16T03:27:53.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 -- 172.21.15.28:0/3300214943 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d001561f0 msgr2=0x7f5d001f0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d001561f0 0x7f5d001f0970 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800cca0 tx=0x7f5cf800a430 comp rx=0 tx=0).stop 2023-12-16T03:27:53.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 -- 172.21.15.28:0/3300214943 shutdown_connections 2023-12-16T03:27:53.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5ce00664a0 0x7f5ce0068960 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d001561f0 0x7f5d001f0970 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5d000c5c60 0x7f5d000a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 --2- 172.21.15.28:0/3300214943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d000a5240 0x7f5d00153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 -- 172.21.15.28:0/3300214943 >> 172.21.15.28:0/3300214943 conn(0x7f5d0006a5b0 msgr2=0x7f5d000c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:53.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 -- 172.21.15.28:0/3300214943 shutdown_connections 2023-12-16T03:27:53.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.587+0000 7f5d05780640 1 -- 172.21.15.28:0/3300214943 wait complete. 2023-12-16T03:27:53.609 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-16T03:27:53.610 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-16T03:27:53.610 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-16T03:27:53.610 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:27:53.610 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-16T03:27:53.610 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-16T03:27:53.610 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-16T03:27:53.610 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:27:53.611 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-16T03:27:53.611 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-16T03:27:53.611 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-16T03:27:53.611 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:27:53.611 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-16T03:27:53.611 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-16T03:27:53.612 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-16T03:27:53.612 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:27:53.622 INFO:tasks.ceph.mds.a:Stopped 2023-12-16T03:27:53.622 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-16T03:27:53.623 INFO:tasks.ceph.mds.c:Stopped 2023-12-16T03:27:53.623 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-16T03:27:53.629 INFO:tasks.ceph.mds.b:Stopped 2023-12-16T03:27:53.629 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-16T03:27:53.630 INFO:tasks.ceph.mds.d:Stopped 2023-12-16T03:27:53.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-16T03:27:53.667 INFO:tasks.ceph.mds.a:Started 2023-12-16T03:27:53.667 DEBUG:teuthology.parallel:result is None 2023-12-16T03:27:53.669 INFO:tasks.ceph.mds.c:Started 2023-12-16T03:27:53.669 DEBUG:teuthology.parallel:result is None 2023-12-16T03:27:53.675 INFO:tasks.ceph.mds.b:Started 2023-12-16T03:27:53.675 DEBUG:teuthology.parallel:result is None 2023-12-16T03:27:53.678 INFO:tasks.ceph.mds.d:Started 2023-12-16T03:27:53.678 DEBUG:teuthology.parallel:result is None 2023-12-16T03:27:53.678 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-16T03:27:53.756 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-12-16T03:27:53.757 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2023-12-16T03:27:53.767 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2023-12-16T03:27:53.768 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-12-16T03:27:53.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b752a640 1 Processor -- start 2023-12-16T03:27:53.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b752a640 1 -- start start 2023-12-16T03:27:53.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b752a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2b00c7ea0 0x7fe2b006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:53.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b752a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe2b006b9e0 0x7fe2b015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:53.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b752a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b006c860 con 0x7fe2b0151e90 2023-12-16T03:27:53.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b752a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b00c8750 con 0x7fe2b006b9e0 2023-12-16T03:27:53.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b752a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b01552d0 con 0x7fe2b00c7ea0 2023-12-16T03:27:53.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b52c6640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe2b0151e90 0x7fe2b00c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48802/0 (socket says 172.21.15.28:48802) 2023-12-16T03:27:53.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b52c6640 1 -- 172.21.15.28:0/4169853304 learned_addr learned my addr 172.21.15.28:0/4169853304 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:53.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b5ac7640 1 --2- 172.21.15.28:0/4169853304 >> v2:172.21.15.28:3300/0 conn(0x7fe2b006b9e0 0x7fe2b015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:53.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b4ac5640 1 --2- 172.21.15.28:0/4169853304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2b00c7ea0 0x7fe2b006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:53.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2a7fff640 1 -- 172.21.15.28:0/4169853304 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329182226 0 0) 0x7fe2b006c860 con 0x7fe2b0151e90 2023-12-16T03:27:53.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2a7fff640 1 -- 172.21.15.28:0/4169853304 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe29c003530 con 0x7fe2b0151e90 2023-12-16T03:27:53.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b5ac7640 1 -- 172.21.15.28:0/4169853304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2b00c7ea0 msgr2=0x7fe2b006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:53.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b5ac7640 1 --2- 172.21.15.28:0/4169853304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2b00c7ea0 0x7fe2b006b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b5ac7640 1 -- 172.21.15.28:0/4169853304 >> v1:172.21.15.28:6789/0 conn(0x7fe2b0151e90 legacy=0x7fe2b00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.823+0000 7fe2b5ac7640 1 -- 172.21.15.28:0/4169853304 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b0154930 con 0x7fe2b006b9e0 2023-12-16T03:27:53.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2b5ac7640 1 --2- 172.21.15.28:0/4169853304 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2b006b9e0 0x7fe2b015f0a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009d90 tx=0x7fe2a801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed610451c344b9af server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2a7fff640 1 -- 172.21.15.28:0/4169853304 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80a6700 con 0x7fe2b006b9e0 2023-12-16T03:27:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2a7fff640 1 -- 172.21.15.28:0/4169853304 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a80a6860 con 0x7fe2b006b9e0 2023-12-16T03:27:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2a7fff640 1 -- 172.21.15.28:0/4169853304 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80a6bf0 con 0x7fe2b006b9e0 2023-12-16T03:27:53.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2b752a640 1 -- 172.21.15.28:0/4169853304 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2b006b9e0 msgr2=0x7fe2b015f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2b752a640 1 --2- 172.21.15.28:0/4169853304 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2b006b9e0 0x7fe2b015f0a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009d90 tx=0x7fe2a801c830 comp rx=0 tx=0).stop 2023-12-16T03:27:53.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2b752a640 1 -- 172.21.15.28:0/4169853304 shutdown_connections 2023-12-16T03:27:53.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2b752a640 1 --2- 172.21.15.28:0/4169853304 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2b006b9e0 0x7fe2b015f0a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2b752a640 1 --2- 172.21.15.28:0/4169853304 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2b00c7ea0 0x7fe2b006b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2b752a640 1 -- 172.21.15.28:0/4169853304 >> 172.21.15.28:0/4169853304 conn(0x7fe2b00ca170 msgr2=0x7fe2b00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:53.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2b752a640 1 -- 172.21.15.28:0/4169853304 shutdown_connections 2023-12-16T03:27:53.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.827+0000 7fe2b752a640 1 -- 172.21.15.28:0/4169853304 wait complete. 2023-12-16T03:27:53.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b752a640 1 Processor -- start 2023-12-16T03:27:53.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b752a640 1 -- start start 2023-12-16T03:27:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b752a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2b006b9e0 0x7fe2b01f0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b752a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2b00c7ea0 0x7fe2b00aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b752a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2b0151e90 0x7fe2b00c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b752a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00ab5f0 con 0x7fe2b0151e90 2023-12-16T03:27:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b752a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b0145cb0 con 0x7fe2b006b9e0 2023-12-16T03:27:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b752a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b01f08d0 con 0x7fe2b00c7ea0 2023-12-16T03:27:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b5ac7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2b0151e90 0x7fe2b00c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b5ac7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2b0151e90 0x7fe2b00c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38544/0 (socket says 172.21.15.28:38544) 2023-12-16T03:27:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b5ac7640 1 -- 172.21.15.28:0/397839991 learned_addr learned my addr 172.21.15.28:0/397839991 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b52c6640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2b006b9e0 0x7fe2b01f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b4ac5640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2b00c7ea0 0x7fe2b00aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b5ac7640 1 -- 172.21.15.28:0/397839991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2b00c7ea0 msgr2=0x7fe2b00aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b5ac7640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2b00c7ea0 0x7fe2b00aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b5ac7640 1 -- 172.21.15.28:0/397839991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2b006b9e0 msgr2=0x7fe2b01f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b5ac7640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2b006b9e0 0x7fe2b01f0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b5ac7640 1 -- 172.21.15.28:0/397839991 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a8009a70 con 0x7fe2b0151e90 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b5ac7640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2b0151e90 0x7fe2b00c3590 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80b0040 tx=0x7fe2a80195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2a5ffb640 1 -- 172.21.15.28:0/397839991 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80ba670 con 0x7fe2b0151e90 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2a5ffb640 1 -- 172.21.15.28:0/397839991 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a80ba7f0 con 0x7fe2b0151e90 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2a5ffb640 1 -- 172.21.15.28:0/397839991 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80baba0 con 0x7fe2b0151e90 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b752a640 1 -- 172.21.15.28:0/397839991 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b01f0bb0 con 0x7fe2b0151e90 2023-12-16T03:27:53.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.831+0000 7fe2b752a640 1 -- 172.21.15.28:0/397839991 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b01f05c0 con 0x7fe2b0151e90 2023-12-16T03:27:53.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.835+0000 7fe2b752a640 1 -- 172.21.15.28:0/397839991 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b01f0d40 con 0x7fe2b0151e90 2023-12-16T03:27:53.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.835+0000 7fe2a5ffb640 1 -- 172.21.15.28:0/397839991 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe2a80bad00 con 0x7fe2b0151e90 2023-12-16T03:27:53.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.835+0000 7fe2a5ffb640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe294066470 0x7fe294068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:53.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.835+0000 7fe2a5ffb640 1 -- 172.21.15.28:0/397839991 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe2a80aa070 con 0x7fe2b0151e90 2023-12-16T03:27:53.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.835+0000 7fe2b52c6640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe294066470 0x7fe294068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:53.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.835+0000 7fe2b52c6640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe294066470 0x7fe294068930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0011f0 tx=0x7fe2ac007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:53.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:53.839+0000 7fe2a5ffb640 1 -- 172.21.15.28:0/397839991 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe2a80ecb30 con 0x7fe2b0151e90 2023-12-16T03:27:54.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.007+0000 7fe2b752a640 1 -- 172.21.15.28:0/397839991 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe2b0068400 con 0x7fe2b0151e90 2023-12-16T03:27:54.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.663+0000 7fe2a5ffb640 1 -- 172.21.15.28:0/397839991 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe2a80f0150 con 0x7fe2b0151e90 2023-12-16T03:27:54.666 INFO:teuthology.orchestra.run.smithi028.stderr: removed all blocklist entries 2023-12-16T03:27:54.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 -- 172.21.15.28:0/397839991 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe294066470 msgr2=0x7fe294068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:54.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe294066470 0x7fe294068930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0011f0 tx=0x7fe2ac007d40 comp rx=0 tx=0).stop 2023-12-16T03:27:54.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 -- 172.21.15.28:0/397839991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2b0151e90 msgr2=0x7fe2b00c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:54.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2b0151e90 0x7fe2b00c3590 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80b0040 tx=0x7fe2a80195d0 comp rx=0 tx=0).stop 2023-12-16T03:27:54.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 -- 172.21.15.28:0/397839991 shutdown_connections 2023-12-16T03:27:54.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe294066470 0x7fe294068930 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:54.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2b0151e90 0x7fe2b00c3590 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:54.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2b00c7ea0 0x7fe2b00aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:54.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 --2- 172.21.15.28:0/397839991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2b006b9e0 0x7fe2b01f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:54.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 -- 172.21.15.28:0/397839991 >> 172.21.15.28:0/397839991 conn(0x7fe2b00ca170 msgr2=0x7fe2b0152540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:54.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 -- 172.21.15.28:0/397839991 shutdown_connections 2023-12-16T03:27:54.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.667+0000 7fe2b752a640 1 -- 172.21.15.28:0/397839991 wait complete. 2023-12-16T03:27:54.694 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-16T03:27:54.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.839+0000 7fab7349a640 1 Processor -- start 2023-12-16T03:27:54.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.839+0000 7fab7349a640 1 -- start start 2023-12-16T03:27:54.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab7349a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fab6c0c5c60 0x7fab6c0c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:54.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab7349a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1561f0 0x7fab6c156680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:54.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab7349a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c0c3bd0 con 0x7fab6c0a5240 2023-12-16T03:27:54.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab7349a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c0bf1e0 con 0x7fab6c0c5c60 2023-12-16T03:27:54.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab7349a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0c3e20 con 0x7fab6c1561f0 2023-12-16T03:27:54.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab71236640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fab6c0a5240 0x7fab6c0bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48804/0 (socket says 172.21.15.28:48804) 2023-12-16T03:27:54.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab71236640 1 -- 172.21.15.28:0/3435268548 learned_addr learned my addr 172.21.15.28:0/3435268548 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:54.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab70a35640 1 --2- 172.21.15.28:0/3435268548 >> v2:172.21.15.134:3300/0 conn(0x7fab6c0c5c60 0x7fab6c0c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:54.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab71a37640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1561f0 0x7fab6c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:54.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473943383 0 0) 0x7fab6c0c3bd0 con 0x7fab6c0a5240 2023-12-16T03:27:54.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab58003530 con 0x7fab6c0a5240 2023-12-16T03:27:54.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3665403359 0 0) 0x7fab58003530 con 0x7fab6c0a5240 2023-12-16T03:27:54.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1561f0 msgr2=0x7fab6c156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:54.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1561f0 0x7fab6c156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 >> v2:172.21.15.134:3300/0 conn(0x7fab6c0c5c60 msgr2=0x7fab6c0c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 --2- 172.21.15.28:0/3435268548 >> v2:172.21.15.134:3300/0 conn(0x7fab6c0c5c60 0x7fab6c0c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0c4100 con 0x7fab6c0a5240 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fab68001680 con 0x7fab6c0a5240 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 >> v1:172.21.15.28:6789/0 conn(0x7fab6c0a5240 legacy=0x7fab6c0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab58003980 0x7fab58003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1561f0 0x7fab580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58004d10 0x7fab58005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0bf1e0 con 0x7fab58004d10 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0c3e20 con 0x7fab58003980 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5800ba10 con 0x7fab6c1561f0 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab71a37640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58004d10 0x7fab58005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab70a35640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1561f0 0x7fab580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:54.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab71236640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab58003980 0x7fab58003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:54.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab71a37640 1 -- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1561f0 msgr2=0x7fab580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:54.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab71a37640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1561f0 0x7fab580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:54.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab71a37640 1 -- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab58003980 msgr2=0x7fab58003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:54.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab71a37640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab58003980 0x7fab58003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:54.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab71a37640 1 -- 172.21.15.28:0/3435268548 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab58003530 con 0x7fab58004d10 2023-12-16T03:27:54.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.843+0000 7fab71236640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab58003980 0x7fab58003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:54.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.847+0000 7fab71a37640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58004d10 0x7fab58005190 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fab64009fc0 tx=0x7fab6401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f2c8564ab283a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:54.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.847+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640a5c20 con 0x7fab58004d10 2023-12-16T03:27:54.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.847+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6400f040 con 0x7fab58004d10 2023-12-16T03:27:54.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.847+0000 7fab63fff640 1 -- 172.21.15.28:0/3435268548 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640ad440 con 0x7fab58004d10 2023-12-16T03:27:54.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.847+0000 7fab7349a640 1 -- 172.21.15.28:0/3435268548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58004d10 msgr2=0x7fab58005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:54.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.847+0000 7fab7349a640 1 --2- 172.21.15.28:0/3435268548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab58004d10 0x7fab58005190 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fab64009fc0 tx=0x7fab6401cc30 comp rx=0 tx=0).stop 2023-12-16T03:27:54.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.847+0000 7fab71a37640 1 -- 172.21.15.28:0/3435268548 reap_dead start 2023-12-16T03:27:54.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.847+0000 7fab7349a640 1 -- 172.21.15.28:0/3435268548 shutdown_connections 2023-12-16T03:27:54.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.847+0000 7fab7349a640 1 -- 172.21.15.28:0/3435268548 >> 172.21.15.28:0/3435268548 conn(0x7fab6c06a5b0 msgr2=0x7fab6c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:54.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.847+0000 7fab7349a640 1 -- 172.21.15.28:0/3435268548 shutdown_connections 2023-12-16T03:27:54.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.847+0000 7fab7349a640 1 -- 172.21.15.28:0/3435268548 wait complete. 2023-12-16T03:27:54.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab7349a640 1 Processor -- start 2023-12-16T03:27:54.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab7349a640 1 -- start start 2023-12-16T03:27:54.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab7349a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab58004d10 0x7fab6c0c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:54.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab7349a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c14f010 0x7fab6c1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab7349a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1513e0 0x7fab6c14e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab7349a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c153ab0 con 0x7fab6c14f010 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab7349a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c150f50 con 0x7fab58004d10 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab7349a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c153ce0 con 0x7fab6c1513e0 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab70a35640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c14f010 0x7fab6c1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab70a35640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c14f010 0x7fab6c1581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38560/0 (socket says 172.21.15.28:38560) 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab70a35640 1 -- 172.21.15.28:0/3182464994 learned_addr learned my addr 172.21.15.28:0/3182464994 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab71a37640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1513e0 0x7fab6c14e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab71236640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab58004d10 0x7fab6c0c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab70a35640 1 -- 172.21.15.28:0/3182464994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1513e0 msgr2=0x7fab6c14e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab70a35640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1513e0 0x7fab6c14e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:54.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab70a35640 1 -- 172.21.15.28:0/3182464994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab58004d10 msgr2=0x7fab6c0c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:54.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab70a35640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab58004d10 0x7fab6c0c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:54.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab70a35640 1 -- 172.21.15.28:0/3182464994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c153f80 con 0x7fab6c14f010 2023-12-16T03:27:54.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab70a35640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c14f010 0x7fab6c1581d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fab5c011aa0 tx=0x7fab5c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:54.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab61ffb640 1 -- 172.21.15.28:0/3182464994 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c00fb80 con 0x7fab6c14f010 2023-12-16T03:27:54.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab61ffb640 1 -- 172.21.15.28:0/3182464994 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c00fce0 con 0x7fab6c14f010 2023-12-16T03:27:54.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab7349a640 1 -- 172.21.15.28:0/3182464994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c0c1d70 con 0x7fab6c14f010 2023-12-16T03:27:54.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab61ffb640 1 -- 172.21.15.28:0/3182464994 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c014680 con 0x7fab6c14f010 2023-12-16T03:27:54.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.851+0000 7fab7349a640 1 -- 172.21.15.28:0/3182464994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c0c23b0 con 0x7fab6c14f010 2023-12-16T03:27:54.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.855+0000 7fab7349a640 1 -- 172.21.15.28:0/3182464994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c1510c0 con 0x7fab6c14f010 2023-12-16T03:27:54.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.855+0000 7fab61ffb640 1 -- 172.21.15.28:0/3182464994 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fab5c0147e0 con 0x7fab6c14f010 2023-12-16T03:27:54.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.855+0000 7fab61ffb640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fab500664a0 0x7fab50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:54.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.855+0000 7fab61ffb640 1 -- 172.21.15.28:0/3182464994 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab5c0842b0 con 0x7fab6c14f010 2023-12-16T03:27:54.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.855+0000 7fab71236640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fab500664a0 0x7fab50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:54.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.855+0000 7fab71236640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fab500664a0 0x7fab50068960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fab68000c10 tx=0x7fab68007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:54.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:54.859+0000 7fab61ffb640 1 -- 172.21.15.28:0/3182464994 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fab5c051b20 con 0x7fab6c14f010 2023-12-16T03:27:55.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 -- 172.21.15.28:0/3182464994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fab6c068400 con 0x7fab6c14f010 2023-12-16T03:27:55.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab61ffb640 1 -- 172.21.15.28:0/3182464994 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5081 (secure 0 0 0) 0x7fab5c055140 con 0x7fab6c14f010 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: "auth_dump": [ 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.a", 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lGdUuDBAA9e6veUuYLf2+kocAK6lSbA==", 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.078 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.b", 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lVwi5GBAAaUcDHi9WGhRuJZxdAF2qFA==", 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.c", 2023-12-16T03:27:55.079 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lhw+xExAA3bRuBx2ItsL1Rc8see+tCQ==", 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.d", 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1ljr1CIBAAkEkWnhykut5uG4ARAKJvRA==", 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:27:55.080 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.0", 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBZGH1l80qNNRAA0+mdmZ1tm0i6Jc4XYM4aCw==", 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.081 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.1", 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBdGH1lJW/FABAAm5ylV9HO9EWb+06Y2OwfVw==", 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.2", 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBgGH1l9x5DBxAAYGKOx8uO5Nf5KROP8dcugA==", 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:27:55.082 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.3", 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBjGH1lEwhVDhAAA66C1s8baoujas3ncXfeiA==", 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.4", 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBpGH1lUKgjGRAACZa14hbBnIoe+pU4Z38i0w==", 2023-12-16T03:27:55.083 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.5", 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBsGH1lzxWVIRAApu48WaE3/juZiozOmmbZnA==", 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.084 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.6", 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBvGH1laENmJxAAmYE1mukqTgUzVp+h5pRYVw==", 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.085 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.7", 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQByGH1lyEIXLhAAIfj8iGtpH2wLL/lvBoPkaA==", 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.0", 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lvVeHJBAAIUmgW3XLan0rUG31Cw+zwQ==", 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow r", 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-16T03:27:55.086 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.1", 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1lgMMbKBAACWizLH1wqYLfSHVjCwyqHQ==", 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow r", 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.admin", 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBXGH1lPy/qKhAAAG+o0iL3cZoTmFmA7XqJdw==", 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.087 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.testuser", 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQAgGX1lNrO2DBAATx/zd0pwltJi3o+CyyJKeQ==", 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow rw fsname=cephfs", 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.088 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.x", 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1l0bdlBxAA/aAGpB8vk/Ggs6Mi6E57sw==", 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.y", 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBYGH1l2CKLAxAA1E6EQPvBVrOt77Tw/cAi3A==", 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-12-16T03:27:55.089 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2023-12-16T03:27:55.090 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-12-16T03:27:55.090 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.090 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:55.090 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2023-12-16T03:27:55.090 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:27:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 -- 172.21.15.28:0/3182464994 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fab500664a0 msgr2=0x7fab50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fab500664a0 0x7fab50068960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fab68000c10 tx=0x7fab68007040 comp rx=0 tx=0).stop 2023-12-16T03:27:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 -- 172.21.15.28:0/3182464994 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c14f010 msgr2=0x7fab6c1581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c14f010 0x7fab6c1581d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fab5c011aa0 tx=0x7fab5c011f60 comp rx=0 tx=0).stop 2023-12-16T03:27:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 -- 172.21.15.28:0/3182464994 shutdown_connections 2023-12-16T03:27:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab6c1513e0 0x7fab6c14e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fab500664a0 0x7fab50068960 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab6c14f010 0x7fab6c1581d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 --2- 172.21.15.28:0/3182464994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab58004d10 0x7fab6c0c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 -- 172.21.15.28:0/3182464994 >> 172.21.15.28:0/3182464994 conn(0x7fab6c06a5b0 msgr2=0x7fab6c14fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:55.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 -- 172.21.15.28:0/3182464994 shutdown_connections 2023-12-16T03:27:55.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.075+0000 7fab7349a640 1 -- 172.21.15.28:0/3182464994 wait complete. 2023-12-16T03:27:55.099 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-16T03:27:55.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.239+0000 7f5f9ebf5640 1 Processor -- start 2023-12-16T03:27:55.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.239+0000 7f5f9ebf5640 1 -- start start 2023-12-16T03:27:55.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.239+0000 7f5f9ebf5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f980c5c60 0x7f5f980c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.239+0000 7f5f9ebf5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5f981561f0 0x7f5f98156680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.239+0000 7f5f9ebf5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f980c3bd0 con 0x7f5f980a5240 2023-12-16T03:27:55.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.239+0000 7f5f9ebf5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f980bf1e0 con 0x7f5f981561f0 2023-12-16T03:27:55.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.239+0000 7f5f9ebf5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980c3e20 con 0x7f5f980c5c60 2023-12-16T03:27:55.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.239+0000 7f5f9d192640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5f981561f0 0x7f5f98156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.239+0000 7f5f97fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f980c5c60 0x7f5f980c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.239+0000 7f5f9d192640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5f981561f0 0x7f5f98156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:37472/0 (socket says 172.21.15.28:37472) 2023-12-16T03:27:55.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.239+0000 7f5f9d192640 1 -- 172.21.15.28:0/2204795431 learned_addr learned my addr 172.21.15.28:0/2204795431 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:55.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.243+0000 7f5f9d192640 1 -- 172.21.15.28:0/2204795431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f980c5c60 msgr2=0x7f5f980c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:55.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.243+0000 7f5f9d192640 1 --2- 172.21.15.28:0/2204795431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f980c5c60 0x7f5f980c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.243+0000 7f5f9d192640 1 -- 172.21.15.28:0/2204795431 >> v1:172.21.15.134:6789/0 conn(0x7f5f980a5240 legacy=0x7f5f980bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.243+0000 7f5f9d192640 1 -- 172.21.15.28:0/2204795431 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f980c4100 con 0x7f5f981561f0 2023-12-16T03:27:55.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.243+0000 7f5f97fff640 1 --2- 172.21.15.28:0/2204795431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f980c5c60 0x7f5f980c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:27:55.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.243+0000 7f5f9d192640 1 --2- 172.21.15.28:0/2204795431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f981561f0 0x7f5f98156680 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009e80 tx=0x7f5f9001c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b1eaea96a4193be server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:55.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.243+0000 7f5f977fe640 1 -- 172.21.15.28:0/2204795431 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f900a5760 con 0x7f5f981561f0 2023-12-16T03:27:55.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.243+0000 7f5f977fe640 1 -- 172.21.15.28:0/2204795431 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f900a58c0 con 0x7f5f981561f0 2023-12-16T03:27:55.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.243+0000 7f5f977fe640 1 -- 172.21.15.28:0/2204795431 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f900a5c50 con 0x7f5f981561f0 2023-12-16T03:27:55.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2204795431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f981561f0 msgr2=0x7f5f98156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 --2- 172.21.15.28:0/2204795431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f981561f0 0x7f5f98156680 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009e80 tx=0x7f5f9001c8a0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2204795431 shutdown_connections 2023-12-16T03:27:55.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 --2- 172.21.15.28:0/2204795431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f981561f0 0x7f5f98156680 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 --2- 172.21.15.28:0/2204795431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f980c5c60 0x7f5f980c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2204795431 >> 172.21.15.28:0/2204795431 conn(0x7f5f9806a5b0 msgr2=0x7f5f9806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2204795431 shutdown_connections 2023-12-16T03:27:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2204795431 wait complete. 2023-12-16T03:27:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 Processor -- start 2023-12-16T03:27:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 -- start start 2023-12-16T03:27:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f980a5240 0x7f5f981555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f980c5c60 0x7f5f98158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f981561f0 0x7f5f98159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98155b20 con 0x7f5f981561f0 2023-12-16T03:27:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f981f1020 con 0x7f5f980a5240 2023-12-16T03:27:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9ebf5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98159160 con 0x7f5f980c5c60 2023-12-16T03:27:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9d192640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f981561f0 0x7f5f98159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9d192640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f981561f0 0x7f5f98159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38564/0 (socket says 172.21.15.28:38564) 2023-12-16T03:27:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9d192640 1 -- 172.21.15.28:0/2651157156 learned_addr learned my addr 172.21.15.28:0/2651157156 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9c991640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f980a5240 0x7f5f981555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f97fff640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f980c5c60 0x7f5f98158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9d192640 1 -- 172.21.15.28:0/2651157156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f980c5c60 msgr2=0x7f5f98158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9d192640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f980c5c60 0x7f5f98158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9d192640 1 -- 172.21.15.28:0/2651157156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f980a5240 msgr2=0x7f5f981555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9d192640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f980a5240 0x7f5f981555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.247+0000 7f5f9d192640 1 -- 172.21.15.28:0/2651157156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f84009420 con 0x7f5f981561f0 2023-12-16T03:27:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.251+0000 7f5f9d192640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f981561f0 0x7f5f98159d70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5f900af040 tx=0x7f5f90019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.251+0000 7f5f957fa640 1 -- 172.21.15.28:0/2651157156 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f900b8670 con 0x7f5f981561f0 2023-12-16T03:27:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.251+0000 7f5f957fa640 1 -- 172.21.15.28:0/2651157156 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f900b87d0 con 0x7f5f981561f0 2023-12-16T03:27:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.251+0000 7f5f957fa640 1 -- 172.21.15.28:0/2651157156 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f900b8b80 con 0x7f5f981561f0 2023-12-16T03:27:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.251+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2651157156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f90009b30 con 0x7f5f981561f0 2023-12-16T03:27:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.251+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2651157156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9815f130 con 0x7f5f981561f0 2023-12-16T03:27:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.251+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2651157156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f980c52e0 con 0x7f5f981561f0 2023-12-16T03:27:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.251+0000 7f5f957fa640 1 -- 172.21.15.28:0/2651157156 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5f900b8ce0 con 0x7f5f981561f0 2023-12-16T03:27:55.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.251+0000 7f5f957fa640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5f7c0664a0 0x7f5f7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.251+0000 7f5f957fa640 1 -- 172.21.15.28:0/2651157156 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f9011ebf0 con 0x7f5f981561f0 2023-12-16T03:27:55.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.251+0000 7f5f9c991640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5f7c0664a0 0x7f5f7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.255+0000 7f5f9c991640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5f7c0664a0 0x7f5f7c068960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5f980a72d0 tx=0x7f5f8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:55.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.255+0000 7f5f957fa640 1 -- 172.21.15.28:0/2651157156 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5f900ec580 con 0x7f5f981561f0 2023-12-16T03:27:55.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.467+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2651157156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f5f98068400 con 0x7f5f981561f0 2023-12-16T03:27:55.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f957fa640 1 -- 172.21.15.28:0/2651157156 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v18) v1 ==== 85+0+0 (secure 0 0 0) 0x7f5f900efba0 con 0x7f5f981561f0 2023-12-16T03:27:55.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2651157156 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5f7c0664a0 msgr2=0x7f5f7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f9ebf5640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5f7c0664a0 0x7f5f7c068960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5f980a72d0 tx=0x7f5f8c009040 comp rx=0 tx=0).stop 2023-12-16T03:27:55.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2651157156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f981561f0 msgr2=0x7f5f98159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f9ebf5640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f981561f0 0x7f5f98159d70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5f900af040 tx=0x7f5f90019640 comp rx=0 tx=0).stop 2023-12-16T03:27:55.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2651157156 shutdown_connections 2023-12-16T03:27:55.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f9ebf5640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5f7c0664a0 0x7f5f7c068960 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f9ebf5640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f981561f0 0x7f5f98159d70 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f9ebf5640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5f980c5c60 0x7f5f98158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f9ebf5640 1 --2- 172.21.15.28:0/2651157156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f980a5240 0x7f5f981555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2651157156 >> 172.21.15.28:0/2651157156 conn(0x7f5f9806a5b0 msgr2=0x7f5f98071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:55.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.471+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2651157156 shutdown_connections 2023-12-16T03:27:55.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.475+0000 7f5f9ebf5640 1 -- 172.21.15.28:0/2651157156 wait complete. 2023-12-16T03:27:55.496 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:55.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bdd6c9640 1 Processor -- start 2023-12-16T03:27:55.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bdd6c9640 1 -- start start 2023-12-16T03:27:55.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bdd6c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd80c61e0 0x7f5bd80a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bdd6c9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd80c28e0 con 0x7f5bd80c1270 2023-12-16T03:27:55.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bdd6c9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd80c2b80 con 0x7f5bd81555c0 2023-12-16T03:27:55.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bdd6c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80c3680 con 0x7f5bd80c61e0 2023-12-16T03:27:55.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bd77fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5bd80c1270 0x7f5bd80c1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48808/0 (socket says 172.21.15.28:48808) 2023-12-16T03:27:55.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bd77fe640 1 -- 172.21.15.28:0/2427867076 learned_addr learned my addr 172.21.15.28:0/2427867076 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:55.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bcffff640 1 --2- 172.21.15.28:0/2427867076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd80c61e0 0x7f5bd80a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bd67fc640 1 -- 172.21.15.28:0/2427867076 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970351937 0 0) 0x7f5bd80c28e0 con 0x7f5bd80c1270 2023-12-16T03:27:55.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bd67fc640 1 -- 172.21.15.28:0/2427867076 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc4003530 con 0x7f5bd80c1270 2023-12-16T03:27:55.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.635+0000 7f5bd67fc640 1 -- 172.21.15.28:0/2427867076 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451046429 0 0) 0x7f5bd80c2b80 con 0x7f5bd81555c0 2023-12-16T03:27:55.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bd67fc640 1 -- 172.21.15.28:0/2427867076 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd80c28e0 con 0x7f5bd81555c0 2023-12-16T03:27:55.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bd67fc640 1 -- 172.21.15.28:0/2427867076 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2378343628 0 0) 0x7f5bc4003530 con 0x7f5bd80c1270 2023-12-16T03:27:55.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bcffff640 1 -- 172.21.15.28:0/2427867076 >> v1:172.21.15.134:6789/0 conn(0x7f5bd81555c0 legacy=0x7f5bd80c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bcffff640 1 -- 172.21.15.28:0/2427867076 >> v1:172.21.15.28:6789/0 conn(0x7f5bd80c1270 legacy=0x7f5bd80c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bcffff640 1 -- 172.21.15.28:0/2427867076 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80c32a0 con 0x7f5bd80c61e0 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bcffff640 1 --2- 172.21.15.28:0/2427867076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd80c61e0 0x7f5bd80a6df0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00097f0 tx=0x7f5bc001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a651b0c4e1145e17 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bd67fc640 1 -- 172.21.15.28:0/2427867076 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0001a00 con 0x7f5bd80c61e0 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bd67fc640 1 -- 172.21.15.28:0/2427867076 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc00a7050 con 0x7f5bd80c61e0 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bd67fc640 1 -- 172.21.15.28:0/2427867076 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00ab620 con 0x7f5bd80c61e0 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/2427867076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd80c61e0 msgr2=0x7f5bd80a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bdd6c9640 1 --2- 172.21.15.28:0/2427867076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd80c61e0 0x7f5bd80a6df0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00097f0 tx=0x7f5bc001c3e0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/2427867076 shutdown_connections 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bdd6c9640 1 --2- 172.21.15.28:0/2427867076 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd80c61e0 0x7f5bd80a6df0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/2427867076 >> 172.21.15.28:0/2427867076 conn(0x7f5bd80c7e40 msgr2=0x7f5bd80c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.639+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/2427867076 shutdown_connections 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/2427867076 wait complete. 2023-12-16T03:27:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bdd6c9640 1 Processor -- start 2023-12-16T03:27:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bdd6c9640 1 -- start start 2023-12-16T03:27:55.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bdd6c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bd80c1270 0x7f5bd814e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bdd6c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bd80c61e0 0x7f5bd8157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bdd6c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd81555c0 0x7f5bd8140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bdd6c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd814d670 con 0x7f5bd80c61e0 2023-12-16T03:27:55.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bdd6c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd814caa0 con 0x7f5bd80c1270 2023-12-16T03:27:55.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bdd6c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd814cd40 con 0x7f5bd81555c0 2023-12-16T03:27:55.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bd80c61e0 0x7f5bd8157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bd80c61e0 0x7f5bd8157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38578/0 (socket says 172.21.15.28:38578) 2023-12-16T03:27:55.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcffff640 1 -- 172.21.15.28:0/3643168602 learned_addr learned my addr 172.21.15.28:0/3643168602 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bd6ffd640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bd80c1270 0x7f5bd814e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bd77fe640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd81555c0 0x7f5bd8140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcffff640 1 -- 172.21.15.28:0/3643168602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd81555c0 msgr2=0x7f5bd8140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcffff640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd81555c0 0x7f5bd8140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcffff640 1 -- 172.21.15.28:0/3643168602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bd80c1270 msgr2=0x7f5bd814e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcffff640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bd80c1270 0x7f5bd814e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcffff640 1 -- 172.21.15.28:0/3643168602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc0009420 con 0x7f5bd80c61e0 2023-12-16T03:27:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bd77fe640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd81555c0 0x7f5bd8140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcffff640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bd80c61e0 0x7f5bd8157bb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00ae040 tx=0x7f5bc0019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcf7fe640 1 -- 172.21.15.28:0/3643168602 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0004030 con 0x7f5bd80c61e0 2023-12-16T03:27:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcf7fe640 1 -- 172.21.15.28:0/3643168602 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc0004190 con 0x7f5bd80c61e0 2023-12-16T03:27:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bcf7fe640 1 -- 172.21.15.28:0/3643168602 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0004520 con 0x7f5bd80c61e0 2023-12-16T03:27:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.643+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/3643168602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd814d020 con 0x7f5bd80c61e0 2023-12-16T03:27:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.647+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/3643168602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd814e990 con 0x7f5bd80c61e0 2023-12-16T03:27:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.647+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/3643168602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd814d7e0 con 0x7f5bd80c61e0 2023-12-16T03:27:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.647+0000 7f5bcf7fe640 1 -- 172.21.15.28:0/3643168602 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5bc00b2040 con 0x7f5bd80c61e0 2023-12-16T03:27:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.647+0000 7f5bcf7fe640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5bb80664a0 0x7f5bb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.647+0000 7f5bcf7fe640 1 -- 172.21.15.28:0/3643168602 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5bc011cfe0 con 0x7f5bd80c61e0 2023-12-16T03:27:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.647+0000 7f5bd6ffd640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5bb80664a0 0x7f5bb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.647+0000 7f5bd6ffd640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5bb80664a0 0x7f5bb8068960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5bc80011f0 tx=0x7f5bc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:55.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.651+0000 7f5bcf7fe640 1 -- 172.21.15.28:0/3643168602 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5bc00ea840 con 0x7f5bd80c61e0 2023-12-16T03:27:55.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.811+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/3643168602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bd8068400 con 0x7f5bd80c61e0 2023-12-16T03:27:55.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bcf7fe640 1 -- 172.21.15.28:0/3643168602 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+12858 (secure 0 0 0) 0x7f5bc00bc090 con 0x7f5bd80c61e0 2023-12-16T03:27:55.817 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:55.817 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":64,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:54.679941+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:27:55.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/3643168602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5bb80664a0 msgr2=0x7f5bb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5bb80664a0 0x7f5bb8068960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5bc80011f0 tx=0x7f5bc8009040 comp rx=0 tx=0).stop 2023-12-16T03:27:55.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/3643168602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bd80c61e0 msgr2=0x7f5bd8157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bd80c61e0 0x7f5bd8157bb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00ae040 tx=0x7f5bc0019180 comp rx=0 tx=0).stop 2023-12-16T03:27:55.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/3643168602 shutdown_connections 2023-12-16T03:27:55.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5bd81555c0 0x7f5bd8140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5bb80664a0 0x7f5bb8068960 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bd80c61e0 0x7f5bd8157bb0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 --2- 172.21.15.28:0/3643168602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bd80c1270 0x7f5bd814e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/3643168602 >> 172.21.15.28:0/3643168602 conn(0x7f5bd80c7e40 msgr2=0x7f5bd806fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:55.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/3643168602 shutdown_connections 2023-12-16T03:27:55.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.815+0000 7f5bdd6c9640 1 -- 172.21.15.28:0/3643168602 wait complete. 2023-12-16T03:27:55.839 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:27:55.839 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:27:55.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92e589c640 1 Processor -- start 2023-12-16T03:27:55.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92e589c640 1 -- start start 2023-12-16T03:27:55.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92e589c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e00725c0 0x7f92e01516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92e589c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e00c2760 con 0x7f92e00a5370 2023-12-16T03:27:55.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92e589c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e00a5750 con 0x7f92e0072090 2023-12-16T03:27:55.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92e589c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00c3070 con 0x7f92e00725c0 2023-12-16T03:27:55.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92deffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f92e00a5370 0x7f92e00c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48818/0 (socket says 172.21.15.28:48818) 2023-12-16T03:27:55.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92deffd640 1 -- 172.21.15.28:0/769603838 learned_addr learned my addr 172.21.15.28:0/769603838 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:55.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92df7fe640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e00725c0 0x7f92e01516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251964588 0 0) 0x7f92e00c2760 con 0x7f92e00a5370 2023-12-16T03:27:55.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92cc003450 con 0x7f92e00a5370 2023-12-16T03:27:55.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669172762 0 0) 0x7f92e00a5750 con 0x7f92e0072090 2023-12-16T03:27:55.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e00c2760 con 0x7f92e0072090 2023-12-16T03:27:55.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3000576865 0 0) 0x7f92cc003450 con 0x7f92e00a5370 2023-12-16T03:27:55.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e00725c0 msgr2=0x7f92e01516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:55.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e00725c0 0x7f92e01516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 >> v1:172.21.15.134:6789/0 conn(0x7f92e0072090 legacy=0x7f92e0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e00aad20 con 0x7f92e00a5370 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f92d0001680 con 0x7f92e00a5370 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 >> v1:172.21.15.28:6789/0 conn(0x7f92e00a5370 legacy=0x7f92e00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92cc003c30 0x7f92cc008860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 0x7f92cc00b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e00725c0 0x7f92cc00d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00c3070 con 0x7f92cc008da0 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc00ddb0 con 0x7f92cc003c30 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc00df70 con 0x7f92e00725c0 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92d7fff640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 0x7f92cc00b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92deffd640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92cc003c30 0x7f92cc008860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.983+0000 7f92df7fe640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e00725c0 0x7f92cc00d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92d7fff640 1 -- 172.21.15.28:0/769603838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e00725c0 msgr2=0x7f92cc00d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:55.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92d7fff640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e00725c0 0x7f92cc00d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92d7fff640 1 -- 172.21.15.28:0/769603838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92cc003c30 msgr2=0x7f92cc008860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:55.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92d7fff640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92cc003c30 0x7f92cc008860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92d7fff640 1 -- 172.21.15.28:0/769603838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc003450 con 0x7f92cc008da0 2023-12-16T03:27:55.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92d7fff640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 0x7f92cc00b190 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f92c80018d0 tx=0x7f92c801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11040fccff42cb5d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:55.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c80052d0 con 0x7f92cc008da0 2023-12-16T03:27:55.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c8005450 con 0x7f92cc008da0 2023-12-16T03:27:55.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92de7fc640 1 -- 172.21.15.28:0/769603838 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8003840 con 0x7f92cc008da0 2023-12-16T03:27:55.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92e589c640 1 -- 172.21.15.28:0/769603838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 msgr2=0x7f92cc00b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92e589c640 1 --2- 172.21.15.28:0/769603838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 0x7f92cc00b190 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f92c80018d0 tx=0x7f92c801c530 comp rx=0 tx=0).stop 2023-12-16T03:27:55.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92df7fe640 1 -- 172.21.15.28:0/769603838 reap_dead start 2023-12-16T03:27:55.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92e589c640 1 -- 172.21.15.28:0/769603838 shutdown_connections 2023-12-16T03:27:55.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92e589c640 1 -- 172.21.15.28:0/769603838 >> 172.21.15.28:0/769603838 conn(0x7f92e006a5b0 msgr2=0x7f92e006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:55.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.987+0000 7f92e589c640 1 -- 172.21.15.28:0/769603838 shutdown_connections 2023-12-16T03:27:55.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92e589c640 1 -- 172.21.15.28:0/769603838 wait complete. 2023-12-16T03:27:55.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92e589c640 1 Processor -- start 2023-12-16T03:27:55.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92e589c640 1 -- start start 2023-12-16T03:27:55.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92e589c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 0x7f92e00c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92e589c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92e01ed2c0 0x7f92e00a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92e589c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e01554c0 0x7f92e00a8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92e589c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0155d10 con 0x7f92cc008da0 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92e589c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0156400 con 0x7f92e01ed2c0 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92e589c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e01ece30 con 0x7f92e01554c0 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92deffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 0x7f92e00c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92deffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 0x7f92e00c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38598/0 (socket says 172.21.15.28:38598) 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92deffd640 1 -- 172.21.15.28:0/2997993791 learned_addr learned my addr 172.21.15.28:0/2997993791 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92d7fff640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92e01ed2c0 0x7f92e00a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92df7fe640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e01554c0 0x7f92e00a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92deffd640 1 -- 172.21.15.28:0/2997993791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e01554c0 msgr2=0x7f92e00a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92deffd640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e01554c0 0x7f92e00a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92deffd640 1 -- 172.21.15.28:0/2997993791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92e01ed2c0 msgr2=0x7f92e00a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:55.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92deffd640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92e01ed2c0 0x7f92e00a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:55.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92deffd640 1 -- 172.21.15.28:0/2997993791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e0155a30 con 0x7f92cc008da0 2023-12-16T03:27:55.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92d7fff640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92e01ed2c0 0x7f92e00a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:55.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92deffd640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 0x7f92e00c4de0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f92d0004e10 tx=0x7f92d0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:55.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92dcff9640 1 -- 172.21.15.28:0/2997993791 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d00010c0 con 0x7f92cc008da0 2023-12-16T03:27:55.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92dcff9640 1 -- 172.21.15.28:0/2997993791 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d000f7b0 con 0x7f92cc008da0 2023-12-16T03:27:55.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92e589c640 1 -- 172.21.15.28:0/2997993791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e01ec7e0 con 0x7f92cc008da0 2023-12-16T03:27:55.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.991+0000 7f92dcff9640 1 -- 172.21.15.28:0/2997993791 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d000fb40 con 0x7f92cc008da0 2023-12-16T03:27:55.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.995+0000 7f92e589c640 1 -- 172.21.15.28:0/2997993791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e00c0960 con 0x7f92cc008da0 2023-12-16T03:27:55.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.995+0000 7f92e589c640 1 -- 172.21.15.28:0/2997993791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e01ec640 con 0x7f92cc008da0 2023-12-16T03:27:55.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.995+0000 7f92dcff9640 1 -- 172.21.15.28:0/2997993791 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f92d000fca0 con 0x7f92cc008da0 2023-12-16T03:27:55.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.995+0000 7f92dcff9640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f92c00664a0 0x7f92c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:55.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.995+0000 7f92dcff9640 1 -- 172.21.15.28:0/2997993791 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f92d00839c0 con 0x7f92cc008da0 2023-12-16T03:27:55.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.995+0000 7f92d7fff640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f92c00664a0 0x7f92c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.995+0000 7f92d7fff640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f92c00664a0 0x7f92c0068960 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f92c80ad000 tx=0x7f92c80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:56.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:55.999+0000 7f92dcff9640 1 -- 172.21.15.28:0/2997993791 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f92e01ec640 con 0x7f92cc008da0 2023-12-16T03:27:56.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.159+0000 7f92e589c640 1 -- 172.21.15.28:0/2997993791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92e01ec640 con 0x7f92cc008da0 2023-12-16T03:27:56.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.159+0000 7f92dcff9640 1 -- 172.21.15.28:0/2997993791 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92e01ec640 con 0x7f92cc008da0 2023-12-16T03:27:56.163 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:27:56.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 -- 172.21.15.28:0/2997993791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f92c00664a0 msgr2=0x7f92c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:56.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f92c00664a0 0x7f92c0068960 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f92c80ad000 tx=0x7f92c80a7000 comp rx=0 tx=0).stop 2023-12-16T03:27:56.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 -- 172.21.15.28:0/2997993791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 msgr2=0x7f92e00c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:56.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 0x7f92e00c4de0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f92d0004e10 tx=0x7f92d0007430 comp rx=0 tx=0).stop 2023-12-16T03:27:56.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 -- 172.21.15.28:0/2997993791 shutdown_connections 2023-12-16T03:27:56.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92e01554c0 0x7f92e00a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92e01ed2c0 0x7f92e00a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f92c00664a0 0x7f92c0068960 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 --2- 172.21.15.28:0/2997993791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92cc008da0 0x7f92e00c4de0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 -- 172.21.15.28:0/2997993791 >> 172.21.15.28:0/2997993791 conn(0x7f92e006a5b0 msgr2=0x7f92e006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:56.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 -- 172.21.15.28:0/2997993791 shutdown_connections 2023-12-16T03:27:56.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.163+0000 7f92e589c640 1 -- 172.21.15.28:0/2997993791 wait complete. 2023-12-16T03:27:56.184 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-16T03:27:56.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.323+0000 7fdf8eb0f640 1 Processor -- start 2023-12-16T03:27:56.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.323+0000 7fdf8eb0f640 1 -- start start 2023-12-16T03:27:56.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8eb0f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdf880c61e0 0x7fdf880a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8eb0f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdf880c1270 0x7fdf880c1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8eb0f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf880c28e0 con 0x7fdf881555c0 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8eb0f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf880c3680 con 0x7fdf880c1270 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8eb0f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf880c2b80 con 0x7fdf880c61e0 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8c8ab640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdf881555c0 0x7fdf880c6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48826/0 (socket says 172.21.15.28:48826) 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8c8ab640 1 -- 172.21.15.28:0/223152079 learned_addr learned my addr 172.21.15.28:0/223152079 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8d0ac640 1 --2- 172.21.15.28:0/223152079 >> v2:172.21.15.28:3300/0 conn(0x7fdf880c1270 0x7fdf880c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf87fff640 1 --2- 172.21.15.28:0/223152079 >> v2:172.21.15.134:3300/0 conn(0x7fdf880c61e0 0x7fdf880a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf877fe640 1 -- 172.21.15.28:0/223152079 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257157936 0 0) 0x7fdf880c28e0 con 0x7fdf881555c0 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf877fe640 1 -- 172.21.15.28:0/223152079 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf78003530 con 0x7fdf881555c0 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8d0ac640 1 -- 172.21.15.28:0/223152079 >> v2:172.21.15.134:3300/0 conn(0x7fdf880c61e0 msgr2=0x7fdf880a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8d0ac640 1 --2- 172.21.15.28:0/223152079 >> v2:172.21.15.134:3300/0 conn(0x7fdf880c61e0 0x7fdf880a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8d0ac640 1 -- 172.21.15.28:0/223152079 >> v1:172.21.15.28:6789/0 conn(0x7fdf881555c0 legacy=0x7fdf880c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8d0ac640 1 -- 172.21.15.28:0/223152079 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf880c32a0 con 0x7fdf880c1270 2023-12-16T03:27:56.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.327+0000 7fdf8d0ac640 1 --2- 172.21.15.28:0/223152079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf880c1270 0x7fdf880c1720 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fdf88066cc0 tx=0x7fdf8001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbe16790a743126 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:56.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf877fe640 1 -- 172.21.15.28:0/223152079 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800a58e0 con 0x7fdf880c1270 2023-12-16T03:27:56.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf877fe640 1 -- 172.21.15.28:0/223152079 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf800a5a40 con 0x7fdf880c1270 2023-12-16T03:27:56.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf877fe640 1 -- 172.21.15.28:0/223152079 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800a5dd0 con 0x7fdf880c1270 2023-12-16T03:27:56.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/223152079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf880c1270 msgr2=0x7fdf880c1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:56.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 --2- 172.21.15.28:0/223152079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf880c1270 0x7fdf880c1720 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fdf88066cc0 tx=0x7fdf8001c910 comp rx=0 tx=0).stop 2023-12-16T03:27:56.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/223152079 shutdown_connections 2023-12-16T03:27:56.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 --2- 172.21.15.28:0/223152079 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf880c1270 0x7fdf880c1720 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 --2- 172.21.15.28:0/223152079 >> v2:172.21.15.134:3300/0 conn(0x7fdf880c61e0 0x7fdf880a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/223152079 >> 172.21.15.28:0/223152079 conn(0x7fdf880c7e40 msgr2=0x7fdf880c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:56.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/223152079 shutdown_connections 2023-12-16T03:27:56.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/223152079 wait complete. 2023-12-16T03:27:56.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 Processor -- start 2023-12-16T03:27:56.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 -- start start 2023-12-16T03:27:56.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf880c1270 0x7fdf881527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf880c61e0 0x7fdf88156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf881555c0 0x7fdf8815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88151d60 con 0x7fdf880c61e0 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88152320 con 0x7fdf880c1270 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf8eb0f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88155e20 con 0x7fdf881555c0 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf87fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf880c61e0 0x7fdf88156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf87fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf880c61e0 0x7fdf88156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38630/0 (socket says 172.21.15.28:38630) 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.331+0000 7fdf87fff640 1 -- 172.21.15.28:0/4236581514 learned_addr learned my addr 172.21.15.28:0/4236581514 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf8c8ab640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf880c1270 0x7fdf881527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf8d0ac640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf881555c0 0x7fdf8815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf87fff640 1 -- 172.21.15.28:0/4236581514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf881555c0 msgr2=0x7fdf8815e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf87fff640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf881555c0 0x7fdf8815e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf87fff640 1 -- 172.21.15.28:0/4236581514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf880c1270 msgr2=0x7fdf881527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf87fff640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf880c1270 0x7fdf881527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf87fff640 1 -- 172.21.15.28:0/4236581514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80009a70 con 0x7fdf880c61e0 2023-12-16T03:27:56.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf8d0ac640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf881555c0 0x7fdf8815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:27:56.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf87fff640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf880c61e0 0x7fdf88156dc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400e930 tx=0x7fdf7400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:56.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf857fa640 1 -- 172.21.15.28:0/4236581514 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74009690 con 0x7fdf880c61e0 2023-12-16T03:27:56.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf857fa640 1 -- 172.21.15.28:0/4236581514 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7400c9a0 con 0x7fdf880c61e0 2023-12-16T03:27:56.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf857fa640 1 -- 172.21.15.28:0/4236581514 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400cd10 con 0x7fdf880c61e0 2023-12-16T03:27:56.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/4236581514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf88156100 con 0x7fdf880c61e0 2023-12-16T03:27:56.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/4236581514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf88153220 con 0x7fdf880c61e0 2023-12-16T03:27:56.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/4236581514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf880c38d0 con 0x7fdf880c61e0 2023-12-16T03:27:56.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf857fa640 1 -- 172.21.15.28:0/4236581514 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdf74013470 con 0x7fdf880c61e0 2023-12-16T03:27:56.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf857fa640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdf6c066470 0x7fdf6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.335+0000 7fdf857fa640 1 -- 172.21.15.28:0/4236581514 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf74083fb0 con 0x7fdf880c61e0 2023-12-16T03:27:56.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.339+0000 7fdf8c8ab640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdf6c066470 0x7fdf6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.339+0000 7fdf8c8ab640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdf6c066470 0x7fdf6c068930 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c007fd0 tx=0x7fdf7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:56.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.339+0000 7fdf857fa640 1 -- 172.21.15.28:0/4236581514 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdf740b5290 con 0x7fdf880c61e0 2023-12-16T03:27:56.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.499+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/4236581514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdf880c66b0 con 0x7fdf880c61e0 2023-12-16T03:27:56.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.499+0000 7fdf857fa640 1 -- 172.21.15.28:0/4236581514 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdf74017090 con 0x7fdf880c61e0 2023-12-16T03:27:56.504 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:27:56.504 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2023-12-16T03:27:56.504 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:27:56.504 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2023-12-16T03:27:56.504 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2023-12-16T03:27:56.505 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:27:56.505 INFO:teuthology.orchestra.run.smithi028.stdout:] 2023-12-16T03:27:56.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/4236581514 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdf6c066470 msgr2=0x7fdf6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:56.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdf6c066470 0x7fdf6c068930 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c007fd0 tx=0x7fdf7c009040 comp rx=0 tx=0).stop 2023-12-16T03:27:56.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/4236581514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf880c61e0 msgr2=0x7fdf88156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:56.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf880c61e0 0x7fdf88156dc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400e930 tx=0x7fdf7400edf0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/4236581514 shutdown_connections 2023-12-16T03:27:56.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdf881555c0 0x7fdf8815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fdf6c066470 0x7fdf6c068930 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf880c61e0 0x7fdf88156dc0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 --2- 172.21.15.28:0/4236581514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf880c1270 0x7fdf881527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/4236581514 >> 172.21.15.28:0/4236581514 conn(0x7fdf880c7e40 msgr2=0x7fdf880c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:56.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/4236581514 shutdown_connections 2023-12-16T03:27:56.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.503+0000 7fdf8eb0f640 1 -- 172.21.15.28:0/4236581514 wait complete. 2023-12-16T03:27:56.525 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-16T03:27:56.525 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-16T03:27:56.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.667+0000 7ff5586c9640 1 Processor -- start 2023-12-16T03:27:56.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff5586c9640 1 -- start start 2023-12-16T03:27:56.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff5586c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff550151c70 0x7ff55006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff5586c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff550155320 0x7ff5500c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff5586c9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff5500c8b90 0x7ff5500c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff5586c9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff550154630 con 0x7ff5500c8b90 2023-12-16T03:27:56.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff5586c9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff550154e90 con 0x7ff550151c70 2023-12-16T03:27:56.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff5586c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500c4df0 con 0x7ff550155320 2023-12-16T03:27:56.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff556c66640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff5500c8b90 0x7ff5500c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff555c64640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff550155320 0x7ff5500c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff556465640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff550151c70 0x7ff55006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff555c64640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff550155320 0x7ff5500c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:35714/0 (socket says 172.21.15.28:35714) 2023-12-16T03:27:56.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff556c66640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff5500c8b90 0x7ff5500c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38644/0 (socket says 172.21.15.28:38644) 2023-12-16T03:27:56.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff555c64640 1 -- 172.21.15.28:0/910966823 learned_addr learned my addr 172.21.15.28:0/910966823 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:56.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff556c66640 1 -- 172.21.15.28:0/910966823 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff550155320 msgr2=0x7ff5500c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:56.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff556c66640 1 --2- 172.21.15.28:0/910966823 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff550155320 0x7ff5500c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff556c66640 1 -- 172.21.15.28:0/910966823 >> v2:172.21.15.134:3300/0 conn(0x7ff550151c70 msgr2=0x7ff55006ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:56.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff556c66640 1 --2- 172.21.15.28:0/910966823 >> v2:172.21.15.134:3300/0 conn(0x7ff550151c70 0x7ff55006ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.671+0000 7ff556c66640 1 -- 172.21.15.28:0/910966823 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5500c5350 con 0x7ff5500c8b90 2023-12-16T03:27:56.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff556c66640 1 --2- 172.21.15.28:0/910966823 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5500c8b90 0x7ff5500c9040 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff550072cc0 tx=0x7ff54801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42785e724f20edbb server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:56.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff555463640 1 -- 172.21.15.28:0/910966823 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480a55f0 con 0x7ff5500c8b90 2023-12-16T03:27:56.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff555463640 1 -- 172.21.15.28:0/910966823 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5480a5750 con 0x7ff5500c8b90 2023-12-16T03:27:56.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff555463640 1 -- 172.21.15.28:0/910966823 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480a5ae0 con 0x7ff5500c8b90 2023-12-16T03:27:56.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff5586c9640 1 -- 172.21.15.28:0/910966823 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5500c8b90 msgr2=0x7ff5500c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:56.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff5586c9640 1 --2- 172.21.15.28:0/910966823 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5500c8b90 0x7ff5500c9040 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff550072cc0 tx=0x7ff54801c880 comp rx=0 tx=0).stop 2023-12-16T03:27:56.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff5586c9640 1 -- 172.21.15.28:0/910966823 shutdown_connections 2023-12-16T03:27:56.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff5586c9640 1 --2- 172.21.15.28:0/910966823 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff5500c8b90 0x7ff5500c9040 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff5586c9640 1 --2- 172.21.15.28:0/910966823 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff550155320 0x7ff5500c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff5586c9640 1 --2- 172.21.15.28:0/910966823 >> v2:172.21.15.134:3300/0 conn(0x7ff550151c70 0x7ff55006ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff5586c9640 1 -- 172.21.15.28:0/910966823 >> 172.21.15.28:0/910966823 conn(0x7ff5500abcf0 msgr2=0x7ff5500ac100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:56.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff5586c9640 1 -- 172.21.15.28:0/910966823 shutdown_connections 2023-12-16T03:27:56.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.675+0000 7ff5586c9640 1 -- 172.21.15.28:0/910966823 wait complete. 2023-12-16T03:27:56.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff5586c9640 1 Processor -- start 2023-12-16T03:27:56.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff5586c9640 1 -- start start 2023-12-16T03:27:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff5586c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5500c8b90 0x7ff550144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff5586c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff550151c70 0x7ff550146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff5586c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff550155320 0x7ff5501ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff5586c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501448d0 con 0x7ff550151c70 2023-12-16T03:27:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff5586c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500ab390 con 0x7ff5500c8b90 2023-12-16T03:27:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff5586c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501f0fa0 con 0x7ff550155320 2023-12-16T03:27:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff555c64640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff550151c70 0x7ff550146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff555c64640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff550151c70 0x7ff550146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38656/0 (socket says 172.21.15.28:38656) 2023-12-16T03:27:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff555c64640 1 -- 172.21.15.28:0/2723586670 learned_addr learned my addr 172.21.15.28:0/2723586670 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff556c66640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff550155320 0x7ff5501ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff556465640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5500c8b90 0x7ff550144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff555c64640 1 -- 172.21.15.28:0/2723586670 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff550155320 msgr2=0x7ff5501ecd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:56.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff555c64640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff550155320 0x7ff5501ecd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff555c64640 1 -- 172.21.15.28:0/2723586670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5500c8b90 msgr2=0x7ff550144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:56.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff555c64640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5500c8b90 0x7ff550144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:56.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff555c64640 1 -- 172.21.15.28:0/2723586670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff548009a70 con 0x7ff550151c70 2023-12-16T03:27:56.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff555c64640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff550151c70 0x7ff550146980 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff54000e870 tx=0x7ff54000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:56.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff546ffd640 1 -- 172.21.15.28:0/2723586670 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54000c940 con 0x7ff550151c70 2023-12-16T03:27:56.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff546ffd640 1 -- 172.21.15.28:0/2723586670 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54000caa0 con 0x7ff550151c70 2023-12-16T03:27:56.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff5586c9640 1 -- 172.21.15.28:0/2723586670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5500ab650 con 0x7ff550151c70 2023-12-16T03:27:56.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff546ffd640 1 -- 172.21.15.28:0/2723586670 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54000ce30 con 0x7ff550151c70 2023-12-16T03:27:56.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.679+0000 7ff5586c9640 1 -- 172.21.15.28:0/2723586670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff550146ec0 con 0x7ff550151c70 2023-12-16T03:27:56.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.683+0000 7ff5586c9640 1 -- 172.21.15.28:0/2723586670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff550068400 con 0x7ff550151c70 2023-12-16T03:27:56.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.683+0000 7ff546ffd640 1 -- 172.21.15.28:0/2723586670 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff540013470 con 0x7ff550151c70 2023-12-16T03:27:56.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.683+0000 7ff546ffd640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff534066470 0x7ff534068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:56.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.683+0000 7ff546ffd640 1 -- 172.21.15.28:0/2723586670 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff540083ea0 con 0x7ff550151c70 2023-12-16T03:27:56.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.683+0000 7ff556465640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff534066470 0x7ff534068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:56.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.683+0000 7ff556465640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff534066470 0x7ff534068930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff5500c42e0 tx=0x7ff54c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:56.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.687+0000 7ff546ffd640 1 -- 172.21.15.28:0/2723586670 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff540051710 con 0x7ff550151c70 2023-12-16T03:27:56.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:56.847+0000 7ff5586c9640 1 -- 172.21.15.28:0/2723586670 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff550152bb0 con 0x7ff550151c70 2023-12-16T03:27:57.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.679+0000 7ff546ffd640 1 -- 172.21.15.28:0/2723586670 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff5400210b0 con 0x7ff550151c70 2023-12-16T03:27:57.683 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2023-12-16T03:27:57.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 -- 172.21.15.28:0/2723586670 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff534066470 msgr2=0x7ff534068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:57.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff534066470 0x7ff534068930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff5500c42e0 tx=0x7ff54c009190 comp rx=0 tx=0).stop 2023-12-16T03:27:57.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 -- 172.21.15.28:0/2723586670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff550151c70 msgr2=0x7ff550146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:57.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff550151c70 0x7ff550146980 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff54000e870 tx=0x7ff54000ed30 comp rx=0 tx=0).stop 2023-12-16T03:27:57.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 -- 172.21.15.28:0/2723586670 shutdown_connections 2023-12-16T03:27:57.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff550155320 0x7ff5501ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:57.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff534066470 0x7ff534068930 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:57.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff550151c70 0x7ff550146980 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:57.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 --2- 172.21.15.28:0/2723586670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5500c8b90 0x7ff550144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:57.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 -- 172.21.15.28:0/2723586670 >> 172.21.15.28:0/2723586670 conn(0x7ff5500abcf0 msgr2=0x7ff55006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:57.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 -- 172.21.15.28:0/2723586670 shutdown_connections 2023-12-16T03:27:57.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.683+0000 7ff5586c9640 1 -- 172.21.15.28:0/2723586670 wait complete. 2023-12-16T03:27:57.715 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-16T03:27:57.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cafc9a640 1 Processor -- start 2023-12-16T03:27:57.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cafc9a640 1 -- start start 2023-12-16T03:27:57.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cafc9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca81560e0 0x7f7ca815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:57.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cafc9a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7ca80bffc0 0x7f7ca80c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:57.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cafc9a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca815c600 con 0x7f7ca806d520 2023-12-16T03:27:57.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cafc9a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca815a5c0 con 0x7f7ca80bffc0 2023-12-16T03:27:57.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cafc9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca81594e0 con 0x7f7ca81560e0 2023-12-16T03:27:57.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cae237640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7ca80bffc0 0x7f7ca80c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:57.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cad235640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7ca806d520 0x7f7ca8159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48840/0 (socket says 172.21.15.28:48840) 2023-12-16T03:27:57.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cad235640 1 -- 172.21.15.28:0/1144397051 learned_addr learned my addr 172.21.15.28:0/1144397051 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:57.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cada36640 1 --2- 172.21.15.28:0/1144397051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca81560e0 0x7f7ca815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:57.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cae237640 1 -- 172.21.15.28:0/1144397051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca81560e0 msgr2=0x7f7ca815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:57.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cae237640 1 --2- 172.21.15.28:0/1144397051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca81560e0 0x7f7ca815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:57.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cae237640 1 -- 172.21.15.28:0/1144397051 >> v1:172.21.15.28:6789/0 conn(0x7f7ca806d520 legacy=0x7f7ca8159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:57.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7cae237640 1 -- 172.21.15.28:0/1144397051 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca81597c0 con 0x7f7ca80bffc0 2023-12-16T03:27:57.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.867+0000 7f7caca34640 1 -- 172.21.15.28:0/1144397051 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649270392 0 0) 0x7f7ca815c600 con 0x7f7ca806d520 2023-12-16T03:27:57.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7cae237640 1 --2- 172.21.15.28:0/1144397051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80bffc0 0x7f7ca80c1bf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009d90 tx=0x7f7ca001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a53dc9e66243428 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:57.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7caca34640 1 -- 172.21.15.28:0/1144397051 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00a58f0 con 0x7f7ca80bffc0 2023-12-16T03:27:57.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7caca34640 1 -- 172.21.15.28:0/1144397051 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca00a5a50 con 0x7f7ca80bffc0 2023-12-16T03:27:57.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7caca34640 1 -- 172.21.15.28:0/1144397051 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00a5de0 con 0x7f7ca80bffc0 2023-12-16T03:27:57.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7cafc9a640 1 -- 172.21.15.28:0/1144397051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80bffc0 msgr2=0x7f7ca80c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:57.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7cafc9a640 1 --2- 172.21.15.28:0/1144397051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80bffc0 0x7f7ca80c1bf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009d90 tx=0x7f7ca001c920 comp rx=0 tx=0).stop 2023-12-16T03:27:57.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7cafc9a640 1 -- 172.21.15.28:0/1144397051 shutdown_connections 2023-12-16T03:27:57.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7cafc9a640 1 --2- 172.21.15.28:0/1144397051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca80bffc0 0x7f7ca80c1bf0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:57.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7cafc9a640 1 --2- 172.21.15.28:0/1144397051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca81560e0 0x7f7ca815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:57.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7cafc9a640 1 -- 172.21.15.28:0/1144397051 >> 172.21.15.28:0/1144397051 conn(0x7f7ca806a5b0 msgr2=0x7f7ca806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:57.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7cafc9a640 1 -- 172.21.15.28:0/1144397051 shutdown_connections 2023-12-16T03:27:57.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.871+0000 7f7cafc9a640 1 -- 172.21.15.28:0/1144397051 wait complete. 2023-12-16T03:27:57.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cafc9a640 1 Processor -- start 2023-12-16T03:27:57.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cafc9a640 1 -- start start 2023-12-16T03:27:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cafc9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ca806d520 0x7f7ca81f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cafc9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca80bffc0 0x7f7ca8155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cafc9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca81560e0 0x7f7ca81f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cafc9a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80a5eb0 con 0x7f7ca81560e0 2023-12-16T03:27:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cafc9a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80a2a90 con 0x7f7ca806d520 2023-12-16T03:27:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cafc9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80a27b0 con 0x7f7ca80bffc0 2023-12-16T03:27:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cae237640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca81560e0 0x7f7ca81f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:57.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cae237640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca81560e0 0x7f7ca81f4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38668/0 (socket says 172.21.15.28:38668) 2023-12-16T03:27:57.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cae237640 1 -- 172.21.15.28:0/359273820 learned_addr learned my addr 172.21.15.28:0/359273820 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:57.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cad235640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca80bffc0 0x7f7ca8155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:57.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cada36640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ca806d520 0x7f7ca81f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:57.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cae237640 1 -- 172.21.15.28:0/359273820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca80bffc0 msgr2=0x7f7ca8155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:57.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cae237640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca80bffc0 0x7f7ca8155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:57.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cae237640 1 -- 172.21.15.28:0/359273820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ca806d520 msgr2=0x7f7ca81f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:57.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cae237640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ca806d520 0x7f7ca81f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:57.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cae237640 1 -- 172.21.15.28:0/359273820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca0009a70 con 0x7f7ca81560e0 2023-12-16T03:27:57.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cae237640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca81560e0 0x7f7ca81f4d20 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00b0040 tx=0x7f7ca00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:57.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/359273820 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00b9860 con 0x7f7ca81560e0 2023-12-16T03:27:57.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/359273820 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca00b99c0 con 0x7f7ca81560e0 2023-12-16T03:27:57.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/359273820 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00b9d70 con 0x7f7ca81560e0 2023-12-16T03:27:57.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cafc9a640 1 -- 172.21.15.28:0/359273820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca81f18c0 con 0x7f7ca81560e0 2023-12-16T03:27:57.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cafc9a640 1 -- 172.21.15.28:0/359273820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca81f1e80 con 0x7f7ca81560e0 2023-12-16T03:27:57.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.875+0000 7f7cafc9a640 1 -- 172.21.15.28:0/359273820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca81f2070 con 0x7f7ca81560e0 2023-12-16T03:27:57.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.879+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/359273820 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7ca00ad440 con 0x7f7ca81560e0 2023-12-16T03:27:57.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.879+0000 7f7c9e7fc640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c0664a0 0x7f7c8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:57.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.879+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/359273820 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7ca011efe0 con 0x7f7ca81560e0 2023-12-16T03:27:57.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.879+0000 7f7cada36640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c0664a0 0x7f7c8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:57.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.879+0000 7f7cada36640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c0664a0 0x7f7c8c068960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009a50 tx=0x7f7ca4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:57.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:57.883+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/359273820 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7ca00ec6d0 con 0x7f7ca81560e0 2023-12-16T03:27:58.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.043+0000 7f7cafc9a640 1 -- 172.21.15.28:0/359273820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7ca8068400 con 0x7f7ca81560e0 2023-12-16T03:27:58.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.687+0000 7f7c9e7fc640 1 -- 172.21.15.28:0/359273820 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7ca00efcf0 con 0x7f7ca81560e0 2023-12-16T03:27:58.690 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2023-12-16T03:27:58.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 -- 172.21.15.28:0/359273820 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c0664a0 msgr2=0x7f7c8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:58.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c0664a0 0x7f7c8c068960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009a50 tx=0x7f7ca4008040 comp rx=0 tx=0).stop 2023-12-16T03:27:58.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 -- 172.21.15.28:0/359273820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca81560e0 msgr2=0x7f7ca81f4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:58.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca81560e0 0x7f7ca81f4d20 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00b0040 tx=0x7f7ca00196c0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 -- 172.21.15.28:0/359273820 shutdown_connections 2023-12-16T03:27:58.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7c8c0664a0 0x7f7c8c068960 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ca81560e0 0x7f7ca81f4d20 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ca80bffc0 0x7f7ca8155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 --2- 172.21.15.28:0/359273820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ca806d520 0x7f7ca81f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 -- 172.21.15.28:0/359273820 >> 172.21.15.28:0/359273820 conn(0x7f7ca806a5b0 msgr2=0x7f7ca80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:58.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 -- 172.21.15.28:0/359273820 shutdown_connections 2023-12-16T03:27:58.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.691+0000 7f7cafc9a640 1 -- 172.21.15.28:0/359273820 wait complete. 2023-12-16T03:27:58.730 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-16T03:27:58.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.875+0000 7fa2cb9d1640 1 Processor -- start 2023-12-16T03:27:58.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.875+0000 7fa2cb9d1640 1 -- start start 2023-12-16T03:27:58.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.875+0000 7fa2cb9d1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa2c40c5260 0x7fa2c406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:58.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2cb9d1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2c40c5640 0x7fa2c40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:58.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2cb9d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2c40c60f0 0x7fa2c4155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:58.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2cb9d1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c40c17f0 con 0x7fa2c40c5260 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2cb9d1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c40c2580 con 0x7fa2c40c5640 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2cb9d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c40c1a00 con 0x7fa2c40c60f0 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2c976d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa2c40c5260 0x7fa2c406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2c976d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa2c40c5260 0x7fa2c406d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38674/0 (socket says 172.21.15.28:38674) 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2c976d640 1 -- 172.21.15.28:0/907435516 learned_addr learned my addr 172.21.15.28:0/907435516 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2c9f6e640 1 --2- 172.21.15.28:0/907435516 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2c40c60f0 0x7fa2c4155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2c8f6c640 1 --2- 172.21.15.28:0/907435516 >> v2:172.21.15.134:3300/0 conn(0x7fa2c40c5640 0x7fa2c40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2c976d640 1 -- 172.21.15.28:0/907435516 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2c40c60f0 msgr2=0x7fa2c4155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2c976d640 1 --2- 172.21.15.28:0/907435516 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2c40c60f0 0x7fa2c4155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2c976d640 1 -- 172.21.15.28:0/907435516 >> v2:172.21.15.134:3300/0 conn(0x7fa2c40c5640 msgr2=0x7fa2c40c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2c976d640 1 --2- 172.21.15.28:0/907435516 >> v2:172.21.15.134:3300/0 conn(0x7fa2c40c5640 0x7fa2c40c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2c976d640 1 -- 172.21.15.28:0/907435516 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c40c1ce0 con 0x7fa2c40c5260 2023-12-16T03:27:58.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2c976d640 1 --2- 172.21.15.28:0/907435516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2c40c5260 0x7fa2c406d5b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa2c406b390 tx=0x7fa2c001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b12a5b21e2efcfe server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:58.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2bbfff640 1 -- 172.21.15.28:0/907435516 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00ac640 con 0x7fa2c40c5260 2023-12-16T03:27:58.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2bbfff640 1 -- 172.21.15.28:0/907435516 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c00ac7a0 con 0x7fa2c40c5260 2023-12-16T03:27:58.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.879+0000 7fa2bbfff640 1 -- 172.21.15.28:0/907435516 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00acb30 con 0x7fa2c40c5260 2023-12-16T03:27:58.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/907435516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2c40c5260 msgr2=0x7fa2c406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:58.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 --2- 172.21.15.28:0/907435516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2c40c5260 0x7fa2c406d5b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa2c406b390 tx=0x7fa2c001c440 comp rx=0 tx=0).stop 2023-12-16T03:27:58.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/907435516 shutdown_connections 2023-12-16T03:27:58.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 --2- 172.21.15.28:0/907435516 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2c40c60f0 0x7fa2c4155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 --2- 172.21.15.28:0/907435516 >> v2:172.21.15.134:3300/0 conn(0x7fa2c40c5640 0x7fa2c40c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 --2- 172.21.15.28:0/907435516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2c40c5260 0x7fa2c406d5b0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/907435516 >> 172.21.15.28:0/907435516 conn(0x7fa2c406a5b0 msgr2=0x7fa2c406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:58.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/907435516 shutdown_connections 2023-12-16T03:27:58.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/907435516 wait complete. 2023-12-16T03:27:58.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 Processor -- start 2023-12-16T03:27:58.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 -- start start 2023-12-16T03:27:58.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2c40c5260 0x7fa2c41f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:58.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2c40c5640 0x7fa2c4140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:58.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2c40c60f0 0x7fa2c41412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:58.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c4159bf0 con 0x7fa2c40c5260 2023-12-16T03:27:58.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c4156d70 con 0x7fa2c40c5640 2023-12-16T03:27:58.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2cb9d1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c414f190 con 0x7fa2c40c60f0 2023-12-16T03:27:58.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2c976d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2c40c5260 0x7fa2c41f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:58.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2c976d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2c40c5260 0x7fa2c41f0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38690/0 (socket says 172.21.15.28:38690) 2023-12-16T03:27:58.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2c976d640 1 -- 172.21.15.28:0/557563253 learned_addr learned my addr 172.21.15.28:0/557563253 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:58.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2c9f6e640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2c40c60f0 0x7fa2c41412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:58.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2c8f6c640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2c40c5640 0x7fa2c4140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:58.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2c976d640 1 -- 172.21.15.28:0/557563253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2c40c60f0 msgr2=0x7fa2c41412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:58.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2c976d640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2c40c60f0 0x7fa2c41412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2c976d640 1 -- 172.21.15.28:0/557563253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2c40c5640 msgr2=0x7fa2c4140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:58.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2c976d640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2c40c5640 0x7fa2c4140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:58.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.883+0000 7fa2c976d640 1 -- 172.21.15.28:0/557563253 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00094d0 con 0x7fa2c40c5260 2023-12-16T03:27:58.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.887+0000 7fa2c976d640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2c40c5260 0x7fa2c41f0990 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00af040 tx=0x7fa2c001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:58.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.887+0000 7fa2b9ffb640 1 -- 172.21.15.28:0/557563253 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00b7830 con 0x7fa2c40c5260 2023-12-16T03:27:58.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.887+0000 7fa2b9ffb640 1 -- 172.21.15.28:0/557563253 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c00b79b0 con 0x7fa2c40c5260 2023-12-16T03:27:58.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.887+0000 7fa2b9ffb640 1 -- 172.21.15.28:0/557563253 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00b7d60 con 0x7fa2c40c5260 2023-12-16T03:27:58.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.887+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/557563253 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c4156f80 con 0x7fa2c40c5260 2023-12-16T03:27:58.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.887+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/557563253 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c414f450 con 0x7fa2c40c5260 2023-12-16T03:27:58.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.887+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/557563253 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c4068400 con 0x7fa2c40c5260 2023-12-16T03:27:58.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.887+0000 7fa2b9ffb640 1 -- 172.21.15.28:0/557563253 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa2c00b3040 con 0x7fa2c40c5260 2023-12-16T03:27:58.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.887+0000 7fa2b9ffb640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa2a8066470 0x7fa2a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:58.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.887+0000 7fa2b9ffb640 1 -- 172.21.15.28:0/557563253 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa2c011e9c0 con 0x7fa2c40c5260 2023-12-16T03:27:58.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.891+0000 7fa2c8f6c640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa2a8066470 0x7fa2a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:58.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.891+0000 7fa2c8f6c640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa2a8066470 0x7fa2a8068930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4151d60 tx=0x7fa2b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:58.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:58.891+0000 7fa2b9ffb640 1 -- 172.21.15.28:0/557563253 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa2c00ebfc0 con 0x7fa2c40c5260 2023-12-16T03:27:59.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.083+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/557563253 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa2c406d390 con 0x7fa2c40c5260 2023-12-16T03:27:59.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.691+0000 7fa2b9ffb640 1 -- 172.21.15.28:0/557563253 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa2c00ac600 con 0x7fa2c40c5260 2023-12-16T03:27:59.693 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 12 and data pool 13 2023-12-16T03:27:59.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.691+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/557563253 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa2a8066470 msgr2=0x7fa2a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:59.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.691+0000 7fa2cb9d1640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa2a8066470 0x7fa2a8068930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4151d60 tx=0x7fa2b4008040 comp rx=0 tx=0).stop 2023-12-16T03:27:59.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.695+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/557563253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2c40c5260 msgr2=0x7fa2c41f0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:59.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.695+0000 7fa2cb9d1640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2c40c5260 0x7fa2c41f0990 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00af040 tx=0x7fa2c001ac80 comp rx=0 tx=0).stop 2023-12-16T03:27:59.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.695+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/557563253 shutdown_connections 2023-12-16T03:27:59.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.695+0000 7fa2cb9d1640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2c40c60f0 0x7fa2c41412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:59.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.695+0000 7fa2cb9d1640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2c40c5640 0x7fa2c4140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:59.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.695+0000 7fa2cb9d1640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa2a8066470 0x7fa2a8068930 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:59.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.695+0000 7fa2cb9d1640 1 --2- 172.21.15.28:0/557563253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2c40c5260 0x7fa2c41f0990 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:59.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.695+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/557563253 >> 172.21.15.28:0/557563253 conn(0x7fa2c406a5b0 msgr2=0x7fa2c40bf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.699+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/557563253 shutdown_connections 2023-12-16T03:27:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.699+0000 7fa2cb9d1640 1 -- 172.21.15.28:0/557563253 wait complete. 2023-12-16T03:27:59.753 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:27:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.895+0000 7f794d4ea640 1 Processor -- start 2023-12-16T03:27:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.895+0000 7f794d4ea640 1 -- start start 2023-12-16T03:27:59.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.895+0000 7f794d4ea640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79481555c0 0x7f79480a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:59.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.895+0000 7f794d4ea640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79480c28e0 con 0x7f79480c1270 2023-12-16T03:27:59.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.895+0000 7f794d4ea640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79480c2b80 con 0x7f79480c61e0 2023-12-16T03:27:59.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.895+0000 7f794d4ea640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79480c3680 con 0x7f79481555c0 2023-12-16T03:27:59.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.895+0000 7f79477fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f79480c1270 0x7f79480c1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55008/0 (socket says 172.21.15.28:55008) 2023-12-16T03:27:59.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.895+0000 7f79477fe640 1 -- 172.21.15.28:0/3630103346 learned_addr learned my addr 172.21.15.28:0/3630103346 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:27:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.895+0000 7f7946ffd640 1 --2- 172.21.15.28:0/3630103346 >> v2:172.21.15.134:3300/0 conn(0x7f79481555c0 0x7f79480a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.899+0000 7f79467fc640 1 -- 172.21.15.28:0/3630103346 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854726356 0 0) 0x7f79480c28e0 con 0x7f79480c1270 2023-12-16T03:27:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.899+0000 7f79467fc640 1 -- 172.21.15.28:0/3630103346 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7934003530 con 0x7f79480c1270 2023-12-16T03:27:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.899+0000 7f7946ffd640 1 -- 172.21.15.28:0/3630103346 >> v1:172.21.15.134:6789/0 conn(0x7f79480c61e0 legacy=0x7f79480c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.899+0000 7f7946ffd640 1 -- 172.21.15.28:0/3630103346 >> v1:172.21.15.28:6789/0 conn(0x7f79480c1270 legacy=0x7f79480c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.899+0000 7f79467fc640 1 -- 172.21.15.28:0/3630103346 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115336654 0 0) 0x7f7934003530 con 0x7f79480c1270 2023-12-16T03:27:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.899+0000 7f7946ffd640 1 -- 172.21.15.28:0/3630103346 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79480c32a0 con 0x7f79481555c0 2023-12-16T03:27:59.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.899+0000 7f7946ffd640 1 --2- 172.21.15.28:0/3630103346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79481555c0 0x7f79480a6df0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f79380097c0 tx=0x7f793801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ab73e3d9dd32bfc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:59.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.899+0000 7f79467fc640 1 -- 172.21.15.28:0/3630103346 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940001a00 con 0x7f79481555c0 2023-12-16T03:27:59.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.899+0000 7f79467fc640 1 -- 172.21.15.28:0/3630103346 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79380a7050 con 0x7f79481555c0 2023-12-16T03:27:59.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.899+0000 7f79467fc640 1 -- 172.21.15.28:0/3630103346 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380ab600 con 0x7f79481555c0 2023-12-16T03:27:59.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 -- 172.21.15.28:0/3630103346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79481555c0 msgr2=0x7f79480a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:59.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 --2- 172.21.15.28:0/3630103346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79481555c0 0x7f79480a6df0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f79380097c0 tx=0x7f793801c3a0 comp rx=0 tx=0).stop 2023-12-16T03:27:59.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 -- 172.21.15.28:0/3630103346 shutdown_connections 2023-12-16T03:27:59.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 --2- 172.21.15.28:0/3630103346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79481555c0 0x7f79480a6df0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:59.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 -- 172.21.15.28:0/3630103346 >> 172.21.15.28:0/3630103346 conn(0x7f79480c7e40 msgr2=0x7f79480c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:27:59.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 -- 172.21.15.28:0/3630103346 shutdown_connections 2023-12-16T03:27:59.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 -- 172.21.15.28:0/3630103346 wait complete. 2023-12-16T03:27:59.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 Processor -- start 2023-12-16T03:27:59.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 -- start start 2023-12-16T03:27:59.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79480c1270 0x7f79481455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:59.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79480c61e0 0x7f7948147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79481555c0 0x7f79481f0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7948148480 con 0x7f79481555c0 2023-12-16T03:27:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7948157a40 con 0x7f79480c61e0 2023-12-16T03:27:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f794d4ea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79481582e0 con 0x7f79480c1270 2023-12-16T03:27:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f79477fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79481555c0 0x7f79481f0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f79477fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79481555c0 0x7f79481f0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57718/0 (socket says 172.21.15.28:57718) 2023-12-16T03:27:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f79477fe640 1 -- 172.21.15.28:0/715491933 learned_addr learned my addr 172.21.15.28:0/715491933 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:27:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f793ffff640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79480c61e0 0x7f7948147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f7946ffd640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79480c1270 0x7f79481455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:59.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f79477fe640 1 -- 172.21.15.28:0/715491933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79480c1270 msgr2=0x7f79481455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:59.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f79477fe640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79480c1270 0x7f79481455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:59.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f79477fe640 1 -- 172.21.15.28:0/715491933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79480c61e0 msgr2=0x7f7948147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:27:59.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f79477fe640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79480c61e0 0x7f7948147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:27:59.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f79477fe640 1 -- 172.21.15.28:0/715491933 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7938009420 con 0x7f79481555c0 2023-12-16T03:27:59.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.903+0000 7f79477fe640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79481555c0 0x7f79481f0400 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f794000cc30 tx=0x7f794000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.907+0000 7f793f7fe640 1 -- 172.21.15.28:0/715491933 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794000ce40 con 0x7f79481555c0 2023-12-16T03:27:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.907+0000 7f793f7fe640 1 -- 172.21.15.28:0/715491933 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7940012400 con 0x7f79481555c0 2023-12-16T03:27:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.907+0000 7f793f7fe640 1 -- 172.21.15.28:0/715491933 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400127b0 con 0x7f79481555c0 2023-12-16T03:27:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.907+0000 7f794d4ea640 1 -- 172.21.15.28:0/715491933 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7948158770 con 0x7f79481555c0 2023-12-16T03:27:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.907+0000 7f794d4ea640 1 -- 172.21.15.28:0/715491933 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7948157c90 con 0x7f79481555c0 2023-12-16T03:27:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.907+0000 7f794d4ea640 1 -- 172.21.15.28:0/715491933 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7948068400 con 0x7f79481555c0 2023-12-16T03:27:59.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.907+0000 7f793f7fe640 1 -- 172.21.15.28:0/715491933 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7940012910 con 0x7f79481555c0 2023-12-16T03:27:59.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.907+0000 7f793f7fe640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79280664a0 0x7f7928068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:27:59.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.907+0000 7f793f7fe640 1 -- 172.21.15.28:0/715491933 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7940084500 con 0x7f79481555c0 2023-12-16T03:27:59.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.907+0000 7f7946ffd640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79280664a0 0x7f7928068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:27:59.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.911+0000 7f7946ffd640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79280664a0 0x7f7928068960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f79380ad000 tx=0x7f79380a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:27:59.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:27:59.911+0000 7f793f7fe640 1 -- 172.21.15.28:0/715491933 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7940051a10 con 0x7f79481555c0 2023-12-16T03:28:00.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.103+0000 7f794d4ea640 1 -- 172.21.15.28:0/715491933 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79480c51a0 con 0x7f79481555c0 2023-12-16T03:28:00.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f793f7fe640 1 -- 172.21.15.28:0/715491933 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f7940055030 con 0x7f79481555c0 2023-12-16T03:28:00.109 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:00.109 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":67,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:59.086170+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:00.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 -- 172.21.15.28:0/715491933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79280664a0 msgr2=0x7f7928068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79280664a0 0x7f7928068960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f79380ad000 tx=0x7f79380a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:00.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 -- 172.21.15.28:0/715491933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79481555c0 msgr2=0x7f79481f0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79481555c0 0x7f79481f0400 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f794000cc30 tx=0x7f794000a430 comp rx=0 tx=0).stop 2023-12-16T03:28:00.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 -- 172.21.15.28:0/715491933 shutdown_connections 2023-12-16T03:28:00.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f79280664a0 0x7f7928068960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f79481555c0 0x7f79481f0400 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79480c61e0 0x7f7948147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 --2- 172.21.15.28:0/715491933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79480c1270 0x7f79481455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 -- 172.21.15.28:0/715491933 >> 172.21.15.28:0/715491933 conn(0x7f79480c7e40 msgr2=0x7f794806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:00.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 -- 172.21.15.28:0/715491933 shutdown_connections 2023-12-16T03:28:00.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.107+0000 7f794d4ea640 1 -- 172.21.15.28:0/715491933 wait complete. 2023-12-16T03:28:00.131 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:00.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9dc5a32640 1 Processor -- start 2023-12-16T03:28:00.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9dc5a32640 1 -- start start 2023-12-16T03:28:00.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9dc5a32640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9dc0151e90 0x7f9dc00c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:00.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9dc5a32640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc006c860 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9dc5a32640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc0154930 con 0x7f9dc00c4e60 2023-12-16T03:28:00.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9dc5a32640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc00c8750 con 0x7f9dc0151e90 2023-12-16T03:28:00.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9dbeffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9dc0151e90 0x7f9dc00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:00.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9db7fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9dc00c7ea0 0x7f9dc006b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55010/0 (socket says 172.21.15.28:55010) 2023-12-16T03:28:00.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9db7fff640 1 -- 172.21.15.28:0/2570037494 learned_addr learned my addr 172.21.15.28:0/2570037494 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:00.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9dbeffd640 1 -- 172.21.15.28:0/2570037494 >> v1:172.21.15.134:6789/0 conn(0x7f9dc00c4e60 legacy=0x7f9dc015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9dbeffd640 1 -- 172.21.15.28:0/2570037494 >> v1:172.21.15.28:6789/0 conn(0x7f9dc00c7ea0 legacy=0x7f9dc006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.271+0000 7f9dbeffd640 1 -- 172.21.15.28:0/2570037494 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc0154c10 con 0x7f9dc0151e90 2023-12-16T03:28:00.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.275+0000 7f9dbeffd640 1 --2- 172.21.15.28:0/2570037494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dc0151e90 0x7f9dc00c4920 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9db00097c0 tx=0x7f9db001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463b246a90bc54ec server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:00.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.275+0000 7f9dbe7fc640 1 -- 172.21.15.28:0/2570037494 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db00ab600 con 0x7f9dc0151e90 2023-12-16T03:28:00.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.275+0000 7f9dbe7fc640 1 -- 172.21.15.28:0/2570037494 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db00a7050 con 0x7f9dc0151e90 2023-12-16T03:28:00.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.275+0000 7f9dbe7fc640 1 -- 172.21.15.28:0/2570037494 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db00ab980 con 0x7f9dc0151e90 2023-12-16T03:28:00.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.275+0000 7f9dc5a32640 1 -- 172.21.15.28:0/2570037494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dc0151e90 msgr2=0x7f9dc00c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.275+0000 7f9dc5a32640 1 --2- 172.21.15.28:0/2570037494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dc0151e90 0x7f9dc00c4920 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9db00097c0 tx=0x7f9db001c360 comp rx=0 tx=0).stop 2023-12-16T03:28:00.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.275+0000 7f9dc5a32640 1 -- 172.21.15.28:0/2570037494 shutdown_connections 2023-12-16T03:28:00.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.275+0000 7f9dc5a32640 1 --2- 172.21.15.28:0/2570037494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dc0151e90 0x7f9dc00c4920 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.275+0000 7f9dc5a32640 1 -- 172.21.15.28:0/2570037494 >> 172.21.15.28:0/2570037494 conn(0x7f9dc00ca170 msgr2=0x7f9dc00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:00.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.275+0000 7f9dc5a32640 1 -- 172.21.15.28:0/2570037494 shutdown_connections 2023-12-16T03:28:00.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.275+0000 7f9dc5a32640 1 -- 172.21.15.28:0/2570037494 wait complete. 2023-12-16T03:28:00.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dc5a32640 1 Processor -- start 2023-12-16T03:28:00.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dc5a32640 1 -- start start 2023-12-16T03:28:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dc5a32640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc00c4e60 0x7f9dc01f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dc5a32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dc00c7ea0 0x7f9dc01f1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:00.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dc5a32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9dc0151e90 0x7f9dc0157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dc5a32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc01552d0 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dc5a32640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00c22d0 con 0x7f9dc00c4e60 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dc5a32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc01f1770 con 0x7f9dc0151e90 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9db7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dc00c7ea0 0x7f9dc01f1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9db7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dc00c7ea0 0x7f9dc01f1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57746/0 (socket says 172.21.15.28:57746) 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9db7fff640 1 -- 172.21.15.28:0/897537624 learned_addr learned my addr 172.21.15.28:0/897537624 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dbf7fe640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9dc0151e90 0x7f9dc0157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dbeffd640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc00c4e60 0x7f9dc01f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9db7fff640 1 -- 172.21.15.28:0/897537624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9dc0151e90 msgr2=0x7f9dc0157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9db7fff640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9dc0151e90 0x7f9dc0157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9db7fff640 1 -- 172.21.15.28:0/897537624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc00c4e60 msgr2=0x7f9dc01f0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9db7fff640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc00c4e60 0x7f9dc01f0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9db7fff640 1 -- 172.21.15.28:0/897537624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db0009420 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9db7fff640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dc00c7ea0 0x7f9dc01f1230 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9da800c400 tx=0x7f9da800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dbcff9640 1 -- 172.21.15.28:0/897537624 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8005cf0 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dbcff9640 1 -- 172.21.15.28:0/897537624 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da8005e50 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dbcff9640 1 -- 172.21.15.28:0/897537624 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da80072d0 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dc5a32640 1 -- 172.21.15.28:0/897537624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc00abf50 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dc5a32640 1 -- 172.21.15.28:0/897537624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc014b540 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.279+0000 7f9dc5a32640 1 -- 172.21.15.28:0/897537624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc00c2440 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.283+0000 7f9dbcff9640 1 -- 172.21.15.28:0/897537624 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9da8007430 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.283+0000 7f9dbcff9640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9da0066470 0x7f9da0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:00.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.283+0000 7f9dbcff9640 1 -- 172.21.15.28:0/897537624 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9da8083320 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.283+0000 7f9dbeffd640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9da0066470 0x7f9da0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:00.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.283+0000 7f9dbeffd640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9da0066470 0x7f9da0068930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9db00ad000 tx=0x7f9db00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:00.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.287+0000 7f9dbcff9640 1 -- 172.21.15.28:0/897537624 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9da8050840 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.447+0000 7f9dc5a32640 1 -- 172.21.15.28:0/897537624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dc0068400 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.447+0000 7f9dbcff9640 1 -- 172.21.15.28:0/897537624 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f9da8053e60 con 0x7f9dc00c7ea0 2023-12-16T03:28:00.451 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:00.452 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":67,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:27:59.086170+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:00.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 -- 172.21.15.28:0/897537624 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9da0066470 msgr2=0x7f9da0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9da0066470 0x7f9da0068930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9db00ad000 tx=0x7f9db00a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 -- 172.21.15.28:0/897537624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dc00c7ea0 msgr2=0x7f9dc01f1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dc00c7ea0 0x7f9dc01f1230 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9da800c400 tx=0x7f9da800c8c0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 -- 172.21.15.28:0/897537624 shutdown_connections 2023-12-16T03:28:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9dc0151e90 0x7f9dc0157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9da0066470 0x7f9da0068930 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dc00c7ea0 0x7f9dc01f1230 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 --2- 172.21.15.28:0/897537624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dc00c4e60 0x7f9dc01f0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 -- 172.21.15.28:0/897537624 >> 172.21.15.28:0/897537624 conn(0x7f9dc00ca170 msgr2=0x7f9dc0150050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 -- 172.21.15.28:0/897537624 shutdown_connections 2023-12-16T03:28:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.451+0000 7f9dc5a32640 1 -- 172.21.15.28:0/897537624 wait complete. 2023-12-16T03:28:00.475 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-16T03:28:00.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef8c71d640 1 Processor -- start 2023-12-16T03:28:00.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef8c71d640 1 -- start start 2023-12-16T03:28:00.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef8c71d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fef840c63c0 0x7fef840c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:00.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef8c71d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef840c31c0 con 0x7fef840c4100 2023-12-16T03:28:00.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef8c71d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef840c34a0 con 0x7fef840c2bb0 2023-12-16T03:28:00.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef8c71d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef840c1030 con 0x7fef840c63c0 2023-12-16T03:28:00.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef89cb8640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fef840c4100 0x7fef840c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55022/0 (socket says 172.21.15.28:55022) 2023-12-16T03:28:00.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef89cb8640 1 -- 172.21.15.28:0/1294238331 learned_addr learned my addr 172.21.15.28:0/1294238331 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:00.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef8a4b9640 1 --2- 172.21.15.28:0/1294238331 >> v2:172.21.15.134:3300/0 conn(0x7fef840c63c0 0x7fef840c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:00.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef894b7640 1 -- 172.21.15.28:0/1294238331 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499571722 0 0) 0x7fef840c31c0 con 0x7fef840c4100 2023-12-16T03:28:00.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef894b7640 1 -- 172.21.15.28:0/1294238331 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef70003530 con 0x7fef840c4100 2023-12-16T03:28:00.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef8a4b9640 1 -- 172.21.15.28:0/1294238331 >> v1:172.21.15.134:6789/0 conn(0x7fef840c2bb0 legacy=0x7fef840a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef894b7640 1 -- 172.21.15.28:0/1294238331 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150241226 0 0) 0x7fef840c34a0 con 0x7fef840c2bb0 2023-12-16T03:28:00.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef8a4b9640 1 -- 172.21.15.28:0/1294238331 >> v1:172.21.15.28:6789/0 conn(0x7fef840c4100 legacy=0x7fef840c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.619+0000 7fef8a4b9640 1 -- 172.21.15.28:0/1294238331 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef840c1310 con 0x7fef840c63c0 2023-12-16T03:28:00.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.623+0000 7fef8a4b9640 1 --2- 172.21.15.28:0/1294238331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef840c63c0 0x7fef840c06d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fef800097c0 tx=0x7fef8001c1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=470a55c5d2e22b0e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:00.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.623+0000 7fef894b7640 1 -- 172.21.15.28:0/1294238331 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74001600 con 0x7fef840c63c0 2023-12-16T03:28:00.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.623+0000 7fef894b7640 1 -- 172.21.15.28:0/1294238331 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef800a7050 con 0x7fef840c63c0 2023-12-16T03:28:00.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.623+0000 7fef894b7640 1 -- 172.21.15.28:0/1294238331 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef800ab620 con 0x7fef840c63c0 2023-12-16T03:28:00.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.623+0000 7fef8c71d640 1 -- 172.21.15.28:0/1294238331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef840c63c0 msgr2=0x7fef840c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.623+0000 7fef8c71d640 1 --2- 172.21.15.28:0/1294238331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef840c63c0 0x7fef840c06d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fef800097c0 tx=0x7fef8001c1a0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.623+0000 7fef8c71d640 1 -- 172.21.15.28:0/1294238331 shutdown_connections 2023-12-16T03:28:00.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.623+0000 7fef8c71d640 1 --2- 172.21.15.28:0/1294238331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef840c63c0 0x7fef840c06d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.623+0000 7fef8c71d640 1 -- 172.21.15.28:0/1294238331 >> 172.21.15.28:0/1294238331 conn(0x7fef8406a5b0 msgr2=0x7fef8406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:00.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.623+0000 7fef8c71d640 1 -- 172.21.15.28:0/1294238331 shutdown_connections 2023-12-16T03:28:00.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.623+0000 7fef8c71d640 1 -- 172.21.15.28:0/1294238331 wait complete. 2023-12-16T03:28:00.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8c71d640 1 Processor -- start 2023-12-16T03:28:00.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8c71d640 1 -- start start 2023-12-16T03:28:00.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8c71d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef840c2bb0 0x7fef84071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:00.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8c71d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef840c4100 0x7fef8415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8c71d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef840c63c0 0x7fef8415a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8c71d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef841edbd0 con 0x7fef840c2bb0 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8c71d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef841ecf50 con 0x7fef840c4100 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8c71d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef841ed230 con 0x7fef840c63c0 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8a4b9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef840c2bb0 0x7fef84071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8a4b9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef840c2bb0 0x7fef84071cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57750/0 (socket says 172.21.15.28:57750) 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8a4b9640 1 -- 172.21.15.28:0/1248131276 learned_addr learned my addr 172.21.15.28:0/1248131276 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8a4b9640 1 -- 172.21.15.28:0/1248131276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef840c63c0 msgr2=0x7fef8415a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8a4b9640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef840c63c0 0x7fef8415a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8a4b9640 1 -- 172.21.15.28:0/1248131276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef840c4100 msgr2=0x7fef8415b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef89cb8640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef840c4100 0x7fef8415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8a4b9640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef840c4100 0x7fef8415b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8a4b9640 1 -- 172.21.15.28:0/1248131276 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef80009420 con 0x7fef840c2bb0 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef89cb8640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef840c4100 0x7fef8415b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8a4b9640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef840c2bb0 0x7fef84071cc0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fef800097c0 tx=0x7fef8001a9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:00.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef7affd640 1 -- 172.21.15.28:0/1248131276 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef800abd80 con 0x7fef840c2bb0 2023-12-16T03:28:00.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef7affd640 1 -- 172.21.15.28:0/1248131276 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef80004020 con 0x7fef840c2bb0 2023-12-16T03:28:00.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8c71d640 1 -- 172.21.15.28:0/1248131276 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef841ed510 con 0x7fef840c2bb0 2023-12-16T03:28:00.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef7affd640 1 -- 172.21.15.28:0/1248131276 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef800043d0 con 0x7fef840c2bb0 2023-12-16T03:28:00.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.627+0000 7fef8c71d640 1 -- 172.21.15.28:0/1248131276 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef84072200 con 0x7fef840c2bb0 2023-12-16T03:28:00.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.631+0000 7fef8c71d640 1 -- 172.21.15.28:0/1248131276 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef84068400 con 0x7fef840c2bb0 2023-12-16T03:28:00.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.631+0000 7fef7affd640 1 -- 172.21.15.28:0/1248131276 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fef80003620 con 0x7fef840c2bb0 2023-12-16T03:28:00.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.631+0000 7fef7affd640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fef68066470 0x7fef68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:00.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.631+0000 7fef7affd640 1 -- 172.21.15.28:0/1248131276 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef8011e4a0 con 0x7fef840c2bb0 2023-12-16T03:28:00.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.631+0000 7fef89cb8640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fef68066470 0x7fef68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:00.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.631+0000 7fef89cb8640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fef68066470 0x7fef68068930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fef74000f70 tx=0x7fef74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:00.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.635+0000 7fef7affd640 1 -- 172.21.15.28:0/1248131276 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fef800eb910 con 0x7fef840c2bb0 2023-12-16T03:28:00.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:00.835+0000 7fef8c71d640 1 -- 172.21.15.28:0/1248131276 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fef840a4ee0 con 0x7fef840c2bb0 2023-12-16T03:28:01.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.715+0000 7fef7affd640 1 -- 172.21.15.28:0/1248131276 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7fef800eef30 con 0x7fef840c2bb0 2023-12-16T03:28:01.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 -- 172.21.15.28:0/1248131276 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fef68066470 msgr2=0x7fef68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:01.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fef68066470 0x7fef68068930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fef74000f70 tx=0x7fef74009040 comp rx=0 tx=0).stop 2023-12-16T03:28:01.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 -- 172.21.15.28:0/1248131276 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef840c2bb0 msgr2=0x7fef84071cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:01.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef840c2bb0 0x7fef84071cc0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fef800097c0 tx=0x7fef8001a9e0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 -- 172.21.15.28:0/1248131276 shutdown_connections 2023-12-16T03:28:01.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef840c63c0 0x7fef8415a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef840c4100 0x7fef8415b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fef68066470 0x7fef68068930 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 --2- 172.21.15.28:0/1248131276 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fef840c2bb0 0x7fef84071cc0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 -- 172.21.15.28:0/1248131276 >> 172.21.15.28:0/1248131276 conn(0x7fef8406a5b0 msgr2=0x7fef840a6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:01.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 -- 172.21.15.28:0/1248131276 shutdown_connections 2023-12-16T03:28:01.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.719+0000 7fef8c71d640 1 -- 172.21.15.28:0/1248131276 wait complete. 2023-12-16T03:28:01.744 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-16T03:28:01.745 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-16T03:28:01.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.891+0000 7f42770bb640 1 Processor -- start 2023-12-16T03:28:01.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.891+0000 7f42770bb640 1 -- start start 2023-12-16T03:28:01.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f42770bb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f42700a5370 0x7f42700c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:01.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f42770bb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f42700c4110 0x7f4270150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:01.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f42770bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4270072090 0x7f42701514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:01.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f42770bb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42700c3070 con 0x7f42700a5370 2023-12-16T03:28:01.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f42770bb640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42700c2760 con 0x7f42700c4110 2023-12-16T03:28:01.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f42770bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42700a5750 con 0x7f4270072090 2023-12-16T03:28:01.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f4274e57640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f42700a5370 0x7f42700c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f4274e57640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f42700a5370 0x7f42700c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57756/0 (socket says 172.21.15.28:57756) 2023-12-16T03:28:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f4274e57640 1 -- 172.21.15.28:0/3390430440 learned_addr learned my addr 172.21.15.28:0/3390430440 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f426ffff640 1 --2- 172.21.15.28:0/3390430440 >> v2:172.21.15.134:3300/0 conn(0x7f42700c4110 0x7f4270150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f4274e57640 1 -- 172.21.15.28:0/3390430440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4270072090 msgr2=0x7f42701514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f4275658640 1 --2- 172.21.15.28:0/3390430440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4270072090 0x7f42701514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f4274e57640 1 --2- 172.21.15.28:0/3390430440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4270072090 0x7f42701514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f4274e57640 1 -- 172.21.15.28:0/3390430440 >> v2:172.21.15.134:3300/0 conn(0x7f42700c4110 msgr2=0x7f4270150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f4274e57640 1 --2- 172.21.15.28:0/3390430440 >> v2:172.21.15.134:3300/0 conn(0x7f42700c4110 0x7f4270150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f4274e57640 1 -- 172.21.15.28:0/3390430440 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700aad20 con 0x7f42700a5370 2023-12-16T03:28:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f426ffff640 1 --2- 172.21.15.28:0/3390430440 >> v2:172.21.15.134:3300/0 conn(0x7f42700c4110 0x7f4270150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:01.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.895+0000 7f4275658640 1 --2- 172.21.15.28:0/3390430440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4270072090 0x7f42701514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:01.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f4274e57640 1 --2- 172.21.15.28:0/3390430440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42700a5370 0x7f42700c3bd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f427006b360 tx=0x7f426401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b76fdc15440c2da server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:01.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f426f7fe640 1 -- 172.21.15.28:0/3390430440 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640ab600 con 0x7f42700a5370 2023-12-16T03:28:01.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f426f7fe640 1 -- 172.21.15.28:0/3390430440 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42640a7050 con 0x7f42700a5370 2023-12-16T03:28:01.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f426f7fe640 1 -- 172.21.15.28:0/3390430440 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640ab980 con 0x7f42700a5370 2023-12-16T03:28:01.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f42770bb640 1 -- 172.21.15.28:0/3390430440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42700a5370 msgr2=0x7f42700c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:01.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f42770bb640 1 --2- 172.21.15.28:0/3390430440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42700a5370 0x7f42700c3bd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f427006b360 tx=0x7f426401c3b0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f42770bb640 1 -- 172.21.15.28:0/3390430440 shutdown_connections 2023-12-16T03:28:01.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f42770bb640 1 --2- 172.21.15.28:0/3390430440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4270072090 0x7f42701514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f42770bb640 1 --2- 172.21.15.28:0/3390430440 >> v2:172.21.15.134:3300/0 conn(0x7f42700c4110 0x7f4270150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f42770bb640 1 --2- 172.21.15.28:0/3390430440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42700a5370 0x7f42700c3bd0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f42770bb640 1 -- 172.21.15.28:0/3390430440 >> 172.21.15.28:0/3390430440 conn(0x7f427006a5b0 msgr2=0x7f427006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:01.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f42770bb640 1 -- 172.21.15.28:0/3390430440 shutdown_connections 2023-12-16T03:28:01.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f42770bb640 1 -- 172.21.15.28:0/3390430440 wait complete. 2023-12-16T03:28:01.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f42770bb640 1 Processor -- start 2023-12-16T03:28:01.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.899+0000 7f42770bb640 1 -- start start 2023-12-16T03:28:01.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f42770bb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4270072090 0x7f427006d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f42770bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42700a5370 0x7f427014b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f42770bb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42700c4110 0x7f427014b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f42770bb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270150950 con 0x7f42700c4110 2023-12-16T03:28:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f42770bb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427014fcb0 con 0x7f4270072090 2023-12-16T03:28:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f42770bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42701f0fc0 con 0x7f42700a5370 2023-12-16T03:28:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f4275658640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42700c4110 0x7f427014b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f4275658640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42700c4110 0x7f427014b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57758/0 (socket says 172.21.15.28:57758) 2023-12-16T03:28:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f426ffff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42700a5370 0x7f427014b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f4275658640 1 -- 172.21.15.28:0/1517865107 learned_addr learned my addr 172.21.15.28:0/1517865107 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f4274e57640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4270072090 0x7f427006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:01.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f4275658640 1 -- 172.21.15.28:0/1517865107 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42700a5370 msgr2=0x7f427014b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:01.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f4275658640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42700a5370 0x7f427014b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f4275658640 1 -- 172.21.15.28:0/1517865107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4270072090 msgr2=0x7f427006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:01.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f4275658640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4270072090 0x7f427006d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:01.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f4275658640 1 -- 172.21.15.28:0/1517865107 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640094d0 con 0x7f42700c4110 2023-12-16T03:28:01.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f4275658640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42700c4110 0x7f427014b6b0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f426800cef0 tx=0x7f426800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:01.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f426d7fa640 1 -- 172.21.15.28:0/1517865107 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800d840 con 0x7f42700c4110 2023-12-16T03:28:01.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f426d7fa640 1 -- 172.21.15.28:0/1517865107 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800d9a0 con 0x7f42700c4110 2023-12-16T03:28:01.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f426d7fa640 1 -- 172.21.15.28:0/1517865107 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800dd50 con 0x7f42700c4110 2023-12-16T03:28:01.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f42770bb640 1 -- 172.21.15.28:0/1517865107 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427014c260 con 0x7f42700c4110 2023-12-16T03:28:01.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f42770bb640 1 -- 172.21.15.28:0/1517865107 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427006db60 con 0x7f42700c4110 2023-12-16T03:28:01.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f42770bb640 1 -- 172.21.15.28:0/1517865107 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4270150670 con 0x7f42700c4110 2023-12-16T03:28:01.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.903+0000 7f426d7fa640 1 -- 172.21.15.28:0/1517865107 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f426801e3b0 con 0x7f42700c4110 2023-12-16T03:28:01.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.907+0000 7f426d7fa640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4254066470 0x7f4254068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:01.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.907+0000 7f426d7fa640 1 -- 172.21.15.28:0/1517865107 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42680847e0 con 0x7f42700c4110 2023-12-16T03:28:01.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.907+0000 7f4274e57640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4254066470 0x7f4254068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:01.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.907+0000 7f4274e57640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4254066470 0x7f4254068930 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f42640ad000 tx=0x7f42640a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:01.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:01.911+0000 7f426d7fa640 1 -- 172.21.15.28:0/1517865107 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4270150670 con 0x7f42700c4110 2023-12-16T03:28:02.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.103+0000 7f42770bb640 1 -- 172.21.15.28:0/1517865107 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4270150670 con 0x7f42700c4110 2023-12-16T03:28:02.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f426d7fa640 1 -- 172.21.15.28:0/1517865107 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4270150670 con 0x7f42700c4110 2023-12-16T03:28:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 -- 172.21.15.28:0/1517865107 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4254066470 msgr2=0x7f4254068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4254066470 0x7f4254068930 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f42640ad000 tx=0x7f42640a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 -- 172.21.15.28:0/1517865107 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42700c4110 msgr2=0x7f427014b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42700c4110 0x7f427014b6b0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f426800cef0 tx=0x7f426800a710 comp rx=0 tx=0).stop 2023-12-16T03:28:02.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 -- 172.21.15.28:0/1517865107 shutdown_connections 2023-12-16T03:28:02.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4254066470 0x7f4254068930 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:02.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42700c4110 0x7f427014b6b0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:02.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f42700a5370 0x7f427014b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:02.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 --2- 172.21.15.28:0/1517865107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4270072090 0x7f427006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:02.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 -- 172.21.15.28:0/1517865107 >> 172.21.15.28:0/1517865107 conn(0x7f427006a5b0 msgr2=0x7f4270154540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:02.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 -- 172.21.15.28:0/1517865107 shutdown_connections 2023-12-16T03:28:02.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.723+0000 7f42770bb640 1 -- 172.21.15.28:0/1517865107 wait complete. 2023-12-16T03:28:02.751 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-16T03:28:02.751 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:28:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.895+0000 7efc047b8640 1 Processor -- start 2023-12-16T03:28:02.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.895+0000 7efc047b8640 1 -- start start 2023-12-16T03:28:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.895+0000 7efc047b8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c4100 0x7efbfc0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.895+0000 7efc047b8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efbfc0c06d0 0x7efbfc0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.895+0000 7efc047b8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc0c31c0 con 0x7efbfc0c63c0 2023-12-16T03:28:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.895+0000 7efc047b8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc0c34a0 con 0x7efbfc0c06d0 2023-12-16T03:28:02.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.895+0000 7efc047b8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0c1030 con 0x7efbfc0c4100 2023-12-16T03:28:02.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc01d53640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c4100 0x7efbfc0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc02d55640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efbfc0c06d0 0x7efbfc0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc01d53640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c4100 0x7efbfc0c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:36886/0 (socket says 172.21.15.28:36886) 2023-12-16T03:28:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc01d53640 1 -- 172.21.15.28:0/2375879344 learned_addr learned my addr 172.21.15.28:0/2375879344 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc01552640 1 -- 172.21.15.28:0/2375879344 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962309342 0 0) 0x7efbfc0c31c0 con 0x7efbfc0c63c0 2023-12-16T03:28:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc01552640 1 -- 172.21.15.28:0/2375879344 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe8003530 con 0x7efbfc0c63c0 2023-12-16T03:28:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc01d53640 1 -- 172.21.15.28:0/2375879344 >> v2:172.21.15.134:3300/0 conn(0x7efbfc0c06d0 msgr2=0x7efbfc0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc01d53640 1 --2- 172.21.15.28:0/2375879344 >> v2:172.21.15.134:3300/0 conn(0x7efbfc0c06d0 0x7efbfc0a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc01d53640 1 -- 172.21.15.28:0/2375879344 >> v1:172.21.15.134:6789/0 conn(0x7efbfc0c63c0 legacy=0x7efbfc0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc01d53640 1 -- 172.21.15.28:0/2375879344 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc0c1310 con 0x7efbfc0c4100 2023-12-16T03:28:02.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc02d55640 1 --2- 172.21.15.28:0/2375879344 >> v2:172.21.15.134:3300/0 conn(0x7efbfc0c06d0 0x7efbfc0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.899+0000 7efc01d53640 1 --2- 172.21.15.28:0/2375879344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c4100 0x7efbfc0c2bb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efbec009870 tx=0x7efbec01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aaca3d60dc0480f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc01552640 1 -- 172.21.15.28:0/2375879344 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0aa3d0 con 0x7efbfc0c4100 2023-12-16T03:28:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc01552640 1 -- 172.21.15.28:0/2375879344 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec0a7050 con 0x7efbfc0c4100 2023-12-16T03:28:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc01552640 1 -- 172.21.15.28:0/2375879344 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec0ab820 con 0x7efbfc0c4100 2023-12-16T03:28:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 -- 172.21.15.28:0/2375879344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c4100 msgr2=0x7efbfc0c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 --2- 172.21.15.28:0/2375879344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c4100 0x7efbfc0c2bb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efbec009870 tx=0x7efbec01c420 comp rx=0 tx=0).stop 2023-12-16T03:28:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 -- 172.21.15.28:0/2375879344 shutdown_connections 2023-12-16T03:28:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 --2- 172.21.15.28:0/2375879344 >> v2:172.21.15.134:3300/0 conn(0x7efbfc0c06d0 0x7efbfc0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 --2- 172.21.15.28:0/2375879344 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c4100 0x7efbfc0c2bb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 -- 172.21.15.28:0/2375879344 >> 172.21.15.28:0/2375879344 conn(0x7efbfc06a5b0 msgr2=0x7efbfc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 -- 172.21.15.28:0/2375879344 shutdown_connections 2023-12-16T03:28:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 -- 172.21.15.28:0/2375879344 wait complete. 2023-12-16T03:28:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 Processor -- start 2023-12-16T03:28:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 -- start start 2023-12-16T03:28:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efbfc0c06d0 0x7efbfc1ec740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbfc0c4100 0x7efbfc15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c63c0 0x7efbfc153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc1ed750 con 0x7efbfc0c06d0 2023-12-16T03:28:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc071f50 con 0x7efbfc0c4100 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc047b8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc1ecc80 con 0x7efbfc0c63c0 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc02554640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efbfc0c06d0 0x7efbfc1ec740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc02554640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efbfc0c06d0 0x7efbfc1ec740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57772/0 (socket says 172.21.15.28:57772) 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc02554640 1 -- 172.21.15.28:0/1998033667 learned_addr learned my addr 172.21.15.28:0/1998033667 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.903+0000 7efc01d53640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbfc0c4100 0x7efbfc15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efc02d55640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c63c0 0x7efbfc153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efc02554640 1 -- 172.21.15.28:0/1998033667 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c63c0 msgr2=0x7efbfc153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efc02554640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c63c0 0x7efbfc153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efc02554640 1 -- 172.21.15.28:0/1998033667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbfc0c4100 msgr2=0x7efbfc15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efc02554640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbfc0c4100 0x7efbfc15a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efc02554640 1 -- 172.21.15.28:0/1998033667 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf4009a70 con 0x7efbfc0c06d0 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efc02554640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efbfc0c06d0 0x7efbfc1ec740 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7efbf800c430 tx=0x7efbf800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efbf2ffd640 1 -- 172.21.15.28:0/1998033667 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80052d0 con 0x7efbfc0c06d0 2023-12-16T03:28:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efbf2ffd640 1 -- 172.21.15.28:0/1998033667 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf8005450 con 0x7efbfc0c06d0 2023-12-16T03:28:02.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efbf2ffd640 1 -- 172.21.15.28:0/1998033667 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8003840 con 0x7efbfc0c06d0 2023-12-16T03:28:02.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efc047b8640 1 -- 172.21.15.28:0/1998033667 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbec0094d0 con 0x7efbfc0c06d0 2023-12-16T03:28:02.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efc047b8640 1 -- 172.21.15.28:0/1998033667 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc1ed190 con 0x7efbfc0c06d0 2023-12-16T03:28:02.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efc047b8640 1 -- 172.21.15.28:0/1998033667 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc068400 con 0x7efbfc0c06d0 2023-12-16T03:28:02.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efbf2ffd640 1 -- 172.21.15.28:0/1998033667 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7efbf80039a0 con 0x7efbfc0c06d0 2023-12-16T03:28:02.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efbf2ffd640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbe0066470 0x7efbe0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:02.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efbf2ffd640 1 -- 172.21.15.28:0/1998033667 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efbf8083400 con 0x7efbfc0c06d0 2023-12-16T03:28:02.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.907+0000 7efc01d53640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbe0066470 0x7efbe0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:02.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.911+0000 7efc01d53640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbe0066470 0x7efbe0068930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efbec0ad000 tx=0x7efbec0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:02.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:02.911+0000 7efbf2ffd640 1 -- 172.21.15.28:0/1998033667 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7efbf8050890 con 0x7efbfc0c06d0 2023-12-16T03:28:03.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 -- 172.21.15.28:0/1998033667 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efbfc0c3e70 con 0x7efbfc0c06d0 2023-12-16T03:28:03.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efbf2ffd640 1 -- 172.21.15.28:0/1998033667 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4940 (secure 0 0 0) 0x7efbf8053eb0 con 0x7efbfc0c06d0 2023-12-16T03:28:03.106 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:03.106 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/651767003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":651767003},{"type":"v1","addr":"172.21.15.28:6837","nonce":651767003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4202659808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4202659808},{"type":"v1","addr":"172.21.15.134:6834","nonce":4202659808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/931138884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":931138884},{"type":"v1","addr":"172.21.15.134:6835","nonce":931138884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:59.086495+0000","modified":"2023-12-16T03:28:02.105487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/2582425067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2582425067},{"type":"v1","addr":"172.21.15.28:6836","nonce":2582425067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-16T03:28:03.106 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 46 2023-12-16T03:28:03.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 -- 172.21.15.28:0/1998033667 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbe0066470 msgr2=0x7efbe0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbe0066470 0x7efbe0068930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efbec0ad000 tx=0x7efbec0a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:03.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 -- 172.21.15.28:0/1998033667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efbfc0c06d0 msgr2=0x7efbfc1ec740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efbfc0c06d0 0x7efbfc1ec740 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7efbf800c430 tx=0x7efbf800c830 comp rx=0 tx=0).stop 2023-12-16T03:28:03.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 -- 172.21.15.28:0/1998033667 shutdown_connections 2023-12-16T03:28:03.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efbfc0c63c0 0x7efbfc153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbfc0c4100 0x7efbfc15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbe0066470 0x7efbe0068930 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 --2- 172.21.15.28:0/1998033667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efbfc0c06d0 0x7efbfc1ec740 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 -- 172.21.15.28:0/1998033667 >> 172.21.15.28:0/1998033667 conn(0x7efbfc06a5b0 msgr2=0x7efbfc06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:03.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 -- 172.21.15.28:0/1998033667 shutdown_connections 2023-12-16T03:28:03.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.103+0000 7efc047b8640 1 -- 172.21.15.28:0/1998033667 wait complete. 2023-12-16T03:28:03.127 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:03.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.267+0000 7fbbdac9c640 1 Processor -- start 2023-12-16T03:28:03.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.267+0000 7fbbdac9c640 1 -- start start 2023-12-16T03:28:03.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.267+0000 7fbbdac9c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbbd406dfe0 0x7fbbd406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.267+0000 7fbbdac9c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd406b1e0 0x7fbbd40c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.267+0000 7fbbdac9c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd4072500 con 0x7fbbd406a5b0 2023-12-16T03:28:03.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.267+0000 7fbbdac9c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd406ef50 con 0x7fbbd406dfe0 2023-12-16T03:28:03.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.267+0000 7fbbdac9c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40720b0 con 0x7fbbd406b1e0 2023-12-16T03:28:03.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.267+0000 7fbbd8a38640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbbd406a5b0 0x7fbbd40c2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55026/0 (socket says 172.21.15.28:55026) 2023-12-16T03:28:03.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.267+0000 7fbbd8a38640 1 -- 172.21.15.28:0/1590724420 learned_addr learned my addr 172.21.15.28:0/1590724420 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:03.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd3fff640 1 --2- 172.21.15.28:0/1590724420 >> v2:172.21.15.134:3300/0 conn(0x7fbbd406dfe0 0x7fbbd406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597374292 0 0) 0x7fbbd4072500 con 0x7fbbd406a5b0 2023-12-16T03:28:03.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc4003530 con 0x7fbbd406a5b0 2023-12-16T03:28:03.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd9239640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd406b1e0 0x7fbbd40c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3390685389 0 0) 0x7fbbc4003530 con 0x7fbbd406a5b0 2023-12-16T03:28:03.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd406b1e0 msgr2=0x7fbbd40c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:03.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd406b1e0 0x7fbbd40c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 >> v2:172.21.15.134:3300/0 conn(0x7fbbd406dfe0 msgr2=0x7fbbd406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:03.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 --2- 172.21.15.28:0/1590724420 >> v2:172.21.15.134:3300/0 conn(0x7fbbd406dfe0 0x7fbbd406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd4070f60 con 0x7fbbd406a5b0 2023-12-16T03:28:03.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fbbc8001680 con 0x7fbbd406a5b0 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd9239640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd406b1e0 0x7fbbd40c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 >> v1:172.21.15.28:6789/0 conn(0x7fbbd406a5b0 legacy=0x7fbbd40c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc4003980 0x7fbbc4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd406b1e0 0x7fbbc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc4004d10 0x7fbbc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd406ef50 con 0x7fbbc4004d10 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40720b0 con 0x7fbbc4003980 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc400ba10 con 0x7fbbd406b1e0 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd9239640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc4004d10 0x7fbbc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd8a38640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc4003980 0x7fbbc4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd3fff640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd406b1e0 0x7fbbc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd9239640 1 -- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd406b1e0 msgr2=0x7fbbc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd9239640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd406b1e0 0x7fbbc40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd9239640 1 -- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc4003980 msgr2=0x7fbbc4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:03.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd9239640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc4003980 0x7fbbc4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.271+0000 7fbbd9239640 1 -- 172.21.15.28:0/1590724420 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4003530 con 0x7fbbc4004d10 2023-12-16T03:28:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbd9239640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc4004d10 0x7fbbc4005190 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0073e0 tx=0x7fbbcc01cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f498dd2aed76055 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0a5c90 con 0x7fbbc4004d10 2023-12-16T03:28:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc0a5df0 con 0x7fbbc4004d10 2023-12-16T03:28:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbd37fe640 1 -- 172.21.15.28:0/1590724420 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0ad640 con 0x7fbbc4004d10 2023-12-16T03:28:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 -- 172.21.15.28:0/1590724420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc4004d10 msgr2=0x7fbbc4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 --2- 172.21.15.28:0/1590724420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc4004d10 0x7fbbc4005190 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0073e0 tx=0x7fbbcc01cea0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbd9239640 1 -- 172.21.15.28:0/1590724420 reap_dead start 2023-12-16T03:28:03.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 -- 172.21.15.28:0/1590724420 shutdown_connections 2023-12-16T03:28:03.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 -- 172.21.15.28:0/1590724420 >> 172.21.15.28:0/1590724420 conn(0x7fbbd40c6ef0 msgr2=0x7fbbd40c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:03.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 -- 172.21.15.28:0/1590724420 shutdown_connections 2023-12-16T03:28:03.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 -- 172.21.15.28:0/1590724420 wait complete. 2023-12-16T03:28:03.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 Processor -- start 2023-12-16T03:28:03.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 -- start start 2023-12-16T03:28:03.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc4004d10 0x7fbbd40a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd40abfd0 0x7fbbd4158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd4156b70 0x7fbbd4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4147660 con 0x7fbbd40abfd0 2023-12-16T03:28:03.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40a9220 con 0x7fbbc4004d10 2023-12-16T03:28:03.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.275+0000 7fbbdac9c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd41ed650 con 0x7fbbd4156b70 2023-12-16T03:28:03.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd40abfd0 0x7fbbd4158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd40abfd0 0x7fbbd4158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57798/0 (socket says 172.21.15.28:57798) 2023-12-16T03:28:03.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd3fff640 1 -- 172.21.15.28:0/829780625 learned_addr learned my addr 172.21.15.28:0/829780625 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:03.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd8a38640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc4004d10 0x7fbbd40a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd9239640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd4156b70 0x7fbbd4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd3fff640 1 -- 172.21.15.28:0/829780625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd4156b70 msgr2=0x7fbbd4156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd3fff640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd4156b70 0x7fbbd4156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd3fff640 1 -- 172.21.15.28:0/829780625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc4004d10 msgr2=0x7fbbd40a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd3fff640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc4004d10 0x7fbbd40a8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd3fff640 1 -- 172.21.15.28:0/829780625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd41ed930 con 0x7fbbd40abfd0 2023-12-16T03:28:03.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd3fff640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd40abfd0 0x7fbbd4158520 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0011660 tx=0x7fbbc0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:03.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd17fa640 1 -- 172.21.15.28:0/829780625 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0015870 con 0x7fbbd40abfd0 2023-12-16T03:28:03.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd17fa640 1 -- 172.21.15.28:0/829780625 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc00159d0 con 0x7fbbd40abfd0 2023-12-16T03:28:03.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd17fa640 1 -- 172.21.15.28:0/829780625 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0015d40 con 0x7fbbd40abfd0 2023-12-16T03:28:03.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbdac9c640 1 -- 172.21.15.28:0/829780625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd41edc10 con 0x7fbbd40abfd0 2023-12-16T03:28:03.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbdac9c640 1 -- 172.21.15.28:0/829780625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd41ee1d0 con 0x7fbbd40abfd0 2023-12-16T03:28:03.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbdac9c640 1 -- 172.21.15.28:0/829780625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd406edc0 con 0x7fbbd40abfd0 2023-12-16T03:28:03.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd17fa640 1 -- 172.21.15.28:0/829780625 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbbc000f480 con 0x7fbbd40abfd0 2023-12-16T03:28:03.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.279+0000 7fbbd17fa640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb80664a0 0x7fbbb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.283+0000 7fbbd17fa640 1 -- 172.21.15.28:0/829780625 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbc0084200 con 0x7fbbd40abfd0 2023-12-16T03:28:03.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.283+0000 7fbbd8a38640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb80664a0 0x7fbbb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.283+0000 7fbbd8a38640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb80664a0 0x7fbbb8068960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8000c10 tx=0x7fbbc80019a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:03.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.283+0000 7fbbd17fa640 1 -- 172.21.15.28:0/829780625 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fbbc0051680 con 0x7fbbd40abfd0 2023-12-16T03:28:03.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.443+0000 7fbbdac9c640 1 -- 172.21.15.28:0/829780625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbd4068400 con 0x7fbbd40abfd0 2023-12-16T03:28:03.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.443+0000 7fbbd17fa640 1 -- 172.21.15.28:0/829780625 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16560 (secure 0 0 0) 0x7fbbc0054ca0 con 0x7fbbd40abfd0 2023-12-16T03:28:03.448 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:03.449 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":68,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:00.706254+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 -- 172.21.15.28:0/829780625 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb80664a0 msgr2=0x7fbbb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb80664a0 0x7fbbb8068960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8000c10 tx=0x7fbbc80019a0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 -- 172.21.15.28:0/829780625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd40abfd0 msgr2=0x7fbbd4158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd40abfd0 0x7fbbd4158520 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0011660 tx=0x7fbbc0011a60 comp rx=0 tx=0).stop 2023-12-16T03:28:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 -- 172.21.15.28:0/829780625 shutdown_connections 2023-12-16T03:28:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbbd4156b70 0x7fbbd4156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbb80664a0 0x7fbbb8068960 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbd40abfd0 0x7fbbd4158520 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 --2- 172.21.15.28:0/829780625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc4004d10 0x7fbbd40a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 -- 172.21.15.28:0/829780625 >> 172.21.15.28:0/829780625 conn(0x7fbbd40c6ef0 msgr2=0x7fbbd40c2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:03.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 -- 172.21.15.28:0/829780625 shutdown_connections 2023-12-16T03:28:03.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.447+0000 7fbbdac9c640 1 -- 172.21.15.28:0/829780625 wait complete. 2023-12-16T03:28:03.470 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-16T03:28:03.471 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:28:03.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f090a6dd640 1 Processor -- start 2023-12-16T03:28:03.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f090a6dd640 1 -- start start 2023-12-16T03:28:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f090a6dd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09040c63c0 0x7f09040c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f090a6dd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f09040c2bb0 0x7f09040a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f090a6dd640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09040c31c0 con 0x7f09040c4100 2023-12-16T03:28:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f090a6dd640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09040c34a0 con 0x7f09040c2bb0 2023-12-16T03:28:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f090a6dd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09040c1030 con 0x7f09040c63c0 2023-12-16T03:28:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f0908c7a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f09040c2bb0 0x7f09040a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f09037fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f09040c4100 0x7f09040c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55034/0 (socket says 172.21.15.28:55034) 2023-12-16T03:28:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f09037fe640 1 -- 172.21.15.28:0/269117876 learned_addr learned my addr 172.21.15.28:0/269117876 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:03.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f0903fff640 1 --2- 172.21.15.28:0/269117876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09040c63c0 0x7f09040c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f0908c7a640 1 -- 172.21.15.28:0/269117876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09040c63c0 msgr2=0x7f09040c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f0908c7a640 1 --2- 172.21.15.28:0/269117876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09040c63c0 0x7f09040c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f0908c7a640 1 -- 172.21.15.28:0/269117876 >> v1:172.21.15.28:6789/0 conn(0x7f09040c4100 legacy=0x7f09040c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f0908c7a640 1 -- 172.21.15.28:0/269117876 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09040c1310 con 0x7f09040c2bb0 2023-12-16T03:28:03.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.611+0000 7f0903fff640 1 --2- 172.21.15.28:0/269117876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09040c63c0 0x7f09040c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:03.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f0908c7a640 1 --2- 172.21.15.28:0/269117876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09040c2bb0 0x7f09040a9680 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009d90 tx=0x7f08fc01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf71e1c9fdaaa6b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:03.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f0902ffd640 1 -- 172.21.15.28:0/269117876 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09040aa3d0 con 0x7f09040c2bb0 2023-12-16T03:28:03.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f0902ffd640 1 -- 172.21.15.28:0/269117876 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc0a58e0 con 0x7f09040c2bb0 2023-12-16T03:28:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f0902ffd640 1 -- 172.21.15.28:0/269117876 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc0a5c70 con 0x7f09040c2bb0 2023-12-16T03:28:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f090a6dd640 1 -- 172.21.15.28:0/269117876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09040c2bb0 msgr2=0x7f09040a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f090a6dd640 1 --2- 172.21.15.28:0/269117876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09040c2bb0 0x7f09040a9680 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009d90 tx=0x7f08fc01c800 comp rx=0 tx=0).stop 2023-12-16T03:28:03.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f090a6dd640 1 -- 172.21.15.28:0/269117876 shutdown_connections 2023-12-16T03:28:03.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f090a6dd640 1 --2- 172.21.15.28:0/269117876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09040c2bb0 0x7f09040a9680 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f090a6dd640 1 --2- 172.21.15.28:0/269117876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09040c63c0 0x7f09040c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f090a6dd640 1 -- 172.21.15.28:0/269117876 >> 172.21.15.28:0/269117876 conn(0x7f090406a5b0 msgr2=0x7f090406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:03.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f090a6dd640 1 -- 172.21.15.28:0/269117876 shutdown_connections 2023-12-16T03:28:03.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.615+0000 7f090a6dd640 1 -- 172.21.15.28:0/269117876 wait complete. 2023-12-16T03:28:03.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f090a6dd640 1 Processor -- start 2023-12-16T03:28:03.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f090a6dd640 1 -- start start 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f090a6dd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09040c2bb0 0x7f090415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f090a6dd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09040c4100 0x7f090414df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f090a6dd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09040c63c0 0x7f090414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f090a6dd640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09040c5370 con 0x7f09040c2bb0 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f090a6dd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09041eeac0 con 0x7f09040c4100 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f090a6dd640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09041edd00 con 0x7f09040c63c0 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0903fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09040c2bb0 0x7f090415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0903fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09040c2bb0 0x7f090415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57822/0 (socket says 172.21.15.28:57822) 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0903fff640 1 -- 172.21.15.28:0/1343028533 learned_addr learned my addr 172.21.15.28:0/1343028533 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0908c7a640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09040c63c0 0x7f090414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f09037fe640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09040c4100 0x7f090414df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0903fff640 1 -- 172.21.15.28:0/1343028533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09040c63c0 msgr2=0x7f090414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0903fff640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09040c63c0 0x7f090414e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0903fff640 1 -- 172.21.15.28:0/1343028533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09040c4100 msgr2=0x7f090414df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0903fff640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09040c4100 0x7f090414df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0903fff640 1 -- 172.21.15.28:0/1343028533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc009a70 con 0x7f09040c2bb0 2023-12-16T03:28:03.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0903fff640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09040c2bb0 0x7f090415a1f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f08f400d830 tx=0x7f08f400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:03.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0900ff9640 1 -- 172.21.15.28:0/1343028533 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40096c0 con 0x7f09040c2bb0 2023-12-16T03:28:03.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0900ff9640 1 -- 172.21.15.28:0/1343028533 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f4009820 con 0x7f09040c2bb0 2023-12-16T03:28:03.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f0900ff9640 1 -- 172.21.15.28:0/1343028533 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4009bd0 con 0x7f09040c2bb0 2023-12-16T03:28:03.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.619+0000 7f090a6dd640 1 -- 172.21.15.28:0/1343028533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09041edfe0 con 0x7f09040c2bb0 2023-12-16T03:28:03.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.623+0000 7f090a6dd640 1 -- 172.21.15.28:0/1343028533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09041ee5a0 con 0x7f09040c2bb0 2023-12-16T03:28:03.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.623+0000 7f090a6dd640 1 -- 172.21.15.28:0/1343028533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0904068400 con 0x7f09040c2bb0 2023-12-16T03:28:03.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.623+0000 7f0900ff9640 1 -- 172.21.15.28:0/1343028533 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f08f4014410 con 0x7f09040c2bb0 2023-12-16T03:28:03.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.623+0000 7f0900ff9640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08f0066470 0x7f08f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:03.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.623+0000 7f0900ff9640 1 -- 172.21.15.28:0/1343028533 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08f40846f0 con 0x7f09040c2bb0 2023-12-16T03:28:03.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.623+0000 7f09037fe640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08f0066470 0x7f08f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:03.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.623+0000 7f09037fe640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08f0066470 0x7f08f0068930 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f09040bc270 tx=0x7f08f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:03.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.627+0000 7f0900ff9640 1 -- 172.21.15.28:0/1343028533 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f08f4051b80 con 0x7f09040c2bb0 2023-12-16T03:28:03.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.783+0000 7f090a6dd640 1 -- 172.21.15.28:0/1343028533 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09040c3e70 con 0x7f08f0066470 2023-12-16T03:28:03.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.791+0000 7f0900ff9640 1 -- 172.21.15.28:0/1343028533 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277713 (secure 0 0 0) 0x7f09040c3e70 con 0x7f08f0066470 2023-12-16T03:28:03.798 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:03.800 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:28:03.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 -- 172.21.15.28:0/1343028533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08f0066470 msgr2=0x7f08f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08f0066470 0x7f08f0068930 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f09040bc270 tx=0x7f08f8009040 comp rx=0 tx=0).stop 2023-12-16T03:28:03.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 -- 172.21.15.28:0/1343028533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09040c2bb0 msgr2=0x7f090415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:03.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09040c2bb0 0x7f090415a1f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f08f400d830 tx=0x7f08f400dcf0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 -- 172.21.15.28:0/1343028533 shutdown_connections 2023-12-16T03:28:03.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09040c63c0 0x7f090414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09040c4100 0x7f090414df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f08f0066470 0x7f08f0068930 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 --2- 172.21.15.28:0/1343028533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09040c2bb0 0x7f090415a1f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:03.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 -- 172.21.15.28:0/1343028533 >> 172.21.15.28:0/1343028533 conn(0x7f090406a5b0 msgr2=0x7f09040aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:03.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 -- 172.21.15.28:0/1343028533 shutdown_connections 2023-12-16T03:28:03.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.795+0000 7f090a6dd640 1 -- 172.21.15.28:0/1343028533 wait complete. 2023-12-16T03:28:03.818 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-12-16T03:28:01.831128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244272,"kb_used_data":7292,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730448,"statfs":{"total":773094113280,"available":772843978752,"internally_reserved":0,"allocated":7467008,"data_stored":3888463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.147404"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.693360+0000","last_change":"2023-12-16T03:27:57.693360+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.693360+0000","last_undegraded":"2023-12-16T03:27:57.693360+0000","last_fullsized":"2023-12-16T03:27:57.693360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.687955+0000","last_change":"2023-12-16T03:27:57.687955+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.687955+0000","last_undegraded":"2023-12-16T03:27:57.687955+0000","last_fullsized":"2023-12-16T03:27:57.687955+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688366+0000","last_change":"2023-12-16T03:27:57.688366+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688366+0000","last_undegraded":"2023-12-16T03:27:57.688366+0000","last_fullsized":"2023-12-16T03:27:57.688366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688882+0000","last_change":"2023-12-16T03:27:57.688882+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688882+0000","last_undegraded":"2023-12-16T03:27:57.688882+0000","last_fullsized":"2023-12-16T03:27:57.688882+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.687916+0000","last_change":"2023-12-16T03:27:57.687916+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.687916+0000","last_undegraded":"2023-12-16T03:27:57.687916+0000","last_fullsized":"2023-12-16T03:27:57.687916+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688914+0000","last_change":"2023-12-16T03:27:57.688914+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688914+0000","last_undegraded":"2023-12-16T03:27:57.688914+0000","last_fullsized":"2023-12-16T03:27:57.688914+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688349+0000","last_change":"2023-12-16T03:27:57.688349+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688349+0000","last_undegraded":"2023-12-16T03:27:57.688349+0000","last_fullsized":"2023-12-16T03:27:57.688349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.694514+0000","last_change":"2023-12-16T03:27:57.694514+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.694514+0000","last_undegraded":"2023-12-16T03:27:57.694514+0000","last_fullsized":"2023-12-16T03:27:57.694514+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.692806+0000","last_change":"2023-12-16T03:27:57.692806+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.692806+0000","last_undegraded":"2023-12-16T03:27:57.692806+0000","last_fullsized":"2023-12-16T03:27:57.692806+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.692108+0000","last_change":"2023-12-16T03:27:57.692108+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.692108+0000","last_undegraded":"2023-12-16T03:27:57.692108+0000","last_fullsized":"2023-12-16T03:27:57.692108+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.692751+0000","last_change":"2023-12-16T03:27:57.692751+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.692751+0000","last_undegraded":"2023-12-16T03:27:57.692751+0000","last_fullsized":"2023-12-16T03:27:57.692751+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688178+0000","last_change":"2023-12-16T03:27:57.688178+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688178+0000","last_undegraded":"2023-12-16T03:27:57.688178+0000","last_fullsized":"2023-12-16T03:27:57.688178+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.693224+0000","last_change":"2023-12-16T03:27:57.693224+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.693224+0000","last_undegraded":"2023-12-16T03:27:57.693224+0000","last_fullsized":"2023-12-16T03:27:57.693224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.693754+0000","last_change":"2023-12-16T03:27:57.693754+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.693754+0000","last_undegraded":"2023-12-16T03:27:57.693754+0000","last_fullsized":"2023-12-16T03:27:57.693754+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688779+0000","last_change":"2023-12-16T03:27:57.688779+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688779+0000","last_undegraded":"2023-12-16T03:27:57.688779+0000","last_fullsized":"2023-12-16T03:27:57.688779+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688245+0000","last_change":"2023-12-16T03:27:57.688245+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688245+0000","last_undegraded":"2023-12-16T03:27:57.688245+0000","last_fullsized":"2023-12-16T03:27:57.688245+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.692151+0000","last_change":"2023-12-16T03:27:57.692151+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.692151+0000","last_undegraded":"2023-12-16T03:27:57.692151+0000","last_fullsized":"2023-12-16T03:27:57.692151+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688288+0000","last_change":"2023-12-16T03:27:57.688288+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688288+0000","last_undegraded":"2023-12-16T03:27:57.688288+0000","last_fullsized":"2023-12-16T03:27:57.688288+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688311+0000","last_change":"2023-12-16T03:27:57.688311+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688311+0000","last_undegraded":"2023-12-16T03:27:57.688311+0000","last_fullsized":"2023-12-16T03:27:57.688311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.694536+0000","last_change":"2023-12-16T03:27:57.694536+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.694536+0000","last_undegraded":"2023-12-16T03:27:57.694536+0000","last_fullsized":"2023-12-16T03:27:57.694536+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.691447+0000","last_change":"2023-12-16T03:27:57.691447+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.691447+0000","last_undegraded":"2023-12-16T03:27:57.691447+0000","last_fullsized":"2023-12-16T03:27:57.691447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.691309+0000","last_change":"2023-12-16T03:27:57.691309+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.691309+0000","last_undegraded":"2023-12-16T03:27:57.691309+0000","last_fullsized":"2023-12-16T03:27:57.691309+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.693386+0000","last_change":"2023-12-16T03:27:57.693386+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.693386+0000","last_undegraded":"2023-12-16T03:27:57.693386+0000","last_fullsized":"2023-12-16T03:27:57.693386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.693465+0000","last_change":"2023-12-16T03:27:57.693465+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.693465+0000","last_undegraded":"2023-12-16T03:27:57.693465+0000","last_fullsized":"2023-12-16T03:27:57.693465+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.693160+0000","last_change":"2023-12-16T03:27:57.693160+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.693160+0000","last_undegraded":"2023-12-16T03:27:57.693160+0000","last_fullsized":"2023-12-16T03:27:57.693160+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.692163+0000","last_change":"2023-12-16T03:27:57.692163+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.692163+0000","last_undegraded":"2023-12-16T03:27:57.692163+0000","last_fullsized":"2023-12-16T03:27:57.692163+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.691707+0000","last_change":"2023-12-16T03:27:57.691707+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.691707+0000","last_undegraded":"2023-12-16T03:27:57.691707+0000","last_fullsized":"2023-12-16T03:27:57.691707+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688218+0000","last_change":"2023-12-16T03:27:57.688218+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688218+0000","last_undegraded":"2023-12-16T03:27:57.688218+0000","last_fullsized":"2023-12-16T03:27:57.688218+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688365+0000","last_change":"2023-12-16T03:27:57.688365+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688365+0000","last_undegraded":"2023-12-16T03:27:57.688365+0000","last_fullsized":"2023-12-16T03:27:57.688365+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.691692+0000","last_change":"2023-12-16T03:27:57.691692+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.691692+0000","last_undegraded":"2023-12-16T03:27:57.691692+0000","last_fullsized":"2023-12-16T03:27:57.691692+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.688570+0000","last_change":"2023-12-16T03:27:57.688570+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.688570+0000","last_undegraded":"2023-12-16T03:27:57.688570+0000","last_fullsized":"2023-12-16T03:27:57.688570+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-16T03:27:58.683428+0000","last_change":"2023-12-16T03:27:58.683428+0000","last_active":"2023-12-16T03:27:58.683428+0000","last_peered":"2023-12-16T03:27:58.683428+0000","last_clean":"2023-12-16T03:27:58.683428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:58.683428+0000","last_undegraded":"2023-12-16T03:27:58.683428+0000","last_fullsized":"2023-12-16T03:27:58.683428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-12-16T03:27:57.691012+0000","last_change":"2023-12-16T03:27:57.691012+0000","last_active":"2023-12-16T03:27:57.675038+0000","last_peered":"2023-12-16T03:27:57.675038+0000","last_clean":"2023-12-16T03:27:57.675038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-16T03:27:57.691012+0000","last_undegraded":"2023-12-16T03:27:57.691012+0000","last_fullsized":"2023-12-16T03:27:57.691012+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-16T03:27:57.336004+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:27:57.336004+0000","last_peered":"2023-12-16T03:27:57.336004+0000","last_clean":"2023-12-16T03:27:57.336004+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:27:57.336004+0000","last_undegraded":"2023-12-16T03:27:57.336004+0000","last_fullsized":"2023-12-16T03:27:57.336004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1368064,"data_stored":924409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":1.155,"15min":1.155},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90700000000000003,"5min":1.585,"15min":1.585},"last":0.73799999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88200000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.81299999999999994,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85099999999999998,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77300000000000002,"15min":0.79100000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.79600000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92700000000000005,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.90000000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96299999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94399999999999995,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.93999999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81899999999999995,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.5},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.874,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.68500000000000005}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.004,"15min":1.004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.89300000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":339098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.437,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93400000000000005,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93799999999999994,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.82999999999999996}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82899999999999996,"15min":0.85499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95399999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":1.02,"15min":1.075},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96299999999999997,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.59099999999999997}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.98099999999999998,"15min":1.0289999999999999},"min":{"1min":0.51200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.042,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.069,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":1.131}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.87,"15min":0.89700000000000002},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":4.242,"15min":4.242},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.90300000000000002,"15min":0.93500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92600000000000005,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.95799999999999996}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88100000000000001,"5min":1.111,"15min":1.111},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.52300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":1.073,"15min":1.073},"last":0.746}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.075},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.077,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.70299999999999996}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.99099999999999999,"5min":1.246,"15min":1.246},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":339098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.60999999999999999},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.751}]},{"osd":1,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1,"15min":1},"last":0.65100000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.71399999999999997}]},{"osd":3,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.622},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.77700000000000002}]},{"osd":4,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74399999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.755,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64000000000000001,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73599999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.73099999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.82399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.89100000000000001,"5min":1.105,"15min":1.105},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":339098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.78200000000000003,"15min":0.81000000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":4.194,"15min":4.194},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.70399999999999996}]},{"osd":2,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85299999999999998,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.60599999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.91500000000000004,"5min":1.288,"15min":1.288},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.93500000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84399999999999997,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.92500000000000004,"15min":0.96199999999999997},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86099999999999999,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.629}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.92800000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.751,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.44600000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96499999999999997,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88600000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88900000000000001,"5min":1.881,"15min":1.881},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.81999999999999995,"15min":0.83999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.746}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.747,"15min":0.80400000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67700000000000005,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.80900000000000005,"15min":0.871},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.39000000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.66700000000000004,"15min":0.70499999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63500000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.316},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.66300000000000003,"15min":0.68400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.72999999999999998,"15min":0.76500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94999999999999996,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.048,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.89400000000000002,"15min":0.92200000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.89500000000000002,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.84799999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.86899999999999999,"15min":0.89100000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.006,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.92500000000000004,"15min":0.95299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97499999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.82999999999999996}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.93400000000000005,"15min":0.96399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94499999999999995,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.95299999999999996,"15min":0.97999999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0609999999999999,"5min":3.375,"15min":3.375},"last":0.871}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48399999999999999,"15min":0.48499999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.875,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.55700000000000005}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.38},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.503,"15min":0.498},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.80000000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.621},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.022},"last":0.59299999999999997}]},{"osd":4,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77200000000000002,"15min":0.77700000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1060000000000001,"5min":1.587,"15min":1.587},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0609999999999999,"5min":1.913,"15min":1.913},"last":0.69299999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.97599999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.179,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.04,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.86399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":339098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.60999999999999999,"15min":0.64200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97199999999999998,"5min":4.476,"15min":4.476},"last":0.48799999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.80800000000000005,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73899999999999999,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.749,"15min":0.79300000000000004},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.70299999999999996,"15min":0.73399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.66700000000000004,"15min":0.70099999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.03,"15min":1.0820000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0840000000000001,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.93799999999999994,"15min":0.97199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.133,"5min":4.984,"15min":4.984},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.90200000000000002,"15min":0.93999999999999995},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.996,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.745,"5min":1.089,"15min":1.147},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0209999999999999,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.78700000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.95199999999999996,"15min":0.98899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0880000000000001,"15min":1.147},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95299999999999996,"5min":7.681,"15min":7.681},"last":0.73899999999999999}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":1.0369999999999999,"15min":1.077},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.177,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.995,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.98199999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.58899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1380352,"data_stored":929466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.751,"15min":0.80900000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68200000000000005,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.433},{"interface":"front","average":{"1min":0.495,"5min":0.89300000000000002,"15min":0.95899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70699999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.93000000000000005,"15min":0.999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.028,"15min":1.1100000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82199999999999995,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.41099999999999998}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.92800000000000005,"15min":1.0109999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57399999999999995,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.78100000000000003,"15min":0.82599999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":3.254,"15min":3.254},"last":0.38}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95099999999999996,"15min":0.98599999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.60599999999999998}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.0900000000000001,"15min":1.151},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.98499999999999999,"15min":1.036},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97499999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97899999999999998,"15min":1.0249999999999999},"min":{"1min":0.54700000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.171,"15min":1.2450000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94399999999999995,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":1.181,"15min":1.2490000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95899999999999996,"5min":4.444,"15min":4.444},"last":0.626},{"interface":"front","average":{"1min":0.77000000000000002,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0109999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:28:03.824 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:28:04.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f60a10fe640 1 Processor -- start 2023-12-16T03:28:04.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f60a10fe640 1 -- start start 2023-12-16T03:28:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f60a10fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f609c151e90 0x7f609c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f60a10fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f609c0c4e60 0x7f609c06bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f60a10fe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c06c860 con 0x7f609c0c7ea0 2023-12-16T03:28:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f60a10fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c0c8750 con 0x7f609c151e90 2023-12-16T03:28:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f60a10fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1552d0 con 0x7f609c0c4e60 2023-12-16T03:28:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f609b59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f609c0c4e60 0x7f609c06bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f609ad9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f609c151e90 0x7f609c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f609ad9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f609c151e90 0x7f609c0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:36724/0 (socket says 172.21.15.28:36724) 2023-12-16T03:28:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f609ad9d640 1 -- 172.21.15.28:0/1397941311 learned_addr learned my addr 172.21.15.28:0/1397941311 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f609b59e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f609c0c4e60 0x7f609c06bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:36942/0 (socket says 172.21.15.28:36942) 2023-12-16T03:28:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:03.999+0000 7f6093fff640 1 --1- 172.21.15.28:0/1397941311 >> v1:172.21.15.134:6789/0 conn(0x7f609c0c7ea0 0x7f609c06b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:42912/0 (socket says 172.21.15.28:42912) 2023-12-16T03:28:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.003+0000 7f609ad9d640 1 -- 172.21.15.28:0/1397941311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f609c0c4e60 msgr2=0x7f609c06bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.003+0000 7f609ad9d640 1 --2- 172.21.15.28:0/1397941311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f609c0c4e60 0x7f609c06bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.003+0000 7f609ad9d640 1 -- 172.21.15.28:0/1397941311 >> v1:172.21.15.134:6789/0 conn(0x7f609c0c7ea0 legacy=0x7f609c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.003+0000 7f609ad9d640 1 -- 172.21.15.28:0/1397941311 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c154930 con 0x7f609c151e90 2023-12-16T03:28:04.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.003+0000 7f609ad9d640 1 --2- 172.21.15.28:0/1397941311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c151e90 0x7f609c0c4920 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f608c009870 tx=0x7f608c01c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d7af9153302c314 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.003+0000 7f609a59c640 1 -- 172.21.15.28:0/1397941311 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0ab600 con 0x7f609c151e90 2023-12-16T03:28:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.003+0000 7f609a59c640 1 -- 172.21.15.28:0/1397941311 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c0a7050 con 0x7f609c151e90 2023-12-16T03:28:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.003+0000 7f609a59c640 1 -- 172.21.15.28:0/1397941311 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0ab980 con 0x7f609c151e90 2023-12-16T03:28:04.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.003+0000 7f60a10fe640 1 -- 172.21.15.28:0/1397941311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c151e90 msgr2=0x7f609c0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.003+0000 7f60a10fe640 1 --2- 172.21.15.28:0/1397941311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c151e90 0x7f609c0c4920 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f608c009870 tx=0x7f608c01c420 comp rx=0 tx=0).stop 2023-12-16T03:28:04.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 -- 172.21.15.28:0/1397941311 shutdown_connections 2023-12-16T03:28:04.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 --2- 172.21.15.28:0/1397941311 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f609c0c4e60 0x7f609c06bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 --2- 172.21.15.28:0/1397941311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c151e90 0x7f609c0c4920 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 -- 172.21.15.28:0/1397941311 >> 172.21.15.28:0/1397941311 conn(0x7f609c0ca170 msgr2=0x7f609c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:04.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 -- 172.21.15.28:0/1397941311 shutdown_connections 2023-12-16T03:28:04.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 -- 172.21.15.28:0/1397941311 wait complete. 2023-12-16T03:28:04.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 Processor -- start 2023-12-16T03:28:04.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 -- start start 2023-12-16T03:28:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f609c0c4e60 0x7f609c0aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c0c7ea0 0x7f609c0ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f609c151e90 0x7f609c14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1587f0 con 0x7f609c0c4e60 2023-12-16T03:28:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0ac6a0 con 0x7f609c0c7ea0 2023-12-16T03:28:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f60a10fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0a9b40 con 0x7f609c151e90 2023-12-16T03:28:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f609ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f609c0c4e60 0x7f609c0aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f609ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f609c0c4e60 0x7f609c0aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57832/0 (socket says 172.21.15.28:57832) 2023-12-16T03:28:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f609ad9d640 1 -- 172.21.15.28:0/2473576737 learned_addr learned my addr 172.21.15.28:0/2473576737 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f609b59e640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f609c151e90 0x7f609c14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f6093fff640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c0c7ea0 0x7f609c0ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f609ad9d640 1 -- 172.21.15.28:0/2473576737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f609c151e90 msgr2=0x7f609c14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f609ad9d640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f609c151e90 0x7f609c14b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f609ad9d640 1 -- 172.21.15.28:0/2473576737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c0c7ea0 msgr2=0x7f609c0ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f609ad9d640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c0c7ea0 0x7f609c0ac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f609ad9d640 1 -- 172.21.15.28:0/2473576737 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0094d0 con 0x7f609c0c4e60 2023-12-16T03:28:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.007+0000 7f609ad9d640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f609c0c4e60 0x7f609c0aa900 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f608c0ae040 tx=0x7f608c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.011+0000 7f60937fe640 1 -- 172.21.15.28:0/2473576737 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0b6420 con 0x7f609c0c4e60 2023-12-16T03:28:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.011+0000 7f60937fe640 1 -- 172.21.15.28:0/2473576737 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c0b6580 con 0x7f609c0c4e60 2023-12-16T03:28:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.011+0000 7f60937fe640 1 -- 172.21.15.28:0/2473576737 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0b6930 con 0x7f609c0c4e60 2023-12-16T03:28:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.011+0000 7f60a10fe640 1 -- 172.21.15.28:0/2473576737 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c0a9e20 con 0x7f609c0c4e60 2023-12-16T03:28:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.011+0000 7f60a10fe640 1 -- 172.21.15.28:0/2473576737 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c0aa3e0 con 0x7f609c0c4e60 2023-12-16T03:28:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.011+0000 7f60a10fe640 1 -- 172.21.15.28:0/2473576737 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c068400 con 0x7f609c0c4e60 2023-12-16T03:28:04.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.011+0000 7f60937fe640 1 -- 172.21.15.28:0/2473576737 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f608c0b2040 con 0x7f609c0c4e60 2023-12-16T03:28:04.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.011+0000 7f60937fe640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f607c066470 0x7f607c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.011+0000 7f60937fe640 1 -- 172.21.15.28:0/2473576737 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f608c11e1a0 con 0x7f609c0c4e60 2023-12-16T03:28:04.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.011+0000 7f6093fff640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f607c066470 0x7f607c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.015+0000 7f6093fff640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f607c066470 0x7f607c068930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f609c0c5830 tx=0x7f6084007e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:04.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.015+0000 7f60937fe640 1 -- 172.21.15.28:0/2473576737 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f608c0eb6d0 con 0x7f609c0c4e60 2023-12-16T03:28:04.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.171+0000 7f60a10fe640 1 -- 172.21.15.28:0/2473576737 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f609c0c5a60 con 0x7f607c066470 2023-12-16T03:28:04.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.179+0000 7f60937fe640 1 -- 172.21.15.28:0/2473576737 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289600 (secure 0 0 0) 0x7f609c0c5a60 con 0x7f607c066470 2023-12-16T03:28:04.185 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:04.187 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:28:04.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 -- 172.21.15.28:0/2473576737 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f607c066470 msgr2=0x7f607c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f607c066470 0x7f607c068930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f609c0c5830 tx=0x7f6084007e50 comp rx=0 tx=0).stop 2023-12-16T03:28:04.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 -- 172.21.15.28:0/2473576737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f609c0c4e60 msgr2=0x7f609c0aa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f609c0c4e60 0x7f609c0aa900 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f608c0ae040 tx=0x7f608c01ac60 comp rx=0 tx=0).stop 2023-12-16T03:28:04.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 -- 172.21.15.28:0/2473576737 shutdown_connections 2023-12-16T03:28:04.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f609c151e90 0x7f609c14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f609c0c7ea0 0x7f609c0ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f607c066470 0x7f607c068930 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 --2- 172.21.15.28:0/2473576737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f609c0c4e60 0x7f609c0aa900 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 -- 172.21.15.28:0/2473576737 >> 172.21.15.28:0/2473576737 conn(0x7f609c0ca170 msgr2=0x7f609c15e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:04.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 -- 172.21.15.28:0/2473576737 shutdown_connections 2023-12-16T03:28:04.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.183+0000 7f60a10fe640 1 -- 172.21.15.28:0/2473576737 wait complete. 2023-12-16T03:28:04.205 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2023-12-16T03:28:03.831613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257224,"kb_used_data":7752,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717496,"statfs":{"total":773094113280,"available":772830715904,"internally_reserved":0,"allocated":7938048,"data_stored":4099676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001091"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861292+0000","last_change":"2023-12-16T03:27:59.729049+0000","last_active":"2023-12-16T03:28:01.861292+0000","last_peered":"2023-12-16T03:28:01.861292+0000","last_clean":"2023-12-16T03:28:01.861292+0000","last_became_active":"2023-12-16T03:27:59.728714+0000","last_became_peered":"2023-12-16T03:27:59.728714+0000","last_unstale":"2023-12-16T03:28:01.861292+0000","last_undegraded":"2023-12-16T03:28:01.861292+0000","last_fullsized":"2023-12-16T03:28:01.861292+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:38.945695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861765+0000","last_change":"2023-12-16T03:27:59.722443+0000","last_active":"2023-12-16T03:28:01.861765+0000","last_peered":"2023-12-16T03:28:01.861765+0000","last_clean":"2023-12-16T03:28:01.861765+0000","last_became_active":"2023-12-16T03:27:59.722119+0000","last_became_peered":"2023-12-16T03:27:59.722119+0000","last_unstale":"2023-12-16T03:28:01.861765+0000","last_undegraded":"2023-12-16T03:28:01.861765+0000","last_fullsized":"2023-12-16T03:28:01.861765+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:26:08.675666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861255+0000","last_change":"2023-12-16T03:27:59.719770+0000","last_active":"2023-12-16T03:28:01.861255+0000","last_peered":"2023-12-16T03:28:01.861255+0000","last_clean":"2023-12-16T03:28:01.861255+0000","last_became_active":"2023-12-16T03:27:59.719384+0000","last_became_peered":"2023-12-16T03:27:59.719384+0000","last_unstale":"2023-12-16T03:28:01.861255+0000","last_undegraded":"2023-12-16T03:28:01.861255+0000","last_fullsized":"2023-12-16T03:28:01.861255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:47:50.256780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714277+0000","last_change":"2023-12-16T03:27:59.740570+0000","last_active":"2023-12-16T03:28:00.714277+0000","last_peered":"2023-12-16T03:28:00.714277+0000","last_clean":"2023-12-16T03:28:00.714277+0000","last_became_active":"2023-12-16T03:27:59.740240+0000","last_became_peered":"2023-12-16T03:27:59.740240+0000","last_unstale":"2023-12-16T03:28:00.714277+0000","last_undegraded":"2023-12-16T03:28:00.714277+0000","last_fullsized":"2023-12-16T03:28:00.714277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:10:51.762407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714574+0000","last_change":"2023-12-16T03:27:59.711730+0000","last_active":"2023-12-16T03:28:00.714574+0000","last_peered":"2023-12-16T03:28:00.714574+0000","last_clean":"2023-12-16T03:28:00.714574+0000","last_became_active":"2023-12-16T03:27:59.711388+0000","last_became_peered":"2023-12-16T03:27:59.711388+0000","last_unstale":"2023-12-16T03:28:00.714574+0000","last_undegraded":"2023-12-16T03:28:00.714574+0000","last_fullsized":"2023-12-16T03:28:00.714574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:40.409035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.713753+0000","last_change":"2023-12-16T03:27:59.733239+0000","last_active":"2023-12-16T03:28:00.713753+0000","last_peered":"2023-12-16T03:28:00.713753+0000","last_clean":"2023-12-16T03:28:00.713753+0000","last_became_active":"2023-12-16T03:27:59.732722+0000","last_became_peered":"2023-12-16T03:27:59.732722+0000","last_unstale":"2023-12-16T03:28:00.713753+0000","last_undegraded":"2023-12-16T03:28:00.713753+0000","last_fullsized":"2023-12-16T03:28:00.713753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:57.134718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714107+0000","last_change":"2023-12-16T03:27:59.728242+0000","last_active":"2023-12-16T03:28:00.714107+0000","last_peered":"2023-12-16T03:28:00.714107+0000","last_clean":"2023-12-16T03:28:00.714107+0000","last_became_active":"2023-12-16T03:27:59.726176+0000","last_became_peered":"2023-12-16T03:27:59.726176+0000","last_unstale":"2023-12-16T03:28:00.714107+0000","last_undegraded":"2023-12-16T03:28:00.714107+0000","last_fullsized":"2023-12-16T03:28:00.714107+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:39:51.551442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.713586+0000","last_change":"2023-12-16T03:27:59.710966+0000","last_active":"2023-12-16T03:28:00.713586+0000","last_peered":"2023-12-16T03:28:00.713586+0000","last_clean":"2023-12-16T03:28:00.713586+0000","last_became_active":"2023-12-16T03:27:59.710627+0000","last_became_peered":"2023-12-16T03:27:59.710627+0000","last_unstale":"2023-12-16T03:28:00.713586+0000","last_undegraded":"2023-12-16T03:28:00.713586+0000","last_fullsized":"2023-12-16T03:28:00.713586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:19:42.795934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714171+0000","last_change":"2023-12-16T03:27:59.723118+0000","last_active":"2023-12-16T03:28:00.714171+0000","last_peered":"2023-12-16T03:28:00.714171+0000","last_clean":"2023-12-16T03:28:00.714171+0000","last_became_active":"2023-12-16T03:27:59.722803+0000","last_became_peered":"2023-12-16T03:27:59.722803+0000","last_unstale":"2023-12-16T03:28:00.714171+0000","last_undegraded":"2023-12-16T03:28:00.714171+0000","last_fullsized":"2023-12-16T03:28:00.714171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:06.347016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861388+0000","last_change":"2023-12-16T03:27:59.724226+0000","last_active":"2023-12-16T03:28:01.861388+0000","last_peered":"2023-12-16T03:28:01.861388+0000","last_clean":"2023-12-16T03:28:01.861388+0000","last_became_active":"2023-12-16T03:27:59.723929+0000","last_became_peered":"2023-12-16T03:27:59.723929+0000","last_unstale":"2023-12-16T03:28:01.861388+0000","last_undegraded":"2023-12-16T03:28:01.861388+0000","last_fullsized":"2023-12-16T03:28:01.861388+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:48:36.777385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861649+0000","last_change":"2023-12-16T03:27:59.710177+0000","last_active":"2023-12-16T03:28:01.861649+0000","last_peered":"2023-12-16T03:28:01.861649+0000","last_clean":"2023-12-16T03:28:01.861649+0000","last_became_active":"2023-12-16T03:27:59.709870+0000","last_became_peered":"2023-12-16T03:27:59.709870+0000","last_unstale":"2023-12-16T03:28:01.861649+0000","last_undegraded":"2023-12-16T03:28:01.861649+0000","last_fullsized":"2023-12-16T03:28:01.861649+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:26:43.167751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.860841+0000","last_change":"2023-12-16T03:27:59.726745+0000","last_active":"2023-12-16T03:28:01.860841+0000","last_peered":"2023-12-16T03:28:01.860841+0000","last_clean":"2023-12-16T03:28:01.860841+0000","last_became_active":"2023-12-16T03:27:59.725932+0000","last_became_peered":"2023-12-16T03:27:59.725932+0000","last_unstale":"2023-12-16T03:28:01.860841+0000","last_undegraded":"2023-12-16T03:28:01.860841+0000","last_fullsized":"2023-12-16T03:28:01.860841+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:20:58.921708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861448+0000","last_change":"2023-12-16T03:27:59.706154+0000","last_active":"2023-12-16T03:28:01.861448+0000","last_peered":"2023-12-16T03:28:01.861448+0000","last_clean":"2023-12-16T03:28:01.861448+0000","last_became_active":"2023-12-16T03:27:59.704791+0000","last_became_peered":"2023-12-16T03:27:59.704791+0000","last_unstale":"2023-12-16T03:28:01.861448+0000","last_undegraded":"2023-12-16T03:28:01.861448+0000","last_fullsized":"2023-12-16T03:28:01.861448+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:48:36.777385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714626+0000","last_change":"2023-12-16T03:27:59.740901+0000","last_active":"2023-12-16T03:28:00.714626+0000","last_peered":"2023-12-16T03:28:00.714626+0000","last_clean":"2023-12-16T03:28:00.714626+0000","last_became_active":"2023-12-16T03:27:59.740547+0000","last_became_peered":"2023-12-16T03:27:59.740547+0000","last_unstale":"2023-12-16T03:28:00.714626+0000","last_undegraded":"2023-12-16T03:28:00.714626+0000","last_fullsized":"2023-12-16T03:28:00.714626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:58.754019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.736583+0000","last_change":"2023-12-16T03:27:59.718827+0000","last_active":"2023-12-16T03:28:00.736583+0000","last_peered":"2023-12-16T03:28:00.736583+0000","last_clean":"2023-12-16T03:28:00.736583+0000","last_became_active":"2023-12-16T03:27:59.718127+0000","last_became_peered":"2023-12-16T03:27:59.718127+0000","last_unstale":"2023-12-16T03:28:00.736583+0000","last_undegraded":"2023-12-16T03:28:00.736583+0000","last_fullsized":"2023-12-16T03:28:00.736583+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:55.561580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.713373+0000","last_change":"2023-12-16T03:27:59.725235+0000","last_active":"2023-12-16T03:28:00.713373+0000","last_peered":"2023-12-16T03:28:00.713373+0000","last_clean":"2023-12-16T03:28:00.713373+0000","last_became_active":"2023-12-16T03:27:59.720567+0000","last_became_peered":"2023-12-16T03:27:59.720567+0000","last_unstale":"2023-12-16T03:28:00.713373+0000","last_undegraded":"2023-12-16T03:28:00.713373+0000","last_fullsized":"2023-12-16T03:28:00.713373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:57.134718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714196+0000","last_change":"2023-12-16T03:27:59.733876+0000","last_active":"2023-12-16T03:28:00.714196+0000","last_peered":"2023-12-16T03:28:00.714196+0000","last_clean":"2023-12-16T03:28:00.714196+0000","last_became_active":"2023-12-16T03:27:59.733338+0000","last_became_peered":"2023-12-16T03:27:59.733338+0000","last_unstale":"2023-12-16T03:28:00.714196+0000","last_undegraded":"2023-12-16T03:28:00.714196+0000","last_fullsized":"2023-12-16T03:28:00.714196+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:06.347016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714567+0000","last_change":"2023-12-16T03:27:59.737553+0000","last_active":"2023-12-16T03:28:00.714567+0000","last_peered":"2023-12-16T03:28:00.714567+0000","last_clean":"2023-12-16T03:28:00.714567+0000","last_became_active":"2023-12-16T03:27:59.737272+0000","last_became_peered":"2023-12-16T03:27:59.737272+0000","last_unstale":"2023-12-16T03:28:00.714567+0000","last_undegraded":"2023-12-16T03:28:00.714567+0000","last_fullsized":"2023-12-16T03:28:00.714567+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:51.828325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.862353+0000","last_change":"2023-12-16T03:27:59.730293+0000","last_active":"2023-12-16T03:28:01.862353+0000","last_peered":"2023-12-16T03:28:01.862353+0000","last_clean":"2023-12-16T03:28:01.862353+0000","last_became_active":"2023-12-16T03:27:59.725734+0000","last_became_peered":"2023-12-16T03:27:59.725734+0000","last_unstale":"2023-12-16T03:28:01.862353+0000","last_undegraded":"2023-12-16T03:28:01.862353+0000","last_fullsized":"2023-12-16T03:28:01.862353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:45.169228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714326+0000","last_change":"2023-12-16T03:27:59.736580+0000","last_active":"2023-12-16T03:28:00.714326+0000","last_peered":"2023-12-16T03:28:00.714326+0000","last_clean":"2023-12-16T03:28:00.714326+0000","last_became_active":"2023-12-16T03:27:59.736291+0000","last_became_peered":"2023-12-16T03:27:59.736291+0000","last_unstale":"2023-12-16T03:28:00.714326+0000","last_undegraded":"2023-12-16T03:28:00.714326+0000","last_fullsized":"2023-12-16T03:28:00.714326+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:46.410977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714359+0000","last_change":"2023-12-16T03:27:59.738532+0000","last_active":"2023-12-16T03:28:00.714359+0000","last_peered":"2023-12-16T03:28:00.714359+0000","last_clean":"2023-12-16T03:28:00.714359+0000","last_became_active":"2023-12-16T03:27:59.735740+0000","last_became_peered":"2023-12-16T03:27:59.735740+0000","last_unstale":"2023-12-16T03:28:00.714359+0000","last_undegraded":"2023-12-16T03:28:00.714359+0000","last_fullsized":"2023-12-16T03:28:00.714359+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:58.145120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861760+0000","last_change":"2023-12-16T03:27:59.724263+0000","last_active":"2023-12-16T03:28:01.861760+0000","last_peered":"2023-12-16T03:28:01.861760+0000","last_clean":"2023-12-16T03:28:01.861760+0000","last_became_active":"2023-12-16T03:27:59.723977+0000","last_became_peered":"2023-12-16T03:27:59.723977+0000","last_unstale":"2023-12-16T03:28:01.861760+0000","last_undegraded":"2023-12-16T03:28:01.861760+0000","last_fullsized":"2023-12-16T03:28:01.861760+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:25.732965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861201+0000","last_change":"2023-12-16T03:27:59.731798+0000","last_active":"2023-12-16T03:28:01.861201+0000","last_peered":"2023-12-16T03:28:01.861201+0000","last_clean":"2023-12-16T03:28:01.861201+0000","last_became_active":"2023-12-16T03:27:59.731495+0000","last_became_peered":"2023-12-16T03:27:59.731495+0000","last_unstale":"2023-12-16T03:28:01.861201+0000","last_undegraded":"2023-12-16T03:28:01.861201+0000","last_fullsized":"2023-12-16T03:28:01.861201+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:45.169228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714477+0000","last_change":"2023-12-16T03:27:59.735415+0000","last_active":"2023-12-16T03:28:00.714477+0000","last_peered":"2023-12-16T03:28:00.714477+0000","last_clean":"2023-12-16T03:28:00.714477+0000","last_became_active":"2023-12-16T03:27:59.735157+0000","last_became_peered":"2023-12-16T03:27:59.735157+0000","last_unstale":"2023-12-16T03:28:00.714477+0000","last_undegraded":"2023-12-16T03:28:00.714477+0000","last_fullsized":"2023-12-16T03:28:00.714477+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:35.229043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861651+0000","last_change":"2023-12-16T03:27:59.712831+0000","last_active":"2023-12-16T03:28:01.861651+0000","last_peered":"2023-12-16T03:28:01.861651+0000","last_clean":"2023-12-16T03:28:01.861651+0000","last_became_active":"2023-12-16T03:27:59.712536+0000","last_became_peered":"2023-12-16T03:27:59.712536+0000","last_unstale":"2023-12-16T03:28:01.861651+0000","last_undegraded":"2023-12-16T03:28:01.861651+0000","last_fullsized":"2023-12-16T03:28:01.861651+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:50.291606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861870+0000","last_change":"2023-12-16T03:27:59.710497+0000","last_active":"2023-12-16T03:28:01.861870+0000","last_peered":"2023-12-16T03:28:01.861870+0000","last_clean":"2023-12-16T03:28:01.861870+0000","last_became_active":"2023-12-16T03:27:59.710219+0000","last_became_peered":"2023-12-16T03:27:59.710219+0000","last_unstale":"2023-12-16T03:28:01.861870+0000","last_undegraded":"2023-12-16T03:28:01.861870+0000","last_fullsized":"2023-12-16T03:28:01.861870+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:24:57.766259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.713622+0000","last_change":"2023-12-16T03:27:59.712771+0000","last_active":"2023-12-16T03:28:00.713622+0000","last_peered":"2023-12-16T03:28:00.713622+0000","last_clean":"2023-12-16T03:28:00.713622+0000","last_became_active":"2023-12-16T03:27:59.712506+0000","last_became_peered":"2023-12-16T03:27:59.712506+0000","last_unstale":"2023-12-16T03:28:00.713622+0000","last_undegraded":"2023-12-16T03:28:00.713622+0000","last_fullsized":"2023-12-16T03:28:00.713622+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:55:37.693337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.860952+0000","last_change":"2023-12-16T03:27:59.719153+0000","last_active":"2023-12-16T03:28:01.860952+0000","last_peered":"2023-12-16T03:28:01.860952+0000","last_clean":"2023-12-16T03:28:01.860952+0000","last_became_active":"2023-12-16T03:27:59.718863+0000","last_became_peered":"2023-12-16T03:27:59.718863+0000","last_unstale":"2023-12-16T03:28:01.860952+0000","last_undegraded":"2023-12-16T03:28:01.860952+0000","last_fullsized":"2023-12-16T03:28:01.860952+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:40.409035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861728+0000","last_change":"2023-12-16T03:27:59.716721+0000","last_active":"2023-12-16T03:28:01.861728+0000","last_peered":"2023-12-16T03:28:01.861728+0000","last_clean":"2023-12-16T03:28:01.861728+0000","last_became_active":"2023-12-16T03:27:59.714950+0000","last_became_peered":"2023-12-16T03:27:59.714950+0000","last_unstale":"2023-12-16T03:28:01.861728+0000","last_undegraded":"2023-12-16T03:28:01.861728+0000","last_fullsized":"2023-12-16T03:28:01.861728+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:19.672282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861732+0000","last_change":"2023-12-16T03:27:59.735977+0000","last_active":"2023-12-16T03:28:01.861732+0000","last_peered":"2023-12-16T03:28:01.861732+0000","last_clean":"2023-12-16T03:28:01.861732+0000","last_became_active":"2023-12-16T03:27:59.735626+0000","last_became_peered":"2023-12-16T03:27:59.735626+0000","last_unstale":"2023-12-16T03:28:01.861732+0000","last_undegraded":"2023-12-16T03:28:01.861732+0000","last_fullsized":"2023-12-16T03:28:01.861732+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:15:14.726435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.713414+0000","last_change":"2023-12-16T03:27:59.711640+0000","last_active":"2023-12-16T03:28:00.713414+0000","last_peered":"2023-12-16T03:28:00.713414+0000","last_clean":"2023-12-16T03:28:00.713414+0000","last_became_active":"2023-12-16T03:27:59.711336+0000","last_became_peered":"2023-12-16T03:27:59.711336+0000","last_unstale":"2023-12-16T03:28:00.713414+0000","last_undegraded":"2023-12-16T03:28:00.713414+0000","last_fullsized":"2023-12-16T03:28:00.713414+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:55.005723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.860730+0000","last_change":"2023-12-16T03:27:59.718509+0000","last_active":"2023-12-16T03:28:01.860730+0000","last_peered":"2023-12-16T03:28:01.860730+0000","last_clean":"2023-12-16T03:28:01.860730+0000","last_became_active":"2023-12-16T03:27:59.718083+0000","last_became_peered":"2023-12-16T03:27:59.718083+0000","last_unstale":"2023-12-16T03:28:01.860730+0000","last_undegraded":"2023-12-16T03:28:01.860730+0000","last_fullsized":"2023-12-16T03:28:01.860730+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:33.266132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714626+0000","last_change":"2023-12-16T03:27:59.726845+0000","last_active":"2023-12-16T03:28:00.714626+0000","last_peered":"2023-12-16T03:28:00.714626+0000","last_clean":"2023-12-16T03:28:00.714626+0000","last_became_active":"2023-12-16T03:27:59.722341+0000","last_became_peered":"2023-12-16T03:27:59.722341+0000","last_unstale":"2023-12-16T03:28:00.714626+0000","last_undegraded":"2023-12-16T03:28:00.714626+0000","last_fullsized":"2023-12-16T03:28:00.714626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:21.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.739004+0000","last_change":"2023-12-16T03:27:58.719610+0000","last_active":"2023-12-16T03:27:59.739004+0000","last_peered":"2023-12-16T03:27:59.739004+0000","last_clean":"2023-12-16T03:27:59.739004+0000","last_became_active":"2023-12-16T03:27:58.719344+0000","last_became_peered":"2023-12-16T03:27:58.719344+0000","last_unstale":"2023-12-16T03:27:59.739004+0000","last_undegraded":"2023-12-16T03:27:59.739004+0000","last_fullsized":"2023-12-16T03:27:59.739004+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:55:36.684947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861433+0000","last_change":"2023-12-16T03:27:59.724069+0000","last_active":"2023-12-16T03:28:01.861433+0000","last_peered":"2023-12-16T03:28:01.861433+0000","last_clean":"2023-12-16T03:28:01.861433+0000","last_became_active":"2023-12-16T03:27:59.723703+0000","last_became_peered":"2023-12-16T03:27:59.723703+0000","last_unstale":"2023-12-16T03:28:01.861433+0000","last_undegraded":"2023-12-16T03:28:01.861433+0000","last_fullsized":"2023-12-16T03:28:01.861433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:40:30.607572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.728574+0000","last_change":"2023-12-16T03:27:58.715152+0000","last_active":"2023-12-16T03:27:59.728574+0000","last_peered":"2023-12-16T03:27:59.728574+0000","last_clean":"2023-12-16T03:27:59.728574+0000","last_became_active":"2023-12-16T03:27:58.714836+0000","last_became_peered":"2023-12-16T03:27:58.714836+0000","last_unstale":"2023-12-16T03:27:59.728574+0000","last_undegraded":"2023-12-16T03:27:59.728574+0000","last_fullsized":"2023-12-16T03:27:59.728574+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:19:41.787545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861019+0000","last_change":"2023-12-16T03:27:59.718830+0000","last_active":"2023-12-16T03:28:01.861019+0000","last_peered":"2023-12-16T03:28:01.861019+0000","last_clean":"2023-12-16T03:28:01.861019+0000","last_became_active":"2023-12-16T03:27:59.718490+0000","last_became_peered":"2023-12-16T03:27:59.718490+0000","last_unstale":"2023-12-16T03:28:01.861019+0000","last_undegraded":"2023-12-16T03:28:01.861019+0000","last_fullsized":"2023-12-16T03:28:01.861019+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:21.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.740676+0000","last_change":"2023-12-16T03:27:58.716124+0000","last_active":"2023-12-16T03:27:59.740676+0000","last_peered":"2023-12-16T03:27:59.740676+0000","last_clean":"2023-12-16T03:27:59.740676+0000","last_became_active":"2023-12-16T03:27:58.715821+0000","last_became_peered":"2023-12-16T03:27:58.715821+0000","last_unstale":"2023-12-16T03:27:59.740676+0000","last_undegraded":"2023-12-16T03:27:59.740676+0000","last_fullsized":"2023-12-16T03:27:59.740676+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:05.338626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861851+0000","last_change":"2023-12-16T03:27:59.733764+0000","last_active":"2023-12-16T03:28:01.861851+0000","last_peered":"2023-12-16T03:28:01.861851+0000","last_clean":"2023-12-16T03:28:01.861851+0000","last_became_active":"2023-12-16T03:27:59.733395+0000","last_became_peered":"2023-12-16T03:27:59.733395+0000","last_unstale":"2023-12-16T03:28:01.861851+0000","last_undegraded":"2023-12-16T03:28:01.861851+0000","last_fullsized":"2023-12-16T03:28:01.861851+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:34.741103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.741367+0000","last_change":"2023-12-16T03:27:58.716176+0000","last_active":"2023-12-16T03:27:59.741367+0000","last_peered":"2023-12-16T03:27:59.741367+0000","last_clean":"2023-12-16T03:27:59.741367+0000","last_became_active":"2023-12-16T03:27:58.714966+0000","last_became_peered":"2023-12-16T03:27:58.714966+0000","last_unstale":"2023-12-16T03:27:59.741367+0000","last_undegraded":"2023-12-16T03:27:59.741367+0000","last_fullsized":"2023-12-16T03:27:59.741367+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:44.133983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861861+0000","last_change":"2023-12-16T03:27:59.734193+0000","last_active":"2023-12-16T03:28:01.861861+0000","last_peered":"2023-12-16T03:28:01.861861+0000","last_clean":"2023-12-16T03:28:01.861861+0000","last_became_active":"2023-12-16T03:27:59.733906+0000","last_became_peered":"2023-12-16T03:27:59.733906+0000","last_unstale":"2023-12-16T03:28:01.861861+0000","last_undegraded":"2023-12-16T03:28:01.861861+0000","last_fullsized":"2023-12-16T03:28:01.861861+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:27:07.594429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.735051+0000","last_change":"2023-12-16T03:27:58.722406+0000","last_active":"2023-12-16T03:27:59.735051+0000","last_peered":"2023-12-16T03:27:59.735051+0000","last_clean":"2023-12-16T03:27:59.735051+0000","last_became_active":"2023-12-16T03:27:58.722107+0000","last_became_peered":"2023-12-16T03:27:58.722107+0000","last_unstale":"2023-12-16T03:27:59.735051+0000","last_undegraded":"2023-12-16T03:27:59.735051+0000","last_fullsized":"2023-12-16T03:27:59.735051+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:27:42.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714559+0000","last_change":"2023-12-16T03:27:59.733566+0000","last_active":"2023-12-16T03:28:00.714559+0000","last_peered":"2023-12-16T03:28:00.714559+0000","last_clean":"2023-12-16T03:28:00.714559+0000","last_became_active":"2023-12-16T03:27:59.733308+0000","last_became_peered":"2023-12-16T03:27:59.733308+0000","last_unstale":"2023-12-16T03:28:00.714559+0000","last_undegraded":"2023-12-16T03:28:00.714559+0000","last_fullsized":"2023-12-16T03:28:00.714559+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:20:58.921708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.731929+0000","last_change":"2023-12-16T03:27:58.717341+0000","last_active":"2023-12-16T03:27:59.731929+0000","last_peered":"2023-12-16T03:27:59.731929+0000","last_clean":"2023-12-16T03:27:59.731929+0000","last_became_active":"2023-12-16T03:27:58.717037+0000","last_became_peered":"2023-12-16T03:27:58.717037+0000","last_unstale":"2023-12-16T03:27:59.731929+0000","last_undegraded":"2023-12-16T03:27:59.731929+0000","last_fullsized":"2023-12-16T03:27:59.731929+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:26:30.859183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.860690+0000","last_change":"2023-12-16T03:27:59.723598+0000","last_active":"2023-12-16T03:28:01.860690+0000","last_peered":"2023-12-16T03:28:01.860690+0000","last_clean":"2023-12-16T03:28:01.860690+0000","last_became_active":"2023-12-16T03:27:59.723319+0000","last_became_peered":"2023-12-16T03:27:59.723319+0000","last_unstale":"2023-12-16T03:28:01.860690+0000","last_undegraded":"2023-12-16T03:28:01.860690+0000","last_fullsized":"2023-12-16T03:28:01.860690+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:45.169228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.705999+0000","last_change":"2023-12-16T03:27:58.703166+0000","last_active":"2023-12-16T03:27:59.705999+0000","last_peered":"2023-12-16T03:27:59.705999+0000","last_clean":"2023-12-16T03:27:59.705999+0000","last_became_active":"2023-12-16T03:27:58.702889+0000","last_became_peered":"2023-12-16T03:27:58.702889+0000","last_unstale":"2023-12-16T03:27:59.705999+0000","last_undegraded":"2023-12-16T03:27:59.705999+0000","last_fullsized":"2023-12-16T03:27:59.705999+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:19:41.787545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.736597+0000","last_change":"2023-12-16T03:27:59.718875+0000","last_active":"2023-12-16T03:28:00.736597+0000","last_peered":"2023-12-16T03:28:00.736597+0000","last_clean":"2023-12-16T03:28:00.736597+0000","last_became_active":"2023-12-16T03:27:59.718513+0000","last_became_peered":"2023-12-16T03:27:59.718513+0000","last_unstale":"2023-12-16T03:28:00.736597+0000","last_undegraded":"2023-12-16T03:28:00.736597+0000","last_fullsized":"2023-12-16T03:28:00.736597+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:20.215362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.697571+0000","last_change":"2023-12-16T03:27:58.723547+0000","last_active":"2023-12-16T03:27:59.697571+0000","last_peered":"2023-12-16T03:27:59.697571+0000","last_clean":"2023-12-16T03:27:59.697571+0000","last_became_active":"2023-12-16T03:27:58.723244+0000","last_became_peered":"2023-12-16T03:27:58.723244+0000","last_unstale":"2023-12-16T03:27:59.697571+0000","last_undegraded":"2023-12-16T03:27:59.697571+0000","last_fullsized":"2023-12-16T03:27:59.697571+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:50.819935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.736919+0000","last_change":"2023-12-16T03:27:59.717795+0000","last_active":"2023-12-16T03:28:00.736919+0000","last_peered":"2023-12-16T03:28:00.736919+0000","last_clean":"2023-12-16T03:28:00.736919+0000","last_became_active":"2023-12-16T03:27:59.717470+0000","last_became_peered":"2023-12-16T03:27:59.717470+0000","last_unstale":"2023-12-16T03:28:00.736919+0000","last_undegraded":"2023-12-16T03:28:00.736919+0000","last_fullsized":"2023-12-16T03:28:00.736919+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:10.829694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.708249+0000","last_change":"2023-12-16T03:27:58.717293+0000","last_active":"2023-12-16T03:27:59.708249+0000","last_peered":"2023-12-16T03:27:59.708249+0000","last_clean":"2023-12-16T03:27:59.708249+0000","last_became_active":"2023-12-16T03:27:58.716996+0000","last_became_peered":"2023-12-16T03:27:58.716996+0000","last_unstale":"2023-12-16T03:27:59.708249+0000","last_undegraded":"2023-12-16T03:27:59.708249+0000","last_fullsized":"2023-12-16T03:27:59.708249+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:42.424788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714288+0000","last_change":"2023-12-16T03:27:59.734554+0000","last_active":"2023-12-16T03:28:00.714288+0000","last_peered":"2023-12-16T03:28:00.714288+0000","last_clean":"2023-12-16T03:28:00.714288+0000","last_became_active":"2023-12-16T03:27:59.734106+0000","last_became_peered":"2023-12-16T03:27:59.734106+0000","last_unstale":"2023-12-16T03:28:00.714288+0000","last_undegraded":"2023-12-16T03:28:00.714288+0000","last_fullsized":"2023-12-16T03:28:00.714288+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:45.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.708674+0000","last_change":"2023-12-16T03:27:58.711663+0000","last_active":"2023-12-16T03:27:59.708674+0000","last_peered":"2023-12-16T03:27:59.708674+0000","last_clean":"2023-12-16T03:27:59.708674+0000","last_became_active":"2023-12-16T03:27:58.711356+0000","last_became_peered":"2023-12-16T03:27:58.711356+0000","last_unstale":"2023-12-16T03:27:59.708674+0000","last_undegraded":"2023-12-16T03:27:59.708674+0000","last_fullsized":"2023-12-16T03:27:59.708674+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:05.338626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.862277+0000","last_change":"2023-12-16T03:27:59.727694+0000","last_active":"2023-12-16T03:28:01.862277+0000","last_peered":"2023-12-16T03:28:01.862277+0000","last_clean":"2023-12-16T03:28:01.862277+0000","last_became_active":"2023-12-16T03:27:59.727388+0000","last_became_peered":"2023-12-16T03:27:59.727388+0000","last_unstale":"2023-12-16T03:28:01.862277+0000","last_undegraded":"2023-12-16T03:28:01.862277+0000","last_fullsized":"2023-12-16T03:28:01.862277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:06:37.917845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.734488+0000","last_change":"2023-12-16T03:27:58.716440+0000","last_active":"2023-12-16T03:27:59.734488+0000","last_peered":"2023-12-16T03:27:59.734488+0000","last_clean":"2023-12-16T03:27:59.734488+0000","last_became_active":"2023-12-16T03:27:58.716067+0000","last_became_peered":"2023-12-16T03:27:58.716067+0000","last_unstale":"2023-12-16T03:27:59.734488+0000","last_undegraded":"2023-12-16T03:27:59.734488+0000","last_fullsized":"2023-12-16T03:27:59.734488+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:27:06.586039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714097+0000","last_change":"2023-12-16T03:27:59.724678+0000","last_active":"2023-12-16T03:28:00.714097+0000","last_peered":"2023-12-16T03:28:00.714097+0000","last_clean":"2023-12-16T03:28:00.714097+0000","last_became_active":"2023-12-16T03:27:59.724328+0000","last_became_peered":"2023-12-16T03:27:59.724328+0000","last_unstale":"2023-12-16T03:28:00.714097+0000","last_undegraded":"2023-12-16T03:28:00.714097+0000","last_fullsized":"2023-12-16T03:28:00.714097+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:43.433178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'6","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.739437+0000","last_change":"2023-12-16T03:27:58.716691+0000","last_active":"2023-12-16T03:27:59.739437+0000","last_peered":"2023-12-16T03:27:59.739437+0000","last_clean":"2023-12-16T03:27:59.739437+0000","last_became_active":"2023-12-16T03:27:58.716447+0000","last_became_peered":"2023-12-16T03:27:58.716447+0000","last_unstale":"2023-12-16T03:27:59.739437+0000","last_undegraded":"2023-12-16T03:27:59.739437+0000","last_fullsized":"2023-12-16T03:27:59.739437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:27:42.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.862111+0000","last_change":"2023-12-16T03:27:59.719384+0000","last_active":"2023-12-16T03:28:01.862111+0000","last_peered":"2023-12-16T03:28:01.862111+0000","last_clean":"2023-12-16T03:28:01.862111+0000","last_became_active":"2023-12-16T03:27:59.718520+0000","last_became_peered":"2023-12-16T03:27:59.718520+0000","last_unstale":"2023-12-16T03:28:01.862111+0000","last_undegraded":"2023-12-16T03:28:01.862111+0000","last_fullsized":"2023-12-16T03:28:01.862111+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:40.409035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.739459+0000","last_change":"2023-12-16T03:27:58.721903+0000","last_active":"2023-12-16T03:27:59.739459+0000","last_peered":"2023-12-16T03:27:59.739459+0000","last_clean":"2023-12-16T03:27:59.739459+0000","last_became_active":"2023-12-16T03:27:58.721611+0000","last_became_peered":"2023-12-16T03:27:58.721611+0000","last_unstale":"2023-12-16T03:27:59.739459+0000","last_undegraded":"2023-12-16T03:27:59.739459+0000","last_fullsized":"2023-12-16T03:27:59.739459+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:08:43.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861574+0000","last_change":"2023-12-16T03:27:59.723346+0000","last_active":"2023-12-16T03:28:01.861574+0000","last_peered":"2023-12-16T03:28:01.861574+0000","last_clean":"2023-12-16T03:28:01.861574+0000","last_became_active":"2023-12-16T03:27:59.722968+0000","last_became_peered":"2023-12-16T03:27:59.722968+0000","last_unstale":"2023-12-16T03:28:01.861574+0000","last_undegraded":"2023-12-16T03:28:01.861574+0000","last_fullsized":"2023-12-16T03:28:01.861574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:40:30.607572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.707744+0000","last_change":"2023-12-16T03:27:58.724631+0000","last_active":"2023-12-16T03:27:59.707744+0000","last_peered":"2023-12-16T03:27:59.707744+0000","last_clean":"2023-12-16T03:27:59.707744+0000","last_became_active":"2023-12-16T03:27:58.724267+0000","last_became_peered":"2023-12-16T03:27:58.724267+0000","last_unstale":"2023-12-16T03:27:59.707744+0000","last_undegraded":"2023-12-16T03:27:59.707744+0000","last_fullsized":"2023-12-16T03:27:59.707744+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:08:00.782230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861324+0000","last_change":"2023-12-16T03:27:59.735336+0000","last_active":"2023-12-16T03:28:01.861324+0000","last_peered":"2023-12-16T03:28:01.861324+0000","last_clean":"2023-12-16T03:28:01.861324+0000","last_became_active":"2023-12-16T03:27:59.735041+0000","last_became_peered":"2023-12-16T03:27:59.735041+0000","last_unstale":"2023-12-16T03:28:01.861324+0000","last_undegraded":"2023-12-16T03:28:01.861324+0000","last_fullsized":"2023-12-16T03:28:01.861324+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:11.022363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.706437+0000","last_change":"2023-12-16T03:27:58.707831+0000","last_active":"2023-12-16T03:27:59.706437+0000","last_peered":"2023-12-16T03:27:59.706437+0000","last_clean":"2023-12-16T03:27:59.706437+0000","last_became_active":"2023-12-16T03:27:58.707542+0000","last_became_peered":"2023-12-16T03:27:58.707542+0000","last_unstale":"2023-12-16T03:27:59.706437+0000","last_undegraded":"2023-12-16T03:27:59.706437+0000","last_fullsized":"2023-12-16T03:27:59.706437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:01:08.706369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861208+0000","last_change":"2023-12-16T03:27:59.720229+0000","last_active":"2023-12-16T03:28:01.861208+0000","last_peered":"2023-12-16T03:28:01.861208+0000","last_clean":"2023-12-16T03:28:01.861208+0000","last_became_active":"2023-12-16T03:27:59.719927+0000","last_became_peered":"2023-12-16T03:27:59.719927+0000","last_unstale":"2023-12-16T03:28:01.861208+0000","last_undegraded":"2023-12-16T03:28:01.861208+0000","last_fullsized":"2023-12-16T03:28:01.861208+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:16.254698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.728817+0000","last_change":"2023-12-16T03:27:58.713349+0000","last_active":"2023-12-16T03:27:59.728817+0000","last_peered":"2023-12-16T03:27:59.728817+0000","last_clean":"2023-12-16T03:27:59.728817+0000","last_became_active":"2023-12-16T03:27:58.712977+0000","last_became_peered":"2023-12-16T03:27:58.712977+0000","last_unstale":"2023-12-16T03:27:59.728817+0000","last_undegraded":"2023-12-16T03:27:59.728817+0000","last_fullsized":"2023-12-16T03:27:59.728817+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:56.126328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861887+0000","last_change":"2023-12-16T03:27:59.713056+0000","last_active":"2023-12-16T03:28:01.861887+0000","last_peered":"2023-12-16T03:28:01.861887+0000","last_clean":"2023-12-16T03:28:01.861887+0000","last_became_active":"2023-12-16T03:27:59.712760+0000","last_became_peered":"2023-12-16T03:27:59.712760+0000","last_unstale":"2023-12-16T03:28:01.861887+0000","last_undegraded":"2023-12-16T03:28:01.861887+0000","last_fullsized":"2023-12-16T03:28:01.861887+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:46.650579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.735482+0000","last_change":"2023-12-16T03:27:58.710741+0000","last_active":"2023-12-16T03:27:59.735482+0000","last_peered":"2023-12-16T03:27:59.735482+0000","last_clean":"2023-12-16T03:27:59.735482+0000","last_became_active":"2023-12-16T03:27:58.710391+0000","last_became_peered":"2023-12-16T03:27:58.710391+0000","last_unstale":"2023-12-16T03:27:59.735482+0000","last_undegraded":"2023-12-16T03:27:59.735482+0000","last_fullsized":"2023-12-16T03:27:59.735482+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:44.133983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861508+0000","last_change":"2023-12-16T03:27:59.719682+0000","last_active":"2023-12-16T03:28:01.861508+0000","last_peered":"2023-12-16T03:28:01.861508+0000","last_clean":"2023-12-16T03:28:01.861508+0000","last_became_active":"2023-12-16T03:27:59.719285+0000","last_became_peered":"2023-12-16T03:27:59.719285+0000","last_unstale":"2023-12-16T03:28:01.861508+0000","last_undegraded":"2023-12-16T03:28:01.861508+0000","last_fullsized":"2023-12-16T03:28:01.861508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:34.741103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.727245+0000","last_change":"2023-12-16T03:27:58.714603+0000","last_active":"2023-12-16T03:27:59.727245+0000","last_peered":"2023-12-16T03:27:59.727245+0000","last_clean":"2023-12-16T03:27:59.727245+0000","last_became_active":"2023-12-16T03:27:58.714204+0000","last_became_peered":"2023-12-16T03:27:58.714204+0000","last_unstale":"2023-12-16T03:27:59.727245+0000","last_undegraded":"2023-12-16T03:27:59.727245+0000","last_fullsized":"2023-12-16T03:27:59.727245+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:53.997333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714223+0000","last_change":"2023-12-16T03:27:59.712998+0000","last_active":"2023-12-16T03:28:00.714223+0000","last_peered":"2023-12-16T03:28:00.714223+0000","last_clean":"2023-12-16T03:28:00.714223+0000","last_became_active":"2023-12-16T03:27:59.712032+0000","last_became_peered":"2023-12-16T03:27:59.712032+0000","last_unstale":"2023-12-16T03:28:00.714223+0000","last_undegraded":"2023-12-16T03:28:00.714223+0000","last_fullsized":"2023-12-16T03:28:00.714223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:45.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.707254+0000","last_change":"2023-12-16T03:27:58.703925+0000","last_active":"2023-12-16T03:27:59.707254+0000","last_peered":"2023-12-16T03:27:59.707254+0000","last_clean":"2023-12-16T03:27:59.707254+0000","last_became_active":"2023-12-16T03:27:58.703623+0000","last_became_peered":"2023-12-16T03:27:58.703623+0000","last_unstale":"2023-12-16T03:27:59.707254+0000","last_undegraded":"2023-12-16T03:27:59.707254+0000","last_fullsized":"2023-12-16T03:27:59.707254+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:32.257742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714436+0000","last_change":"2023-12-16T03:27:59.740195+0000","last_active":"2023-12-16T03:28:00.714436+0000","last_peered":"2023-12-16T03:28:00.714436+0000","last_clean":"2023-12-16T03:28:00.714436+0000","last_became_active":"2023-12-16T03:27:59.739697+0000","last_became_peered":"2023-12-16T03:27:59.739697+0000","last_unstale":"2023-12-16T03:28:00.714436+0000","last_undegraded":"2023-12-16T03:28:00.714436+0000","last_fullsized":"2023-12-16T03:28:00.714436+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:12:40.578081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.735342+0000","last_change":"2023-12-16T03:27:58.719438+0000","last_active":"2023-12-16T03:27:59.735342+0000","last_peered":"2023-12-16T03:27:59.735342+0000","last_clean":"2023-12-16T03:27:59.735342+0000","last_became_active":"2023-12-16T03:27:58.719140+0000","last_became_peered":"2023-12-16T03:27:58.719140+0000","last_unstale":"2023-12-16T03:27:59.735342+0000","last_undegraded":"2023-12-16T03:27:59.735342+0000","last_fullsized":"2023-12-16T03:27:59.735342+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:45.642189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.713786+0000","last_change":"2023-12-16T03:27:59.725032+0000","last_active":"2023-12-16T03:28:00.713786+0000","last_peered":"2023-12-16T03:28:00.713786+0000","last_clean":"2023-12-16T03:28:00.713786+0000","last_became_active":"2023-12-16T03:27:59.724136+0000","last_became_peered":"2023-12-16T03:27:59.724136+0000","last_unstale":"2023-12-16T03:28:00.713786+0000","last_undegraded":"2023-12-16T03:28:00.713786+0000","last_fullsized":"2023-12-16T03:28:00.713786+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:55:37.693337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.722436+0000","last_change":"2023-12-16T03:27:58.714711+0000","last_active":"2023-12-16T03:27:59.722436+0000","last_peered":"2023-12-16T03:27:59.722436+0000","last_clean":"2023-12-16T03:27:59.722436+0000","last_became_active":"2023-12-16T03:27:58.714425+0000","last_became_peered":"2023-12-16T03:27:58.714425+0000","last_unstale":"2023-12-16T03:27:59.722436+0000","last_undegraded":"2023-12-16T03:27:59.722436+0000","last_fullsized":"2023-12-16T03:27:59.722436+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:46.678443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714176+0000","last_change":"2023-12-16T03:27:59.731322+0000","last_active":"2023-12-16T03:28:00.714176+0000","last_peered":"2023-12-16T03:28:00.714176+0000","last_clean":"2023-12-16T03:28:00.714176+0000","last_became_active":"2023-12-16T03:27:59.730648+0000","last_became_peered":"2023-12-16T03:27:59.730648+0000","last_unstale":"2023-12-16T03:28:00.714176+0000","last_undegraded":"2023-12-16T03:28:00.714176+0000","last_fullsized":"2023-12-16T03:28:00.714176+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:08:50.058653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.713225+0000","last_change":"2023-12-16T03:27:58.714609+0000","last_active":"2023-12-16T03:27:59.713225+0000","last_peered":"2023-12-16T03:27:59.713225+0000","last_clean":"2023-12-16T03:27:59.713225+0000","last_became_active":"2023-12-16T03:27:58.714279+0000","last_became_peered":"2023-12-16T03:27:58.714279+0000","last_unstale":"2023-12-16T03:27:59.713225+0000","last_undegraded":"2023-12-16T03:27:59.713225+0000","last_fullsized":"2023-12-16T03:27:59.713225+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:23:31.017856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.713763+0000","last_change":"2023-12-16T03:27:59.726049+0000","last_active":"2023-12-16T03:28:00.713763+0000","last_peered":"2023-12-16T03:28:00.713763+0000","last_clean":"2023-12-16T03:28:00.713763+0000","last_became_active":"2023-12-16T03:27:59.725688+0000","last_became_peered":"2023-12-16T03:27:59.725688+0000","last_unstale":"2023-12-16T03:28:00.713763+0000","last_undegraded":"2023-12-16T03:28:00.713763+0000","last_fullsized":"2023-12-16T03:28:00.713763+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:55.005723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.707275+0000","last_change":"2023-12-16T03:27:58.715914+0000","last_active":"2023-12-16T03:27:59.707275+0000","last_peered":"2023-12-16T03:27:59.707275+0000","last_clean":"2023-12-16T03:27:59.707275+0000","last_became_active":"2023-12-16T03:27:58.715602+0000","last_became_peered":"2023-12-16T03:27:58.715602+0000","last_unstale":"2023-12-16T03:27:59.707275+0000","last_undegraded":"2023-12-16T03:27:59.707275+0000","last_fullsized":"2023-12-16T03:27:59.707275+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:24:56.757869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714731+0000","last_change":"2023-12-16T03:27:59.717815+0000","last_active":"2023-12-16T03:28:00.714731+0000","last_peered":"2023-12-16T03:28:00.714731+0000","last_clean":"2023-12-16T03:28:00.714731+0000","last_became_active":"2023-12-16T03:27:59.714803+0000","last_became_peered":"2023-12-16T03:27:59.714803+0000","last_unstale":"2023-12-16T03:28:00.714731+0000","last_undegraded":"2023-12-16T03:28:00.714731+0000","last_fullsized":"2023-12-16T03:28:00.714731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:06:37.917845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.739463+0000","last_change":"2023-12-16T03:27:58.718818+0000","last_active":"2023-12-16T03:27:59.739463+0000","last_peered":"2023-12-16T03:27:59.739463+0000","last_clean":"2023-12-16T03:27:59.739463+0000","last_became_active":"2023-12-16T03:27:58.718323+0000","last_became_peered":"2023-12-16T03:27:58.718323+0000","last_unstale":"2023-12-16T03:27:59.739463+0000","last_undegraded":"2023-12-16T03:27:59.739463+0000","last_fullsized":"2023-12-16T03:27:59.739463+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:13:36.671175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861886+0000","last_change":"2023-12-16T03:27:59.730417+0000","last_active":"2023-12-16T03:28:01.861886+0000","last_peered":"2023-12-16T03:28:01.861886+0000","last_clean":"2023-12-16T03:28:01.861886+0000","last_became_active":"2023-12-16T03:27:59.729416+0000","last_became_peered":"2023-12-16T03:27:59.729416+0000","last_unstale":"2023-12-16T03:28:01.861886+0000","last_undegraded":"2023-12-16T03:28:01.861886+0000","last_fullsized":"2023-12-16T03:28:01.861886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:08:01.790620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.701385+0000","last_change":"2023-12-16T03:27:58.715883+0000","last_active":"2023-12-16T03:27:59.701385+0000","last_peered":"2023-12-16T03:27:59.701385+0000","last_clean":"2023-12-16T03:27:59.701385+0000","last_became_active":"2023-12-16T03:27:58.714400+0000","last_became_peered":"2023-12-16T03:27:58.714400+0000","last_unstale":"2023-12-16T03:27:59.701385+0000","last_undegraded":"2023-12-16T03:27:59.701385+0000","last_fullsized":"2023-12-16T03:27:59.701385+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:45.783332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861134+0000","last_change":"2023-12-16T03:27:59.733598+0000","last_active":"2023-12-16T03:28:01.861134+0000","last_peered":"2023-12-16T03:28:01.861134+0000","last_clean":"2023-12-16T03:28:01.861134+0000","last_became_active":"2023-12-16T03:27:59.733274+0000","last_became_peered":"2023-12-16T03:27:59.733274+0000","last_unstale":"2023-12-16T03:28:01.861134+0000","last_undegraded":"2023-12-16T03:28:01.861134+0000","last_fullsized":"2023-12-16T03:28:01.861134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:06:37.917845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.705656+0000","last_change":"2023-12-16T03:27:58.714025+0000","last_active":"2023-12-16T03:27:59.705656+0000","last_peered":"2023-12-16T03:27:59.705656+0000","last_clean":"2023-12-16T03:27:59.705656+0000","last_became_active":"2023-12-16T03:27:58.713597+0000","last_became_peered":"2023-12-16T03:27:58.713597+0000","last_unstale":"2023-12-16T03:27:59.705656+0000","last_undegraded":"2023-12-16T03:27:59.705656+0000","last_fullsized":"2023-12-16T03:27:59.705656+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:00.746235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.714337+0000","last_change":"2023-12-16T03:27:59.726447+0000","last_active":"2023-12-16T03:28:00.714337+0000","last_peered":"2023-12-16T03:28:00.714337+0000","last_clean":"2023-12-16T03:28:00.714337+0000","last_became_active":"2023-12-16T03:27:59.724012+0000","last_became_peered":"2023-12-16T03:27:59.724012+0000","last_unstale":"2023-12-16T03:28:00.714337+0000","last_undegraded":"2023-12-16T03:28:00.714337+0000","last_fullsized":"2023-12-16T03:28:00.714337+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:33.266132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.707473+0000","last_change":"2023-12-16T03:27:58.717331+0000","last_active":"2023-12-16T03:27:59.707473+0000","last_peered":"2023-12-16T03:27:59.707473+0000","last_clean":"2023-12-16T03:27:59.707473+0000","last_became_active":"2023-12-16T03:27:58.716980+0000","last_became_peered":"2023-12-16T03:27:58.716980+0000","last_unstale":"2023-12-16T03:27:59.707473+0000","last_undegraded":"2023-12-16T03:27:59.707473+0000","last_fullsized":"2023-12-16T03:27:59.707473+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:56.126328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:00.713886+0000","last_change":"2023-12-16T03:27:59.725040+0000","last_active":"2023-12-16T03:28:00.713886+0000","last_peered":"2023-12-16T03:28:00.713886+0000","last_clean":"2023-12-16T03:28:00.713886+0000","last_became_active":"2023-12-16T03:27:59.724679+0000","last_became_peered":"2023-12-16T03:27:59.724679+0000","last_unstale":"2023-12-16T03:28:00.713886+0000","last_undegraded":"2023-12-16T03:28:00.713886+0000","last_fullsized":"2023-12-16T03:28:00.713886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:43.433178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.707315+0000","last_change":"2023-12-16T03:27:58.715680+0000","last_active":"2023-12-16T03:27:59.707315+0000","last_peered":"2023-12-16T03:27:59.707315+0000","last_clean":"2023-12-16T03:27:59.707315+0000","last_became_active":"2023-12-16T03:27:58.715382+0000","last_became_peered":"2023-12-16T03:27:58.715382+0000","last_unstale":"2023-12-16T03:27:59.707315+0000","last_undegraded":"2023-12-16T03:27:59.707315+0000","last_fullsized":"2023-12-16T03:27:59.707315+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:20:57.913319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.862226+0000","last_change":"2023-12-16T03:27:59.724572+0000","last_active":"2023-12-16T03:28:01.862226+0000","last_peered":"2023-12-16T03:28:01.862226+0000","last_clean":"2023-12-16T03:28:01.862226+0000","last_became_active":"2023-12-16T03:27:59.724284+0000","last_became_peered":"2023-12-16T03:27:59.724284+0000","last_unstale":"2023-12-16T03:28:01.862226+0000","last_undegraded":"2023-12-16T03:28:01.862226+0000","last_fullsized":"2023-12-16T03:28:01.862226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:21.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.701042+0000","last_change":"2023-12-16T03:27:58.715475+0000","last_active":"2023-12-16T03:27:59.701042+0000","last_peered":"2023-12-16T03:27:59.701042+0000","last_clean":"2023-12-16T03:27:59.701042+0000","last_became_active":"2023-12-16T03:27:58.715159+0000","last_became_peered":"2023-12-16T03:27:58.715159+0000","last_unstale":"2023-12-16T03:27:59.701042+0000","last_undegraded":"2023-12-16T03:27:59.701042+0000","last_fullsized":"2023-12-16T03:27:59.701042+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:01:08.706369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.860866+0000","last_change":"2023-12-16T03:27:59.713363+0000","last_active":"2023-12-16T03:28:01.860866+0000","last_peered":"2023-12-16T03:28:01.860866+0000","last_clean":"2023-12-16T03:28:01.860866+0000","last_became_active":"2023-12-16T03:27:59.711676+0000","last_became_peered":"2023-12-16T03:27:59.711676+0000","last_unstale":"2023-12-16T03:28:01.860866+0000","last_undegraded":"2023-12-16T03:28:01.860866+0000","last_fullsized":"2023-12-16T03:28:01.860866+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:38.945695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.707936+0000","last_change":"2023-12-16T03:27:58.715221+0000","last_active":"2023-12-16T03:27:59.707936+0000","last_peered":"2023-12-16T03:27:59.707936+0000","last_clean":"2023-12-16T03:27:59.707936+0000","last_became_active":"2023-12-16T03:27:58.714876+0000","last_became_peered":"2023-12-16T03:27:58.714876+0000","last_unstale":"2023-12-16T03:27:59.707936+0000","last_undegraded":"2023-12-16T03:27:59.707936+0000","last_fullsized":"2023-12-16T03:27:59.707936+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:53.997333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861377+0000","last_change":"2023-12-16T03:27:59.724587+0000","last_active":"2023-12-16T03:28:01.861377+0000","last_peered":"2023-12-16T03:28:01.861377+0000","last_clean":"2023-12-16T03:28:01.861377+0000","last_became_active":"2023-12-16T03:27:59.724247+0000","last_became_peered":"2023-12-16T03:27:59.724247+0000","last_unstale":"2023-12-16T03:28:01.861377+0000","last_undegraded":"2023-12-16T03:28:01.861377+0000","last_fullsized":"2023-12-16T03:28:01.861377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:47:50.256780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.700526+0000","last_change":"2023-12-16T03:27:58.711121+0000","last_active":"2023-12-16T03:27:59.700526+0000","last_peered":"2023-12-16T03:27:59.700526+0000","last_clean":"2023-12-16T03:27:59.700526+0000","last_became_active":"2023-12-16T03:27:58.710879+0000","last_became_peered":"2023-12-16T03:27:58.710879+0000","last_unstale":"2023-12-16T03:27:59.700526+0000","last_undegraded":"2023-12-16T03:27:59.700526+0000","last_fullsized":"2023-12-16T03:27:59.700526+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:15.561452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-16T03:28:01.861638+0000","last_change":"2023-12-16T03:27:59.716568+0000","last_active":"2023-12-16T03:28:01.861638+0000","last_peered":"2023-12-16T03:28:01.861638+0000","last_clean":"2023-12-16T03:28:01.861638+0000","last_became_active":"2023-12-16T03:27:59.715445+0000","last_became_peered":"2023-12-16T03:27:59.715445+0000","last_unstale":"2023-12-16T03:28:01.861638+0000","last_undegraded":"2023-12-16T03:28:01.861638+0000","last_fullsized":"2023-12-16T03:28:01.861638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:21:50.345325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.724753+0000","last_change":"2023-12-16T03:27:58.721261+0000","last_active":"2023-12-16T03:27:59.724753+0000","last_peered":"2023-12-16T03:27:59.724753+0000","last_clean":"2023-12-16T03:27:59.724753+0000","last_became_active":"2023-12-16T03:27:58.720869+0000","last_became_peered":"2023-12-16T03:27:58.720869+0000","last_unstale":"2023-12-16T03:27:59.724753+0000","last_undegraded":"2023-12-16T03:27:59.724753+0000","last_fullsized":"2023-12-16T03:27:59.724753+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:20.366036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-16T03:27:59.697864+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:27:59.697864+0000","last_peered":"2023-12-16T03:27:59.697864+0000","last_clean":"2023-12-16T03:27:59.697864+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:27:59.697864+0000","last_undegraded":"2023-12-16T03:27:59.697864+0000","last_fullsized":"2023-12-16T03:27:59.697864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":954703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":1.155,"15min":1.155},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90700000000000003,"5min":1.585,"15min":1.585},"last":0.70499999999999996}]},{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78300000000000003,"15min":0.79500000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88200000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.81299999999999994,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85099999999999998,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77300000000000002,"15min":0.79100000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.79600000000000004,"15min":0.81100000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.92700000000000005,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96299999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94399999999999995,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.498}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81899999999999995,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.751},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.874,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.48299999999999998}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.81200000000000006}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.004,"15min":1.004},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.89300000000000002,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":364959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.80700000000000005,"15min":0.83099999999999996},"min":{"1min":0.437,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.93400000000000005,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.93799999999999994,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82899999999999996,"15min":0.85499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95399999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":1.02,"15min":1.075},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96299999999999997,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.78500000000000003}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.98099999999999998,"15min":1.0289999999999999},"min":{"1min":0.51200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.042,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.069,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.87}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.87,"15min":0.89700000000000002},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":4.242,"15min":4.242},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.90300000000000002,"15min":0.93500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92600000000000005,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.79700000000000004}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88100000000000001,"5min":1.111,"15min":1.111},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.52300000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0329999999999999,"5min":1.073,"15min":1.073},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.49399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.077,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.99099999999999999,"5min":1.246,"15min":1.246},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.89300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":851968,"data_stored":365899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.60999999999999999},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.69699999999999995}]},{"osd":1,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86499999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1,"15min":1},"last":0.75800000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":1.04}]},{"osd":3,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":1.129},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.82399999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.74399999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.755,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.89000000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64000000000000001,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73599999999999999,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.91200000000000003}]},{"osd":7,"last update":"Sat Dec 16 03:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.82399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.89100000000000001,"5min":1.105,"15min":1.105},"last":1.022}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":835584,"data_stored":364265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.78200000000000003,"15min":0.81000000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":4.194,"15min":4.194},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89200000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.70399999999999996}]},{"osd":2,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85299999999999998,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.60599999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.91500000000000004,"5min":1.288,"15min":1.288},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.93500000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84399999999999997,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.92500000000000004,"15min":0.96199999999999997},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86099999999999999,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.629}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.92800000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.751,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93899999999999995,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.44600000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96499999999999997,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88600000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88900000000000001,"5min":1.881,"15min":1.881},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.81999999999999995,"15min":0.83999999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.746}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":365877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.747,"15min":0.80400000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67700000000000005,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.80900000000000005,"15min":0.871},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.45400000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.66700000000000004,"15min":0.70499999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63500000000000001,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86499999999999999,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.66300000000000003,"15min":0.68400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73399999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.503},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.72999999999999998,"15min":0.76500000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.58599999999999997}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.84299999999999997,"15min":0.86499999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94999999999999996,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.93200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.038,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.83499999999999996}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.048,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.746},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.89400000000000002,"15min":0.92200000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.89500000000000002,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.86899999999999999,"15min":0.89100000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.006,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.874},{"interface":"front","average":{"1min":0.753,"5min":0.92500000000000004,"15min":0.95299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97499999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.93400000000000005,"15min":0.96399999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.94499999999999995,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.95299999999999996,"15min":0.97999999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0609999999999999,"5min":3.375,"15min":3.375},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":364847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45300000000000001,"15min":0.45700000000000002},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48399999999999999,"15min":0.48499999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.875,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.40500000000000003}]},{"osd":1,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.438,"15min":0.42899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.503,"15min":0.498},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.42899999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.496},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.022},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77200000000000002,"15min":0.77700000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1060000000000001,"5min":1.587,"15min":1.587},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0609999999999999,"5min":1.913,"15min":1.913},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.63,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.179,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Dec 16 03:27:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.04,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.629}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":364459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.60999999999999999,"15min":0.64200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.97199999999999998,"5min":4.476,"15min":4.476},"last":0.42899999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.80800000000000005,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73899999999999999,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.749,"15min":0.79300000000000004},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.38300000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.70299999999999996,"15min":0.73399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.66700000000000004,"15min":0.70099999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66600000000000004,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.36599999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.03,"15min":1.0820000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0840000000000001,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.93799999999999994,"15min":0.97199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.133,"5min":4.984,"15min":4.984},"last":0.57599999999999996}]},{"osd":5,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.90200000000000002,"15min":0.93999999999999995},"min":{"1min":0.53800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.996,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.745,"5min":1.089,"15min":1.147},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0209999999999999,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.54900000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.95199999999999996,"15min":0.98899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.0880000000000001,"15min":1.147},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95299999999999996,"5min":7.681,"15min":7.681},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":1.0369999999999999,"15min":1.077},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.177,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.995,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.98199999999999998,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.71499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":954667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.751,"15min":0.80900000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68200000000000005,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.89300000000000002,"15min":0.95899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70699999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.42899999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.93000000000000005,"15min":0.999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80700000000000005,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":1.028,"15min":1.1100000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82199999999999995,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.54700000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.92800000000000005,"15min":1.0109999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57399999999999995,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.498},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.78100000000000003,"15min":0.82599999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":3.254,"15min":3.254},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.95099999999999996,"15min":0.98599999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.97799999999999998,"15min":1.02},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.748}]},{"osd":5,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.0900000000000001,"15min":1.151},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98999999999999999,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.98499999999999999,"15min":1.036},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97499999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97899999999999998,"15min":1.0249999999999999},"min":{"1min":0.54700000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.171,"15min":1.2450000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94399999999999995,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Dec 16 03:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":1.181,"15min":1.2490000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95899999999999996,"5min":4.444,"15min":4.444},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0109999999999999,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.77500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:28:04.210 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-16T03:28:04.210 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-16T03:28:04.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c9df5640 1 Processor -- start 2023-12-16T03:28:04.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c9df5640 1 -- start start 2023-12-16T03:28:04.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c9df5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0c41578f0 0x7fd0c40c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c9df5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd0c40a6c60 0x7fd0c40c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c9df5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd0c40c2840 0x7fd0c40c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c9df5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c40c2e00 con 0x7fd0c40a6c60 2023-12-16T03:28:04.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c9df5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c4157cd0 con 0x7fd0c40c2840 2023-12-16T03:28:04.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c9df5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c4158850 con 0x7fd0c41578f0 2023-12-16T03:28:04.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c2ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd0c40a6c60 0x7fd0c40c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c2ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd0c40a6c60 0x7fd0c40c3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57844/0 (socket says 172.21.15.28:57844) 2023-12-16T03:28:04.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c2ffd640 1 -- 172.21.15.28:0/3507803587 learned_addr learned my addr 172.21.15.28:0/3507803587 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:04.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c3fff640 1 --2- 172.21.15.28:0/3507803587 >> v2:172.21.15.134:3300/0 conn(0x7fd0c40c2840 0x7fd0c40c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c37fe640 1 --2- 172.21.15.28:0/3507803587 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0c41578f0 0x7fd0c40c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c2ffd640 1 -- 172.21.15.28:0/3507803587 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0c41578f0 msgr2=0x7fd0c40c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:04.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c2ffd640 1 --2- 172.21.15.28:0/3507803587 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0c41578f0 0x7fd0c40c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c2ffd640 1 -- 172.21.15.28:0/3507803587 >> v2:172.21.15.134:3300/0 conn(0x7fd0c40c2840 msgr2=0x7fd0c40c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:04.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c2ffd640 1 --2- 172.21.15.28:0/3507803587 >> v2:172.21.15.134:3300/0 conn(0x7fd0c40c2840 0x7fd0c40c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c2ffd640 1 -- 172.21.15.28:0/3507803587 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4157f20 con 0x7fd0c40a6c60 2023-12-16T03:28:04.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.395+0000 7fd0c3fff640 1 --2- 172.21.15.28:0/3507803587 >> v2:172.21.15.134:3300/0 conn(0x7fd0c40c2840 0x7fd0c40c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:04.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c2ffd640 1 --2- 172.21.15.28:0/3507803587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0c40a6c60 0x7fd0c40c3620 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd0c406b530 tx=0x7fd0b801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caecaa40c38b98c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:04.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c27fc640 1 -- 172.21.15.28:0/3507803587 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80ab600 con 0x7fd0c40a6c60 2023-12-16T03:28:04.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c27fc640 1 -- 172.21.15.28:0/3507803587 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b80a7050 con 0x7fd0c40a6c60 2023-12-16T03:28:04.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c27fc640 1 -- 172.21.15.28:0/3507803587 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80ab980 con 0x7fd0c40a6c60 2023-12-16T03:28:04.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c9df5640 1 -- 172.21.15.28:0/3507803587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0c40a6c60 msgr2=0x7fd0c40c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c9df5640 1 --2- 172.21.15.28:0/3507803587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0c40a6c60 0x7fd0c40c3620 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd0c406b530 tx=0x7fd0b801c470 comp rx=0 tx=0).stop 2023-12-16T03:28:04.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c9df5640 1 -- 172.21.15.28:0/3507803587 shutdown_connections 2023-12-16T03:28:04.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c9df5640 1 --2- 172.21.15.28:0/3507803587 >> v2:172.21.15.134:3300/0 conn(0x7fd0c40c2840 0x7fd0c40c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c9df5640 1 --2- 172.21.15.28:0/3507803587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0c40a6c60 0x7fd0c40c3620 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c9df5640 1 --2- 172.21.15.28:0/3507803587 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0c41578f0 0x7fd0c40c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c9df5640 1 -- 172.21.15.28:0/3507803587 >> 172.21.15.28:0/3507803587 conn(0x7fd0c40c7e40 msgr2=0x7fd0c40c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:04.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c9df5640 1 -- 172.21.15.28:0/3507803587 shutdown_connections 2023-12-16T03:28:04.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.399+0000 7fd0c9df5640 1 -- 172.21.15.28:0/3507803587 wait complete. 2023-12-16T03:28:04.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c9df5640 1 Processor -- start 2023-12-16T03:28:04.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c9df5640 1 -- start start 2023-12-16T03:28:04.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c9df5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0c40a6c60 0x7fd0c41ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c9df5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0c40c2840 0x7fd0c40abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c9df5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c41578f0 0x7fd0c40ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c9df5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40abd10 con 0x7fd0c40a6c60 2023-12-16T03:28:04.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c9df5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c414dc20 con 0x7fd0c41578f0 2023-12-16T03:28:04.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c9df5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40ab790 con 0x7fd0c40c2840 2023-12-16T03:28:04.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0c40a6c60 0x7fd0c41ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0c40a6c60 0x7fd0c41ed500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57854/0 (socket says 172.21.15.28:57854) 2023-12-16T03:28:04.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c37fe640 1 -- 172.21.15.28:0/1137322337 learned_addr learned my addr 172.21.15.28:0/1137322337 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:04.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c37fe640 1 -- 172.21.15.28:0/1137322337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0c40c2840 msgr2=0x7fd0c40abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c37fe640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0c40c2840 0x7fd0c40abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c37fe640 1 -- 172.21.15.28:0/1137322337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c41578f0 msgr2=0x7fd0c40ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c37fe640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c41578f0 0x7fd0c40ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c37fe640 1 -- 172.21.15.28:0/1137322337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b80094d0 con 0x7fd0c40a6c60 2023-12-16T03:28:04.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c37fe640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0c40a6c60 0x7fd0c41ed500 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400d5f0 tx=0x7fd0b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:04.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0abfff640 1 -- 172.21.15.28:0/1137322337 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40125f0 con 0x7fd0c40a6c60 2023-12-16T03:28:04.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0abfff640 1 -- 172.21.15.28:0/1137322337 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b4012750 con 0x7fd0c40a6c60 2023-12-16T03:28:04.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0abfff640 1 -- 172.21.15.28:0/1137322337 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4012ae0 con 0x7fd0c40a6c60 2023-12-16T03:28:04.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c9df5640 1 -- 172.21.15.28:0/1137322337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c41ede50 con 0x7fd0c40a6c60 2023-12-16T03:28:04.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c9df5640 1 -- 172.21.15.28:0/1137322337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c406e0a0 con 0x7fd0c40a6c60 2023-12-16T03:28:04.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.403+0000 7fd0c9df5640 1 -- 172.21.15.28:0/1137322337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c40c7c10 con 0x7fd0c40a6c60 2023-12-16T03:28:04.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.407+0000 7fd0abfff640 1 -- 172.21.15.28:0/1137322337 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd0b4012c40 con 0x7fd0c40a6c60 2023-12-16T03:28:04.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.407+0000 7fd0abfff640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0b0066470 0x7fd0b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.407+0000 7fd0abfff640 1 -- 172.21.15.28:0/1137322337 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0b40843f0 con 0x7fd0c40a6c60 2023-12-16T03:28:04.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.407+0000 7fd0c2ffd640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0b0066470 0x7fd0b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.407+0000 7fd0c2ffd640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0b0066470 0x7fd0b0068930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80ad000 tx=0x7fd0b8004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:04.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.411+0000 7fd0abfff640 1 -- 172.21.15.28:0/1137322337 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd0b40517d0 con 0x7fd0c40a6c60 2023-12-16T03:28:04.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.627+0000 7fd0c9df5640 1 -- 172.21.15.28:0/1137322337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd0c4068400 con 0x7fd0c40a6c60 2023-12-16T03:28:04.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.627+0000 7fd0abfff640 1 -- 172.21.15.28:0/1137322337 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd0b4007380 con 0x7fd0c40a6c60 2023-12-16T03:28:04.632 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2023-12-16T03:28:04.632 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1lvVeHJBAAIUmgW3XLan0rUG31Cw+zwQ== 2023-12-16T03:28:04.632 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2023-12-16T03:28:04.632 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2023-12-16T03:28:04.632 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-16T03:28:04.632 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2023-12-16T03:28:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 -- 172.21.15.28:0/1137322337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0b0066470 msgr2=0x7fd0b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0b0066470 0x7fd0b0068930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80ad000 tx=0x7fd0b8004740 comp rx=0 tx=0).stop 2023-12-16T03:28:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 -- 172.21.15.28:0/1137322337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0c40a6c60 msgr2=0x7fd0c41ed500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0c40a6c60 0x7fd0c41ed500 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400d5f0 tx=0x7fd0b400dab0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 -- 172.21.15.28:0/1137322337 shutdown_connections 2023-12-16T03:28:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c41578f0 0x7fd0c40ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd0c40c2840 0x7fd0c40abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd0b0066470 0x7fd0b0068930 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 --2- 172.21.15.28:0/1137322337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0c40a6c60 0x7fd0c41ed500 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 -- 172.21.15.28:0/1137322337 >> 172.21.15.28:0/1137322337 conn(0x7fd0c40c7e40 msgr2=0x7fd0c40c2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 -- 172.21.15.28:0/1137322337 shutdown_connections 2023-12-16T03:28:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.631+0000 7fd0c9df5640 1 -- 172.21.15.28:0/1137322337 wait complete. 2023-12-16T03:28:04.654 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:28:04.671 INFO:tasks.ceph.mds.a.smithi028.stderr:2023-12-16T03:28:04.667+0000 7f69ceed3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:28:04.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.795+0000 7f2b7c69a640 1 Processor -- start 2023-12-16T03:28:04.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.795+0000 7f2b7c69a640 1 -- start start 2023-12-16T03:28:04.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.795+0000 7f2b7c69a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c63c0 0x7f2b740c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.795+0000 7f2b7c69a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b740c31c0 con 0x7f2b740c2bb0 2023-12-16T03:28:04.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.795+0000 7f2b7c69a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b740c34a0 con 0x7f2b740c4100 2023-12-16T03:28:04.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.795+0000 7f2b7c69a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740c1030 con 0x7f2b740c63c0 2023-12-16T03:28:04.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.795+0000 7f2b7ac37640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2b740c2bb0 0x7f2b740a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55038/0 (socket says 172.21.15.28:55038) 2023-12-16T03:28:04.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.795+0000 7f2b7ac37640 1 -- 172.21.15.28:0/285233970 learned_addr learned my addr 172.21.15.28:0/285233970 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.795+0000 7f2b7a436640 1 --2- 172.21.15.28:0/285233970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c63c0 0x7f2b740c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b79434640 1 -- 172.21.15.28:0/285233970 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225841849 0 0) 0x7f2b740c31c0 con 0x7f2b740c2bb0 2023-12-16T03:28:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b79434640 1 -- 172.21.15.28:0/285233970 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b60003530 con 0x7f2b740c2bb0 2023-12-16T03:28:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b79434640 1 -- 172.21.15.28:0/285233970 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728344245 0 0) 0x7f2b740c34a0 con 0x7f2b740c4100 2023-12-16T03:28:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b79434640 1 -- 172.21.15.28:0/285233970 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b740c31c0 con 0x7f2b740c4100 2023-12-16T03:28:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b7a436640 1 -- 172.21.15.28:0/285233970 >> v1:172.21.15.134:6789/0 conn(0x7f2b740c4100 legacy=0x7f2b740c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b79434640 1 -- 172.21.15.28:0/285233970 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3788963992 0 0) 0x7f2b60003530 con 0x7f2b740c2bb0 2023-12-16T03:28:04.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b7a436640 1 -- 172.21.15.28:0/285233970 >> v1:172.21.15.28:6789/0 conn(0x7f2b740c2bb0 legacy=0x7f2b740a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b7a436640 1 -- 172.21.15.28:0/285233970 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b740c1310 con 0x7f2b740c63c0 2023-12-16T03:28:04.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b7a436640 1 --2- 172.21.15.28:0/285233970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c63c0 0x7f2b740c06d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b700097f0 tx=0x7f2b7001c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e101ff591049003 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:04.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b79434640 1 -- 172.21.15.28:0/285233970 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c001a00 con 0x7f2b740c63c0 2023-12-16T03:28:04.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b79434640 1 -- 172.21.15.28:0/285233970 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b700a7050 con 0x7f2b740c63c0 2023-12-16T03:28:04.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.799+0000 7f2b79434640 1 -- 172.21.15.28:0/285233970 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700ab620 con 0x7f2b740c63c0 2023-12-16T03:28:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 -- 172.21.15.28:0/285233970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c63c0 msgr2=0x7f2b740c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 --2- 172.21.15.28:0/285233970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c63c0 0x7f2b740c06d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b700097f0 tx=0x7f2b7001c290 comp rx=0 tx=0).stop 2023-12-16T03:28:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 -- 172.21.15.28:0/285233970 shutdown_connections 2023-12-16T03:28:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 --2- 172.21.15.28:0/285233970 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c63c0 0x7f2b740c06d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 -- 172.21.15.28:0/285233970 >> 172.21.15.28:0/285233970 conn(0x7f2b7406a5b0 msgr2=0x7f2b7406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 -- 172.21.15.28:0/285233970 shutdown_connections 2023-12-16T03:28:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 -- 172.21.15.28:0/285233970 wait complete. 2023-12-16T03:28:04.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 Processor -- start 2023-12-16T03:28:04.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 -- start start 2023-12-16T03:28:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b740c2bb0 0x7f2b740bffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c4100 0x7f2b740a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b740c63c0 0x7f2b740a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740a7780 con 0x7f2b740c2bb0 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b741f0920 con 0x7f2b740c63c0 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7c69a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b741f0be0 con 0x7f2b740c4100 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7a436640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b740c2bb0 0x7f2b740bffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7a436640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b740c2bb0 0x7f2b740bffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57858/0 (socket says 172.21.15.28:57858) 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7a436640 1 -- 172.21.15.28:0/2533038755 learned_addr learned my addr 172.21.15.28:0/2533038755 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7ac37640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b740c63c0 0x7f2b740a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b79c35640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c4100 0x7f2b740a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7a436640 1 -- 172.21.15.28:0/2533038755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c4100 msgr2=0x7f2b740a4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7a436640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c4100 0x7f2b740a4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7a436640 1 -- 172.21.15.28:0/2533038755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b740c63c0 msgr2=0x7f2b740a3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7a436640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b740c63c0 0x7f2b740a3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7a436640 1 -- 172.21.15.28:0/2533038755 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70009420 con 0x7f2b740c2bb0 2023-12-16T03:28:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b79c35640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c4100 0x7f2b740a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:04.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.803+0000 7f2b7a436640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b740c2bb0 0x7f2b740bffd0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009740 tx=0x7f2b70019030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:04.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.807+0000 7f2b6affd640 1 -- 172.21.15.28:0/2533038755 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700abd10 con 0x7f2b740c2bb0 2023-12-16T03:28:04.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.807+0000 7f2b6affd640 1 -- 172.21.15.28:0/2533038755 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b700abe70 con 0x7f2b740c2bb0 2023-12-16T03:28:04.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.807+0000 7f2b7c69a640 1 -- 172.21.15.28:0/2533038755 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b740c69b0 con 0x7f2b740c2bb0 2023-12-16T03:28:04.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.807+0000 7f2b6affd640 1 -- 172.21.15.28:0/2533038755 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70004220 con 0x7f2b740c2bb0 2023-12-16T03:28:04.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.807+0000 7f2b7c69a640 1 -- 172.21.15.28:0/2533038755 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b741f11a0 con 0x7f2b740c2bb0 2023-12-16T03:28:04.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.807+0000 7f2b7c69a640 1 -- 172.21.15.28:0/2533038755 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b74068400 con 0x7f2b740c2bb0 2023-12-16T03:28:04.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.807+0000 7f2b6affd640 1 -- 172.21.15.28:0/2533038755 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2b700b2040 con 0x7f2b740c2bb0 2023-12-16T03:28:04.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.807+0000 7f2b6affd640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2b58066470 0x7f2b58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:04.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.807+0000 7f2b6affd640 1 -- 172.21.15.28:0/2533038755 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b7011e080 con 0x7f2b740c2bb0 2023-12-16T03:28:04.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.807+0000 7f2b79c35640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2b58066470 0x7f2b58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:04.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.807+0000 7f2b79c35640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2b58066470 0x7f2b58068930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2b740a7370 tx=0x7f2b64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:04.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:04.811+0000 7f2b6affd640 1 -- 172.21.15.28:0/2533038755 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2b7014f290 con 0x7f2b740c2bb0 2023-12-16T03:28:05.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.003+0000 7f2b7c69a640 1 -- 172.21.15.28:0/2533038755 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b740c0c90 con 0x7f2b740c2bb0 2023-12-16T03:28:05.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b6affd640 1 -- 172.21.15.28:0/2533038755 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f2b700bc020 con 0x7f2b740c2bb0 2023-12-16T03:28:05.009 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:05.009 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/651767003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":651767003},{"type":"v1","addr":"172.21.15.28:6837","nonce":651767003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4202659808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4202659808},{"type":"v1","addr":"172.21.15.134:6834","nonce":4202659808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/931138884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":931138884},{"type":"v1","addr":"172.21.15.134:6835","nonce":931138884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:59.086495+0000","modified":"2023-12-16T03:28:02.105487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/2582425067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2582425067},{"type":"v1","addr":"172.21.15.28:6836","nonce":2582425067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-16T03:28:05.009 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 46 2023-12-16T03:28:05.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 -- 172.21.15.28:0/2533038755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2b58066470 msgr2=0x7f2b58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2b58066470 0x7f2b58068930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2b740a7370 tx=0x7f2b64009040 comp rx=0 tx=0).stop 2023-12-16T03:28:05.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 -- 172.21.15.28:0/2533038755 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b740c2bb0 msgr2=0x7f2b740bffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b740c2bb0 0x7f2b740bffd0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009740 tx=0x7f2b70019030 comp rx=0 tx=0).stop 2023-12-16T03:28:05.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 -- 172.21.15.28:0/2533038755 shutdown_connections 2023-12-16T03:28:05.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b740c63c0 0x7f2b740a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2b740c4100 0x7f2b740a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2b58066470 0x7f2b58068930 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 --2- 172.21.15.28:0/2533038755 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b740c2bb0 0x7f2b740bffd0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 -- 172.21.15.28:0/2533038755 >> 172.21.15.28:0/2533038755 conn(0x7f2b7406a5b0 msgr2=0x7f2b74070330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:05.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 -- 172.21.15.28:0/2533038755 shutdown_connections 2023-12-16T03:28:05.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.007+0000 7f2b7c69a640 1 -- 172.21.15.28:0/2533038755 wait complete. 2023-12-16T03:28:05.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-16T03:27:59.086495+0000', 'modified': '2023-12-16T03:28:02.105487+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6492}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6492': {'gid': 6492, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.28:6836/2582425067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6834', 'nonce': 2582425067}, {'type': 'v1', 'addr': '172.21.15.28:6836', 'nonce': 2582425067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-16T03:28:05.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-16T03:28:05.433 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-16T03:28:05.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffea79640 1 Processor -- start 2023-12-16T03:28:05.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffea79640 1 -- start start 2023-12-16T03:28:05.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffea79640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6ff80c63c0 0x7f6ff80c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffea79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c4100 0x7f6ff80c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffea79640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff80c31c0 con 0x7f6ff80c29e0 2023-12-16T03:28:05.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffea79640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff80c34a0 con 0x7f6ff80c63c0 2023-12-16T03:28:05.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffea79640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80c1030 con 0x7f6ff80c4100 2023-12-16T03:28:05.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffc815640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6ff80c63c0 0x7f6ff80c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffc815640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6ff80c63c0 0x7f6ff80c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57864/0 (socket says 172.21.15.28:57864) 2023-12-16T03:28:05.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffc815640 1 -- 172.21.15.28:0/1231101125 learned_addr learned my addr 172.21.15.28:0/1231101125 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:05.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/1231101125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c4100 0x7f6ff80c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffc815640 1 -- 172.21.15.28:0/1231101125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c4100 msgr2=0x7f6ff80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:05.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffc815640 1 --2- 172.21.15.28:0/1231101125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c4100 0x7f6ff80c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffc815640 1 -- 172.21.15.28:0/1231101125 >> v1:172.21.15.134:6789/0 conn(0x7f6ff80c29e0 legacy=0x7f6ff80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:05.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ffc815640 1 -- 172.21.15.28:0/1231101125 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80c1310 con 0x7f6ff80c63c0 2023-12-16T03:28:05.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.579+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/1231101125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c4100 0x7f6ff80c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:05.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ffc815640 1 --2- 172.21.15.28:0/1231101125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ff80c63c0 0x7f6ff80c06d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009870 tx=0x7f6fec01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64afe7a49e63d293 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:05.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ff77fe640 1 -- 172.21.15.28:0/1231101125 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0ad640 con 0x7f6ff80c63c0 2023-12-16T03:28:05.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ff77fe640 1 -- 172.21.15.28:0/1231101125 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec0ad7a0 con 0x7f6ff80c63c0 2023-12-16T03:28:05.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ff77fe640 1 -- 172.21.15.28:0/1231101125 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0adb30 con 0x7f6ff80c63c0 2023-12-16T03:28:05.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ffea79640 1 -- 172.21.15.28:0/1231101125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ff80c63c0 msgr2=0x7f6ff80c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ffea79640 1 --2- 172.21.15.28:0/1231101125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ff80c63c0 0x7f6ff80c06d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009870 tx=0x7f6fec01c3b0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ffea79640 1 -- 172.21.15.28:0/1231101125 shutdown_connections 2023-12-16T03:28:05.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ffea79640 1 --2- 172.21.15.28:0/1231101125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c4100 0x7f6ff80c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ffea79640 1 --2- 172.21.15.28:0/1231101125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ff80c63c0 0x7f6ff80c06d0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ffea79640 1 -- 172.21.15.28:0/1231101125 >> 172.21.15.28:0/1231101125 conn(0x7f6ff806a5b0 msgr2=0x7f6ff806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:05.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ffea79640 1 -- 172.21.15.28:0/1231101125 shutdown_connections 2023-12-16T03:28:05.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.583+0000 7f6ffea79640 1 -- 172.21.15.28:0/1231101125 wait complete. 2023-12-16T03:28:05.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffea79640 1 Processor -- start 2023-12-16T03:28:05.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffea79640 1 -- start start 2023-12-16T03:28:05.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffea79640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff80c29e0 0x7f6ff81f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffea79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ff80c4100 0x7f6ff815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffea79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c63c0 0x7f6ff815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffea79640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff815d8c0 con 0x7f6ff80c4100 2023-12-16T03:28:05.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffea79640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff815b650 con 0x7f6ff80c29e0 2023-12-16T03:28:05.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffea79640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff815edb0 con 0x7f6ff80c63c0 2023-12-16T03:28:05.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ff80c4100 0x7f6ff815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ff80c4100 0x7f6ff815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57868/0 (socket says 172.21.15.28:57868) 2023-12-16T03:28:05.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff7fff640 1 -- 172.21.15.28:0/310655401 learned_addr learned my addr 172.21.15.28:0/310655401 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:05.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffc815640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff80c29e0 0x7f6ff81f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff7fff640 1 -- 172.21.15.28:0/310655401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c63c0 msgr2=0x7f6ff815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffd016640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c63c0 0x7f6ff815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c63c0 0x7f6ff815b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff7fff640 1 -- 172.21.15.28:0/310655401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff80c29e0 msgr2=0x7f6ff81f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff80c29e0 0x7f6ff81f05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff7fff640 1 -- 172.21.15.28:0/310655401 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0094d0 con 0x7f6ff80c4100 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffc815640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff80c29e0 0x7f6ff81f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffd016640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c63c0 0x7f6ff815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ff80c4100 0x7f6ff815abd0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400c7c0 tx=0x7f6fe400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff57fa640 1 -- 172.21.15.28:0/310655401 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4007a30 con 0x7f6ff80c4100 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff57fa640 1 -- 172.21.15.28:0/310655401 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe4007b90 con 0x7f6ff80c4100 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ff57fa640 1 -- 172.21.15.28:0/310655401 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe400ce70 con 0x7f6ff80c4100 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffea79640 1 -- 172.21.15.28:0/310655401 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff81f0e80 con 0x7f6ff80c4100 2023-12-16T03:28:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.587+0000 7f6ffea79640 1 -- 172.21.15.28:0/310655401 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff815e010 con 0x7f6ff80c4100 2023-12-16T03:28:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff57fa640 1 -- 172.21.15.28:0/310655401 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6fe40113f0 con 0x7f6ff80c4100 2023-12-16T03:28:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff57fa640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6fdc066470 0x7f6fdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff57fa640 1 -- 172.21.15.28:0/310655401 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fe4084310 con 0x7f6ff80c4100 2023-12-16T03:28:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f7001df0000 1 Processor -- start 2023-12-16T03:28:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ffc815640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6fdc066470 0x7f6fdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f7001df0000 1 -- start start 2023-12-16T03:28:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ffc815640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6fdc066470 0x7f6fdc068930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0af000 tx=0x7f6fec0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f7001df0000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50d660 0x5579ab50da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f7001df0000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab50e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f7001df0000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50e8a0 0x5579ab557df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f7001df0000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ab3d7f10 con 0x5579ab50df80 2023-12-16T03:28:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f7001df0000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ab347dd0 con 0x5579ab50d660 2023-12-16T03:28:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f7001df0000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579ab345300 con 0x5579ab50e8a0 2023-12-16T03:28:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab50e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab50e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57876/0 (socket says 172.21.15.28:57876) 2023-12-16T03:28:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff7fff640 1 -- 172.21.15.28:0/1835611490 learned_addr learned my addr 172.21.15.28:0/1835611490 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ffc815640 1 --2- 172.21.15.28:0/1835611490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50d660 0x5579ab50da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ffd016640 1 --2- 172.21.15.28:0/1835611490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50e8a0 0x5579ab557df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff7fff640 1 -- 172.21.15.28:0/1835611490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50e8a0 msgr2=0x5579ab557df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:05.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/1835611490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50e8a0 0x5579ab557df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff7fff640 1 -- 172.21.15.28:0/1835611490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50d660 msgr2=0x5579ab50da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:05.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/1835611490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50d660 0x5579ab50da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff7fff640 1 -- 172.21.15.28:0/1835611490 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579ab038890 con 0x5579ab50df80 2023-12-16T03:28:05.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ffc815640 1 --2- 172.21.15.28:0/1835611490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50d660 0x5579ab50da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:05.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/1835611490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab50e360 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6fe405d210 tx=0x7f6fe4055c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5de853eb097a3d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:05.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.591+0000 7f6fe27fc640 1 -- 172.21.15.28:0/1835611490 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe405d740 con 0x5579ab50df80 2023-12-16T03:28:05.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6fe27fc640 1 -- 172.21.15.28:0/1835611490 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe4053580 con 0x5579ab50df80 2023-12-16T03:28:05.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6fe27fc640 1 -- 172.21.15.28:0/1835611490 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4051b50 con 0x5579ab50df80 2023-12-16T03:28:05.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 -- 172.21.15.28:0/1835611490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 msgr2=0x5579ab50e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 --2- 172.21.15.28:0/1835611490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab50e360 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6fe405d210 tx=0x7f6fe4055c80 comp rx=0 tx=0).stop 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 -- 172.21.15.28:0/1835611490 shutdown_connections 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 --2- 172.21.15.28:0/1835611490 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50e8a0 0x5579ab557df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 --2- 172.21.15.28:0/1835611490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab50e360 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 --2- 172.21.15.28:0/1835611490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50d660 0x5579ab50da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 -- 172.21.15.28:0/1835611490 >> 172.21.15.28:0/1835611490 conn(0x5579ab516300 msgr2=0x5579ab54db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 -- 172.21.15.28:0/1835611490 shutdown_connections 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 -- 172.21.15.28:0/1835611490 wait complete. 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 -- start start 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 Processor -- start 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 0x5579ab512410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab512950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50e8a0 0x5579ab512e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ab340bf0 con 0x5579ab50df80 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ab2f8c60 con 0x5579ab50e8a0 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579ab2feb00 con 0x5579ab50d660 2023-12-16T03:28:05.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f7001df0000 10 client.0 _ll_register_callbacks cb 0x5579ab4fb720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab512950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab512950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57888/0 (socket says 172.21.15.28:57888) 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6ff7fff640 1 -- 172.21.15.28:0/1632012475 learned_addr learned my addr 172.21.15.28:0/1632012475 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6ffd016640 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50e8a0 0x5579ab512e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6ffc815640 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 0x5579ab512410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6ff7fff640 1 -- 172.21.15.28:0/1632012475 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 msgr2=0x5579ab512410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 0x5579ab512410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6ff7fff640 1 -- 172.21.15.28:0/1632012475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50e8a0 msgr2=0x5579ab512e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50e8a0 0x5579ab512e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6ff7fff640 1 -- 172.21.15.28:0/1632012475 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff815e010 con 0x5579ab50df80 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab512950 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400cfd0 tx=0x7f6fe4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9648aac5206691a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.595+0000 7f6fd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f6fd77fe640 1 -- 172.21.15.28:0/1632012475 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4054b30 con 0x5579ab50df80 2023-12-16T03:28:05.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f6fd77fe640 1 -- 172.21.15.28:0/1632012475 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fe406a070 con 0x5579ab50df80 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 -- 172.21.15.28:0/1632012475 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579ab2fe490 con 0x5579ab50df80 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f6fd77fe640 1 -- 172.21.15.28:0/1632012475 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fe4053640 con 0x5579ab50df80 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 10 client.6633 fetch_fsmap learned FSMap version 46 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 -- 172.21.15.28:0/1632012475 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x5579ab301200 con 0x5579ab50df80 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f6fd77fe640 1 -- 172.21.15.28:0/1632012475 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5579ab2fe490 con 0x5579ab50df80 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f6fd77fe640 1 -- 172.21.15.28:0/1632012475 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6fe4021070 con 0x5579ab50df80 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 10 client.6633 fetch_fsmap finished waiting for FSMap version 46 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 10 client.6633 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 20 client.6633 populate_metadata read hostname 'smithi028' 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.28:6834/2582425067,v1:172.21.15.28:6836/2582425067] conn(0x5579ab560150 0x5579ab562540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 4 client.6633 mds_command: new command op to 6492 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 -- 172.21.15.28:0/1632012475 --> [v2:172.21.15.28:6834/2582425067,v1:172.21.15.28:6836/2582425067] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5579ab33f540 con 0x5579ab560150 2023-12-16T03:28:05.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f6ffc815640 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.28:6834/2582425067,v1:172.21.15.28:6836/2582425067] conn(0x5579ab560150 0x5579ab562540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f6ffc815640 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.28:6834/2582425067,v1:172.21.15.28:6836/2582425067] conn(0x5579ab560150 0x5579ab562540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ca70f7b05372c11 server_cookie=7e07c51b681dd5f8 in_seq=0 out_seq=0 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f6fd77fe640 10 client.6633 ms_handle_connect on v2:172.21.15.28:6834/2582425067 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f6fd77fe640 1 -- 172.21.15.28:0/1632012475 <== mds.0 v2:172.21.15.28:6834/2582425067 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5579ab33f540 con 0x5579ab560150 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f6fd77fe640 10 client.6633 handle_command_reply: tid=0 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 client.6633 shutdown 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 -- 172.21.15.28:0/1632012475 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 msgr2=0x5579ab512950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab512950 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400cfd0 tx=0x7f6fe4000bd0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 -- 172.21.15.28:0/1632012475 shutdown_connections 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.28:6834/2582425067,v1:172.21.15.28:6836/2582425067] conn(0x5579ab560150 0x5579ab562540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50e8a0 0x5579ab512e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab512950 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 --2- 172.21.15.28:0/1632012475 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 0x5579ab512410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 -- 172.21.15.28:0/1632012475 >> 172.21.15.28:0/1632012475 conn(0x5579ab516300 msgr2=0x5579ab50cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f6fd77fe640 0 client.6633 ms_handle_reset on v2:172.21.15.28:6834/2582425067 2023-12-16T03:28:05.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 -- 172.21.15.28:0/1632012475 shutdown_connections 2023-12-16T03:28:05.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 1 -- 172.21.15.28:0/1632012475 wait complete. 2023-12-16T03:28:05.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.599+0000 7f7001df0000 20 client.6633 trim_cache size 0 max 16384 2023-12-16T03:28:05.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f7001df0000 1 Processor -- start 2023-12-16T03:28:05.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f7001df0000 1 -- start start 2023-12-16T03:28:05.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f7001df0000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 0x5579ab5aa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f7001df0000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50df80 0x5579ab5aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f7001df0000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50e8a0 0x5579ab5aade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f7001df0000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579aaff9940 con 0x5579ab50e8a0 2023-12-16T03:28:05.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f7001df0000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ab34b020 con 0x5579ab50df80 2023-12-16T03:28:05.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f7001df0000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579ab2f8c60 con 0x5579ab50d660 2023-12-16T03:28:05.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f6ffd016640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50e8a0 0x5579ab5aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f6ffd016640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50e8a0 0x5579ab5aade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57894/0 (socket says 172.21.15.28:57894) 2023-12-16T03:28:05.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f6ffd016640 1 -- 172.21.15.28:0/4010441345 learned_addr learned my addr 172.21.15.28:0/4010441345 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:05.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/4010441345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50df80 0x5579ab5aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.615+0000 7f6ffc815640 1 --2- 172.21.15.28:0/4010441345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 0x5579ab5aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ffd016640 1 -- 172.21.15.28:0/4010441345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 msgr2=0x5579ab5aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:05.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ffd016640 1 --2- 172.21.15.28:0/4010441345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 0x5579ab5aa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ffd016640 1 -- 172.21.15.28:0/4010441345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50df80 msgr2=0x5579ab5aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:05.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ffd016640 1 --2- 172.21.15.28:0/4010441345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50df80 0x5579ab5aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ffd016640 1 -- 172.21.15.28:0/4010441345 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579ab2e7500 con 0x5579ab50e8a0 2023-12-16T03:28:05.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ffd016640 1 --2- 172.21.15.28:0/4010441345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50e8a0 0x5579ab5aade0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0005640 tx=0x7f6ff0012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240527600ca429ff server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:05.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6fe2ffd640 1 -- 172.21.15.28:0/4010441345 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0012ec0 con 0x5579ab50e8a0 2023-12-16T03:28:05.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6fe2ffd640 1 -- 172.21.15.28:0/4010441345 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff000d050 con 0x5579ab50e8a0 2023-12-16T03:28:05.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6fe2ffd640 1 -- 172.21.15.28:0/4010441345 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0015440 con 0x5579ab50e8a0 2023-12-16T03:28:05.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 -- 172.21.15.28:0/4010441345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50e8a0 msgr2=0x5579ab5aade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 --2- 172.21.15.28:0/4010441345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50e8a0 0x5579ab5aade0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0005640 tx=0x7f6ff0012690 comp rx=0 tx=0).stop 2023-12-16T03:28:05.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 -- 172.21.15.28:0/4010441345 shutdown_connections 2023-12-16T03:28:05.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 --2- 172.21.15.28:0/4010441345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50e8a0 0x5579ab5aade0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 --2- 172.21.15.28:0/4010441345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50df80 0x5579ab5aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 --2- 172.21.15.28:0/4010441345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 0x5579ab5aa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 -- 172.21.15.28:0/4010441345 >> 172.21.15.28:0/4010441345 conn(0x5579ab516300 msgr2=0x5579ab5495f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:05.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 -- 172.21.15.28:0/4010441345 shutdown_connections 2023-12-16T03:28:05.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 -- 172.21.15.28:0/4010441345 wait complete. 2023-12-16T03:28:05.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 -- start start 2023-12-16T03:28:05.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 Processor -- start 2023-12-16T03:28:05.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 0x5579ab5ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab5aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50e8a0 0x5579ab5af630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ab33dff0 con 0x5579ab50df80 2023-12-16T03:28:05.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ab3a2260 con 0x5579ab50e8a0 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579ab343750 con 0x5579ab50d660 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f7001df0000 10 client.0 _ll_register_callbacks cb 0x5579ab4dbf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab5aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab5aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57908/0 (socket says 172.21.15.28:57908) 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ff7fff640 1 -- 172.21.15.28:0/2550535601 learned_addr learned my addr 172.21.15.28:0/2550535601 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ffd016640 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50e8a0 0x5579ab5af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ff7fff640 1 -- 172.21.15.28:0/2550535601 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 msgr2=0x5579ab5ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 0x5579ab5ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ff7fff640 1 -- 172.21.15.28:0/2550535601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50e8a0 msgr2=0x5579ab5af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50e8a0 0x5579ab5af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ff7fff640 1 -- 172.21.15.28:0/2550535601 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff0005320 con 0x5579ab50df80 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.619+0000 7f6ffd016640 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50e8a0 0x5579ab5af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ff7fff640 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab5aeb30 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4007410 tx=0x7f6fe4057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c75a2456c3d9de server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:05.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6fd77fe640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6fd77fe640 1 -- 172.21.15.28:0/2550535601 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4053640 con 0x5579ab50df80 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6fd77fe640 1 -- 172.21.15.28:0/2550535601 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fe406a040 con 0x5579ab50df80 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 -- 172.21.15.28:0/2550535601 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579ab2c7a50 con 0x5579ab50df80 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6fd77fe640 1 -- 172.21.15.28:0/2550535601 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fe4059360 con 0x5579ab50df80 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 10 client.6639 fetch_fsmap learned FSMap version 46 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 -- 172.21.15.28:0/2550535601 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x5579ab038cc0 con 0x5579ab50df80 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6fd77fe640 1 -- 172.21.15.28:0/2550535601 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5579ab2c7a50 con 0x5579ab50df80 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6fd77fe640 1 -- 172.21.15.28:0/2550535601 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6fe4021040 con 0x5579ab50df80 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 10 client.6639 fetch_fsmap finished waiting for FSMap version 46 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 10 client.6639 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 20 client.6639 populate_metadata read hostname 'smithi028' 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.28:6834/2582425067,v1:172.21.15.28:6836/2582425067] conn(0x5579ab5afb70 0x5579ab5aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 4 client.6639 mds_command: new command op to 6492 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 -- 172.21.15.28:0/2550535601 --> [v2:172.21.15.28:6834/2582425067,v1:172.21.15.28:6836/2582425067] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5579ab38ef40 con 0x5579ab5afb70 2023-12-16T03:28:05.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffc815640 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.28:6834/2582425067,v1:172.21.15.28:6836/2582425067] conn(0x5579ab5afb70 0x5579ab5aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6fd77fe640 10 client.6639 ms_handle_connect on v2:172.21.15.28:6834/2582425067 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffc815640 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.28:6834/2582425067,v1:172.21.15.28:6836/2582425067] conn(0x5579ab5afb70 0x5579ab5aff50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78657f09bd5a9aa2 server_cookie=94b2eb8c8a43602f in_seq=0 out_seq=0 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6fd77fe640 1 -- 172.21.15.28:0/2550535601 <== mds.0 v2:172.21.15.28:6834/2582425067 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5579ab38ef40 con 0x5579ab5afb70 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6fd77fe640 10 client.6639 handle_command_reply: tid=0 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 client.6639 shutdown 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 -- 172.21.15.28:0/2550535601 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 msgr2=0x5579ab5aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab5aeb30 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4007410 tx=0x7f6fe4057000 comp rx=0 tx=0).stop 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 -- 172.21.15.28:0/2550535601 shutdown_connections 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.28:6834/2582425067,v1:172.21.15.28:6836/2582425067] conn(0x5579ab5afb70 0x5579ab5aff50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5579ab50e8a0 0x5579ab5af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5579ab50df80 0x5579ab5aeb30 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 --2- 172.21.15.28:0/2550535601 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5579ab50d660 0x5579ab5ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6fd77fe640 0 client.6639 ms_handle_reset on v2:172.21.15.28:6834/2582425067 2023-12-16T03:28:05.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 -- 172.21.15.28:0/2550535601 >> 172.21.15.28:0/2550535601 conn(0x5579ab516300 msgr2=0x5579ab548d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:05.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 -- 172.21.15.28:0/2550535601 shutdown_connections 2023-12-16T03:28:05.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 1 -- 172.21.15.28:0/2550535601 wait complete. 2023-12-16T03:28:05.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f7001df0000 20 client.6639 trim_cache size 0 max 16384 2023-12-16T03:28:05.631 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:28:05.631 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "96b65b79-be1d-4832-b923-85c874d6fb27", 2023-12-16T03:28:05.631 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2023-12-16T03:28:05.631 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 6492, 2023-12-16T03:28:05.631 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2023-12-16T03:28:05.631 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2023-12-16T03:28:05.631 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2023-12-16T03:28:05.631 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 5.9320293470000003, 2023-12-16T03:28:05.632 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 46, 2023-12-16T03:28:05.632 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 68, 2023-12-16T03:28:05.632 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 68, 2023-12-16T03:28:05.632 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 11.866004758000001 2023-12-16T03:28:05.632 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 -- 172.21.15.28:0/310655401 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6fdc066470 msgr2=0x7f6fdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6fdc066470 0x7f6fdc068930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0af000 tx=0x7f6fec0a7070 comp rx=0 tx=0).stop 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 -- 172.21.15.28:0/310655401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ff80c4100 msgr2=0x7f6ff815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ff80c4100 0x7f6ff815abd0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400c7c0 tx=0x7f6fe400cc80 comp rx=0 tx=0).stop 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 -- 172.21.15.28:0/310655401 shutdown_connections 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6ff80c63c0 0x7f6ff815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6fdc066470 0x7f6fdc068930 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ff80c4100 0x7f6ff815abd0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 --2- 172.21.15.28:0/310655401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ff80c29e0 0x7f6ff81f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 -- 172.21.15.28:0/310655401 >> 172.21.15.28:0/310655401 conn(0x7f6ff806a5b0 msgr2=0x7f6ff806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 -- 172.21.15.28:0/310655401 shutdown_connections 2023-12-16T03:28:05.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.623+0000 7f6ffea79640 1 -- 172.21.15.28:0/310655401 wait complete. 2023-12-16T03:28:05.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:28:05.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af3c32640 1 Processor -- start 2023-12-16T03:28:05.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af3c32640 1 -- start start 2023-12-16T03:28:05.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af3c32640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9aec1560e0 0x7f9aec15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af3c32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9aec06d520 0x7f9aec159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af3c32640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aec15c600 con 0x7f9aec0bffc0 2023-12-16T03:28:05.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af3c32640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aec1594e0 con 0x7f9aec1560e0 2023-12-16T03:28:05.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af3c32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec1597c0 con 0x7f9aec06d520 2023-12-16T03:28:05.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af19ce640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9aec1560e0 0x7f9aec15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af21cf640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9aec0bffc0 0x7f9aec0c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55044/0 (socket says 172.21.15.28:55044) 2023-12-16T03:28:05.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af21cf640 1 -- 172.21.15.28:0/3295917059 learned_addr learned my addr 172.21.15.28:0/3295917059 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:05.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af11cd640 1 --2- 172.21.15.28:0/3295917059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9aec06d520 0x7f9aec159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af19ce640 1 -- 172.21.15.28:0/3295917059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9aec06d520 msgr2=0x7f9aec159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:05.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af19ce640 1 --2- 172.21.15.28:0/3295917059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9aec06d520 0x7f9aec159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af19ce640 1 -- 172.21.15.28:0/3295917059 >> v1:172.21.15.28:6789/0 conn(0x7f9aec0bffc0 legacy=0x7f9aec0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.787+0000 7f9af19ce640 1 -- 172.21.15.28:0/3295917059 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec15bfb0 con 0x7f9aec1560e0 2023-12-16T03:28:05.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af19ce640 1 --2- 172.21.15.28:0/3295917059 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9aec1560e0 0x7f9aec15ca90 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80097c0 tx=0x7f9ae801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966a44dedbf86b4b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:05.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af09cc640 1 -- 172.21.15.28:0/3295917059 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec1566d0 con 0x7f9aec1560e0 2023-12-16T03:28:05.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af09cc640 1 -- 172.21.15.28:0/3295917059 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae80ab670 con 0x7f9aec1560e0 2023-12-16T03:28:05.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af09cc640 1 -- 172.21.15.28:0/3295917059 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80aba00 con 0x7f9aec1560e0 2023-12-16T03:28:05.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af3c32640 1 -- 172.21.15.28:0/3295917059 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9aec1560e0 msgr2=0x7f9aec15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af3c32640 1 --2- 172.21.15.28:0/3295917059 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9aec1560e0 0x7f9aec15ca90 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80097c0 tx=0x7f9ae801c450 comp rx=0 tx=0).stop 2023-12-16T03:28:05.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af3c32640 1 -- 172.21.15.28:0/3295917059 shutdown_connections 2023-12-16T03:28:05.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af3c32640 1 --2- 172.21.15.28:0/3295917059 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9aec06d520 0x7f9aec159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af3c32640 1 --2- 172.21.15.28:0/3295917059 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9aec1560e0 0x7f9aec15ca90 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af3c32640 1 -- 172.21.15.28:0/3295917059 >> 172.21.15.28:0/3295917059 conn(0x7f9aec06a5b0 msgr2=0x7f9aec06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:05.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af3c32640 1 -- 172.21.15.28:0/3295917059 shutdown_connections 2023-12-16T03:28:05.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.791+0000 7f9af3c32640 1 -- 172.21.15.28:0/3295917059 wait complete. 2023-12-16T03:28:05.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af3c32640 1 Processor -- start 2023-12-16T03:28:05.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af3c32640 1 -- start start 2023-12-16T03:28:05.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af3c32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9aec06d520 0x7f9aec155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af3c32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9aec0bffc0 0x7f9aec0aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af3c32640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9aec1560e0 0x7f9aec0aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af3c32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec0a9700 con 0x7f9aec06d520 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af3c32640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec0a9f60 con 0x7f9aec1560e0 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af3c32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec157bc0 con 0x7f9aec0bffc0 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af19ce640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9aec06d520 0x7f9aec155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af19ce640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9aec06d520 0x7f9aec155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57920/0 (socket says 172.21.15.28:57920) 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af19ce640 1 -- 172.21.15.28:0/2205434295 learned_addr learned my addr 172.21.15.28:0/2205434295 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af21cf640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9aec1560e0 0x7f9aec0aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af11cd640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9aec0bffc0 0x7f9aec0aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af19ce640 1 -- 172.21.15.28:0/2205434295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9aec0bffc0 msgr2=0x7f9aec0aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af19ce640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9aec0bffc0 0x7f9aec0aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af19ce640 1 -- 172.21.15.28:0/2205434295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9aec1560e0 msgr2=0x7f9aec0aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:05.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af19ce640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9aec1560e0 0x7f9aec0aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:05.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af19ce640 1 -- 172.21.15.28:0/2205434295 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8009420 con 0x7f9aec06d520 2023-12-16T03:28:05.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af19ce640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9aec06d520 0x7f9aec155290 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9ae801a080 tx=0x7f9ae801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:05.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9ae27fc640 1 -- 172.21.15.28:0/2205434295 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80b5810 con 0x7f9aec06d520 2023-12-16T03:28:05.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9ae27fc640 1 -- 172.21.15.28:0/2205434295 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae80b5990 con 0x7f9aec06d520 2023-12-16T03:28:05.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9ae27fc640 1 -- 172.21.15.28:0/2205434295 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80b5d40 con 0x7f9aec06d520 2023-12-16T03:28:05.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af3c32640 1 -- 172.21.15.28:0/2205434295 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aec1f5800 con 0x7f9aec06d520 2023-12-16T03:28:05.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.795+0000 7f9af3c32640 1 -- 172.21.15.28:0/2205434295 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aec0a9bf0 con 0x7f9aec06d520 2023-12-16T03:28:05.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.799+0000 7f9af3c32640 1 -- 172.21.15.28:0/2205434295 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aec0c69a0 con 0x7f9aec06d520 2023-12-16T03:28:05.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.799+0000 7f9ae27fc640 1 -- 172.21.15.28:0/2205434295 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9ae80b4390 con 0x7f9aec06d520 2023-12-16T03:28:05.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.799+0000 7f9ae27fc640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 0x7f9ad0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:05.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.799+0000 7f9ae27fc640 1 -- 172.21.15.28:0/2205434295 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ae811e5f0 con 0x7f9aec06d520 2023-12-16T03:28:05.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.799+0000 7f9af11cd640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 0x7f9ad0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:05.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.799+0000 7f9af11cd640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 0x7f9ad0068930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9aec1f2660 tx=0x7f9adc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:05.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.803+0000 7f9ae27fc640 1 -- 172.21.15.28:0/2205434295 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9ae80eb9d0 con 0x7f9aec06d520 2023-12-16T03:28:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 -- 172.21.15.28:0/2205434295 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9aec0c0d50 con 0x7f9aec06d520 2023-12-16T03:28:05.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9ae27fc640 1 -- 172.21.15.28:0/2205434295 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9ae80eeff0 con 0x7f9aec06d520 2023-12-16T03:28:05.998 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:28:06.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 -- 172.21.15.28:0/2205434295 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 msgr2=0x7f9ad0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:06.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 0x7f9ad0068930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9aec1f2660 tx=0x7f9adc008040 comp rx=0 tx=0).stop 2023-12-16T03:28:06.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 -- 172.21.15.28:0/2205434295 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9aec06d520 msgr2=0x7f9aec155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:06.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9aec06d520 0x7f9aec155290 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9ae801a080 tx=0x7f9ae801ac90 comp rx=0 tx=0).stop 2023-12-16T03:28:06.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 -- 172.21.15.28:0/2205434295 shutdown_connections 2023-12-16T03:28:06.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9aec1560e0 0x7f9aec0aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9aec0bffc0 0x7f9aec0aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 0x7f9ad0068930 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 --2- 172.21.15.28:0/2205434295 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9aec06d520 0x7f9aec155290 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 -- 172.21.15.28:0/2205434295 >> 172.21.15.28:0/2205434295 conn(0x7f9aec06a5b0 msgr2=0x7f9aec072680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:06.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 -- 172.21.15.28:0/2205434295 shutdown_connections 2023-12-16T03:28:06.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:05.995+0000 7f9af3c32640 1 -- 172.21.15.28:0/2205434295 wait complete. 2023-12-16T03:28:06.019 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-16T03:28:06.019 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:28:06.019 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2023-12-16T03:28:06.019 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-16T03:28:06.019 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T03:28:06.019 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-16T03:28:06.019 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:28:06.020 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:28:06.020 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:28:06.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:06.020 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2023-12-16T03:28:06.030 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:28:06.030 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:28:06.030 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:28:06.030 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:06.030 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2023-12-16T03:28:06.030 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:06.030 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:06.030 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:06.030 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42220sec preferred_lft 42220sec 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:28:06.031 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:9f:0c:41:28 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:28:06.032 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:06.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:06.033 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:28:06.074 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:28:06.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:28:06.092 INFO:teuthology.orchestra.run.smithi028.stdout:1 2023-12-16T03:28:06.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:06.094 DEBUG:teuthology.orchestra.run.smithi028:> route 2023-12-16T03:28:06.177 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2023-12-16T03:28:06.177 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:28:06.177 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-16T03:28:06.177 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:28:06.178 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-16T03:28:06.178 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:28:06.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:06.178 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec bash -c ' 2023-12-16T03:28:06.178 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2023-12-16T03:28:06.178 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-16T03:28:06.178 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-16T03:28:06.178 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-16T03:28:06.178 DEBUG:teuthology.orchestra.run.smithi028:> ') 2023-12-16T03:28:06.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:06.273 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2023-12-16T03:28:06.282 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T03:28:06.283 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:28:06.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:06.283 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2023-12-16T03:28:06.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:28:06.346 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T03:28:06.397 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:28:06.397 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:28:06.452 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-16T03:28:06.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:06.453 DEBUG:teuthology.orchestra.run.smithi028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:06.548 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:06.549 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:28:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:28:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:28:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: trying mount with new device syntax: 0@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs=/ 2023-12-16T03:28:06.563 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:28:06.566 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:28:06.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:06.567 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:28:06.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:06.588 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:28:06.656 INFO:teuthology.orchestra.run.smithi028.stdout:client5840 2023-12-16T03:28:06.656 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:06.656 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:06.705 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:28:06.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.887+0000 7f5313b72640 1 Processor -- start 2023-12-16T03:28:06.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.887+0000 7f5313b72640 1 -- start start 2023-12-16T03:28:06.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.887+0000 7f5313b72640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f530c0c63c0 0x7f530c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:06.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.887+0000 7f5313b72640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f530c0c4100 0x7f530c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:06.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.887+0000 7f5313b72640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f530c0c29e0 0x7f530c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:06.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.887+0000 7f5313b72640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530c0c31c0 con 0x7f530c0c4100 2023-12-16T03:28:06.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.887+0000 7f5313b72640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530c0c34a0 con 0x7f530c0c63c0 2023-12-16T03:28:06.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.887+0000 7f5313b72640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c0c1030 con 0x7f530c0c29e0 2023-12-16T03:28:06.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531110d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f530c0c4100 0x7f530c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:06.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531110d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f530c0c4100 0x7f530c0c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57932/0 (socket says 172.21.15.28:57932) 2023-12-16T03:28:06.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531110d640 1 -- 172.21.15.28:0/1840888553 learned_addr learned my addr 172.21.15.28:0/1840888553 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:06.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531210f640 1 --2- 172.21.15.28:0/1840888553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f530c0c29e0 0x7f530c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:06.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531190e640 1 --2- 172.21.15.28:0/1840888553 >> v2:172.21.15.134:3300/0 conn(0x7f530c0c63c0 0x7f530c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:06.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531110d640 1 -- 172.21.15.28:0/1840888553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f530c0c29e0 msgr2=0x7f530c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:06.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531110d640 1 --2- 172.21.15.28:0/1840888553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f530c0c29e0 0x7f530c0a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531110d640 1 -- 172.21.15.28:0/1840888553 >> v2:172.21.15.134:3300/0 conn(0x7f530c0c63c0 msgr2=0x7f530c0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:06.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531110d640 1 --2- 172.21.15.28:0/1840888553 >> v2:172.21.15.134:3300/0 conn(0x7f530c0c63c0 0x7f530c0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531110d640 1 -- 172.21.15.28:0/1840888553 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c0c1310 con 0x7f530c0c4100 2023-12-16T03:28:06.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531210f640 1 --2- 172.21.15.28:0/1840888553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f530c0c29e0 0x7f530c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:06.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531110d640 1 --2- 172.21.15.28:0/1840888553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f530c0c4100 0x7f530c0c24a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f530c06e000 tx=0x7f52fc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c956b75b930de45 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:06.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531090c640 1 -- 172.21.15.28:0/1840888553 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0aa3d0 con 0x7f530c0c4100 2023-12-16T03:28:06.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531090c640 1 -- 172.21.15.28:0/1840888553 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc0ad640 con 0x7f530c0c4100 2023-12-16T03:28:06.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.891+0000 7f531090c640 1 -- 172.21.15.28:0/1840888553 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0ad9d0 con 0x7f530c0c4100 2023-12-16T03:28:06.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 -- 172.21.15.28:0/1840888553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f530c0c4100 msgr2=0x7f530c0c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:06.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 --2- 172.21.15.28:0/1840888553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f530c0c4100 0x7f530c0c24a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f530c06e000 tx=0x7f52fc01c3b0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 -- 172.21.15.28:0/1840888553 shutdown_connections 2023-12-16T03:28:06.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 --2- 172.21.15.28:0/1840888553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f530c0c29e0 0x7f530c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 --2- 172.21.15.28:0/1840888553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f530c0c4100 0x7f530c0c24a0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 --2- 172.21.15.28:0/1840888553 >> v2:172.21.15.134:3300/0 conn(0x7f530c0c63c0 0x7f530c0c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 -- 172.21.15.28:0/1840888553 >> 172.21.15.28:0/1840888553 conn(0x7f530c06a5b0 msgr2=0x7f530c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:06.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 -- 172.21.15.28:0/1840888553 shutdown_connections 2023-12-16T03:28:06.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 -- 172.21.15.28:0/1840888553 wait complete. 2023-12-16T03:28:06.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 Processor -- start 2023-12-16T03:28:06.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 -- start start 2023-12-16T03:28:06.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f530c0c29e0 0x7f530c1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:06.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f530c0c4100 0x7f530c150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:06.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f530c0c63c0 0x7f530c154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:06.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c1ecf60 con 0x7f530c0c29e0 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c157250 con 0x7f530c0c4100 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f5313b72640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c156f70 con 0x7f530c0c63c0 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f531190e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f530c0c29e0 0x7f530c1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f531190e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f530c0c29e0 0x7f530c1568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57946/0 (socket says 172.21.15.28:57946) 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f531190e640 1 -- 172.21.15.28:0/4038630063 learned_addr learned my addr 172.21.15.28:0/4038630063 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f531110d640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f530c0c4100 0x7f530c150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f531210f640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f530c0c63c0 0x7f530c154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f531190e640 1 -- 172.21.15.28:0/4038630063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f530c0c63c0 msgr2=0x7f530c154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f531190e640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f530c0c63c0 0x7f530c154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f531190e640 1 -- 172.21.15.28:0/4038630063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f530c0c4100 msgr2=0x7f530c150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f531190e640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f530c0c4100 0x7f530c150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:06.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.895+0000 7f531190e640 1 -- 172.21.15.28:0/4038630063 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0094d0 con 0x7f530c0c29e0 2023-12-16T03:28:06.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.899+0000 7f531190e640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f530c0c29e0 0x7f530c1568e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f530800d5f0 tx=0x7f530800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:06.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.899+0000 7f53027fc640 1 -- 172.21.15.28:0/4038630063 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080125f0 con 0x7f530c0c29e0 2023-12-16T03:28:06.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.899+0000 7f53027fc640 1 -- 172.21.15.28:0/4038630063 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308012750 con 0x7f530c0c29e0 2023-12-16T03:28:06.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.899+0000 7f53027fc640 1 -- 172.21.15.28:0/4038630063 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308012ae0 con 0x7f530c0c29e0 2023-12-16T03:28:06.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.899+0000 7f5313b72640 1 -- 172.21.15.28:0/4038630063 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530c0c69b0 con 0x7f530c0c29e0 2023-12-16T03:28:06.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.899+0000 7f5313b72640 1 -- 172.21.15.28:0/4038630063 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530c1ed440 con 0x7f530c0c29e0 2023-12-16T03:28:06.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.899+0000 7f5313b72640 1 -- 172.21.15.28:0/4038630063 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530c0c6b40 con 0x7f530c0c29e0 2023-12-16T03:28:06.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.899+0000 7f53027fc640 1 -- 172.21.15.28:0/4038630063 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5308012c40 con 0x7f530c0c29e0 2023-12-16T03:28:06.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.899+0000 7f53027fc640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f52f0066470 0x7f52f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:06.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.899+0000 7f53027fc640 1 -- 172.21.15.28:0/4038630063 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53080841a0 con 0x7f530c0c29e0 2023-12-16T03:28:06.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.899+0000 7f531110d640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f52f0066470 0x7f52f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:06.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.903+0000 7f531110d640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f52f0066470 0x7f52f0068930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0af000 tx=0x7f52fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:06.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:06.903+0000 7f53027fc640 1 -- 172.21.15.28:0/4038630063 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f53080516c0 con 0x7f530c0c29e0 2023-12-16T03:28:07.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.095+0000 7f5313b72640 1 -- 172.21.15.28:0/4038630063 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f530c068400 con 0x7f530c0c29e0 2023-12-16T03:28:07.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.095+0000 7f53027fc640 1 -- 172.21.15.28:0/4038630063 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5308054ce0 con 0x7f530c0c29e0 2023-12-16T03:28:07.101 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 -- 172.21.15.28:0/4038630063 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f52f0066470 msgr2=0x7f52f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f52f0066470 0x7f52f0068930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0af000 tx=0x7f52fc009040 comp rx=0 tx=0).stop 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 -- 172.21.15.28:0/4038630063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f530c0c29e0 msgr2=0x7f530c1568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f530c0c29e0 0x7f530c1568e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f530800d5f0 tx=0x7f530800dab0 comp rx=0 tx=0).stop 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 -- 172.21.15.28:0/4038630063 shutdown_connections 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f530c0c63c0 0x7f530c154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f530c0c4100 0x7f530c150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f52f0066470 0x7f52f0068930 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 --2- 172.21.15.28:0/4038630063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f530c0c29e0 0x7f530c1568e0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 -- 172.21.15.28:0/4038630063 >> 172.21.15.28:0/4038630063 conn(0x7f530c06a5b0 msgr2=0x7f530c0c0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 -- 172.21.15.28:0/4038630063 shutdown_connections 2023-12-16T03:28:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.099+0000 7f5313b72640 1 -- 172.21.15.28:0/4038630063 wait complete. 2023-12-16T03:28:07.126 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-16T03:28:07.126 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:28:07.126 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-12-16T03:28:07.127 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-16T03:28:07.127 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:07.127 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-16T03:28:07.127 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:28:07.127 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:28:07.127 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:28:07.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:07.127 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-12-16T03:28:07.138 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:28:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:28:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:28:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42253sec preferred_lft 42253sec 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 02:42:8f:0f:48:af brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:28:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:07.141 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:28:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T03:28:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:28:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:07.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:07.142 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:28:07.210 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-12-16T03:28:07.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:07.213 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-12-16T03:28:07.268 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-12-16T03:28:07.268 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:28:07.268 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-16T03:28:07.268 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T03:28:07.268 INFO:teuthology.orchestra.run.smithi134.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:28:07.268 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T03:28:07.269 INFO:teuthology.orchestra.run.smithi134.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:28:07.269 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:28:07.269 INFO:teuthology.orchestra.run.smithi134.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:28:07.269 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:28:07.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:07.269 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:28:07.269 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:28:07.269 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T03:28:07.269 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T03:28:07.269 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T03:28:07.269 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:28:07.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:07.368 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-16T03:28:07.378 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T03:28:07.378 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:28:07.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:07.378 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-12-16T03:28:07.441 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:28:07.441 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:07.493 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:28:07.493 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:28:07.493 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:07.544 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-16T03:28:07.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:07.544 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:07.641 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:07.641 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:28:07.655 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:07.655 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:28:07.655 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:28:07.655 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: 1@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs=/ 2023-12-16T03:28:07.655 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:28:07.659 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:28:07.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:07.659 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:07.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:07.679 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:28:07.734 INFO:teuthology.orchestra.run.smithi134.stdout:client5849 2023-12-16T03:28:07.734 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:07.734 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:07.785 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-16T03:28:07.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.935+0000 7ff367268640 1 Processor -- start 2023-12-16T03:28:07.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.935+0000 7ff367268640 1 -- start start 2023-12-16T03:28:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.935+0000 7ff367268640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3600a5370 0x7ff3600c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.935+0000 7ff367268640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff3600c4110 0x7ff360150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.935+0000 7ff367268640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3600c2760 con 0x7ff360072090 2023-12-16T03:28:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.935+0000 7ff367268640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3600c3070 con 0x7ff3600c4110 2023-12-16T03:28:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.935+0000 7ff367268640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff360151bf0 con 0x7ff3600a5370 2023-12-16T03:28:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.939+0000 7ff365805640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff360072090 0x7ff3601514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55058/0 (socket says 172.21.15.28:55058) 2023-12-16T03:28:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.939+0000 7ff365805640 1 -- 172.21.15.28:0/3940971129 learned_addr learned my addr 172.21.15.28:0/3940971129 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.939+0000 7ff364803640 1 --2- 172.21.15.28:0/3940971129 >> v2:172.21.15.134:3300/0 conn(0x7ff3600c4110 0x7ff360150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:07.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.939+0000 7ff365004640 1 --2- 172.21.15.28:0/3940971129 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3600a5370 0x7ff3600c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.939+0000 7ff357fff640 1 -- 172.21.15.28:0/3940971129 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920689728 0 0) 0x7ff3600c2760 con 0x7ff360072090 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.939+0000 7ff357fff640 1 -- 172.21.15.28:0/3940971129 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff34c003530 con 0x7ff360072090 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.939+0000 7ff364803640 1 -- 172.21.15.28:0/3940971129 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3600a5370 msgr2=0x7ff3600c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.939+0000 7ff364803640 1 --2- 172.21.15.28:0/3940971129 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3600a5370 0x7ff3600c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.939+0000 7ff364803640 1 -- 172.21.15.28:0/3940971129 >> v1:172.21.15.28:6789/0 conn(0x7ff360072090 legacy=0x7ff3601514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.939+0000 7ff364803640 1 -- 172.21.15.28:0/3940971129 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600a5750 con 0x7ff3600c4110 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.939+0000 7ff364803640 1 --2- 172.21.15.28:0/3940971129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600c4110 0x7ff360150fa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff3500097f0 tx=0x7ff35001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84b72f999a51a28c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff357fff640 1 -- 172.21.15.28:0/3940971129 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3500ab600 con 0x7ff3600c4110 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff357fff640 1 -- 172.21.15.28:0/3940971129 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3500a7050 con 0x7ff3600c4110 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff357fff640 1 -- 172.21.15.28:0/3940971129 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3500ab960 con 0x7ff3600c4110 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 -- 172.21.15.28:0/3940971129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600c4110 msgr2=0x7ff360150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:07.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 --2- 172.21.15.28:0/3940971129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600c4110 0x7ff360150fa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff3500097f0 tx=0x7ff35001c330 comp rx=0 tx=0).stop 2023-12-16T03:28:07.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 -- 172.21.15.28:0/3940971129 shutdown_connections 2023-12-16T03:28:07.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 --2- 172.21.15.28:0/3940971129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600c4110 0x7ff360150fa0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:07.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 --2- 172.21.15.28:0/3940971129 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3600a5370 0x7ff3600c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:07.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 -- 172.21.15.28:0/3940971129 >> 172.21.15.28:0/3940971129 conn(0x7ff36006a5b0 msgr2=0x7ff36006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:07.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 -- 172.21.15.28:0/3940971129 shutdown_connections 2023-12-16T03:28:07.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 -- 172.21.15.28:0/3940971129 wait complete. 2023-12-16T03:28:07.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 Processor -- start 2023-12-16T03:28:07.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 -- start start 2023-12-16T03:28:07.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff360072090 0x7ff3600a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:07.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3600a5370 0x7ff36015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:07.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600c4110 0x7ff36015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:07.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3601f00a0 con 0x7ff360072090 2023-12-16T03:28:07.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600c6370 con 0x7ff3600c4110 2023-12-16T03:28:07.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.943+0000 7ff367268640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3601efdc0 con 0x7ff3600a5370 2023-12-16T03:28:07.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff365004640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff360072090 0x7ff3600a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:07.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff365004640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff360072090 0x7ff3600a6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57962/0 (socket says 172.21.15.28:57962) 2023-12-16T03:28:07.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff364803640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3600a5370 0x7ff36015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:07.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff365004640 1 -- 172.21.15.28:0/2910461019 learned_addr learned my addr 172.21.15.28:0/2910461019 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:07.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff365805640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600c4110 0x7ff36015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:07.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff365004640 1 -- 172.21.15.28:0/2910461019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3600a5370 msgr2=0x7ff36015a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff365004640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3600a5370 0x7ff36015a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff365004640 1 -- 172.21.15.28:0/2910461019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600c4110 msgr2=0x7ff36015aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff365004640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600c4110 0x7ff36015aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff365004640 1 -- 172.21.15.28:0/2910461019 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff350009420 con 0x7ff360072090 2023-12-16T03:28:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff364803640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3600a5370 0x7ff36015a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff365004640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff360072090 0x7ff3600a6430 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00e930 tx=0x7ff35c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff355ffb640 1 -- 172.21.15.28:0/2910461019 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c009690 con 0x7ff360072090 2023-12-16T03:28:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff355ffb640 1 -- 172.21.15.28:0/2910461019 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c00ca00 con 0x7ff360072090 2023-12-16T03:28:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff355ffb640 1 -- 172.21.15.28:0/2910461019 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c00cd70 con 0x7ff360072090 2023-12-16T03:28:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff367268640 1 -- 172.21.15.28:0/2910461019 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff360152160 con 0x7ff360072090 2023-12-16T03:28:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff367268640 1 -- 172.21.15.28:0/2910461019 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3600a6970 con 0x7ff360072090 2023-12-16T03:28:07.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff367268640 1 -- 172.21.15.28:0/2910461019 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff360068400 con 0x7ff360072090 2023-12-16T03:28:07.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.947+0000 7ff355ffb640 1 -- 172.21.15.28:0/2910461019 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff35c013470 con 0x7ff360072090 2023-12-16T03:28:07.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.951+0000 7ff355ffb640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3440664a0 0x7ff344068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:07.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.951+0000 7ff355ffb640 1 -- 172.21.15.28:0/2910461019 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff35c0840a0 con 0x7ff360072090 2023-12-16T03:28:07.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.951+0000 7ff364803640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3440664a0 0x7ff344068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:07.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.951+0000 7ff364803640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3440664a0 0x7ff344068960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff3500ad000 tx=0x7ff350008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:07.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:07.955+0000 7ff355ffb640 1 -- 172.21.15.28:0/2910461019 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff35c0515f0 con 0x7ff360072090 2023-12-16T03:28:08.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.167+0000 7ff367268640 1 -- 172.21.15.28:0/2910461019 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7ff3600c6780 con 0x7ff360072090 2023-12-16T03:28:08.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.167+0000 7ff355ffb640 1 -- 172.21.15.28:0/2910461019 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v19) v1 ==== 84+0+0 (secure 0 0 0) 0x7ff35c054c10 con 0x7ff360072090 2023-12-16T03:28:08.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 -- 172.21.15.28:0/2910461019 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3440664a0 msgr2=0x7ff344068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3440664a0 0x7ff344068960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff3500ad000 tx=0x7ff350008040 comp rx=0 tx=0).stop 2023-12-16T03:28:08.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 -- 172.21.15.28:0/2910461019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff360072090 msgr2=0x7ff3600a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff360072090 0x7ff3600a6430 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00e930 tx=0x7ff35c00edf0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 -- 172.21.15.28:0/2910461019 shutdown_connections 2023-12-16T03:28:08.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600c4110 0x7ff36015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff3600a5370 0x7ff36015a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff3440664a0 0x7ff344068960 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 --2- 172.21.15.28:0/2910461019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff360072090 0x7ff3600a6430 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 -- 172.21.15.28:0/2910461019 >> 172.21.15.28:0/2910461019 conn(0x7ff36006a5b0 msgr2=0x7ff3601495c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:08.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 -- 172.21.15.28:0/2910461019 shutdown_connections 2023-12-16T03:28:08.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.171+0000 7ff367268640 1 -- 172.21.15.28:0/2910461019 wait complete. 2023-12-16T03:28:08.193 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:08.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27f079640 1 Processor -- start 2023-12-16T03:28:08.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27f079640 1 -- start start 2023-12-16T03:28:08.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27f079640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd2780c63c0 0x7fd2780c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27f079640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd2780c2bb0 0x7fd2780a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27f079640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2780c31c0 con 0x7fd2780c4100 2023-12-16T03:28:08.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27f079640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2780c34a0 con 0x7fd2780c63c0 2023-12-16T03:28:08.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27f079640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2780c1030 con 0x7fd2780c2bb0 2023-12-16T03:28:08.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27ce15640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd2780c63c0 0x7fd2780c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27ce15640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd2780c63c0 0x7fd2780c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57976/0 (socket says 172.21.15.28:57976) 2023-12-16T03:28:08.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27ce15640 1 -- 172.21.15.28:0/643588100 learned_addr learned my addr 172.21.15.28:0/643588100 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:08.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27d616640 1 --2- 172.21.15.28:0/643588100 >> v2:172.21.15.134:3300/0 conn(0x7fd2780c2bb0 0x7fd2780a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27ce15640 1 -- 172.21.15.28:0/643588100 >> v2:172.21.15.134:3300/0 conn(0x7fd2780c2bb0 msgr2=0x7fd2780a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:08.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27ce15640 1 --2- 172.21.15.28:0/643588100 >> v2:172.21.15.134:3300/0 conn(0x7fd2780c2bb0 0x7fd2780a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27ce15640 1 -- 172.21.15.28:0/643588100 >> v1:172.21.15.134:6789/0 conn(0x7fd2780c4100 legacy=0x7fd2780c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:08.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.335+0000 7fd27ce15640 1 -- 172.21.15.28:0/643588100 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780c1310 con 0x7fd2780c63c0 2023-12-16T03:28:08.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd27ce15640 1 --2- 172.21.15.28:0/643588100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2780c63c0 0x7fd2780c06d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd2780c4550 tx=0x7fd26c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cec1f03b03900c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:08.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd2777fe640 1 -- 172.21.15.28:0/643588100 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2780aa3d0 con 0x7fd2780c63c0 2023-12-16T03:28:08.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd2777fe640 1 -- 172.21.15.28:0/643588100 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c0ac620 con 0x7fd2780c63c0 2023-12-16T03:28:08.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd2777fe640 1 -- 172.21.15.28:0/643588100 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0ac9b0 con 0x7fd2780c63c0 2023-12-16T03:28:08.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd27f079640 1 -- 172.21.15.28:0/643588100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2780c63c0 msgr2=0x7fd2780c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd27f079640 1 --2- 172.21.15.28:0/643588100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2780c63c0 0x7fd2780c06d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd2780c4550 tx=0x7fd26c01c3a0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd27f079640 1 -- 172.21.15.28:0/643588100 shutdown_connections 2023-12-16T03:28:08.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd27f079640 1 --2- 172.21.15.28:0/643588100 >> v2:172.21.15.134:3300/0 conn(0x7fd2780c2bb0 0x7fd2780a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd27f079640 1 --2- 172.21.15.28:0/643588100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2780c63c0 0x7fd2780c06d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd27f079640 1 -- 172.21.15.28:0/643588100 >> 172.21.15.28:0/643588100 conn(0x7fd27806a5b0 msgr2=0x7fd27806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:08.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd27f079640 1 -- 172.21.15.28:0/643588100 shutdown_connections 2023-12-16T03:28:08.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.339+0000 7fd27f079640 1 -- 172.21.15.28:0/643588100 wait complete. 2023-12-16T03:28:08.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27f079640 1 Processor -- start 2023-12-16T03:28:08.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27f079640 1 -- start start 2023-12-16T03:28:08.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27f079640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2780c2bb0 0x7fd27814e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27f079640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2780c4100 0x7fd27814adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27f079640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2780c63c0 0x7fd27814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27f079640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780705d0 con 0x7fd2780c63c0 2023-12-16T03:28:08.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27f079640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd278152eb0 con 0x7fd2780c4100 2023-12-16T03:28:08.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27f079640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780722e0 con 0x7fd2780c2bb0 2023-12-16T03:28:08.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27d616640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2780c63c0 0x7fd27814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27d616640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2780c63c0 0x7fd27814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57980/0 (socket says 172.21.15.28:57980) 2023-12-16T03:28:08.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27d616640 1 -- 172.21.15.28:0/226207441 learned_addr learned my addr 172.21.15.28:0/226207441 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:08.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd277fff640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2780c4100 0x7fd27814adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27ce15640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2780c2bb0 0x7fd27814e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27d616640 1 -- 172.21.15.28:0/226207441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2780c2bb0 msgr2=0x7fd27814e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27d616640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2780c2bb0 0x7fd27814e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27d616640 1 -- 172.21.15.28:0/226207441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2780c4100 msgr2=0x7fd27814adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27d616640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2780c4100 0x7fd27814adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27d616640 1 -- 172.21.15.28:0/226207441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c0094d0 con 0x7fd2780c63c0 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27ce15640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2780c2bb0 0x7fd27814e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27d616640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2780c63c0 0x7fd27814b2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd270007e40 tx=0x7fd27000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd2757fa640 1 -- 172.21.15.28:0/226207441 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270014620 con 0x7fd2780c63c0 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd2757fa640 1 -- 172.21.15.28:0/226207441 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27000ee90 con 0x7fd2780c63c0 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd2757fa640 1 -- 172.21.15.28:0/226207441 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2700149e0 con 0x7fd2780c63c0 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27f079640 1 -- 172.21.15.28:0/226207441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd278153100 con 0x7fd2780c63c0 2023-12-16T03:28:08.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.343+0000 7fd27f079640 1 -- 172.21.15.28:0/226207441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27814b830 con 0x7fd2780c63c0 2023-12-16T03:28:08.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.347+0000 7fd27f079640 1 -- 172.21.15.28:0/226207441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd278068400 con 0x7fd2780c63c0 2023-12-16T03:28:08.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.347+0000 7fd2757fa640 1 -- 172.21.15.28:0/226207441 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd270014b40 con 0x7fd2780c63c0 2023-12-16T03:28:08.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.347+0000 7fd2757fa640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd25c0664a0 0x7fd25c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.347+0000 7fd2757fa640 1 -- 172.21.15.28:0/226207441 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2700847c0 con 0x7fd2780c63c0 2023-12-16T03:28:08.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.347+0000 7fd27ce15640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd25c0664a0 0x7fd25c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.347+0000 7fd27ce15640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd25c0664a0 0x7fd25c068960 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0ae000 tx=0x7fd26c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:08.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.351+0000 7fd2757fa640 1 -- 172.21.15.28:0/226207441 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd270051c30 con 0x7fd2780c63c0 2023-12-16T03:28:08.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.507+0000 7fd27f079640 1 -- 172.21.15.28:0/226207441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2780c2340 con 0x7fd2780c63c0 2023-12-16T03:28:08.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd2757fa640 1 -- 172.21.15.28:0/226207441 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16560 (secure 0 0 0) 0x7fd270055250 con 0x7fd2780c63c0 2023-12-16T03:28:08.514 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:08.514 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":68,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:00.706254+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:08.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 -- 172.21.15.28:0/226207441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd25c0664a0 msgr2=0x7fd25c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd25c0664a0 0x7fd25c068960 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0ae000 tx=0x7fd26c008040 comp rx=0 tx=0).stop 2023-12-16T03:28:08.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 -- 172.21.15.28:0/226207441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2780c63c0 msgr2=0x7fd27814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2780c63c0 0x7fd27814b2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd270007e40 tx=0x7fd27000e4b0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 -- 172.21.15.28:0/226207441 shutdown_connections 2023-12-16T03:28:08.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd25c0664a0 0x7fd25c068960 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2780c63c0 0x7fd27814b2f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2780c4100 0x7fd27814adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 --2- 172.21.15.28:0/226207441 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2780c2bb0 0x7fd27814e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 -- 172.21.15.28:0/226207441 >> 172.21.15.28:0/226207441 conn(0x7fd27806a5b0 msgr2=0x7fd2780a7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:08.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 -- 172.21.15.28:0/226207441 shutdown_connections 2023-12-16T03:28:08.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.511+0000 7fd27f079640 1 -- 172.21.15.28:0/226207441 wait complete. 2023-12-16T03:28:08.535 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:27:56.894984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:27:58.090972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:28:08.536 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:28:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41cfd65640 1 Processor -- start 2023-12-16T03:28:08.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41cfd65640 1 -- start start 2023-12-16T03:28:08.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41cfd65640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c8154030 0x7f41c8154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41cfd65640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f41c80c1390 0x7f41c8154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41cfd65640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c80c2870 con 0x7f41c806a5b0 2023-12-16T03:28:08.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41cfd65640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c806be70 con 0x7f41c80c1390 2023-12-16T03:28:08.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41cfd65640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c814ae80 con 0x7f41c8154030 2023-12-16T03:28:08.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41ce302640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f41c806a5b0 0x7f41c8150a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55068/0 (socket says 172.21.15.28:55068) 2023-12-16T03:28:08.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41ce302640 1 -- 172.21.15.28:0/2440803197 learned_addr learned my addr 172.21.15.28:0/2440803197 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:08.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41cdb01640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c8154030 0x7f41c8154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41cd300640 1 --2- 172.21.15.28:0/2440803197 >> v2:172.21.15.134:3300/0 conn(0x7f41c80c1390 0x7f41c8154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246937317 0 0) 0x7f41c80c2870 con 0x7f41c806a5b0 2023-12-16T03:28:08.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.679+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41b4003530 con 0x7f41c806a5b0 2023-12-16T03:28:08.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1791116340 0 0) 0x7f41b4003530 con 0x7f41c806a5b0 2023-12-16T03:28:08.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c8154030 msgr2=0x7f41c8154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c8154030 0x7f41c8154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 >> v2:172.21.15.134:3300/0 conn(0x7f41c80c1390 msgr2=0x7f41c8154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 --2- 172.21.15.28:0/2440803197 >> v2:172.21.15.134:3300/0 conn(0x7f41c80c1390 0x7f41c8154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8070ec0 con 0x7f41c806a5b0 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f41c0001a00 con 0x7f41c806a5b0 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 >> v1:172.21.15.28:6789/0 conn(0x7f41c806a5b0 legacy=0x7f41c8150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c8154030 0x7f41b4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41b4003f50 0x7f41b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41b4004d10 0x7f41b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c806be70 con 0x7f41b4004d10 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c814ae80 con 0x7f41b4003f50 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b400ba40 con 0x7f41c8154030 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ce302640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41b4004d10 0x7f41b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41cdb01640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c8154030 0x7f41b4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41cd300640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41b4003f50 0x7f41b40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ce302640 1 -- 172.21.15.28:0/2440803197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c8154030 msgr2=0x7f41b4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:08.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ce302640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c8154030 0x7f41b4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ce302640 1 -- 172.21.15.28:0/2440803197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41b4003f50 msgr2=0x7f41b40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:08.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ce302640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41b4003f50 0x7f41b40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ce302640 1 -- 172.21.15.28:0/2440803197 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b4003530 con 0x7f41b4004d10 2023-12-16T03:28:08.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.683+0000 7f41ce302640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41b4004d10 0x7f41b4005190 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f41c000a780 tx=0x7f41c001f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83168085e847c918 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:08.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c00aa610 con 0x7f41b4004d10 2023-12-16T03:28:08.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c00aa770 con 0x7f41b4004d10 2023-12-16T03:28:08.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41ccaff640 1 -- 172.21.15.28:0/2440803197 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c00aab60 con 0x7f41b4004d10 2023-12-16T03:28:08.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 -- 172.21.15.28:0/2440803197 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41b4004d10 msgr2=0x7f41b4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 --2- 172.21.15.28:0/2440803197 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41b4004d10 0x7f41b4005190 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f41c000a780 tx=0x7f41c001f9e0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41ce302640 1 -- 172.21.15.28:0/2440803197 reap_dead start 2023-12-16T03:28:08.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 -- 172.21.15.28:0/2440803197 shutdown_connections 2023-12-16T03:28:08.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 -- 172.21.15.28:0/2440803197 >> 172.21.15.28:0/2440803197 conn(0x7f41c80c30c0 msgr2=0x7f41c80c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:08.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 -- 172.21.15.28:0/2440803197 shutdown_connections 2023-12-16T03:28:08.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 -- 172.21.15.28:0/2440803197 wait complete. 2023-12-16T03:28:08.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 Processor -- start 2023-12-16T03:28:08.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 -- start start 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41b4004d10 0x7f41c8150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41c814f2c0 0x7f41c8149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c814d750 0x7f41c81ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c8150fc0 con 0x7f41c814f2c0 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c81e9c00 con 0x7f41b4004d10 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cfd65640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c814dd10 con 0x7f41c814d750 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.687+0000 7f41cd300640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41c814f2c0 0x7f41c8149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cd300640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41c814f2c0 0x7f41c8149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57998/0 (socket says 172.21.15.28:57998) 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cd300640 1 -- 172.21.15.28:0/3442652473 learned_addr learned my addr 172.21.15.28:0/3442652473 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cdb01640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41b4004d10 0x7f41c8150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41ce302640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c814d750 0x7f41c81ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cd300640 1 -- 172.21.15.28:0/3442652473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c814d750 msgr2=0x7f41c81ea3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cd300640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c814d750 0x7f41c81ea3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cd300640 1 -- 172.21.15.28:0/3442652473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41b4004d10 msgr2=0x7f41c8150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cd300640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41b4004d10 0x7f41c8150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cd300640 1 -- 172.21.15.28:0/3442652473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c814dff0 con 0x7f41c814f2c0 2023-12-16T03:28:08.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41ce302640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c814d750 0x7f41c81ea3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:08.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cd300640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41c814f2c0 0x7f41c8149170 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f41b80119d0 tx=0x7f41b8011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:08.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41be7fc640 1 -- 172.21.15.28:0/3442652473 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b800faf0 con 0x7f41c814f2c0 2023-12-16T03:28:08.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41be7fc640 1 -- 172.21.15.28:0/3442652473 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b800fc50 con 0x7f41c814f2c0 2023-12-16T03:28:08.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41be7fc640 1 -- 172.21.15.28:0/3442652473 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8014440 con 0x7f41c814f2c0 2023-12-16T03:28:08.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cfd65640 1 -- 172.21.15.28:0/3442652473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c81e9ea0 con 0x7f41c814f2c0 2023-12-16T03:28:08.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cfd65640 1 -- 172.21.15.28:0/3442652473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c81496b0 con 0x7f41c814f2c0 2023-12-16T03:28:08.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41cfd65640 1 -- 172.21.15.28:0/3442652473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c8068400 con 0x7f41c814f2c0 2023-12-16T03:28:08.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.691+0000 7f41be7fc640 1 -- 172.21.15.28:0/3442652473 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f41b80145a0 con 0x7f41c814f2c0 2023-12-16T03:28:08.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.695+0000 7f41be7fc640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41ac066470 0x7f41ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:08.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.695+0000 7f41be7fc640 1 -- 172.21.15.28:0/3442652473 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41b80846c0 con 0x7f41c814f2c0 2023-12-16T03:28:08.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.695+0000 7f41cdb01640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41ac066470 0x7f41ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:08.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.695+0000 7f41cdb01640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41ac066470 0x7f41ac068930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009be0 tx=0x7f41c4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:08.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.699+0000 7f41be7fc640 1 -- 172.21.15.28:0/3442652473 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f41b8051bf0 con 0x7f41c814f2c0 2023-12-16T03:28:08.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 -- 172.21.15.28:0/3442652473 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41c8072a80 con 0x7f41c814f2c0 2023-12-16T03:28:08.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41be7fc640 1 -- 172.21.15.28:0/3442652473 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41b8055210 con 0x7f41c814f2c0 2023-12-16T03:28:08.862 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:28:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 -- 172.21.15.28:0/3442652473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41ac066470 msgr2=0x7f41ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41ac066470 0x7f41ac068930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009be0 tx=0x7f41c4009190 comp rx=0 tx=0).stop 2023-12-16T03:28:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 -- 172.21.15.28:0/3442652473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41c814f2c0 msgr2=0x7f41c8149170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41c814f2c0 0x7f41c8149170 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f41b80119d0 tx=0x7f41b8011dd0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 -- 172.21.15.28:0/3442652473 shutdown_connections 2023-12-16T03:28:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41c814d750 0x7f41c81ea3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f41ac066470 0x7f41ac068930 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41c814f2c0 0x7f41c8149170 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 --2- 172.21.15.28:0/3442652473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41b4004d10 0x7f41c8150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 -- 172.21.15.28:0/3442652473 >> 172.21.15.28:0/3442652473 conn(0x7f41c80c30c0 msgr2=0x7f41c8152b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 -- 172.21.15.28:0/3442652473 shutdown_connections 2023-12-16T03:28:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:08.859+0000 7f41cfd65640 1 -- 172.21.15.28:0/3442652473 wait complete. 2023-12-16T03:28:08.883 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:28:09.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d383f5640 1 Processor -- start 2023-12-16T03:28:09.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d383f5640 1 -- start start 2023-12-16T03:28:09.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d383f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d300a5370 0x7f9d300c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d383f5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9d300c4110 0x7f9d30150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d383f5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d300c2760 con 0x7f9d30072090 2023-12-16T03:28:09.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d383f5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d300c3070 con 0x7f9d300c4110 2023-12-16T03:28:09.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d383f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d30151bf0 con 0x7f9d300a5370 2023-12-16T03:28:09.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d36992640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9d30072090 0x7f9d301514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55074/0 (socket says 172.21.15.28:55074) 2023-12-16T03:28:09.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d36992640 1 -- 172.21.15.28:0/352612931 learned_addr learned my addr 172.21.15.28:0/352612931 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:09.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d35990640 1 --2- 172.21.15.28:0/352612931 >> v2:172.21.15.134:3300/0 conn(0x7f9d300c4110 0x7f9d30150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278983481 0 0) 0x7f9d300c2760 con 0x7f9d30072090 2023-12-16T03:28:09.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d36191640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d300a5370 0x7f9d300c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d1c003530 con 0x7f9d30072090 2023-12-16T03:28:09.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1571068516 0 0) 0x7f9d1c003530 con 0x7f9d30072090 2023-12-16T03:28:09.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d300a5370 msgr2=0x7f9d300c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:09.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d300a5370 0x7f9d300c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 >> v2:172.21.15.134:3300/0 conn(0x7f9d300c4110 msgr2=0x7f9d30150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:09.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 --2- 172.21.15.28:0/352612931 >> v2:172.21.15.134:3300/0 conn(0x7f9d300c4110 0x7f9d30150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d300a5750 con 0x7f9d30072090 2023-12-16T03:28:09.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f9d28001a00 con 0x7f9d30072090 2023-12-16T03:28:09.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 >> v1:172.21.15.28:6789/0 conn(0x7f9d30072090 legacy=0x7f9d301514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d1c0039b0 0x7f9d1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d300a5370 0x7f9d1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d1c004d10 0x7f9d1c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300c3070 con 0x7f9d1c004d10 2023-12-16T03:28:09.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d30151bf0 con 0x7f9d1c0039b0 2023-12-16T03:28:09.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c00ba40 con 0x7f9d300a5370 2023-12-16T03:28:09.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d36191640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d1c0039b0 0x7f9d1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d36992640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d1c004d10 0x7f9d1c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d35990640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d300a5370 0x7f9d1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d36191640 1 -- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d300a5370 msgr2=0x7f9d1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:09.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d36191640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d300a5370 0x7f9d1c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d36191640 1 -- 172.21.15.28:0/352612931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d1c004d10 msgr2=0x7f9d1c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:09.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d36191640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d1c004d10 0x7f9d1c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.027+0000 7f9d36191640 1 -- 172.21.15.28:0/352612931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c003530 con 0x7f9d1c0039b0 2023-12-16T03:28:09.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.031+0000 7f9d36191640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d1c0039b0 0x7f9d1c003dd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009ae0 tx=0x7f9d2c01ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbac12614d280261 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:09.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.031+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0a55f0 con 0x7f9d1c0039b0 2023-12-16T03:28:09.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.031+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0a5750 con 0x7f9d1c0039b0 2023-12-16T03:28:09.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.031+0000 7f9d3518f640 1 -- 172.21.15.28:0/352612931 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0a5b00 con 0x7f9d1c0039b0 2023-12-16T03:28:09.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.031+0000 7f9d383f5640 1 -- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d1c0039b0 msgr2=0x7f9d1c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.031+0000 7f9d383f5640 1 --2- 172.21.15.28:0/352612931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d1c0039b0 0x7f9d1c003dd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009ae0 tx=0x7f9d2c01ca20 comp rx=0 tx=0).stop 2023-12-16T03:28:09.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.031+0000 7f9d36992640 1 -- 172.21.15.28:0/352612931 reap_dead start 2023-12-16T03:28:09.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.031+0000 7f9d383f5640 1 -- 172.21.15.28:0/352612931 shutdown_connections 2023-12-16T03:28:09.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.031+0000 7f9d383f5640 1 -- 172.21.15.28:0/352612931 >> 172.21.15.28:0/352612931 conn(0x7f9d3006a5b0 msgr2=0x7f9d3006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:09.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.031+0000 7f9d383f5640 1 -- 172.21.15.28:0/352612931 shutdown_connections 2023-12-16T03:28:09.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.031+0000 7f9d383f5640 1 -- 172.21.15.28:0/352612931 wait complete. 2023-12-16T03:28:09.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d383f5640 1 Processor -- start 2023-12-16T03:28:09.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d383f5640 1 -- start start 2023-12-16T03:28:09.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d383f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d1c0039b0 0x7f9d3014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d383f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d3014e6a0 0x7f9d30158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d383f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d3014f8e0 0x7f9d30159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d383f5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d30157910 con 0x7f9d3014f8e0 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d383f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d30159890 con 0x7f9d1c0039b0 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d383f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300717c0 con 0x7f9d3014e6a0 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d36992640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d3014f8e0 0x7f9d30159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d36992640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d3014f8e0 0x7f9d30159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58014/0 (socket says 172.21.15.28:58014) 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d36992640 1 -- 172.21.15.28:0/1203371259 learned_addr learned my addr 172.21.15.28:0/1203371259 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d36191640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d1c0039b0 0x7f9d3014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d35990640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d3014e6a0 0x7f9d30158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d36992640 1 -- 172.21.15.28:0/1203371259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d3014e6a0 msgr2=0x7f9d30158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d36992640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d3014e6a0 0x7f9d30158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d36992640 1 -- 172.21.15.28:0/1203371259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d1c0039b0 msgr2=0x7f9d3014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d36992640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d1c0039b0 0x7f9d3014f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d36992640 1 -- 172.21.15.28:0/1203371259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d301589f0 con 0x7f9d3014f8e0 2023-12-16T03:28:09.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d36992640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d3014f8e0 0x7f9d30159350 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f9d300aaae0 tx=0x7f9d28007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:09.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d26ffd640 1 -- 172.21.15.28:0/1203371259 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800abd0 con 0x7f9d3014f8e0 2023-12-16T03:28:09.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d26ffd640 1 -- 172.21.15.28:0/1203371259 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2800ad50 con 0x7f9d3014f8e0 2023-12-16T03:28:09.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d383f5640 1 -- 172.21.15.28:0/1203371259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d30157670 con 0x7f9d3014f8e0 2023-12-16T03:28:09.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d26ffd640 1 -- 172.21.15.28:0/1203371259 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28013630 con 0x7f9d3014f8e0 2023-12-16T03:28:09.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.035+0000 7f9d383f5640 1 -- 172.21.15.28:0/1203371259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d30071c50 con 0x7f9d3014f8e0 2023-12-16T03:28:09.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.039+0000 7f9d383f5640 1 -- 172.21.15.28:0/1203371259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d30070860 con 0x7f9d3014f8e0 2023-12-16T03:28:09.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.039+0000 7f9d26ffd640 1 -- 172.21.15.28:0/1203371259 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9d28013790 con 0x7f9d3014f8e0 2023-12-16T03:28:09.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.039+0000 7f9d26ffd640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d140664a0 0x7f9d14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.039+0000 7f9d26ffd640 1 -- 172.21.15.28:0/1203371259 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d280844e0 con 0x7f9d3014f8e0 2023-12-16T03:28:09.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.039+0000 7f9d36191640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d140664a0 0x7f9d14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.039+0000 7f9d36191640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d140664a0 0x7f9d14068960 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0af000 tx=0x7f9d2c0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:09.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.043+0000 7f9d26ffd640 1 -- 172.21.15.28:0/1203371259 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9d30070860 con 0x7f9d3014f8e0 2023-12-16T03:28:09.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.199+0000 7f9d383f5640 1 -- 172.21.15.28:0/1203371259 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d30070860 con 0x7f9d3014f8e0 2023-12-16T03:28:09.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.199+0000 7f9d26ffd640 1 -- 172.21.15.28:0/1203371259 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d30070860 con 0x7f9d3014f8e0 2023-12-16T03:28:09.204 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:09.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 -- 172.21.15.28:0/1203371259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d140664a0 msgr2=0x7f9d14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d140664a0 0x7f9d14068960 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0af000 tx=0x7f9d2c0046d0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 -- 172.21.15.28:0/1203371259 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d3014f8e0 msgr2=0x7f9d30159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d3014f8e0 0x7f9d30159350 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f9d300aaae0 tx=0x7f9d28007bd0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 -- 172.21.15.28:0/1203371259 shutdown_connections 2023-12-16T03:28:09.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d140664a0 0x7f9d14068960 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d3014f8e0 0x7f9d30159350 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d3014e6a0 0x7f9d30158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 --2- 172.21.15.28:0/1203371259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d1c0039b0 0x7f9d3014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 -- 172.21.15.28:0/1203371259 >> 172.21.15.28:0/1203371259 conn(0x7f9d3006a5b0 msgr2=0x7f9d3015acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:09.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 -- 172.21.15.28:0/1203371259 shutdown_connections 2023-12-16T03:28:09.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.203+0000 7f9d383f5640 1 -- 172.21.15.28:0/1203371259 wait complete. 2023-12-16T03:28:09.225 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:28:09.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76d1cfe640 1 Processor -- start 2023-12-16T03:28:09.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76d1cfe640 1 -- start start 2023-12-16T03:28:09.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76d1cfe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76cc151e90 0x7f76cc0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76d1cfe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f76cc0c4e60 0x7f76cc06bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76d1cfe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc06c860 con 0x7f76cc0c7ea0 2023-12-16T03:28:09.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76d1cfe640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc0c8750 con 0x7f76cc0c4e60 2023-12-16T03:28:09.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76d1cfe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1552d0 con 0x7f76cc151e90 2023-12-16T03:28:09.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76cbfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f76cc0c4e60 0x7f76cc06bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76cbfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f76cc0c4e60 0x7f76cc06bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58030/0 (socket says 172.21.15.28:58030) 2023-12-16T03:28:09.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76cbfff640 1 -- 172.21.15.28:0/1613432641 learned_addr learned my addr 172.21.15.28:0/1613432641 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:09.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76cb7fe640 1 --2- 172.21.15.28:0/1613432641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76cc151e90 0x7f76cc0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76cbfff640 1 -- 172.21.15.28:0/1613432641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76cc151e90 msgr2=0x7f76cc0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:09.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76cbfff640 1 --2- 172.21.15.28:0/1613432641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76cc151e90 0x7f76cc0c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76cbfff640 1 -- 172.21.15.28:0/1613432641 >> v1:172.21.15.134:6789/0 conn(0x7f76cc0c7ea0 legacy=0x7f76cc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.367+0000 7f76cbfff640 1 -- 172.21.15.28:0/1613432641 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc154930 con 0x7f76cc0c4e60 2023-12-16T03:28:09.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76cbfff640 1 --2- 172.21.15.28:0/1613432641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76cc0c4e60 0x7f76cc06bbb0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009e50 tx=0x7f76c401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6cbc521bd03ad server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:09.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76ca7fc640 1 -- 172.21.15.28:0/1613432641 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c40a55b0 con 0x7f76cc0c4e60 2023-12-16T03:28:09.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76ca7fc640 1 -- 172.21.15.28:0/1613432641 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c40a5710 con 0x7f76cc0c4e60 2023-12-16T03:28:09.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76ca7fc640 1 -- 172.21.15.28:0/1613432641 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c40a5aa0 con 0x7f76cc0c4e60 2023-12-16T03:28:09.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76d1cfe640 1 -- 172.21.15.28:0/1613432641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76cc0c4e60 msgr2=0x7f76cc06bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76d1cfe640 1 --2- 172.21.15.28:0/1613432641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76cc0c4e60 0x7f76cc06bbb0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009e50 tx=0x7f76c401c8f0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76d1cfe640 1 -- 172.21.15.28:0/1613432641 shutdown_connections 2023-12-16T03:28:09.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76d1cfe640 1 --2- 172.21.15.28:0/1613432641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76cc0c4e60 0x7f76cc06bbb0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76d1cfe640 1 --2- 172.21.15.28:0/1613432641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76cc151e90 0x7f76cc0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76d1cfe640 1 -- 172.21.15.28:0/1613432641 >> 172.21.15.28:0/1613432641 conn(0x7f76cc0ca170 msgr2=0x7f76cc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:09.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76d1cfe640 1 -- 172.21.15.28:0/1613432641 shutdown_connections 2023-12-16T03:28:09.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.371+0000 7f76d1cfe640 1 -- 172.21.15.28:0/1613432641 wait complete. 2023-12-16T03:28:09.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76d1cfe640 1 Processor -- start 2023-12-16T03:28:09.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76d1cfe640 1 -- start start 2023-12-16T03:28:09.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76d1cfe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76cc0c4e60 0x7f76cc14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76d1cfe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76cc0c7ea0 0x7f76cc1f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76d1cfe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76cc151e90 0x7f76cc1f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76d1cfe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1f1250 con 0x7f76cc0c4e60 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76d1cfe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc14c490 con 0x7f76cc0c7ea0 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76d1cfe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc14c770 con 0x7f76cc151e90 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76cb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76cc0c4e60 0x7f76cc14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76cb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76cc0c4e60 0x7f76cc14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58040/0 (socket says 172.21.15.28:58040) 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76cb7fe640 1 -- 172.21.15.28:0/2595681842 learned_addr learned my addr 172.21.15.28:0/2595681842 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76caffd640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76cc0c7ea0 0x7f76cc1f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76cbfff640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76cc151e90 0x7f76cc1f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76cb7fe640 1 -- 172.21.15.28:0/2595681842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76cc151e90 msgr2=0x7f76cc1f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76cb7fe640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76cc151e90 0x7f76cc1f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76cb7fe640 1 -- 172.21.15.28:0/2595681842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76cc0c7ea0 msgr2=0x7f76cc1f07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76cb7fe640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76cc0c7ea0 0x7f76cc1f07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76cb7fe640 1 -- 172.21.15.28:0/2595681842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4009b30 con 0x7f76cc0c4e60 2023-12-16T03:28:09.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76cb7fe640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76cc0c4e60 0x7f76cc14b2f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00d800 tx=0x7f76bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:09.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76b3fff640 1 -- 172.21.15.28:0/2595681842 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc00b6c0 con 0x7f76cc0c4e60 2023-12-16T03:28:09.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76b3fff640 1 -- 172.21.15.28:0/2595681842 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc00b860 con 0x7f76cc0c4e60 2023-12-16T03:28:09.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76b3fff640 1 -- 172.21.15.28:0/2595681842 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc00bc10 con 0x7f76cc0c4e60 2023-12-16T03:28:09.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76d1cfe640 1 -- 172.21.15.28:0/2595681842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc14ca50 con 0x7f76cc0c4e60 2023-12-16T03:28:09.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.375+0000 7f76d1cfe640 1 -- 172.21.15.28:0/2595681842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc14b830 con 0x7f76cc0c4e60 2023-12-16T03:28:09.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.379+0000 7f76d1cfe640 1 -- 172.21.15.28:0/2595681842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc14cf00 con 0x7f76cc0c4e60 2023-12-16T03:28:09.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.379+0000 7f76b3fff640 1 -- 172.21.15.28:0/2595681842 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f76bc01e460 con 0x7f76cc0c4e60 2023-12-16T03:28:09.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.379+0000 7f76b3fff640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76b8066470 0x7f76b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.379+0000 7f76b3fff640 1 -- 172.21.15.28:0/2595681842 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76bc084270 con 0x7f76cc0c4e60 2023-12-16T03:28:09.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.379+0000 7f76caffd640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76b8066470 0x7f76b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.379+0000 7f76caffd640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76b8066470 0x7f76b8068930 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f76cc150a10 tx=0x7f76c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:09.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.383+0000 7f76b3fff640 1 -- 172.21.15.28:0/2595681842 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f76bc051830 con 0x7f76cc0c4e60 2023-12-16T03:28:09.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.539+0000 7f76d1cfe640 1 -- 172.21.15.28:0/2595681842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76cc068400 con 0x7f76cc0c4e60 2023-12-16T03:28:09.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.539+0000 7f76b3fff640 1 -- 172.21.15.28:0/2595681842 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7f76bc054e50 con 0x7f76cc0c4e60 2023-12-16T03:28:09.544 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:09.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 -- 172.21.15.28:0/2595681842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76b8066470 msgr2=0x7f76b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76b8066470 0x7f76b8068930 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f76cc150a10 tx=0x7f76c0009040 comp rx=0 tx=0).stop 2023-12-16T03:28:09.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 -- 172.21.15.28:0/2595681842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76cc0c4e60 msgr2=0x7f76cc14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76cc0c4e60 0x7f76cc14b2f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00d800 tx=0x7f76bc00dcc0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 -- 172.21.15.28:0/2595681842 shutdown_connections 2023-12-16T03:28:09.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f76cc151e90 0x7f76cc1f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76cc0c7ea0 0x7f76cc1f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f76b8066470 0x7f76b8068930 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 --2- 172.21.15.28:0/2595681842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f76cc0c4e60 0x7f76cc14b2f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 -- 172.21.15.28:0/2595681842 >> 172.21.15.28:0/2595681842 conn(0x7f76cc0ca170 msgr2=0x7f76cc0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:09.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 -- 172.21.15.28:0/2595681842 shutdown_connections 2023-12-16T03:28:09.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.543+0000 7f76d1cfe640 1 -- 172.21.15.28:0/2595681842 wait complete. 2023-12-16T03:28:09.565 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-16T03:28:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.703+0000 7f9aea0e3640 1 Processor -- start 2023-12-16T03:28:09.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.703+0000 7f9aea0e3640 1 -- start start 2023-12-16T03:28:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9aea0e3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 0x7f9ae406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9aea0e3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae4072500 con 0x7f9ae406a5b0 2023-12-16T03:28:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9aea0e3640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae4070f60 con 0x7f9ae406b1e0 2023-12-16T03:28:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9aea0e3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae406ef50 con 0x7f9ae406dfe0 2023-12-16T03:28:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9ae37fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9ae406a5b0 0x7f9ae40c2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57186/0 (socket says 172.21.15.28:57186) 2023-12-16T03:28:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9ae37fe640 1 -- 172.21.15.28:0/1234733729 learned_addr learned my addr 172.21.15.28:0/1234733729 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9ae2ffd640 1 --2- 172.21.15.28:0/1234733729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 0x7f9ae406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9ae27fc640 1 -- 172.21.15.28:0/1234733729 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507095382 0 0) 0x7f9ae4072500 con 0x7f9ae406a5b0 2023-12-16T03:28:09.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9ae27fc640 1 -- 172.21.15.28:0/1234733729 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9acc003530 con 0x7f9ae406a5b0 2023-12-16T03:28:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9ae27fc640 1 -- 172.21.15.28:0/1234733729 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910545429 0 0) 0x7f9ae4070f60 con 0x7f9ae406b1e0 2023-12-16T03:28:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9ae27fc640 1 -- 172.21.15.28:0/1234733729 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae4072500 con 0x7f9ae406b1e0 2023-12-16T03:28:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9ae2ffd640 1 -- 172.21.15.28:0/1234733729 >> v1:172.21.15.134:6789/0 conn(0x7f9ae406b1e0 legacy=0x7f9ae415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9ae27fc640 1 -- 172.21.15.28:0/1234733729 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4092997507 0 0) 0x7f9acc003530 con 0x7f9ae406a5b0 2023-12-16T03:28:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9ae2ffd640 1 -- 172.21.15.28:0/1234733729 >> v1:172.21.15.28:6789/0 conn(0x7f9ae406a5b0 legacy=0x7f9ae40c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.707+0000 7f9ae2ffd640 1 -- 172.21.15.28:0/1234733729 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae414eda0 con 0x7f9ae406dfe0 2023-12-16T03:28:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9ae2ffd640 1 --2- 172.21.15.28:0/1234733729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 0x7f9ae406a990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80097f0 tx=0x7f9ad801c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3459c5351205da8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9ae27fc640 1 -- 172.21.15.28:0/1234733729 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4001680 con 0x7f9ae406dfe0 2023-12-16T03:28:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9ae27fc640 1 -- 172.21.15.28:0/1234733729 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad80a7050 con 0x7f9ae406dfe0 2023-12-16T03:28:09.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9ae27fc640 1 -- 172.21.15.28:0/1234733729 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80ab620 con 0x7f9ae406dfe0 2023-12-16T03:28:09.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 -- 172.21.15.28:0/1234733729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 msgr2=0x7f9ae406a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 --2- 172.21.15.28:0/1234733729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 0x7f9ae406a990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80097f0 tx=0x7f9ad801c350 comp rx=0 tx=0).stop 2023-12-16T03:28:09.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 -- 172.21.15.28:0/1234733729 shutdown_connections 2023-12-16T03:28:09.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 --2- 172.21.15.28:0/1234733729 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 0x7f9ae406a990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 -- 172.21.15.28:0/1234733729 >> 172.21.15.28:0/1234733729 conn(0x7f9ae40c6ef0 msgr2=0x7f9ae40c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:09.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 -- 172.21.15.28:0/1234733729 shutdown_connections 2023-12-16T03:28:09.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 -- 172.21.15.28:0/1234733729 wait complete. 2023-12-16T03:28:09.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 Processor -- start 2023-12-16T03:28:09.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 -- start start 2023-12-16T03:28:09.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ae406a5b0 0x7f9ae414a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae406b1e0 0x7f9ae413fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 0x7f9ae413d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae4140110 con 0x7f9ae406a5b0 2023-12-16T03:28:09.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae414b020 con 0x7f9ae406b1e0 2023-12-16T03:28:09.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.711+0000 7f9aea0e3640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae41f1520 con 0x7f9ae406dfe0 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ae406a5b0 0x7f9ae414a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ae406a5b0 0x7f9ae414a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45668/0 (socket says 172.21.15.28:45668) 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae37fe640 1 -- 172.21.15.28:0/3896525973 learned_addr learned my addr 172.21.15.28:0/3896525973 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae2ffd640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae406b1e0 0x7f9ae413fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae3fff640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 0x7f9ae413d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae37fe640 1 -- 172.21.15.28:0/3896525973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 msgr2=0x7f9ae413d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae37fe640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 0x7f9ae413d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae37fe640 1 -- 172.21.15.28:0/3896525973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae406b1e0 msgr2=0x7f9ae413fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae37fe640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae406b1e0 0x7f9ae413fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae37fe640 1 -- 172.21.15.28:0/3896525973 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8009420 con 0x7f9ae406a5b0 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae3fff640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 0x7f9ae413d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:09.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9ae37fe640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ae406a5b0 0x7f9ae414a740 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400c780 tx=0x7f9ad400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:09.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9acbfff640 1 -- 172.21.15.28:0/3896525973 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4005ae0 con 0x7f9ae406a5b0 2023-12-16T03:28:09.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9acbfff640 1 -- 172.21.15.28:0/3896525973 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad4005c40 con 0x7f9ae406a5b0 2023-12-16T03:28:09.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9acbfff640 1 -- 172.21.15.28:0/3896525973 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4007070 con 0x7f9ae406a5b0 2023-12-16T03:28:09.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9aea0e3640 1 -- 172.21.15.28:0/3896525973 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae40c6b80 con 0x7f9ae406a5b0 2023-12-16T03:28:09.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9aea0e3640 1 -- 172.21.15.28:0/3896525973 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae414ad40 con 0x7f9ae406a5b0 2023-12-16T03:28:09.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9aea0e3640 1 -- 172.21.15.28:0/3896525973 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae41f0d70 con 0x7f9ae406a5b0 2023-12-16T03:28:09.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9acbfff640 1 -- 172.21.15.28:0/3896525973 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9ad40071f0 con 0x7f9ae406a5b0 2023-12-16T03:28:09.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.715+0000 7f9acbfff640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 0x7f9ad0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:09.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.719+0000 7f9acbfff640 1 -- 172.21.15.28:0/3896525973 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ad4083b20 con 0x7f9ae406a5b0 2023-12-16T03:28:09.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.719+0000 7f9ae2ffd640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 0x7f9ad0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:09.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.719+0000 7f9ae2ffd640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 0x7f9ad0068930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80ad000 tx=0x7f9ad80a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:09.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.723+0000 7f9acbfff640 1 -- 172.21.15.28:0/3896525973 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9ae41f0d70 con 0x7f9ae406a5b0 2023-12-16T03:28:09.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 -- 172.21.15.28:0/3896525973 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9ae41f0d70 con 0x7f9ae406a5b0 2023-12-16T03:28:09.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9acbfff640 1 -- 172.21.15.28:0/3896525973 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+209 (secure 0 0 0) 0x7f9ae41f0d70 con 0x7f9ae406a5b0 2023-12-16T03:28:09.890 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:09.890 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2023-12-16T03:28:09.890 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:28:09.890 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2023-12-16T03:28:09.890 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2023-12-16T03:28:09.891 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:28:09.891 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:28:09.891 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 12, 2023-12-16T03:28:09.891 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": "cephfs_metadata" 2023-12-16T03:28:09.891 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-12-16T03:28:09.891 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-12-16T03:28:09.891 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 13, 2023-12-16T03:28:09.891 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": "cephfs_data" 2023-12-16T03:28:09.891 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-12-16T03:28:09.891 INFO:teuthology.orchestra.run.smithi028.stdout:] 2023-12-16T03:28:09.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 -- 172.21.15.28:0/3896525973 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 msgr2=0x7f9ad0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 0x7f9ad0068930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80ad000 tx=0x7f9ad80a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:09.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 -- 172.21.15.28:0/3896525973 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ae406a5b0 msgr2=0x7f9ae414a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:09.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ae406a5b0 0x7f9ae414a740 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400c780 tx=0x7f9ad400cc40 comp rx=0 tx=0).stop 2023-12-16T03:28:09.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 -- 172.21.15.28:0/3896525973 shutdown_connections 2023-12-16T03:28:09.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9ae406dfe0 0x7f9ae413d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ae406b1e0 0x7f9ae413fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9ad0066470 0x7f9ad0068930 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 --2- 172.21.15.28:0/3896525973 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ae406a5b0 0x7f9ae414a740 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:09.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 -- 172.21.15.28:0/3896525973 >> 172.21.15.28:0/3896525973 conn(0x7f9ae40c6ef0 msgr2=0x7f9ae4140a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:09.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 -- 172.21.15.28:0/3896525973 shutdown_connections 2023-12-16T03:28:09.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:09.886+0000 7f9aea0e3640 1 -- 172.21.15.28:0/3896525973 wait complete. 2023-12-16T03:28:09.912 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-16T03:28:09.912 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-16T03:28:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.054+0000 7ff19e432640 1 Processor -- start 2023-12-16T03:28:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.054+0000 7ff19e432640 1 -- start start 2023-12-16T03:28:10.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.054+0000 7ff19e432640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff1980c1250 0x7ff1980c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.054+0000 7ff19e432640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1980c0aa0 0x7ff1980c4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.054+0000 7ff19e432640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff198072800 con 0x7ff19806fec0 2023-12-16T03:28:10.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.054+0000 7ff19e432640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1980a9fc0 con 0x7ff1980c1250 2023-12-16T03:28:10.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.054+0000 7ff19e432640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff198072ae0 con 0x7ff1980c0aa0 2023-12-16T03:28:10.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff1977fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff19806fec0 0x7ff1980c3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57202/0 (socket says 172.21.15.28:57202) 2023-12-16T03:28:10.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff1977fe640 1 -- 172.21.15.28:0/490192855 learned_addr learned my addr 172.21.15.28:0/490192855 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:10.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff197fff640 1 --2- 172.21.15.28:0/490192855 >> v2:172.21.15.134:3300/0 conn(0x7ff1980c1250 0x7ff1980c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff19c9cf640 1 --2- 172.21.15.28:0/490192855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1980c0aa0 0x7ff1980c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff196ffd640 1 -- 172.21.15.28:0/490192855 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946067801 0 0) 0x7ff198072800 con 0x7ff19806fec0 2023-12-16T03:28:10.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff196ffd640 1 -- 172.21.15.28:0/490192855 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff180003530 con 0x7ff19806fec0 2023-12-16T03:28:10.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff196ffd640 1 -- 172.21.15.28:0/490192855 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3024289025 0 0) 0x7ff180003530 con 0x7ff19806fec0 2023-12-16T03:28:10.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff197fff640 1 -- 172.21.15.28:0/490192855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1980c0aa0 msgr2=0x7ff1980c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff197fff640 1 --2- 172.21.15.28:0/490192855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1980c0aa0 0x7ff1980c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff197fff640 1 -- 172.21.15.28:0/490192855 >> v1:172.21.15.28:6789/0 conn(0x7ff19806fec0 legacy=0x7ff1980c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff197fff640 1 -- 172.21.15.28:0/490192855 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980a9900 con 0x7ff1980c1250 2023-12-16T03:28:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.058+0000 7ff19c9cf640 1 --2- 172.21.15.28:0/490192855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1980c0aa0 0x7ff1980c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff197fff640 1 --2- 172.21.15.28:0/490192855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1980c1250 0x7ff1980c1de0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff1880097c0 tx=0x7ff18801c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d8a58cb156e8fc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff196ffd640 1 -- 172.21.15.28:0/490192855 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c001680 con 0x7ff1980c1250 2023-12-16T03:28:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff196ffd640 1 -- 172.21.15.28:0/490192855 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1880a7050 con 0x7ff1980c1250 2023-12-16T03:28:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff196ffd640 1 -- 172.21.15.28:0/490192855 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1880ab620 con 0x7ff1980c1250 2023-12-16T03:28:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 -- 172.21.15.28:0/490192855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1980c1250 msgr2=0x7ff1980c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 --2- 172.21.15.28:0/490192855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1980c1250 0x7ff1980c1de0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff1880097c0 tx=0x7ff18801c250 comp rx=0 tx=0).stop 2023-12-16T03:28:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 -- 172.21.15.28:0/490192855 shutdown_connections 2023-12-16T03:28:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 --2- 172.21.15.28:0/490192855 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1980c0aa0 0x7ff1980c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 --2- 172.21.15.28:0/490192855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1980c1250 0x7ff1980c1de0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 -- 172.21.15.28:0/490192855 >> 172.21.15.28:0/490192855 conn(0x7ff1980c5d40 msgr2=0x7ff1980c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 -- 172.21.15.28:0/490192855 shutdown_connections 2023-12-16T03:28:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 -- 172.21.15.28:0/490192855 wait complete. 2023-12-16T03:28:10.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 Processor -- start 2023-12-16T03:28:10.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 -- start start 2023-12-16T03:28:10.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19806fec0 0x7ff198152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1980c0aa0 0x7ff19806d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1980c1250 0x7ff19814fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1981531b0 con 0x7ff1980c1250 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1981f1220 con 0x7ff19806fec0 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.062+0000 7ff19e432640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1981f16b0 con 0x7ff1980c0aa0 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19c9cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1980c1250 0x7ff19814fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19c9cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1980c1250 0x7ff19814fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45684/0 (socket says 172.21.15.28:45684) 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19c9cf640 1 -- 172.21.15.28:0/729135782 learned_addr learned my addr 172.21.15.28:0/729135782 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff1977fe640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1980c0aa0 0x7ff19806d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff197fff640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19806fec0 0x7ff198152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19c9cf640 1 -- 172.21.15.28:0/729135782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1980c0aa0 msgr2=0x7ff19806d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19c9cf640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1980c0aa0 0x7ff19806d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19c9cf640 1 -- 172.21.15.28:0/729135782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19806fec0 msgr2=0x7ff198152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19c9cf640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19806fec0 0x7ff198152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19c9cf640 1 -- 172.21.15.28:0/729135782 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19000ab80 con 0x7ff1980c1250 2023-12-16T03:28:10.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19c9cf640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1980c1250 0x7ff19814fb40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff190009f00 tx=0x7ff1900075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:10.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff194ff9640 1 -- 172.21.15.28:0/729135782 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190018070 con 0x7ff1980c1250 2023-12-16T03:28:10.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff194ff9640 1 -- 172.21.15.28:0/729135782 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff190010040 con 0x7ff1980c1250 2023-12-16T03:28:10.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff194ff9640 1 -- 172.21.15.28:0/729135782 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190003ba0 con 0x7ff1980c1250 2023-12-16T03:28:10.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19e432640 1 -- 172.21.15.28:0/729135782 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff188009420 con 0x7ff1980c1250 2023-12-16T03:28:10.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19e432640 1 -- 172.21.15.28:0/729135782 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1980a7790 con 0x7ff1980c1250 2023-12-16T03:28:10.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff19e432640 1 -- 172.21.15.28:0/729135782 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1981f1390 con 0x7ff1980c1250 2023-12-16T03:28:10.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff194ff9640 1 -- 172.21.15.28:0/729135782 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff19001d410 con 0x7ff1980c1250 2023-12-16T03:28:10.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff194ff9640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff1840664a0 0x7ff184068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.066+0000 7ff194ff9640 1 -- 172.21.15.28:0/729135782 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1900841b0 con 0x7ff1980c1250 2023-12-16T03:28:10.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.070+0000 7ff197fff640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff1840664a0 0x7ff184068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.070+0000 7ff197fff640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff1840664a0 0x7ff184068960 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff1880ad000 tx=0x7ff1880a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:10.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.070+0000 7ff194ff9640 1 -- 172.21.15.28:0/729135782 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff1900516c0 con 0x7ff1980c1250 2023-12-16T03:28:10.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.230+0000 7ff19e432640 1 -- 172.21.15.28:0/729135782 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff198068400 con 0x7ff1980c1250 2023-12-16T03:28:10.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.754+0000 7ff194ff9640 1 -- 172.21.15.28:0/729135782 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v69) v1 ==== 140+0+0 (secure 0 0 0) 0x7ff19000ae60 con 0x7ff1980c1250 2023-12-16T03:28:10.757 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_metadata' created 2023-12-16T03:28:10.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.754+0000 7ff19e432640 1 -- 172.21.15.28:0/729135782 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff1840664a0 msgr2=0x7ff184068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:10.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.754+0000 7ff19e432640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff1840664a0 0x7ff184068960 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff1880ad000 tx=0x7ff1880a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:10.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.754+0000 7ff19e432640 1 -- 172.21.15.28:0/729135782 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1980c1250 msgr2=0x7ff19814fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:10.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.754+0000 7ff19e432640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1980c1250 0x7ff19814fb40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff190009f00 tx=0x7ff1900075c0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.754+0000 7ff19e432640 1 -- 172.21.15.28:0/729135782 shutdown_connections 2023-12-16T03:28:10.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.754+0000 7ff19e432640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff1840664a0 0x7ff184068960 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.754+0000 7ff19e432640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff1980c1250 0x7ff19814fb40 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.754+0000 7ff19e432640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1980c0aa0 0x7ff19806d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.754+0000 7ff19e432640 1 --2- 172.21.15.28:0/729135782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff19806fec0 0x7ff198152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.754+0000 7ff19e432640 1 -- 172.21.15.28:0/729135782 >> 172.21.15.28:0/729135782 conn(0x7ff1980c5d40 msgr2=0x7ff198155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:10.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.758+0000 7ff19e432640 1 -- 172.21.15.28:0/729135782 shutdown_connections 2023-12-16T03:28:10.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.758+0000 7ff19e432640 1 -- 172.21.15.28:0/729135782 wait complete. 2023-12-16T03:28:10.789 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-16T03:28:10.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.934+0000 7f139fe9c640 1 Processor -- start 2023-12-16T03:28:10.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.934+0000 7f139fe9c640 1 -- start start 2023-12-16T03:28:10.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139fe9c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f139806a5b0 0x7f139806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139fe9c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f139806dfe0 0x7f13980c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139fe9c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f139806b1e0 0x7f13980c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139fe9c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139806ef50 con 0x7f139806a5b0 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139fe9c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980720b0 con 0x7f139806dfe0 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139fe9c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1398072500 con 0x7f139806b1e0 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139dc38640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f139806a5b0 0x7f139806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139dc38640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f139806a5b0 0x7f139806a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45698/0 (socket says 172.21.15.28:45698) 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139dc38640 1 -- 172.21.15.28:0/1381897718 learned_addr learned my addr 172.21.15.28:0/1381897718 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139e439640 1 --2- 172.21.15.28:0/1381897718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f139806b1e0 0x7f13980c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139d437640 1 --2- 172.21.15.28:0/1381897718 >> v2:172.21.15.134:3300/0 conn(0x7f139806dfe0 0x7f13980c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139dc38640 1 -- 172.21.15.28:0/1381897718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f139806b1e0 msgr2=0x7f13980c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139dc38640 1 --2- 172.21.15.28:0/1381897718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f139806b1e0 0x7f13980c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139dc38640 1 -- 172.21.15.28:0/1381897718 >> v2:172.21.15.134:3300/0 conn(0x7f139806dfe0 msgr2=0x7f13980c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139dc38640 1 --2- 172.21.15.28:0/1381897718 >> v2:172.21.15.134:3300/0 conn(0x7f139806dfe0 0x7f13980c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139dc38640 1 -- 172.21.15.28:0/1381897718 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398070f60 con 0x7f139806a5b0 2023-12-16T03:28:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.938+0000 7f139d437640 1 --2- 172.21.15.28:0/1381897718 >> v2:172.21.15.134:3300/0 conn(0x7f139806dfe0 0x7f13980c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:10.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139dc38640 1 --2- 172.21.15.28:0/1381897718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f139806a5b0 0x7f139806a990 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f139806ced0 tx=0x7f139401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368c3ac00699f6c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:10.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139cc36640 1 -- 172.21.15.28:0/1381897718 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13940ab600 con 0x7f139806a5b0 2023-12-16T03:28:10.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139cc36640 1 -- 172.21.15.28:0/1381897718 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13940a7050 con 0x7f139806a5b0 2023-12-16T03:28:10.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139cc36640 1 -- 172.21.15.28:0/1381897718 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13940ab980 con 0x7f139806a5b0 2023-12-16T03:28:10.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139fe9c640 1 -- 172.21.15.28:0/1381897718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f139806a5b0 msgr2=0x7f139806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:10.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139fe9c640 1 --2- 172.21.15.28:0/1381897718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f139806a5b0 0x7f139806a990 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f139806ced0 tx=0x7f139401c470 comp rx=0 tx=0).stop 2023-12-16T03:28:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139fe9c640 1 -- 172.21.15.28:0/1381897718 shutdown_connections 2023-12-16T03:28:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139fe9c640 1 --2- 172.21.15.28:0/1381897718 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f139806b1e0 0x7f13980c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139fe9c640 1 --2- 172.21.15.28:0/1381897718 >> v2:172.21.15.134:3300/0 conn(0x7f139806dfe0 0x7f13980c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139fe9c640 1 --2- 172.21.15.28:0/1381897718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f139806a5b0 0x7f139806a990 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139fe9c640 1 -- 172.21.15.28:0/1381897718 >> 172.21.15.28:0/1381897718 conn(0x7f13980c6ef0 msgr2=0x7f13980c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139fe9c640 1 -- 172.21.15.28:0/1381897718 shutdown_connections 2023-12-16T03:28:10.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139fe9c640 1 -- 172.21.15.28:0/1381897718 wait complete. 2023-12-16T03:28:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139fe9c640 1 Processor -- start 2023-12-16T03:28:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.942+0000 7f139fe9c640 1 -- start start 2023-12-16T03:28:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139fe9c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f139806a5b0 0x7f1398156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139fe9c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f139806b1e0 0x7f1398156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139fe9c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139806dfe0 0x7f13981425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139fe9c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13980c5e40 con 0x7f139806b1e0 2023-12-16T03:28:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139fe9c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1398157110 con 0x7f139806dfe0 2023-12-16T03:28:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139fe9c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1398155a00 con 0x7f139806a5b0 2023-12-16T03:28:10.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139d437640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f139806b1e0 0x7f1398156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139d437640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f139806b1e0 0x7f1398156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45704/0 (socket says 172.21.15.28:45704) 2023-12-16T03:28:10.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139d437640 1 -- 172.21.15.28:0/3590473610 learned_addr learned my addr 172.21.15.28:0/3590473610 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:10.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139e439640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139806dfe0 0x7f13981425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139dc38640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f139806a5b0 0x7f1398156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139d437640 1 -- 172.21.15.28:0/3590473610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f139806a5b0 msgr2=0x7f1398156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:10.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139d437640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f139806a5b0 0x7f1398156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139d437640 1 -- 172.21.15.28:0/3590473610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139806dfe0 msgr2=0x7f13981425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:10.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139d437640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139806dfe0 0x7f13981425c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:10.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139d437640 1 -- 172.21.15.28:0/3590473610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13940094d0 con 0x7f139806b1e0 2023-12-16T03:28:10.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139d437640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f139806b1e0 0x7f1398156bd0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f138800c820 tx=0x7f138800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:10.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f138e7fc640 1 -- 172.21.15.28:0/3590473610 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880079d0 con 0x7f139806b1e0 2023-12-16T03:28:10.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f138e7fc640 1 -- 172.21.15.28:0/3590473610 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388007b30 con 0x7f139806b1e0 2023-12-16T03:28:10.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139fe9c640 1 -- 172.21.15.28:0/3590473610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13981560e0 con 0x7f139806b1e0 2023-12-16T03:28:10.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f138e7fc640 1 -- 172.21.15.28:0/3590473610 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138800ce10 con 0x7f139806b1e0 2023-12-16T03:28:10.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139fe9c640 1 -- 172.21.15.28:0/3590473610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13980c5b60 con 0x7f139806b1e0 2023-12-16T03:28:10.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.946+0000 7f139fe9c640 1 -- 172.21.15.28:0/3590473610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1398068400 con 0x7f139806b1e0 2023-12-16T03:28:10.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.950+0000 7f138e7fc640 1 -- 172.21.15.28:0/3590473610 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1388024480 con 0x7f139806b1e0 2023-12-16T03:28:10.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.950+0000 7f138e7fc640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f137c0664a0 0x7f137c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:10.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.950+0000 7f138e7fc640 1 -- 172.21.15.28:0/3590473610 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f13880844d0 con 0x7f139806b1e0 2023-12-16T03:28:10.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.950+0000 7f139dc38640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f137c0664a0 0x7f137c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:10.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.950+0000 7f139dc38640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f137c0664a0 0x7f137c068960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f13940ad000 tx=0x7f13940a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:10.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:10.954+0000 7f138e7fc640 1 -- 172.21.15.28:0/3590473610 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1388051800 con 0x7f139806b1e0 2023-12-16T03:28:11.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.118+0000 7f139fe9c640 1 -- 172.21.15.28:0/3590473610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f13980c7cb0 con 0x7f139806b1e0 2023-12-16T03:28:11.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.754+0000 7f138e7fc640 1 -- 172.21.15.28:0/3590473610 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v70) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1388054e20 con 0x7f139806b1e0 2023-12-16T03:28:11.761 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_data' created 2023-12-16T03:28:11.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.758+0000 7f139fe9c640 1 -- 172.21.15.28:0/3590473610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f137c0664a0 msgr2=0x7f137c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:11.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.758+0000 7f139fe9c640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f137c0664a0 0x7f137c068960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f13940ad000 tx=0x7f13940a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:11.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.758+0000 7f139fe9c640 1 -- 172.21.15.28:0/3590473610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f139806b1e0 msgr2=0x7f1398156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:11.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.758+0000 7f139fe9c640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f139806b1e0 0x7f1398156bd0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f138800c820 tx=0x7f138800cce0 comp rx=0 tx=0).stop 2023-12-16T03:28:11.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.758+0000 7f139fe9c640 1 -- 172.21.15.28:0/3590473610 shutdown_connections 2023-12-16T03:28:11.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.758+0000 7f139fe9c640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f139806dfe0 0x7f13981425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:11.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.758+0000 7f139fe9c640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f137c0664a0 0x7f137c068960 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:11.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.758+0000 7f139fe9c640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f139806b1e0 0x7f1398156bd0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:11.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.758+0000 7f139fe9c640 1 --2- 172.21.15.28:0/3590473610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f139806a5b0 0x7f1398156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:11.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.758+0000 7f139fe9c640 1 -- 172.21.15.28:0/3590473610 >> 172.21.15.28:0/3590473610 conn(0x7f13980c6ef0 msgr2=0x7f139806e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:11.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.762+0000 7f139fe9c640 1 -- 172.21.15.28:0/3590473610 shutdown_connections 2023-12-16T03:28:11.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.762+0000 7f139fe9c640 1 -- 172.21.15.28:0/3590473610 wait complete. 2023-12-16T03:28:11.808 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-16T03:28:11.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd721646640 1 Processor -- start 2023-12-16T03:28:11.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd721646640 1 -- start start 2023-12-16T03:28:11.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd721646640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71c0c5640 0x7fd71c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:11.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd721646640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd71c0c60f0 0x7fd71c155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:11.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd721646640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c0c2580 con 0x7fd71c0c5260 2023-12-16T03:28:11.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd721646640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71c153510 con 0x7fd71c0c60f0 2023-12-16T03:28:11.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd721646640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0c17f0 con 0x7fd71c0c5640 2023-12-16T03:28:11.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd71b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd71c0c60f0 0x7fd71c155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:11.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd71b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd71c0c60f0 0x7fd71c155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45716/0 (socket says 172.21.15.28:45716) 2023-12-16T03:28:11.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd71b7fe640 1 -- 172.21.15.28:0/1619117968 learned_addr learned my addr 172.21.15.28:0/1619117968 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:11.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd7127fc640 1 --2- 172.21.15.28:0/1619117968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71c0c5640 0x7fd71c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:11.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd71b7fe640 1 -- 172.21.15.28:0/1619117968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71c0c5640 msgr2=0x7fd71c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:11.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd71b7fe640 1 --2- 172.21.15.28:0/1619117968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71c0c5640 0x7fd71c0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:11.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd71b7fe640 1 -- 172.21.15.28:0/1619117968 >> v1:172.21.15.134:6789/0 conn(0x7fd71c0c5260 legacy=0x7fd71c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:11.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.954+0000 7fd71b7fe640 1 -- 172.21.15.28:0/1619117968 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0c1a00 con 0x7fd71c0c60f0 2023-12-16T03:28:11.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd71b7fe640 1 --2- 172.21.15.28:0/1619117968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd71c0c60f0 0x7fd71c155de0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0c1930 tx=0x7fd71401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e835cade265ffe7f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:11.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd71a7fc640 1 -- 172.21.15.28:0/1619117968 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140a57f0 con 0x7fd71c0c60f0 2023-12-16T03:28:11.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd71a7fc640 1 -- 172.21.15.28:0/1619117968 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7140a5950 con 0x7fd71c0c60f0 2023-12-16T03:28:11.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd71a7fc640 1 -- 172.21.15.28:0/1619117968 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140a5ce0 con 0x7fd71c0c60f0 2023-12-16T03:28:11.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd721646640 1 -- 172.21.15.28:0/1619117968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd71c0c60f0 msgr2=0x7fd71c155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:11.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd721646640 1 --2- 172.21.15.28:0/1619117968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd71c0c60f0 0x7fd71c155de0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0c1930 tx=0x7fd71401c930 comp rx=0 tx=0).stop 2023-12-16T03:28:11.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd721646640 1 -- 172.21.15.28:0/1619117968 shutdown_connections 2023-12-16T03:28:11.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd721646640 1 --2- 172.21.15.28:0/1619117968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71c0c5640 0x7fd71c0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:11.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd721646640 1 --2- 172.21.15.28:0/1619117968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd71c0c60f0 0x7fd71c155de0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:11.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd721646640 1 -- 172.21.15.28:0/1619117968 >> 172.21.15.28:0/1619117968 conn(0x7fd71c06a5b0 msgr2=0x7fd71c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:11.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd721646640 1 -- 172.21.15.28:0/1619117968 shutdown_connections 2023-12-16T03:28:11.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.958+0000 7fd721646640 1 -- 172.21.15.28:0/1619117968 wait complete. 2023-12-16T03:28:11.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd721646640 1 Processor -- start 2023-12-16T03:28:11.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd721646640 1 -- start start 2023-12-16T03:28:11.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd721646640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd71c0c5260 0x7fd71c1f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:11.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd721646640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71c0c5640 0x7fd71c1f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:11.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd721646640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71c0c60f0 0x7fd71c14e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:11.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd721646640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c1f58a0 con 0x7fd71c0c5260 2023-12-16T03:28:11.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd721646640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c14f090 con 0x7fd71c0c60f0 2023-12-16T03:28:11.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd721646640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c1f14f0 con 0x7fd71c0c5640 2023-12-16T03:28:11.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd71affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd71c0c5260 0x7fd71c1f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:11.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd71affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd71c0c5260 0x7fd71c1f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45726/0 (socket says 172.21.15.28:45726) 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd71affd640 1 -- 172.21.15.28:0/3373157695 learned_addr learned my addr 172.21.15.28:0/3373157695 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd7127fc640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71c0c5640 0x7fd71c1f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd71b7fe640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71c0c60f0 0x7fd71c14e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd71affd640 1 -- 172.21.15.28:0/3373157695 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71c0c5640 msgr2=0x7fd71c1f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd71affd640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71c0c5640 0x7fd71c1f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd71affd640 1 -- 172.21.15.28:0/3373157695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71c0c60f0 msgr2=0x7fd71c14e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd71affd640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71c0c60f0 0x7fd71c14e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd71affd640 1 -- 172.21.15.28:0/3373157695 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd714009b30 con 0x7fd71c0c5260 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd71affd640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd71c0c5260 0x7fd71c1f1f90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00c3c0 tx=0x7fd70c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd713fff640 1 -- 172.21.15.28:0/3373157695 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0052d0 con 0x7fd71c0c5260 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd713fff640 1 -- 172.21.15.28:0/3373157695 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c005430 con 0x7fd71c0c5260 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd721646640 1 -- 172.21.15.28:0/3373157695 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c0aa3d0 con 0x7fd71c0c5260 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd713fff640 1 -- 172.21.15.28:0/3373157695 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c003840 con 0x7fd71c0c5260 2023-12-16T03:28:11.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd721646640 1 -- 172.21.15.28:0/3373157695 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c1f1a70 con 0x7fd71c0c5260 2023-12-16T03:28:11.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.962+0000 7fd721646640 1 -- 172.21.15.28:0/3373157695 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c068400 con 0x7fd71c0c5260 2023-12-16T03:28:11.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.966+0000 7fd713fff640 1 -- 172.21.15.28:0/3373157695 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd70c0039a0 con 0x7fd71c0c5260 2023-12-16T03:28:11.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.966+0000 7fd713fff640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6fc066470 0x7fd6fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:11.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.966+0000 7fd713fff640 1 -- 172.21.15.28:0/3373157695 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fd70c083aa0 con 0x7fd71c0c5260 2023-12-16T03:28:11.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.966+0000 7fd7127fc640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6fc066470 0x7fd6fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:11.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.966+0000 7fd7127fc640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6fc066470 0x7fd6fc068930 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0a8d20 tx=0x7fd704009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:11.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:11.970+0000 7fd713fff640 1 -- 172.21.15.28:0/3373157695 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd70c050cc0 con 0x7fd71c0c5260 2023-12-16T03:28:12.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.166+0000 7fd721646640 1 -- 172.21.15.28:0/3373157695 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fd71c0a8840 con 0x7fd71c0c5260 2023-12-16T03:28:12.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.774+0000 7fd713fff640 1 -- 172.21.15.28:0/3373157695 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v47) v1 ==== 177+0+0 (secure 0 0 0) 0x7fd70c0542e0 con 0x7fd71c0c5260 2023-12-16T03:28:12.778 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 14 and data pool 15 2023-12-16T03:28:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 -- 172.21.15.28:0/3373157695 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6fc066470 msgr2=0x7fd6fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6fc066470 0x7fd6fc068930 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0a8d20 tx=0x7fd704009190 comp rx=0 tx=0).stop 2023-12-16T03:28:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 -- 172.21.15.28:0/3373157695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd71c0c5260 msgr2=0x7fd71c1f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd71c0c5260 0x7fd71c1f1f90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00c3c0 tx=0x7fd70c00c880 comp rx=0 tx=0).stop 2023-12-16T03:28:12.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 -- 172.21.15.28:0/3373157695 shutdown_connections 2023-12-16T03:28:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71c0c60f0 0x7fd71c14e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd71c0c5640 0x7fd71c1f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd6fc066470 0x7fd6fc068930 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 --2- 172.21.15.28:0/3373157695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd71c0c5260 0x7fd71c1f1f90 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 -- 172.21.15.28:0/3373157695 >> 172.21.15.28:0/3373157695 conn(0x7fd71c06a5b0 msgr2=0x7fd71c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:12.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 -- 172.21.15.28:0/3373157695 shutdown_connections 2023-12-16T03:28:12.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.778+0000 7fd721646640 1 -- 172.21.15.28:0/3373157695 wait complete. 2023-12-16T03:28:12.827 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:12.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c5266b640 1 Processor -- start 2023-12-16T03:28:12.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c5266b640 1 -- start start 2023-12-16T03:28:12.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c5266b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c4c152030 0x7f3c4c0c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:12.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c5266b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3c4c06c470 0x7f3c4c157c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:12.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c5266b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c154b60 con 0x7f3c4c154ff0 2023-12-16T03:28:12.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c5266b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4c152410 con 0x7f3c4c06c470 2023-12-16T03:28:12.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c5266b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0c1820 con 0x7f3c4c152030 2023-12-16T03:28:12.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c4b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3c4c06c470 0x7f3c4c157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:12.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c4b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3c4c06c470 0x7f3c4c157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45734/0 (socket says 172.21.15.28:45734) 2023-12-16T03:28:12.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c4b7fe640 1 -- 172.21.15.28:0/1150352728 learned_addr learned my addr 172.21.15.28:0/1150352728 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:12.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c4bfff640 1 --2- 172.21.15.28:0/1150352728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c4c152030 0x7f3c4c0c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:12.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c4b7fe640 1 -- 172.21.15.28:0/1150352728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c4c152030 msgr2=0x7f3c4c0c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:12.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c4b7fe640 1 --2- 172.21.15.28:0/1150352728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c4c152030 0x7f3c4c0c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:12.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c4b7fe640 1 -- 172.21.15.28:0/1150352728 >> v1:172.21.15.134:6789/0 conn(0x7f3c4c154ff0 legacy=0x7f3c4c0c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:12.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c4b7fe640 1 -- 172.21.15.28:0/1150352728 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c0c1260 con 0x7f3c4c06c470 2023-12-16T03:28:12.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.970+0000 7f3c4bfff640 1 --2- 172.21.15.28:0/1150352728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c4c152030 0x7f3c4c0c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:12.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c4b7fe640 1 --2- 172.21.15.28:0/1150352728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c4c06c470 0x7f3c4c157c90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009870 tx=0x7f3c4001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf90385a2ca0c16 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:12.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c4affd640 1 -- 172.21.15.28:0/1150352728 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400a7070 con 0x7f3c4c06c470 2023-12-16T03:28:12.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c4affd640 1 -- 172.21.15.28:0/1150352728 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400ab430 con 0x7f3c4c06c470 2023-12-16T03:28:12.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c4affd640 1 -- 172.21.15.28:0/1150352728 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400ab7c0 con 0x7f3c4c06c470 2023-12-16T03:28:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c5266b640 1 -- 172.21.15.28:0/1150352728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c4c06c470 msgr2=0x7f3c4c157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c5266b640 1 --2- 172.21.15.28:0/1150352728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c4c06c470 0x7f3c4c157c90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009870 tx=0x7f3c4001c470 comp rx=0 tx=0).stop 2023-12-16T03:28:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c5266b640 1 -- 172.21.15.28:0/1150352728 shutdown_connections 2023-12-16T03:28:12.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c5266b640 1 --2- 172.21.15.28:0/1150352728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c4c06c470 0x7f3c4c157c90 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:12.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c5266b640 1 --2- 172.21.15.28:0/1150352728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c4c152030 0x7f3c4c0c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:12.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c5266b640 1 -- 172.21.15.28:0/1150352728 >> 172.21.15.28:0/1150352728 conn(0x7f3c4c06a5b0 msgr2=0x7f3c4c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:12.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c5266b640 1 -- 172.21.15.28:0/1150352728 shutdown_connections 2023-12-16T03:28:12.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.974+0000 7f3c5266b640 1 -- 172.21.15.28:0/1150352728 wait complete. 2023-12-16T03:28:12.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c5266b640 1 Processor -- start 2023-12-16T03:28:12.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c5266b640 1 -- start start 2023-12-16T03:28:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c5266b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c4c06c470 0x7f3c4c1577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c5266b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c4c152030 0x7f3c4c0aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c5266b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c4c154ff0 0x7f3c4c0c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c5266b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c157cf0 con 0x7f3c4c152030 2023-12-16T03:28:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c5266b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0c56a0 con 0x7f3c4c154ff0 2023-12-16T03:28:12.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c5266b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c071e90 con 0x7f3c4c06c470 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c4b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c4c152030 0x7f3c4c0aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c4b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c4c152030 0x7f3c4c0aa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45744/0 (socket says 172.21.15.28:45744) 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c4bfff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c4c06c470 0x7f3c4c1577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c4b7fe640 1 -- 172.21.15.28:0/4197480061 learned_addr learned my addr 172.21.15.28:0/4197480061 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c50c08640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c4c154ff0 0x7f3c4c0c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c4b7fe640 1 -- 172.21.15.28:0/4197480061 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c4c06c470 msgr2=0x7f3c4c1577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c4b7fe640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c4c06c470 0x7f3c4c1577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c4b7fe640 1 -- 172.21.15.28:0/4197480061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c4c154ff0 msgr2=0x7f3c4c0c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c4b7fe640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c4c154ff0 0x7f3c4c0c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c4b7fe640 1 -- 172.21.15.28:0/4197480061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400094d0 con 0x7f3c4c152030 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c50c08640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c4c154ff0 0x7f3c4c0c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c4b7fe640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c4c152030 0x7f3c4c0aa6a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3c4001ab20 tx=0x7f3c40019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c48ff9640 1 -- 172.21.15.28:0/4197480061 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400ba070 con 0x7f3c4c152030 2023-12-16T03:28:12.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c48ff9640 1 -- 172.21.15.28:0/4197480061 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400b4630 con 0x7f3c4c152030 2023-12-16T03:28:12.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c5266b640 1 -- 172.21.15.28:0/4197480061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c072170 con 0x7f3c4c152030 2023-12-16T03:28:12.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c48ff9640 1 -- 172.21.15.28:0/4197480061 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400b4a00 con 0x7f3c4c152030 2023-12-16T03:28:12.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.978+0000 7f3c5266b640 1 -- 172.21.15.28:0/4197480061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c0aabe0 con 0x7f3c4c152030 2023-12-16T03:28:12.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.982+0000 7f3c5266b640 1 -- 172.21.15.28:0/4197480061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c06d540 con 0x7f3c4c152030 2023-12-16T03:28:12.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.982+0000 7f3c48ff9640 1 -- 172.21.15.28:0/4197480061 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3c400b4b60 con 0x7f3c4c152030 2023-12-16T03:28:12.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.982+0000 7f3c48ff9640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3c38066470 0x7f3c38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:12.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.982+0000 7f3c48ff9640 1 -- 172.21.15.28:0/4197480061 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3c4011dc20 con 0x7f3c4c152030 2023-12-16T03:28:12.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.982+0000 7f3c4bfff640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3c38066470 0x7f3c38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:12.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.982+0000 7f3c4bfff640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3c38066470 0x7f3c38068930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00ab60 tx=0x7f3c3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:12.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:12.986+0000 7f3c48ff9640 1 -- 172.21.15.28:0/4197480061 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3c400eae50 con 0x7f3c4c152030 2023-12-16T03:28:13.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 -- 172.21.15.28:0/4197480061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c4c068400 con 0x7f3c4c152030 2023-12-16T03:28:13.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c48ff9640 1 -- 172.21.15.28:0/4197480061 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20227 (secure 0 0 0) 0x7f3c4011d090 con 0x7f3c4c152030 2023-12-16T03:28:13.151 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:13.151 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":71,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:12.169764+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 -- 172.21.15.28:0/4197480061 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3c38066470 msgr2=0x7f3c38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3c38066470 0x7f3c38068930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00ab60 tx=0x7f3c3c008040 comp rx=0 tx=0).stop 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 -- 172.21.15.28:0/4197480061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c4c152030 msgr2=0x7f3c4c0aa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c4c152030 0x7f3c4c0aa6a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3c4001ab20 tx=0x7f3c40019210 comp rx=0 tx=0).stop 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 -- 172.21.15.28:0/4197480061 shutdown_connections 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c4c154ff0 0x7f3c4c0c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3c38066470 0x7f3c38068930 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c4c152030 0x7f3c4c0aa6a0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 --2- 172.21.15.28:0/4197480061 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3c4c06c470 0x7f3c4c1577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 -- 172.21.15.28:0/4197480061 >> 172.21.15.28:0/4197480061 conn(0x7f3c4c06a5b0 msgr2=0x7f3c4c15e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.146+0000 7f3c5266b640 1 -- 172.21.15.28:0/4197480061 shutdown_connections 2023-12-16T03:28:13.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.150+0000 7f3c5266b640 1 -- 172.21.15.28:0/4197480061 wait complete. 2023-12-16T03:28:13.172 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:13.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f33434d6640 1 Processor -- start 2023-12-16T03:28:13.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f33434d6640 1 -- start start 2023-12-16T03:28:13.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f33434d6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f333c0c63c0 0x7f333c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f33434d6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f333c0c2bb0 0x7f333c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f33434d6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c0c31c0 con 0x7f333c0c4100 2023-12-16T03:28:13.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f33434d6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0c34a0 con 0x7f333c0c63c0 2023-12-16T03:28:13.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f33434d6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0c1030 con 0x7f333c0c2bb0 2023-12-16T03:28:13.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f3341272640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f333c0c63c0 0x7f333c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f3341272640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f333c0c63c0 0x7f333c0c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45758/0 (socket says 172.21.15.28:45758) 2023-12-16T03:28:13.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f3341272640 1 -- 172.21.15.28:0/2163570440 learned_addr learned my addr 172.21.15.28:0/2163570440 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:13.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f3341a73640 1 --2- 172.21.15.28:0/2163570440 >> v2:172.21.15.134:3300/0 conn(0x7f333c0c2bb0 0x7f333c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f3341272640 1 -- 172.21.15.28:0/2163570440 >> v2:172.21.15.134:3300/0 conn(0x7f333c0c2bb0 msgr2=0x7f333c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:13.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f3341272640 1 --2- 172.21.15.28:0/2163570440 >> v2:172.21.15.134:3300/0 conn(0x7f333c0c2bb0 0x7f333c0a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f3341272640 1 -- 172.21.15.28:0/2163570440 >> v1:172.21.15.134:6789/0 conn(0x7f333c0c4100 legacy=0x7f333c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.310+0000 7f3341272640 1 -- 172.21.15.28:0/2163570440 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0c1310 con 0x7f333c0c63c0 2023-12-16T03:28:13.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f3341272640 1 --2- 172.21.15.28:0/2163570440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f333c0c63c0 0x7f333c0c06d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f333c0c4550 tx=0x7f333801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae74b8e8285eeb33 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:13.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f3333fff640 1 -- 172.21.15.28:0/2163570440 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c0aa3d0 con 0x7f333c0c63c0 2023-12-16T03:28:13.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f3333fff640 1 -- 172.21.15.28:0/2163570440 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380ab600 con 0x7f333c0c63c0 2023-12-16T03:28:13.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f3333fff640 1 -- 172.21.15.28:0/2163570440 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380ab990 con 0x7f333c0c63c0 2023-12-16T03:28:13.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f33434d6640 1 -- 172.21.15.28:0/2163570440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f333c0c63c0 msgr2=0x7f333c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f33434d6640 1 --2- 172.21.15.28:0/2163570440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f333c0c63c0 0x7f333c0c06d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f333c0c4550 tx=0x7f333801c3e0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f33434d6640 1 -- 172.21.15.28:0/2163570440 shutdown_connections 2023-12-16T03:28:13.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f33434d6640 1 --2- 172.21.15.28:0/2163570440 >> v2:172.21.15.134:3300/0 conn(0x7f333c0c2bb0 0x7f333c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f33434d6640 1 --2- 172.21.15.28:0/2163570440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f333c0c63c0 0x7f333c0c06d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f33434d6640 1 -- 172.21.15.28:0/2163570440 >> 172.21.15.28:0/2163570440 conn(0x7f333c06a5b0 msgr2=0x7f333c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:13.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f33434d6640 1 -- 172.21.15.28:0/2163570440 shutdown_connections 2023-12-16T03:28:13.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.314+0000 7f33434d6640 1 -- 172.21.15.28:0/2163570440 wait complete. 2023-12-16T03:28:13.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f33434d6640 1 Processor -- start 2023-12-16T03:28:13.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f33434d6640 1 -- start start 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f33434d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f333c0c2bb0 0x7f333c0a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f33434d6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f333c0c4100 0x7f333c14d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f33434d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f333c0c63c0 0x7f333c14d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f33434d6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0705c0 con 0x7f333c0c4100 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f33434d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c06fe50 con 0x7f333c0c63c0 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f33434d6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c070130 con 0x7f333c0c2bb0 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3340a71640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f333c0c4100 0x7f333c14d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3341272640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f333c0c2bb0 0x7f333c0a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3340a71640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f333c0c4100 0x7f333c14d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45762/0 (socket says 172.21.15.28:45762) 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3341272640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f333c0c2bb0 0x7f333c0a71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:52450/0 (socket says 172.21.15.28:52450) 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3340a71640 1 -- 172.21.15.28:0/1877368590 learned_addr learned my addr 172.21.15.28:0/1877368590 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:13.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3341a73640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f333c0c63c0 0x7f333c14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3340a71640 1 -- 172.21.15.28:0/1877368590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f333c0c2bb0 msgr2=0x7f333c0a71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3340a71640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f333c0c2bb0 0x7f333c0a71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3340a71640 1 -- 172.21.15.28:0/1877368590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f333c0c63c0 msgr2=0x7f333c14d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3340a71640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f333c0c63c0 0x7f333c14d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3340a71640 1 -- 172.21.15.28:0/1877368590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33380094d0 con 0x7f333c0c4100 2023-12-16T03:28:13.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3340a71640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f333c0c4100 0x7f333c14d220 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f332c00c450 tx=0x7f332c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:13.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3331ffb640 1 -- 172.21.15.28:0/1877368590 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c0052d0 con 0x7f333c0c4100 2023-12-16T03:28:13.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3331ffb640 1 -- 172.21.15.28:0/1877368590 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c005430 con 0x7f333c0c4100 2023-12-16T03:28:13.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f3331ffb640 1 -- 172.21.15.28:0/1877368590 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c007260 con 0x7f333c0c4100 2023-12-16T03:28:13.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.318+0000 7f33434d6640 1 -- 172.21.15.28:0/1877368590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333c15e2a0 con 0x7f333c0c4100 2023-12-16T03:28:13.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.322+0000 7f33434d6640 1 -- 172.21.15.28:0/1877368590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c14df00 con 0x7f333c0c4100 2023-12-16T03:28:13.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.322+0000 7f33434d6640 1 -- 172.21.15.28:0/1877368590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c0702c0 con 0x7f333c0c4100 2023-12-16T03:28:13.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.322+0000 7f3331ffb640 1 -- 172.21.15.28:0/1877368590 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f332c0073c0 con 0x7f333c0c4100 2023-12-16T03:28:13.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.322+0000 7f3331ffb640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3320066470 0x7f3320068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.322+0000 7f3331ffb640 1 -- 172.21.15.28:0/1877368590 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f332c0838e0 con 0x7f333c0c4100 2023-12-16T03:28:13.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.322+0000 7f3341272640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3320066470 0x7f3320068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.326+0000 7f3341272640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3320066470 0x7f3320068930 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f33380af000 tx=0x7f33380b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.326+0000 7f3331ffb640 1 -- 172.21.15.28:0/1877368590 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f332c050b40 con 0x7f333c0c4100 2023-12-16T03:28:13.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.486+0000 7f33434d6640 1 -- 172.21.15.28:0/1877368590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f333c068400 con 0x7f333c0c4100 2023-12-16T03:28:13.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.486+0000 7f3331ffb640 1 -- 172.21.15.28:0/1877368590 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20227 (secure 0 0 0) 0x7f332c054160 con 0x7f333c0c4100 2023-12-16T03:28:13.492 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:13.492 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":71,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:12.169764+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:13.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 -- 172.21.15.28:0/1877368590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3320066470 msgr2=0x7f3320068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3320066470 0x7f3320068930 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f33380af000 tx=0x7f33380b6040 comp rx=0 tx=0).stop 2023-12-16T03:28:13.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 -- 172.21.15.28:0/1877368590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f333c0c4100 msgr2=0x7f333c14d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f333c0c4100 0x7f333c14d220 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f332c00c450 tx=0x7f332c00c910 comp rx=0 tx=0).stop 2023-12-16T03:28:13.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 -- 172.21.15.28:0/1877368590 shutdown_connections 2023-12-16T03:28:13.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f333c0c63c0 0x7f333c14d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3320066470 0x7f3320068930 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f333c0c4100 0x7f333c14d220 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 --2- 172.21.15.28:0/1877368590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f333c0c2bb0 0x7f333c0a71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 -- 172.21.15.28:0/1877368590 >> 172.21.15.28:0/1877368590 conn(0x7f333c06a5b0 msgr2=0x7f333c0c2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:13.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 -- 172.21.15.28:0/1877368590 shutdown_connections 2023-12-16T03:28:13.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.490+0000 7f33434d6640 1 -- 172.21.15.28:0/1877368590 wait complete. 2023-12-16T03:28:13.514 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-16T03:28:13.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.654+0000 7fd7953d8640 1 Processor -- start 2023-12-16T03:28:13.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.654+0000 7fd7953d8640 1 -- start start 2023-12-16T03:28:13.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd7953d8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd790152f10 0x7fd790070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd7953d8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7900727f0 con 0x7fd79006fd90 2023-12-16T03:28:13.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd7953d8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7900c0b00 con 0x7fd7900714c0 2023-12-16T03:28:13.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd7953d8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900c0560 con 0x7fd790152f10 2023-12-16T03:28:13.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78effd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd79006fd90 0x7fd790152800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57214/0 (socket says 172.21.15.28:57214) 2023-12-16T03:28:13.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78effd640 1 -- 172.21.15.28:0/2110938321 learned_addr learned my addr 172.21.15.28:0/2110938321 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:13.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78f7fe640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd790152f10 0x7fd790070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881213685 0 0) 0x7fd7900727f0 con 0x7fd79006fd90 2023-12-16T03:28:13.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd77c003530 con 0x7fd79006fd90 2023-12-16T03:28:13.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836372154 0 0) 0x7fd7900c0b00 con 0x7fd7900714c0 2023-12-16T03:28:13.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7900727f0 con 0x7fd7900714c0 2023-12-16T03:28:13.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1963578859 0 0) 0x7fd77c003530 con 0x7fd79006fd90 2023-12-16T03:28:13.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd790152f10 msgr2=0x7fd790070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:13.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd790152f10 0x7fd790070170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 >> v1:172.21.15.134:6789/0 conn(0x7fd7900714c0 legacy=0x7fd79015ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790072a40 con 0x7fd79006fd90 2023-12-16T03:28:13.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fd780001680 con 0x7fd79006fd90 2023-12-16T03:28:13.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 >> v1:172.21.15.28:6789/0 conn(0x7fd79006fd90 legacy=0x7fd790152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd77c003b40 0x7fd77c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd77c0047d0 0x7fd77c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77c005190 0x7fd77c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900c0560 con 0x7fd77c003b40 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c00c000 con 0x7fd77c005190 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c00c1c0 con 0x7fd77c0047d0 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78f7fe640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd790152f10 0x7fd790070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78effd640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd77c003b40 0x7fd77c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd787fff640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd77c0047d0 0x7fd77c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78f7fe640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77c005190 0x7fd77c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78effd640 1 -- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd77c0047d0 msgr2=0x7fd77c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78effd640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd77c0047d0 0x7fd77c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78effd640 1 -- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77c005190 msgr2=0x7fd77c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78effd640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77c005190 0x7fd77c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd78effd640 1 -- 172.21.15.28:0/2110938321 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c003530 con 0x7fd77c003b40 2023-12-16T03:28:13.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.658+0000 7fd787fff640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd77c0047d0 0x7fd77c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:13.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.662+0000 7fd78effd640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd77c003b40 0x7fd77c003f40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c160 tx=0x7fd78001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95de7108265fdc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:13.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.662+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7800058e0 con 0x7fd77c003b40 2023-12-16T03:28:13.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.662+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd780005a60 con 0x7fd77c003b40 2023-12-16T03:28:13.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.662+0000 7fd78e7fc640 1 -- 172.21.15.28:0/2110938321 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780005e10 con 0x7fd77c003b40 2023-12-16T03:28:13.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.662+0000 7fd7953d8640 1 -- 172.21.15.28:0/2110938321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd77c003b40 msgr2=0x7fd77c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.662+0000 7fd7953d8640 1 --2- 172.21.15.28:0/2110938321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd77c003b40 0x7fd77c003f40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c160 tx=0x7fd78001cb90 comp rx=0 tx=0).stop 2023-12-16T03:28:13.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.662+0000 7fd78f7fe640 1 -- 172.21.15.28:0/2110938321 reap_dead start 2023-12-16T03:28:13.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.662+0000 7fd7953d8640 1 -- 172.21.15.28:0/2110938321 shutdown_connections 2023-12-16T03:28:13.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.662+0000 7fd7953d8640 1 -- 172.21.15.28:0/2110938321 >> 172.21.15.28:0/2110938321 conn(0x7fd7900a7910 msgr2=0x7fd7900a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:13.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.662+0000 7fd7953d8640 1 -- 172.21.15.28:0/2110938321 shutdown_connections 2023-12-16T03:28:13.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.662+0000 7fd7953d8640 1 -- 172.21.15.28:0/2110938321 wait complete. 2023-12-16T03:28:13.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7953d8640 1 Processor -- start 2023-12-16T03:28:13.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7953d8640 1 -- start start 2023-12-16T03:28:13.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7953d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77c003b40 0x7fd7901535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7953d8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd79015be10 0x7fd790147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7953d8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7901ed9f0 0x7fd790148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7953d8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901edf60 con 0x7fd79015be10 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7953d8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901552e0 con 0x7fd77c003b40 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7953d8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900bf880 con 0x7fd7901ed9f0 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd787fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd79015be10 0x7fd790147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd787fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd79015be10 0x7fd790147af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45778/0 (socket says 172.21.15.28:45778) 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd787fff640 1 -- 172.21.15.28:0/4045451648 learned_addr learned my addr 172.21.15.28:0/4045451648 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd78effd640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77c003b40 0x7fd7901535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd78f7fe640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7901ed9f0 0x7fd790148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd787fff640 1 -- 172.21.15.28:0/4045451648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7901ed9f0 msgr2=0x7fd790148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd787fff640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7901ed9f0 0x7fd790148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd787fff640 1 -- 172.21.15.28:0/4045451648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77c003b40 msgr2=0x7fd7901535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd787fff640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77c003b40 0x7fd7901535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd787fff640 1 -- 172.21.15.28:0/4045451648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790155510 con 0x7fd79015be10 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd78effd640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77c003b40 0x7fd7901535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:13.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd787fff640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd79015be10 0x7fd790147af0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fd77800e7b0 tx=0x7fd77800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:13.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7877fe640 1 -- 172.21.15.28:0/4045451648 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778017070 con 0x7fd79015be10 2023-12-16T03:28:13.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7877fe640 1 -- 172.21.15.28:0/4045451648 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7780050d0 con 0x7fd79015be10 2023-12-16T03:28:13.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7877fe640 1 -- 172.21.15.28:0/4045451648 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778005240 con 0x7fd79015be10 2023-12-16T03:28:13.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7953d8640 1 -- 172.21.15.28:0/4045451648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7901557f0 con 0x7fd79015be10 2023-12-16T03:28:13.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7953d8640 1 -- 172.21.15.28:0/4045451648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd790155db0 con 0x7fd79015be10 2023-12-16T03:28:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.666+0000 7fd7953d8640 1 -- 172.21.15.28:0/4045451648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79004e850 con 0x7fd79015be10 2023-12-16T03:28:13.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.670+0000 7fd7877fe640 1 -- 172.21.15.28:0/4045451648 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd778007020 con 0x7fd79015be10 2023-12-16T03:28:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.670+0000 7fd7877fe640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd770066470 0x7fd770068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.670+0000 7fd7877fe640 1 -- 172.21.15.28:0/4045451648 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd778083970 con 0x7fd79015be10 2023-12-16T03:28:13.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.670+0000 7fd78effd640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd770066470 0x7fd770068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:13.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.670+0000 7fd78effd640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd770066470 0x7fd770068930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd7800aa000 tx=0x7fd780001a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:13.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.674+0000 7fd7877fe640 1 -- 172.21.15.28:0/4045451648 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd778050a80 con 0x7fd79015be10 2023-12-16T03:28:13.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:13.866+0000 7fd7953d8640 1 -- 172.21.15.28:0/4045451648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd7900c0fc0 con 0x7fd79015be10 2023-12-16T03:28:14.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7877fe640 1 -- 172.21.15.28:0/4045451648 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 119+0+0 (secure 0 0 0) 0x7fd7780540a0 con 0x7fd79015be10 2023-12-16T03:28:14.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 -- 172.21.15.28:0/4045451648 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd770066470 msgr2=0x7fd770068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:14.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd770066470 0x7fd770068930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd7800aa000 tx=0x7fd780001a00 comp rx=0 tx=0).stop 2023-12-16T03:28:14.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 -- 172.21.15.28:0/4045451648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd79015be10 msgr2=0x7fd790147af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:14.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd79015be10 0x7fd790147af0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fd77800e7b0 tx=0x7fd77800ec70 comp rx=0 tx=0).stop 2023-12-16T03:28:14.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 -- 172.21.15.28:0/4045451648 shutdown_connections 2023-12-16T03:28:14.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd7901ed9f0 0x7fd790148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:14.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd770066470 0x7fd770068930 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:14.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd79015be10 0x7fd790147af0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:14.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 --2- 172.21.15.28:0/4045451648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77c003b40 0x7fd7901535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:14.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 -- 172.21.15.28:0/4045451648 >> 172.21.15.28:0/4045451648 conn(0x7fd7900a7910 msgr2=0x7fd79014f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:14.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 -- 172.21.15.28:0/4045451648 shutdown_connections 2023-12-16T03:28:14.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.806+0000 7fd7953d8640 1 -- 172.21.15.28:0/4045451648 wait complete. 2023-12-16T03:28:14.835 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-16T03:28:14.836 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-16T03:28:14.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.982+0000 7f84d1079640 1 Processor -- start 2023-12-16T03:28:14.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84d1079640 1 -- start start 2023-12-16T03:28:14.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84d1079640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84cc0c5260 0x7f84cc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:14.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84d1079640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f84cc0c5640 0x7f84cc0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:14.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84d1079640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84cc0c2580 con 0x7f84cc0c60f0 2023-12-16T03:28:14.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84d1079640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84cc153510 con 0x7f84cc0c5640 2023-12-16T03:28:14.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84d1079640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0c17f0 con 0x7f84cc0c5260 2023-12-16T03:28:14.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84cb59e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f84cc0c60f0 0x7f84cc155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57230/0 (socket says 172.21.15.28:57230) 2023-12-16T03:28:14.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84cb59e640 1 -- 172.21.15.28:0/824945571 learned_addr learned my addr 172.21.15.28:0/824945571 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:14.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927844538 0 0) 0x7f84cc0c2580 con 0x7f84cc0c60f0 2023-12-16T03:28:14.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84ca59c640 1 --2- 172.21.15.28:0/824945571 >> v2:172.21.15.134:3300/0 conn(0x7f84cc0c5640 0x7f84cc0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:14.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b4003530 con 0x7f84cc0c60f0 2023-12-16T03:28:14.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84cad9d640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84cc0c5260 0x7f84cc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:14.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1305717107 0 0) 0x7f84b4003530 con 0x7f84cc0c60f0 2023-12-16T03:28:14.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84cc0c5260 msgr2=0x7f84cc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:14.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84cc0c5260 0x7f84cc06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:14.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 >> v2:172.21.15.134:3300/0 conn(0x7f84cc0c5640 msgr2=0x7f84cc0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:14.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 --2- 172.21.15.28:0/824945571 >> v2:172.21.15.134:3300/0 conn(0x7f84cc0c5640 0x7f84cc0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc0c1a00 con 0x7f84cc0c60f0 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f84c4001a00 con 0x7f84cc0c60f0 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 >> v1:172.21.15.28:6789/0 conn(0x7f84cc0c60f0 legacy=0x7f84cc155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84b4003980 0x7f84b4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84b40047d0 0x7f84b4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84cc0c5260 0x7f84b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0c17f0 con 0x7f84b40047d0 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b400b990 con 0x7f84b4003980 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b400bb50 con 0x7f84cc0c5260 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84ca59c640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84b40047d0 0x7f84b4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84cad9d640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84b4003980 0x7f84b4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84cb59e640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84cc0c5260 0x7f84b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:14.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84ca59c640 1 -- 172.21.15.28:0/824945571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84cc0c5260 msgr2=0x7f84b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:14.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84ca59c640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84cc0c5260 0x7f84b4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:14.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84ca59c640 1 -- 172.21.15.28:0/824945571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84b4003980 msgr2=0x7f84b4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:14.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84ca59c640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84b4003980 0x7f84b4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:14.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.986+0000 7f84ca59c640 1 -- 172.21.15.28:0/824945571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4003530 con 0x7f84b40047d0 2023-12-16T03:28:14.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.990+0000 7f84ca59c640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84b40047d0 0x7f84b4004c50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009ab0 tx=0x7f84c001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138b4e9a6f7e1ddc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:14.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.990+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00a6450 con 0x7f84b40047d0 2023-12-16T03:28:14.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.990+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c00a65b0 con 0x7f84b40047d0 2023-12-16T03:28:14.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.990+0000 7f84c9d9b640 1 -- 172.21.15.28:0/824945571 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00a6960 con 0x7f84b40047d0 2023-12-16T03:28:14.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.990+0000 7f84d1079640 1 -- 172.21.15.28:0/824945571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84b40047d0 msgr2=0x7f84b4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:14.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.990+0000 7f84d1079640 1 --2- 172.21.15.28:0/824945571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84b40047d0 0x7f84b4004c50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009ab0 tx=0x7f84c001ca40 comp rx=0 tx=0).stop 2023-12-16T03:28:14.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.990+0000 7f84cb59e640 1 -- 172.21.15.28:0/824945571 reap_dead start 2023-12-16T03:28:14.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.990+0000 7f84d1079640 1 -- 172.21.15.28:0/824945571 shutdown_connections 2023-12-16T03:28:14.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.990+0000 7f84d1079640 1 -- 172.21.15.28:0/824945571 >> 172.21.15.28:0/824945571 conn(0x7f84cc06a5b0 msgr2=0x7f84cc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:14.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.990+0000 7f84d1079640 1 -- 172.21.15.28:0/824945571 shutdown_connections 2023-12-16T03:28:14.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.990+0000 7f84d1079640 1 -- 172.21.15.28:0/824945571 wait complete. 2023-12-16T03:28:14.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84d1079640 1 Processor -- start 2023-12-16T03:28:14.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84d1079640 1 -- start start 2023-12-16T03:28:14.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84d1079640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84b40047d0 0x7f84cc0a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:14.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84d1079640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84cc071100 0x7f84cc1e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:14.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84d1079640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84cc1e8430 0x7f84cc1eaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:14.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84d1079640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc1e88b0 con 0x7f84cc071100 2023-12-16T03:28:14.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84d1079640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0a6f70 con 0x7f84cc1e8430 2023-12-16T03:28:14.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84d1079640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0a5a80 con 0x7f84b40047d0 2023-12-16T03:28:14.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84ca59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84cc071100 0x7f84cc1e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:14.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84ca59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84cc071100 0x7f84cc1e7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45786/0 (socket says 172.21.15.28:45786) 2023-12-16T03:28:14.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84ca59c640 1 -- 172.21.15.28:0/1363095557 learned_addr learned my addr 172.21.15.28:0/1363095557 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:14.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84cb59e640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84cc1e8430 0x7f84cc1eaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:14.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84cad9d640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84b40047d0 0x7f84cc0a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:15.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84ca59c640 1 -- 172.21.15.28:0/1363095557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84b40047d0 msgr2=0x7f84cc0a6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:15.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84ca59c640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84b40047d0 0x7f84cc0a6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:15.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84ca59c640 1 -- 172.21.15.28:0/1363095557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84cc1e8430 msgr2=0x7f84cc1eaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:15.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84ca59c640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84cc1e8430 0x7f84cc1eaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:15.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84ca59c640 1 -- 172.21.15.28:0/1363095557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc0a5d60 con 0x7f84cc071100 2023-12-16T03:28:15.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84ca59c640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84cc071100 0x7f84cc1e7ef0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009ab0 tx=0x7f84b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:15.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84b37fe640 1 -- 172.21.15.28:0/1363095557 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00a6450 con 0x7f84cc071100 2023-12-16T03:28:15.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84b37fe640 1 -- 172.21.15.28:0/1363095557 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c00a6d20 con 0x7f84cc071100 2023-12-16T03:28:15.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84d1079640 1 -- 172.21.15.28:0/1363095557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84cc1e88b0 con 0x7f84cc071100 2023-12-16T03:28:15.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84b37fe640 1 -- 172.21.15.28:0/1363095557 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00bc690 con 0x7f84cc071100 2023-12-16T03:28:15.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.994+0000 7f84d1079640 1 -- 172.21.15.28:0/1363095557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84cc070900 con 0x7f84cc071100 2023-12-16T03:28:15.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.998+0000 7f84d1079640 1 -- 172.21.15.28:0/1363095557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84cc068400 con 0x7f84cc071100 2023-12-16T03:28:15.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.998+0000 7f84b37fe640 1 -- 172.21.15.28:0/1363095557 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f84c00bc7f0 con 0x7f84cc071100 2023-12-16T03:28:15.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.998+0000 7f84b37fe640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84b80664a0 0x7f84b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:15.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.998+0000 7f84b37fe640 1 -- 172.21.15.28:0/1363095557 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f84c011e430 con 0x7f84cc071100 2023-12-16T03:28:15.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.998+0000 7f84cad9d640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84b80664a0 0x7f84b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:15.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:14.998+0000 7f84cad9d640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84b80664a0 0x7f84b8068960 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009b00 tx=0x7f84bc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:15.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.002+0000 7f84b37fe640 1 -- 172.21.15.28:0/1363095557 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f84c00eb5e0 con 0x7f84cc071100 2023-12-16T03:28:15.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.194+0000 7f84d1079640 1 -- 172.21.15.28:0/1363095557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f84cc06d390 con 0x7f84cc071100 2023-12-16T03:28:15.676 INFO:tasks.ceph.mds.b.smithi134.stderr:2023-12-16T03:28:15.671+0000 7fb25d1fb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:28:15.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.806+0000 7f84b37fe640 1 -- 172.21.15.28:0/1363095557 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 123+0+0 (secure 0 0 0) 0x7f84c00eec00 con 0x7f84cc071100 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 -- 172.21.15.28:0/1363095557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84b80664a0 msgr2=0x7f84b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84b80664a0 0x7f84b8068960 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009b00 tx=0x7f84bc009190 comp rx=0 tx=0).stop 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 -- 172.21.15.28:0/1363095557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84cc071100 msgr2=0x7f84cc1e7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84cc071100 0x7f84cc1e7ef0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009ab0 tx=0x7f84b4005800 comp rx=0 tx=0).stop 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 -- 172.21.15.28:0/1363095557 shutdown_connections 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84cc1e8430 0x7f84cc1eaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f84b80664a0 0x7f84b8068960 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84cc071100 0x7f84cc1e7ef0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 --2- 172.21.15.28:0/1363095557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f84b40047d0 0x7f84cc0a6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 -- 172.21.15.28:0/1363095557 >> 172.21.15.28:0/1363095557 conn(0x7f84cc06a5b0 msgr2=0x7f84cc150f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 -- 172.21.15.28:0/1363095557 shutdown_connections 2023-12-16T03:28:15.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.810+0000 7f84d1079640 1 -- 172.21.15.28:0/1363095557 wait complete. 2023-12-16T03:28:15.838 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-16T03:28:15.838 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:28:15.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b5690f640 1 Processor -- start 2023-12-16T03:28:15.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b5690f640 1 -- start start 2023-12-16T03:28:15.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b5690f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5b500c5640 0x7f5b500c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:15.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b5690f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c60f0 0x7f5b50155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:15.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b5690f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b500c2580 con 0x7f5b500c5260 2023-12-16T03:28:15.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b5690f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b50153510 con 0x7f5b500c5640 2023-12-16T03:28:15.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b5690f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b500c17f0 con 0x7f5b500c60f0 2023-12-16T03:28:15.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b54eac640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c60f0 0x7f5b50155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:15.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b4f7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5b500c5640 0x7f5b500c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:15.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b54eac640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c60f0 0x7f5b50155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:52524/0 (socket says 172.21.15.28:52524) 2023-12-16T03:28:15.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b54eac640 1 -- 172.21.15.28:0/262028797 learned_addr learned my addr 172.21.15.28:0/262028797 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:15.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b54eac640 1 -- 172.21.15.28:0/262028797 >> v2:172.21.15.134:3300/0 conn(0x7f5b500c5640 msgr2=0x7f5b500c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:15.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b54eac640 1 --2- 172.21.15.28:0/262028797 >> v2:172.21.15.134:3300/0 conn(0x7f5b500c5640 0x7f5b500c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:15.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b54eac640 1 -- 172.21.15.28:0/262028797 >> v1:172.21.15.134:6789/0 conn(0x7f5b500c5260 legacy=0x7f5b5006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:15.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.982+0000 7f5b54eac640 1 -- 172.21.15.28:0/262028797 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b500c1a00 con 0x7f5b500c60f0 2023-12-16T03:28:15.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b54eac640 1 --2- 172.21.15.28:0/262028797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c60f0 0x7f5b50155de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5b500c1930 tx=0x7f5b4801c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5d896c0c5c3d30b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:15.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b4effd640 1 -- 172.21.15.28:0/262028797 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b480a57f0 con 0x7f5b500c60f0 2023-12-16T03:28:15.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b4effd640 1 -- 172.21.15.28:0/262028797 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b480a5950 con 0x7f5b500c60f0 2023-12-16T03:28:15.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b4effd640 1 -- 172.21.15.28:0/262028797 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b480a5ce0 con 0x7f5b500c60f0 2023-12-16T03:28:15.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b5690f640 1 -- 172.21.15.28:0/262028797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c60f0 msgr2=0x7f5b50155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:15.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b5690f640 1 --2- 172.21.15.28:0/262028797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c60f0 0x7f5b50155de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5b500c1930 tx=0x7f5b4801c930 comp rx=0 tx=0).stop 2023-12-16T03:28:15.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b5690f640 1 -- 172.21.15.28:0/262028797 shutdown_connections 2023-12-16T03:28:15.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b5690f640 1 --2- 172.21.15.28:0/262028797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c60f0 0x7f5b50155de0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:15.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b5690f640 1 --2- 172.21.15.28:0/262028797 >> v2:172.21.15.134:3300/0 conn(0x7f5b500c5640 0x7f5b500c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:15.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b5690f640 1 -- 172.21.15.28:0/262028797 >> 172.21.15.28:0/262028797 conn(0x7f5b5006a5b0 msgr2=0x7f5b5006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:15.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b5690f640 1 -- 172.21.15.28:0/262028797 shutdown_connections 2023-12-16T03:28:15.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.986+0000 7f5b5690f640 1 -- 172.21.15.28:0/262028797 wait complete. 2023-12-16T03:28:15.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b5690f640 1 Processor -- start 2023-12-16T03:28:15.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b5690f640 1 -- start start 2023-12-16T03:28:15.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b5690f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c5260 0x7f5b500aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:15.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b5690f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5b500c5640 0x7f5b500bf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:15.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b5690f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b500c60f0 0x7f5b500be940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:15.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b5690f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b501f5890 con 0x7f5b500c5640 2023-12-16T03:28:15.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b5690f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b501f4c10 con 0x7f5b500c60f0 2023-12-16T03:28:15.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b5690f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b501f4ef0 con 0x7f5b500c5260 2023-12-16T03:28:15.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5b500c5640 0x7f5b500bf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:15.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5b500c5640 0x7f5b500bf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45800/0 (socket says 172.21.15.28:45800) 2023-12-16T03:28:15.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4f7fe640 1 -- 172.21.15.28:0/3795369960 learned_addr learned my addr 172.21.15.28:0/3795369960 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:15.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b54eac640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b500c60f0 0x7f5b500be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:15.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4ffff640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c5260 0x7f5b500aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:15.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4f7fe640 1 -- 172.21.15.28:0/3795369960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c5260 msgr2=0x7f5b500aa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:15.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4f7fe640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c5260 0x7f5b500aa010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:15.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4f7fe640 1 -- 172.21.15.28:0/3795369960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b500c60f0 msgr2=0x7f5b500be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:15.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4f7fe640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b500c60f0 0x7f5b500be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:15.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4f7fe640 1 -- 172.21.15.28:0/3795369960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b48009b30 con 0x7f5b500c5640 2023-12-16T03:28:15.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4f7fe640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5b500c5640 0x7f5b500bf740 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400e840 tx=0x7f5b4400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:15.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4cff9640 1 -- 172.21.15.28:0/3795369960 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b44009510 con 0x7f5b500c5640 2023-12-16T03:28:15.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4cff9640 1 -- 172.21.15.28:0/3795369960 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4400ee90 con 0x7f5b500c5640 2023-12-16T03:28:15.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b4cff9640 1 -- 172.21.15.28:0/3795369960 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4400cb80 con 0x7f5b500c5640 2023-12-16T03:28:15.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b5690f640 1 -- 172.21.15.28:0/3795369960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b501f51d0 con 0x7f5b500c5640 2023-12-16T03:28:15.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.990+0000 7f5b5690f640 1 -- 172.21.15.28:0/3795369960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b500aa550 con 0x7f5b500c5640 2023-12-16T03:28:15.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.994+0000 7f5b5690f640 1 -- 172.21.15.28:0/3795369960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b50068400 con 0x7f5b500c5640 2023-12-16T03:28:15.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.994+0000 7f5b4cff9640 1 -- 172.21.15.28:0/3795369960 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5b4400cce0 con 0x7f5b500c5640 2023-12-16T03:28:15.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.994+0000 7f5b4cff9640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5b3c066470 0x7f5b3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:15.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.994+0000 7f5b4cff9640 1 -- 172.21.15.28:0/3795369960 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5b440842c0 con 0x7f5b500c5640 2023-12-16T03:28:15.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.994+0000 7f5b4ffff640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5b3c066470 0x7f5b3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.994+0000 7f5b4ffff640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5b3c066470 0x7f5b3c068930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5b40000f70 tx=0x7f5b40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:16.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:15.998+0000 7f5b4cff9640 1 -- 172.21.15.28:0/3795369960 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5b440513d0 con 0x7f5b500c5640 2023-12-16T03:28:16.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b5690f640 1 -- 172.21.15.28:0/3795369960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b501520b0 con 0x7f5b500c5640 2023-12-16T03:28:16.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b4cff9640 1 -- 172.21.15.28:0/3795369960 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6184 (secure 0 0 0) 0x7f5b440549f0 con 0x7f5b500c5640 2023-12-16T03:28:16.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:16.191 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/651767003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":651767003},{"type":"v1","addr":"172.21.15.28:6837","nonce":651767003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4202659808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4202659808},{"type":"v1","addr":"172.21.15.134:6834","nonce":4202659808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:59.086495+0000","modified":"2023-12-16T03:28:02.105487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/2582425067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2582425067},{"type":"v1","addr":"172.21.15.28:6836","nonce":2582425067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:28:12.170094+0000","modified":"2023-12-16T03:28:15.197722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5729":{"gid":5729,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6835/931138884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":931138884},{"type":"v1","addr":"172.21.15.134:6835","nonce":931138884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-16T03:28:16.191 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 51 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b5690f640 1 -- 172.21.15.28:0/3795369960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5b3c066470 msgr2=0x7f5b3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b5690f640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5b3c066470 0x7f5b3c068930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5b40000f70 tx=0x7f5b40009040 comp rx=0 tx=0).stop 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b5690f640 1 -- 172.21.15.28:0/3795369960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5b500c5640 msgr2=0x7f5b500bf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b5690f640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5b500c5640 0x7f5b500bf740 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400e840 tx=0x7f5b4400ec40 comp rx=0 tx=0).stop 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b5690f640 1 -- 172.21.15.28:0/3795369960 shutdown_connections 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b5690f640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b500c60f0 0x7f5b500be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b5690f640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5b3c066470 0x7f5b3c068930 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b5690f640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5b500c5640 0x7f5b500bf740 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b5690f640 1 --2- 172.21.15.28:0/3795369960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b500c5260 0x7f5b500aa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.186+0000 7f5b5690f640 1 -- 172.21.15.28:0/3795369960 >> 172.21.15.28:0/3795369960 conn(0x7f5b5006a5b0 msgr2=0x7f5b500a7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.190+0000 7f5b5690f640 1 -- 172.21.15.28:0/3795369960 shutdown_connections 2023-12-16T03:28:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.190+0000 7f5b5690f640 1 -- 172.21.15.28:0/3795369960 wait complete. 2023-12-16T03:28:16.212 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:16.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.350+0000 7fac7f155640 1 Processor -- start 2023-12-16T03:28:16.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.350+0000 7fac7f155640 1 -- start start 2023-12-16T03:28:16.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7f155640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac780c4100 0x7fac780c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7f155640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fac780c06d0 0x7fac780a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7f155640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac780c31c0 con 0x7fac780c63c0 2023-12-16T03:28:16.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7f155640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac780c34a0 con 0x7fac780c06d0 2023-12-16T03:28:16.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7f155640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac780c1030 con 0x7fac780c4100 2023-12-16T03:28:16.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7d6f2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fac780c06d0 0x7fac780a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7d6f2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fac780c06d0 0x7fac780a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45814/0 (socket says 172.21.15.28:45814) 2023-12-16T03:28:16.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7d6f2640 1 -- 172.21.15.28:0/2627776814 learned_addr learned my addr 172.21.15.28:0/2627776814 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:16.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac77fff640 1 --2- 172.21.15.28:0/2627776814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac780c4100 0x7fac780c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7d6f2640 1 -- 172.21.15.28:0/2627776814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac780c4100 msgr2=0x7fac780c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:16.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7d6f2640 1 --2- 172.21.15.28:0/2627776814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac780c4100 0x7fac780c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7d6f2640 1 -- 172.21.15.28:0/2627776814 >> v1:172.21.15.134:6789/0 conn(0x7fac780c63c0 legacy=0x7fac780c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.354+0000 7fac7d6f2640 1 -- 172.21.15.28:0/2627776814 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac780c1310 con 0x7fac780c06d0 2023-12-16T03:28:16.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7d6f2640 1 --2- 172.21.15.28:0/2627776814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac780c06d0 0x7fac780a9680 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fac70009e50 tx=0x7fac7001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7175077daeab1f66 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:16.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac777fe640 1 -- 172.21.15.28:0/2627776814 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac780aa3d0 con 0x7fac780c06d0 2023-12-16T03:28:16.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac777fe640 1 -- 172.21.15.28:0/2627776814 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac700a56c0 con 0x7fac780c06d0 2023-12-16T03:28:16.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac777fe640 1 -- 172.21.15.28:0/2627776814 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac700a5a50 con 0x7fac780c06d0 2023-12-16T03:28:16.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 -- 172.21.15.28:0/2627776814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac780c06d0 msgr2=0x7fac780a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 --2- 172.21.15.28:0/2627776814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac780c06d0 0x7fac780a9680 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fac70009e50 tx=0x7fac7001c8f0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 -- 172.21.15.28:0/2627776814 shutdown_connections 2023-12-16T03:28:16.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 --2- 172.21.15.28:0/2627776814 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac780c4100 0x7fac780c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 --2- 172.21.15.28:0/2627776814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac780c06d0 0x7fac780a9680 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 -- 172.21.15.28:0/2627776814 >> 172.21.15.28:0/2627776814 conn(0x7fac7806a5b0 msgr2=0x7fac7806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:16.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 -- 172.21.15.28:0/2627776814 shutdown_connections 2023-12-16T03:28:16.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 -- 172.21.15.28:0/2627776814 wait complete. 2023-12-16T03:28:16.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 Processor -- start 2023-12-16T03:28:16.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 -- start start 2023-12-16T03:28:16.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac780c06d0 0x7fac78152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac780c4100 0x7fac7815a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac780c63c0 0x7fac7815a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7814cda0 con 0x7fac780c4100 2023-12-16T03:28:16.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac78070080 con 0x7fac780c63c0 2023-12-16T03:28:16.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.358+0000 7fac7f155640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac781502a0 con 0x7fac780c06d0 2023-12-16T03:28:16.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac77fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac780c4100 0x7fac7815a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac77fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac780c4100 0x7fac7815a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45816/0 (socket says 172.21.15.28:45816) 2023-12-16T03:28:16.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac77fff640 1 -- 172.21.15.28:0/2149976837 learned_addr learned my addr 172.21.15.28:0/2149976837 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:16.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac7cef1640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac780c06d0 0x7fac78152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac7d6f2640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac780c63c0 0x7fac7815a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac77fff640 1 -- 172.21.15.28:0/2149976837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac780c06d0 msgr2=0x7fac78152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac77fff640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac780c06d0 0x7fac78152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac77fff640 1 -- 172.21.15.28:0/2149976837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac780c63c0 msgr2=0x7fac7815a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac77fff640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac780c63c0 0x7fac7815a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac77fff640 1 -- 172.21.15.28:0/2149976837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70009b30 con 0x7fac780c4100 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac7cef1640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac780c06d0 0x7fac78152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac77fff640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac780c4100 0x7fac7815a120 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fac6400e960 tx=0x7fac6400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac757fa640 1 -- 172.21.15.28:0/2149976837 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64009690 con 0x7fac780c4100 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac757fa640 1 -- 172.21.15.28:0/2149976837 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6400ca00 con 0x7fac780c4100 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac757fa640 1 -- 172.21.15.28:0/2149976837 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6400cd90 con 0x7fac780c4100 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac7f155640 1 -- 172.21.15.28:0/2149976837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac781ed420 con 0x7fac780c4100 2023-12-16T03:28:16.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac7f155640 1 -- 172.21.15.28:0/2149976837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac780a5b70 con 0x7fac780c4100 2023-12-16T03:28:16.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac7f155640 1 -- 172.21.15.28:0/2149976837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7806fe30 con 0x7fac780c4100 2023-12-16T03:28:16.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.362+0000 7fac757fa640 1 -- 172.21.15.28:0/2149976837 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fac64013470 con 0x7fac780c4100 2023-12-16T03:28:16.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.366+0000 7fac757fa640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fac5c066470 0x7fac5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.366+0000 7fac757fa640 1 -- 172.21.15.28:0/2149976837 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fac64084340 con 0x7fac780c4100 2023-12-16T03:28:16.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.366+0000 7fac7cef1640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fac5c066470 0x7fac5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.366+0000 7fac7cef1640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fac5c066470 0x7fac5c068930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fac6c000f70 tx=0x7fac6c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:16.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.370+0000 7fac757fa640 1 -- 172.21.15.28:0/2149976837 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fac64051500 con 0x7fac780c4100 2023-12-16T03:28:16.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.526+0000 7fac7f155640 1 -- 172.21.15.28:0/2149976837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac78068400 con 0x7fac780c4100 2023-12-16T03:28:16.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac757fa640 1 -- 172.21.15.28:0/2149976837 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20214 (secure 0 0 0) 0x7fac64054b20 con 0x7fac780c4100 2023-12-16T03:28:16.534 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:16.534 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:13.793649+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:16.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 -- 172.21.15.28:0/2149976837 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fac5c066470 msgr2=0x7fac5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fac5c066470 0x7fac5c068930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fac6c000f70 tx=0x7fac6c009040 comp rx=0 tx=0).stop 2023-12-16T03:28:16.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 -- 172.21.15.28:0/2149976837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac780c4100 msgr2=0x7fac7815a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac780c4100 0x7fac7815a120 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fac6400e960 tx=0x7fac6400ee20 comp rx=0 tx=0).stop 2023-12-16T03:28:16.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 -- 172.21.15.28:0/2149976837 shutdown_connections 2023-12-16T03:28:16.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac780c63c0 0x7fac7815a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.536 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fac5c066470 0x7fac5c068930 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac780c4100 0x7fac7815a120 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 --2- 172.21.15.28:0/2149976837 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fac780c06d0 0x7fac78152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 -- 172.21.15.28:0/2149976837 >> 172.21.15.28:0/2149976837 conn(0x7fac7806a5b0 msgr2=0x7fac7806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:16.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 -- 172.21.15.28:0/2149976837 shutdown_connections 2023-12-16T03:28:16.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.530+0000 7fac7f155640 1 -- 172.21.15.28:0/2149976837 wait complete. 2023-12-16T03:28:16.556 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-16T03:28:16.556 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:28:16.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.694+0000 7f8b7e079640 1 Processor -- start 2023-12-16T03:28:16.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.694+0000 7f8b7e079640 1 -- start start 2023-12-16T03:28:16.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.694+0000 7f8b7e079640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8b780a5240 0x7f8b780bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.694+0000 7f8b7e079640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8b780c01c0 0x7f8b780c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.694+0000 7f8b7e079640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b780c3bd0 con 0x7f8b780c61a0 2023-12-16T03:28:16.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.694+0000 7f8b7e079640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b780bf1e0 con 0x7f8b780c01c0 2023-12-16T03:28:16.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.694+0000 7f8b7e079640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b780c3e20 con 0x7f8b780a5240 2023-12-16T03:28:16.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b76ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8b780c01c0 0x7f8b780c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b77fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8b780c61a0 0x7f8b781561f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57236/0 (socket says 172.21.15.28:57236) 2023-12-16T03:28:16.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b77fff640 1 -- 172.21.15.28:0/2110830511 learned_addr learned my addr 172.21.15.28:0/2110830511 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:16.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b777fe640 1 --2- 172.21.15.28:0/2110830511 >> v2:172.21.15.134:3300/0 conn(0x7f8b780a5240 0x7f8b780bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b76ffd640 1 -- 172.21.15.28:0/2110830511 >> v2:172.21.15.134:3300/0 conn(0x7f8b780a5240 msgr2=0x7f8b780bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:16.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b76ffd640 1 --2- 172.21.15.28:0/2110830511 >> v2:172.21.15.134:3300/0 conn(0x7f8b780a5240 0x7f8b780bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b76ffd640 1 -- 172.21.15.28:0/2110830511 >> v1:172.21.15.28:6789/0 conn(0x7f8b780c61a0 legacy=0x7f8b781561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b76ffd640 1 -- 172.21.15.28:0/2110830511 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b780c4100 con 0x7f8b780c01c0 2023-12-16T03:28:16.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b76ffd640 1 --2- 172.21.15.28:0/2110830511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b780c01c0 0x7f8b780c5c60 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8b780bf530 tx=0x7f8b6c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4818fb851fef13ff server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:16.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b767fc640 1 -- 172.21.15.28:0/2110830511 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0ac600 con 0x7f8b780c01c0 2023-12-16T03:28:16.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b767fc640 1 -- 172.21.15.28:0/2110830511 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c0a8050 con 0x7f8b780c01c0 2023-12-16T03:28:16.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.698+0000 7f8b767fc640 1 -- 172.21.15.28:0/2110830511 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0ac980 con 0x7f8b780c01c0 2023-12-16T03:28:16.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 -- 172.21.15.28:0/2110830511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b780c01c0 msgr2=0x7f8b780c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 --2- 172.21.15.28:0/2110830511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b780c01c0 0x7f8b780c5c60 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8b780bf530 tx=0x7f8b6c01c3a0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 -- 172.21.15.28:0/2110830511 shutdown_connections 2023-12-16T03:28:16.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 --2- 172.21.15.28:0/2110830511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b780c01c0 0x7f8b780c5c60 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 --2- 172.21.15.28:0/2110830511 >> v2:172.21.15.134:3300/0 conn(0x7f8b780a5240 0x7f8b780bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 -- 172.21.15.28:0/2110830511 >> 172.21.15.28:0/2110830511 conn(0x7f8b7806a5b0 msgr2=0x7f8b7806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:16.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 -- 172.21.15.28:0/2110830511 shutdown_connections 2023-12-16T03:28:16.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 -- 172.21.15.28:0/2110830511 wait complete. 2023-12-16T03:28:16.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 Processor -- start 2023-12-16T03:28:16.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 -- start start 2023-12-16T03:28:16.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b780a5240 0x7f8b7814bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b780c01c0 0x7f8b7814c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b780c61a0 0x7f8b78070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7814cf40 con 0x7f8b780c61a0 2023-12-16T03:28:16.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7814c740 con 0x7f8b780a5240 2023-12-16T03:28:16.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b7e079640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7814da80 con 0x7f8b780c01c0 2023-12-16T03:28:16.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b780c61a0 0x7f8b78070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b780c61a0 0x7f8b78070580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45842/0 (socket says 172.21.15.28:45842) 2023-12-16T03:28:16.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b77fff640 1 -- 172.21.15.28:0/3832801164 learned_addr learned my addr 172.21.15.28:0/3832801164 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:16.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b777fe640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b780a5240 0x7f8b7814bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b76ffd640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b780c01c0 0x7f8b7814c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b77fff640 1 -- 172.21.15.28:0/3832801164 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b780c01c0 msgr2=0x7f8b7814c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b77fff640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b780c01c0 0x7f8b7814c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b77fff640 1 -- 172.21.15.28:0/3832801164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b780a5240 msgr2=0x7f8b7814bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b77fff640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b780a5240 0x7f8b7814bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.702+0000 7f8b77fff640 1 -- 172.21.15.28:0/3832801164 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c009420 con 0x7f8b780c61a0 2023-12-16T03:28:16.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.706+0000 7f8b77fff640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b780c61a0 0x7f8b78070580 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000ca80 tx=0x7f8b7000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:16.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.706+0000 7f8b5ffff640 1 -- 172.21.15.28:0/3832801164 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7000ac30 con 0x7f8b780c61a0 2023-12-16T03:28:16.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.706+0000 7f8b5ffff640 1 -- 172.21.15.28:0/3832801164 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7000ad90 con 0x7f8b780c61a0 2023-12-16T03:28:16.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.706+0000 7f8b5ffff640 1 -- 172.21.15.28:0/3832801164 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70012600 con 0x7f8b780c61a0 2023-12-16T03:28:16.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.706+0000 7f8b7e079640 1 -- 172.21.15.28:0/3832801164 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7814ed70 con 0x7f8b780c61a0 2023-12-16T03:28:16.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.706+0000 7f8b7e079640 1 -- 172.21.15.28:0/3832801164 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7814e7b0 con 0x7f8b780c61a0 2023-12-16T03:28:16.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.706+0000 7f8b7e079640 1 -- 172.21.15.28:0/3832801164 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b780c52e0 con 0x7f8b780c61a0 2023-12-16T03:28:16.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.706+0000 7f8b5ffff640 1 -- 172.21.15.28:0/3832801164 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8b70007070 con 0x7f8b780c61a0 2023-12-16T03:28:16.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.706+0000 7f8b5ffff640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b64066470 0x7f8b64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:16.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.706+0000 7f8b5ffff640 1 -- 172.21.15.28:0/3832801164 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8b70083fe0 con 0x7f8b780c61a0 2023-12-16T03:28:16.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.706+0000 7f8b777fe640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b64066470 0x7f8b64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:16.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.710+0000 7f8b777fe640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b64066470 0x7f8b64068930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b68007a60 tx=0x7f8b68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:16.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.710+0000 7f8b5ffff640 1 -- 172.21.15.28:0/3832801164 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8b700511c0 con 0x7f8b780c61a0 2023-12-16T03:28:16.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.866+0000 7f8b7e079640 1 -- 172.21.15.28:0/3832801164 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b78156d10 con 0x7f8b64066470 2023-12-16T03:28:16.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.882+0000 7f8b5ffff640 1 -- 172.21.15.28:0/3832801164 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528037 (secure 0 0 0) 0x7f8b68010990 con 0x7f8b64066470 2023-12-16T03:28:16.890 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:16.895 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:28:16.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 -- 172.21.15.28:0/3832801164 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b64066470 msgr2=0x7f8b64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b64066470 0x7f8b64068930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b68007a60 tx=0x7f8b68008040 comp rx=0 tx=0).stop 2023-12-16T03:28:16.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 -- 172.21.15.28:0/3832801164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b780c61a0 msgr2=0x7f8b78070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:16.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b780c61a0 0x7f8b78070580 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000ca80 tx=0x7f8b7000cf40 comp rx=0 tx=0).stop 2023-12-16T03:28:16.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 -- 172.21.15.28:0/3832801164 shutdown_connections 2023-12-16T03:28:16.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8b64066470 0x7f8b64068930 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b780c61a0 0x7f8b78070580 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8b780c01c0 0x7f8b7814c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 --2- 172.21.15.28:0/3832801164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b780a5240 0x7f8b7814bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:16.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 -- 172.21.15.28:0/3832801164 >> 172.21.15.28:0/3832801164 conn(0x7f8b7806a5b0 msgr2=0x7f8b7806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:16.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 -- 172.21.15.28:0/3832801164 shutdown_connections 2023-12-16T03:28:16.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:16.886+0000 7f8b7e079640 1 -- 172.21.15.28:0/3832801164 wait complete. 2023-12-16T03:28:16.909 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-12-16T03:28:15.833941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":261,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257436,"kb_used_data":7960,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717284,"statfs":{"total":773094113280,"available":772830498816,"internally_reserved":0,"allocated":8151040,"data_stored":4220741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.076132"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.806770+0000","last_change":"2023-12-16T03:28:12.802270+0000","last_active":"2023-12-16T03:28:12.806770+0000","last_peered":"2023-12-16T03:28:12.806770+0000","last_clean":"2023-12-16T03:28:12.806770+0000","last_became_active":"2023-12-16T03:28:12.801995+0000","last_became_peered":"2023-12-16T03:28:12.801995+0000","last_unstale":"2023-12-16T03:28:12.806770+0000","last_undegraded":"2023-12-16T03:28:12.806770+0000","last_fullsized":"2023-12-16T03:28:12.806770+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:11.995380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781078+0000","last_change":"2023-12-16T03:27:59.729049+0000","last_active":"2023-12-16T03:28:11.781078+0000","last_peered":"2023-12-16T03:28:11.781078+0000","last_clean":"2023-12-16T03:28:11.781078+0000","last_became_active":"2023-12-16T03:27:59.728714+0000","last_became_peered":"2023-12-16T03:27:59.728714+0000","last_unstale":"2023-12-16T03:28:11.781078+0000","last_undegraded":"2023-12-16T03:28:11.781078+0000","last_fullsized":"2023-12-16T03:28:11.781078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:38.945695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827630+0000","last_change":"2023-12-16T03:28:12.825540+0000","last_active":"2023-12-16T03:28:12.827630+0000","last_peered":"2023-12-16T03:28:12.827630+0000","last_clean":"2023-12-16T03:28:12.827630+0000","last_became_active":"2023-12-16T03:28:12.825277+0000","last_became_peered":"2023-12-16T03:28:12.825277+0000","last_unstale":"2023-12-16T03:28:12.827630+0000","last_undegraded":"2023-12-16T03:28:12.827630+0000","last_fullsized":"2023-12-16T03:28:12.827630+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:19.990543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.783241+0000","last_change":"2023-12-16T03:27:59.722443+0000","last_active":"2023-12-16T03:28:11.783241+0000","last_peered":"2023-12-16T03:28:11.783241+0000","last_clean":"2023-12-16T03:28:11.783241+0000","last_became_active":"2023-12-16T03:27:59.722119+0000","last_became_peered":"2023-12-16T03:27:59.722119+0000","last_unstale":"2023-12-16T03:28:11.783241+0000","last_undegraded":"2023-12-16T03:28:11.783241+0000","last_fullsized":"2023-12-16T03:28:11.783241+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:26:08.675666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.806346+0000","last_change":"2023-12-16T03:28:12.793339+0000","last_active":"2023-12-16T03:28:12.806346+0000","last_peered":"2023-12-16T03:28:12.806346+0000","last_clean":"2023-12-16T03:28:12.806346+0000","last_became_active":"2023-12-16T03:28:12.792935+0000","last_became_peered":"2023-12-16T03:28:12.792935+0000","last_unstale":"2023-12-16T03:28:12.806346+0000","last_undegraded":"2023-12-16T03:28:12.806346+0000","last_fullsized":"2023-12-16T03:28:12.806346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:58.216044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781131+0000","last_change":"2023-12-16T03:27:59.719770+0000","last_active":"2023-12-16T03:28:11.781131+0000","last_peered":"2023-12-16T03:28:11.781131+0000","last_clean":"2023-12-16T03:28:11.781131+0000","last_became_active":"2023-12-16T03:27:59.719384+0000","last_became_peered":"2023-12-16T03:27:59.719384+0000","last_unstale":"2023-12-16T03:28:11.781131+0000","last_undegraded":"2023-12-16T03:28:11.781131+0000","last_fullsized":"2023-12-16T03:28:11.781131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:47:50.256780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827429+0000","last_change":"2023-12-16T03:28:12.811873+0000","last_active":"2023-12-16T03:28:12.827429+0000","last_peered":"2023-12-16T03:28:12.827429+0000","last_clean":"2023-12-16T03:28:12.827429+0000","last_became_active":"2023-12-16T03:28:12.811564+0000","last_became_peered":"2023-12-16T03:28:12.811564+0000","last_unstale":"2023-12-16T03:28:12.827429+0000","last_undegraded":"2023-12-16T03:28:12.827429+0000","last_fullsized":"2023-12-16T03:28:12.827429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:19.990543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.773972+0000","last_change":"2023-12-16T03:27:59.740570+0000","last_active":"2023-12-16T03:28:11.773972+0000","last_peered":"2023-12-16T03:28:11.773972+0000","last_clean":"2023-12-16T03:28:11.773972+0000","last_became_active":"2023-12-16T03:27:59.740240+0000","last_became_peered":"2023-12-16T03:27:59.740240+0000","last_unstale":"2023-12-16T03:28:11.773972+0000","last_undegraded":"2023-12-16T03:28:11.773972+0000","last_fullsized":"2023-12-16T03:28:11.773972+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:10:51.762407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.821881+0000","last_change":"2023-12-16T03:28:12.816587+0000","last_active":"2023-12-16T03:28:12.821881+0000","last_peered":"2023-12-16T03:28:12.821881+0000","last_clean":"2023-12-16T03:28:12.821881+0000","last_became_active":"2023-12-16T03:28:12.816217+0000","last_became_peered":"2023-12-16T03:28:12.816217+0000","last_unstale":"2023-12-16T03:28:12.821881+0000","last_undegraded":"2023-12-16T03:28:12.821881+0000","last_fullsized":"2023-12-16T03:28:12.821881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:27:00.658089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768232+0000","last_change":"2023-12-16T03:27:59.711730+0000","last_active":"2023-12-16T03:28:11.768232+0000","last_peered":"2023-12-16T03:28:11.768232+0000","last_clean":"2023-12-16T03:28:11.768232+0000","last_became_active":"2023-12-16T03:27:59.711388+0000","last_became_peered":"2023-12-16T03:27:59.711388+0000","last_unstale":"2023-12-16T03:28:11.768232+0000","last_undegraded":"2023-12-16T03:28:11.768232+0000","last_fullsized":"2023-12-16T03:28:11.768232+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:40.409035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827523+0000","last_change":"2023-12-16T03:28:12.823483+0000","last_active":"2023-12-16T03:28:12.827523+0000","last_peered":"2023-12-16T03:28:12.827523+0000","last_clean":"2023-12-16T03:28:12.827523+0000","last_became_active":"2023-12-16T03:28:12.823220+0000","last_became_peered":"2023-12-16T03:28:12.823220+0000","last_unstale":"2023-12-16T03:28:12.827523+0000","last_undegraded":"2023-12-16T03:28:12.827523+0000","last_fullsized":"2023-12-16T03:28:12.827523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:22.570453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767219+0000","last_change":"2023-12-16T03:27:59.733239+0000","last_active":"2023-12-16T03:28:11.767219+0000","last_peered":"2023-12-16T03:28:11.767219+0000","last_clean":"2023-12-16T03:28:11.767219+0000","last_became_active":"2023-12-16T03:27:59.732722+0000","last_became_peered":"2023-12-16T03:27:59.732722+0000","last_unstale":"2023-12-16T03:28:11.767219+0000","last_undegraded":"2023-12-16T03:28:11.767219+0000","last_fullsized":"2023-12-16T03:28:11.767219+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:57.134718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.820780+0000","last_change":"2023-12-16T03:28:12.818698+0000","last_active":"2023-12-16T03:28:12.820780+0000","last_peered":"2023-12-16T03:28:12.820780+0000","last_clean":"2023-12-16T03:28:12.820780+0000","last_became_active":"2023-12-16T03:28:12.818419+0000","last_became_peered":"2023-12-16T03:28:12.818419+0000","last_unstale":"2023-12-16T03:28:12.820780+0000","last_undegraded":"2023-12-16T03:28:12.820780+0000","last_fullsized":"2023-12-16T03:28:12.820780+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:22.570453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.773254+0000","last_change":"2023-12-16T03:27:59.728242+0000","last_active":"2023-12-16T03:28:11.773254+0000","last_peered":"2023-12-16T03:28:11.773254+0000","last_clean":"2023-12-16T03:28:11.773254+0000","last_became_active":"2023-12-16T03:27:59.726176+0000","last_became_peered":"2023-12-16T03:27:59.726176+0000","last_unstale":"2023-12-16T03:28:11.773254+0000","last_undegraded":"2023-12-16T03:28:11.773254+0000","last_fullsized":"2023-12-16T03:28:11.773254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:39:51.551442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817693+0000","last_change":"2023-12-16T03:28:12.814790+0000","last_active":"2023-12-16T03:28:12.817693+0000","last_peered":"2023-12-16T03:28:12.817693+0000","last_clean":"2023-12-16T03:28:12.817693+0000","last_became_active":"2023-12-16T03:28:12.814190+0000","last_became_peered":"2023-12-16T03:28:12.814190+0000","last_unstale":"2023-12-16T03:28:12.817693+0000","last_undegraded":"2023-12-16T03:28:12.817693+0000","last_fullsized":"2023-12-16T03:28:12.817693+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:48:29.764892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.766568+0000","last_change":"2023-12-16T03:27:59.710966+0000","last_active":"2023-12-16T03:28:11.766568+0000","last_peered":"2023-12-16T03:28:11.766568+0000","last_clean":"2023-12-16T03:28:11.766568+0000","last_became_active":"2023-12-16T03:27:59.710627+0000","last_became_peered":"2023-12-16T03:27:59.710627+0000","last_unstale":"2023-12-16T03:28:11.766568+0000","last_undegraded":"2023-12-16T03:28:11.766568+0000","last_fullsized":"2023-12-16T03:28:11.766568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:19:42.795934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.826015+0000","last_change":"2023-12-16T03:28:12.822031+0000","last_active":"2023-12-16T03:28:12.826015+0000","last_peered":"2023-12-16T03:28:12.826015+0000","last_clean":"2023-12-16T03:28:12.826015+0000","last_became_active":"2023-12-16T03:28:12.821682+0000","last_became_peered":"2023-12-16T03:28:12.821682+0000","last_unstale":"2023-12-16T03:28:12.826015+0000","last_undegraded":"2023-12-16T03:28:12.826015+0000","last_fullsized":"2023-12-16T03:28:12.826015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:37.364217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769362+0000","last_change":"2023-12-16T03:27:59.723118+0000","last_active":"2023-12-16T03:28:11.769362+0000","last_peered":"2023-12-16T03:28:11.769362+0000","last_clean":"2023-12-16T03:28:11.769362+0000","last_became_active":"2023-12-16T03:27:59.722803+0000","last_became_peered":"2023-12-16T03:27:59.722803+0000","last_unstale":"2023-12-16T03:28:11.769362+0000","last_undegraded":"2023-12-16T03:28:11.769362+0000","last_fullsized":"2023-12-16T03:28:11.769362+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:06.347016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818581+0000","last_change":"2023-12-16T03:28:12.802671+0000","last_active":"2023-12-16T03:28:12.818581+0000","last_peered":"2023-12-16T03:28:12.818581+0000","last_clean":"2023-12-16T03:28:12.818581+0000","last_became_active":"2023-12-16T03:28:12.802358+0000","last_became_peered":"2023-12-16T03:28:12.802358+0000","last_unstale":"2023-12-16T03:28:12.818581+0000","last_undegraded":"2023-12-16T03:28:12.818581+0000","last_fullsized":"2023-12-16T03:28:12.818581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:33.289034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781811+0000","last_change":"2023-12-16T03:27:59.724226+0000","last_active":"2023-12-16T03:28:11.781811+0000","last_peered":"2023-12-16T03:28:11.781811+0000","last_clean":"2023-12-16T03:28:11.781811+0000","last_became_active":"2023-12-16T03:27:59.723929+0000","last_became_peered":"2023-12-16T03:27:59.723929+0000","last_unstale":"2023-12-16T03:28:11.781811+0000","last_undegraded":"2023-12-16T03:28:11.781811+0000","last_fullsized":"2023-12-16T03:28:11.781811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:48:36.777385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819700+0000","last_change":"2023-12-16T03:28:12.806281+0000","last_active":"2023-12-16T03:28:12.819700+0000","last_peered":"2023-12-16T03:28:12.819700+0000","last_clean":"2023-12-16T03:28:12.819700+0000","last_became_active":"2023-12-16T03:28:12.806007+0000","last_became_peered":"2023-12-16T03:28:12.806007+0000","last_unstale":"2023-12-16T03:28:12.819700+0000","last_undegraded":"2023-12-16T03:28:12.819700+0000","last_fullsized":"2023-12-16T03:28:12.819700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:05.273802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.783529+0000","last_change":"2023-12-16T03:27:59.710177+0000","last_active":"2023-12-16T03:28:11.783529+0000","last_peered":"2023-12-16T03:28:11.783529+0000","last_clean":"2023-12-16T03:28:11.783529+0000","last_became_active":"2023-12-16T03:27:59.709870+0000","last_became_peered":"2023-12-16T03:27:59.709870+0000","last_unstale":"2023-12-16T03:28:11.783529+0000","last_undegraded":"2023-12-16T03:28:11.783529+0000","last_fullsized":"2023-12-16T03:28:11.783529+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:26:43.167751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819183+0000","last_change":"2023-12-16T03:28:12.813094+0000","last_active":"2023-12-16T03:28:12.819183+0000","last_peered":"2023-12-16T03:28:12.819183+0000","last_clean":"2023-12-16T03:28:12.819183+0000","last_became_active":"2023-12-16T03:28:12.811974+0000","last_became_peered":"2023-12-16T03:28:12.811974+0000","last_unstale":"2023-12-16T03:28:12.819183+0000","last_undegraded":"2023-12-16T03:28:12.819183+0000","last_fullsized":"2023-12-16T03:28:12.819183+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:08.869195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.778346+0000","last_change":"2023-12-16T03:27:59.726745+0000","last_active":"2023-12-16T03:28:11.778346+0000","last_peered":"2023-12-16T03:28:11.778346+0000","last_clean":"2023-12-16T03:28:11.778346+0000","last_became_active":"2023-12-16T03:27:59.725932+0000","last_became_peered":"2023-12-16T03:27:59.725932+0000","last_unstale":"2023-12-16T03:28:11.778346+0000","last_undegraded":"2023-12-16T03:28:11.778346+0000","last_fullsized":"2023-12-16T03:28:11.778346+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:20:58.921708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819237+0000","last_change":"2023-12-16T03:28:12.813133+0000","last_active":"2023-12-16T03:28:12.819237+0000","last_peered":"2023-12-16T03:28:12.819237+0000","last_clean":"2023-12-16T03:28:12.819237+0000","last_became_active":"2023-12-16T03:28:12.812771+0000","last_became_peered":"2023-12-16T03:28:12.812771+0000","last_unstale":"2023-12-16T03:28:12.819237+0000","last_undegraded":"2023-12-16T03:28:12.819237+0000","last_fullsized":"2023-12-16T03:28:12.819237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:27:00.658089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779204+0000","last_change":"2023-12-16T03:27:59.706154+0000","last_active":"2023-12-16T03:28:11.779204+0000","last_peered":"2023-12-16T03:28:11.779204+0000","last_clean":"2023-12-16T03:28:11.779204+0000","last_became_active":"2023-12-16T03:27:59.704791+0000","last_became_peered":"2023-12-16T03:27:59.704791+0000","last_unstale":"2023-12-16T03:28:11.779204+0000","last_undegraded":"2023-12-16T03:28:11.779204+0000","last_fullsized":"2023-12-16T03:28:11.779204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:48:36.777385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.831164+0000","last_change":"2023-12-16T03:28:12.827140+0000","last_active":"2023-12-16T03:28:12.831164+0000","last_peered":"2023-12-16T03:28:12.831164+0000","last_clean":"2023-12-16T03:28:12.831164+0000","last_became_active":"2023-12-16T03:28:12.826818+0000","last_became_peered":"2023-12-16T03:28:12.826818+0000","last_unstale":"2023-12-16T03:28:12.831164+0000","last_undegraded":"2023-12-16T03:28:12.831164+0000","last_fullsized":"2023-12-16T03:28:12.831164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:22.570453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779755+0000","last_change":"2023-12-16T03:27:59.740901+0000","last_active":"2023-12-16T03:28:11.779755+0000","last_peered":"2023-12-16T03:28:11.779755+0000","last_clean":"2023-12-16T03:28:11.779755+0000","last_became_active":"2023-12-16T03:27:59.740547+0000","last_became_peered":"2023-12-16T03:27:59.740547+0000","last_unstale":"2023-12-16T03:28:11.779755+0000","last_undegraded":"2023-12-16T03:28:11.779755+0000","last_fullsized":"2023-12-16T03:28:11.779755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:58.754019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.830597+0000","last_change":"2023-12-16T03:28:12.829413+0000","last_active":"2023-12-16T03:28:12.830597+0000","last_peered":"2023-12-16T03:28:12.830597+0000","last_clean":"2023-12-16T03:28:12.830597+0000","last_became_active":"2023-12-16T03:28:12.829074+0000","last_became_peered":"2023-12-16T03:28:12.829074+0000","last_unstale":"2023-12-16T03:28:12.830597+0000","last_undegraded":"2023-12-16T03:28:12.830597+0000","last_fullsized":"2023-12-16T03:28:12.830597+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:03:48.039286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.780156+0000","last_change":"2023-12-16T03:27:59.718827+0000","last_active":"2023-12-16T03:28:11.780156+0000","last_peered":"2023-12-16T03:28:11.780156+0000","last_clean":"2023-12-16T03:28:11.780156+0000","last_became_active":"2023-12-16T03:27:59.718127+0000","last_became_peered":"2023-12-16T03:27:59.718127+0000","last_unstale":"2023-12-16T03:28:11.780156+0000","last_undegraded":"2023-12-16T03:28:11.780156+0000","last_fullsized":"2023-12-16T03:28:11.780156+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:55.561580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817745+0000","last_change":"2023-12-16T03:28:12.809665+0000","last_active":"2023-12-16T03:28:12.817745+0000","last_peered":"2023-12-16T03:28:12.817745+0000","last_clean":"2023-12-16T03:28:12.817745+0000","last_became_active":"2023-12-16T03:28:12.809379+0000","last_became_peered":"2023-12-16T03:28:12.809379+0000","last_unstale":"2023-12-16T03:28:12.817745+0000","last_undegraded":"2023-12-16T03:28:12.817745+0000","last_fullsized":"2023-12-16T03:28:12.817745+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:26:56.241423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767497+0000","last_change":"2023-12-16T03:27:59.725235+0000","last_active":"2023-12-16T03:28:11.767497+0000","last_peered":"2023-12-16T03:28:11.767497+0000","last_clean":"2023-12-16T03:28:11.767497+0000","last_became_active":"2023-12-16T03:27:59.720567+0000","last_became_peered":"2023-12-16T03:27:59.720567+0000","last_unstale":"2023-12-16T03:28:11.767497+0000","last_undegraded":"2023-12-16T03:28:11.767497+0000","last_fullsized":"2023-12-16T03:28:11.767497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:57.134718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817267+0000","last_change":"2023-12-16T03:28:12.803510+0000","last_active":"2023-12-16T03:28:12.817267+0000","last_peered":"2023-12-16T03:28:12.817267+0000","last_clean":"2023-12-16T03:28:12.817267+0000","last_became_active":"2023-12-16T03:28:12.803146+0000","last_became_peered":"2023-12-16T03:28:12.803146+0000","last_unstale":"2023-12-16T03:28:12.817267+0000","last_undegraded":"2023-12-16T03:28:12.817267+0000","last_fullsized":"2023-12-16T03:28:12.817267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:13:50.753237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769745+0000","last_change":"2023-12-16T03:27:59.733876+0000","last_active":"2023-12-16T03:28:11.769745+0000","last_peered":"2023-12-16T03:28:11.769745+0000","last_clean":"2023-12-16T03:28:11.769745+0000","last_became_active":"2023-12-16T03:27:59.733338+0000","last_became_peered":"2023-12-16T03:27:59.733338+0000","last_unstale":"2023-12-16T03:28:11.769745+0000","last_undegraded":"2023-12-16T03:28:11.769745+0000","last_fullsized":"2023-12-16T03:28:11.769745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:06.347016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823397+0000","last_change":"2023-12-16T03:28:12.813238+0000","last_active":"2023-12-16T03:28:12.823397+0000","last_peered":"2023-12-16T03:28:12.823397+0000","last_clean":"2023-12-16T03:28:12.823397+0000","last_became_active":"2023-12-16T03:28:12.812947+0000","last_became_peered":"2023-12-16T03:28:12.812947+0000","last_unstale":"2023-12-16T03:28:12.823397+0000","last_undegraded":"2023-12-16T03:28:12.823397+0000","last_fullsized":"2023-12-16T03:28:12.823397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:59.724251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.776736+0000","last_change":"2023-12-16T03:27:59.737553+0000","last_active":"2023-12-16T03:28:11.776736+0000","last_peered":"2023-12-16T03:28:11.776736+0000","last_clean":"2023-12-16T03:28:11.776736+0000","last_became_active":"2023-12-16T03:27:59.737272+0000","last_became_peered":"2023-12-16T03:27:59.737272+0000","last_unstale":"2023-12-16T03:28:11.776736+0000","last_undegraded":"2023-12-16T03:28:11.776736+0000","last_fullsized":"2023-12-16T03:28:11.776736+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:51.828325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.828016+0000","last_change":"2023-12-16T03:28:12.811528+0000","last_active":"2023-12-16T03:28:12.828016+0000","last_peered":"2023-12-16T03:28:12.828016+0000","last_clean":"2023-12-16T03:28:12.828016+0000","last_became_active":"2023-12-16T03:28:12.811223+0000","last_became_peered":"2023-12-16T03:28:12.811223+0000","last_unstale":"2023-12-16T03:28:12.828016+0000","last_undegraded":"2023-12-16T03:28:12.828016+0000","last_fullsized":"2023-12-16T03:28:12.828016+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.175468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765051+0000","last_change":"2023-12-16T03:27:59.730293+0000","last_active":"2023-12-16T03:28:11.765051+0000","last_peered":"2023-12-16T03:28:11.765051+0000","last_clean":"2023-12-16T03:28:11.765051+0000","last_became_active":"2023-12-16T03:27:59.725734+0000","last_became_peered":"2023-12-16T03:27:59.725734+0000","last_unstale":"2023-12-16T03:28:11.765051+0000","last_undegraded":"2023-12-16T03:28:11.765051+0000","last_fullsized":"2023-12-16T03:28:11.765051+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:45.169228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823655+0000","last_change":"2023-12-16T03:28:12.819623+0000","last_active":"2023-12-16T03:28:12.823655+0000","last_peered":"2023-12-16T03:28:12.823655+0000","last_clean":"2023-12-16T03:28:12.823655+0000","last_became_active":"2023-12-16T03:28:12.819289+0000","last_became_peered":"2023-12-16T03:28:12.819289+0000","last_unstale":"2023-12-16T03:28:12.823655+0000","last_undegraded":"2023-12-16T03:28:12.823655+0000","last_fullsized":"2023-12-16T03:28:12.823655+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:29:57.891539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.774060+0000","last_change":"2023-12-16T03:27:59.736580+0000","last_active":"2023-12-16T03:28:11.774060+0000","last_peered":"2023-12-16T03:28:11.774060+0000","last_clean":"2023-12-16T03:28:11.774060+0000","last_became_active":"2023-12-16T03:27:59.736291+0000","last_became_peered":"2023-12-16T03:27:59.736291+0000","last_unstale":"2023-12-16T03:28:11.774060+0000","last_undegraded":"2023-12-16T03:28:11.774060+0000","last_fullsized":"2023-12-16T03:28:11.774060+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:46.410977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.825935+0000","last_change":"2023-12-16T03:28:12.807562+0000","last_active":"2023-12-16T03:28:12.825935+0000","last_peered":"2023-12-16T03:28:12.825935+0000","last_clean":"2023-12-16T03:28:12.825935+0000","last_became_active":"2023-12-16T03:28:12.807291+0000","last_became_peered":"2023-12-16T03:28:12.807291+0000","last_unstale":"2023-12-16T03:28:12.825935+0000","last_undegraded":"2023-12-16T03:28:12.825935+0000","last_fullsized":"2023-12-16T03:28:12.825935+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:51:38.457946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.777688+0000","last_change":"2023-12-16T03:27:59.738532+0000","last_active":"2023-12-16T03:28:11.777688+0000","last_peered":"2023-12-16T03:28:11.777688+0000","last_clean":"2023-12-16T03:28:11.777688+0000","last_became_active":"2023-12-16T03:27:59.735740+0000","last_became_peered":"2023-12-16T03:27:59.735740+0000","last_unstale":"2023-12-16T03:28:11.777688+0000","last_undegraded":"2023-12-16T03:28:11.777688+0000","last_fullsized":"2023-12-16T03:28:11.777688+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:58.145120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823470+0000","last_change":"2023-12-16T03:28:12.818641+0000","last_active":"2023-12-16T03:28:12.823470+0000","last_peered":"2023-12-16T03:28:12.823470+0000","last_clean":"2023-12-16T03:28:12.823470+0000","last_became_active":"2023-12-16T03:28:12.817241+0000","last_became_peered":"2023-12-16T03:28:12.817241+0000","last_unstale":"2023-12-16T03:28:12.823470+0000","last_undegraded":"2023-12-16T03:28:12.823470+0000","last_fullsized":"2023-12-16T03:28:12.823470+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:03:48.039286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781887+0000","last_change":"2023-12-16T03:27:59.724263+0000","last_active":"2023-12-16T03:28:11.781887+0000","last_peered":"2023-12-16T03:28:11.781887+0000","last_clean":"2023-12-16T03:28:11.781887+0000","last_became_active":"2023-12-16T03:27:59.723977+0000","last_became_peered":"2023-12-16T03:27:59.723977+0000","last_unstale":"2023-12-16T03:28:11.781887+0000","last_undegraded":"2023-12-16T03:28:11.781887+0000","last_fullsized":"2023-12-16T03:28:11.781887+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:25.732965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818316+0000","last_change":"2023-12-16T03:28:12.804296+0000","last_active":"2023-12-16T03:28:12.818316+0000","last_peered":"2023-12-16T03:28:12.818316+0000","last_clean":"2023-12-16T03:28:12.818316+0000","last_became_active":"2023-12-16T03:28:12.803964+0000","last_became_peered":"2023-12-16T03:28:12.803964+0000","last_unstale":"2023-12-16T03:28:12.818316+0000","last_undegraded":"2023-12-16T03:28:12.818316+0000","last_fullsized":"2023-12-16T03:28:12.818316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:03.418997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779626+0000","last_change":"2023-12-16T03:27:59.731798+0000","last_active":"2023-12-16T03:28:11.779626+0000","last_peered":"2023-12-16T03:28:11.779626+0000","last_clean":"2023-12-16T03:28:11.779626+0000","last_became_active":"2023-12-16T03:27:59.731495+0000","last_became_peered":"2023-12-16T03:27:59.731495+0000","last_unstale":"2023-12-16T03:28:11.779626+0000","last_undegraded":"2023-12-16T03:28:11.779626+0000","last_fullsized":"2023-12-16T03:28:11.779626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:45.169228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.820729+0000","last_change":"2023-12-16T03:28:12.806871+0000","last_active":"2023-12-16T03:28:12.820729+0000","last_peered":"2023-12-16T03:28:12.820729+0000","last_clean":"2023-12-16T03:28:12.820729+0000","last_became_active":"2023-12-16T03:28:12.806591+0000","last_became_peered":"2023-12-16T03:28:12.806591+0000","last_unstale":"2023-12-16T03:28:12.820729+0000","last_undegraded":"2023-12-16T03:28:12.820729+0000","last_fullsized":"2023-12-16T03:28:12.820729+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:27:00.658089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.785057+0000","last_change":"2023-12-16T03:27:59.735415+0000","last_active":"2023-12-16T03:28:11.785057+0000","last_peered":"2023-12-16T03:28:11.785057+0000","last_clean":"2023-12-16T03:28:11.785057+0000","last_became_active":"2023-12-16T03:27:59.735157+0000","last_became_peered":"2023-12-16T03:27:59.735157+0000","last_unstale":"2023-12-16T03:28:11.785057+0000","last_undegraded":"2023-12-16T03:28:11.785057+0000","last_fullsized":"2023-12-16T03:28:11.785057+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:35.229043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823358+0000","last_change":"2023-12-16T03:28:12.819248+0000","last_active":"2023-12-16T03:28:12.823358+0000","last_peered":"2023-12-16T03:28:12.823358+0000","last_clean":"2023-12-16T03:28:12.823358+0000","last_became_active":"2023-12-16T03:28:12.818954+0000","last_became_peered":"2023-12-16T03:28:12.818954+0000","last_unstale":"2023-12-16T03:28:12.823358+0000","last_undegraded":"2023-12-16T03:28:12.823358+0000","last_fullsized":"2023-12-16T03:28:12.823358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:19.990543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.783695+0000","last_change":"2023-12-16T03:27:59.712831+0000","last_active":"2023-12-16T03:28:11.783695+0000","last_peered":"2023-12-16T03:28:11.783695+0000","last_clean":"2023-12-16T03:28:11.783695+0000","last_became_active":"2023-12-16T03:27:59.712536+0000","last_became_peered":"2023-12-16T03:27:59.712536+0000","last_unstale":"2023-12-16T03:28:11.783695+0000","last_undegraded":"2023-12-16T03:28:11.783695+0000","last_fullsized":"2023-12-16T03:28:11.783695+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:50.291606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.820760+0000","last_change":"2023-12-16T03:28:12.815782+0000","last_active":"2023-12-16T03:28:12.820760+0000","last_peered":"2023-12-16T03:28:12.820760+0000","last_clean":"2023-12-16T03:28:12.820760+0000","last_became_active":"2023-12-16T03:28:12.815548+0000","last_became_peered":"2023-12-16T03:28:12.815548+0000","last_unstale":"2023-12-16T03:28:12.820760+0000","last_undegraded":"2023-12-16T03:28:12.820760+0000","last_fullsized":"2023-12-16T03:28:12.820760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:05.273802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782347+0000","last_change":"2023-12-16T03:27:59.710497+0000","last_active":"2023-12-16T03:28:11.782347+0000","last_peered":"2023-12-16T03:28:11.782347+0000","last_clean":"2023-12-16T03:28:11.782347+0000","last_became_active":"2023-12-16T03:27:59.710219+0000","last_became_peered":"2023-12-16T03:27:59.710219+0000","last_unstale":"2023-12-16T03:28:11.782347+0000","last_undegraded":"2023-12-16T03:28:11.782347+0000","last_fullsized":"2023-12-16T03:28:11.782347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:24:57.766259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.816010+0000","last_change":"2023-12-16T03:28:12.813186+0000","last_active":"2023-12-16T03:28:12.816010+0000","last_peered":"2023-12-16T03:28:12.816010+0000","last_clean":"2023-12-16T03:28:12.816010+0000","last_became_active":"2023-12-16T03:28:12.812252+0000","last_became_peered":"2023-12-16T03:28:12.812252+0000","last_unstale":"2023-12-16T03:28:12.816010+0000","last_undegraded":"2023-12-16T03:28:12.816010+0000","last_fullsized":"2023-12-16T03:28:12.816010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:24:50.227951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768129+0000","last_change":"2023-12-16T03:27:59.712771+0000","last_active":"2023-12-16T03:28:11.768129+0000","last_peered":"2023-12-16T03:28:11.768129+0000","last_clean":"2023-12-16T03:28:11.768129+0000","last_became_active":"2023-12-16T03:27:59.712506+0000","last_became_peered":"2023-12-16T03:27:59.712506+0000","last_unstale":"2023-12-16T03:28:11.768129+0000","last_undegraded":"2023-12-16T03:28:11.768129+0000","last_fullsized":"2023-12-16T03:28:11.768129+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:55:37.693337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.811381+0000","last_change":"2023-12-16T03:28:12.805199+0000","last_active":"2023-12-16T03:28:12.811381+0000","last_peered":"2023-12-16T03:28:12.811381+0000","last_clean":"2023-12-16T03:28:12.811381+0000","last_became_active":"2023-12-16T03:28:12.804911+0000","last_became_peered":"2023-12-16T03:28:12.804911+0000","last_unstale":"2023-12-16T03:28:12.811381+0000","last_undegraded":"2023-12-16T03:28:12.811381+0000","last_fullsized":"2023-12-16T03:28:12.811381+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:08.869195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.778672+0000","last_change":"2023-12-16T03:27:59.719153+0000","last_active":"2023-12-16T03:28:11.778672+0000","last_peered":"2023-12-16T03:28:11.778672+0000","last_clean":"2023-12-16T03:28:11.778672+0000","last_became_active":"2023-12-16T03:27:59.718863+0000","last_became_peered":"2023-12-16T03:27:59.718863+0000","last_unstale":"2023-12-16T03:28:11.778672+0000","last_undegraded":"2023-12-16T03:28:11.778672+0000","last_fullsized":"2023-12-16T03:28:11.778672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:40.409035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819218+0000","last_change":"2023-12-16T03:28:12.808217+0000","last_active":"2023-12-16T03:28:12.819218+0000","last_peered":"2023-12-16T03:28:12.819218+0000","last_clean":"2023-12-16T03:28:12.819218+0000","last_became_active":"2023-12-16T03:28:12.807897+0000","last_became_peered":"2023-12-16T03:28:12.807897+0000","last_unstale":"2023-12-16T03:28:12.819218+0000","last_undegraded":"2023-12-16T03:28:12.819218+0000","last_fullsized":"2023-12-16T03:28:12.819218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:24:50.227951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781731+0000","last_change":"2023-12-16T03:27:59.716721+0000","last_active":"2023-12-16T03:28:11.781731+0000","last_peered":"2023-12-16T03:28:11.781731+0000","last_clean":"2023-12-16T03:28:11.781731+0000","last_became_active":"2023-12-16T03:27:59.714950+0000","last_became_peered":"2023-12-16T03:27:59.714950+0000","last_unstale":"2023-12-16T03:28:11.781731+0000","last_undegraded":"2023-12-16T03:28:11.781731+0000","last_fullsized":"2023-12-16T03:28:11.781731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:19.672282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823282+0000","last_change":"2023-12-16T03:28:12.813431+0000","last_active":"2023-12-16T03:28:12.823282+0000","last_peered":"2023-12-16T03:28:12.823282+0000","last_clean":"2023-12-16T03:28:12.823282+0000","last_became_active":"2023-12-16T03:28:12.809937+0000","last_became_peered":"2023-12-16T03:28:12.809937+0000","last_unstale":"2023-12-16T03:28:12.823282+0000","last_undegraded":"2023-12-16T03:28:12.823282+0000","last_fullsized":"2023-12-16T03:28:12.823282+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:10.208389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781980+0000","last_change":"2023-12-16T03:27:59.735977+0000","last_active":"2023-12-16T03:28:11.781980+0000","last_peered":"2023-12-16T03:28:11.781980+0000","last_clean":"2023-12-16T03:28:11.781980+0000","last_became_active":"2023-12-16T03:27:59.735626+0000","last_became_peered":"2023-12-16T03:27:59.735626+0000","last_unstale":"2023-12-16T03:28:11.781980+0000","last_undegraded":"2023-12-16T03:28:11.781980+0000","last_fullsized":"2023-12-16T03:28:11.781980+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:15:14.726435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818030+0000","last_change":"2023-12-16T03:28:12.804603+0000","last_active":"2023-12-16T03:28:12.818030+0000","last_peered":"2023-12-16T03:28:12.818030+0000","last_clean":"2023-12-16T03:28:12.818030+0000","last_became_active":"2023-12-16T03:28:12.804304+0000","last_became_peered":"2023-12-16T03:28:12.804304+0000","last_unstale":"2023-12-16T03:28:12.818030+0000","last_undegraded":"2023-12-16T03:28:12.818030+0000","last_fullsized":"2023-12-16T03:28:12.818030+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:04:02.206799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767725+0000","last_change":"2023-12-16T03:27:59.711640+0000","last_active":"2023-12-16T03:28:11.767725+0000","last_peered":"2023-12-16T03:28:11.767725+0000","last_clean":"2023-12-16T03:28:11.767725+0000","last_became_active":"2023-12-16T03:27:59.711336+0000","last_became_peered":"2023-12-16T03:27:59.711336+0000","last_unstale":"2023-12-16T03:28:11.767725+0000","last_undegraded":"2023-12-16T03:28:11.767725+0000","last_fullsized":"2023-12-16T03:28:11.767725+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:55.005723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817725+0000","last_change":"2023-12-16T03:28:12.801992+0000","last_active":"2023-12-16T03:28:12.817725+0000","last_peered":"2023-12-16T03:28:12.817725+0000","last_clean":"2023-12-16T03:28:12.817725+0000","last_became_active":"2023-12-16T03:28:12.801633+0000","last_became_peered":"2023-12-16T03:28:12.801633+0000","last_unstale":"2023-12-16T03:28:12.817725+0000","last_undegraded":"2023-12-16T03:28:12.817725+0000","last_fullsized":"2023-12-16T03:28:12.817725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:39:01.590074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.780573+0000","last_change":"2023-12-16T03:27:59.718509+0000","last_active":"2023-12-16T03:28:11.780573+0000","last_peered":"2023-12-16T03:28:11.780573+0000","last_clean":"2023-12-16T03:28:11.780573+0000","last_became_active":"2023-12-16T03:27:59.718083+0000","last_became_peered":"2023-12-16T03:27:59.718083+0000","last_unstale":"2023-12-16T03:28:11.780573+0000","last_undegraded":"2023-12-16T03:28:11.780573+0000","last_fullsized":"2023-12-16T03:28:11.780573+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:33.266132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.812004+0000","last_change":"2023-12-16T03:28:12.798925+0000","last_active":"2023-12-16T03:28:12.812004+0000","last_peered":"2023-12-16T03:28:12.812004+0000","last_clean":"2023-12-16T03:28:12.812004+0000","last_became_active":"2023-12-16T03:28:12.798629+0000","last_became_peered":"2023-12-16T03:28:12.798629+0000","last_unstale":"2023-12-16T03:28:12.812004+0000","last_undegraded":"2023-12-16T03:28:12.812004+0000","last_fullsized":"2023-12-16T03:28:12.812004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:19.420688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827661+0000","last_change":"2023-12-16T03:28:11.795335+0000","last_active":"2023-12-16T03:28:12.827661+0000","last_peered":"2023-12-16T03:28:12.827661+0000","last_clean":"2023-12-16T03:28:12.827661+0000","last_became_active":"2023-12-16T03:28:11.795030+0000","last_became_peered":"2023-12-16T03:28:11.795030+0000","last_unstale":"2023-12-16T03:28:12.827661+0000","last_undegraded":"2023-12-16T03:28:12.827661+0000","last_fullsized":"2023-12-16T03:28:12.827661+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:36.357743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769639+0000","last_change":"2023-12-16T03:27:59.726845+0000","last_active":"2023-12-16T03:28:11.769639+0000","last_peered":"2023-12-16T03:28:11.769639+0000","last_clean":"2023-12-16T03:28:11.769639+0000","last_became_active":"2023-12-16T03:27:59.722341+0000","last_became_peered":"2023-12-16T03:27:59.722341+0000","last_unstale":"2023-12-16T03:28:11.769639+0000","last_undegraded":"2023-12-16T03:28:11.769639+0000","last_fullsized":"2023-12-16T03:28:11.769639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:21.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781343+0000","last_change":"2023-12-16T03:27:58.719610+0000","last_active":"2023-12-16T03:28:11.781343+0000","last_peered":"2023-12-16T03:28:11.781343+0000","last_clean":"2023-12-16T03:28:11.781343+0000","last_became_active":"2023-12-16T03:27:58.719344+0000","last_became_peered":"2023-12-16T03:27:58.719344+0000","last_unstale":"2023-12-16T03:28:11.781343+0000","last_undegraded":"2023-12-16T03:28:11.781343+0000","last_fullsized":"2023-12-16T03:28:11.781343+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:55:36.684947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.810041+0000","last_change":"2023-12-16T03:28:12.798017+0000","last_active":"2023-12-16T03:28:12.810041+0000","last_peered":"2023-12-16T03:28:12.810041+0000","last_clean":"2023-12-16T03:28:12.810041+0000","last_became_active":"2023-12-16T03:28:12.797718+0000","last_became_peered":"2023-12-16T03:28:12.797718+0000","last_unstale":"2023-12-16T03:28:12.810041+0000","last_undegraded":"2023-12-16T03:28:12.810041+0000","last_fullsized":"2023-12-16T03:28:12.810041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:27:08.635252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.824521+0000","last_change":"2023-12-16T03:28:11.784507+0000","last_active":"2023-12-16T03:28:12.824521+0000","last_peered":"2023-12-16T03:28:12.824521+0000","last_clean":"2023-12-16T03:28:12.824521+0000","last_became_active":"2023-12-16T03:28:11.784209+0000","last_became_peered":"2023-12-16T03:28:11.784209+0000","last_unstale":"2023-12-16T03:28:12.824521+0000","last_undegraded":"2023-12-16T03:28:12.824521+0000","last_fullsized":"2023-12-16T03:28:12.824521+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:44.401345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781157+0000","last_change":"2023-12-16T03:27:59.724069+0000","last_active":"2023-12-16T03:28:11.781157+0000","last_peered":"2023-12-16T03:28:11.781157+0000","last_clean":"2023-12-16T03:28:11.781157+0000","last_became_active":"2023-12-16T03:27:59.723703+0000","last_became_peered":"2023-12-16T03:27:59.723703+0000","last_unstale":"2023-12-16T03:28:11.781157+0000","last_undegraded":"2023-12-16T03:28:11.781157+0000","last_fullsized":"2023-12-16T03:28:11.781157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:40:30.607572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769762+0000","last_change":"2023-12-16T03:27:58.715152+0000","last_active":"2023-12-16T03:28:11.769762+0000","last_peered":"2023-12-16T03:28:11.769762+0000","last_clean":"2023-12-16T03:28:11.769762+0000","last_became_active":"2023-12-16T03:27:58.714836+0000","last_became_peered":"2023-12-16T03:27:58.714836+0000","last_unstale":"2023-12-16T03:28:11.769762+0000","last_undegraded":"2023-12-16T03:28:11.769762+0000","last_fullsized":"2023-12-16T03:28:11.769762+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:19:41.787545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.821238+0000","last_change":"2023-12-16T03:28:12.818491+0000","last_active":"2023-12-16T03:28:12.821238+0000","last_peered":"2023-12-16T03:28:12.821238+0000","last_clean":"2023-12-16T03:28:12.821238+0000","last_became_active":"2023-12-16T03:28:12.818098+0000","last_became_peered":"2023-12-16T03:28:12.818098+0000","last_unstale":"2023-12-16T03:28:12.821238+0000","last_undegraded":"2023-12-16T03:28:12.821238+0000","last_fullsized":"2023-12-16T03:28:12.821238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:03.365277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"71'4","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.828145+0000","last_change":"2023-12-16T03:28:11.789836+0000","last_active":"2023-12-16T03:28:12.828145+0000","last_peered":"2023-12-16T03:28:12.828145+0000","last_clean":"2023-12-16T03:28:12.828145+0000","last_became_active":"2023-12-16T03:28:11.789274+0000","last_became_peered":"2023-12-16T03:28:11.789274+0000","last_unstale":"2023-12-16T03:28:12.828145+0000","last_undegraded":"2023-12-16T03:28:12.828145+0000","last_fullsized":"2023-12-16T03:28:12.828145+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:11:00.573887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779101+0000","last_change":"2023-12-16T03:27:59.718830+0000","last_active":"2023-12-16T03:28:11.779101+0000","last_peered":"2023-12-16T03:28:11.779101+0000","last_clean":"2023-12-16T03:28:11.779101+0000","last_became_active":"2023-12-16T03:27:59.718490+0000","last_became_peered":"2023-12-16T03:27:59.718490+0000","last_unstale":"2023-12-16T03:28:11.779101+0000","last_undegraded":"2023-12-16T03:28:11.779101+0000","last_fullsized":"2023-12-16T03:28:11.779101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:21.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765921+0000","last_change":"2023-12-16T03:27:58.716124+0000","last_active":"2023-12-16T03:28:11.765921+0000","last_peered":"2023-12-16T03:28:11.765921+0000","last_clean":"2023-12-16T03:28:11.765921+0000","last_became_active":"2023-12-16T03:27:58.715821+0000","last_became_peered":"2023-12-16T03:27:58.715821+0000","last_unstale":"2023-12-16T03:28:11.765921+0000","last_undegraded":"2023-12-16T03:28:11.765921+0000","last_fullsized":"2023-12-16T03:28:11.765921+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:05.338626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819410+0000","last_change":"2023-12-16T03:28:12.815994+0000","last_active":"2023-12-16T03:28:12.819410+0000","last_peered":"2023-12-16T03:28:12.819410+0000","last_clean":"2023-12-16T03:28:12.819410+0000","last_became_active":"2023-12-16T03:28:12.815688+0000","last_became_peered":"2023-12-16T03:28:12.815688+0000","last_unstale":"2023-12-16T03:28:12.819410+0000","last_undegraded":"2023-12-16T03:28:12.819410+0000","last_fullsized":"2023-12-16T03:28:12.819410+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.407819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.814558+0000","last_change":"2023-12-16T03:28:11.791486+0000","last_active":"2023-12-16T03:28:12.814558+0000","last_peered":"2023-12-16T03:28:12.814558+0000","last_clean":"2023-12-16T03:28:12.814558+0000","last_became_active":"2023-12-16T03:28:11.791004+0000","last_became_peered":"2023-12-16T03:28:11.791004+0000","last_unstale":"2023-12-16T03:28:12.814558+0000","last_undegraded":"2023-12-16T03:28:12.814558+0000","last_fullsized":"2023-12-16T03:28:12.814558+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:29:56.885065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781228+0000","last_change":"2023-12-16T03:27:59.733764+0000","last_active":"2023-12-16T03:28:11.781228+0000","last_peered":"2023-12-16T03:28:11.781228+0000","last_clean":"2023-12-16T03:28:11.781228+0000","last_became_active":"2023-12-16T03:27:59.733395+0000","last_became_peered":"2023-12-16T03:27:59.733395+0000","last_unstale":"2023-12-16T03:28:11.781228+0000","last_undegraded":"2023-12-16T03:28:11.781228+0000","last_fullsized":"2023-12-16T03:28:11.781228+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:34.741103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765786+0000","last_change":"2023-12-16T03:27:58.716176+0000","last_active":"2023-12-16T03:28:11.765786+0000","last_peered":"2023-12-16T03:28:11.765786+0000","last_clean":"2023-12-16T03:28:11.765786+0000","last_became_active":"2023-12-16T03:27:58.714966+0000","last_became_peered":"2023-12-16T03:27:58.714966+0000","last_unstale":"2023-12-16T03:28:11.765786+0000","last_undegraded":"2023-12-16T03:28:11.765786+0000","last_fullsized":"2023-12-16T03:28:11.765786+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:44.133983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.812345+0000","last_change":"2023-12-16T03:28:12.798196+0000","last_active":"2023-12-16T03:28:12.812345+0000","last_peered":"2023-12-16T03:28:12.812345+0000","last_clean":"2023-12-16T03:28:12.812345+0000","last_became_active":"2023-12-16T03:28:12.797907+0000","last_became_peered":"2023-12-16T03:28:12.797907+0000","last_unstale":"2023-12-16T03:28:12.812345+0000","last_undegraded":"2023-12-16T03:28:12.812345+0000","last_fullsized":"2023-12-16T03:28:12.812345+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:22.570453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.794322+0000","last_change":"2023-12-16T03:28:11.793820+0000","last_active":"2023-12-16T03:28:12.794322+0000","last_peered":"2023-12-16T03:28:12.794322+0000","last_clean":"2023-12-16T03:28:12.794322+0000","last_became_active":"2023-12-16T03:28:11.793529+0000","last_became_peered":"2023-12-16T03:28:11.793529+0000","last_unstale":"2023-12-16T03:28:12.794322+0000","last_undegraded":"2023-12-16T03:28:12.794322+0000","last_fullsized":"2023-12-16T03:28:12.794322+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:44.401345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782069+0000","last_change":"2023-12-16T03:27:59.734193+0000","last_active":"2023-12-16T03:28:11.782069+0000","last_peered":"2023-12-16T03:28:11.782069+0000","last_clean":"2023-12-16T03:28:11.782069+0000","last_became_active":"2023-12-16T03:27:59.733906+0000","last_became_peered":"2023-12-16T03:27:59.733906+0000","last_unstale":"2023-12-16T03:28:11.782069+0000","last_undegraded":"2023-12-16T03:28:11.782069+0000","last_fullsized":"2023-12-16T03:28:11.782069+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:27:07.594429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768051+0000","last_change":"2023-12-16T03:27:58.722406+0000","last_active":"2023-12-16T03:28:11.768051+0000","last_peered":"2023-12-16T03:28:11.768051+0000","last_clean":"2023-12-16T03:28:11.768051+0000","last_became_active":"2023-12-16T03:27:58.722107+0000","last_became_peered":"2023-12-16T03:27:58.722107+0000","last_unstale":"2023-12-16T03:28:11.768051+0000","last_undegraded":"2023-12-16T03:28:11.768051+0000","last_fullsized":"2023-12-16T03:28:11.768051+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:27:42.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818672+0000","last_change":"2023-12-16T03:28:12.807087+0000","last_active":"2023-12-16T03:28:12.818672+0000","last_peered":"2023-12-16T03:28:12.818672+0000","last_clean":"2023-12-16T03:28:12.818672+0000","last_became_active":"2023-12-16T03:28:12.806613+0000","last_became_peered":"2023-12-16T03:28:12.806613+0000","last_unstale":"2023-12-16T03:28:12.818672+0000","last_undegraded":"2023-12-16T03:28:12.818672+0000","last_fullsized":"2023-12-16T03:28:12.818672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.175468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.781701+0000","last_change":"2023-12-16T03:28:11.793806+0000","last_active":"2023-12-16T03:28:12.781701+0000","last_peered":"2023-12-16T03:28:12.781701+0000","last_clean":"2023-12-16T03:28:12.781701+0000","last_became_active":"2023-12-16T03:28:11.792942+0000","last_became_peered":"2023-12-16T03:28:11.792942+0000","last_unstale":"2023-12-16T03:28:12.781701+0000","last_undegraded":"2023-12-16T03:28:12.781701+0000","last_fullsized":"2023-12-16T03:28:12.781701+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:19:54.863132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767890+0000","last_change":"2023-12-16T03:27:59.733566+0000","last_active":"2023-12-16T03:28:11.767890+0000","last_peered":"2023-12-16T03:28:11.767890+0000","last_clean":"2023-12-16T03:28:11.767890+0000","last_became_active":"2023-12-16T03:27:59.733308+0000","last_became_peered":"2023-12-16T03:27:59.733308+0000","last_unstale":"2023-12-16T03:28:11.767890+0000","last_undegraded":"2023-12-16T03:28:11.767890+0000","last_fullsized":"2023-12-16T03:28:11.767890+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:20:58.921708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768095+0000","last_change":"2023-12-16T03:27:58.717341+0000","last_active":"2023-12-16T03:28:11.768095+0000","last_peered":"2023-12-16T03:28:11.768095+0000","last_clean":"2023-12-16T03:28:11.768095+0000","last_became_active":"2023-12-16T03:27:58.717037+0000","last_became_peered":"2023-12-16T03:27:58.717037+0000","last_unstale":"2023-12-16T03:28:11.768095+0000","last_undegraded":"2023-12-16T03:28:11.768095+0000","last_fullsized":"2023-12-16T03:28:11.768095+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:26:30.859183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.813584+0000","last_change":"2023-12-16T03:28:12.811683+0000","last_active":"2023-12-16T03:28:12.813584+0000","last_peered":"2023-12-16T03:28:12.813584+0000","last_clean":"2023-12-16T03:28:12.813584+0000","last_became_active":"2023-12-16T03:28:12.811042+0000","last_became_peered":"2023-12-16T03:28:12.811042+0000","last_unstale":"2023-12-16T03:28:12.813584+0000","last_undegraded":"2023-12-16T03:28:12.813584+0000","last_fullsized":"2023-12-16T03:28:12.813584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:52.019367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.820374+0000","last_change":"2023-12-16T03:28:11.786803+0000","last_active":"2023-12-16T03:28:12.820374+0000","last_peered":"2023-12-16T03:28:12.820374+0000","last_clean":"2023-12-16T03:28:12.820374+0000","last_became_active":"2023-12-16T03:28:11.786512+0000","last_became_peered":"2023-12-16T03:28:11.786512+0000","last_unstale":"2023-12-16T03:28:12.820374+0000","last_undegraded":"2023-12-16T03:28:12.820374+0000","last_fullsized":"2023-12-16T03:28:12.820374+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:23:07.072921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.775313+0000","last_change":"2023-12-16T03:27:59.723598+0000","last_active":"2023-12-16T03:28:11.775313+0000","last_peered":"2023-12-16T03:28:11.775313+0000","last_clean":"2023-12-16T03:28:11.775313+0000","last_became_active":"2023-12-16T03:27:59.723319+0000","last_became_peered":"2023-12-16T03:27:59.723319+0000","last_unstale":"2023-12-16T03:28:11.775313+0000","last_undegraded":"2023-12-16T03:28:11.775313+0000","last_fullsized":"2023-12-16T03:28:11.775313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:45.169228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.764871+0000","last_change":"2023-12-16T03:27:58.703166+0000","last_active":"2023-12-16T03:28:11.764871+0000","last_peered":"2023-12-16T03:28:11.764871+0000","last_clean":"2023-12-16T03:28:11.764871+0000","last_became_active":"2023-12-16T03:27:58.702889+0000","last_became_peered":"2023-12-16T03:27:58.702889+0000","last_unstale":"2023-12-16T03:28:11.764871+0000","last_undegraded":"2023-12-16T03:28:11.764871+0000","last_fullsized":"2023-12-16T03:28:11.764871+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:19:41.787545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817730+0000","last_change":"2023-12-16T03:28:12.815614+0000","last_active":"2023-12-16T03:28:12.817730+0000","last_peered":"2023-12-16T03:28:12.817730+0000","last_clean":"2023-12-16T03:28:12.817730+0000","last_became_active":"2023-12-16T03:28:12.815287+0000","last_became_peered":"2023-12-16T03:28:12.815287+0000","last_unstale":"2023-12-16T03:28:12.817730+0000","last_undegraded":"2023-12-16T03:28:12.817730+0000","last_fullsized":"2023-12-16T03:28:12.817730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:42:42.681540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827341+0000","last_change":"2023-12-16T03:28:11.790770+0000","last_active":"2023-12-16T03:28:12.827341+0000","last_peered":"2023-12-16T03:28:12.827341+0000","last_clean":"2023-12-16T03:28:12.827341+0000","last_became_active":"2023-12-16T03:28:11.790335+0000","last_became_peered":"2023-12-16T03:28:11.790335+0000","last_unstale":"2023-12-16T03:28:12.827341+0000","last_undegraded":"2023-12-16T03:28:12.827341+0000","last_fullsized":"2023-12-16T03:28:12.827341+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:24:49.221477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.780237+0000","last_change":"2023-12-16T03:27:59.718875+0000","last_active":"2023-12-16T03:28:11.780237+0000","last_peered":"2023-12-16T03:28:11.780237+0000","last_clean":"2023-12-16T03:28:11.780237+0000","last_became_active":"2023-12-16T03:27:59.718513+0000","last_became_peered":"2023-12-16T03:27:59.718513+0000","last_unstale":"2023-12-16T03:28:11.780237+0000","last_undegraded":"2023-12-16T03:28:11.780237+0000","last_fullsized":"2023-12-16T03:28:11.780237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:20.215362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782490+0000","last_change":"2023-12-16T03:27:58.723547+0000","last_active":"2023-12-16T03:28:11.782490+0000","last_peered":"2023-12-16T03:28:11.782490+0000","last_clean":"2023-12-16T03:28:11.782490+0000","last_became_active":"2023-12-16T03:27:58.723244+0000","last_became_peered":"2023-12-16T03:27:58.723244+0000","last_unstale":"2023-12-16T03:28:11.782490+0000","last_undegraded":"2023-12-16T03:28:11.782490+0000","last_fullsized":"2023-12-16T03:28:11.782490+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:50.819935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819057+0000","last_change":"2023-12-16T03:28:12.814953+0000","last_active":"2023-12-16T03:28:12.819057+0000","last_peered":"2023-12-16T03:28:12.819057+0000","last_clean":"2023-12-16T03:28:12.819057+0000","last_became_active":"2023-12-16T03:28:12.813413+0000","last_became_peered":"2023-12-16T03:28:12.813413+0000","last_unstale":"2023-12-16T03:28:12.819057+0000","last_undegraded":"2023-12-16T03:28:12.819057+0000","last_fullsized":"2023-12-16T03:28:12.819057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.175468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"71'3","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823455+0000","last_change":"2023-12-16T03:28:11.787108+0000","last_active":"2023-12-16T03:28:12.823455+0000","last_peered":"2023-12-16T03:28:12.823455+0000","last_clean":"2023-12-16T03:28:12.823455+0000","last_became_active":"2023-12-16T03:28:11.786653+0000","last_became_peered":"2023-12-16T03:28:11.786653+0000","last_unstale":"2023-12-16T03:28:12.823455+0000","last_undegraded":"2023-12-16T03:28:12.823455+0000","last_fullsized":"2023-12-16T03:28:12.823455+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:22:57.123345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.777367+0000","last_change":"2023-12-16T03:27:59.717795+0000","last_active":"2023-12-16T03:28:11.777367+0000","last_peered":"2023-12-16T03:28:11.777367+0000","last_clean":"2023-12-16T03:28:11.777367+0000","last_became_active":"2023-12-16T03:27:59.717470+0000","last_became_peered":"2023-12-16T03:27:59.717470+0000","last_unstale":"2023-12-16T03:28:11.777367+0000","last_undegraded":"2023-12-16T03:28:11.777367+0000","last_fullsized":"2023-12-16T03:28:11.777367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:10.829694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781437+0000","last_change":"2023-12-16T03:27:58.717293+0000","last_active":"2023-12-16T03:28:11.781437+0000","last_peered":"2023-12-16T03:28:11.781437+0000","last_clean":"2023-12-16T03:28:11.781437+0000","last_became_active":"2023-12-16T03:27:58.716996+0000","last_became_peered":"2023-12-16T03:27:58.716996+0000","last_unstale":"2023-12-16T03:28:11.781437+0000","last_undegraded":"2023-12-16T03:28:11.781437+0000","last_fullsized":"2023-12-16T03:28:11.781437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:42.424788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.831151+0000","last_change":"2023-12-16T03:28:12.827156+0000","last_active":"2023-12-16T03:28:12.831151+0000","last_peered":"2023-12-16T03:28:12.831151+0000","last_clean":"2023-12-16T03:28:12.831151+0000","last_became_active":"2023-12-16T03:28:12.826829+0000","last_became_peered":"2023-12-16T03:28:12.826829+0000","last_unstale":"2023-12-16T03:28:12.831151+0000","last_undegraded":"2023-12-16T03:28:12.831151+0000","last_fullsized":"2023-12-16T03:28:12.831151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:24:50.227951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"71'6","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.829719+0000","last_change":"2023-12-16T03:28:11.790693+0000","last_active":"2023-12-16T03:28:12.829719+0000","last_peered":"2023-12-16T03:28:12.829719+0000","last_clean":"2023-12-16T03:28:12.829719+0000","last_became_active":"2023-12-16T03:28:11.790311+0000","last_became_peered":"2023-12-16T03:28:11.790311+0000","last_unstale":"2023-12-16T03:28:12.829719+0000","last_undegraded":"2023-12-16T03:28:12.829719+0000","last_fullsized":"2023-12-16T03:28:12.829719+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:51:37.451472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769446+0000","last_change":"2023-12-16T03:27:59.734554+0000","last_active":"2023-12-16T03:28:11.769446+0000","last_peered":"2023-12-16T03:28:11.769446+0000","last_clean":"2023-12-16T03:28:11.769446+0000","last_became_active":"2023-12-16T03:27:59.734106+0000","last_became_peered":"2023-12-16T03:27:59.734106+0000","last_unstale":"2023-12-16T03:28:11.769446+0000","last_undegraded":"2023-12-16T03:28:11.769446+0000","last_fullsized":"2023-12-16T03:28:11.769446+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:45.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781878+0000","last_change":"2023-12-16T03:27:58.711663+0000","last_active":"2023-12-16T03:28:11.781878+0000","last_peered":"2023-12-16T03:28:11.781878+0000","last_clean":"2023-12-16T03:28:11.781878+0000","last_became_active":"2023-12-16T03:27:58.711356+0000","last_became_peered":"2023-12-16T03:27:58.711356+0000","last_unstale":"2023-12-16T03:28:11.781878+0000","last_undegraded":"2023-12-16T03:28:11.781878+0000","last_fullsized":"2023-12-16T03:28:11.781878+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:05.338626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827449+0000","last_change":"2023-12-16T03:28:12.821986+0000","last_active":"2023-12-16T03:28:12.827449+0000","last_peered":"2023-12-16T03:28:12.827449+0000","last_clean":"2023-12-16T03:28:12.827449+0000","last_became_active":"2023-12-16T03:28:12.821621+0000","last_became_peered":"2023-12-16T03:28:12.821621+0000","last_unstale":"2023-12-16T03:28:12.827449+0000","last_undegraded":"2023-12-16T03:28:12.827449+0000","last_fullsized":"2023-12-16T03:28:12.827449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:22:58.129819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.785338+0000","last_change":"2023-12-16T03:28:11.788902+0000","last_active":"2023-12-16T03:28:12.785338+0000","last_peered":"2023-12-16T03:28:12.785338+0000","last_clean":"2023-12-16T03:28:12.785338+0000","last_became_active":"2023-12-16T03:28:11.788217+0000","last_became_peered":"2023-12-16T03:28:11.788217+0000","last_unstale":"2023-12-16T03:28:12.785338+0000","last_undegraded":"2023-12-16T03:28:12.785338+0000","last_fullsized":"2023-12-16T03:28:12.785338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:33.441623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765672+0000","last_change":"2023-12-16T03:27:59.727694+0000","last_active":"2023-12-16T03:28:11.765672+0000","last_peered":"2023-12-16T03:28:11.765672+0000","last_clean":"2023-12-16T03:28:11.765672+0000","last_became_active":"2023-12-16T03:27:59.727388+0000","last_became_peered":"2023-12-16T03:27:59.727388+0000","last_unstale":"2023-12-16T03:28:11.765672+0000","last_undegraded":"2023-12-16T03:28:11.765672+0000","last_fullsized":"2023-12-16T03:28:11.765672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:06:37.917845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779041+0000","last_change":"2023-12-16T03:27:58.716440+0000","last_active":"2023-12-16T03:28:11.779041+0000","last_peered":"2023-12-16T03:28:11.779041+0000","last_clean":"2023-12-16T03:28:11.779041+0000","last_became_active":"2023-12-16T03:27:58.716067+0000","last_became_peered":"2023-12-16T03:27:58.716067+0000","last_unstale":"2023-12-16T03:28:11.779041+0000","last_undegraded":"2023-12-16T03:28:11.779041+0000","last_fullsized":"2023-12-16T03:28:11.779041+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:27:06.586039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819682+0000","last_change":"2023-12-16T03:28:12.805703+0000","last_active":"2023-12-16T03:28:12.819682+0000","last_peered":"2023-12-16T03:28:12.819682+0000","last_clean":"2023-12-16T03:28:12.819682+0000","last_became_active":"2023-12-16T03:28:12.802612+0000","last_became_peered":"2023-12-16T03:28:12.802612+0000","last_unstale":"2023-12-16T03:28:12.819682+0000","last_undegraded":"2023-12-16T03:28:12.819682+0000","last_fullsized":"2023-12-16T03:28:12.819682+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:08:14.864292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.795148+0000","last_change":"2023-12-16T03:28:11.797743+0000","last_active":"2023-12-16T03:28:12.795148+0000","last_peered":"2023-12-16T03:28:12.795148+0000","last_clean":"2023-12-16T03:28:12.795148+0000","last_became_active":"2023-12-16T03:28:11.797125+0000","last_became_peered":"2023-12-16T03:28:11.797125+0000","last_unstale":"2023-12-16T03:28:12.795148+0000","last_undegraded":"2023-12-16T03:28:12.795148+0000","last_fullsized":"2023-12-16T03:28:12.795148+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:22:57.123345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768166+0000","last_change":"2023-12-16T03:27:59.724678+0000","last_active":"2023-12-16T03:28:11.768166+0000","last_peered":"2023-12-16T03:28:11.768166+0000","last_clean":"2023-12-16T03:28:11.768166+0000","last_became_active":"2023-12-16T03:27:59.724328+0000","last_became_peered":"2023-12-16T03:27:59.724328+0000","last_unstale":"2023-12-16T03:28:11.768166+0000","last_undegraded":"2023-12-16T03:28:11.768166+0000","last_fullsized":"2023-12-16T03:28:11.768166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:43.433178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767841+0000","last_change":"2023-12-16T03:27:58.716691+0000","last_active":"2023-12-16T03:28:11.767841+0000","last_peered":"2023-12-16T03:28:11.767841+0000","last_clean":"2023-12-16T03:28:11.767841+0000","last_became_active":"2023-12-16T03:27:58.716447+0000","last_became_peered":"2023-12-16T03:27:58.716447+0000","last_unstale":"2023-12-16T03:28:11.767841+0000","last_undegraded":"2023-12-16T03:28:11.767841+0000","last_fullsized":"2023-12-16T03:28:11.767841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:27:42.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.810165+0000","last_change":"2023-12-16T03:28:12.798613+0000","last_active":"2023-12-16T03:28:12.810165+0000","last_peered":"2023-12-16T03:28:12.810165+0000","last_clean":"2023-12-16T03:28:12.810165+0000","last_became_active":"2023-12-16T03:28:12.798309+0000","last_became_peered":"2023-12-16T03:28:12.798309+0000","last_unstale":"2023-12-16T03:28:12.810165+0000","last_undegraded":"2023-12-16T03:28:12.810165+0000","last_fullsized":"2023-12-16T03:28:12.810165+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:23.903366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.787625+0000","last_change":"2023-12-16T03:28:11.780708+0000","last_active":"2023-12-16T03:28:12.787625+0000","last_peered":"2023-12-16T03:28:12.787625+0000","last_clean":"2023-12-16T03:28:12.787625+0000","last_became_active":"2023-12-16T03:28:11.780418+0000","last_became_peered":"2023-12-16T03:28:11.780418+0000","last_unstale":"2023-12-16T03:28:12.787625+0000","last_undegraded":"2023-12-16T03:28:12.787625+0000","last_fullsized":"2023-12-16T03:28:12.787625+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:07.862721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765074+0000","last_change":"2023-12-16T03:27:59.719384+0000","last_active":"2023-12-16T03:28:11.765074+0000","last_peered":"2023-12-16T03:28:11.765074+0000","last_clean":"2023-12-16T03:28:11.765074+0000","last_became_active":"2023-12-16T03:27:59.718520+0000","last_became_peered":"2023-12-16T03:27:59.718520+0000","last_unstale":"2023-12-16T03:28:11.765074+0000","last_undegraded":"2023-12-16T03:28:11.765074+0000","last_fullsized":"2023-12-16T03:28:11.765074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:40.409035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781910+0000","last_change":"2023-12-16T03:27:58.721903+0000","last_active":"2023-12-16T03:28:11.781910+0000","last_peered":"2023-12-16T03:28:11.781910+0000","last_clean":"2023-12-16T03:28:11.781910+0000","last_became_active":"2023-12-16T03:27:58.721611+0000","last_became_peered":"2023-12-16T03:27:58.721611+0000","last_unstale":"2023-12-16T03:28:11.781910+0000","last_undegraded":"2023-12-16T03:28:11.781910+0000","last_fullsized":"2023-12-16T03:28:11.781910+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:08:43.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.805698+0000","last_change":"2023-12-16T03:28:12.796247+0000","last_active":"2023-12-16T03:28:12.805698+0000","last_peered":"2023-12-16T03:28:12.805698+0000","last_clean":"2023-12-16T03:28:12.805698+0000","last_became_active":"2023-12-16T03:28:12.795955+0000","last_became_peered":"2023-12-16T03:28:12.795955+0000","last_unstale":"2023-12-16T03:28:12.805698+0000","last_undegraded":"2023-12-16T03:28:12.805698+0000","last_fullsized":"2023-12-16T03:28:12.805698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:53:19.206136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"71'8","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.829423+0000","last_change":"2023-12-16T03:28:11.787013+0000","last_active":"2023-12-16T03:28:12.829423+0000","last_peered":"2023-12-16T03:28:12.829423+0000","last_clean":"2023-12-16T03:28:12.829423+0000","last_became_active":"2023-12-16T03:28:11.786697+0000","last_became_peered":"2023-12-16T03:28:11.786697+0000","last_unstale":"2023-12-16T03:28:12.829423+0000","last_undegraded":"2023-12-16T03:28:12.829423+0000","last_fullsized":"2023-12-16T03:28:12.829423+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:55:49.760534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779459+0000","last_change":"2023-12-16T03:27:59.723346+0000","last_active":"2023-12-16T03:28:11.779459+0000","last_peered":"2023-12-16T03:28:11.779459+0000","last_clean":"2023-12-16T03:28:11.779459+0000","last_became_active":"2023-12-16T03:27:59.722968+0000","last_became_peered":"2023-12-16T03:27:59.722968+0000","last_unstale":"2023-12-16T03:28:11.779459+0000","last_undegraded":"2023-12-16T03:28:11.779459+0000","last_fullsized":"2023-12-16T03:28:11.779459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:40:30.607572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779646+0000","last_change":"2023-12-16T03:27:58.724631+0000","last_active":"2023-12-16T03:28:11.779646+0000","last_peered":"2023-12-16T03:28:11.779646+0000","last_clean":"2023-12-16T03:28:11.779646+0000","last_became_active":"2023-12-16T03:27:58.724267+0000","last_became_peered":"2023-12-16T03:27:58.724267+0000","last_unstale":"2023-12-16T03:28:11.779646+0000","last_undegraded":"2023-12-16T03:28:11.779646+0000","last_fullsized":"2023-12-16T03:28:11.779646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:08:00.782230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819256+0000","last_change":"2023-12-16T03:28:12.813577+0000","last_active":"2023-12-16T03:28:12.819256+0000","last_peered":"2023-12-16T03:28:12.819256+0000","last_clean":"2023-12-16T03:28:12.819256+0000","last_became_active":"2023-12-16T03:28:12.813252+0000","last_became_peered":"2023-12-16T03:28:12.813252+0000","last_unstale":"2023-12-16T03:28:12.819256+0000","last_undegraded":"2023-12-16T03:28:12.819256+0000","last_fullsized":"2023-12-16T03:28:12.819256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:11:01.580361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823785+0000","last_change":"2023-12-16T03:28:11.783296+0000","last_active":"2023-12-16T03:28:12.823785+0000","last_peered":"2023-12-16T03:28:12.823785+0000","last_clean":"2023-12-16T03:28:12.823785+0000","last_became_active":"2023-12-16T03:28:11.782974+0000","last_became_peered":"2023-12-16T03:28:11.782974+0000","last_unstale":"2023-12-16T03:28:12.823785+0000","last_undegraded":"2023-12-16T03:28:12.823785+0000","last_fullsized":"2023-12-16T03:28:12.823785+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:37.800163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782349+0000","last_change":"2023-12-16T03:27:59.735336+0000","last_active":"2023-12-16T03:28:11.782349+0000","last_peered":"2023-12-16T03:28:11.782349+0000","last_clean":"2023-12-16T03:28:11.782349+0000","last_became_active":"2023-12-16T03:27:59.735041+0000","last_became_peered":"2023-12-16T03:27:59.735041+0000","last_unstale":"2023-12-16T03:28:11.782349+0000","last_undegraded":"2023-12-16T03:28:11.782349+0000","last_fullsized":"2023-12-16T03:28:11.782349+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:11.022363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767102+0000","last_change":"2023-12-16T03:27:58.707831+0000","last_active":"2023-12-16T03:28:11.767102+0000","last_peered":"2023-12-16T03:28:11.767102+0000","last_clean":"2023-12-16T03:28:11.767102+0000","last_became_active":"2023-12-16T03:27:58.707542+0000","last_became_peered":"2023-12-16T03:27:58.707542+0000","last_unstale":"2023-12-16T03:28:11.767102+0000","last_undegraded":"2023-12-16T03:28:11.767102+0000","last_fullsized":"2023-12-16T03:28:11.767102+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:01:08.706369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.826095+0000","last_change":"2023-12-16T03:28:12.822342+0000","last_active":"2023-12-16T03:28:12.826095+0000","last_peered":"2023-12-16T03:28:12.826095+0000","last_clean":"2023-12-16T03:28:12.826095+0000","last_became_active":"2023-12-16T03:28:12.822033+0000","last_became_peered":"2023-12-16T03:28:12.822033+0000","last_unstale":"2023-12-16T03:28:12.826095+0000","last_undegraded":"2023-12-16T03:28:12.826095+0000","last_fullsized":"2023-12-16T03:28:12.826095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:56.506850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.795143+0000","last_change":"2023-12-16T03:28:11.793479+0000","last_active":"2023-12-16T03:28:12.795143+0000","last_peered":"2023-12-16T03:28:12.795143+0000","last_clean":"2023-12-16T03:28:12.795143+0000","last_became_active":"2023-12-16T03:28:11.793190+0000","last_became_peered":"2023-12-16T03:28:11.793190+0000","last_unstale":"2023-12-16T03:28:12.795143+0000","last_undegraded":"2023-12-16T03:28:12.795143+0000","last_fullsized":"2023-12-16T03:28:12.795143+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:15:26.793633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.780837+0000","last_change":"2023-12-16T03:27:59.720229+0000","last_active":"2023-12-16T03:28:11.780837+0000","last_peered":"2023-12-16T03:28:11.780837+0000","last_clean":"2023-12-16T03:28:11.780837+0000","last_became_active":"2023-12-16T03:27:59.719927+0000","last_became_peered":"2023-12-16T03:27:59.719927+0000","last_unstale":"2023-12-16T03:28:11.780837+0000","last_undegraded":"2023-12-16T03:28:11.780837+0000","last_fullsized":"2023-12-16T03:28:11.780837+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:16.254698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.764633+0000","last_change":"2023-12-16T03:27:58.713349+0000","last_active":"2023-12-16T03:28:11.764633+0000","last_peered":"2023-12-16T03:28:11.764633+0000","last_clean":"2023-12-16T03:28:11.764633+0000","last_became_active":"2023-12-16T03:27:58.712977+0000","last_became_peered":"2023-12-16T03:27:58.712977+0000","last_unstale":"2023-12-16T03:28:11.764633+0000","last_undegraded":"2023-12-16T03:28:11.764633+0000","last_fullsized":"2023-12-16T03:28:11.764633+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:56.126328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.812014+0000","last_change":"2023-12-16T03:28:12.804785+0000","last_active":"2023-12-16T03:28:12.812014+0000","last_peered":"2023-12-16T03:28:12.812014+0000","last_clean":"2023-12-16T03:28:12.812014+0000","last_became_active":"2023-12-16T03:28:12.804514+0000","last_became_peered":"2023-12-16T03:28:12.804514+0000","last_unstale":"2023-12-16T03:28:12.812014+0000","last_undegraded":"2023-12-16T03:28:12.812014+0000","last_fullsized":"2023-12-16T03:28:12.812014+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:48:49.851057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.809633+0000","last_change":"2023-12-16T03:28:11.777911+0000","last_active":"2023-12-16T03:28:12.809633+0000","last_peered":"2023-12-16T03:28:12.809633+0000","last_clean":"2023-12-16T03:28:12.809633+0000","last_became_active":"2023-12-16T03:28:11.777600+0000","last_became_peered":"2023-12-16T03:28:11.777600+0000","last_unstale":"2023-12-16T03:28:12.809633+0000","last_undegraded":"2023-12-16T03:28:12.809633+0000","last_fullsized":"2023-12-16T03:28:12.809633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:29:56.885065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782694+0000","last_change":"2023-12-16T03:27:59.713056+0000","last_active":"2023-12-16T03:28:11.782694+0000","last_peered":"2023-12-16T03:28:11.782694+0000","last_clean":"2023-12-16T03:28:11.782694+0000","last_became_active":"2023-12-16T03:27:59.712760+0000","last_became_peered":"2023-12-16T03:27:59.712760+0000","last_unstale":"2023-12-16T03:28:11.782694+0000","last_undegraded":"2023-12-16T03:28:11.782694+0000","last_fullsized":"2023-12-16T03:28:11.782694+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:46.650579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781575+0000","last_change":"2023-12-16T03:27:58.710741+0000","last_active":"2023-12-16T03:28:11.781575+0000","last_peered":"2023-12-16T03:28:11.781575+0000","last_clean":"2023-12-16T03:28:11.781575+0000","last_became_active":"2023-12-16T03:27:58.710391+0000","last_became_peered":"2023-12-16T03:27:58.710391+0000","last_unstale":"2023-12-16T03:28:11.781575+0000","last_undegraded":"2023-12-16T03:28:11.781575+0000","last_fullsized":"2023-12-16T03:28:11.781575+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:44.133983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.825997+0000","last_change":"2023-12-16T03:28:12.821036+0000","last_active":"2023-12-16T03:28:12.825997+0000","last_peered":"2023-12-16T03:28:12.825997+0000","last_clean":"2023-12-16T03:28:12.825997+0000","last_became_active":"2023-12-16T03:28:12.819929+0000","last_became_peered":"2023-12-16T03:28:12.819929+0000","last_unstale":"2023-12-16T03:28:12.825997+0000","last_undegraded":"2023-12-16T03:28:12.825997+0000","last_fullsized":"2023-12-16T03:28:12.825997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.407819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.792711+0000","last_change":"2023-12-16T03:28:11.783906+0000","last_active":"2023-12-16T03:28:12.792711+0000","last_peered":"2023-12-16T03:28:12.792711+0000","last_clean":"2023-12-16T03:28:12.792711+0000","last_became_active":"2023-12-16T03:28:11.780954+0000","last_became_peered":"2023-12-16T03:28:11.780954+0000","last_unstale":"2023-12-16T03:28:12.792711+0000","last_undegraded":"2023-12-16T03:28:12.792711+0000","last_fullsized":"2023-12-16T03:28:12.792711+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:29:56.885065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781257+0000","last_change":"2023-12-16T03:27:59.719682+0000","last_active":"2023-12-16T03:28:11.781257+0000","last_peered":"2023-12-16T03:28:11.781257+0000","last_clean":"2023-12-16T03:28:11.781257+0000","last_became_active":"2023-12-16T03:27:59.719285+0000","last_became_peered":"2023-12-16T03:27:59.719285+0000","last_unstale":"2023-12-16T03:28:11.781257+0000","last_undegraded":"2023-12-16T03:28:11.781257+0000","last_fullsized":"2023-12-16T03:28:11.781257+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:34.741103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.766155+0000","last_change":"2023-12-16T03:27:58.714603+0000","last_active":"2023-12-16T03:28:11.766155+0000","last_peered":"2023-12-16T03:28:11.766155+0000","last_clean":"2023-12-16T03:28:11.766155+0000","last_became_active":"2023-12-16T03:27:58.714204+0000","last_became_peered":"2023-12-16T03:27:58.714204+0000","last_unstale":"2023-12-16T03:28:11.766155+0000","last_undegraded":"2023-12-16T03:28:11.766155+0000","last_fullsized":"2023-12-16T03:28:11.766155+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:53.997333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819090+0000","last_change":"2023-12-16T03:28:12.815214+0000","last_active":"2023-12-16T03:28:12.819090+0000","last_peered":"2023-12-16T03:28:12.819090+0000","last_clean":"2023-12-16T03:28:12.819090+0000","last_became_active":"2023-12-16T03:28:12.813475+0000","last_became_peered":"2023-12-16T03:28:12.813475+0000","last_unstale":"2023-12-16T03:28:12.819090+0000","last_undegraded":"2023-12-16T03:28:12.819090+0000","last_fullsized":"2023-12-16T03:28:12.819090+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:11:01.580361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818879+0000","last_change":"2023-12-16T03:28:11.789226+0000","last_active":"2023-12-16T03:28:12.818879+0000","last_peered":"2023-12-16T03:28:12.818879+0000","last_clean":"2023-12-16T03:28:12.818879+0000","last_became_active":"2023-12-16T03:28:11.787749+0000","last_became_peered":"2023-12-16T03:28:11.787749+0000","last_unstale":"2023-12-16T03:28:12.818879+0000","last_undegraded":"2023-12-16T03:28:12.818879+0000","last_fullsized":"2023-12-16T03:28:12.818879+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:23:19.825675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768204+0000","last_change":"2023-12-16T03:27:59.712998+0000","last_active":"2023-12-16T03:28:11.768204+0000","last_peered":"2023-12-16T03:28:11.768204+0000","last_clean":"2023-12-16T03:28:11.768204+0000","last_became_active":"2023-12-16T03:27:59.712032+0000","last_became_peered":"2023-12-16T03:27:59.712032+0000","last_unstale":"2023-12-16T03:28:11.768204+0000","last_undegraded":"2023-12-16T03:28:11.768204+0000","last_fullsized":"2023-12-16T03:28:11.768204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:45.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765894+0000","last_change":"2023-12-16T03:27:58.703925+0000","last_active":"2023-12-16T03:28:11.765894+0000","last_peered":"2023-12-16T03:28:11.765894+0000","last_clean":"2023-12-16T03:28:11.765894+0000","last_became_active":"2023-12-16T03:27:58.703623+0000","last_became_peered":"2023-12-16T03:27:58.703623+0000","last_unstale":"2023-12-16T03:28:11.765894+0000","last_undegraded":"2023-12-16T03:28:11.765894+0000","last_fullsized":"2023-12-16T03:28:11.765894+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:32.257742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817043+0000","last_change":"2023-12-16T03:28:12.807536+0000","last_active":"2023-12-16T03:28:12.817043+0000","last_peered":"2023-12-16T03:28:12.817043+0000","last_clean":"2023-12-16T03:28:12.817043+0000","last_became_active":"2023-12-16T03:28:12.803921+0000","last_became_peered":"2023-12-16T03:28:12.803921+0000","last_unstale":"2023-12-16T03:28:12.817043+0000","last_undegraded":"2023-12-16T03:28:12.817043+0000","last_fullsized":"2023-12-16T03:28:12.817043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:20:07.023742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.787193+0000","last_change":"2023-12-16T03:28:11.790069+0000","last_active":"2023-12-16T03:28:12.787193+0000","last_peered":"2023-12-16T03:28:12.787193+0000","last_clean":"2023-12-16T03:28:12.787193+0000","last_became_active":"2023-12-16T03:28:11.789694+0000","last_became_peered":"2023-12-16T03:28:11.789694+0000","last_unstale":"2023-12-16T03:28:12.787193+0000","last_undegraded":"2023-12-16T03:28:12.787193+0000","last_fullsized":"2023-12-16T03:28:12.787193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:02.323978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779846+0000","last_change":"2023-12-16T03:27:59.740195+0000","last_active":"2023-12-16T03:28:11.779846+0000","last_peered":"2023-12-16T03:28:11.779846+0000","last_clean":"2023-12-16T03:28:11.779846+0000","last_became_active":"2023-12-16T03:27:59.739697+0000","last_became_peered":"2023-12-16T03:27:59.739697+0000","last_unstale":"2023-12-16T03:28:11.779846+0000","last_undegraded":"2023-12-16T03:28:11.779846+0000","last_fullsized":"2023-12-16T03:28:11.779846+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:12:40.578081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781188+0000","last_change":"2023-12-16T03:27:58.719438+0000","last_active":"2023-12-16T03:28:11.781188+0000","last_peered":"2023-12-16T03:28:11.781188+0000","last_clean":"2023-12-16T03:28:11.781188+0000","last_became_active":"2023-12-16T03:27:58.719140+0000","last_became_peered":"2023-12-16T03:27:58.719140+0000","last_unstale":"2023-12-16T03:28:11.781188+0000","last_undegraded":"2023-12-16T03:28:11.781188+0000","last_fullsized":"2023-12-16T03:28:11.781188+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:45.642189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.814101+0000","last_change":"2023-12-16T03:28:12.811060+0000","last_active":"2023-12-16T03:28:12.814101+0000","last_peered":"2023-12-16T03:28:12.814101+0000","last_clean":"2023-12-16T03:28:12.814101+0000","last_became_active":"2023-12-16T03:28:12.810766+0000","last_became_peered":"2023-12-16T03:28:12.810766+0000","last_unstale":"2023-12-16T03:28:12.814101+0000","last_undegraded":"2023-12-16T03:28:12.814101+0000","last_fullsized":"2023-12-16T03:28:12.814101+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.905635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.793018+0000","last_change":"2023-12-16T03:28:11.792840+0000","last_active":"2023-12-16T03:28:12.793018+0000","last_peered":"2023-12-16T03:28:12.793018+0000","last_clean":"2023-12-16T03:28:12.793018+0000","last_became_active":"2023-12-16T03:28:11.792525+0000","last_became_peered":"2023-12-16T03:28:11.792525+0000","last_unstale":"2023-12-16T03:28:12.793018+0000","last_undegraded":"2023-12-16T03:28:12.793018+0000","last_fullsized":"2023-12-16T03:28:12.793018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:03:47.032812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767098+0000","last_change":"2023-12-16T03:27:59.725032+0000","last_active":"2023-12-16T03:28:11.767098+0000","last_peered":"2023-12-16T03:28:11.767098+0000","last_clean":"2023-12-16T03:28:11.767098+0000","last_became_active":"2023-12-16T03:27:59.724136+0000","last_became_peered":"2023-12-16T03:27:59.724136+0000","last_unstale":"2023-12-16T03:28:11.767098+0000","last_undegraded":"2023-12-16T03:28:11.767098+0000","last_fullsized":"2023-12-16T03:28:11.767098+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:55:37.693337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779938+0000","last_change":"2023-12-16T03:27:58.714711+0000","last_active":"2023-12-16T03:28:11.779938+0000","last_peered":"2023-12-16T03:28:11.779938+0000","last_clean":"2023-12-16T03:28:11.779938+0000","last_became_active":"2023-12-16T03:27:58.714425+0000","last_became_peered":"2023-12-16T03:27:58.714425+0000","last_unstale":"2023-12-16T03:28:11.779938+0000","last_undegraded":"2023-12-16T03:28:11.779938+0000","last_fullsized":"2023-12-16T03:28:11.779938+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:46.678443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.821143+0000","last_change":"2023-12-16T03:28:12.817601+0000","last_active":"2023-12-16T03:28:12.821143+0000","last_peered":"2023-12-16T03:28:12.821143+0000","last_clean":"2023-12-16T03:28:12.821143+0000","last_became_active":"2023-12-16T03:28:12.816989+0000","last_became_peered":"2023-12-16T03:28:12.816989+0000","last_unstale":"2023-12-16T03:28:12.821143+0000","last_undegraded":"2023-12-16T03:28:12.821143+0000","last_fullsized":"2023-12-16T03:28:12.821143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:32.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827319+0000","last_change":"2023-12-16T03:28:11.787826+0000","last_active":"2023-12-16T03:28:12.827319+0000","last_peered":"2023-12-16T03:28:12.827319+0000","last_clean":"2023-12-16T03:28:12.827319+0000","last_became_active":"2023-12-16T03:28:11.787529+0000","last_became_peered":"2023-12-16T03:28:11.787529+0000","last_unstale":"2023-12-16T03:28:12.827319+0000","last_undegraded":"2023-12-16T03:28:12.827319+0000","last_fullsized":"2023-12-16T03:28:12.827319+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.937334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.785143+0000","last_change":"2023-12-16T03:27:59.731322+0000","last_active":"2023-12-16T03:28:11.785143+0000","last_peered":"2023-12-16T03:28:11.785143+0000","last_clean":"2023-12-16T03:28:11.785143+0000","last_became_active":"2023-12-16T03:27:59.730648+0000","last_became_peered":"2023-12-16T03:27:59.730648+0000","last_unstale":"2023-12-16T03:28:11.785143+0000","last_undegraded":"2023-12-16T03:28:11.785143+0000","last_fullsized":"2023-12-16T03:28:11.785143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:08:50.058653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.773346+0000","last_change":"2023-12-16T03:27:58.714609+0000","last_active":"2023-12-16T03:28:11.773346+0000","last_peered":"2023-12-16T03:28:11.773346+0000","last_clean":"2023-12-16T03:28:11.773346+0000","last_became_active":"2023-12-16T03:27:58.714279+0000","last_became_peered":"2023-12-16T03:27:58.714279+0000","last_unstale":"2023-12-16T03:28:11.773346+0000","last_undegraded":"2023-12-16T03:28:11.773346+0000","last_fullsized":"2023-12-16T03:28:11.773346+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:23:31.017856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827789+0000","last_change":"2023-12-16T03:28:12.824195+0000","last_active":"2023-12-16T03:28:12.827789+0000","last_peered":"2023-12-16T03:28:12.827789+0000","last_clean":"2023-12-16T03:28:12.827789+0000","last_became_active":"2023-12-16T03:28:12.823931+0000","last_became_peered":"2023-12-16T03:28:12.823931+0000","last_unstale":"2023-12-16T03:28:12.827789+0000","last_undegraded":"2023-12-16T03:28:12.827789+0000","last_fullsized":"2023-12-16T03:28:12.827789+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:04.331792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.789870+0000","last_change":"2023-12-16T03:28:11.788469+0000","last_active":"2023-12-16T03:28:12.789870+0000","last_peered":"2023-12-16T03:28:12.789870+0000","last_clean":"2023-12-16T03:28:12.789870+0000","last_became_active":"2023-12-16T03:28:11.788104+0000","last_became_peered":"2023-12-16T03:28:11.788104+0000","last_unstale":"2023-12-16T03:28:12.789870+0000","last_undegraded":"2023-12-16T03:28:12.789870+0000","last_fullsized":"2023-12-16T03:28:12.789870+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:40:42.674770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.766954+0000","last_change":"2023-12-16T03:27:59.726049+0000","last_active":"2023-12-16T03:28:11.766954+0000","last_peered":"2023-12-16T03:28:11.766954+0000","last_clean":"2023-12-16T03:28:11.766954+0000","last_became_active":"2023-12-16T03:27:59.725688+0000","last_became_peered":"2023-12-16T03:27:59.725688+0000","last_unstale":"2023-12-16T03:28:11.766954+0000","last_undegraded":"2023-12-16T03:28:11.766954+0000","last_fullsized":"2023-12-16T03:28:11.766954+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:55.005723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.777640+0000","last_change":"2023-12-16T03:27:58.715914+0000","last_active":"2023-12-16T03:28:11.777640+0000","last_peered":"2023-12-16T03:28:11.777640+0000","last_clean":"2023-12-16T03:28:11.777640+0000","last_became_active":"2023-12-16T03:27:58.715602+0000","last_became_peered":"2023-12-16T03:27:58.715602+0000","last_unstale":"2023-12-16T03:28:11.777640+0000","last_undegraded":"2023-12-16T03:28:11.777640+0000","last_fullsized":"2023-12-16T03:28:11.777640+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:24:56.757869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.812984+0000","last_change":"2023-12-16T03:28:12.809893+0000","last_active":"2023-12-16T03:28:12.812984+0000","last_peered":"2023-12-16T03:28:12.812984+0000","last_clean":"2023-12-16T03:28:12.812984+0000","last_became_active":"2023-12-16T03:28:12.809530+0000","last_became_peered":"2023-12-16T03:28:12.809530+0000","last_unstale":"2023-12-16T03:28:12.812984+0000","last_undegraded":"2023-12-16T03:28:12.812984+0000","last_fullsized":"2023-12-16T03:28:12.812984+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:46.339804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.796145+0000","last_change":"2023-12-16T03:28:11.783211+0000","last_active":"2023-12-16T03:28:12.796145+0000","last_peered":"2023-12-16T03:28:12.796145+0000","last_clean":"2023-12-16T03:28:12.796145+0000","last_became_active":"2023-12-16T03:28:11.782893+0000","last_became_peered":"2023-12-16T03:28:11.782893+0000","last_unstale":"2023-12-16T03:28:12.796145+0000","last_undegraded":"2023-12-16T03:28:12.796145+0000","last_fullsized":"2023-12-16T03:28:12.796145+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:26:15.244218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769639+0000","last_change":"2023-12-16T03:27:59.717815+0000","last_active":"2023-12-16T03:28:11.769639+0000","last_peered":"2023-12-16T03:28:11.769639+0000","last_clean":"2023-12-16T03:28:11.769639+0000","last_became_active":"2023-12-16T03:27:59.714803+0000","last_became_peered":"2023-12-16T03:27:59.714803+0000","last_unstale":"2023-12-16T03:28:11.769639+0000","last_undegraded":"2023-12-16T03:28:11.769639+0000","last_fullsized":"2023-12-16T03:28:11.769639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:06:37.917845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.783530+0000","last_change":"2023-12-16T03:27:58.718818+0000","last_active":"2023-12-16T03:28:11.783530+0000","last_peered":"2023-12-16T03:28:11.783530+0000","last_clean":"2023-12-16T03:28:11.783530+0000","last_became_active":"2023-12-16T03:27:58.718323+0000","last_became_peered":"2023-12-16T03:27:58.718323+0000","last_unstale":"2023-12-16T03:28:11.783530+0000","last_undegraded":"2023-12-16T03:28:11.783530+0000","last_fullsized":"2023-12-16T03:28:11.783530+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:13:36.671175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819155+0000","last_change":"2023-12-16T03:28:12.815629+0000","last_active":"2023-12-16T03:28:12.819155+0000","last_peered":"2023-12-16T03:28:12.819155+0000","last_clean":"2023-12-16T03:28:12.819155+0000","last_became_active":"2023-12-16T03:28:12.814785+0000","last_became_peered":"2023-12-16T03:28:12.814785+0000","last_unstale":"2023-12-16T03:28:12.819155+0000","last_undegraded":"2023-12-16T03:28:12.819155+0000","last_fullsized":"2023-12-16T03:28:12.819155+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:27:00.658089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.798082+0000","last_change":"2023-12-16T03:28:11.785634+0000","last_active":"2023-12-16T03:28:12.798082+0000","last_peered":"2023-12-16T03:28:12.798082+0000","last_clean":"2023-12-16T03:28:12.798082+0000","last_became_active":"2023-12-16T03:28:11.785308+0000","last_became_peered":"2023-12-16T03:28:11.785308+0000","last_unstale":"2023-12-16T03:28:12.798082+0000","last_undegraded":"2023-12-16T03:28:12.798082+0000","last_fullsized":"2023-12-16T03:28:12.798082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:03:47.032812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782757+0000","last_change":"2023-12-16T03:27:59.730417+0000","last_active":"2023-12-16T03:28:11.782757+0000","last_peered":"2023-12-16T03:28:11.782757+0000","last_clean":"2023-12-16T03:28:11.782757+0000","last_became_active":"2023-12-16T03:27:59.729416+0000","last_became_peered":"2023-12-16T03:27:59.729416+0000","last_unstale":"2023-12-16T03:28:11.782757+0000","last_undegraded":"2023-12-16T03:28:11.782757+0000","last_fullsized":"2023-12-16T03:28:11.782757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:08:01.790620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782953+0000","last_change":"2023-12-16T03:27:58.715883+0000","last_active":"2023-12-16T03:28:11.782953+0000","last_peered":"2023-12-16T03:28:11.782953+0000","last_clean":"2023-12-16T03:28:11.782953+0000","last_became_active":"2023-12-16T03:27:58.714400+0000","last_became_peered":"2023-12-16T03:27:58.714400+0000","last_unstale":"2023-12-16T03:28:11.782953+0000","last_undegraded":"2023-12-16T03:28:11.782953+0000","last_fullsized":"2023-12-16T03:28:11.782953+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:45.783332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.811361+0000","last_change":"2023-12-16T03:28:12.803502+0000","last_active":"2023-12-16T03:28:12.811361+0000","last_peered":"2023-12-16T03:28:12.811361+0000","last_clean":"2023-12-16T03:28:12.811361+0000","last_became_active":"2023-12-16T03:28:12.802826+0000","last_became_peered":"2023-12-16T03:28:12.802826+0000","last_unstale":"2023-12-16T03:28:12.811361+0000","last_undegraded":"2023-12-16T03:28:12.811361+0000","last_fullsized":"2023-12-16T03:28:12.811361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.905635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.821452+0000","last_change":"2023-12-16T03:28:11.774528+0000","last_active":"2023-12-16T03:28:12.821452+0000","last_peered":"2023-12-16T03:28:12.821452+0000","last_clean":"2023-12-16T03:28:12.821452+0000","last_became_active":"2023-12-16T03:28:11.774222+0000","last_became_peered":"2023-12-16T03:28:11.774222+0000","last_unstale":"2023-12-16T03:28:12.821452+0000","last_undegraded":"2023-12-16T03:28:12.821452+0000","last_fullsized":"2023-12-16T03:28:12.821452+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:46.808301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779195+0000","last_change":"2023-12-16T03:27:59.733598+0000","last_active":"2023-12-16T03:28:11.779195+0000","last_peered":"2023-12-16T03:28:11.779195+0000","last_clean":"2023-12-16T03:28:11.779195+0000","last_became_active":"2023-12-16T03:27:59.733274+0000","last_became_peered":"2023-12-16T03:27:59.733274+0000","last_unstale":"2023-12-16T03:28:11.779195+0000","last_undegraded":"2023-12-16T03:28:11.779195+0000","last_fullsized":"2023-12-16T03:28:11.779195+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:06:37.917845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779205+0000","last_change":"2023-12-16T03:27:58.714025+0000","last_active":"2023-12-16T03:28:11.779205+0000","last_peered":"2023-12-16T03:28:11.779205+0000","last_clean":"2023-12-16T03:28:11.779205+0000","last_became_active":"2023-12-16T03:27:58.713597+0000","last_became_peered":"2023-12-16T03:27:58.713597+0000","last_unstale":"2023-12-16T03:28:11.779205+0000","last_undegraded":"2023-12-16T03:28:11.779205+0000","last_fullsized":"2023-12-16T03:28:11.779205+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:00.746235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.806729+0000","last_change":"2023-12-16T03:28:12.800344+0000","last_active":"2023-12-16T03:28:12.806729+0000","last_peered":"2023-12-16T03:28:12.806729+0000","last_clean":"2023-12-16T03:28:12.806729+0000","last_became_active":"2023-12-16T03:28:12.799972+0000","last_became_peered":"2023-12-16T03:28:12.799972+0000","last_unstale":"2023-12-16T03:28:12.806729+0000","last_undegraded":"2023-12-16T03:28:12.806729+0000","last_fullsized":"2023-12-16T03:28:12.806729+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:53.482706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.793924+0000","last_change":"2023-12-16T03:28:11.795477+0000","last_active":"2023-12-16T03:28:12.793924+0000","last_peered":"2023-12-16T03:28:12.793924+0000","last_clean":"2023-12-16T03:28:12.793924+0000","last_became_active":"2023-12-16T03:28:11.795188+0000","last_became_peered":"2023-12-16T03:28:11.795188+0000","last_unstale":"2023-12-16T03:28:12.793924+0000","last_undegraded":"2023-12-16T03:28:12.793924+0000","last_fullsized":"2023-12-16T03:28:12.793924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:48:28.758418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769197+0000","last_change":"2023-12-16T03:27:59.726447+0000","last_active":"2023-12-16T03:28:11.769197+0000","last_peered":"2023-12-16T03:28:11.769197+0000","last_clean":"2023-12-16T03:28:11.769197+0000","last_became_active":"2023-12-16T03:27:59.724012+0000","last_became_peered":"2023-12-16T03:27:59.724012+0000","last_unstale":"2023-12-16T03:28:11.769197+0000","last_undegraded":"2023-12-16T03:28:11.769197+0000","last_fullsized":"2023-12-16T03:28:11.769197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:33.266132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779283+0000","last_change":"2023-12-16T03:27:58.717331+0000","last_active":"2023-12-16T03:28:11.779283+0000","last_peered":"2023-12-16T03:28:11.779283+0000","last_clean":"2023-12-16T03:28:11.779283+0000","last_became_active":"2023-12-16T03:27:58.716980+0000","last_became_peered":"2023-12-16T03:27:58.716980+0000","last_unstale":"2023-12-16T03:28:11.779283+0000","last_undegraded":"2023-12-16T03:28:11.779283+0000","last_fullsized":"2023-12-16T03:28:11.779283+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:56.126328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817066+0000","last_change":"2023-12-16T03:28:12.810590+0000","last_active":"2023-12-16T03:28:12.817066+0000","last_peered":"2023-12-16T03:28:12.817066+0000","last_clean":"2023-12-16T03:28:12.817066+0000","last_became_active":"2023-12-16T03:28:12.810249+0000","last_became_peered":"2023-12-16T03:28:12.810249+0000","last_unstale":"2023-12-16T03:28:12.817066+0000","last_undegraded":"2023-12-16T03:28:12.817066+0000","last_fullsized":"2023-12-16T03:28:12.817066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:16.517293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.797183+0000","last_change":"2023-12-16T03:28:11.790473+0000","last_active":"2023-12-16T03:28:12.797183+0000","last_peered":"2023-12-16T03:28:12.797183+0000","last_clean":"2023-12-16T03:28:12.797183+0000","last_became_active":"2023-12-16T03:28:11.790180+0000","last_became_peered":"2023-12-16T03:28:11.790180+0000","last_unstale":"2023-12-16T03:28:12.797183+0000","last_undegraded":"2023-12-16T03:28:12.797183+0000","last_fullsized":"2023-12-16T03:28:12.797183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:48:28.758418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767296+0000","last_change":"2023-12-16T03:27:59.725040+0000","last_active":"2023-12-16T03:28:11.767296+0000","last_peered":"2023-12-16T03:28:11.767296+0000","last_clean":"2023-12-16T03:28:11.767296+0000","last_became_active":"2023-12-16T03:27:59.724679+0000","last_became_peered":"2023-12-16T03:27:59.724679+0000","last_unstale":"2023-12-16T03:28:11.767296+0000","last_undegraded":"2023-12-16T03:28:11.767296+0000","last_fullsized":"2023-12-16T03:28:11.767296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:43.433178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765764+0000","last_change":"2023-12-16T03:27:58.715680+0000","last_active":"2023-12-16T03:28:11.765764+0000","last_peered":"2023-12-16T03:28:11.765764+0000","last_clean":"2023-12-16T03:28:11.765764+0000","last_became_active":"2023-12-16T03:27:58.715382+0000","last_became_peered":"2023-12-16T03:27:58.715382+0000","last_unstale":"2023-12-16T03:28:11.765764+0000","last_undegraded":"2023-12-16T03:28:11.765764+0000","last_fullsized":"2023-12-16T03:28:11.765764+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:20:57.913319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.828180+0000","last_change":"2023-12-16T03:28:12.826289+0000","last_active":"2023-12-16T03:28:12.828180+0000","last_peered":"2023-12-16T03:28:12.828180+0000","last_clean":"2023-12-16T03:28:12.828180+0000","last_became_active":"2023-12-16T03:28:12.825801+0000","last_became_peered":"2023-12-16T03:28:12.825801+0000","last_unstale":"2023-12-16T03:28:12.828180+0000","last_undegraded":"2023-12-16T03:28:12.828180+0000","last_fullsized":"2023-12-16T03:28:12.828180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:04:02.206799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.788975+0000","last_change":"2023-12-16T03:28:11.797180+0000","last_active":"2023-12-16T03:28:12.788975+0000","last_peered":"2023-12-16T03:28:12.788975+0000","last_clean":"2023-12-16T03:28:12.788975+0000","last_became_active":"2023-12-16T03:28:11.796313+0000","last_became_peered":"2023-12-16T03:28:11.796313+0000","last_unstale":"2023-12-16T03:28:12.788975+0000","last_undegraded":"2023-12-16T03:28:12.788975+0000","last_fullsized":"2023-12-16T03:28:12.788975+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:23.089560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765653+0000","last_change":"2023-12-16T03:27:59.724572+0000","last_active":"2023-12-16T03:28:11.765653+0000","last_peered":"2023-12-16T03:28:11.765653+0000","last_clean":"2023-12-16T03:28:11.765653+0000","last_became_active":"2023-12-16T03:27:59.724284+0000","last_became_peered":"2023-12-16T03:27:59.724284+0000","last_unstale":"2023-12-16T03:28:11.765653+0000","last_undegraded":"2023-12-16T03:28:11.765653+0000","last_fullsized":"2023-12-16T03:28:11.765653+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:21.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768188+0000","last_change":"2023-12-16T03:27:58.715475+0000","last_active":"2023-12-16T03:28:11.768188+0000","last_peered":"2023-12-16T03:28:11.768188+0000","last_clean":"2023-12-16T03:28:11.768188+0000","last_became_active":"2023-12-16T03:27:58.715159+0000","last_became_peered":"2023-12-16T03:27:58.715159+0000","last_unstale":"2023-12-16T03:28:11.768188+0000","last_undegraded":"2023-12-16T03:28:11.768188+0000","last_fullsized":"2023-12-16T03:28:11.768188+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:01:08.706369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.805744+0000","last_change":"2023-12-16T03:28:12.797453+0000","last_active":"2023-12-16T03:28:12.805744+0000","last_peered":"2023-12-16T03:28:12.805744+0000","last_clean":"2023-12-16T03:28:12.805744+0000","last_became_active":"2023-12-16T03:28:12.796846+0000","last_became_peered":"2023-12-16T03:28:12.796846+0000","last_unstale":"2023-12-16T03:28:12.805744+0000","last_undegraded":"2023-12-16T03:28:12.805744+0000","last_fullsized":"2023-12-16T03:28:12.805744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:59.865394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.795852+0000","last_change":"2023-12-16T03:28:11.792009+0000","last_active":"2023-12-16T03:28:12.795852+0000","last_peered":"2023-12-16T03:28:12.795852+0000","last_clean":"2023-12-16T03:28:12.795852+0000","last_became_active":"2023-12-16T03:28:11.791540+0000","last_became_peered":"2023-12-16T03:28:11.791540+0000","last_unstale":"2023-12-16T03:28:12.795852+0000","last_undegraded":"2023-12-16T03:28:12.795852+0000","last_fullsized":"2023-12-16T03:28:12.795852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:42:41.675066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.775415+0000","last_change":"2023-12-16T03:27:59.713363+0000","last_active":"2023-12-16T03:28:11.775415+0000","last_peered":"2023-12-16T03:28:11.775415+0000","last_clean":"2023-12-16T03:28:11.775415+0000","last_became_active":"2023-12-16T03:27:59.711676+0000","last_became_peered":"2023-12-16T03:27:59.711676+0000","last_unstale":"2023-12-16T03:28:11.775415+0000","last_undegraded":"2023-12-16T03:28:11.775415+0000","last_fullsized":"2023-12-16T03:28:11.775415+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:38.945695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779727+0000","last_change":"2023-12-16T03:27:58.715221+0000","last_active":"2023-12-16T03:28:11.779727+0000","last_peered":"2023-12-16T03:28:11.779727+0000","last_clean":"2023-12-16T03:28:11.779727+0000","last_became_active":"2023-12-16T03:27:58.714876+0000","last_became_peered":"2023-12-16T03:27:58.714876+0000","last_unstale":"2023-12-16T03:28:11.779727+0000","last_undegraded":"2023-12-16T03:28:11.779727+0000","last_fullsized":"2023-12-16T03:28:11.779727+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:53.997333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818572+0000","last_change":"2023-12-16T03:28:12.801925+0000","last_active":"2023-12-16T03:28:12.818572+0000","last_peered":"2023-12-16T03:28:12.818572+0000","last_clean":"2023-12-16T03:28:12.818572+0000","last_became_active":"2023-12-16T03:28:12.801647+0000","last_became_peered":"2023-12-16T03:28:12.801647+0000","last_unstale":"2023-12-16T03:28:12.818572+0000","last_undegraded":"2023-12-16T03:28:12.818572+0000","last_fullsized":"2023-12-16T03:28:12.818572+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:25:10.839931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.791389+0000","last_change":"2023-12-16T03:28:11.788392+0000","last_active":"2023-12-16T03:28:12.791389+0000","last_peered":"2023-12-16T03:28:12.791389+0000","last_clean":"2023-12-16T03:28:12.791389+0000","last_became_active":"2023-12-16T03:28:11.788075+0000","last_became_peered":"2023-12-16T03:28:11.788075+0000","last_unstale":"2023-12-16T03:28:12.791389+0000","last_undegraded":"2023-12-16T03:28:12.791389+0000","last_fullsized":"2023-12-16T03:28:12.791389+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:51:37.451472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779682+0000","last_change":"2023-12-16T03:27:59.724587+0000","last_active":"2023-12-16T03:28:11.779682+0000","last_peered":"2023-12-16T03:28:11.779682+0000","last_clean":"2023-12-16T03:28:11.779682+0000","last_became_active":"2023-12-16T03:27:59.724247+0000","last_became_peered":"2023-12-16T03:27:59.724247+0000","last_unstale":"2023-12-16T03:28:11.779682+0000","last_undegraded":"2023-12-16T03:28:11.779682+0000","last_fullsized":"2023-12-16T03:28:11.779682+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:47:50.256780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767564+0000","last_change":"2023-12-16T03:27:58.711121+0000","last_active":"2023-12-16T03:28:11.767564+0000","last_peered":"2023-12-16T03:28:11.767564+0000","last_clean":"2023-12-16T03:28:11.767564+0000","last_became_active":"2023-12-16T03:27:58.710879+0000","last_became_peered":"2023-12-16T03:27:58.710879+0000","last_unstale":"2023-12-16T03:28:11.767564+0000","last_undegraded":"2023-12-16T03:28:11.767564+0000","last_fullsized":"2023-12-16T03:28:11.767564+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:15.561452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817640+0000","last_change":"2023-12-16T03:28:12.801876+0000","last_active":"2023-12-16T03:28:12.817640+0000","last_peered":"2023-12-16T03:28:12.817640+0000","last_clean":"2023-12-16T03:28:12.817640+0000","last_became_active":"2023-12-16T03:28:12.801581+0000","last_became_peered":"2023-12-16T03:28:12.801581+0000","last_unstale":"2023-12-16T03:28:12.817640+0000","last_undegraded":"2023-12-16T03:28:12.817640+0000","last_fullsized":"2023-12-16T03:28:12.817640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:29.328369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.825606+0000","last_change":"2023-12-16T03:28:11.796826+0000","last_active":"2023-12-16T03:28:12.825606+0000","last_peered":"2023-12-16T03:28:12.825606+0000","last_clean":"2023-12-16T03:28:12.825606+0000","last_became_active":"2023-12-16T03:28:11.796625+0000","last_became_peered":"2023-12-16T03:28:11.796625+0000","last_unstale":"2023-12-16T03:28:12.825606+0000","last_undegraded":"2023-12-16T03:28:12.825606+0000","last_fullsized":"2023-12-16T03:28:12.825606+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:11:00.573887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.783135+0000","last_change":"2023-12-16T03:27:59.716568+0000","last_active":"2023-12-16T03:28:11.783135+0000","last_peered":"2023-12-16T03:28:11.783135+0000","last_clean":"2023-12-16T03:28:11.783135+0000","last_became_active":"2023-12-16T03:27:59.715445+0000","last_became_peered":"2023-12-16T03:27:59.715445+0000","last_unstale":"2023-12-16T03:28:11.783135+0000","last_undegraded":"2023-12-16T03:28:11.783135+0000","last_fullsized":"2023-12-16T03:28:11.783135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:21:50.345325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781591+0000","last_change":"2023-12-16T03:27:58.721261+0000","last_active":"2023-12-16T03:28:11.781591+0000","last_peered":"2023-12-16T03:28:11.781591+0000","last_clean":"2023-12-16T03:28:11.781591+0000","last_became_active":"2023-12-16T03:27:58.720869+0000","last_became_peered":"2023-12-16T03:27:58.720869+0000","last_unstale":"2023-12-16T03:28:11.781591+0000","last_undegraded":"2023-12-16T03:28:11.781591+0000","last_fullsized":"2023-12-16T03:28:11.781591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:20.366036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":210,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.775599+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:28:11.775599+0000","last_peered":"2023-12-16T03:28:11.775599+0000","last_clean":"2023-12-16T03:28:11.775599+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:28:11.775599+0000","last_undegraded":"2023-12-16T03:28:11.775599+0000","last_fullsized":"2023-12-16T03:28:11.775599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1458176,"data_stored":968504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85899999999999999,"5min":1.155,"15min":1.155},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70099999999999996,"15min":0.71099999999999997},"min":{"1min":0.51500000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89400000000000002,"5min":1.585,"15min":1.585},"last":0.81499999999999995}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.75800000000000001,"15min":0.78700000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95099999999999996,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.82599999999999996},"min":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84099999999999997,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.84499999999999997}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99399999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.76700000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.871,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2370000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88300000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.55500000000000005}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.629}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78900000000000003,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.746,"15min":0.76100000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":378760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.77100000000000002,"15min":0.81899999999999995},"min":{"1min":0.44700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.502,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.84099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.93200000000000005,"15min":1.046},"min":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85699999999999998,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.89900000000000002,"15min":1.002},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.51500000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.131,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.72299999999999998}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91800000000000004,"5min":4.242,"15min":4.242},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.85999999999999999,"15min":0.92000000000000004},"min":{"1min":0.57399999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.74299999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.873,"5min":1.111,"15min":1.111},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86099999999999999,"5min":1.073,"15min":1.073},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92800000000000005,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.246,"15min":1.246},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80000000000000004,"15min":0.80800000000000005},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":876544,"data_stored":381195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86699999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":1.111,"15min":1.111},"last":0.68400000000000005}]},{"osd":1,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92500000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.51000000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.622},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71399999999999997,"15min":0.70699999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93999999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.60799999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.622,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.71599999999999997},"min":{"1min":0.48199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.64600000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63600000000000001,"15min":0.65100000000000002},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.505},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71199999999999997,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.81599999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.022,"5min":1.105,"15min":1.105},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":378066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.751,"15min":0.79900000000000004},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":4.194,"15min":4.194},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.034,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.80400000000000005}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.621,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95199999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82799999999999996}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.84899999999999998,"15min":0.93100000000000005},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0700000000000001,"5min":1.288,"15min":1.288},"last":0.73599999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84699999999999998,"15min":0.91800000000000004},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91200000000000003,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.878,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.77900000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.70199999999999996,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.879},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73399999999999999,"15min":0.76200000000000001},"min":{"1min":0.47399999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85599999999999998,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.96499999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.75,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92400000000000004,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93100000000000005,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.93799999999999994}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85699999999999998,"5min":1.881,"15min":1.881},"last":1.014},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80300000000000005,"15min":0.83499999999999996},"min":{"1min":0.53600000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.95599999999999996,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.98799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":381173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.66200000000000003,"15min":0.77600000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.71599999999999997,"15min":0.83999999999999997},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.58699999999999997,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60699999999999998,"15min":0.68500000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.57999999999999996,"15min":0.622},"min":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63700000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.628,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.82199999999999995,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.67600000000000005,"15min":0.747},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73799999999999999,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.432}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81100000000000005,"15min":0.85399999999999998},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.871,"15min":0.92100000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.016,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.84199999999999997,"15min":0.88800000000000001},"min":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.99199999999999999,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.85799999999999998,"15min":0.91000000000000003},"min":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.88800000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84799999999999998,"15min":0.88400000000000001},"min":{"1min":0.60299999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.94799999999999995,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.88100000000000001,"15min":0.93899999999999995},"min":{"1min":0.60099999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98399999999999999,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.71799999999999997}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97699999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.87},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90900000000000003,"15min":0.96499999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":3.375,"15min":3.375},"last":0.73899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":386315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.436,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47799999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.42999999999999999},"min":{"1min":0.318,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.627,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70699999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":1.022,"15min":1.022},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93700000000000006,"5min":1.587,"15min":1.587},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.76600000000000001,"15min":0.79900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90500000000000003,"5min":1.913,"15min":1.913},"last":0.95399999999999996}]},{"osd":5,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.86899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.099},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.78000000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97599999999999998,"5min":1.018,"15min":1.018},"last":0.80800000000000005}]},{"osd":6,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93200000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.77600000000000002,"15min":0.78700000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92600000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.90000000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.81000000000000005,"15min":0.83999999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94999999999999996,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.97999999999999998,"5min":1.212,"15min":1.212},"last":0.995}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":378260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.55900000000000005,"15min":0.625},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61199999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.63600000000000001,"15min":0.70099999999999996},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70599999999999996,"5min":4.476,"15min":4.476},"last":0.52200000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.71399999999999997,"15min":0.83099999999999996},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66400000000000003,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.68100000000000005,"15min":0.77100000000000002},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.755,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.441}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.66000000000000003,"15min":0.71999999999999997},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.68400000000000005},"min":{"1min":0.318,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81799999999999995,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.94899999999999995,"15min":1.0549999999999999},"min":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86699999999999999,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.872,"15min":0.94999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98299999999999998,"5min":4.984,"15min":4.984},"last":0.64300000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.84699999999999998,"15min":0.92100000000000004},"min":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.98699999999999999,"15min":1.113},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.61199999999999999}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.88700000000000001,"15min":0.96699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92000000000000004,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.624},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.99199999999999999,"15min":1.115},"min":{"1min":0.56200000000000006,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96599999999999997,"5min":7.681,"15min":7.681},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.96099999999999997,"15min":1.0509999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94499999999999995,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.93200000000000005,"15min":1.0129999999999999},"min":{"1min":0.58899999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.042,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.69899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1458176,"data_stored":968468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.67100000000000004,"15min":0.78300000000000003},"min":{"1min":0.30499999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.378},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.78900000000000003,"15min":0.92500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.40799999999999997}]},{"osd":2,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.82199999999999995,"15min":0.96299999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90100000000000002,"15min":1.0680000000000001},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79200000000000004,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.36099999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.80000000000000004,"15min":0.96799999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89800000000000002,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.71599999999999997,"15min":0.80400000000000005},"min":{"1min":0.36899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77000000000000002,"5min":3.254,"15min":3.254},"last":0.501}]},{"osd":4,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89400000000000002,"15min":0.96699999999999997},"min":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0660000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.92200000000000004,"15min":1.002},"min":{"1min":0.56499999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.98999999999999999,"15min":1.1180000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.625},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.90500000000000003,"15min":1.0089999999999999},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.90900000000000003,"15min":1.002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84499999999999997,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.056,"15min":1.206},"min":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.999,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":1.0760000000000001,"15min":1.214},"min":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0980000000000001,"5min":4.444,"15min":4.444},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96299999999999997,"15min":1.056},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.94899999999999995,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:28:16.918 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:28:17.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.094+0000 7f7eb11df640 1 Processor -- start 2023-12-16T03:28:17.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.094+0000 7f7eb11df640 1 -- start start 2023-12-16T03:28:17.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eb11df640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7eac0a5240 0x7f7eac0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eb11df640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eac0c01c0 0x7f7eac0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eb11df640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7eac0c61a0 0x7f7eac1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eb11df640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0c3bd0 con 0x7f7eac0c61a0 2023-12-16T03:28:17.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eb11df640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0bf1e0 con 0x7f7eac0a5240 2023-12-16T03:28:17.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eb11df640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c3e20 con 0x7f7eac0c01c0 2023-12-16T03:28:17.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eab59e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7eac0c61a0 0x7f7eac1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eab59e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7eac0c61a0 0x7f7eac1561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45850/0 (socket says 172.21.15.28:45850) 2023-12-16T03:28:17.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eab59e640 1 -- 172.21.15.28:0/3004493956 learned_addr learned my addr 172.21.15.28:0/3004493956 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:17.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7ea3fff640 1 --2- 172.21.15.28:0/3004493956 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eac0c01c0 0x7f7eac0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eaad9d640 1 --2- 172.21.15.28:0/3004493956 >> v2:172.21.15.134:3300/0 conn(0x7f7eac0a5240 0x7f7eac0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eab59e640 1 -- 172.21.15.28:0/3004493956 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eac0c01c0 msgr2=0x7f7eac0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:17.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eab59e640 1 --2- 172.21.15.28:0/3004493956 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eac0c01c0 0x7f7eac0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eab59e640 1 -- 172.21.15.28:0/3004493956 >> v2:172.21.15.134:3300/0 conn(0x7f7eac0a5240 msgr2=0x7f7eac0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:17.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eab59e640 1 --2- 172.21.15.28:0/3004493956 >> v2:172.21.15.134:3300/0 conn(0x7f7eac0a5240 0x7f7eac0bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eab59e640 1 -- 172.21.15.28:0/3004493956 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac0c4100 con 0x7f7eac0c61a0 2023-12-16T03:28:17.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eaad9d640 1 --2- 172.21.15.28:0/3004493956 >> v2:172.21.15.134:3300/0 conn(0x7f7eac0a5240 0x7f7eac0bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:17.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.098+0000 7f7eab59e640 1 --2- 172.21.15.28:0/3004493956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eac0c61a0 0x7f7eac1561f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009e50 tx=0x7f7ea401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be050b89826c132 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:17.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eaa59c640 1 -- 172.21.15.28:0/3004493956 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac156f40 con 0x7f7eac0c61a0 2023-12-16T03:28:17.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eaa59c640 1 -- 172.21.15.28:0/3004493956 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea40a5790 con 0x7f7eac0c61a0 2023-12-16T03:28:17.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eaa59c640 1 -- 172.21.15.28:0/3004493956 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea40a5b20 con 0x7f7eac0c61a0 2023-12-16T03:28:17.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 -- 172.21.15.28:0/3004493956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eac0c61a0 msgr2=0x7f7eac1561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:17.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 --2- 172.21.15.28:0/3004493956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eac0c61a0 0x7f7eac1561f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009e50 tx=0x7f7ea401c910 comp rx=0 tx=0).stop 2023-12-16T03:28:17.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 -- 172.21.15.28:0/3004493956 shutdown_connections 2023-12-16T03:28:17.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 --2- 172.21.15.28:0/3004493956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eac0c61a0 0x7f7eac1561f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 --2- 172.21.15.28:0/3004493956 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eac0c01c0 0x7f7eac0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 --2- 172.21.15.28:0/3004493956 >> v2:172.21.15.134:3300/0 conn(0x7f7eac0a5240 0x7f7eac0bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 -- 172.21.15.28:0/3004493956 >> 172.21.15.28:0/3004493956 conn(0x7f7eac06a5b0 msgr2=0x7f7eac06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:17.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 -- 172.21.15.28:0/3004493956 shutdown_connections 2023-12-16T03:28:17.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 -- 172.21.15.28:0/3004493956 wait complete. 2023-12-16T03:28:17.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 Processor -- start 2023-12-16T03:28:17.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 -- start start 2023-12-16T03:28:17.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7eac0a5240 0x7f7eac153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eac0c01c0 0x7f7eac0715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eac0c61a0 0x7f7eac1f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac070900 con 0x7f7eac0c01c0 2023-12-16T03:28:17.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac1540b0 con 0x7f7eac0a5240 2023-12-16T03:28:17.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.102+0000 7f7eb11df640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac071b30 con 0x7f7eac0c61a0 2023-12-16T03:28:17.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eac0c01c0 0x7f7eac0715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eac0c01c0 0x7f7eac0715f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45852/0 (socket says 172.21.15.28:45852) 2023-12-16T03:28:17.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea3fff640 1 -- 172.21.15.28:0/2839682384 learned_addr learned my addr 172.21.15.28:0/2839682384 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7eaad9d640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7eac0a5240 0x7f7eac153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7eab59e640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eac0c61a0 0x7f7eac1f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea3fff640 1 -- 172.21.15.28:0/2839682384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eac0c61a0 msgr2=0x7f7eac1f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea3fff640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eac0c61a0 0x7f7eac1f06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea3fff640 1 -- 172.21.15.28:0/2839682384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7eac0a5240 msgr2=0x7f7eac153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea3fff640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7eac0a5240 0x7f7eac153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea3fff640 1 -- 172.21.15.28:0/2839682384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4009b30 con 0x7f7eac0c01c0 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea3fff640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eac0c01c0 0x7f7eac0715f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400d7d0 tx=0x7f7e9400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea37fe640 1 -- 172.21.15.28:0/2839682384 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400b6c0 con 0x7f7eac0c01c0 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea37fe640 1 -- 172.21.15.28:0/2839682384 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9400b820 con 0x7f7eac0c01c0 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea37fe640 1 -- 172.21.15.28:0/2839682384 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400bbd0 con 0x7f7eac0c01c0 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7eb11df640 1 -- 172.21.15.28:0/2839682384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eac1f1010 con 0x7f7eac0c01c0 2023-12-16T03:28:17.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7eb11df640 1 -- 172.21.15.28:0/2839682384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac1f12f0 con 0x7f7eac0c01c0 2023-12-16T03:28:17.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7eb11df640 1 -- 172.21.15.28:0/2839682384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac0c52e0 con 0x7f7eac0c01c0 2023-12-16T03:28:17.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.106+0000 7f7ea37fe640 1 -- 172.21.15.28:0/2839682384 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7e9400bd30 con 0x7f7eac0c01c0 2023-12-16T03:28:17.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.110+0000 7f7ea37fe640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e8c0664f0 0x7f7e8c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.110+0000 7f7ea37fe640 1 -- 172.21.15.28:0/2839682384 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7e94084440 con 0x7f7eac0c01c0 2023-12-16T03:28:17.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.110+0000 7f7eaad9d640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e8c0664f0 0x7f7e8c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.110+0000 7f7eaad9d640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e8c0664f0 0x7f7e8c0689b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7eac067990 tx=0x7f7e9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:17.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.114+0000 7f7ea37fe640 1 -- 172.21.15.28:0/2839682384 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7e94051780 con 0x7f7eac0c01c0 2023-12-16T03:28:17.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.266+0000 7f7eb11df640 1 -- 172.21.15.28:0/2839682384 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7eac15f3c0 con 0x7f7e8c0664f0 2023-12-16T03:28:17.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.278+0000 7f7ea37fe640 1 -- 172.21.15.28:0/2839682384 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528037 (secure 0 0 0) 0x7f7eac15f3c0 con 0x7f7e8c0664f0 2023-12-16T03:28:17.289 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:17.293 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:28:17.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 -- 172.21.15.28:0/2839682384 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e8c0664f0 msgr2=0x7f7e8c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e8c0664f0 0x7f7e8c0689b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7eac067990 tx=0x7f7e9c008040 comp rx=0 tx=0).stop 2023-12-16T03:28:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 -- 172.21.15.28:0/2839682384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eac0c01c0 msgr2=0x7f7eac0715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eac0c01c0 0x7f7eac0715f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400d7d0 tx=0x7f7e9400dc90 comp rx=0 tx=0).stop 2023-12-16T03:28:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 -- 172.21.15.28:0/2839682384 shutdown_connections 2023-12-16T03:28:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7eac0c61a0 0x7f7eac1f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7e8c0664f0 0x7f7e8c0689b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7eac0c01c0 0x7f7eac0715f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 --2- 172.21.15.28:0/2839682384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7eac0a5240 0x7f7eac153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 -- 172.21.15.28:0/2839682384 >> 172.21.15.28:0/2839682384 conn(0x7f7eac06a5b0 msgr2=0x7f7eac06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 -- 172.21.15.28:0/2839682384 shutdown_connections 2023-12-16T03:28:17.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.286+0000 7f7eb11df640 1 -- 172.21.15.28:0/2839682384 wait complete. 2023-12-16T03:28:17.309 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-12-16T03:28:15.833941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":261,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257436,"kb_used_data":7960,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717284,"statfs":{"total":773094113280,"available":772830498816,"internally_reserved":0,"allocated":8151040,"data_stored":4220741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.076132"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.806770+0000","last_change":"2023-12-16T03:28:12.802270+0000","last_active":"2023-12-16T03:28:12.806770+0000","last_peered":"2023-12-16T03:28:12.806770+0000","last_clean":"2023-12-16T03:28:12.806770+0000","last_became_active":"2023-12-16T03:28:12.801995+0000","last_became_peered":"2023-12-16T03:28:12.801995+0000","last_unstale":"2023-12-16T03:28:12.806770+0000","last_undegraded":"2023-12-16T03:28:12.806770+0000","last_fullsized":"2023-12-16T03:28:12.806770+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:21:11.995380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781078+0000","last_change":"2023-12-16T03:27:59.729049+0000","last_active":"2023-12-16T03:28:11.781078+0000","last_peered":"2023-12-16T03:28:11.781078+0000","last_clean":"2023-12-16T03:28:11.781078+0000","last_became_active":"2023-12-16T03:27:59.728714+0000","last_became_peered":"2023-12-16T03:27:59.728714+0000","last_unstale":"2023-12-16T03:28:11.781078+0000","last_undegraded":"2023-12-16T03:28:11.781078+0000","last_fullsized":"2023-12-16T03:28:11.781078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:38.945695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827630+0000","last_change":"2023-12-16T03:28:12.825540+0000","last_active":"2023-12-16T03:28:12.827630+0000","last_peered":"2023-12-16T03:28:12.827630+0000","last_clean":"2023-12-16T03:28:12.827630+0000","last_became_active":"2023-12-16T03:28:12.825277+0000","last_became_peered":"2023-12-16T03:28:12.825277+0000","last_unstale":"2023-12-16T03:28:12.827630+0000","last_undegraded":"2023-12-16T03:28:12.827630+0000","last_fullsized":"2023-12-16T03:28:12.827630+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:19.990543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.783241+0000","last_change":"2023-12-16T03:27:59.722443+0000","last_active":"2023-12-16T03:28:11.783241+0000","last_peered":"2023-12-16T03:28:11.783241+0000","last_clean":"2023-12-16T03:28:11.783241+0000","last_became_active":"2023-12-16T03:27:59.722119+0000","last_became_peered":"2023-12-16T03:27:59.722119+0000","last_unstale":"2023-12-16T03:28:11.783241+0000","last_undegraded":"2023-12-16T03:28:11.783241+0000","last_fullsized":"2023-12-16T03:28:11.783241+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:26:08.675666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.806346+0000","last_change":"2023-12-16T03:28:12.793339+0000","last_active":"2023-12-16T03:28:12.806346+0000","last_peered":"2023-12-16T03:28:12.806346+0000","last_clean":"2023-12-16T03:28:12.806346+0000","last_became_active":"2023-12-16T03:28:12.792935+0000","last_became_peered":"2023-12-16T03:28:12.792935+0000","last_unstale":"2023-12-16T03:28:12.806346+0000","last_undegraded":"2023-12-16T03:28:12.806346+0000","last_fullsized":"2023-12-16T03:28:12.806346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:58.216044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781131+0000","last_change":"2023-12-16T03:27:59.719770+0000","last_active":"2023-12-16T03:28:11.781131+0000","last_peered":"2023-12-16T03:28:11.781131+0000","last_clean":"2023-12-16T03:28:11.781131+0000","last_became_active":"2023-12-16T03:27:59.719384+0000","last_became_peered":"2023-12-16T03:27:59.719384+0000","last_unstale":"2023-12-16T03:28:11.781131+0000","last_undegraded":"2023-12-16T03:28:11.781131+0000","last_fullsized":"2023-12-16T03:28:11.781131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:47:50.256780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827429+0000","last_change":"2023-12-16T03:28:12.811873+0000","last_active":"2023-12-16T03:28:12.827429+0000","last_peered":"2023-12-16T03:28:12.827429+0000","last_clean":"2023-12-16T03:28:12.827429+0000","last_became_active":"2023-12-16T03:28:12.811564+0000","last_became_peered":"2023-12-16T03:28:12.811564+0000","last_unstale":"2023-12-16T03:28:12.827429+0000","last_undegraded":"2023-12-16T03:28:12.827429+0000","last_fullsized":"2023-12-16T03:28:12.827429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:19.990543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.773972+0000","last_change":"2023-12-16T03:27:59.740570+0000","last_active":"2023-12-16T03:28:11.773972+0000","last_peered":"2023-12-16T03:28:11.773972+0000","last_clean":"2023-12-16T03:28:11.773972+0000","last_became_active":"2023-12-16T03:27:59.740240+0000","last_became_peered":"2023-12-16T03:27:59.740240+0000","last_unstale":"2023-12-16T03:28:11.773972+0000","last_undegraded":"2023-12-16T03:28:11.773972+0000","last_fullsized":"2023-12-16T03:28:11.773972+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:10:51.762407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.821881+0000","last_change":"2023-12-16T03:28:12.816587+0000","last_active":"2023-12-16T03:28:12.821881+0000","last_peered":"2023-12-16T03:28:12.821881+0000","last_clean":"2023-12-16T03:28:12.821881+0000","last_became_active":"2023-12-16T03:28:12.816217+0000","last_became_peered":"2023-12-16T03:28:12.816217+0000","last_unstale":"2023-12-16T03:28:12.821881+0000","last_undegraded":"2023-12-16T03:28:12.821881+0000","last_fullsized":"2023-12-16T03:28:12.821881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:27:00.658089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768232+0000","last_change":"2023-12-16T03:27:59.711730+0000","last_active":"2023-12-16T03:28:11.768232+0000","last_peered":"2023-12-16T03:28:11.768232+0000","last_clean":"2023-12-16T03:28:11.768232+0000","last_became_active":"2023-12-16T03:27:59.711388+0000","last_became_peered":"2023-12-16T03:27:59.711388+0000","last_unstale":"2023-12-16T03:28:11.768232+0000","last_undegraded":"2023-12-16T03:28:11.768232+0000","last_fullsized":"2023-12-16T03:28:11.768232+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:40.409035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827523+0000","last_change":"2023-12-16T03:28:12.823483+0000","last_active":"2023-12-16T03:28:12.827523+0000","last_peered":"2023-12-16T03:28:12.827523+0000","last_clean":"2023-12-16T03:28:12.827523+0000","last_became_active":"2023-12-16T03:28:12.823220+0000","last_became_peered":"2023-12-16T03:28:12.823220+0000","last_unstale":"2023-12-16T03:28:12.827523+0000","last_undegraded":"2023-12-16T03:28:12.827523+0000","last_fullsized":"2023-12-16T03:28:12.827523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:22.570453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767219+0000","last_change":"2023-12-16T03:27:59.733239+0000","last_active":"2023-12-16T03:28:11.767219+0000","last_peered":"2023-12-16T03:28:11.767219+0000","last_clean":"2023-12-16T03:28:11.767219+0000","last_became_active":"2023-12-16T03:27:59.732722+0000","last_became_peered":"2023-12-16T03:27:59.732722+0000","last_unstale":"2023-12-16T03:28:11.767219+0000","last_undegraded":"2023-12-16T03:28:11.767219+0000","last_fullsized":"2023-12-16T03:28:11.767219+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:57.134718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.820780+0000","last_change":"2023-12-16T03:28:12.818698+0000","last_active":"2023-12-16T03:28:12.820780+0000","last_peered":"2023-12-16T03:28:12.820780+0000","last_clean":"2023-12-16T03:28:12.820780+0000","last_became_active":"2023-12-16T03:28:12.818419+0000","last_became_peered":"2023-12-16T03:28:12.818419+0000","last_unstale":"2023-12-16T03:28:12.820780+0000","last_undegraded":"2023-12-16T03:28:12.820780+0000","last_fullsized":"2023-12-16T03:28:12.820780+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:22.570453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.773254+0000","last_change":"2023-12-16T03:27:59.728242+0000","last_active":"2023-12-16T03:28:11.773254+0000","last_peered":"2023-12-16T03:28:11.773254+0000","last_clean":"2023-12-16T03:28:11.773254+0000","last_became_active":"2023-12-16T03:27:59.726176+0000","last_became_peered":"2023-12-16T03:27:59.726176+0000","last_unstale":"2023-12-16T03:28:11.773254+0000","last_undegraded":"2023-12-16T03:28:11.773254+0000","last_fullsized":"2023-12-16T03:28:11.773254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:39:51.551442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817693+0000","last_change":"2023-12-16T03:28:12.814790+0000","last_active":"2023-12-16T03:28:12.817693+0000","last_peered":"2023-12-16T03:28:12.817693+0000","last_clean":"2023-12-16T03:28:12.817693+0000","last_became_active":"2023-12-16T03:28:12.814190+0000","last_became_peered":"2023-12-16T03:28:12.814190+0000","last_unstale":"2023-12-16T03:28:12.817693+0000","last_undegraded":"2023-12-16T03:28:12.817693+0000","last_fullsized":"2023-12-16T03:28:12.817693+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:48:29.764892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.766568+0000","last_change":"2023-12-16T03:27:59.710966+0000","last_active":"2023-12-16T03:28:11.766568+0000","last_peered":"2023-12-16T03:28:11.766568+0000","last_clean":"2023-12-16T03:28:11.766568+0000","last_became_active":"2023-12-16T03:27:59.710627+0000","last_became_peered":"2023-12-16T03:27:59.710627+0000","last_unstale":"2023-12-16T03:28:11.766568+0000","last_undegraded":"2023-12-16T03:28:11.766568+0000","last_fullsized":"2023-12-16T03:28:11.766568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:19:42.795934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.826015+0000","last_change":"2023-12-16T03:28:12.822031+0000","last_active":"2023-12-16T03:28:12.826015+0000","last_peered":"2023-12-16T03:28:12.826015+0000","last_clean":"2023-12-16T03:28:12.826015+0000","last_became_active":"2023-12-16T03:28:12.821682+0000","last_became_peered":"2023-12-16T03:28:12.821682+0000","last_unstale":"2023-12-16T03:28:12.826015+0000","last_undegraded":"2023-12-16T03:28:12.826015+0000","last_fullsized":"2023-12-16T03:28:12.826015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:37.364217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769362+0000","last_change":"2023-12-16T03:27:59.723118+0000","last_active":"2023-12-16T03:28:11.769362+0000","last_peered":"2023-12-16T03:28:11.769362+0000","last_clean":"2023-12-16T03:28:11.769362+0000","last_became_active":"2023-12-16T03:27:59.722803+0000","last_became_peered":"2023-12-16T03:27:59.722803+0000","last_unstale":"2023-12-16T03:28:11.769362+0000","last_undegraded":"2023-12-16T03:28:11.769362+0000","last_fullsized":"2023-12-16T03:28:11.769362+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:06.347016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818581+0000","last_change":"2023-12-16T03:28:12.802671+0000","last_active":"2023-12-16T03:28:12.818581+0000","last_peered":"2023-12-16T03:28:12.818581+0000","last_clean":"2023-12-16T03:28:12.818581+0000","last_became_active":"2023-12-16T03:28:12.802358+0000","last_became_peered":"2023-12-16T03:28:12.802358+0000","last_unstale":"2023-12-16T03:28:12.818581+0000","last_undegraded":"2023-12-16T03:28:12.818581+0000","last_fullsized":"2023-12-16T03:28:12.818581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:33.289034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781811+0000","last_change":"2023-12-16T03:27:59.724226+0000","last_active":"2023-12-16T03:28:11.781811+0000","last_peered":"2023-12-16T03:28:11.781811+0000","last_clean":"2023-12-16T03:28:11.781811+0000","last_became_active":"2023-12-16T03:27:59.723929+0000","last_became_peered":"2023-12-16T03:27:59.723929+0000","last_unstale":"2023-12-16T03:28:11.781811+0000","last_undegraded":"2023-12-16T03:28:11.781811+0000","last_fullsized":"2023-12-16T03:28:11.781811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:48:36.777385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819700+0000","last_change":"2023-12-16T03:28:12.806281+0000","last_active":"2023-12-16T03:28:12.819700+0000","last_peered":"2023-12-16T03:28:12.819700+0000","last_clean":"2023-12-16T03:28:12.819700+0000","last_became_active":"2023-12-16T03:28:12.806007+0000","last_became_peered":"2023-12-16T03:28:12.806007+0000","last_unstale":"2023-12-16T03:28:12.819700+0000","last_undegraded":"2023-12-16T03:28:12.819700+0000","last_fullsized":"2023-12-16T03:28:12.819700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:05.273802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.783529+0000","last_change":"2023-12-16T03:27:59.710177+0000","last_active":"2023-12-16T03:28:11.783529+0000","last_peered":"2023-12-16T03:28:11.783529+0000","last_clean":"2023-12-16T03:28:11.783529+0000","last_became_active":"2023-12-16T03:27:59.709870+0000","last_became_peered":"2023-12-16T03:27:59.709870+0000","last_unstale":"2023-12-16T03:28:11.783529+0000","last_undegraded":"2023-12-16T03:28:11.783529+0000","last_fullsized":"2023-12-16T03:28:11.783529+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:26:43.167751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819183+0000","last_change":"2023-12-16T03:28:12.813094+0000","last_active":"2023-12-16T03:28:12.819183+0000","last_peered":"2023-12-16T03:28:12.819183+0000","last_clean":"2023-12-16T03:28:12.819183+0000","last_became_active":"2023-12-16T03:28:12.811974+0000","last_became_peered":"2023-12-16T03:28:12.811974+0000","last_unstale":"2023-12-16T03:28:12.819183+0000","last_undegraded":"2023-12-16T03:28:12.819183+0000","last_fullsized":"2023-12-16T03:28:12.819183+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:08.869195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.778346+0000","last_change":"2023-12-16T03:27:59.726745+0000","last_active":"2023-12-16T03:28:11.778346+0000","last_peered":"2023-12-16T03:28:11.778346+0000","last_clean":"2023-12-16T03:28:11.778346+0000","last_became_active":"2023-12-16T03:27:59.725932+0000","last_became_peered":"2023-12-16T03:27:59.725932+0000","last_unstale":"2023-12-16T03:28:11.778346+0000","last_undegraded":"2023-12-16T03:28:11.778346+0000","last_fullsized":"2023-12-16T03:28:11.778346+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:20:58.921708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819237+0000","last_change":"2023-12-16T03:28:12.813133+0000","last_active":"2023-12-16T03:28:12.819237+0000","last_peered":"2023-12-16T03:28:12.819237+0000","last_clean":"2023-12-16T03:28:12.819237+0000","last_became_active":"2023-12-16T03:28:12.812771+0000","last_became_peered":"2023-12-16T03:28:12.812771+0000","last_unstale":"2023-12-16T03:28:12.819237+0000","last_undegraded":"2023-12-16T03:28:12.819237+0000","last_fullsized":"2023-12-16T03:28:12.819237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:27:00.658089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779204+0000","last_change":"2023-12-16T03:27:59.706154+0000","last_active":"2023-12-16T03:28:11.779204+0000","last_peered":"2023-12-16T03:28:11.779204+0000","last_clean":"2023-12-16T03:28:11.779204+0000","last_became_active":"2023-12-16T03:27:59.704791+0000","last_became_peered":"2023-12-16T03:27:59.704791+0000","last_unstale":"2023-12-16T03:28:11.779204+0000","last_undegraded":"2023-12-16T03:28:11.779204+0000","last_fullsized":"2023-12-16T03:28:11.779204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:48:36.777385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.831164+0000","last_change":"2023-12-16T03:28:12.827140+0000","last_active":"2023-12-16T03:28:12.831164+0000","last_peered":"2023-12-16T03:28:12.831164+0000","last_clean":"2023-12-16T03:28:12.831164+0000","last_became_active":"2023-12-16T03:28:12.826818+0000","last_became_peered":"2023-12-16T03:28:12.826818+0000","last_unstale":"2023-12-16T03:28:12.831164+0000","last_undegraded":"2023-12-16T03:28:12.831164+0000","last_fullsized":"2023-12-16T03:28:12.831164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:22.570453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779755+0000","last_change":"2023-12-16T03:27:59.740901+0000","last_active":"2023-12-16T03:28:11.779755+0000","last_peered":"2023-12-16T03:28:11.779755+0000","last_clean":"2023-12-16T03:28:11.779755+0000","last_became_active":"2023-12-16T03:27:59.740547+0000","last_became_peered":"2023-12-16T03:27:59.740547+0000","last_unstale":"2023-12-16T03:28:11.779755+0000","last_undegraded":"2023-12-16T03:28:11.779755+0000","last_fullsized":"2023-12-16T03:28:11.779755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:58.754019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.830597+0000","last_change":"2023-12-16T03:28:12.829413+0000","last_active":"2023-12-16T03:28:12.830597+0000","last_peered":"2023-12-16T03:28:12.830597+0000","last_clean":"2023-12-16T03:28:12.830597+0000","last_became_active":"2023-12-16T03:28:12.829074+0000","last_became_peered":"2023-12-16T03:28:12.829074+0000","last_unstale":"2023-12-16T03:28:12.830597+0000","last_undegraded":"2023-12-16T03:28:12.830597+0000","last_fullsized":"2023-12-16T03:28:12.830597+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:03:48.039286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.780156+0000","last_change":"2023-12-16T03:27:59.718827+0000","last_active":"2023-12-16T03:28:11.780156+0000","last_peered":"2023-12-16T03:28:11.780156+0000","last_clean":"2023-12-16T03:28:11.780156+0000","last_became_active":"2023-12-16T03:27:59.718127+0000","last_became_peered":"2023-12-16T03:27:59.718127+0000","last_unstale":"2023-12-16T03:28:11.780156+0000","last_undegraded":"2023-12-16T03:28:11.780156+0000","last_fullsized":"2023-12-16T03:28:11.780156+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:26:55.561580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817745+0000","last_change":"2023-12-16T03:28:12.809665+0000","last_active":"2023-12-16T03:28:12.817745+0000","last_peered":"2023-12-16T03:28:12.817745+0000","last_clean":"2023-12-16T03:28:12.817745+0000","last_became_active":"2023-12-16T03:28:12.809379+0000","last_became_peered":"2023-12-16T03:28:12.809379+0000","last_unstale":"2023-12-16T03:28:12.817745+0000","last_undegraded":"2023-12-16T03:28:12.817745+0000","last_fullsized":"2023-12-16T03:28:12.817745+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:26:56.241423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767497+0000","last_change":"2023-12-16T03:27:59.725235+0000","last_active":"2023-12-16T03:28:11.767497+0000","last_peered":"2023-12-16T03:28:11.767497+0000","last_clean":"2023-12-16T03:28:11.767497+0000","last_became_active":"2023-12-16T03:27:59.720567+0000","last_became_peered":"2023-12-16T03:27:59.720567+0000","last_unstale":"2023-12-16T03:28:11.767497+0000","last_undegraded":"2023-12-16T03:28:11.767497+0000","last_fullsized":"2023-12-16T03:28:11.767497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:57.134718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817267+0000","last_change":"2023-12-16T03:28:12.803510+0000","last_active":"2023-12-16T03:28:12.817267+0000","last_peered":"2023-12-16T03:28:12.817267+0000","last_clean":"2023-12-16T03:28:12.817267+0000","last_became_active":"2023-12-16T03:28:12.803146+0000","last_became_peered":"2023-12-16T03:28:12.803146+0000","last_unstale":"2023-12-16T03:28:12.817267+0000","last_undegraded":"2023-12-16T03:28:12.817267+0000","last_fullsized":"2023-12-16T03:28:12.817267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:13:50.753237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769745+0000","last_change":"2023-12-16T03:27:59.733876+0000","last_active":"2023-12-16T03:28:11.769745+0000","last_peered":"2023-12-16T03:28:11.769745+0000","last_clean":"2023-12-16T03:28:11.769745+0000","last_became_active":"2023-12-16T03:27:59.733338+0000","last_became_peered":"2023-12-16T03:27:59.733338+0000","last_unstale":"2023-12-16T03:28:11.769745+0000","last_undegraded":"2023-12-16T03:28:11.769745+0000","last_fullsized":"2023-12-16T03:28:11.769745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:06.347016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823397+0000","last_change":"2023-12-16T03:28:12.813238+0000","last_active":"2023-12-16T03:28:12.823397+0000","last_peered":"2023-12-16T03:28:12.823397+0000","last_clean":"2023-12-16T03:28:12.823397+0000","last_became_active":"2023-12-16T03:28:12.812947+0000","last_became_peered":"2023-12-16T03:28:12.812947+0000","last_unstale":"2023-12-16T03:28:12.823397+0000","last_undegraded":"2023-12-16T03:28:12.823397+0000","last_fullsized":"2023-12-16T03:28:12.823397+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:59.724251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.776736+0000","last_change":"2023-12-16T03:27:59.737553+0000","last_active":"2023-12-16T03:28:11.776736+0000","last_peered":"2023-12-16T03:28:11.776736+0000","last_clean":"2023-12-16T03:28:11.776736+0000","last_became_active":"2023-12-16T03:27:59.737272+0000","last_became_peered":"2023-12-16T03:27:59.737272+0000","last_unstale":"2023-12-16T03:28:11.776736+0000","last_undegraded":"2023-12-16T03:28:11.776736+0000","last_fullsized":"2023-12-16T03:28:11.776736+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:51.828325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.828016+0000","last_change":"2023-12-16T03:28:12.811528+0000","last_active":"2023-12-16T03:28:12.828016+0000","last_peered":"2023-12-16T03:28:12.828016+0000","last_clean":"2023-12-16T03:28:12.828016+0000","last_became_active":"2023-12-16T03:28:12.811223+0000","last_became_peered":"2023-12-16T03:28:12.811223+0000","last_unstale":"2023-12-16T03:28:12.828016+0000","last_undegraded":"2023-12-16T03:28:12.828016+0000","last_fullsized":"2023-12-16T03:28:12.828016+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.175468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765051+0000","last_change":"2023-12-16T03:27:59.730293+0000","last_active":"2023-12-16T03:28:11.765051+0000","last_peered":"2023-12-16T03:28:11.765051+0000","last_clean":"2023-12-16T03:28:11.765051+0000","last_became_active":"2023-12-16T03:27:59.725734+0000","last_became_peered":"2023-12-16T03:27:59.725734+0000","last_unstale":"2023-12-16T03:28:11.765051+0000","last_undegraded":"2023-12-16T03:28:11.765051+0000","last_fullsized":"2023-12-16T03:28:11.765051+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:45.169228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823655+0000","last_change":"2023-12-16T03:28:12.819623+0000","last_active":"2023-12-16T03:28:12.823655+0000","last_peered":"2023-12-16T03:28:12.823655+0000","last_clean":"2023-12-16T03:28:12.823655+0000","last_became_active":"2023-12-16T03:28:12.819289+0000","last_became_peered":"2023-12-16T03:28:12.819289+0000","last_unstale":"2023-12-16T03:28:12.823655+0000","last_undegraded":"2023-12-16T03:28:12.823655+0000","last_fullsized":"2023-12-16T03:28:12.823655+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:29:57.891539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.774060+0000","last_change":"2023-12-16T03:27:59.736580+0000","last_active":"2023-12-16T03:28:11.774060+0000","last_peered":"2023-12-16T03:28:11.774060+0000","last_clean":"2023-12-16T03:28:11.774060+0000","last_became_active":"2023-12-16T03:27:59.736291+0000","last_became_peered":"2023-12-16T03:27:59.736291+0000","last_unstale":"2023-12-16T03:28:11.774060+0000","last_undegraded":"2023-12-16T03:28:11.774060+0000","last_fullsized":"2023-12-16T03:28:11.774060+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:54:46.410977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.825935+0000","last_change":"2023-12-16T03:28:12.807562+0000","last_active":"2023-12-16T03:28:12.825935+0000","last_peered":"2023-12-16T03:28:12.825935+0000","last_clean":"2023-12-16T03:28:12.825935+0000","last_became_active":"2023-12-16T03:28:12.807291+0000","last_became_peered":"2023-12-16T03:28:12.807291+0000","last_unstale":"2023-12-16T03:28:12.825935+0000","last_undegraded":"2023-12-16T03:28:12.825935+0000","last_fullsized":"2023-12-16T03:28:12.825935+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:51:38.457946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.777688+0000","last_change":"2023-12-16T03:27:59.738532+0000","last_active":"2023-12-16T03:28:11.777688+0000","last_peered":"2023-12-16T03:28:11.777688+0000","last_clean":"2023-12-16T03:28:11.777688+0000","last_became_active":"2023-12-16T03:27:59.735740+0000","last_became_peered":"2023-12-16T03:27:59.735740+0000","last_unstale":"2023-12-16T03:28:11.777688+0000","last_undegraded":"2023-12-16T03:28:11.777688+0000","last_fullsized":"2023-12-16T03:28:11.777688+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:45:58.145120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823470+0000","last_change":"2023-12-16T03:28:12.818641+0000","last_active":"2023-12-16T03:28:12.823470+0000","last_peered":"2023-12-16T03:28:12.823470+0000","last_clean":"2023-12-16T03:28:12.823470+0000","last_became_active":"2023-12-16T03:28:12.817241+0000","last_became_peered":"2023-12-16T03:28:12.817241+0000","last_unstale":"2023-12-16T03:28:12.823470+0000","last_undegraded":"2023-12-16T03:28:12.823470+0000","last_fullsized":"2023-12-16T03:28:12.823470+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:03:48.039286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781887+0000","last_change":"2023-12-16T03:27:59.724263+0000","last_active":"2023-12-16T03:28:11.781887+0000","last_peered":"2023-12-16T03:28:11.781887+0000","last_clean":"2023-12-16T03:28:11.781887+0000","last_became_active":"2023-12-16T03:27:59.723977+0000","last_became_peered":"2023-12-16T03:27:59.723977+0000","last_unstale":"2023-12-16T03:28:11.781887+0000","last_undegraded":"2023-12-16T03:28:11.781887+0000","last_fullsized":"2023-12-16T03:28:11.781887+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:25.732965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818316+0000","last_change":"2023-12-16T03:28:12.804296+0000","last_active":"2023-12-16T03:28:12.818316+0000","last_peered":"2023-12-16T03:28:12.818316+0000","last_clean":"2023-12-16T03:28:12.818316+0000","last_became_active":"2023-12-16T03:28:12.803964+0000","last_became_peered":"2023-12-16T03:28:12.803964+0000","last_unstale":"2023-12-16T03:28:12.818316+0000","last_undegraded":"2023-12-16T03:28:12.818316+0000","last_fullsized":"2023-12-16T03:28:12.818316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:22:03.418997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779626+0000","last_change":"2023-12-16T03:27:59.731798+0000","last_active":"2023-12-16T03:28:11.779626+0000","last_peered":"2023-12-16T03:28:11.779626+0000","last_clean":"2023-12-16T03:28:11.779626+0000","last_became_active":"2023-12-16T03:27:59.731495+0000","last_became_peered":"2023-12-16T03:27:59.731495+0000","last_unstale":"2023-12-16T03:28:11.779626+0000","last_undegraded":"2023-12-16T03:28:11.779626+0000","last_fullsized":"2023-12-16T03:28:11.779626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:45.169228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.820729+0000","last_change":"2023-12-16T03:28:12.806871+0000","last_active":"2023-12-16T03:28:12.820729+0000","last_peered":"2023-12-16T03:28:12.820729+0000","last_clean":"2023-12-16T03:28:12.820729+0000","last_became_active":"2023-12-16T03:28:12.806591+0000","last_became_peered":"2023-12-16T03:28:12.806591+0000","last_unstale":"2023-12-16T03:28:12.820729+0000","last_undegraded":"2023-12-16T03:28:12.820729+0000","last_fullsized":"2023-12-16T03:28:12.820729+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:27:00.658089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.785057+0000","last_change":"2023-12-16T03:27:59.735415+0000","last_active":"2023-12-16T03:28:11.785057+0000","last_peered":"2023-12-16T03:28:11.785057+0000","last_clean":"2023-12-16T03:28:11.785057+0000","last_became_active":"2023-12-16T03:27:59.735157+0000","last_became_peered":"2023-12-16T03:27:59.735157+0000","last_unstale":"2023-12-16T03:28:11.785057+0000","last_undegraded":"2023-12-16T03:28:11.785057+0000","last_fullsized":"2023-12-16T03:28:11.785057+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:00:35.229043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823358+0000","last_change":"2023-12-16T03:28:12.819248+0000","last_active":"2023-12-16T03:28:12.823358+0000","last_peered":"2023-12-16T03:28:12.823358+0000","last_clean":"2023-12-16T03:28:12.823358+0000","last_became_active":"2023-12-16T03:28:12.818954+0000","last_became_peered":"2023-12-16T03:28:12.818954+0000","last_unstale":"2023-12-16T03:28:12.823358+0000","last_undegraded":"2023-12-16T03:28:12.823358+0000","last_fullsized":"2023-12-16T03:28:12.823358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:45:19.990543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.783695+0000","last_change":"2023-12-16T03:27:59.712831+0000","last_active":"2023-12-16T03:28:11.783695+0000","last_peered":"2023-12-16T03:28:11.783695+0000","last_clean":"2023-12-16T03:28:11.783695+0000","last_became_active":"2023-12-16T03:27:59.712536+0000","last_became_peered":"2023-12-16T03:27:59.712536+0000","last_unstale":"2023-12-16T03:28:11.783695+0000","last_undegraded":"2023-12-16T03:28:11.783695+0000","last_fullsized":"2023-12-16T03:28:11.783695+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:10:50.291606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.820760+0000","last_change":"2023-12-16T03:28:12.815782+0000","last_active":"2023-12-16T03:28:12.820760+0000","last_peered":"2023-12-16T03:28:12.820760+0000","last_clean":"2023-12-16T03:28:12.820760+0000","last_became_active":"2023-12-16T03:28:12.815548+0000","last_became_peered":"2023-12-16T03:28:12.815548+0000","last_unstale":"2023-12-16T03:28:12.820760+0000","last_undegraded":"2023-12-16T03:28:12.820760+0000","last_fullsized":"2023-12-16T03:28:12.820760+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:53:05.273802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782347+0000","last_change":"2023-12-16T03:27:59.710497+0000","last_active":"2023-12-16T03:28:11.782347+0000","last_peered":"2023-12-16T03:28:11.782347+0000","last_clean":"2023-12-16T03:28:11.782347+0000","last_became_active":"2023-12-16T03:27:59.710219+0000","last_became_peered":"2023-12-16T03:27:59.710219+0000","last_unstale":"2023-12-16T03:28:11.782347+0000","last_undegraded":"2023-12-16T03:28:11.782347+0000","last_fullsized":"2023-12-16T03:28:11.782347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:24:57.766259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.816010+0000","last_change":"2023-12-16T03:28:12.813186+0000","last_active":"2023-12-16T03:28:12.816010+0000","last_peered":"2023-12-16T03:28:12.816010+0000","last_clean":"2023-12-16T03:28:12.816010+0000","last_became_active":"2023-12-16T03:28:12.812252+0000","last_became_peered":"2023-12-16T03:28:12.812252+0000","last_unstale":"2023-12-16T03:28:12.816010+0000","last_undegraded":"2023-12-16T03:28:12.816010+0000","last_fullsized":"2023-12-16T03:28:12.816010+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:24:50.227951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768129+0000","last_change":"2023-12-16T03:27:59.712771+0000","last_active":"2023-12-16T03:28:11.768129+0000","last_peered":"2023-12-16T03:28:11.768129+0000","last_clean":"2023-12-16T03:28:11.768129+0000","last_became_active":"2023-12-16T03:27:59.712506+0000","last_became_peered":"2023-12-16T03:27:59.712506+0000","last_unstale":"2023-12-16T03:28:11.768129+0000","last_undegraded":"2023-12-16T03:28:11.768129+0000","last_fullsized":"2023-12-16T03:28:11.768129+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:55:37.693337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.811381+0000","last_change":"2023-12-16T03:28:12.805199+0000","last_active":"2023-12-16T03:28:12.811381+0000","last_peered":"2023-12-16T03:28:12.811381+0000","last_clean":"2023-12-16T03:28:12.811381+0000","last_became_active":"2023-12-16T03:28:12.804911+0000","last_became_peered":"2023-12-16T03:28:12.804911+0000","last_unstale":"2023-12-16T03:28:12.811381+0000","last_undegraded":"2023-12-16T03:28:12.811381+0000","last_fullsized":"2023-12-16T03:28:12.811381+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:08.869195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.778672+0000","last_change":"2023-12-16T03:27:59.719153+0000","last_active":"2023-12-16T03:28:11.778672+0000","last_peered":"2023-12-16T03:28:11.778672+0000","last_clean":"2023-12-16T03:28:11.778672+0000","last_became_active":"2023-12-16T03:27:59.718863+0000","last_became_peered":"2023-12-16T03:27:59.718863+0000","last_unstale":"2023-12-16T03:28:11.778672+0000","last_undegraded":"2023-12-16T03:28:11.778672+0000","last_fullsized":"2023-12-16T03:28:11.778672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:40.409035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819218+0000","last_change":"2023-12-16T03:28:12.808217+0000","last_active":"2023-12-16T03:28:12.819218+0000","last_peered":"2023-12-16T03:28:12.819218+0000","last_clean":"2023-12-16T03:28:12.819218+0000","last_became_active":"2023-12-16T03:28:12.807897+0000","last_became_peered":"2023-12-16T03:28:12.807897+0000","last_unstale":"2023-12-16T03:28:12.819218+0000","last_undegraded":"2023-12-16T03:28:12.819218+0000","last_fullsized":"2023-12-16T03:28:12.819218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:24:50.227951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781731+0000","last_change":"2023-12-16T03:27:59.716721+0000","last_active":"2023-12-16T03:28:11.781731+0000","last_peered":"2023-12-16T03:28:11.781731+0000","last_clean":"2023-12-16T03:28:11.781731+0000","last_became_active":"2023-12-16T03:27:59.714950+0000","last_became_peered":"2023-12-16T03:27:59.714950+0000","last_unstale":"2023-12-16T03:28:11.781731+0000","last_undegraded":"2023-12-16T03:28:11.781731+0000","last_fullsized":"2023-12-16T03:28:11.781731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:19.672282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823282+0000","last_change":"2023-12-16T03:28:12.813431+0000","last_active":"2023-12-16T03:28:12.823282+0000","last_peered":"2023-12-16T03:28:12.823282+0000","last_clean":"2023-12-16T03:28:12.823282+0000","last_became_active":"2023-12-16T03:28:12.809937+0000","last_became_peered":"2023-12-16T03:28:12.809937+0000","last_unstale":"2023-12-16T03:28:12.823282+0000","last_undegraded":"2023-12-16T03:28:12.823282+0000","last_fullsized":"2023-12-16T03:28:12.823282+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:51:10.208389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781980+0000","last_change":"2023-12-16T03:27:59.735977+0000","last_active":"2023-12-16T03:28:11.781980+0000","last_peered":"2023-12-16T03:28:11.781980+0000","last_clean":"2023-12-16T03:28:11.781980+0000","last_became_active":"2023-12-16T03:27:59.735626+0000","last_became_peered":"2023-12-16T03:27:59.735626+0000","last_unstale":"2023-12-16T03:28:11.781980+0000","last_undegraded":"2023-12-16T03:28:11.781980+0000","last_fullsized":"2023-12-16T03:28:11.781980+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:15:14.726435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818030+0000","last_change":"2023-12-16T03:28:12.804603+0000","last_active":"2023-12-16T03:28:12.818030+0000","last_peered":"2023-12-16T03:28:12.818030+0000","last_clean":"2023-12-16T03:28:12.818030+0000","last_became_active":"2023-12-16T03:28:12.804304+0000","last_became_peered":"2023-12-16T03:28:12.804304+0000","last_unstale":"2023-12-16T03:28:12.818030+0000","last_undegraded":"2023-12-16T03:28:12.818030+0000","last_fullsized":"2023-12-16T03:28:12.818030+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:04:02.206799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767725+0000","last_change":"2023-12-16T03:27:59.711640+0000","last_active":"2023-12-16T03:28:11.767725+0000","last_peered":"2023-12-16T03:28:11.767725+0000","last_clean":"2023-12-16T03:28:11.767725+0000","last_became_active":"2023-12-16T03:27:59.711336+0000","last_became_peered":"2023-12-16T03:27:59.711336+0000","last_unstale":"2023-12-16T03:28:11.767725+0000","last_undegraded":"2023-12-16T03:28:11.767725+0000","last_fullsized":"2023-12-16T03:28:11.767725+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:55.005723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817725+0000","last_change":"2023-12-16T03:28:12.801992+0000","last_active":"2023-12-16T03:28:12.817725+0000","last_peered":"2023-12-16T03:28:12.817725+0000","last_clean":"2023-12-16T03:28:12.817725+0000","last_became_active":"2023-12-16T03:28:12.801633+0000","last_became_peered":"2023-12-16T03:28:12.801633+0000","last_unstale":"2023-12-16T03:28:12.817725+0000","last_undegraded":"2023-12-16T03:28:12.817725+0000","last_fullsized":"2023-12-16T03:28:12.817725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:39:01.590074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.780573+0000","last_change":"2023-12-16T03:27:59.718509+0000","last_active":"2023-12-16T03:28:11.780573+0000","last_peered":"2023-12-16T03:28:11.780573+0000","last_clean":"2023-12-16T03:28:11.780573+0000","last_became_active":"2023-12-16T03:27:59.718083+0000","last_became_peered":"2023-12-16T03:27:59.718083+0000","last_unstale":"2023-12-16T03:28:11.780573+0000","last_undegraded":"2023-12-16T03:28:11.780573+0000","last_fullsized":"2023-12-16T03:28:11.780573+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:33.266132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.812004+0000","last_change":"2023-12-16T03:28:12.798925+0000","last_active":"2023-12-16T03:28:12.812004+0000","last_peered":"2023-12-16T03:28:12.812004+0000","last_clean":"2023-12-16T03:28:12.812004+0000","last_became_active":"2023-12-16T03:28:12.798629+0000","last_became_peered":"2023-12-16T03:28:12.798629+0000","last_unstale":"2023-12-16T03:28:12.812004+0000","last_undegraded":"2023-12-16T03:28:12.812004+0000","last_fullsized":"2023-12-16T03:28:12.812004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:19.420688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827661+0000","last_change":"2023-12-16T03:28:11.795335+0000","last_active":"2023-12-16T03:28:12.827661+0000","last_peered":"2023-12-16T03:28:12.827661+0000","last_clean":"2023-12-16T03:28:12.827661+0000","last_became_active":"2023-12-16T03:28:11.795030+0000","last_became_peered":"2023-12-16T03:28:11.795030+0000","last_unstale":"2023-12-16T03:28:12.827661+0000","last_undegraded":"2023-12-16T03:28:12.827661+0000","last_fullsized":"2023-12-16T03:28:12.827661+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:01:36.357743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769639+0000","last_change":"2023-12-16T03:27:59.726845+0000","last_active":"2023-12-16T03:28:11.769639+0000","last_peered":"2023-12-16T03:28:11.769639+0000","last_clean":"2023-12-16T03:28:11.769639+0000","last_became_active":"2023-12-16T03:27:59.722341+0000","last_became_peered":"2023-12-16T03:27:59.722341+0000","last_unstale":"2023-12-16T03:28:11.769639+0000","last_undegraded":"2023-12-16T03:28:11.769639+0000","last_fullsized":"2023-12-16T03:28:11.769639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:21.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781343+0000","last_change":"2023-12-16T03:27:58.719610+0000","last_active":"2023-12-16T03:28:11.781343+0000","last_peered":"2023-12-16T03:28:11.781343+0000","last_clean":"2023-12-16T03:28:11.781343+0000","last_became_active":"2023-12-16T03:27:58.719344+0000","last_became_peered":"2023-12-16T03:27:58.719344+0000","last_unstale":"2023-12-16T03:28:11.781343+0000","last_undegraded":"2023-12-16T03:28:11.781343+0000","last_fullsized":"2023-12-16T03:28:11.781343+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:55:36.684947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.810041+0000","last_change":"2023-12-16T03:28:12.798017+0000","last_active":"2023-12-16T03:28:12.810041+0000","last_peered":"2023-12-16T03:28:12.810041+0000","last_clean":"2023-12-16T03:28:12.810041+0000","last_became_active":"2023-12-16T03:28:12.797718+0000","last_became_peered":"2023-12-16T03:28:12.797718+0000","last_unstale":"2023-12-16T03:28:12.810041+0000","last_undegraded":"2023-12-16T03:28:12.810041+0000","last_fullsized":"2023-12-16T03:28:12.810041+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:27:08.635252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.824521+0000","last_change":"2023-12-16T03:28:11.784507+0000","last_active":"2023-12-16T03:28:12.824521+0000","last_peered":"2023-12-16T03:28:12.824521+0000","last_clean":"2023-12-16T03:28:12.824521+0000","last_became_active":"2023-12-16T03:28:11.784209+0000","last_became_peered":"2023-12-16T03:28:11.784209+0000","last_unstale":"2023-12-16T03:28:12.824521+0000","last_undegraded":"2023-12-16T03:28:12.824521+0000","last_fullsized":"2023-12-16T03:28:12.824521+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:44.401345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781157+0000","last_change":"2023-12-16T03:27:59.724069+0000","last_active":"2023-12-16T03:28:11.781157+0000","last_peered":"2023-12-16T03:28:11.781157+0000","last_clean":"2023-12-16T03:28:11.781157+0000","last_became_active":"2023-12-16T03:27:59.723703+0000","last_became_peered":"2023-12-16T03:27:59.723703+0000","last_unstale":"2023-12-16T03:28:11.781157+0000","last_undegraded":"2023-12-16T03:28:11.781157+0000","last_fullsized":"2023-12-16T03:28:11.781157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:40:30.607572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769762+0000","last_change":"2023-12-16T03:27:58.715152+0000","last_active":"2023-12-16T03:28:11.769762+0000","last_peered":"2023-12-16T03:28:11.769762+0000","last_clean":"2023-12-16T03:28:11.769762+0000","last_became_active":"2023-12-16T03:27:58.714836+0000","last_became_peered":"2023-12-16T03:27:58.714836+0000","last_unstale":"2023-12-16T03:28:11.769762+0000","last_undegraded":"2023-12-16T03:28:11.769762+0000","last_fullsized":"2023-12-16T03:28:11.769762+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:19:41.787545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.821238+0000","last_change":"2023-12-16T03:28:12.818491+0000","last_active":"2023-12-16T03:28:12.821238+0000","last_peered":"2023-12-16T03:28:12.821238+0000","last_clean":"2023-12-16T03:28:12.821238+0000","last_became_active":"2023-12-16T03:28:12.818098+0000","last_became_peered":"2023-12-16T03:28:12.818098+0000","last_unstale":"2023-12-16T03:28:12.821238+0000","last_undegraded":"2023-12-16T03:28:12.821238+0000","last_fullsized":"2023-12-16T03:28:12.821238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:11:03.365277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"71'4","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.828145+0000","last_change":"2023-12-16T03:28:11.789836+0000","last_active":"2023-12-16T03:28:12.828145+0000","last_peered":"2023-12-16T03:28:12.828145+0000","last_clean":"2023-12-16T03:28:12.828145+0000","last_became_active":"2023-12-16T03:28:11.789274+0000","last_became_peered":"2023-12-16T03:28:11.789274+0000","last_unstale":"2023-12-16T03:28:12.828145+0000","last_undegraded":"2023-12-16T03:28:12.828145+0000","last_fullsized":"2023-12-16T03:28:12.828145+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:11:00.573887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779101+0000","last_change":"2023-12-16T03:27:59.718830+0000","last_active":"2023-12-16T03:28:11.779101+0000","last_peered":"2023-12-16T03:28:11.779101+0000","last_clean":"2023-12-16T03:28:11.779101+0000","last_became_active":"2023-12-16T03:27:59.718490+0000","last_became_peered":"2023-12-16T03:27:59.718490+0000","last_unstale":"2023-12-16T03:28:11.779101+0000","last_undegraded":"2023-12-16T03:28:11.779101+0000","last_fullsized":"2023-12-16T03:28:11.779101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:21.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765921+0000","last_change":"2023-12-16T03:27:58.716124+0000","last_active":"2023-12-16T03:28:11.765921+0000","last_peered":"2023-12-16T03:28:11.765921+0000","last_clean":"2023-12-16T03:28:11.765921+0000","last_became_active":"2023-12-16T03:27:58.715821+0000","last_became_peered":"2023-12-16T03:27:58.715821+0000","last_unstale":"2023-12-16T03:28:11.765921+0000","last_undegraded":"2023-12-16T03:28:11.765921+0000","last_fullsized":"2023-12-16T03:28:11.765921+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:05.338626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819410+0000","last_change":"2023-12-16T03:28:12.815994+0000","last_active":"2023-12-16T03:28:12.819410+0000","last_peered":"2023-12-16T03:28:12.819410+0000","last_clean":"2023-12-16T03:28:12.819410+0000","last_became_active":"2023-12-16T03:28:12.815688+0000","last_became_peered":"2023-12-16T03:28:12.815688+0000","last_unstale":"2023-12-16T03:28:12.819410+0000","last_undegraded":"2023-12-16T03:28:12.819410+0000","last_fullsized":"2023-12-16T03:28:12.819410+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.407819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.814558+0000","last_change":"2023-12-16T03:28:11.791486+0000","last_active":"2023-12-16T03:28:12.814558+0000","last_peered":"2023-12-16T03:28:12.814558+0000","last_clean":"2023-12-16T03:28:12.814558+0000","last_became_active":"2023-12-16T03:28:11.791004+0000","last_became_peered":"2023-12-16T03:28:11.791004+0000","last_unstale":"2023-12-16T03:28:12.814558+0000","last_undegraded":"2023-12-16T03:28:12.814558+0000","last_fullsized":"2023-12-16T03:28:12.814558+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:29:56.885065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781228+0000","last_change":"2023-12-16T03:27:59.733764+0000","last_active":"2023-12-16T03:28:11.781228+0000","last_peered":"2023-12-16T03:28:11.781228+0000","last_clean":"2023-12-16T03:28:11.781228+0000","last_became_active":"2023-12-16T03:27:59.733395+0000","last_became_peered":"2023-12-16T03:27:59.733395+0000","last_unstale":"2023-12-16T03:28:11.781228+0000","last_undegraded":"2023-12-16T03:28:11.781228+0000","last_fullsized":"2023-12-16T03:28:11.781228+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:34.741103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765786+0000","last_change":"2023-12-16T03:27:58.716176+0000","last_active":"2023-12-16T03:28:11.765786+0000","last_peered":"2023-12-16T03:28:11.765786+0000","last_clean":"2023-12-16T03:28:11.765786+0000","last_became_active":"2023-12-16T03:27:58.714966+0000","last_became_peered":"2023-12-16T03:27:58.714966+0000","last_unstale":"2023-12-16T03:28:11.765786+0000","last_undegraded":"2023-12-16T03:28:11.765786+0000","last_fullsized":"2023-12-16T03:28:11.765786+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:44.133983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.812345+0000","last_change":"2023-12-16T03:28:12.798196+0000","last_active":"2023-12-16T03:28:12.812345+0000","last_peered":"2023-12-16T03:28:12.812345+0000","last_clean":"2023-12-16T03:28:12.812345+0000","last_became_active":"2023-12-16T03:28:12.797907+0000","last_became_peered":"2023-12-16T03:28:12.797907+0000","last_unstale":"2023-12-16T03:28:12.812345+0000","last_undegraded":"2023-12-16T03:28:12.812345+0000","last_fullsized":"2023-12-16T03:28:12.812345+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:43:22.570453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.794322+0000","last_change":"2023-12-16T03:28:11.793820+0000","last_active":"2023-12-16T03:28:12.794322+0000","last_peered":"2023-12-16T03:28:12.794322+0000","last_clean":"2023-12-16T03:28:12.794322+0000","last_became_active":"2023-12-16T03:28:11.793529+0000","last_became_peered":"2023-12-16T03:28:11.793529+0000","last_unstale":"2023-12-16T03:28:12.794322+0000","last_undegraded":"2023-12-16T03:28:12.794322+0000","last_fullsized":"2023-12-16T03:28:12.794322+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:44.401345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782069+0000","last_change":"2023-12-16T03:27:59.734193+0000","last_active":"2023-12-16T03:28:11.782069+0000","last_peered":"2023-12-16T03:28:11.782069+0000","last_clean":"2023-12-16T03:28:11.782069+0000","last_became_active":"2023-12-16T03:27:59.733906+0000","last_became_peered":"2023-12-16T03:27:59.733906+0000","last_unstale":"2023-12-16T03:28:11.782069+0000","last_undegraded":"2023-12-16T03:28:11.782069+0000","last_fullsized":"2023-12-16T03:28:11.782069+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:27:07.594429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768051+0000","last_change":"2023-12-16T03:27:58.722406+0000","last_active":"2023-12-16T03:28:11.768051+0000","last_peered":"2023-12-16T03:28:11.768051+0000","last_clean":"2023-12-16T03:28:11.768051+0000","last_became_active":"2023-12-16T03:27:58.722107+0000","last_became_peered":"2023-12-16T03:27:58.722107+0000","last_unstale":"2023-12-16T03:28:11.768051+0000","last_undegraded":"2023-12-16T03:28:11.768051+0000","last_fullsized":"2023-12-16T03:28:11.768051+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:27:42.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818672+0000","last_change":"2023-12-16T03:28:12.807087+0000","last_active":"2023-12-16T03:28:12.818672+0000","last_peered":"2023-12-16T03:28:12.818672+0000","last_clean":"2023-12-16T03:28:12.818672+0000","last_became_active":"2023-12-16T03:28:12.806613+0000","last_became_peered":"2023-12-16T03:28:12.806613+0000","last_unstale":"2023-12-16T03:28:12.818672+0000","last_undegraded":"2023-12-16T03:28:12.818672+0000","last_fullsized":"2023-12-16T03:28:12.818672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.175468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.781701+0000","last_change":"2023-12-16T03:28:11.793806+0000","last_active":"2023-12-16T03:28:12.781701+0000","last_peered":"2023-12-16T03:28:12.781701+0000","last_clean":"2023-12-16T03:28:12.781701+0000","last_became_active":"2023-12-16T03:28:11.792942+0000","last_became_peered":"2023-12-16T03:28:11.792942+0000","last_unstale":"2023-12-16T03:28:12.781701+0000","last_undegraded":"2023-12-16T03:28:12.781701+0000","last_fullsized":"2023-12-16T03:28:12.781701+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:19:54.863132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767890+0000","last_change":"2023-12-16T03:27:59.733566+0000","last_active":"2023-12-16T03:28:11.767890+0000","last_peered":"2023-12-16T03:28:11.767890+0000","last_clean":"2023-12-16T03:28:11.767890+0000","last_became_active":"2023-12-16T03:27:59.733308+0000","last_became_peered":"2023-12-16T03:27:59.733308+0000","last_unstale":"2023-12-16T03:28:11.767890+0000","last_undegraded":"2023-12-16T03:28:11.767890+0000","last_fullsized":"2023-12-16T03:28:11.767890+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:20:58.921708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768095+0000","last_change":"2023-12-16T03:27:58.717341+0000","last_active":"2023-12-16T03:28:11.768095+0000","last_peered":"2023-12-16T03:28:11.768095+0000","last_clean":"2023-12-16T03:28:11.768095+0000","last_became_active":"2023-12-16T03:27:58.717037+0000","last_became_peered":"2023-12-16T03:27:58.717037+0000","last_unstale":"2023-12-16T03:28:11.768095+0000","last_undegraded":"2023-12-16T03:28:11.768095+0000","last_fullsized":"2023-12-16T03:28:11.768095+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:26:30.859183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.813584+0000","last_change":"2023-12-16T03:28:12.811683+0000","last_active":"2023-12-16T03:28:12.813584+0000","last_peered":"2023-12-16T03:28:12.813584+0000","last_clean":"2023-12-16T03:28:12.813584+0000","last_became_active":"2023-12-16T03:28:12.811042+0000","last_became_peered":"2023-12-16T03:28:12.811042+0000","last_unstale":"2023-12-16T03:28:12.813584+0000","last_undegraded":"2023-12-16T03:28:12.813584+0000","last_fullsized":"2023-12-16T03:28:12.813584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:52.019367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.820374+0000","last_change":"2023-12-16T03:28:11.786803+0000","last_active":"2023-12-16T03:28:12.820374+0000","last_peered":"2023-12-16T03:28:12.820374+0000","last_clean":"2023-12-16T03:28:12.820374+0000","last_became_active":"2023-12-16T03:28:11.786512+0000","last_became_peered":"2023-12-16T03:28:11.786512+0000","last_unstale":"2023-12-16T03:28:12.820374+0000","last_undegraded":"2023-12-16T03:28:12.820374+0000","last_fullsized":"2023-12-16T03:28:12.820374+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:23:07.072921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.775313+0000","last_change":"2023-12-16T03:27:59.723598+0000","last_active":"2023-12-16T03:28:11.775313+0000","last_peered":"2023-12-16T03:28:11.775313+0000","last_clean":"2023-12-16T03:28:11.775313+0000","last_became_active":"2023-12-16T03:27:59.723319+0000","last_became_peered":"2023-12-16T03:27:59.723319+0000","last_unstale":"2023-12-16T03:28:11.775313+0000","last_undegraded":"2023-12-16T03:28:11.775313+0000","last_fullsized":"2023-12-16T03:28:11.775313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:05:45.169228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.764871+0000","last_change":"2023-12-16T03:27:58.703166+0000","last_active":"2023-12-16T03:28:11.764871+0000","last_peered":"2023-12-16T03:28:11.764871+0000","last_clean":"2023-12-16T03:28:11.764871+0000","last_became_active":"2023-12-16T03:27:58.702889+0000","last_became_peered":"2023-12-16T03:27:58.702889+0000","last_unstale":"2023-12-16T03:28:11.764871+0000","last_undegraded":"2023-12-16T03:28:11.764871+0000","last_fullsized":"2023-12-16T03:28:11.764871+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:19:41.787545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817730+0000","last_change":"2023-12-16T03:28:12.815614+0000","last_active":"2023-12-16T03:28:12.817730+0000","last_peered":"2023-12-16T03:28:12.817730+0000","last_clean":"2023-12-16T03:28:12.817730+0000","last_became_active":"2023-12-16T03:28:12.815287+0000","last_became_peered":"2023-12-16T03:28:12.815287+0000","last_unstale":"2023-12-16T03:28:12.817730+0000","last_undegraded":"2023-12-16T03:28:12.817730+0000","last_fullsized":"2023-12-16T03:28:12.817730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:42:42.681540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827341+0000","last_change":"2023-12-16T03:28:11.790770+0000","last_active":"2023-12-16T03:28:12.827341+0000","last_peered":"2023-12-16T03:28:12.827341+0000","last_clean":"2023-12-16T03:28:12.827341+0000","last_became_active":"2023-12-16T03:28:11.790335+0000","last_became_peered":"2023-12-16T03:28:11.790335+0000","last_unstale":"2023-12-16T03:28:12.827341+0000","last_undegraded":"2023-12-16T03:28:12.827341+0000","last_fullsized":"2023-12-16T03:28:12.827341+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:24:49.221477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.780237+0000","last_change":"2023-12-16T03:27:59.718875+0000","last_active":"2023-12-16T03:28:11.780237+0000","last_peered":"2023-12-16T03:28:11.780237+0000","last_clean":"2023-12-16T03:28:11.780237+0000","last_became_active":"2023-12-16T03:27:59.718513+0000","last_became_peered":"2023-12-16T03:27:59.718513+0000","last_unstale":"2023-12-16T03:28:11.780237+0000","last_undegraded":"2023-12-16T03:28:11.780237+0000","last_fullsized":"2023-12-16T03:28:11.780237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:20.215362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782490+0000","last_change":"2023-12-16T03:27:58.723547+0000","last_active":"2023-12-16T03:28:11.782490+0000","last_peered":"2023-12-16T03:28:11.782490+0000","last_clean":"2023-12-16T03:28:11.782490+0000","last_became_active":"2023-12-16T03:27:58.723244+0000","last_became_peered":"2023-12-16T03:27:58.723244+0000","last_unstale":"2023-12-16T03:28:11.782490+0000","last_undegraded":"2023-12-16T03:28:11.782490+0000","last_fullsized":"2023-12-16T03:28:11.782490+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:40:50.819935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819057+0000","last_change":"2023-12-16T03:28:12.814953+0000","last_active":"2023-12-16T03:28:12.819057+0000","last_peered":"2023-12-16T03:28:12.819057+0000","last_clean":"2023-12-16T03:28:12.819057+0000","last_became_active":"2023-12-16T03:28:12.813413+0000","last_became_peered":"2023-12-16T03:28:12.813413+0000","last_unstale":"2023-12-16T03:28:12.819057+0000","last_undegraded":"2023-12-16T03:28:12.819057+0000","last_fullsized":"2023-12-16T03:28:12.819057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:30:51.175468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"71'3","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823455+0000","last_change":"2023-12-16T03:28:11.787108+0000","last_active":"2023-12-16T03:28:12.823455+0000","last_peered":"2023-12-16T03:28:12.823455+0000","last_clean":"2023-12-16T03:28:12.823455+0000","last_became_active":"2023-12-16T03:28:11.786653+0000","last_became_peered":"2023-12-16T03:28:11.786653+0000","last_unstale":"2023-12-16T03:28:12.823455+0000","last_undegraded":"2023-12-16T03:28:12.823455+0000","last_fullsized":"2023-12-16T03:28:12.823455+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:22:57.123345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.777367+0000","last_change":"2023-12-16T03:27:59.717795+0000","last_active":"2023-12-16T03:28:11.777367+0000","last_peered":"2023-12-16T03:28:11.777367+0000","last_clean":"2023-12-16T03:28:11.777367+0000","last_became_active":"2023-12-16T03:27:59.717470+0000","last_became_peered":"2023-12-16T03:27:59.717470+0000","last_unstale":"2023-12-16T03:28:11.777367+0000","last_undegraded":"2023-12-16T03:28:11.777367+0000","last_fullsized":"2023-12-16T03:28:11.777367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:10.829694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781437+0000","last_change":"2023-12-16T03:27:58.717293+0000","last_active":"2023-12-16T03:28:11.781437+0000","last_peered":"2023-12-16T03:28:11.781437+0000","last_clean":"2023-12-16T03:28:11.781437+0000","last_became_active":"2023-12-16T03:27:58.716996+0000","last_became_peered":"2023-12-16T03:27:58.716996+0000","last_unstale":"2023-12-16T03:28:11.781437+0000","last_undegraded":"2023-12-16T03:28:11.781437+0000","last_fullsized":"2023-12-16T03:28:11.781437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:42.424788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.831151+0000","last_change":"2023-12-16T03:28:12.827156+0000","last_active":"2023-12-16T03:28:12.831151+0000","last_peered":"2023-12-16T03:28:12.831151+0000","last_clean":"2023-12-16T03:28:12.831151+0000","last_became_active":"2023-12-16T03:28:12.826829+0000","last_became_peered":"2023-12-16T03:28:12.826829+0000","last_unstale":"2023-12-16T03:28:12.831151+0000","last_undegraded":"2023-12-16T03:28:12.831151+0000","last_fullsized":"2023-12-16T03:28:12.831151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:24:50.227951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"71'6","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.829719+0000","last_change":"2023-12-16T03:28:11.790693+0000","last_active":"2023-12-16T03:28:12.829719+0000","last_peered":"2023-12-16T03:28:12.829719+0000","last_clean":"2023-12-16T03:28:12.829719+0000","last_became_active":"2023-12-16T03:28:11.790311+0000","last_became_peered":"2023-12-16T03:28:11.790311+0000","last_unstale":"2023-12-16T03:28:12.829719+0000","last_undegraded":"2023-12-16T03:28:12.829719+0000","last_fullsized":"2023-12-16T03:28:12.829719+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:51:37.451472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769446+0000","last_change":"2023-12-16T03:27:59.734554+0000","last_active":"2023-12-16T03:28:11.769446+0000","last_peered":"2023-12-16T03:28:11.769446+0000","last_clean":"2023-12-16T03:28:11.769446+0000","last_became_active":"2023-12-16T03:27:59.734106+0000","last_became_peered":"2023-12-16T03:27:59.734106+0000","last_unstale":"2023-12-16T03:28:11.769446+0000","last_undegraded":"2023-12-16T03:28:11.769446+0000","last_fullsized":"2023-12-16T03:28:11.769446+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:45.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781878+0000","last_change":"2023-12-16T03:27:58.711663+0000","last_active":"2023-12-16T03:28:11.781878+0000","last_peered":"2023-12-16T03:28:11.781878+0000","last_clean":"2023-12-16T03:28:11.781878+0000","last_became_active":"2023-12-16T03:27:58.711356+0000","last_became_peered":"2023-12-16T03:27:58.711356+0000","last_unstale":"2023-12-16T03:28:11.781878+0000","last_undegraded":"2023-12-16T03:28:11.781878+0000","last_fullsized":"2023-12-16T03:28:11.781878+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:33:05.338626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827449+0000","last_change":"2023-12-16T03:28:12.821986+0000","last_active":"2023-12-16T03:28:12.827449+0000","last_peered":"2023-12-16T03:28:12.827449+0000","last_clean":"2023-12-16T03:28:12.827449+0000","last_became_active":"2023-12-16T03:28:12.821621+0000","last_became_peered":"2023-12-16T03:28:12.821621+0000","last_unstale":"2023-12-16T03:28:12.827449+0000","last_undegraded":"2023-12-16T03:28:12.827449+0000","last_fullsized":"2023-12-16T03:28:12.827449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:22:58.129819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.785338+0000","last_change":"2023-12-16T03:28:11.788902+0000","last_active":"2023-12-16T03:28:12.785338+0000","last_peered":"2023-12-16T03:28:12.785338+0000","last_clean":"2023-12-16T03:28:12.785338+0000","last_became_active":"2023-12-16T03:28:11.788217+0000","last_became_peered":"2023-12-16T03:28:11.788217+0000","last_unstale":"2023-12-16T03:28:12.785338+0000","last_undegraded":"2023-12-16T03:28:12.785338+0000","last_fullsized":"2023-12-16T03:28:12.785338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:33.441623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765672+0000","last_change":"2023-12-16T03:27:59.727694+0000","last_active":"2023-12-16T03:28:11.765672+0000","last_peered":"2023-12-16T03:28:11.765672+0000","last_clean":"2023-12-16T03:28:11.765672+0000","last_became_active":"2023-12-16T03:27:59.727388+0000","last_became_peered":"2023-12-16T03:27:59.727388+0000","last_unstale":"2023-12-16T03:28:11.765672+0000","last_undegraded":"2023-12-16T03:28:11.765672+0000","last_fullsized":"2023-12-16T03:28:11.765672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:06:37.917845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779041+0000","last_change":"2023-12-16T03:27:58.716440+0000","last_active":"2023-12-16T03:28:11.779041+0000","last_peered":"2023-12-16T03:28:11.779041+0000","last_clean":"2023-12-16T03:28:11.779041+0000","last_became_active":"2023-12-16T03:27:58.716067+0000","last_became_peered":"2023-12-16T03:27:58.716067+0000","last_unstale":"2023-12-16T03:28:11.779041+0000","last_undegraded":"2023-12-16T03:28:11.779041+0000","last_fullsized":"2023-12-16T03:28:11.779041+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:27:06.586039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819682+0000","last_change":"2023-12-16T03:28:12.805703+0000","last_active":"2023-12-16T03:28:12.819682+0000","last_peered":"2023-12-16T03:28:12.819682+0000","last_clean":"2023-12-16T03:28:12.819682+0000","last_became_active":"2023-12-16T03:28:12.802612+0000","last_became_peered":"2023-12-16T03:28:12.802612+0000","last_unstale":"2023-12-16T03:28:12.819682+0000","last_undegraded":"2023-12-16T03:28:12.819682+0000","last_fullsized":"2023-12-16T03:28:12.819682+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:08:14.864292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.795148+0000","last_change":"2023-12-16T03:28:11.797743+0000","last_active":"2023-12-16T03:28:12.795148+0000","last_peered":"2023-12-16T03:28:12.795148+0000","last_clean":"2023-12-16T03:28:12.795148+0000","last_became_active":"2023-12-16T03:28:11.797125+0000","last_became_peered":"2023-12-16T03:28:11.797125+0000","last_unstale":"2023-12-16T03:28:12.795148+0000","last_undegraded":"2023-12-16T03:28:12.795148+0000","last_fullsized":"2023-12-16T03:28:12.795148+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:22:57.123345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768166+0000","last_change":"2023-12-16T03:27:59.724678+0000","last_active":"2023-12-16T03:28:11.768166+0000","last_peered":"2023-12-16T03:28:11.768166+0000","last_clean":"2023-12-16T03:28:11.768166+0000","last_became_active":"2023-12-16T03:27:59.724328+0000","last_became_peered":"2023-12-16T03:27:59.724328+0000","last_unstale":"2023-12-16T03:28:11.768166+0000","last_undegraded":"2023-12-16T03:28:11.768166+0000","last_fullsized":"2023-12-16T03:28:11.768166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:43.433178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767841+0000","last_change":"2023-12-16T03:27:58.716691+0000","last_active":"2023-12-16T03:28:11.767841+0000","last_peered":"2023-12-16T03:28:11.767841+0000","last_clean":"2023-12-16T03:28:11.767841+0000","last_became_active":"2023-12-16T03:27:58.716447+0000","last_became_peered":"2023-12-16T03:27:58.716447+0000","last_unstale":"2023-12-16T03:28:11.767841+0000","last_undegraded":"2023-12-16T03:28:11.767841+0000","last_fullsized":"2023-12-16T03:28:11.767841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:27:42.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.810165+0000","last_change":"2023-12-16T03:28:12.798613+0000","last_active":"2023-12-16T03:28:12.810165+0000","last_peered":"2023-12-16T03:28:12.810165+0000","last_clean":"2023-12-16T03:28:12.810165+0000","last_became_active":"2023-12-16T03:28:12.798309+0000","last_became_peered":"2023-12-16T03:28:12.798309+0000","last_unstale":"2023-12-16T03:28:12.810165+0000","last_undegraded":"2023-12-16T03:28:12.810165+0000","last_fullsized":"2023-12-16T03:28:12.810165+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:04:23.903366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.787625+0000","last_change":"2023-12-16T03:28:11.780708+0000","last_active":"2023-12-16T03:28:12.787625+0000","last_peered":"2023-12-16T03:28:12.787625+0000","last_clean":"2023-12-16T03:28:12.787625+0000","last_became_active":"2023-12-16T03:28:11.780418+0000","last_became_peered":"2023-12-16T03:28:11.780418+0000","last_unstale":"2023-12-16T03:28:12.787625+0000","last_undegraded":"2023-12-16T03:28:12.787625+0000","last_fullsized":"2023-12-16T03:28:12.787625+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:30:07.862721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765074+0000","last_change":"2023-12-16T03:27:59.719384+0000","last_active":"2023-12-16T03:28:11.765074+0000","last_peered":"2023-12-16T03:28:11.765074+0000","last_clean":"2023-12-16T03:28:11.765074+0000","last_became_active":"2023-12-16T03:27:59.718520+0000","last_became_peered":"2023-12-16T03:27:59.718520+0000","last_unstale":"2023-12-16T03:28:11.765074+0000","last_undegraded":"2023-12-16T03:28:11.765074+0000","last_fullsized":"2023-12-16T03:28:11.765074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:40.409035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781910+0000","last_change":"2023-12-16T03:27:58.721903+0000","last_active":"2023-12-16T03:28:11.781910+0000","last_peered":"2023-12-16T03:28:11.781910+0000","last_clean":"2023-12-16T03:28:11.781910+0000","last_became_active":"2023-12-16T03:27:58.721611+0000","last_became_peered":"2023-12-16T03:27:58.721611+0000","last_unstale":"2023-12-16T03:28:11.781910+0000","last_undegraded":"2023-12-16T03:28:11.781910+0000","last_fullsized":"2023-12-16T03:28:11.781910+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:08:43.973478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.805698+0000","last_change":"2023-12-16T03:28:12.796247+0000","last_active":"2023-12-16T03:28:12.805698+0000","last_peered":"2023-12-16T03:28:12.805698+0000","last_clean":"2023-12-16T03:28:12.805698+0000","last_became_active":"2023-12-16T03:28:12.795955+0000","last_became_peered":"2023-12-16T03:28:12.795955+0000","last_unstale":"2023-12-16T03:28:12.805698+0000","last_undegraded":"2023-12-16T03:28:12.805698+0000","last_fullsized":"2023-12-16T03:28:12.805698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:53:19.206136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"71'8","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.829423+0000","last_change":"2023-12-16T03:28:11.787013+0000","last_active":"2023-12-16T03:28:12.829423+0000","last_peered":"2023-12-16T03:28:12.829423+0000","last_clean":"2023-12-16T03:28:12.829423+0000","last_became_active":"2023-12-16T03:28:11.786697+0000","last_became_peered":"2023-12-16T03:28:11.786697+0000","last_unstale":"2023-12-16T03:28:12.829423+0000","last_undegraded":"2023-12-16T03:28:12.829423+0000","last_fullsized":"2023-12-16T03:28:12.829423+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:55:49.760534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779459+0000","last_change":"2023-12-16T03:27:59.723346+0000","last_active":"2023-12-16T03:28:11.779459+0000","last_peered":"2023-12-16T03:28:11.779459+0000","last_clean":"2023-12-16T03:28:11.779459+0000","last_became_active":"2023-12-16T03:27:59.722968+0000","last_became_peered":"2023-12-16T03:27:59.722968+0000","last_unstale":"2023-12-16T03:28:11.779459+0000","last_undegraded":"2023-12-16T03:28:11.779459+0000","last_fullsized":"2023-12-16T03:28:11.779459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:40:30.607572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779646+0000","last_change":"2023-12-16T03:27:58.724631+0000","last_active":"2023-12-16T03:28:11.779646+0000","last_peered":"2023-12-16T03:28:11.779646+0000","last_clean":"2023-12-16T03:28:11.779646+0000","last_became_active":"2023-12-16T03:27:58.724267+0000","last_became_peered":"2023-12-16T03:27:58.724267+0000","last_unstale":"2023-12-16T03:28:11.779646+0000","last_undegraded":"2023-12-16T03:28:11.779646+0000","last_fullsized":"2023-12-16T03:28:11.779646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:08:00.782230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819256+0000","last_change":"2023-12-16T03:28:12.813577+0000","last_active":"2023-12-16T03:28:12.819256+0000","last_peered":"2023-12-16T03:28:12.819256+0000","last_clean":"2023-12-16T03:28:12.819256+0000","last_became_active":"2023-12-16T03:28:12.813252+0000","last_became_peered":"2023-12-16T03:28:12.813252+0000","last_unstale":"2023-12-16T03:28:12.819256+0000","last_undegraded":"2023-12-16T03:28:12.819256+0000","last_fullsized":"2023-12-16T03:28:12.819256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:11:01.580361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.823785+0000","last_change":"2023-12-16T03:28:11.783296+0000","last_active":"2023-12-16T03:28:12.823785+0000","last_peered":"2023-12-16T03:28:12.823785+0000","last_clean":"2023-12-16T03:28:12.823785+0000","last_became_active":"2023-12-16T03:28:11.782974+0000","last_became_peered":"2023-12-16T03:28:11.782974+0000","last_unstale":"2023-12-16T03:28:12.823785+0000","last_undegraded":"2023-12-16T03:28:12.823785+0000","last_fullsized":"2023-12-16T03:28:12.823785+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:49:37.800163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782349+0000","last_change":"2023-12-16T03:27:59.735336+0000","last_active":"2023-12-16T03:28:11.782349+0000","last_peered":"2023-12-16T03:28:11.782349+0000","last_clean":"2023-12-16T03:28:11.782349+0000","last_became_active":"2023-12-16T03:27:59.735041+0000","last_became_peered":"2023-12-16T03:27:59.735041+0000","last_unstale":"2023-12-16T03:28:11.782349+0000","last_undegraded":"2023-12-16T03:28:11.782349+0000","last_fullsized":"2023-12-16T03:28:11.782349+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:11.022363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767102+0000","last_change":"2023-12-16T03:27:58.707831+0000","last_active":"2023-12-16T03:28:11.767102+0000","last_peered":"2023-12-16T03:28:11.767102+0000","last_clean":"2023-12-16T03:28:11.767102+0000","last_became_active":"2023-12-16T03:27:58.707542+0000","last_became_peered":"2023-12-16T03:27:58.707542+0000","last_unstale":"2023-12-16T03:28:11.767102+0000","last_undegraded":"2023-12-16T03:28:11.767102+0000","last_fullsized":"2023-12-16T03:28:11.767102+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:01:08.706369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.826095+0000","last_change":"2023-12-16T03:28:12.822342+0000","last_active":"2023-12-16T03:28:12.826095+0000","last_peered":"2023-12-16T03:28:12.826095+0000","last_clean":"2023-12-16T03:28:12.826095+0000","last_became_active":"2023-12-16T03:28:12.822033+0000","last_became_peered":"2023-12-16T03:28:12.822033+0000","last_unstale":"2023-12-16T03:28:12.826095+0000","last_undegraded":"2023-12-16T03:28:12.826095+0000","last_fullsized":"2023-12-16T03:28:12.826095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:56.506850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.795143+0000","last_change":"2023-12-16T03:28:11.793479+0000","last_active":"2023-12-16T03:28:12.795143+0000","last_peered":"2023-12-16T03:28:12.795143+0000","last_clean":"2023-12-16T03:28:12.795143+0000","last_became_active":"2023-12-16T03:28:11.793190+0000","last_became_peered":"2023-12-16T03:28:11.793190+0000","last_unstale":"2023-12-16T03:28:12.795143+0000","last_undegraded":"2023-12-16T03:28:12.795143+0000","last_fullsized":"2023-12-16T03:28:12.795143+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:15:26.793633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.780837+0000","last_change":"2023-12-16T03:27:59.720229+0000","last_active":"2023-12-16T03:28:11.780837+0000","last_peered":"2023-12-16T03:28:11.780837+0000","last_clean":"2023-12-16T03:28:11.780837+0000","last_became_active":"2023-12-16T03:27:59.719927+0000","last_became_peered":"2023-12-16T03:27:59.719927+0000","last_unstale":"2023-12-16T03:28:11.780837+0000","last_undegraded":"2023-12-16T03:28:11.780837+0000","last_fullsized":"2023-12-16T03:28:11.780837+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:16.254698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.764633+0000","last_change":"2023-12-16T03:27:58.713349+0000","last_active":"2023-12-16T03:28:11.764633+0000","last_peered":"2023-12-16T03:28:11.764633+0000","last_clean":"2023-12-16T03:28:11.764633+0000","last_became_active":"2023-12-16T03:27:58.712977+0000","last_became_peered":"2023-12-16T03:27:58.712977+0000","last_unstale":"2023-12-16T03:28:11.764633+0000","last_undegraded":"2023-12-16T03:28:11.764633+0000","last_fullsized":"2023-12-16T03:28:11.764633+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:56.126328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.812014+0000","last_change":"2023-12-16T03:28:12.804785+0000","last_active":"2023-12-16T03:28:12.812014+0000","last_peered":"2023-12-16T03:28:12.812014+0000","last_clean":"2023-12-16T03:28:12.812014+0000","last_became_active":"2023-12-16T03:28:12.804514+0000","last_became_peered":"2023-12-16T03:28:12.804514+0000","last_unstale":"2023-12-16T03:28:12.812014+0000","last_undegraded":"2023-12-16T03:28:12.812014+0000","last_fullsized":"2023-12-16T03:28:12.812014+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:48:49.851057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.809633+0000","last_change":"2023-12-16T03:28:11.777911+0000","last_active":"2023-12-16T03:28:12.809633+0000","last_peered":"2023-12-16T03:28:12.809633+0000","last_clean":"2023-12-16T03:28:12.809633+0000","last_became_active":"2023-12-16T03:28:11.777600+0000","last_became_peered":"2023-12-16T03:28:11.777600+0000","last_unstale":"2023-12-16T03:28:12.809633+0000","last_undegraded":"2023-12-16T03:28:12.809633+0000","last_fullsized":"2023-12-16T03:28:12.809633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:29:56.885065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782694+0000","last_change":"2023-12-16T03:27:59.713056+0000","last_active":"2023-12-16T03:28:11.782694+0000","last_peered":"2023-12-16T03:28:11.782694+0000","last_clean":"2023-12-16T03:28:11.782694+0000","last_became_active":"2023-12-16T03:27:59.712760+0000","last_became_peered":"2023-12-16T03:27:59.712760+0000","last_unstale":"2023-12-16T03:28:11.782694+0000","last_undegraded":"2023-12-16T03:28:11.782694+0000","last_fullsized":"2023-12-16T03:28:11.782694+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:46.650579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781575+0000","last_change":"2023-12-16T03:27:58.710741+0000","last_active":"2023-12-16T03:28:11.781575+0000","last_peered":"2023-12-16T03:28:11.781575+0000","last_clean":"2023-12-16T03:28:11.781575+0000","last_became_active":"2023-12-16T03:27:58.710391+0000","last_became_peered":"2023-12-16T03:27:58.710391+0000","last_unstale":"2023-12-16T03:28:11.781575+0000","last_undegraded":"2023-12-16T03:28:11.781575+0000","last_fullsized":"2023-12-16T03:28:11.781575+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:44.133983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.825997+0000","last_change":"2023-12-16T03:28:12.821036+0000","last_active":"2023-12-16T03:28:12.825997+0000","last_peered":"2023-12-16T03:28:12.825997+0000","last_clean":"2023-12-16T03:28:12.825997+0000","last_became_active":"2023-12-16T03:28:12.819929+0000","last_became_peered":"2023-12-16T03:28:12.819929+0000","last_unstale":"2023-12-16T03:28:12.825997+0000","last_undegraded":"2023-12-16T03:28:12.825997+0000","last_fullsized":"2023-12-16T03:28:12.825997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:30:45.407819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.792711+0000","last_change":"2023-12-16T03:28:11.783906+0000","last_active":"2023-12-16T03:28:12.792711+0000","last_peered":"2023-12-16T03:28:12.792711+0000","last_clean":"2023-12-16T03:28:12.792711+0000","last_became_active":"2023-12-16T03:28:11.780954+0000","last_became_peered":"2023-12-16T03:28:11.780954+0000","last_unstale":"2023-12-16T03:28:12.792711+0000","last_undegraded":"2023-12-16T03:28:12.792711+0000","last_fullsized":"2023-12-16T03:28:12.792711+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:29:56.885065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781257+0000","last_change":"2023-12-16T03:27:59.719682+0000","last_active":"2023-12-16T03:28:11.781257+0000","last_peered":"2023-12-16T03:28:11.781257+0000","last_clean":"2023-12-16T03:28:11.781257+0000","last_became_active":"2023-12-16T03:27:59.719285+0000","last_became_peered":"2023-12-16T03:27:59.719285+0000","last_unstale":"2023-12-16T03:28:11.781257+0000","last_undegraded":"2023-12-16T03:28:11.781257+0000","last_fullsized":"2023-12-16T03:28:11.781257+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:34.741103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.766155+0000","last_change":"2023-12-16T03:27:58.714603+0000","last_active":"2023-12-16T03:28:11.766155+0000","last_peered":"2023-12-16T03:28:11.766155+0000","last_clean":"2023-12-16T03:28:11.766155+0000","last_became_active":"2023-12-16T03:27:58.714204+0000","last_became_peered":"2023-12-16T03:27:58.714204+0000","last_unstale":"2023-12-16T03:28:11.766155+0000","last_undegraded":"2023-12-16T03:28:11.766155+0000","last_fullsized":"2023-12-16T03:28:11.766155+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:53.997333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819090+0000","last_change":"2023-12-16T03:28:12.815214+0000","last_active":"2023-12-16T03:28:12.819090+0000","last_peered":"2023-12-16T03:28:12.819090+0000","last_clean":"2023-12-16T03:28:12.819090+0000","last_became_active":"2023-12-16T03:28:12.813475+0000","last_became_peered":"2023-12-16T03:28:12.813475+0000","last_unstale":"2023-12-16T03:28:12.819090+0000","last_undegraded":"2023-12-16T03:28:12.819090+0000","last_fullsized":"2023-12-16T03:28:12.819090+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:11:01.580361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818879+0000","last_change":"2023-12-16T03:28:11.789226+0000","last_active":"2023-12-16T03:28:12.818879+0000","last_peered":"2023-12-16T03:28:12.818879+0000","last_clean":"2023-12-16T03:28:12.818879+0000","last_became_active":"2023-12-16T03:28:11.787749+0000","last_became_peered":"2023-12-16T03:28:11.787749+0000","last_unstale":"2023-12-16T03:28:12.818879+0000","last_undegraded":"2023-12-16T03:28:12.818879+0000","last_fullsized":"2023-12-16T03:28:12.818879+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:23:19.825675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768204+0000","last_change":"2023-12-16T03:27:59.712998+0000","last_active":"2023-12-16T03:28:11.768204+0000","last_peered":"2023-12-16T03:28:11.768204+0000","last_clean":"2023-12-16T03:28:11.768204+0000","last_became_active":"2023-12-16T03:27:59.712032+0000","last_became_peered":"2023-12-16T03:27:59.712032+0000","last_unstale":"2023-12-16T03:28:11.768204+0000","last_undegraded":"2023-12-16T03:28:11.768204+0000","last_fullsized":"2023-12-16T03:28:11.768204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:20:45.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765894+0000","last_change":"2023-12-16T03:27:58.703925+0000","last_active":"2023-12-16T03:28:11.765894+0000","last_peered":"2023-12-16T03:28:11.765894+0000","last_clean":"2023-12-16T03:28:11.765894+0000","last_became_active":"2023-12-16T03:27:58.703623+0000","last_became_peered":"2023-12-16T03:27:58.703623+0000","last_unstale":"2023-12-16T03:28:11.765894+0000","last_undegraded":"2023-12-16T03:28:11.765894+0000","last_fullsized":"2023-12-16T03:28:11.765894+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:32.257742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817043+0000","last_change":"2023-12-16T03:28:12.807536+0000","last_active":"2023-12-16T03:28:12.817043+0000","last_peered":"2023-12-16T03:28:12.817043+0000","last_clean":"2023-12-16T03:28:12.817043+0000","last_became_active":"2023-12-16T03:28:12.803921+0000","last_became_peered":"2023-12-16T03:28:12.803921+0000","last_unstale":"2023-12-16T03:28:12.817043+0000","last_undegraded":"2023-12-16T03:28:12.817043+0000","last_fullsized":"2023-12-16T03:28:12.817043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:20:07.023742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.787193+0000","last_change":"2023-12-16T03:28:11.790069+0000","last_active":"2023-12-16T03:28:12.787193+0000","last_peered":"2023-12-16T03:28:12.787193+0000","last_clean":"2023-12-16T03:28:12.787193+0000","last_became_active":"2023-12-16T03:28:11.789694+0000","last_became_peered":"2023-12-16T03:28:11.789694+0000","last_unstale":"2023-12-16T03:28:12.787193+0000","last_undegraded":"2023-12-16T03:28:12.787193+0000","last_fullsized":"2023-12-16T03:28:12.787193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:48:02.323978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779846+0000","last_change":"2023-12-16T03:27:59.740195+0000","last_active":"2023-12-16T03:28:11.779846+0000","last_peered":"2023-12-16T03:28:11.779846+0000","last_clean":"2023-12-16T03:28:11.779846+0000","last_became_active":"2023-12-16T03:27:59.739697+0000","last_became_peered":"2023-12-16T03:27:59.739697+0000","last_unstale":"2023-12-16T03:28:11.779846+0000","last_undegraded":"2023-12-16T03:28:11.779846+0000","last_fullsized":"2023-12-16T03:28:11.779846+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:12:40.578081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781188+0000","last_change":"2023-12-16T03:27:58.719438+0000","last_active":"2023-12-16T03:28:11.781188+0000","last_peered":"2023-12-16T03:28:11.781188+0000","last_clean":"2023-12-16T03:28:11.781188+0000","last_became_active":"2023-12-16T03:27:58.719140+0000","last_became_peered":"2023-12-16T03:27:58.719140+0000","last_unstale":"2023-12-16T03:28:11.781188+0000","last_undegraded":"2023-12-16T03:28:11.781188+0000","last_fullsized":"2023-12-16T03:28:11.781188+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:27:45.642189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.814101+0000","last_change":"2023-12-16T03:28:12.811060+0000","last_active":"2023-12-16T03:28:12.814101+0000","last_peered":"2023-12-16T03:28:12.814101+0000","last_clean":"2023-12-16T03:28:12.814101+0000","last_became_active":"2023-12-16T03:28:12.810766+0000","last_became_peered":"2023-12-16T03:28:12.810766+0000","last_unstale":"2023-12-16T03:28:12.814101+0000","last_undegraded":"2023-12-16T03:28:12.814101+0000","last_fullsized":"2023-12-16T03:28:12.814101+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.905635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.793018+0000","last_change":"2023-12-16T03:28:11.792840+0000","last_active":"2023-12-16T03:28:12.793018+0000","last_peered":"2023-12-16T03:28:12.793018+0000","last_clean":"2023-12-16T03:28:12.793018+0000","last_became_active":"2023-12-16T03:28:11.792525+0000","last_became_peered":"2023-12-16T03:28:11.792525+0000","last_unstale":"2023-12-16T03:28:12.793018+0000","last_undegraded":"2023-12-16T03:28:12.793018+0000","last_fullsized":"2023-12-16T03:28:12.793018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:03:47.032812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767098+0000","last_change":"2023-12-16T03:27:59.725032+0000","last_active":"2023-12-16T03:28:11.767098+0000","last_peered":"2023-12-16T03:28:11.767098+0000","last_clean":"2023-12-16T03:28:11.767098+0000","last_became_active":"2023-12-16T03:27:59.724136+0000","last_became_peered":"2023-12-16T03:27:59.724136+0000","last_unstale":"2023-12-16T03:28:11.767098+0000","last_undegraded":"2023-12-16T03:28:11.767098+0000","last_fullsized":"2023-12-16T03:28:11.767098+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:55:37.693337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779938+0000","last_change":"2023-12-16T03:27:58.714711+0000","last_active":"2023-12-16T03:28:11.779938+0000","last_peered":"2023-12-16T03:28:11.779938+0000","last_clean":"2023-12-16T03:28:11.779938+0000","last_became_active":"2023-12-16T03:27:58.714425+0000","last_became_peered":"2023-12-16T03:27:58.714425+0000","last_unstale":"2023-12-16T03:28:11.779938+0000","last_undegraded":"2023-12-16T03:28:11.779938+0000","last_fullsized":"2023-12-16T03:28:11.779938+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T13:49:46.678443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.821143+0000","last_change":"2023-12-16T03:28:12.817601+0000","last_active":"2023-12-16T03:28:12.821143+0000","last_peered":"2023-12-16T03:28:12.821143+0000","last_clean":"2023-12-16T03:28:12.821143+0000","last_became_active":"2023-12-16T03:28:12.816989+0000","last_became_peered":"2023-12-16T03:28:12.816989+0000","last_unstale":"2023-12-16T03:28:12.821143+0000","last_undegraded":"2023-12-16T03:28:12.821143+0000","last_fullsized":"2023-12-16T03:28:12.821143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:04:32.745953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827319+0000","last_change":"2023-12-16T03:28:11.787826+0000","last_active":"2023-12-16T03:28:12.827319+0000","last_peered":"2023-12-16T03:28:12.827319+0000","last_clean":"2023-12-16T03:28:12.827319+0000","last_became_active":"2023-12-16T03:28:11.787529+0000","last_became_peered":"2023-12-16T03:28:11.787529+0000","last_unstale":"2023-12-16T03:28:12.827319+0000","last_undegraded":"2023-12-16T03:28:12.827319+0000","last_fullsized":"2023-12-16T03:28:12.827319+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T09:01:21.937334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.785143+0000","last_change":"2023-12-16T03:27:59.731322+0000","last_active":"2023-12-16T03:28:11.785143+0000","last_peered":"2023-12-16T03:28:11.785143+0000","last_clean":"2023-12-16T03:28:11.785143+0000","last_became_active":"2023-12-16T03:27:59.730648+0000","last_became_peered":"2023-12-16T03:27:59.730648+0000","last_unstale":"2023-12-16T03:28:11.785143+0000","last_undegraded":"2023-12-16T03:28:11.785143+0000","last_fullsized":"2023-12-16T03:28:11.785143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:08:50.058653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.773346+0000","last_change":"2023-12-16T03:27:58.714609+0000","last_active":"2023-12-16T03:28:11.773346+0000","last_peered":"2023-12-16T03:28:11.773346+0000","last_clean":"2023-12-16T03:28:11.773346+0000","last_became_active":"2023-12-16T03:27:58.714279+0000","last_became_peered":"2023-12-16T03:27:58.714279+0000","last_unstale":"2023-12-16T03:28:11.773346+0000","last_undegraded":"2023-12-16T03:28:11.773346+0000","last_fullsized":"2023-12-16T03:28:11.773346+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:23:31.017856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.827789+0000","last_change":"2023-12-16T03:28:12.824195+0000","last_active":"2023-12-16T03:28:12.827789+0000","last_peered":"2023-12-16T03:28:12.827789+0000","last_clean":"2023-12-16T03:28:12.827789+0000","last_became_active":"2023-12-16T03:28:12.823931+0000","last_became_peered":"2023-12-16T03:28:12.823931+0000","last_unstale":"2023-12-16T03:28:12.827789+0000","last_undegraded":"2023-12-16T03:28:12.827789+0000","last_fullsized":"2023-12-16T03:28:12.827789+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:16:04.331792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.789870+0000","last_change":"2023-12-16T03:28:11.788469+0000","last_active":"2023-12-16T03:28:12.789870+0000","last_peered":"2023-12-16T03:28:12.789870+0000","last_clean":"2023-12-16T03:28:12.789870+0000","last_became_active":"2023-12-16T03:28:11.788104+0000","last_became_peered":"2023-12-16T03:28:11.788104+0000","last_unstale":"2023-12-16T03:28:12.789870+0000","last_undegraded":"2023-12-16T03:28:12.789870+0000","last_fullsized":"2023-12-16T03:28:12.789870+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:40:42.674770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.766954+0000","last_change":"2023-12-16T03:27:59.726049+0000","last_active":"2023-12-16T03:28:11.766954+0000","last_peered":"2023-12-16T03:28:11.766954+0000","last_clean":"2023-12-16T03:28:11.766954+0000","last_became_active":"2023-12-16T03:27:59.725688+0000","last_became_peered":"2023-12-16T03:27:59.725688+0000","last_unstale":"2023-12-16T03:28:11.766954+0000","last_undegraded":"2023-12-16T03:28:11.766954+0000","last_fullsized":"2023-12-16T03:28:11.766954+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:55.005723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.777640+0000","last_change":"2023-12-16T03:27:58.715914+0000","last_active":"2023-12-16T03:28:11.777640+0000","last_peered":"2023-12-16T03:28:11.777640+0000","last_clean":"2023-12-16T03:28:11.777640+0000","last_became_active":"2023-12-16T03:27:58.715602+0000","last_became_peered":"2023-12-16T03:27:58.715602+0000","last_unstale":"2023-12-16T03:28:11.777640+0000","last_undegraded":"2023-12-16T03:28:11.777640+0000","last_fullsized":"2023-12-16T03:28:11.777640+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:24:56.757869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.812984+0000","last_change":"2023-12-16T03:28:12.809893+0000","last_active":"2023-12-16T03:28:12.812984+0000","last_peered":"2023-12-16T03:28:12.812984+0000","last_clean":"2023-12-16T03:28:12.812984+0000","last_became_active":"2023-12-16T03:28:12.809530+0000","last_became_peered":"2023-12-16T03:28:12.809530+0000","last_unstale":"2023-12-16T03:28:12.812984+0000","last_undegraded":"2023-12-16T03:28:12.812984+0000","last_fullsized":"2023-12-16T03:28:12.812984+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:46.339804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.796145+0000","last_change":"2023-12-16T03:28:11.783211+0000","last_active":"2023-12-16T03:28:12.796145+0000","last_peered":"2023-12-16T03:28:12.796145+0000","last_clean":"2023-12-16T03:28:12.796145+0000","last_became_active":"2023-12-16T03:28:11.782893+0000","last_became_peered":"2023-12-16T03:28:11.782893+0000","last_unstale":"2023-12-16T03:28:12.796145+0000","last_undegraded":"2023-12-16T03:28:12.796145+0000","last_fullsized":"2023-12-16T03:28:12.796145+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:26:15.244218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769639+0000","last_change":"2023-12-16T03:27:59.717815+0000","last_active":"2023-12-16T03:28:11.769639+0000","last_peered":"2023-12-16T03:28:11.769639+0000","last_clean":"2023-12-16T03:28:11.769639+0000","last_became_active":"2023-12-16T03:27:59.714803+0000","last_became_peered":"2023-12-16T03:27:59.714803+0000","last_unstale":"2023-12-16T03:28:11.769639+0000","last_undegraded":"2023-12-16T03:28:11.769639+0000","last_fullsized":"2023-12-16T03:28:11.769639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:06:37.917845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.783530+0000","last_change":"2023-12-16T03:27:58.718818+0000","last_active":"2023-12-16T03:28:11.783530+0000","last_peered":"2023-12-16T03:28:11.783530+0000","last_clean":"2023-12-16T03:28:11.783530+0000","last_became_active":"2023-12-16T03:27:58.718323+0000","last_became_peered":"2023-12-16T03:27:58.718323+0000","last_unstale":"2023-12-16T03:28:11.783530+0000","last_undegraded":"2023-12-16T03:28:11.783530+0000","last_fullsized":"2023-12-16T03:28:11.783530+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:13:36.671175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.819155+0000","last_change":"2023-12-16T03:28:12.815629+0000","last_active":"2023-12-16T03:28:12.819155+0000","last_peered":"2023-12-16T03:28:12.819155+0000","last_clean":"2023-12-16T03:28:12.819155+0000","last_became_active":"2023-12-16T03:28:12.814785+0000","last_became_peered":"2023-12-16T03:28:12.814785+0000","last_unstale":"2023-12-16T03:28:12.819155+0000","last_undegraded":"2023-12-16T03:28:12.819155+0000","last_fullsized":"2023-12-16T03:28:12.819155+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T15:27:00.658089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.798082+0000","last_change":"2023-12-16T03:28:11.785634+0000","last_active":"2023-12-16T03:28:12.798082+0000","last_peered":"2023-12-16T03:28:12.798082+0000","last_clean":"2023-12-16T03:28:12.798082+0000","last_became_active":"2023-12-16T03:28:11.785308+0000","last_became_peered":"2023-12-16T03:28:11.785308+0000","last_unstale":"2023-12-16T03:28:12.798082+0000","last_undegraded":"2023-12-16T03:28:12.798082+0000","last_fullsized":"2023-12-16T03:28:12.798082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:03:47.032812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782757+0000","last_change":"2023-12-16T03:27:59.730417+0000","last_active":"2023-12-16T03:28:11.782757+0000","last_peered":"2023-12-16T03:28:11.782757+0000","last_clean":"2023-12-16T03:28:11.782757+0000","last_became_active":"2023-12-16T03:27:59.729416+0000","last_became_peered":"2023-12-16T03:27:59.729416+0000","last_unstale":"2023-12-16T03:28:11.782757+0000","last_undegraded":"2023-12-16T03:28:11.782757+0000","last_fullsized":"2023-12-16T03:28:11.782757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T05:08:01.790620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.782953+0000","last_change":"2023-12-16T03:27:58.715883+0000","last_active":"2023-12-16T03:28:11.782953+0000","last_peered":"2023-12-16T03:28:11.782953+0000","last_clean":"2023-12-16T03:28:11.782953+0000","last_became_active":"2023-12-16T03:27:58.714400+0000","last_became_peered":"2023-12-16T03:27:58.714400+0000","last_unstale":"2023-12-16T03:28:11.782953+0000","last_undegraded":"2023-12-16T03:28:11.782953+0000","last_fullsized":"2023-12-16T03:28:11.782953+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:45.783332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.811361+0000","last_change":"2023-12-16T03:28:12.803502+0000","last_active":"2023-12-16T03:28:12.811361+0000","last_peered":"2023-12-16T03:28:12.811361+0000","last_clean":"2023-12-16T03:28:12.811361+0000","last_became_active":"2023-12-16T03:28:12.802826+0000","last_became_peered":"2023-12-16T03:28:12.802826+0000","last_unstale":"2023-12-16T03:28:12.811361+0000","last_undegraded":"2023-12-16T03:28:12.811361+0000","last_fullsized":"2023-12-16T03:28:12.811361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:29:53.905635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.821452+0000","last_change":"2023-12-16T03:28:11.774528+0000","last_active":"2023-12-16T03:28:12.821452+0000","last_peered":"2023-12-16T03:28:12.821452+0000","last_clean":"2023-12-16T03:28:12.821452+0000","last_became_active":"2023-12-16T03:28:11.774222+0000","last_became_peered":"2023-12-16T03:28:11.774222+0000","last_unstale":"2023-12-16T03:28:12.821452+0000","last_undegraded":"2023-12-16T03:28:12.821452+0000","last_fullsized":"2023-12-16T03:28:12.821452+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T10:46:46.808301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779195+0000","last_change":"2023-12-16T03:27:59.733598+0000","last_active":"2023-12-16T03:28:11.779195+0000","last_peered":"2023-12-16T03:28:11.779195+0000","last_clean":"2023-12-16T03:28:11.779195+0000","last_became_active":"2023-12-16T03:27:59.733274+0000","last_became_peered":"2023-12-16T03:27:59.733274+0000","last_unstale":"2023-12-16T03:28:11.779195+0000","last_undegraded":"2023-12-16T03:28:11.779195+0000","last_fullsized":"2023-12-16T03:28:11.779195+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:06:37.917845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779205+0000","last_change":"2023-12-16T03:27:58.714025+0000","last_active":"2023-12-16T03:28:11.779205+0000","last_peered":"2023-12-16T03:28:11.779205+0000","last_clean":"2023-12-16T03:28:11.779205+0000","last_became_active":"2023-12-16T03:27:58.713597+0000","last_became_peered":"2023-12-16T03:27:58.713597+0000","last_unstale":"2023-12-16T03:28:11.779205+0000","last_undegraded":"2023-12-16T03:28:11.779205+0000","last_fullsized":"2023-12-16T03:28:11.779205+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:09:00.746235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.806729+0000","last_change":"2023-12-16T03:28:12.800344+0000","last_active":"2023-12-16T03:28:12.806729+0000","last_peered":"2023-12-16T03:28:12.806729+0000","last_clean":"2023-12-16T03:28:12.806729+0000","last_became_active":"2023-12-16T03:28:12.799972+0000","last_became_peered":"2023-12-16T03:28:12.799972+0000","last_unstale":"2023-12-16T03:28:12.806729+0000","last_undegraded":"2023-12-16T03:28:12.806729+0000","last_fullsized":"2023-12-16T03:28:12.806729+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:53.482706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.793924+0000","last_change":"2023-12-16T03:28:11.795477+0000","last_active":"2023-12-16T03:28:12.793924+0000","last_peered":"2023-12-16T03:28:12.793924+0000","last_clean":"2023-12-16T03:28:12.793924+0000","last_became_active":"2023-12-16T03:28:11.795188+0000","last_became_peered":"2023-12-16T03:28:11.795188+0000","last_unstale":"2023-12-16T03:28:12.793924+0000","last_undegraded":"2023-12-16T03:28:12.793924+0000","last_fullsized":"2023-12-16T03:28:12.793924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:48:28.758418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.769197+0000","last_change":"2023-12-16T03:27:59.726447+0000","last_active":"2023-12-16T03:28:11.769197+0000","last_peered":"2023-12-16T03:28:11.769197+0000","last_clean":"2023-12-16T03:28:11.769197+0000","last_became_active":"2023-12-16T03:27:59.724012+0000","last_became_peered":"2023-12-16T03:27:59.724012+0000","last_unstale":"2023-12-16T03:28:11.769197+0000","last_undegraded":"2023-12-16T03:28:11.769197+0000","last_fullsized":"2023-12-16T03:28:11.769197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:42:33.266132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779283+0000","last_change":"2023-12-16T03:27:58.717331+0000","last_active":"2023-12-16T03:28:11.779283+0000","last_peered":"2023-12-16T03:28:11.779283+0000","last_clean":"2023-12-16T03:28:11.779283+0000","last_became_active":"2023-12-16T03:27:58.716980+0000","last_became_peered":"2023-12-16T03:27:58.716980+0000","last_unstale":"2023-12-16T03:28:11.779283+0000","last_undegraded":"2023-12-16T03:28:11.779283+0000","last_fullsized":"2023-12-16T03:28:11.779283+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:50:56.126328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817066+0000","last_change":"2023-12-16T03:28:12.810590+0000","last_active":"2023-12-16T03:28:12.817066+0000","last_peered":"2023-12-16T03:28:12.817066+0000","last_clean":"2023-12-16T03:28:12.817066+0000","last_became_active":"2023-12-16T03:28:12.810249+0000","last_became_peered":"2023-12-16T03:28:12.810249+0000","last_unstale":"2023-12-16T03:28:12.817066+0000","last_undegraded":"2023-12-16T03:28:12.817066+0000","last_fullsized":"2023-12-16T03:28:12.817066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:21:16.517293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.797183+0000","last_change":"2023-12-16T03:28:11.790473+0000","last_active":"2023-12-16T03:28:12.797183+0000","last_peered":"2023-12-16T03:28:12.797183+0000","last_clean":"2023-12-16T03:28:12.797183+0000","last_became_active":"2023-12-16T03:28:11.790180+0000","last_became_peered":"2023-12-16T03:28:11.790180+0000","last_unstale":"2023-12-16T03:28:12.797183+0000","last_undegraded":"2023-12-16T03:28:12.797183+0000","last_fullsized":"2023-12-16T03:28:12.797183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:48:28.758418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767296+0000","last_change":"2023-12-16T03:27:59.725040+0000","last_active":"2023-12-16T03:28:11.767296+0000","last_peered":"2023-12-16T03:28:11.767296+0000","last_clean":"2023-12-16T03:28:11.767296+0000","last_became_active":"2023-12-16T03:27:59.724679+0000","last_became_peered":"2023-12-16T03:27:59.724679+0000","last_unstale":"2023-12-16T03:28:11.767296+0000","last_undegraded":"2023-12-16T03:28:11.767296+0000","last_fullsized":"2023-12-16T03:28:11.767296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:31:43.433178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765764+0000","last_change":"2023-12-16T03:27:58.715680+0000","last_active":"2023-12-16T03:28:11.765764+0000","last_peered":"2023-12-16T03:28:11.765764+0000","last_clean":"2023-12-16T03:28:11.765764+0000","last_became_active":"2023-12-16T03:27:58.715382+0000","last_became_peered":"2023-12-16T03:27:58.715382+0000","last_unstale":"2023-12-16T03:28:11.765764+0000","last_undegraded":"2023-12-16T03:28:11.765764+0000","last_fullsized":"2023-12-16T03:28:11.765764+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:20:57.913319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.828180+0000","last_change":"2023-12-16T03:28:12.826289+0000","last_active":"2023-12-16T03:28:12.828180+0000","last_peered":"2023-12-16T03:28:12.828180+0000","last_clean":"2023-12-16T03:28:12.828180+0000","last_became_active":"2023-12-16T03:28:12.825801+0000","last_became_peered":"2023-12-16T03:28:12.825801+0000","last_unstale":"2023-12-16T03:28:12.828180+0000","last_undegraded":"2023-12-16T03:28:12.828180+0000","last_fullsized":"2023-12-16T03:28:12.828180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:04:02.206799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.788975+0000","last_change":"2023-12-16T03:28:11.797180+0000","last_active":"2023-12-16T03:28:12.788975+0000","last_peered":"2023-12-16T03:28:12.788975+0000","last_clean":"2023-12-16T03:28:12.788975+0000","last_became_active":"2023-12-16T03:28:11.796313+0000","last_became_peered":"2023-12-16T03:28:11.796313+0000","last_unstale":"2023-12-16T03:28:12.788975+0000","last_undegraded":"2023-12-16T03:28:12.788975+0000","last_fullsized":"2023-12-16T03:28:12.788975+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:09:23.089560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.765653+0000","last_change":"2023-12-16T03:27:59.724572+0000","last_active":"2023-12-16T03:28:11.765653+0000","last_peered":"2023-12-16T03:28:11.765653+0000","last_clean":"2023-12-16T03:28:11.765653+0000","last_became_active":"2023-12-16T03:27:59.724284+0000","last_became_peered":"2023-12-16T03:27:59.724284+0000","last_unstale":"2023-12-16T03:28:11.765653+0000","last_undegraded":"2023-12-16T03:28:11.765653+0000","last_fullsized":"2023-12-16T03:28:11.765653+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:21.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.768188+0000","last_change":"2023-12-16T03:27:58.715475+0000","last_active":"2023-12-16T03:28:11.768188+0000","last_peered":"2023-12-16T03:28:11.768188+0000","last_clean":"2023-12-16T03:28:11.768188+0000","last_became_active":"2023-12-16T03:27:58.715159+0000","last_became_peered":"2023-12-16T03:27:58.715159+0000","last_unstale":"2023-12-16T03:28:11.768188+0000","last_undegraded":"2023-12-16T03:28:11.768188+0000","last_fullsized":"2023-12-16T03:28:11.768188+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T07:01:08.706369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.805744+0000","last_change":"2023-12-16T03:28:12.797453+0000","last_active":"2023-12-16T03:28:12.805744+0000","last_peered":"2023-12-16T03:28:12.805744+0000","last_clean":"2023-12-16T03:28:12.805744+0000","last_became_active":"2023-12-16T03:28:12.796846+0000","last_became_peered":"2023-12-16T03:28:12.796846+0000","last_unstale":"2023-12-16T03:28:12.805744+0000","last_undegraded":"2023-12-16T03:28:12.805744+0000","last_fullsized":"2023-12-16T03:28:12.805744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:10:59.865394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.795852+0000","last_change":"2023-12-16T03:28:11.792009+0000","last_active":"2023-12-16T03:28:12.795852+0000","last_peered":"2023-12-16T03:28:12.795852+0000","last_clean":"2023-12-16T03:28:12.795852+0000","last_became_active":"2023-12-16T03:28:11.791540+0000","last_became_peered":"2023-12-16T03:28:11.791540+0000","last_unstale":"2023-12-16T03:28:12.795852+0000","last_undegraded":"2023-12-16T03:28:12.795852+0000","last_fullsized":"2023-12-16T03:28:12.795852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:42:41.675066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.775415+0000","last_change":"2023-12-16T03:27:59.713363+0000","last_active":"2023-12-16T03:28:11.775415+0000","last_peered":"2023-12-16T03:28:11.775415+0000","last_clean":"2023-12-16T03:28:11.775415+0000","last_became_active":"2023-12-16T03:27:59.711676+0000","last_became_peered":"2023-12-16T03:27:59.711676+0000","last_unstale":"2023-12-16T03:28:11.775415+0000","last_undegraded":"2023-12-16T03:28:11.775415+0000","last_fullsized":"2023-12-16T03:28:11.775415+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:46:38.945695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779727+0000","last_change":"2023-12-16T03:27:58.715221+0000","last_active":"2023-12-16T03:28:11.779727+0000","last_peered":"2023-12-16T03:28:11.779727+0000","last_clean":"2023-12-16T03:28:11.779727+0000","last_became_active":"2023-12-16T03:27:58.714876+0000","last_became_peered":"2023-12-16T03:27:58.714876+0000","last_unstale":"2023-12-16T03:28:11.779727+0000","last_undegraded":"2023-12-16T03:28:11.779727+0000","last_fullsized":"2023-12-16T03:28:11.779727+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T04:22:53.997333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.818572+0000","last_change":"2023-12-16T03:28:12.801925+0000","last_active":"2023-12-16T03:28:12.818572+0000","last_peered":"2023-12-16T03:28:12.818572+0000","last_clean":"2023-12-16T03:28:12.818572+0000","last_became_active":"2023-12-16T03:28:12.801647+0000","last_became_peered":"2023-12-16T03:28:12.801647+0000","last_unstale":"2023-12-16T03:28:12.818572+0000","last_undegraded":"2023-12-16T03:28:12.818572+0000","last_fullsized":"2023-12-16T03:28:12.818572+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T12:25:10.839931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.791389+0000","last_change":"2023-12-16T03:28:11.788392+0000","last_active":"2023-12-16T03:28:12.791389+0000","last_peered":"2023-12-16T03:28:12.791389+0000","last_clean":"2023-12-16T03:28:12.791389+0000","last_became_active":"2023-12-16T03:28:11.788075+0000","last_became_peered":"2023-12-16T03:28:11.788075+0000","last_unstale":"2023-12-16T03:28:12.791389+0000","last_undegraded":"2023-12-16T03:28:12.791389+0000","last_fullsized":"2023-12-16T03:28:12.791389+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:51:37.451472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.779682+0000","last_change":"2023-12-16T03:27:59.724587+0000","last_active":"2023-12-16T03:28:11.779682+0000","last_peered":"2023-12-16T03:28:11.779682+0000","last_clean":"2023-12-16T03:28:11.779682+0000","last_became_active":"2023-12-16T03:27:59.724247+0000","last_became_peered":"2023-12-16T03:27:59.724247+0000","last_unstale":"2023-12-16T03:28:11.779682+0000","last_undegraded":"2023-12-16T03:28:11.779682+0000","last_fullsized":"2023-12-16T03:28:11.779682+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:47:50.256780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.767564+0000","last_change":"2023-12-16T03:27:58.711121+0000","last_active":"2023-12-16T03:28:11.767564+0000","last_peered":"2023-12-16T03:28:11.767564+0000","last_clean":"2023-12-16T03:28:11.767564+0000","last_became_active":"2023-12-16T03:27:58.710879+0000","last_became_peered":"2023-12-16T03:27:58.710879+0000","last_unstale":"2023-12-16T03:28:11.767564+0000","last_undegraded":"2023-12-16T03:28:11.767564+0000","last_fullsized":"2023-12-16T03:28:11.767564+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T03:48:15.561452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.817640+0000","last_change":"2023-12-16T03:28:12.801876+0000","last_active":"2023-12-16T03:28:12.817640+0000","last_peered":"2023-12-16T03:28:12.817640+0000","last_clean":"2023-12-16T03:28:12.817640+0000","last_became_active":"2023-12-16T03:28:12.801581+0000","last_became_peered":"2023-12-16T03:28:12.801581+0000","last_unstale":"2023-12-16T03:28:12.817640+0000","last_undegraded":"2023-12-16T03:28:12.817640+0000","last_fullsized":"2023-12-16T03:28:12.817640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:11.757100+0000","last_clean_scrub_stamp":"2023-12-16T03:28:11.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T06:49:29.328369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-16T03:28:12.825606+0000","last_change":"2023-12-16T03:28:11.796826+0000","last_active":"2023-12-16T03:28:12.825606+0000","last_peered":"2023-12-16T03:28:12.825606+0000","last_clean":"2023-12-16T03:28:12.825606+0000","last_became_active":"2023-12-16T03:28:11.796625+0000","last_became_peered":"2023-12-16T03:28:11.796625+0000","last_unstale":"2023-12-16T03:28:12.825606+0000","last_undegraded":"2023-12-16T03:28:12.825606+0000","last_fullsized":"2023-12-16T03:28:12.825606+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:28:10.750626+0000","last_clean_scrub_stamp":"2023-12-16T03:28:10.750626+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:11:00.573887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.783135+0000","last_change":"2023-12-16T03:27:59.716568+0000","last_active":"2023-12-16T03:28:11.783135+0000","last_peered":"2023-12-16T03:28:11.783135+0000","last_clean":"2023-12-16T03:28:11.783135+0000","last_became_active":"2023-12-16T03:27:59.715445+0000","last_became_peered":"2023-12-16T03:27:59.715445+0000","last_unstale":"2023-12-16T03:28:11.783135+0000","last_undegraded":"2023-12-16T03:28:11.783135+0000","last_fullsized":"2023-12-16T03:28:11.783135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:58.683428+0000","last_clean_scrub_stamp":"2023-12-16T03:27:58.683428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:21:50.345325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.781591+0000","last_change":"2023-12-16T03:27:58.721261+0000","last_active":"2023-12-16T03:28:11.781591+0000","last_peered":"2023-12-16T03:28:11.781591+0000","last_clean":"2023-12-16T03:28:11.781591+0000","last_became_active":"2023-12-16T03:27:58.720869+0000","last_became_peered":"2023-12-16T03:27:58.720869+0000","last_unstale":"2023-12-16T03:28:11.781591+0000","last_undegraded":"2023-12-16T03:28:11.781591+0000","last_fullsized":"2023-12-16T03:28:11.781591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:27:57.675038+0000","last_clean_scrub_stamp":"2023-12-16T03:27:57.675038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T08:25:20.366036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":210,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-16T03:28:11.775599+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:28:11.775599+0000","last_peered":"2023-12-16T03:28:11.775599+0000","last_clean":"2023-12-16T03:28:11.775599+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:28:11.775599+0000","last_undegraded":"2023-12-16T03:28:11.775599+0000","last_fullsized":"2023-12-16T03:28:11.775599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1458176,"data_stored":968504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85899999999999999,"5min":1.155,"15min":1.155},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70099999999999996,"15min":0.71099999999999997},"min":{"1min":0.51500000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89400000000000002,"5min":1.585,"15min":1.585},"last":0.81499999999999995}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.75800000000000001,"15min":0.78700000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95099999999999996,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.82599999999999996},"min":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84099999999999997,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.84499999999999997}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99399999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.76700000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.871,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2370000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88300000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.55500000000000005}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.629}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78900000000000003,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.746,"15min":0.76100000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":378760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.77100000000000002,"15min":0.81899999999999995},"min":{"1min":0.44700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.502,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.84099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.93200000000000005,"15min":1.046},"min":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85699999999999998,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.89900000000000002,"15min":1.002},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.51500000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.131,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.72299999999999998}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91800000000000004,"5min":4.242,"15min":4.242},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.85999999999999999,"15min":0.92000000000000004},"min":{"1min":0.57399999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.74299999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.873,"5min":1.111,"15min":1.111},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86099999999999999,"5min":1.073,"15min":1.073},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92800000000000005,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.246,"15min":1.246},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80000000000000004,"15min":0.80800000000000005},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":876544,"data_stored":381195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86699999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":1.111,"15min":1.111},"last":0.68400000000000005}]},{"osd":1,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92500000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.51000000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.622},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71399999999999997,"15min":0.70699999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93999999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.60799999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.622,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.71599999999999997},"min":{"1min":0.48199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.64600000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63600000000000001,"15min":0.65100000000000002},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.505},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71199999999999997,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48099999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.81599999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.022,"5min":1.105,"15min":1.105},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":378066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.751,"15min":0.79900000000000004},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":4.194,"15min":4.194},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.034,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.80400000000000005}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.621,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95199999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82799999999999996}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.84899999999999998,"15min":0.93100000000000005},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0700000000000001,"5min":1.288,"15min":1.288},"last":0.73599999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84699999999999998,"15min":0.91800000000000004},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91200000000000003,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.878,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.77900000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.70199999999999996,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.879},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73399999999999999,"15min":0.76200000000000001},"min":{"1min":0.47399999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85599999999999998,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.96499999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.75,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92400000000000004,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93100000000000005,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.93799999999999994}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85699999999999998,"5min":1.881,"15min":1.881},"last":1.014},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80300000000000005,"15min":0.83499999999999996},"min":{"1min":0.53600000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.95599999999999996,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.98799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":381173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.66200000000000003,"15min":0.77600000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.71599999999999997,"15min":0.83999999999999997},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.58699999999999997,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60699999999999998,"15min":0.68500000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.57999999999999996,"15min":0.622},"min":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63700000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.628,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.82199999999999995,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.67600000000000005,"15min":0.747},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73799999999999999,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.432}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81100000000000005,"15min":0.85399999999999998},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.871,"15min":0.92100000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.016,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.84199999999999997,"15min":0.88800000000000001},"min":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.99199999999999999,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.85799999999999998,"15min":0.91000000000000003},"min":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.88800000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84799999999999998,"15min":0.88400000000000001},"min":{"1min":0.60299999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.94799999999999995,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.88100000000000001,"15min":0.93899999999999995},"min":{"1min":0.60099999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98399999999999999,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.71799999999999997}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97699999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.87},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90900000000000003,"15min":0.96499999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":3.375,"15min":3.375},"last":0.73899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":386315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.436,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47799999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.42999999999999999},"min":{"1min":0.318,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.627,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70699999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":1.022,"15min":1.022},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93700000000000006,"5min":1.587,"15min":1.587},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.76600000000000001,"15min":0.79900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90500000000000003,"5min":1.913,"15min":1.913},"last":0.95399999999999996}]},{"osd":5,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.86899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.099},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.78000000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97599999999999998,"5min":1.018,"15min":1.018},"last":0.80800000000000005}]},{"osd":6,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93200000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.77600000000000002,"15min":0.78700000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92600000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.90000000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.81000000000000005,"15min":0.83999999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94999999999999996,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.97999999999999998,"5min":1.212,"15min":1.212},"last":0.995}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":378260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.55900000000000005,"15min":0.625},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61199999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.63600000000000001,"15min":0.70099999999999996},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70599999999999996,"5min":4.476,"15min":4.476},"last":0.52200000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.71399999999999997,"15min":0.83099999999999996},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66400000000000003,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.68100000000000005,"15min":0.77100000000000002},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.755,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.441}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.66000000000000003,"15min":0.71999999999999997},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.68400000000000005},"min":{"1min":0.318,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81799999999999995,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.94899999999999995,"15min":1.0549999999999999},"min":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86699999999999999,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.872,"15min":0.94999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98299999999999998,"5min":4.984,"15min":4.984},"last":0.64300000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.84699999999999998,"15min":0.92100000000000004},"min":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.98699999999999999,"15min":1.113},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.61199999999999999}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.88700000000000001,"15min":0.96699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92000000000000004,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.624},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.99199999999999999,"15min":1.115},"min":{"1min":0.56200000000000006,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96599999999999997,"5min":7.681,"15min":7.681},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.96099999999999997,"15min":1.0509999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94499999999999995,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.93200000000000005,"15min":1.0129999999999999},"min":{"1min":0.58899999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.042,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.69899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1458176,"data_stored":968468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.67100000000000004,"15min":0.78300000000000003},"min":{"1min":0.30499999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.378},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.78900000000000003,"15min":0.92500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.40799999999999997}]},{"osd":2,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.82199999999999995,"15min":0.96299999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90100000000000002,"15min":1.0680000000000001},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79200000000000004,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.36099999999999999}]},{"osd":3,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.80000000000000004,"15min":0.96799999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89800000000000002,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.71599999999999997,"15min":0.80400000000000005},"min":{"1min":0.36899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77000000000000002,"5min":3.254,"15min":3.254},"last":0.501}]},{"osd":4,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89400000000000002,"15min":0.96699999999999997},"min":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0660000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.92200000000000004,"15min":1.002},"min":{"1min":0.56499999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.98999999999999999,"15min":1.1180000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.625},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.90500000000000003,"15min":1.0089999999999999},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.90900000000000003,"15min":1.002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84499999999999997,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.056,"15min":1.206},"min":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.999,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":1.0760000000000001,"15min":1.214},"min":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0980000000000001,"5min":4.444,"15min":4.444},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96299999999999997,"15min":1.056},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.94899999999999995,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:28:17.316 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-16T03:28:17.317 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-16T03:28:17.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4fcfe640 1 Processor -- start 2023-12-16T03:28:17.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4fcfe640 1 -- start start 2023-12-16T03:28:17.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4fcfe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d480c61e0 0x7f8d480a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4fcfe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8d480c1270 0x7f8d480c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4fcfe640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d480c28e0 con 0x7f8d481555c0 2023-12-16T03:28:17.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4fcfe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d480c3680 con 0x7f8d480c1270 2023-12-16T03:28:17.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4fcfe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480c2b80 con 0x7f8d480c61e0 2023-12-16T03:28:17.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4da9a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8d481555c0 0x7f8d480c6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57248/0 (socket says 172.21.15.28:57248) 2023-12-16T03:28:17.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4da9a640 1 -- 172.21.15.28:0/222362185 learned_addr learned my addr 172.21.15.28:0/222362185 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:17.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4e29b640 1 --2- 172.21.15.28:0/222362185 >> v2:172.21.15.134:3300/0 conn(0x7f8d480c1270 0x7f8d480c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4d299640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d480c61e0 0x7f8d480a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370641211 0 0) 0x7f8d480c28e0 con 0x7f8d481555c0 2023-12-16T03:28:17.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d34003530 con 0x7f8d481555c0 2023-12-16T03:28:17.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4033344153 0 0) 0x7f8d34003530 con 0x7f8d481555c0 2023-12-16T03:28:17.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d480c61e0 msgr2=0x7f8d480a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:17.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d480c61e0 0x7f8d480a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 >> v2:172.21.15.134:3300/0 conn(0x7f8d480c1270 msgr2=0x7f8d480c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:17.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 --2- 172.21.15.28:0/222362185 >> v2:172.21.15.134:3300/0 conn(0x7f8d480c1270 0x7f8d480c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d480c32a0 con 0x7f8d481555c0 2023-12-16T03:28:17.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f8d44001680 con 0x7f8d481555c0 2023-12-16T03:28:17.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4e29b640 1 --2- 172.21.15.28:0/222362185 >> v2:172.21.15.134:3300/0 conn(0x7f8d480c1270 0x7f8d480c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:17.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 >> v1:172.21.15.28:6789/0 conn(0x7f8d481555c0 legacy=0x7f8d480c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:17.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d34003980 0x7f8d34003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d340047d0 0x7f8d34004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d480c61e0 0x7f8d34005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480c3680 con 0x7f8d34003980 2023-12-16T03:28:17.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480c2b80 con 0x7f8d340047d0 2023-12-16T03:28:17.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3400b990 con 0x7f8d480c61e0 2023-12-16T03:28:17.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4da9a640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d34003980 0x7f8d34003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4d299640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d340047d0 0x7f8d34004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4e29b640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d480c61e0 0x7f8d34005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4da9a640 1 -- 172.21.15.28:0/222362185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d480c61e0 msgr2=0x7f8d34005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4da9a640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d480c61e0 0x7f8d34005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4da9a640 1 -- 172.21.15.28:0/222362185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d340047d0 msgr2=0x7f8d34004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4da9a640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d340047d0 0x7f8d34004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.498+0000 7f8d4da9a640 1 -- 172.21.15.28:0/222362185 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d34003530 con 0x7f8d34003980 2023-12-16T03:28:17.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.502+0000 7f8d4da9a640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d34003980 0x7f8d34003da0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400c240 tx=0x7f8d4401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a93b56d048b403 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:17.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.502+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440058e0 con 0x7f8d34003980 2023-12-16T03:28:17.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.502+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d44005a40 con 0x7f8d34003980 2023-12-16T03:28:17.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.502+0000 7f8d4ca98640 1 -- 172.21.15.28:0/222362185 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44005e10 con 0x7f8d34003980 2023-12-16T03:28:17.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.502+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/222362185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d34003980 msgr2=0x7f8d34003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:17.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.502+0000 7f8d4fcfe640 1 --2- 172.21.15.28:0/222362185 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d34003980 0x7f8d34003da0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400c240 tx=0x7f8d4401cc60 comp rx=0 tx=0).stop 2023-12-16T03:28:17.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.502+0000 7f8d4e29b640 1 -- 172.21.15.28:0/222362185 reap_dead start 2023-12-16T03:28:17.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.502+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/222362185 shutdown_connections 2023-12-16T03:28:17.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.502+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/222362185 >> 172.21.15.28:0/222362185 conn(0x7f8d480c7e40 msgr2=0x7f8d480c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:17.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.502+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/222362185 shutdown_connections 2023-12-16T03:28:17.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.502+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/222362185 wait complete. 2023-12-16T03:28:17.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4fcfe640 1 Processor -- start 2023-12-16T03:28:17.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4fcfe640 1 -- start start 2023-12-16T03:28:17.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4fcfe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d481ed750 0x7f8d481500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4fcfe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d481567b0 0x7f8d481edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4fcfe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d481535e0 0x7f8d481580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4fcfe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d48156370 con 0x7f8d481ed750 2023-12-16T03:28:17.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4fcfe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d48155db0 con 0x7f8d481567b0 2023-12-16T03:28:17.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4fcfe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d48156090 con 0x7f8d481535e0 2023-12-16T03:28:17.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4da9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d481ed750 0x7f8d481500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4da9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d481ed750 0x7f8d481500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45864/0 (socket says 172.21.15.28:45864) 2023-12-16T03:28:17.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4da9a640 1 -- 172.21.15.28:0/3607152593 learned_addr learned my addr 172.21.15.28:0/3607152593 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:17.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4da9a640 1 -- 172.21.15.28:0/3607152593 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d481535e0 msgr2=0x7f8d481580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:17.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4da9a640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d481535e0 0x7f8d481580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4da9a640 1 -- 172.21.15.28:0/3607152593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d481567b0 msgr2=0x7f8d481edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:17.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4da9a640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d481567b0 0x7f8d481edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4da9a640 1 -- 172.21.15.28:0/3607152593 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d48152de0 con 0x7f8d481ed750 2023-12-16T03:28:17.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4da9a640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d481ed750 0x7f8d481500f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400c240 tx=0x7f8d34005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:17.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d3e7fc640 1 -- 172.21.15.28:0/3607152593 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44005db0 con 0x7f8d481ed750 2023-12-16T03:28:17.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d3e7fc640 1 -- 172.21.15.28:0/3607152593 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d440048b0 con 0x7f8d481ed750 2023-12-16T03:28:17.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d3e7fc640 1 -- 172.21.15.28:0/3607152593 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44004c60 con 0x7f8d481ed750 2023-12-16T03:28:17.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/3607152593 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d481530c0 con 0x7f8d481ed750 2023-12-16T03:28:17.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.506+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/3607152593 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d481ee070 con 0x7f8d481ed750 2023-12-16T03:28:17.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.510+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/3607152593 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d48153250 con 0x7f8d481ed750 2023-12-16T03:28:17.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.510+0000 7f8d3e7fc640 1 -- 172.21.15.28:0/3607152593 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8d440a5770 con 0x7f8d481ed750 2023-12-16T03:28:17.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.510+0000 7f8d3e7fc640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d2c066470 0x7f8d2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:17.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.510+0000 7f8d3e7fc640 1 -- 172.21.15.28:0/3607152593 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8d4411d7d0 con 0x7f8d481ed750 2023-12-16T03:28:17.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.510+0000 7f8d4d299640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d2c066470 0x7f8d2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:17.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.510+0000 7f8d4d299640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d2c066470 0x7f8d2c068930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8d480adb80 tx=0x7f8d38009340 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:17.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.514+0000 7f8d3e7fc640 1 -- 172.21.15.28:0/3607152593 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8d440ea980 con 0x7f8d481ed750 2023-12-16T03:28:17.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.726+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/3607152593 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f8d48068400 con 0x7f8d481ed750 2023-12-16T03:28:17.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.726+0000 7f8d3e7fc640 1 -- 172.21.15.28:0/3607152593 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v20) v1 ==== 185+0+142 (secure 0 0 0) 0x7f8d440edfa0 con 0x7f8d481ed750 2023-12-16T03:28:17.732 INFO:teuthology.orchestra.run.smithi028.stdout:[client.1] 2023-12-16T03:28:17.733 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBYGH1lgMMbKBAACWizLH1wqYLfSHVjCwyqHQ== 2023-12-16T03:28:17.733 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2023-12-16T03:28:17.733 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2023-12-16T03:28:17.733 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-16T03:28:17.733 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.1 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/3607152593 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d2c066470 msgr2=0x7f8d2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d2c066470 0x7f8d2c068930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8d480adb80 tx=0x7f8d38009340 comp rx=0 tx=0).stop 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/3607152593 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d481ed750 msgr2=0x7f8d481500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d481ed750 0x7f8d481500f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400c240 tx=0x7f8d34005800 comp rx=0 tx=0).stop 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/3607152593 shutdown_connections 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8d481535e0 0x7f8d481580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d481567b0 0x7f8d481edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8d2c066470 0x7f8d2c068930 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 --2- 172.21.15.28:0/3607152593 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d481ed750 0x7f8d481500f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/3607152593 >> 172.21.15.28:0/3607152593 conn(0x7f8d480c7e40 msgr2=0x7f8d480c4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/3607152593 shutdown_connections 2023-12-16T03:28:17.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.730+0000 7f8d4fcfe640 1 -- 172.21.15.28:0/3607152593 wait complete. 2023-12-16T03:28:17.754 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:17.754 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:17.764 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:17.764 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:17.817 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:17.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9008c46640 1 Processor -- start 2023-12-16T03:28:18.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9008c46640 1 -- start start 2023-12-16T03:28:18.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9008c46640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9004151e90 0x7f90040c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9008c46640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90040c7ea0 0x7f900406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9008c46640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900406c860 con 0x7f90040c4e60 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9008c46640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90040c8750 con 0x7f9004151e90 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9008c46640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90041552d0 con 0x7f90040c7ea0 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9002d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f90040c4e60 0x7f900406b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57260/0 (socket says 172.21.15.28:57260) 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9002d9d640 1 -- 172.21.15.28:0/2955504996 learned_addr learned my addr 172.21.15.28:0/2955504996 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f8ffbfff640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90040c7ea0 0x7f900406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f900259c640 1 --2- 172.21.15.28:0/2955504996 >> v2:172.21.15.134:3300/0 conn(0x7f9004151e90 0x7f90040c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926776244 0 0) 0x7f900406c860 con 0x7f90040c4e60 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff0003530 con 0x7f90040c4e60 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1306769676 0 0) 0x7f8ff0003530 con 0x7f90040c4e60 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90040c7ea0 msgr2=0x7f900406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:18.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90040c7ea0 0x7f900406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 >> v2:172.21.15.134:3300/0 conn(0x7f9004151e90 msgr2=0x7f90040c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 --2- 172.21.15.28:0/2955504996 >> v2:172.21.15.134:3300/0 conn(0x7f9004151e90 0x7f90040c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9004154930 con 0x7f90040c4e60 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f8ffc001a00 con 0x7f90040c4e60 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f900259c640 1 --2- 172.21.15.28:0/2955504996 >> v2:172.21.15.134:3300/0 conn(0x7f9004151e90 0x7f90040c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f8ffbfff640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90040c7ea0 0x7f900406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 >> v1:172.21.15.28:6789/0 conn(0x7f90040c4e60 legacy=0x7f900406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff0003980 0x7f8ff0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90040c7ea0 0x7f8ff00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ff0004d10 0x7f8ff0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90040c8750 con 0x7f8ff0004d10 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90041552d0 con 0x7f8ff0003980 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff000ba40 con 0x7f90040c7ea0 2023-12-16T03:28:18.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f900259c640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff0003980 0x7f8ff0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f8ffbfff640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90040c7ea0 0x7f8ff00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f9002d9d640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ff0004d10 0x7f8ff0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f900259c640 1 -- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90040c7ea0 msgr2=0x7f8ff00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f900259c640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90040c7ea0 0x7f8ff00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f900259c640 1 -- 172.21.15.28:0/2955504996 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ff0004d10 msgr2=0x7f8ff0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f900259c640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8ff0004d10 0x7f8ff0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.958+0000 7f900259c640 1 -- 172.21.15.28:0/2955504996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec009420 con 0x7f8ff0003980 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.962+0000 7f900259c640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff0003980 0x7f8ff0003da0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009cb0 tx=0x7f8ff401cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2beb619c24fdbb71 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.962+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40a5710 con 0x7f8ff0003980 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.962+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff40a5870 con 0x7f8ff0003980 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.962+0000 7f9001d9b640 1 -- 172.21.15.28:0/2955504996 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40a5c20 con 0x7f8ff0003980 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.962+0000 7f9008c46640 1 -- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff0003980 msgr2=0x7f8ff0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.962+0000 7f9008c46640 1 --2- 172.21.15.28:0/2955504996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ff0003980 0x7f8ff0003da0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009cb0 tx=0x7f8ff401cc70 comp rx=0 tx=0).stop 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.962+0000 7f9002d9d640 1 -- 172.21.15.28:0/2955504996 reap_dead start 2023-12-16T03:28:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.962+0000 7f9008c46640 1 -- 172.21.15.28:0/2955504996 shutdown_connections 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.962+0000 7f9008c46640 1 -- 172.21.15.28:0/2955504996 >> 172.21.15.28:0/2955504996 conn(0x7f90040ca170 msgr2=0x7f90040ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.962+0000 7f9008c46640 1 -- 172.21.15.28:0/2955504996 shutdown_connections 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.962+0000 7f9008c46640 1 -- 172.21.15.28:0/2955504996 wait complete. 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9008c46640 1 Processor -- start 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9008c46640 1 -- start start 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9008c46640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ff0003980 0x7f900414ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9008c46640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90040c3eb0 0x7f9004153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9008c46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f900414dae0 0x7f900414c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9008c46640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900414e9e0 con 0x7f900414dae0 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9008c46640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9004154610 con 0x7f90040c3eb0 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9008c46640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90041ecf60 con 0x7f8ff0003980 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9002d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f900414dae0 0x7f900414c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9002d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f900414dae0 0x7f900414c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45872/0 (socket says 172.21.15.28:45872) 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9002d9d640 1 -- 172.21.15.28:0/1601411402 learned_addr learned my addr 172.21.15.28:0/1601411402 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f900259c640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ff0003980 0x7f900414ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f8ffbfff640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90040c3eb0 0x7f9004153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9002d9d640 1 -- 172.21.15.28:0/1601411402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ff0003980 msgr2=0x7f900414ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9002d9d640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ff0003980 0x7f900414ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9002d9d640 1 -- 172.21.15.28:0/1601411402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90040c3eb0 msgr2=0x7f9004153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9002d9d640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90040c3eb0 0x7f9004153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9002d9d640 1 -- 172.21.15.28:0/1601411402 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900414e0b0 con 0x7f900414dae0 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.966+0000 7f9002d9d640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f900414dae0 0x7f900414c140 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f900406a9b0 tx=0x7f8ffc007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.970+0000 7f8ffaffd640 1 -- 172.21.15.28:0/1601411402 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc00aad0 con 0x7f900414dae0 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.970+0000 7f8ffaffd640 1 -- 172.21.15.28:0/1601411402 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc00ac50 con 0x7f900414dae0 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.970+0000 7f9008c46640 1 -- 172.21.15.28:0/1601411402 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900414e390 con 0x7f900414dae0 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.970+0000 7f8ffaffd640 1 -- 172.21.15.28:0/1601411402 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0133f0 con 0x7f900414dae0 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.970+0000 7f9008c46640 1 -- 172.21.15.28:0/1601411402 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9004153cb0 con 0x7f900414dae0 2023-12-16T03:28:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.970+0000 7f9008c46640 1 -- 172.21.15.28:0/1601411402 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900414eb90 con 0x7f900414dae0 2023-12-16T03:28:18.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.970+0000 7f8ffaffd640 1 -- 172.21.15.28:0/1601411402 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8ffc013550 con 0x7f900414dae0 2023-12-16T03:28:18.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.970+0000 7f8ffaffd640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8fe40664a0 0x7f8fe4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.970+0000 7f8ffaffd640 1 -- 172.21.15.28:0/1601411402 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8ffc084950 con 0x7f900414dae0 2023-12-16T03:28:18.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.970+0000 7f900259c640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8fe40664a0 0x7f8fe4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.970+0000 7f900259c640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8fe40664a0 0x7f8fe4068960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40af000 tx=0x7f8ff40046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:18.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:17.974+0000 7f8ffaffd640 1 -- 172.21.15.28:0/1601411402 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f900414eb90 con 0x7f900414dae0 2023-12-16T03:28:18.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.134+0000 7f9008c46640 1 -- 172.21.15.28:0/1601411402 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9004068400 con 0x7f900414dae0 2023-12-16T03:28:18.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.134+0000 7f8ffaffd640 1 -- 172.21.15.28:0/1601411402 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20214 (secure 0 0 0) 0x7f8ffc017020 con 0x7f900414dae0 2023-12-16T03:28:18.140 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:18.140 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:13.793649+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 -- 172.21.15.28:0/1601411402 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8fe40664a0 msgr2=0x7f8fe4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8fe40664a0 0x7f8fe4068960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40af000 tx=0x7f8ff40046d0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 -- 172.21.15.28:0/1601411402 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f900414dae0 msgr2=0x7f900414c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f900414dae0 0x7f900414c140 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f900406a9b0 tx=0x7f8ffc007b00 comp rx=0 tx=0).stop 2023-12-16T03:28:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 -- 172.21.15.28:0/1601411402 shutdown_connections 2023-12-16T03:28:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8fe40664a0 0x7f8fe4068960 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f900414dae0 0x7f900414c140 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90040c3eb0 0x7f9004153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 --2- 172.21.15.28:0/1601411402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ff0003980 0x7f900414ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 -- 172.21.15.28:0/1601411402 >> 172.21.15.28:0/1601411402 conn(0x7f90040ca170 msgr2=0x7f900414b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:18.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 -- 172.21.15.28:0/1601411402 shutdown_connections 2023-12-16T03:28:18.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.138+0000 7f9008c46640 1 -- 172.21.15.28:0/1601411402 wait complete. 2023-12-16T03:28:18.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:27:56.894984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:27:58.090972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:28:10.280019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:28:11.167317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:28:18.162 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:28:18.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.302+0000 7efc134fe640 1 Processor -- start 2023-12-16T03:28:18.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.302+0000 7efc134fe640 1 -- start start 2023-12-16T03:28:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.302+0000 7efc134fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc0c0c63c0 0x7efc0c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.302+0000 7efc134fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 0x7efc0c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.302+0000 7efc134fe640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c0c31c0 con 0x7efc0c0c29e0 2023-12-16T03:28:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.302+0000 7efc134fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0c0c34a0 con 0x7efc0c0c63c0 2023-12-16T03:28:18.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.302+0000 7efc134fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0c1030 con 0x7efc0c0c4100 2023-12-16T03:28:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc11a9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efc0c0c29e0 0x7efc0c0a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57274/0 (socket says 172.21.15.28:57274) 2023-12-16T03:28:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc11a9b640 1 -- 172.21.15.28:0/2298954411 learned_addr learned my addr 172.21.15.28:0/2298954411 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc10a99640 1 --2- 172.21.15.28:0/2298954411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 0x7efc0c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc1129a640 1 --2- 172.21.15.28:0/2298954411 >> v2:172.21.15.134:3300/0 conn(0x7efc0c0c63c0 0x7efc0c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc03fff640 1 -- 172.21.15.28:0/2298954411 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127620090 0 0) 0x7efc0c0c31c0 con 0x7efc0c0c29e0 2023-12-16T03:28:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc03fff640 1 -- 172.21.15.28:0/2298954411 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbf8005740 con 0x7efc0c0c29e0 2023-12-16T03:28:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc10a99640 1 -- 172.21.15.28:0/2298954411 >> v2:172.21.15.134:3300/0 conn(0x7efc0c0c63c0 msgr2=0x7efc0c0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc10a99640 1 --2- 172.21.15.28:0/2298954411 >> v2:172.21.15.134:3300/0 conn(0x7efc0c0c63c0 0x7efc0c0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc03fff640 1 -- 172.21.15.28:0/2298954411 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1611153064 0 0) 0x7efbf8005740 con 0x7efc0c0c29e0 2023-12-16T03:28:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc10a99640 1 -- 172.21.15.28:0/2298954411 >> v1:172.21.15.28:6789/0 conn(0x7efc0c0c29e0 legacy=0x7efc0c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc10a99640 1 -- 172.21.15.28:0/2298954411 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0c1310 con 0x7efc0c0c4100 2023-12-16T03:28:18.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.306+0000 7efc10a99640 1 --2- 172.21.15.28:0/2298954411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 0x7efc0c0c24a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097c0 tx=0x7efbfc01c250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b44e2c421f415737 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:18.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc03fff640 1 -- 172.21.15.28:0/2298954411 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04001a00 con 0x7efc0c0c4100 2023-12-16T03:28:18.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc03fff640 1 -- 172.21.15.28:0/2298954411 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc0a7050 con 0x7efc0c0c4100 2023-12-16T03:28:18.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc03fff640 1 -- 172.21.15.28:0/2298954411 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0ab620 con 0x7efc0c0c4100 2023-12-16T03:28:18.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 -- 172.21.15.28:0/2298954411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 msgr2=0x7efc0c0c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 --2- 172.21.15.28:0/2298954411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 0x7efc0c0c24a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097c0 tx=0x7efbfc01c250 comp rx=0 tx=0).stop 2023-12-16T03:28:18.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 -- 172.21.15.28:0/2298954411 shutdown_connections 2023-12-16T03:28:18.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 --2- 172.21.15.28:0/2298954411 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 0x7efc0c0c24a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 --2- 172.21.15.28:0/2298954411 >> v2:172.21.15.134:3300/0 conn(0x7efc0c0c63c0 0x7efc0c0c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 -- 172.21.15.28:0/2298954411 >> 172.21.15.28:0/2298954411 conn(0x7efc0c06a5b0 msgr2=0x7efc0c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:18.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 -- 172.21.15.28:0/2298954411 shutdown_connections 2023-12-16T03:28:18.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 -- 172.21.15.28:0/2298954411 wait complete. 2023-12-16T03:28:18.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 Processor -- start 2023-12-16T03:28:18.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 -- start start 2023-12-16T03:28:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc0c0c29e0 0x7efc0c0c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 0x7efc0c09b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0c63c0 0x7efc0c153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c1ed690 con 0x7efc0c0c29e0 2023-12-16T03:28:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c1ed970 con 0x7efc0c0c63c0 2023-12-16T03:28:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc134fe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0bded0 con 0x7efc0c0c4100 2023-12-16T03:28:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.310+0000 7efc1129a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc0c0c29e0 0x7efc0c0c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc1129a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc0c0c29e0 0x7efc0c0c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45880/0 (socket says 172.21.15.28:45880) 2023-12-16T03:28:18.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc1129a640 1 -- 172.21.15.28:0/4083903815 learned_addr learned my addr 172.21.15.28:0/4083903815 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc10a99640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 0x7efc0c09b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc1129a640 1 -- 172.21.15.28:0/4083903815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 msgr2=0x7efc0c09b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc11a9b640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0c63c0 0x7efc0c153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc1129a640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 0x7efc0c09b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc1129a640 1 -- 172.21.15.28:0/4083903815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0c63c0 msgr2=0x7efc0c153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc1129a640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0c63c0 0x7efc0c153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc1129a640 1 -- 172.21.15.28:0/4083903815 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc009420 con 0x7efc0c0c29e0 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc10a99640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 0x7efc0c09b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc11a9b640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0c63c0 0x7efc0c153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc1129a640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc0c0c29e0 0x7efc0c0c4ae0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e870 tx=0x7efc0800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc01ffb640 1 -- 172.21.15.28:0/4083903815 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08009510 con 0x7efc0c0c29e0 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc01ffb640 1 -- 172.21.15.28:0/4083903815 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0800eec0 con 0x7efc0c0c29e0 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc134fe640 1 -- 172.21.15.28:0/4083903815 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c0be1b0 con 0x7efc0c0c29e0 2023-12-16T03:28:18.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc01ffb640 1 -- 172.21.15.28:0/4083903815 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0800cb40 con 0x7efc0c0c29e0 2023-12-16T03:28:18.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc134fe640 1 -- 172.21.15.28:0/4083903815 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c0bfb30 con 0x7efc0c0c29e0 2023-12-16T03:28:18.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc134fe640 1 -- 172.21.15.28:0/4083903815 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c068400 con 0x7efc0c0c29e0 2023-12-16T03:28:18.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.314+0000 7efc01ffb640 1 -- 172.21.15.28:0/4083903815 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7efc0800cca0 con 0x7efc0c0c29e0 2023-12-16T03:28:18.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.318+0000 7efc01ffb640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbf0066470 0x7efbf0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.318+0000 7efc01ffb640 1 -- 172.21.15.28:0/4083903815 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efc08084370 con 0x7efc0c0c29e0 2023-12-16T03:28:18.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.318+0000 7efc10a99640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbf0066470 0x7efbf0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.318+0000 7efc10a99640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbf0066470 0x7efbf0068930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0ad000 tx=0x7efbfc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:18.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.322+0000 7efc01ffb640 1 -- 172.21.15.28:0/4083903815 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7efc08051480 con 0x7efc0c0c29e0 2023-12-16T03:28:18.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.478+0000 7efc134fe640 1 -- 172.21.15.28:0/4083903815 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc0c0be340 con 0x7efc0c0c29e0 2023-12-16T03:28:18.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.478+0000 7efc01ffb640 1 -- 172.21.15.28:0/4083903815 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc08054aa0 con 0x7efc0c0c29e0 2023-12-16T03:28:18.484 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:28:18.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 -- 172.21.15.28:0/4083903815 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbf0066470 msgr2=0x7efbf0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbf0066470 0x7efbf0068930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0ad000 tx=0x7efbfc008040 comp rx=0 tx=0).stop 2023-12-16T03:28:18.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 -- 172.21.15.28:0/4083903815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc0c0c29e0 msgr2=0x7efc0c0c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc0c0c29e0 0x7efc0c0c4ae0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e870 tx=0x7efc0800ec70 comp rx=0 tx=0).stop 2023-12-16T03:28:18.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 -- 172.21.15.28:0/4083903815 shutdown_connections 2023-12-16T03:28:18.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0c63c0 0x7efc0c153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc0c0c4100 0x7efc0c09b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efbf0066470 0x7efbf0068930 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 --2- 172.21.15.28:0/4083903815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc0c0c29e0 0x7efc0c0c4ae0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 -- 172.21.15.28:0/4083903815 >> 172.21.15.28:0/4083903815 conn(0x7efc0c06a5b0 msgr2=0x7efc0c155180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:18.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 -- 172.21.15.28:0/4083903815 shutdown_connections 2023-12-16T03:28:18.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.482+0000 7efc134fe640 1 -- 172.21.15.28:0/4083903815 wait complete. 2023-12-16T03:28:18.505 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:28:18.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9b1a9a640 1 Processor -- start 2023-12-16T03:28:18.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9b1a9a640 1 -- start start 2023-12-16T03:28:18.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9b1a9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9ac0c63c0 0x7fc9ac0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9b1a9a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9ac0c2bb0 0x7fc9ac0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9b1a9a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac0c31c0 con 0x7fc9ac0c4100 2023-12-16T03:28:18.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9b1a9a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac0c34a0 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9b1a9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac0c1030 con 0x7fc9ac0c63c0 2023-12-16T03:28:18.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9abfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9ac0c2bb0 0x7fc9ac0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9ab7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9ac0c63c0 0x7fc9ac0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9abfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc9ac0c2bb0 0x7fc9ac0a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:41076/0 (socket says 172.21.15.28:41076) 2023-12-16T03:28:18.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9abfff640 1 -- 172.21.15.28:0/198929166 learned_addr learned my addr 172.21.15.28:0/198929166 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:18.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9abfff640 1 -- 172.21.15.28:0/198929166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9ac0c63c0 msgr2=0x7fc9ac0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:18.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9abfff640 1 --2- 172.21.15.28:0/198929166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9ac0c63c0 0x7fc9ac0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9abfff640 1 -- 172.21.15.28:0/198929166 >> v1:172.21.15.134:6789/0 conn(0x7fc9ac0c4100 legacy=0x7fc9ac0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.650+0000 7fc9abfff640 1 -- 172.21.15.28:0/198929166 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac0c1310 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9abfff640 1 --2- 172.21.15.28:0/198929166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9ac0c2bb0 0x7fc9ac0a9680 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009e50 tx=0x7fc9a401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7f4a5ab7d8203ab server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:18.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9aa7fc640 1 -- 172.21.15.28:0/198929166 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0aa3d0 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9aa7fc640 1 -- 172.21.15.28:0/198929166 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a40a57a0 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9aa7fc640 1 -- 172.21.15.28:0/198929166 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40a5b30 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/198929166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9ac0c2bb0 msgr2=0x7fc9ac0a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9b1a9a640 1 --2- 172.21.15.28:0/198929166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9ac0c2bb0 0x7fc9ac0a9680 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009e50 tx=0x7fc9a401c8c0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/198929166 shutdown_connections 2023-12-16T03:28:18.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9b1a9a640 1 --2- 172.21.15.28:0/198929166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9ac0c2bb0 0x7fc9ac0a9680 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9b1a9a640 1 --2- 172.21.15.28:0/198929166 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9ac0c63c0 0x7fc9ac0c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/198929166 >> 172.21.15.28:0/198929166 conn(0x7fc9ac06a5b0 msgr2=0x7fc9ac06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:18.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/198929166 shutdown_connections 2023-12-16T03:28:18.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/198929166 wait complete. 2023-12-16T03:28:18.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.654+0000 7fc9b1a9a640 1 Processor -- start 2023-12-16T03:28:18.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9b1a9a640 1 -- start start 2023-12-16T03:28:18.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9b1a9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9ac0c2bb0 0x7fc9ac154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9b1a9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9ac0c4100 0x7fc9ac15a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9b1a9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9ac0c63c0 0x7fc9ac1f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9b1a9a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac14a030 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9b1a9a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac154600 con 0x7fc9ac0c63c0 2023-12-16T03:28:18.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9b1a9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac1edb80 con 0x7fc9ac0c4100 2023-12-16T03:28:18.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9ab7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9ac0c2bb0 0x7fc9ac154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9ab7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9ac0c2bb0 0x7fc9ac154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45882/0 (socket says 172.21.15.28:45882) 2023-12-16T03:28:18.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9ab7fe640 1 -- 172.21.15.28:0/3798837060 learned_addr learned my addr 172.21.15.28:0/3798837060 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:18.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9abfff640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9ac0c63c0 0x7fc9ac1f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9aaffd640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9ac0c4100 0x7fc9ac15a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9ab7fe640 1 -- 172.21.15.28:0/3798837060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9ac0c4100 msgr2=0x7fc9ac15a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9ab7fe640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9ac0c4100 0x7fc9ac15a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9ab7fe640 1 -- 172.21.15.28:0/3798837060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9ac0c63c0 msgr2=0x7fc9ac1f01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9ab7fe640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9ac0c63c0 0x7fc9ac1f01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9ab7fe640 1 -- 172.21.15.28:0/3798837060 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4009b30 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9ab7fe640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9ac0c2bb0 0x7fc9ac154a90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00e870 tx=0x7fc99c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:18.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc993fff640 1 -- 172.21.15.28:0/3798837060 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c009510 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc993fff640 1 -- 172.21.15.28:0/3798837060 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c00eec0 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/3798837060 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac155280 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc993fff640 1 -- 172.21.15.28:0/3798837060 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00cb40 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/3798837060 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac155840 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.658+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/3798837060 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac068400 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.662+0000 7fc993fff640 1 -- 172.21.15.28:0/3798837060 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc99c00cca0 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.662+0000 7fc993fff640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc998066470 0x7fc998068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.662+0000 7fc993fff640 1 -- 172.21.15.28:0/3798837060 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc99c0841f0 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.662+0000 7fc9aaffd640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc998066470 0x7fc998068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:18.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.662+0000 7fc9aaffd640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc998066470 0x7fc998068930 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0c0940 tx=0x7fc9a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:18.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.666+0000 7fc993fff640 1 -- 172.21.15.28:0/3798837060 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc99c0513b0 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.822+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/3798837060 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9ac06a990 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc993fff640 1 -- 172.21.15.28:0/3798837060 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc99c0549d0 con 0x7fc9ac0c2bb0 2023-12-16T03:28:18.830 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:18.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/3798837060 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc998066470 msgr2=0x7fc998068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc998066470 0x7fc998068930 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0c0940 tx=0x7fc9a0009040 comp rx=0 tx=0).stop 2023-12-16T03:28:18.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/3798837060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9ac0c2bb0 msgr2=0x7fc9ac154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:18.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9ac0c2bb0 0x7fc9ac154a90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00e870 tx=0x7fc99c00ec70 comp rx=0 tx=0).stop 2023-12-16T03:28:18.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/3798837060 shutdown_connections 2023-12-16T03:28:18.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9ac0c63c0 0x7fc9ac1f01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9ac0c4100 0x7fc9ac15a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc998066470 0x7fc998068930 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 --2- 172.21.15.28:0/3798837060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9ac0c2bb0 0x7fc9ac154a90 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:18.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/3798837060 >> 172.21.15.28:0/3798837060 conn(0x7fc9ac06a5b0 msgr2=0x7fc9ac070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:18.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/3798837060 shutdown_connections 2023-12-16T03:28:18.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.826+0000 7fc9b1a9a640 1 -- 172.21.15.28:0/3798837060 wait complete. 2023-12-16T03:28:18.851 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:28:18.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12c9c1640 1 Processor -- start 2023-12-16T03:28:18.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12c9c1640 1 -- start start 2023-12-16T03:28:18.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12c9c1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd128072090 0x7fd1280a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12c9c1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd1280c3bd0 0x7fd1280c4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:18.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12c9c1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1280c2760 con 0x7fd1280725c0 2023-12-16T03:28:18.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12c9c1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1280c3070 con 0x7fd128072090 2023-12-16T03:28:18.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12c9c1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1280c63e0 con 0x7fd1280c3bd0 2023-12-16T03:28:18.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd128072090 0x7fd1280a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd128072090 0x7fd1280a5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45884/0 (socket says 172.21.15.28:45884) 2023-12-16T03:28:19.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12659c640 1 -- 172.21.15.28:0/3502496416 learned_addr learned my addr 172.21.15.28:0/3502496416 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:19.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd126d9d640 1 --2- 172.21.15.28:0/3502496416 >> v2:172.21.15.134:3300/0 conn(0x7fd1280c3bd0 0x7fd1280c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12659c640 1 -- 172.21.15.28:0/3502496416 >> v2:172.21.15.134:3300/0 conn(0x7fd1280c3bd0 msgr2=0x7fd1280c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:19.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12659c640 1 --2- 172.21.15.28:0/3502496416 >> v2:172.21.15.134:3300/0 conn(0x7fd1280c3bd0 0x7fd1280c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12659c640 1 -- 172.21.15.28:0/3502496416 >> v1:172.21.15.134:6789/0 conn(0x7fd1280725c0 legacy=0x7fd1280c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:19.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.994+0000 7fd12659c640 1 -- 172.21.15.28:0/3502496416 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1280aad20 con 0x7fd128072090 2023-12-16T03:28:19.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd12659c640 1 --2- 172.21.15.28:0/3502496416 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd128072090 0x7fd1280a5370 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd128072020 tx=0x7fd11801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee2a0fd25e712c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:19.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd125d9b640 1 -- 172.21.15.28:0/3502496416 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180ac640 con 0x7fd128072090 2023-12-16T03:28:19.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd125d9b640 1 -- 172.21.15.28:0/3502496416 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1180ac7a0 con 0x7fd128072090 2023-12-16T03:28:19.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd125d9b640 1 -- 172.21.15.28:0/3502496416 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180acb30 con 0x7fd128072090 2023-12-16T03:28:19.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd12c9c1640 1 -- 172.21.15.28:0/3502496416 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd128072090 msgr2=0x7fd1280a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd12c9c1640 1 --2- 172.21.15.28:0/3502496416 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd128072090 0x7fd1280a5370 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd128072020 tx=0x7fd11801c3e0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd12c9c1640 1 -- 172.21.15.28:0/3502496416 shutdown_connections 2023-12-16T03:28:19.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd12c9c1640 1 --2- 172.21.15.28:0/3502496416 >> v2:172.21.15.134:3300/0 conn(0x7fd1280c3bd0 0x7fd1280c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd12c9c1640 1 --2- 172.21.15.28:0/3502496416 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd128072090 0x7fd1280a5370 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd12c9c1640 1 -- 172.21.15.28:0/3502496416 >> 172.21.15.28:0/3502496416 conn(0x7fd12806a5b0 msgr2=0x7fd12806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:19.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd12c9c1640 1 -- 172.21.15.28:0/3502496416 shutdown_connections 2023-12-16T03:28:19.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:18.998+0000 7fd12c9c1640 1 -- 172.21.15.28:0/3502496416 wait complete. 2023-12-16T03:28:19.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12c9c1640 1 Processor -- start 2023-12-16T03:28:19.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12c9c1640 1 -- start start 2023-12-16T03:28:19.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12c9c1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd128072090 0x7fd128153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12c9c1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1280725c0 0x7fd1280bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12c9c1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1280c3bd0 0x7fd12813f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12c9c1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1281540f0 con 0x7fd1280c3bd0 2023-12-16T03:28:19.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12c9c1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd128153b30 con 0x7fd1280725c0 2023-12-16T03:28:19.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12c9c1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd128153e10 con 0x7fd128072090 2023-12-16T03:28:19.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd126d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1280c3bd0 0x7fd12813f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd126d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1280c3bd0 0x7fd12813f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45888/0 (socket says 172.21.15.28:45888) 2023-12-16T03:28:19.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd126d9d640 1 -- 172.21.15.28:0/1308659101 learned_addr learned my addr 172.21.15.28:0/1308659101 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:19.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd11ffff640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1280725c0 0x7fd1280bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12659c640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd128072090 0x7fd128153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd126d9d640 1 -- 172.21.15.28:0/1308659101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd128072090 msgr2=0x7fd128153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd126d9d640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd128072090 0x7fd128153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd126d9d640 1 -- 172.21.15.28:0/1308659101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1280725c0 msgr2=0x7fd1280bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd126d9d640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1280725c0 0x7fd1280bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd126d9d640 1 -- 172.21.15.28:0/1308659101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1180094d0 con 0x7fd1280c3bd0 2023-12-16T03:28:19.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd11ffff640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1280725c0 0x7fd1280bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:19.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd126d9d640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1280c3bd0 0x7fd12813f290 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd120007e40 tx=0x7fd12000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:19.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd11effd640 1 -- 172.21.15.28:0/1308659101 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120014620 con 0x7fd1280c3bd0 2023-12-16T03:28:19.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd11effd640 1 -- 172.21.15.28:0/1308659101 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12000ee90 con 0x7fd1280c3bd0 2023-12-16T03:28:19.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12c9c1640 1 -- 172.21.15.28:0/1308659101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd128152b00 con 0x7fd1280c3bd0 2023-12-16T03:28:19.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd11effd640 1 -- 172.21.15.28:0/1308659101 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200149e0 con 0x7fd1280c3bd0 2023-12-16T03:28:19.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12c9c1640 1 -- 172.21.15.28:0/1308659101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1280bf8a0 con 0x7fd1280c3bd0 2023-12-16T03:28:19.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.002+0000 7fd12c9c1640 1 -- 172.21.15.28:0/1308659101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd128152940 con 0x7fd1280c3bd0 2023-12-16T03:28:19.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.006+0000 7fd11effd640 1 -- 172.21.15.28:0/1308659101 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd120014b40 con 0x7fd1280c3bd0 2023-12-16T03:28:19.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.006+0000 7fd11effd640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1080664a0 0x7fd108068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.006+0000 7fd11effd640 1 -- 172.21.15.28:0/1308659101 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd120084b70 con 0x7fd1280c3bd0 2023-12-16T03:28:19.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.006+0000 7fd12659c640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1080664a0 0x7fd108068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.006+0000 7fd12659c640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1080664a0 0x7fd108068960 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd1180ae000 tx=0x7fd1180a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:19.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.010+0000 7fd11effd640 1 -- 172.21.15.28:0/1308659101 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd120051bf0 con 0x7fd1280c3bd0 2023-12-16T03:28:19.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.162+0000 7fd12c9c1640 1 -- 172.21.15.28:0/1308659101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd128068400 con 0x7fd1280c3bd0 2023-12-16T03:28:19.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd11effd640 1 -- 172.21.15.28:0/1308659101 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd120055210 con 0x7fd1280c3bd0 2023-12-16T03:28:19.170 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:19.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 -- 172.21.15.28:0/1308659101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1080664a0 msgr2=0x7fd108068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1080664a0 0x7fd108068960 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd1180ae000 tx=0x7fd1180a7000 comp rx=0 tx=0).stop 2023-12-16T03:28:19.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 -- 172.21.15.28:0/1308659101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1280c3bd0 msgr2=0x7fd12813f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1280c3bd0 0x7fd12813f290 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd120007e40 tx=0x7fd12000e4b0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 -- 172.21.15.28:0/1308659101 shutdown_connections 2023-12-16T03:28:19.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1080664a0 0x7fd108068960 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1280c3bd0 0x7fd12813f290 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1280725c0 0x7fd1280bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 --2- 172.21.15.28:0/1308659101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd128072090 0x7fd128153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 -- 172.21.15.28:0/1308659101 >> 172.21.15.28:0/1308659101 conn(0x7fd12806a5b0 msgr2=0x7fd1281421e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:19.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 -- 172.21.15.28:0/1308659101 shutdown_connections 2023-12-16T03:28:19.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.166+0000 7fd12c9c1640 1 -- 172.21.15.28:0/1308659101 wait complete. 2023-12-16T03:28:19.190 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:28:19.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.330+0000 7f7d6759e640 1 Processor -- start 2023-12-16T03:28:19.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.330+0000 7f7d6759e640 1 -- start start 2023-12-16T03:28:19.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6759e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7d68151cd0 0x7f7d680ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6759e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d680c7c50 0x7f7d681544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6759e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d680c8160 con 0x7f7d680ca9a0 2023-12-16T03:28:19.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6759e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d68157b40 con 0x7f7d68151cd0 2023-12-16T03:28:19.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6759e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d68157e20 con 0x7f7d680c7c50 2023-12-16T03:28:19.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7d68151cd0 0x7f7d680ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7d68151cd0 0x7f7d680ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45890/0 (socket says 172.21.15.28:45890) 2023-12-16T03:28:19.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6659c640 1 -- 172.21.15.28:0/3791929179 learned_addr learned my addr 172.21.15.28:0/3791929179 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:19.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d5ffff640 1 --2- 172.21.15.28:0/3791929179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d680c7c50 0x7f7d681544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6659c640 1 -- 172.21.15.28:0/3791929179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d680c7c50 msgr2=0x7f7d681544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:19.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6659c640 1 --2- 172.21.15.28:0/3791929179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d680c7c50 0x7f7d681544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6659c640 1 -- 172.21.15.28:0/3791929179 >> v1:172.21.15.134:6789/0 conn(0x7f7d680ca9a0 legacy=0x7f7d6806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d6659c640 1 -- 172.21.15.28:0/3791929179 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68158100 con 0x7f7d68151cd0 2023-12-16T03:28:19.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.334+0000 7f7d5ffff640 1 --2- 172.21.15.28:0/3791929179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d680c7c50 0x7f7d681544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:19.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6659c640 1 --2- 172.21.15.28:0/3791929179 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d68151cd0 0x7f7d680ca460 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009870 tx=0x7f7d5801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9af17492589d158 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:19.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d65d9b640 1 -- 172.21.15.28:0/3791929179 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580a95f0 con 0x7f7d68151cd0 2023-12-16T03:28:19.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d65d9b640 1 -- 172.21.15.28:0/3791929179 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d580a9750 con 0x7f7d68151cd0 2023-12-16T03:28:19.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d65d9b640 1 -- 172.21.15.28:0/3791929179 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580a9ae0 con 0x7f7d68151cd0 2023-12-16T03:28:19.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 -- 172.21.15.28:0/3791929179 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d68151cd0 msgr2=0x7f7d680ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 --2- 172.21.15.28:0/3791929179 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d68151cd0 0x7f7d680ca460 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009870 tx=0x7f7d5801c510 comp rx=0 tx=0).stop 2023-12-16T03:28:19.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 -- 172.21.15.28:0/3791929179 shutdown_connections 2023-12-16T03:28:19.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 --2- 172.21.15.28:0/3791929179 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d680c7c50 0x7f7d681544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 --2- 172.21.15.28:0/3791929179 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d68151cd0 0x7f7d680ca460 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 -- 172.21.15.28:0/3791929179 >> 172.21.15.28:0/3791929179 conn(0x7f7d680abee0 msgr2=0x7f7d680c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:19.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 -- 172.21.15.28:0/3791929179 shutdown_connections 2023-12-16T03:28:19.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 -- 172.21.15.28:0/3791929179 wait complete. 2023-12-16T03:28:19.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 Processor -- start 2023-12-16T03:28:19.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 -- start start 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d680c7c50 0x7f7d681f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d680ca9a0 0x7f7d680c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d68151cd0 0x7f7d681ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6814e2e0 con 0x7f7d680ca9a0 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6814dad0 con 0x7f7d680c7c50 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.338+0000 7f7d6759e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d681f1180 con 0x7f7d68151cd0 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d680ca9a0 0x7f7d680c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d680ca9a0 0x7f7d680c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45892/0 (socket says 172.21.15.28:45892) 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5ffff640 1 -- 172.21.15.28:0/3757678857 learned_addr learned my addr 172.21.15.28:0/3757678857 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d6659c640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d680c7c50 0x7f7d681f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d66d9d640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d68151cd0 0x7f7d681ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5ffff640 1 -- 172.21.15.28:0/3757678857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d68151cd0 msgr2=0x7f7d681ecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5ffff640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d68151cd0 0x7f7d681ecd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5ffff640 1 -- 172.21.15.28:0/3757678857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d680c7c50 msgr2=0x7f7d681f0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5ffff640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d680c7c50 0x7f7d681f0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5ffff640 1 -- 172.21.15.28:0/3757678857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d580094d0 con 0x7f7d680ca9a0 2023-12-16T03:28:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d66d9d640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d68151cd0 0x7f7d681ecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5ffff640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d680ca9a0 0x7f7d680c27a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000e810 tx=0x7f7d5000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5effd640 1 -- 172.21.15.28:0/3757678857 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000c8d0 con 0x7f7d680ca9a0 2023-12-16T03:28:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5effd640 1 -- 172.21.15.28:0/3757678857 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5000ca30 con 0x7f7d680ca9a0 2023-12-16T03:28:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5effd640 1 -- 172.21.15.28:0/3757678857 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000cdc0 con 0x7f7d680ca9a0 2023-12-16T03:28:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d6759e640 1 -- 172.21.15.28:0/3757678857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6814dd20 con 0x7f7d680ca9a0 2023-12-16T03:28:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d6759e640 1 -- 172.21.15.28:0/3757678857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d681f0440 con 0x7f7d680ca9a0 2023-12-16T03:28:19.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d6759e640 1 -- 172.21.15.28:0/3757678857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d681f02a0 con 0x7f7d680ca9a0 2023-12-16T03:28:19.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.342+0000 7f7d5effd640 1 -- 172.21.15.28:0/3757678857 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7d50013410 con 0x7f7d680ca9a0 2023-12-16T03:28:19.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.346+0000 7f7d5effd640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7d480664a0 0x7f7d48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.346+0000 7f7d5effd640 1 -- 172.21.15.28:0/3757678857 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7d50084030 con 0x7f7d680ca9a0 2023-12-16T03:28:19.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.346+0000 7f7d6659c640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7d480664a0 0x7f7d48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.346+0000 7f7d6659c640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7d480664a0 0x7f7d48068960 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7d580ae000 tx=0x7f7d580b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:19.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.350+0000 7f7d5effd640 1 -- 172.21.15.28:0/3757678857 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7d681f02a0 con 0x7f7d680ca9a0 2023-12-16T03:28:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d6759e640 1 -- 172.21.15.28:0/3757678857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d681f02a0 con 0x7f7d680ca9a0 2023-12-16T03:28:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d5effd640 1 -- 172.21.15.28:0/3757678857 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7d681f02a0 con 0x7f7d680ca9a0 2023-12-16T03:28:19.511 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d6759e640 1 -- 172.21.15.28:0/3757678857 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7d480664a0 msgr2=0x7f7d48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d6759e640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7d480664a0 0x7f7d48068960 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7d580ae000 tx=0x7f7d580b3040 comp rx=0 tx=0).stop 2023-12-16T03:28:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d6759e640 1 -- 172.21.15.28:0/3757678857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d680ca9a0 msgr2=0x7f7d680c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d6759e640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d680ca9a0 0x7f7d680c27a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000e810 tx=0x7f7d5000ecd0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d6759e640 1 -- 172.21.15.28:0/3757678857 shutdown_connections 2023-12-16T03:28:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d6759e640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7d68151cd0 0x7f7d681ecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d6759e640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7d480664a0 0x7f7d48068960 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d6759e640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7d680ca9a0 0x7f7d680c27a0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d6759e640 1 --2- 172.21.15.28:0/3757678857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d680c7c50 0x7f7d681f0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.506+0000 7f7d6759e640 1 -- 172.21.15.28:0/3757678857 >> 172.21.15.28:0/3757678857 conn(0x7f7d680abee0 msgr2=0x7f7d680a9730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.510+0000 7f7d6759e640 1 -- 172.21.15.28:0/3757678857 shutdown_connections 2023-12-16T03:28:19.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.510+0000 7f7d6759e640 1 -- 172.21.15.28:0/3757678857 wait complete. 2023-12-16T03:28:19.532 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:28:19.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f773dbc1640 1 Processor -- start 2023-12-16T03:28:19.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f773dbc1640 1 -- start start 2023-12-16T03:28:19.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f773dbc1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f77380c5640 0x7f77380c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f773dbc1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380c60f0 0x7f7738155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f773dbc1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77380c2580 con 0x7f77380c5260 2023-12-16T03:28:19.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f773dbc1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7738153510 con 0x7f77380c5640 2023-12-16T03:28:19.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f773dbc1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77380c17f0 con 0x7f77380c60f0 2023-12-16T03:28:19.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f7736ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f77380c5640 0x7f77380c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f77377fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f77380c5260 0x7f773806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53410/0 (socket says 172.21.15.28:53410) 2023-12-16T03:28:19.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f77377fe640 1 -- 172.21.15.28:0/179747871 learned_addr learned my addr 172.21.15.28:0/179747871 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:19.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f7737fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380c60f0 0x7f7738155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f77367fc640 1 -- 172.21.15.28:0/179747871 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464554553 0 0) 0x7f77380c2580 con 0x7f77380c5260 2023-12-16T03:28:19.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f77367fc640 1 -- 172.21.15.28:0/179747871 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7720003530 con 0x7f77380c5260 2023-12-16T03:28:19.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f7736ffd640 1 -- 172.21.15.28:0/179747871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380c60f0 msgr2=0x7f7738155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:19.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f7736ffd640 1 --2- 172.21.15.28:0/179747871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380c60f0 0x7f7738155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f7736ffd640 1 -- 172.21.15.28:0/179747871 >> v1:172.21.15.134:6789/0 conn(0x7f77380c5260 legacy=0x7f773806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.674+0000 7f7736ffd640 1 -- 172.21.15.28:0/179747871 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77380c1a00 con 0x7f77380c5640 2023-12-16T03:28:19.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f7736ffd640 1 --2- 172.21.15.28:0/179747871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77380c5640 0x7f77380c5bb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f77380c1930 tx=0x7f772c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=456520a3cef0678a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:19.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f77367fc640 1 -- 172.21.15.28:0/179747871 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0ab600 con 0x7f77380c5640 2023-12-16T03:28:19.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f77367fc640 1 -- 172.21.15.28:0/179747871 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c0a7050 con 0x7f77380c5640 2023-12-16T03:28:19.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f77367fc640 1 -- 172.21.15.28:0/179747871 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0ab980 con 0x7f77380c5640 2023-12-16T03:28:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f773dbc1640 1 -- 172.21.15.28:0/179747871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77380c5640 msgr2=0x7f77380c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f773dbc1640 1 --2- 172.21.15.28:0/179747871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77380c5640 0x7f77380c5bb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f77380c1930 tx=0x7f772c01c3c0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f773dbc1640 1 -- 172.21.15.28:0/179747871 shutdown_connections 2023-12-16T03:28:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f773dbc1640 1 --2- 172.21.15.28:0/179747871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380c60f0 0x7f7738155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f773dbc1640 1 --2- 172.21.15.28:0/179747871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77380c5640 0x7f77380c5bb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f773dbc1640 1 -- 172.21.15.28:0/179747871 >> 172.21.15.28:0/179747871 conn(0x7f773806a5b0 msgr2=0x7f773806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f773dbc1640 1 -- 172.21.15.28:0/179747871 shutdown_connections 2023-12-16T03:28:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.678+0000 7f773dbc1640 1 -- 172.21.15.28:0/179747871 wait complete. 2023-12-16T03:28:19.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f773dbc1640 1 Processor -- start 2023-12-16T03:28:19.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f773dbc1640 1 -- start start 2023-12-16T03:28:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f773dbc1640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380c5260 0x7f77380a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f773dbc1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77380c5640 0x7f77381f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f773dbc1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f77380c60f0 0x7f77380a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f773dbc1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77380a8f80 con 0x7f77380c60f0 2023-12-16T03:28:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f773dbc1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77381f5050 con 0x7f77380c5640 2023-12-16T03:28:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f773dbc1640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77381f4d70 con 0x7f77380c5260 2023-12-16T03:28:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f7737fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f77380c60f0 0x7f77380a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f7737fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f77380c60f0 0x7f77380a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47174/0 (socket says 172.21.15.28:47174) 2023-12-16T03:28:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f7737fff640 1 -- 172.21.15.28:0/3059676830 learned_addr learned my addr 172.21.15.28:0/3059676830 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f77377fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380c5260 0x7f77380a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f7736ffd640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77380c5640 0x7f77381f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f7737fff640 1 -- 172.21.15.28:0/3059676830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380c5260 msgr2=0x7f77380a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f7737fff640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380c5260 0x7f77380a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f7737fff640 1 -- 172.21.15.28:0/3059676830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77380c5640 msgr2=0x7f77381f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f7737fff640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77380c5640 0x7f77381f4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f7737fff640 1 -- 172.21.15.28:0/3059676830 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c009420 con 0x7f77380c60f0 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f7737fff640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f77380c60f0 0x7f77380a9680 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f773000efc0 tx=0x7f773000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f771ffff640 1 -- 172.21.15.28:0/3059676830 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730014480 con 0x7f77380c60f0 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f771ffff640 1 -- 172.21.15.28:0/3059676830 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773000f040 con 0x7f77380c60f0 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f771ffff640 1 -- 172.21.15.28:0/3059676830 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730014820 con 0x7f77380c60f0 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f773dbc1640 1 -- 172.21.15.28:0/3059676830 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77380a8c10 con 0x7f77380c60f0 2023-12-16T03:28:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.682+0000 7f773dbc1640 1 -- 172.21.15.28:0/3059676830 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77380a3460 con 0x7f77380c60f0 2023-12-16T03:28:19.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.686+0000 7f773dbc1640 1 -- 172.21.15.28:0/3059676830 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77380a8da0 con 0x7f77380c60f0 2023-12-16T03:28:19.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.686+0000 7f771ffff640 1 -- 172.21.15.28:0/3059676830 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7730014980 con 0x7f77380c60f0 2023-12-16T03:28:19.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.686+0000 7f771ffff640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7724066470 0x7f7724068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:19.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.686+0000 7f771ffff640 1 -- 172.21.15.28:0/3059676830 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7730084cd0 con 0x7f77380c60f0 2023-12-16T03:28:19.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.686+0000 7f77377fe640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7724066470 0x7f7724068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:19.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.686+0000 7f77377fe640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7724066470 0x7f7724068930 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f77280011f0 tx=0x7f7728007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:19.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.690+0000 7f771ffff640 1 -- 172.21.15.28:0/3059676830 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7730051e90 con 0x7f77380c60f0 2023-12-16T03:28:19.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.850+0000 7f773dbc1640 1 -- 172.21.15.28:0/3059676830 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f77380a90c0 con 0x7f77380c60f0 2023-12-16T03:28:19.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.850+0000 7f771ffff640 1 -- 172.21.15.28:0/3059676830 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f77380a90c0 con 0x7f77380c60f0 2023-12-16T03:28:19.856 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 -- 172.21.15.28:0/3059676830 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7724066470 msgr2=0x7f7724068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7724066470 0x7f7724068930 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f77280011f0 tx=0x7f7728007d40 comp rx=0 tx=0).stop 2023-12-16T03:28:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 -- 172.21.15.28:0/3059676830 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f77380c60f0 msgr2=0x7f77380a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f77380c60f0 0x7f77380a9680 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f773000efc0 tx=0x7f773000c490 comp rx=0 tx=0).stop 2023-12-16T03:28:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 -- 172.21.15.28:0/3059676830 shutdown_connections 2023-12-16T03:28:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7724066470 0x7f7724068930 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f77380c60f0 0x7f77380a9680 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77380c5640 0x7f77381f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 --2- 172.21.15.28:0/3059676830 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77380c5260 0x7f77380a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 -- 172.21.15.28:0/3059676830 >> 172.21.15.28:0/3059676830 conn(0x7f773806a5b0 msgr2=0x7f773806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 -- 172.21.15.28:0/3059676830 shutdown_connections 2023-12-16T03:28:19.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:19.854+0000 7f773dbc1640 1 -- 172.21.15.28:0/3059676830 wait complete. 2023-12-16T03:28:19.877 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:28:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae3ab9d640 1 Processor -- start 2023-12-16T03:28:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae3ab9d640 1 -- start start 2023-12-16T03:28:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae3ab9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fae340c63c0 0x7fae340c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae3ab9d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae340c31c0 con 0x7fae340c4100 2023-12-16T03:28:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae3ab9d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae340c34a0 con 0x7fae340c2bb0 2023-12-16T03:28:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae3ab9d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae340c1030 con 0x7fae340c63c0 2023-12-16T03:28:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae38939640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fae340c63c0 0x7fae340c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae33fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fae340c4100 0x7fae340c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37552/0 (socket says 172.21.15.28:37552) 2023-12-16T03:28:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae33fff640 1 -- 172.21.15.28:0/3127125062 learned_addr learned my addr 172.21.15.28:0/3127125062 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae337fe640 1 -- 172.21.15.28:0/3127125062 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87367314 0 0) 0x7fae340c31c0 con 0x7fae340c4100 2023-12-16T03:28:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae337fe640 1 -- 172.21.15.28:0/3127125062 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae24005740 con 0x7fae340c4100 2023-12-16T03:28:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae38939640 1 -- 172.21.15.28:0/3127125062 >> v1:172.21.15.134:6789/0 conn(0x7fae340c2bb0 legacy=0x7fae340a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae38939640 1 -- 172.21.15.28:0/3127125062 >> v1:172.21.15.28:6789/0 conn(0x7fae340c4100 legacy=0x7fae340c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.018+0000 7fae38939640 1 -- 172.21.15.28:0/3127125062 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae340c1310 con 0x7fae340c63c0 2023-12-16T03:28:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.022+0000 7fae38939640 1 --2- 172.21.15.28:0/3127125062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae340c63c0 0x7fae340c06d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fae280097c0 tx=0x7fae2801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7679cc4692e9735 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.022+0000 7fae337fe640 1 -- 172.21.15.28:0/3127125062 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae280ab600 con 0x7fae340c63c0 2023-12-16T03:28:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.022+0000 7fae337fe640 1 -- 172.21.15.28:0/3127125062 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280a7050 con 0x7fae340c63c0 2023-12-16T03:28:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.022+0000 7fae337fe640 1 -- 172.21.15.28:0/3127125062 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae280ab980 con 0x7fae340c63c0 2023-12-16T03:28:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.022+0000 7fae3ab9d640 1 -- 172.21.15.28:0/3127125062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae340c63c0 msgr2=0x7fae340c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.022+0000 7fae3ab9d640 1 --2- 172.21.15.28:0/3127125062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae340c63c0 0x7fae340c06d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fae280097c0 tx=0x7fae2801c360 comp rx=0 tx=0).stop 2023-12-16T03:28:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.022+0000 7fae3ab9d640 1 -- 172.21.15.28:0/3127125062 shutdown_connections 2023-12-16T03:28:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.022+0000 7fae3ab9d640 1 --2- 172.21.15.28:0/3127125062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae340c63c0 0x7fae340c06d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.022+0000 7fae3ab9d640 1 -- 172.21.15.28:0/3127125062 >> 172.21.15.28:0/3127125062 conn(0x7fae3406a5b0 msgr2=0x7fae3406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.022+0000 7fae3ab9d640 1 -- 172.21.15.28:0/3127125062 shutdown_connections 2023-12-16T03:28:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.022+0000 7fae3ab9d640 1 -- 172.21.15.28:0/3127125062 wait complete. 2023-12-16T03:28:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3ab9d640 1 Processor -- start 2023-12-16T03:28:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3ab9d640 1 -- start start 2023-12-16T03:28:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3ab9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340c2bb0 0x7fae34157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3ab9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae340c4100 0x7fae341f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3ab9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae340c63c0 0x7fae34144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3ab9d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3415ae60 con 0x7fae340c63c0 2023-12-16T03:28:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3ab9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae341585c0 con 0x7fae340c4100 2023-12-16T03:28:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3ab9d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae341f16e0 con 0x7fae340c2bb0 2023-12-16T03:28:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3913a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae340c63c0 0x7fae34144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3913a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae340c63c0 0x7fae34144e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47184/0 (socket says 172.21.15.28:47184) 2023-12-16T03:28:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3913a640 1 -- 172.21.15.28:0/4186324795 learned_addr learned my addr 172.21.15.28:0/4186324795 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae33fff640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae340c4100 0x7fae341f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae38939640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340c2bb0 0x7fae34157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3913a640 1 -- 172.21.15.28:0/4186324795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340c2bb0 msgr2=0x7fae34157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3913a640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340c2bb0 0x7fae34157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3913a640 1 -- 172.21.15.28:0/4186324795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae340c4100 msgr2=0x7fae341f09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3913a640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae340c4100 0x7fae341f09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3913a640 1 -- 172.21.15.28:0/4186324795 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28009420 con 0x7fae340c63c0 2023-12-16T03:28:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae33fff640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae340c4100 0x7fae341f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3913a640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae340c63c0 0x7fae34144e70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00c7a0 tx=0x7fae2c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae317fa640 1 -- 172.21.15.28:0/4186324795 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c003b80 con 0x7fae340c63c0 2023-12-16T03:28:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae317fa640 1 -- 172.21.15.28:0/4186324795 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c003ce0 con 0x7fae340c63c0 2023-12-16T03:28:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae317fa640 1 -- 172.21.15.28:0/4186324795 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00aa90 con 0x7fae340c63c0 2023-12-16T03:28:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3ab9d640 1 -- 172.21.15.28:0/4186324795 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae340c69b0 con 0x7fae340c63c0 2023-12-16T03:28:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3ab9d640 1 -- 172.21.15.28:0/4186324795 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae34158090 con 0x7fae340c63c0 2023-12-16T03:28:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.026+0000 7fae3ab9d640 1 -- 172.21.15.28:0/4186324795 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae34068400 con 0x7fae340c63c0 2023-12-16T03:28:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.030+0000 7fae317fa640 1 -- 172.21.15.28:0/4186324795 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fae2c00abf0 con 0x7fae340c63c0 2023-12-16T03:28:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.030+0000 7fae317fa640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fae18066470 0x7fae18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.030+0000 7fae317fa640 1 -- 172.21.15.28:0/4186324795 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fae2c083f90 con 0x7fae340c63c0 2023-12-16T03:28:20.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.030+0000 7fae38939640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fae18066470 0x7fae18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:20.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.030+0000 7fae38939640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fae18066470 0x7fae18068930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fae280ad000 tx=0x7fae280a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.034+0000 7fae317fa640 1 -- 172.21.15.28:0/4186324795 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fae2c0b5290 con 0x7fae340c63c0 2023-12-16T03:28:20.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 -- 172.21.15.28:0/4186324795 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fae340c3e70 con 0x7fae340c63c0 2023-12-16T03:28:20.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae317fa640 1 -- 172.21.15.28:0/4186324795 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7fae2c051140 con 0x7fae340c63c0 2023-12-16T03:28:20.207 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:28:20.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 -- 172.21.15.28:0/4186324795 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fae18066470 msgr2=0x7fae18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fae18066470 0x7fae18068930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fae280ad000 tx=0x7fae280a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:20.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 -- 172.21.15.28:0/4186324795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae340c63c0 msgr2=0x7fae34144e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae340c63c0 0x7fae34144e70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00c7a0 tx=0x7fae2c00cc60 comp rx=0 tx=0).stop 2023-12-16T03:28:20.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 -- 172.21.15.28:0/4186324795 shutdown_connections 2023-12-16T03:28:20.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fae18066470 0x7fae18068930 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae340c63c0 0x7fae34144e70 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae340c4100 0x7fae341f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 --2- 172.21.15.28:0/4186324795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae340c2bb0 0x7fae34157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 -- 172.21.15.28:0/4186324795 >> 172.21.15.28:0/4186324795 conn(0x7fae3406a5b0 msgr2=0x7fae340a7250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:20.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 -- 172.21.15.28:0/4186324795 shutdown_connections 2023-12-16T03:28:20.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.202+0000 7fae3ab9d640 1 -- 172.21.15.28:0/4186324795 wait complete. 2023-12-16T03:28:20.228 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-16T03:28:20.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:20.228 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:20.258 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:28:20.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:20.258 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T03:28:20.309 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:20.310 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:20.361 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-16T03:28:20.361 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:28:20.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.498+0000 7f56b3e46640 1 Processor -- start 2023-12-16T03:28:20.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b3e46640 1 -- start start 2023-12-16T03:28:20.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b3e46640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f56ac0c5260 0x7f56ac06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:20.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b3e46640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f56ac0c5640 0x7f56ac0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:20.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b3e46640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac0c2580 con 0x7f56ac0c60f0 2023-12-16T03:28:20.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b3e46640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ac153510 con 0x7f56ac0c5640 2023-12-16T03:28:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b3e46640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ac0c17f0 con 0x7f56ac0c5260 2023-12-16T03:28:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b13e1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f56ac0c5640 0x7f56ac0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b13e1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f56ac0c5640 0x7f56ac0c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47200/0 (socket says 172.21.15.28:47200) 2023-12-16T03:28:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b13e1640 1 -- 172.21.15.28:0/4196278557 learned_addr learned my addr 172.21.15.28:0/4196278557 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b1be2640 1 --2- 172.21.15.28:0/4196278557 >> v2:172.21.15.134:3300/0 conn(0x7f56ac0c5260 0x7f56ac06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b13e1640 1 -- 172.21.15.28:0/4196278557 >> v2:172.21.15.134:3300/0 conn(0x7f56ac0c5260 msgr2=0x7f56ac06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b13e1640 1 --2- 172.21.15.28:0/4196278557 >> v2:172.21.15.134:3300/0 conn(0x7f56ac0c5260 0x7f56ac06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b13e1640 1 -- 172.21.15.28:0/4196278557 >> v1:172.21.15.134:6789/0 conn(0x7f56ac0c60f0 legacy=0x7f56ac155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.502+0000 7f56b13e1640 1 -- 172.21.15.28:0/4196278557 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac0c1a00 con 0x7f56ac0c5640 2023-12-16T03:28:20.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b13e1640 1 --2- 172.21.15.28:0/4196278557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56ac0c5640 0x7f56ac0c5bb0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0c6920 tx=0x7f569c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394442ff7c04da65 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:20.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b0be0640 1 -- 172.21.15.28:0/4196278557 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0ac640 con 0x7f56ac0c5640 2023-12-16T03:28:20.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b0be0640 1 -- 172.21.15.28:0/4196278557 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c0ac7a0 con 0x7f56ac0c5640 2023-12-16T03:28:20.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b0be0640 1 -- 172.21.15.28:0/4196278557 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0acb30 con 0x7f56ac0c5640 2023-12-16T03:28:20.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b3e46640 1 -- 172.21.15.28:0/4196278557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56ac0c5640 msgr2=0x7f56ac0c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b3e46640 1 --2- 172.21.15.28:0/4196278557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56ac0c5640 0x7f56ac0c5bb0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0c6920 tx=0x7f569c01c400 comp rx=0 tx=0).stop 2023-12-16T03:28:20.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b3e46640 1 -- 172.21.15.28:0/4196278557 shutdown_connections 2023-12-16T03:28:20.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b3e46640 1 --2- 172.21.15.28:0/4196278557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56ac0c5640 0x7f56ac0c5bb0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b3e46640 1 --2- 172.21.15.28:0/4196278557 >> v2:172.21.15.134:3300/0 conn(0x7f56ac0c5260 0x7f56ac06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b3e46640 1 -- 172.21.15.28:0/4196278557 >> 172.21.15.28:0/4196278557 conn(0x7f56ac06a5b0 msgr2=0x7f56ac06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:20.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b3e46640 1 -- 172.21.15.28:0/4196278557 shutdown_connections 2023-12-16T03:28:20.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b3e46640 1 -- 172.21.15.28:0/4196278557 wait complete. 2023-12-16T03:28:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b3e46640 1 Processor -- start 2023-12-16T03:28:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.506+0000 7f56b3e46640 1 -- start start 2023-12-16T03:28:20.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b3e46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56ac0c5260 0x7f56ac14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:20.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b3e46640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56ac0c5640 0x7f56ac15d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:20.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b3e46640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac0c60f0 0x7f56ac1ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:20.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b3e46640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac157dd0 con 0x7f56ac0c5260 2023-12-16T03:28:20.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b3e46640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac14f6b0 con 0x7f56ac0c5640 2023-12-16T03:28:20.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b3e46640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac1554f0 con 0x7f56ac0c60f0 2023-12-16T03:28:20.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b1be2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56ac0c5260 0x7f56ac14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:20.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b1be2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56ac0c5260 0x7f56ac14eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47212/0 (socket says 172.21.15.28:47212) 2023-12-16T03:28:20.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b1be2640 1 -- 172.21.15.28:0/3753832075 learned_addr learned my addr 172.21.15.28:0/3753832075 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:20.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b23e3640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac0c60f0 0x7f56ac1ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:20.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b13e1640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56ac0c5640 0x7f56ac15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b1be2640 1 -- 172.21.15.28:0/3753832075 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac0c60f0 msgr2=0x7f56ac1ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b1be2640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac0c60f0 0x7f56ac1ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b1be2640 1 -- 172.21.15.28:0/3753832075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56ac0c5640 msgr2=0x7f56ac15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b1be2640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56ac0c5640 0x7f56ac15d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b1be2640 1 -- 172.21.15.28:0/3753832075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c0094d0 con 0x7f56ac0c5260 2023-12-16T03:28:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b1be2640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56ac0c5260 0x7f56ac14eac0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f56a800d5f0 tx=0x7f56a800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56a27fc640 1 -- 172.21.15.28:0/3753832075 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a80125f0 con 0x7f56ac0c5260 2023-12-16T03:28:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56a27fc640 1 -- 172.21.15.28:0/3753832075 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a8012750 con 0x7f56ac0c5260 2023-12-16T03:28:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56a27fc640 1 -- 172.21.15.28:0/3753832075 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8012ae0 con 0x7f56ac0c5260 2023-12-16T03:28:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b3e46640 1 -- 172.21.15.28:0/3753832075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac155740 con 0x7f56ac0c5260 2023-12-16T03:28:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b3e46640 1 -- 172.21.15.28:0/3753832075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac0c3a60 con 0x7f56ac0c5260 2023-12-16T03:28:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56b3e46640 1 -- 172.21.15.28:0/3753832075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac0c38c0 con 0x7f56ac0c5260 2023-12-16T03:28:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.510+0000 7f56a27fc640 1 -- 172.21.15.28:0/3753832075 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f56a8012c40 con 0x7f56ac0c5260 2023-12-16T03:28:20.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.514+0000 7f56a27fc640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5690066470 0x7f5690068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:20.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.514+0000 7f56a27fc640 1 -- 172.21.15.28:0/3753832075 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f56a8084580 con 0x7f56ac0c5260 2023-12-16T03:28:20.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.514+0000 7f56b13e1640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5690066470 0x7f5690068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:20.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.514+0000 7f56b13e1640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5690066470 0x7f5690068930 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f569c0ae000 tx=0x7f569c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:20.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.518+0000 7f56a27fc640 1 -- 172.21.15.28:0/3753832075 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f56ac0c38c0 con 0x7f56ac0c5260 2023-12-16T03:28:20.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 -- 172.21.15.28:0/3753832075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f56ac0c38c0 con 0x7f56ac0c5260 2023-12-16T03:28:20.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56a27fc640 1 -- 172.21.15.28:0/3753832075 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7f56ac0c38c0 con 0x7f56ac0c5260 2023-12-16T03:28:20.714 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:28:20.714 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-16T03:28:20.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 -- 172.21.15.28:0/3753832075 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5690066470 msgr2=0x7f5690068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5690066470 0x7f5690068930 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f569c0ae000 tx=0x7f569c008040 comp rx=0 tx=0).stop 2023-12-16T03:28:20.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 -- 172.21.15.28:0/3753832075 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56ac0c5260 msgr2=0x7f56ac14eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:20.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56ac0c5260 0x7f56ac14eac0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f56a800d5f0 tx=0x7f56a800dab0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 -- 172.21.15.28:0/3753832075 shutdown_connections 2023-12-16T03:28:20.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f56ac0c60f0 0x7f56ac1ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56ac0c5640 0x7f56ac15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5690066470 0x7f5690068930 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 --2- 172.21.15.28:0/3753832075 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56ac0c5260 0x7f56ac14eac0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:20.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 -- 172.21.15.28:0/3753832075 >> 172.21.15.28:0/3753832075 conn(0x7f56ac06a5b0 msgr2=0x7f56ac06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:20.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 -- 172.21.15.28:0/3753832075 shutdown_connections 2023-12-16T03:28:20.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:20.710+0000 7f56b3e46640 1 -- 172.21.15.28:0/3753832075 wait complete. 2023-12-16T03:28:20.735 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-16T03:28:20.735 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:28:20.735 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-12-16T03:28:20.736 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-16T03:28:20.736 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:20.736 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-16T03:28:20.736 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:28:20.736 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-16T03:28:20.736 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:28:20.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:20.736 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-12-16T03:28:20.746 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:28:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:28:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:28:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-16T03:28:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42239sec preferred_lft 42239sec 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 02:42:8f:0f:48:af brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T03:28:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:28:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:20.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:20.750 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:28:20.814 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-12-16T03:28:20.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:20.817 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-12-16T03:28:20.872 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-12-16T03:28:20.872 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:28:20.872 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-16T03:28:20.872 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T03:28:20.872 INFO:teuthology.orchestra.run.smithi134.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:28:20.872 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T03:28:20.872 INFO:teuthology.orchestra.run.smithi134.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:28:20.872 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:28:20.872 INFO:teuthology.orchestra.run.smithi134.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:28:20.872 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:28:20.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:20.873 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:28:20.873 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:28:20.873 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T03:28:20.873 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T03:28:20.873 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T03:28:20.873 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:28:20.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:20.965 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-16T03:28:20.974 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T03:28:20.975 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:28:20.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:20.975 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-12-16T03:28:21.037 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:28:21.037 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:21.088 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:28:21.089 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:28:21.089 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:21.140 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-16T03:28:21.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:21.140 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:21.229 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:21.230 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:28:21.242 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:21.243 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:28:21.243 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:28:21.243 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: 1@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs2=/ 2023-12-16T03:28:21.243 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:28:21.246 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:28:21.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:21.246 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:21.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:21.268 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:28:21.325 INFO:teuthology.orchestra.run.smithi134.stdout:client6616 2023-12-16T03:28:21.326 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:21.326 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:21.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:21.377 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2023-12-16T03:28:21.394 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:21.394 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2023-12-16T03:28:21.451 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T03:28:21.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:21.451 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2023-12-16T03:28:21.467 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:21.468 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2023-12-16T03:28:21.522 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:21.522 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2023-12-16T03:28:21.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d949a640 1 Processor -- start 2023-12-16T03:28:21.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d949a640 1 -- start start 2023-12-16T03:28:21.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d949a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f01d4151e90 0x7f01d40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:21.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d949a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01d40c7ea0 0x7f01d406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:21.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d949a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f01d40c4e60 0x7f01d406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:21.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d949a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d40c8750 con 0x7f01d40c4e60 2023-12-16T03:28:21.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d949a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d41552d0 con 0x7f01d4151e90 2023-12-16T03:28:21.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d949a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40c5c60 con 0x7f01d40c7ea0 2023-12-16T03:28:21.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f01d40c4e60 0x7f01d406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:21.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f01d40c4e60 0x7f01d406b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47218/0 (socket says 172.21.15.28:47218) 2023-12-16T03:28:21.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d37fe640 1 -- 172.21.15.28:0/1938087242 learned_addr learned my addr 172.21.15.28:0/1938087242 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:21.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d27fc640 1 --2- 172.21.15.28:0/1938087242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01d40c7ea0 0x7f01d406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:21.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d2ffd640 1 --2- 172.21.15.28:0/1938087242 >> v2:172.21.15.134:3300/0 conn(0x7f01d4151e90 0x7f01d40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:21.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d37fe640 1 -- 172.21.15.28:0/1938087242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01d40c7ea0 msgr2=0x7f01d406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:21.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d37fe640 1 --2- 172.21.15.28:0/1938087242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01d40c7ea0 0x7f01d406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d37fe640 1 -- 172.21.15.28:0/1938087242 >> v2:172.21.15.134:3300/0 conn(0x7f01d4151e90 msgr2=0x7f01d40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:21.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d37fe640 1 --2- 172.21.15.28:0/1938087242 >> v2:172.21.15.134:3300/0 conn(0x7f01d4151e90 0x7f01d40c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.674+0000 7f01d37fe640 1 -- 172.21.15.28:0/1938087242 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d406c860 con 0x7f01d40c4e60 2023-12-16T03:28:21.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d37fe640 1 --2- 172.21.15.28:0/1938087242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01d40c4e60 0x7f01d406b9e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f01d408b410 tx=0x7f01cc01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11dbcd8ca3e1289 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:21.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d1ffb640 1 -- 172.21.15.28:0/1938087242 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0a5530 con 0x7f01d40c4e60 2023-12-16T03:28:21.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d1ffb640 1 -- 172.21.15.28:0/1938087242 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc0a5690 con 0x7f01d40c4e60 2023-12-16T03:28:21.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d1ffb640 1 -- 172.21.15.28:0/1938087242 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0a5a20 con 0x7f01d40c4e60 2023-12-16T03:28:21.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d949a640 1 -- 172.21.15.28:0/1938087242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01d40c4e60 msgr2=0x7f01d406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:21.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d949a640 1 --2- 172.21.15.28:0/1938087242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01d40c4e60 0x7f01d406b9e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f01d408b410 tx=0x7f01cc01c8b0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d949a640 1 -- 172.21.15.28:0/1938087242 shutdown_connections 2023-12-16T03:28:21.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d949a640 1 --2- 172.21.15.28:0/1938087242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01d40c4e60 0x7f01d406b9e0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d949a640 1 --2- 172.21.15.28:0/1938087242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01d40c7ea0 0x7f01d406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d949a640 1 --2- 172.21.15.28:0/1938087242 >> v2:172.21.15.134:3300/0 conn(0x7f01d4151e90 0x7f01d40c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d949a640 1 -- 172.21.15.28:0/1938087242 >> 172.21.15.28:0/1938087242 conn(0x7f01d40ca170 msgr2=0x7f01d40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:21.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d949a640 1 -- 172.21.15.28:0/1938087242 shutdown_connections 2023-12-16T03:28:21.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d949a640 1 -- 172.21.15.28:0/1938087242 wait complete. 2023-12-16T03:28:21.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.678+0000 7f01d949a640 1 Processor -- start 2023-12-16T03:28:21.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d949a640 1 -- start start 2023-12-16T03:28:21.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d949a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d40c4e60 0x7f01d41f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:21.686 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d949a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01d40c7ea0 0x7f01d414e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d949a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01d4151e90 0x7f01d414ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d949a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d41f12a0 con 0x7f01d4151e90 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d949a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40bd970 con 0x7f01d40c4e60 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d949a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d40be320 con 0x7f01d40c7ea0 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01d4151e90 0x7f01d414ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01d4151e90 0x7f01d414ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47224/0 (socket says 172.21.15.28:47224) 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d37fe640 1 -- 172.21.15.28:0/906845183 learned_addr learned my addr 172.21.15.28:0/906845183 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d27fc640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01d40c7ea0 0x7f01d414e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d2ffd640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d40c4e60 0x7f01d41f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d37fe640 1 -- 172.21.15.28:0/906845183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01d40c7ea0 msgr2=0x7f01d414e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d37fe640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01d40c7ea0 0x7f01d414e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d37fe640 1 -- 172.21.15.28:0/906845183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d40c4e60 msgr2=0x7f01d41f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d37fe640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d40c4e60 0x7f01d41f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d37fe640 1 -- 172.21.15.28:0/906845183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009b30 con 0x7f01d4151e90 2023-12-16T03:28:21.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d2ffd640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d40c4e60 0x7f01d41f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:21.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d27fc640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01d40c7ea0 0x7f01d414e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:21.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d37fe640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01d4151e90 0x7f01d414ed10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f01cc01af60 tx=0x7f01cc019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:21.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01bb7fe640 1 -- 172.21.15.28:0/906845183 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0a5530 con 0x7f01d4151e90 2023-12-16T03:28:21.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01bb7fe640 1 -- 172.21.15.28:0/906845183 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc0b8670 con 0x7f01d4151e90 2023-12-16T03:28:21.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d949a640 1 -- 172.21.15.28:0/906845183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d40be600 con 0x7f01d4151e90 2023-12-16T03:28:21.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01bb7fe640 1 -- 172.21.15.28:0/906845183 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0b8a60 con 0x7f01d4151e90 2023-12-16T03:28:21.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d949a640 1 -- 172.21.15.28:0/906845183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d40c2ce0 con 0x7f01d4151e90 2023-12-16T03:28:21.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.682+0000 7f01d949a640 1 -- 172.21.15.28:0/906845183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d40be840 con 0x7f01d4151e90 2023-12-16T03:28:21.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.686+0000 7f01bb7fe640 1 -- 172.21.15.28:0/906845183 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f01cc0b8bc0 con 0x7f01d4151e90 2023-12-16T03:28:21.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.686+0000 7f01bb7fe640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01c0066470 0x7f01c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:21.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.686+0000 7f01bb7fe640 1 -- 172.21.15.28:0/906845183 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f01cc11f460 con 0x7f01d4151e90 2023-12-16T03:28:21.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.686+0000 7f01d2ffd640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01c0066470 0x7f01c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:21.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.686+0000 7f01d2ffd640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01c0066470 0x7f01c0068930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009bb0 tx=0x7f01c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:21.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.690+0000 7f01bb7fe640 1 -- 172.21.15.28:0/906845183 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f01d40be840 con 0x7f01d4151e90 2023-12-16T03:28:21.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.902+0000 7f01d949a640 1 -- 172.21.15.28:0/906845183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7f01d40be840 con 0x7f01d4151e90 2023-12-16T03:28:21.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01bb7fe640 1 -- 172.21.15.28:0/906845183 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v21) v1 ==== 272+0+0 (secure 0 0 0) 0x7f01d40be840 con 0x7f01d4151e90 2023-12-16T03:28:21.910 INFO:teuthology.orchestra.run.smithi028.stderr:added key for client.testuser 2023-12-16T03:28:21.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 -- 172.21.15.28:0/906845183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01c0066470 msgr2=0x7f01c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:21.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01c0066470 0x7f01c0068930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009bb0 tx=0x7f01c4008040 comp rx=0 tx=0).stop 2023-12-16T03:28:21.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 -- 172.21.15.28:0/906845183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01d4151e90 msgr2=0x7f01d414ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:21.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01d4151e90 0x7f01d414ed10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f01cc01af60 tx=0x7f01cc019650 comp rx=0 tx=0).stop 2023-12-16T03:28:21.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 -- 172.21.15.28:0/906845183 shutdown_connections 2023-12-16T03:28:21.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f01c0066470 0x7f01c0068930 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f01d4151e90 0x7f01d414ed10 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01d40c7ea0 0x7f01d414e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 --2- 172.21.15.28:0/906845183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01d40c4e60 0x7f01d41f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:21.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 -- 172.21.15.28:0/906845183 >> 172.21.15.28:0/906845183 conn(0x7f01d40ca170 msgr2=0x7f01d4153520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:21.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 -- 172.21.15.28:0/906845183 shutdown_connections 2023-12-16T03:28:21.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:21.906+0000 7f01d949a640 1 -- 172.21.15.28:0/906845183 wait complete. 2023-12-16T03:28:21.932 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-16T03:28:22.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.070+0000 7f1910f2a640 1 Processor -- start 2023-12-16T03:28:22.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.070+0000 7f1910f2a640 1 -- start start 2023-12-16T03:28:22.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f1910f2a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f190c0c63c0 0x7f190c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f1910f2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f190c0c4100 0x7f190c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f1910f2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f190c0c29e0 0x7f190c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f1910f2a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190c0c31c0 con 0x7f190c0c63c0 2023-12-16T03:28:22.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f1910f2a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190c0c34a0 con 0x7f190c0c4100 2023-12-16T03:28:22.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f1910f2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190c0c1030 con 0x7f190c0c29e0 2023-12-16T03:28:22.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f190a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f190c0c63c0 0x7f190c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f190a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f190c0c63c0 0x7f190c0c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47230/0 (socket says 172.21.15.28:47230) 2023-12-16T03:28:22.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f190a59c640 1 -- 172.21.15.28:0/4294192444 learned_addr learned my addr 172.21.15.28:0/4294192444 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:22.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f190a59c640 1 -- 172.21.15.28:0/4294192444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f190c0c29e0 msgr2=0x7f190c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:22.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f190a59c640 1 --2- 172.21.15.28:0/4294192444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f190c0c29e0 0x7f190c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f190a59c640 1 -- 172.21.15.28:0/4294192444 >> v2:172.21.15.134:3300/0 conn(0x7f190c0c4100 msgr2=0x7f190c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:22.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f190a59c640 1 --2- 172.21.15.28:0/4294192444 >> v2:172.21.15.134:3300/0 conn(0x7f190c0c4100 0x7f190c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.074+0000 7f190a59c640 1 -- 172.21.15.28:0/4294192444 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c0c1310 con 0x7f190c0c63c0 2023-12-16T03:28:22.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f190a59c640 1 --2- 172.21.15.28:0/4294192444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0c63c0 0x7f190c0c06d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f190c0a8b40 tx=0x7f18fc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881babd580f0435f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:22.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f190959a640 1 -- 172.21.15.28:0/4294192444 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c0aa3d0 con 0x7f190c0c63c0 2023-12-16T03:28:22.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f190959a640 1 -- 172.21.15.28:0/4294192444 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc0a7050 con 0x7f190c0c63c0 2023-12-16T03:28:22.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f190959a640 1 -- 172.21.15.28:0/4294192444 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0ab820 con 0x7f190c0c63c0 2023-12-16T03:28:22.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 -- 172.21.15.28:0/4294192444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0c63c0 msgr2=0x7f190c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:22.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 --2- 172.21.15.28:0/4294192444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0c63c0 0x7f190c0c06d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f190c0a8b40 tx=0x7f18fc01c3b0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 -- 172.21.15.28:0/4294192444 shutdown_connections 2023-12-16T03:28:22.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 --2- 172.21.15.28:0/4294192444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f190c0c29e0 0x7f190c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 --2- 172.21.15.28:0/4294192444 >> v2:172.21.15.134:3300/0 conn(0x7f190c0c4100 0x7f190c0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 --2- 172.21.15.28:0/4294192444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0c63c0 0x7f190c0c06d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 -- 172.21.15.28:0/4294192444 >> 172.21.15.28:0/4294192444 conn(0x7f190c06a5b0 msgr2=0x7f190c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:22.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 -- 172.21.15.28:0/4294192444 shutdown_connections 2023-12-16T03:28:22.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 -- 172.21.15.28:0/4294192444 wait complete. 2023-12-16T03:28:22.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 Processor -- start 2023-12-16T03:28:22.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 -- start start 2023-12-16T03:28:22.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f190c0c29e0 0x7f190c0c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f190c0c4100 0x7f190c1ee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0c63c0 0x7f190c1ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190c15dcc0 con 0x7f190c0c63c0 2023-12-16T03:28:22.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190c150f30 con 0x7f190c0c4100 2023-12-16T03:28:22.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.078+0000 7f1910f2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190c151210 con 0x7f190c0c29e0 2023-12-16T03:28:22.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f190ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0c63c0 0x7f190c1ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f190ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0c63c0 0x7f190c1ee5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47236/0 (socket says 172.21.15.28:47236) 2023-12-16T03:28:22.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f190ad9d640 1 -- 172.21.15.28:0/2563399456 learned_addr learned my addr 172.21.15.28:0/2563399456 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:22.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f1909d9b640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f190c0c4100 0x7f190c1ee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f190a59c640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f190c0c29e0 0x7f190c0c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f1909d9b640 1 -- 172.21.15.28:0/2563399456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f190c0c29e0 msgr2=0x7f190c0c00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:22.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f1909d9b640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f190c0c29e0 0x7f190c0c00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f1909d9b640 1 -- 172.21.15.28:0/2563399456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0c63c0 msgr2=0x7f190c1ee5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:22.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f1909d9b640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0c63c0 0x7f190c1ee5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f1909d9b640 1 -- 172.21.15.28:0/2563399456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc0094d0 con 0x7f190c0c4100 2023-12-16T03:28:22.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f190a59c640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f190c0c29e0 0x7f190c0c00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:22.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f1909d9b640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f190c0c4100 0x7f190c1ee0b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f190000b3f0 tx=0x7f190000b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:22.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f18faffd640 1 -- 172.21.15.28:0/2563399456 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011830 con 0x7f190c0c4100 2023-12-16T03:28:22.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f18faffd640 1 -- 172.21.15.28:0/2563399456 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1900011990 con 0x7f190c0c4100 2023-12-16T03:28:22.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f1910f2a640 1 -- 172.21.15.28:0/2563399456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f190c0c69b0 con 0x7f190c0c4100 2023-12-16T03:28:22.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f18faffd640 1 -- 172.21.15.28:0/2563399456 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011d40 con 0x7f190c0c4100 2023-12-16T03:28:22.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f1910f2a640 1 -- 172.21.15.28:0/2563399456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190c1517d0 con 0x7f190c0c4100 2023-12-16T03:28:22.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f1910f2a640 1 -- 172.21.15.28:0/2563399456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190c1519f0 con 0x7f190c0c4100 2023-12-16T03:28:22.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.082+0000 7f18faffd640 1 -- 172.21.15.28:0/2563399456 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f190001a400 con 0x7f190c0c4100 2023-12-16T03:28:22.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.086+0000 7f18faffd640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18ec0664a0 0x7f18ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.086+0000 7f18faffd640 1 -- 172.21.15.28:0/2563399456 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f19000840d0 con 0x7f190c0c4100 2023-12-16T03:28:22.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.086+0000 7f190a59c640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18ec0664a0 0x7f18ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.086+0000 7f190a59c640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18ec0664a0 0x7f18ec068960 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0ad000 tx=0x7f18fc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.090+0000 7f18faffd640 1 -- 172.21.15.28:0/2563399456 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1900051310 con 0x7f190c0c4100 2023-12-16T03:28:22.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 -- 172.21.15.28:0/2563399456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f190c151070 con 0x7f190c0c4100 2023-12-16T03:28:22.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f18faffd640 1 -- 172.21.15.28:0/2563399456 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v21) v1 ==== 85+0+226 (secure 0 0 0) 0x7f1900015100 con 0x7f190c0c4100 2023-12-16T03:28:22.306 INFO:teuthology.orchestra.run.smithi028.stdout:[client.testuser] 2023-12-16T03:28:22.306 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBVGX1lwB4fNhAAjayc1Li38MQXtxCV86dMRg== 2023-12-16T03:28:22.306 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2023-12-16T03:28:22.307 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2023-12-16T03:28:22.307 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-16T03:28:22.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 -- 172.21.15.28:0/2563399456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18ec0664a0 msgr2=0x7f18ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:22.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18ec0664a0 0x7f18ec068960 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0ad000 tx=0x7f18fc0a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:22.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 -- 172.21.15.28:0/2563399456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f190c0c4100 msgr2=0x7f190c1ee0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:22.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f190c0c4100 0x7f190c1ee0b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f190000b3f0 tx=0x7f190000b8b0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 -- 172.21.15.28:0/2563399456 shutdown_connections 2023-12-16T03:28:22.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f18ec0664a0 0x7f18ec068960 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0c63c0 0x7f190c1ee5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f190c0c4100 0x7f190c1ee0b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 --2- 172.21.15.28:0/2563399456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f190c0c29e0 0x7f190c0c00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 -- 172.21.15.28:0/2563399456 >> 172.21.15.28:0/2563399456 conn(0x7f190c06a5b0 msgr2=0x7f190c0a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:22.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 -- 172.21.15.28:0/2563399456 shutdown_connections 2023-12-16T03:28:22.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.302+0000 7f1910f2a640 1 -- 172.21.15.28:0/2563399456 wait complete. 2023-12-16T03:28:22.327 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQBVGX1lwB4fNhAAjayc1Li38MQXtxCV86dMRg== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-16T03:28:22.328 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2023-12-16T03:28:22.337 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.cLk6fq0sXx 2023-12-16T03:28:22.337 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:22.337 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/tmp/tmp.cLk6fq0sXx 2023-12-16T03:28:22.393 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:22.393 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:22.449 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:22.449 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:22.501 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:22.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.682+0000 7fb632faa640 1 Processor -- start 2023-12-16T03:28:22.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.682+0000 7fb632faa640 1 -- start start 2023-12-16T03:28:22.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.682+0000 7fb632faa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb62c0c63c0 0x7fb62c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.682+0000 7fb632faa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb62c0c4100 0x7fb62c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.682+0000 7fb632faa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb62c0c29e0 0x7fb62c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.682+0000 7fb632faa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0c31c0 con 0x7fb62c0c29e0 2023-12-16T03:28:22.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.682+0000 7fb632faa640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0c34a0 con 0x7fb62c0c63c0 2023-12-16T03:28:22.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.682+0000 7fb632faa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0c1030 con 0x7fb62c0c4100 2023-12-16T03:28:22.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb631547640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb62c0c29e0 0x7fb62c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb631547640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb62c0c29e0 0x7fb62c0a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47238/0 (socket says 172.21.15.28:47238) 2023-12-16T03:28:22.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb631547640 1 -- 172.21.15.28:0/53409934 learned_addr learned my addr 172.21.15.28:0/53409934 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:22.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb62bfff640 1 --2- 172.21.15.28:0/53409934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb62c0c4100 0x7fb62c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb630d46640 1 --2- 172.21.15.28:0/53409934 >> v2:172.21.15.134:3300/0 conn(0x7fb62c0c63c0 0x7fb62c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb631547640 1 -- 172.21.15.28:0/53409934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb62c0c4100 msgr2=0x7fb62c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:22.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb631547640 1 --2- 172.21.15.28:0/53409934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb62c0c4100 0x7fb62c0c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb631547640 1 -- 172.21.15.28:0/53409934 >> v2:172.21.15.134:3300/0 conn(0x7fb62c0c63c0 msgr2=0x7fb62c0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:22.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb631547640 1 --2- 172.21.15.28:0/53409934 >> v2:172.21.15.134:3300/0 conn(0x7fb62c0c63c0 0x7fb62c0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb631547640 1 -- 172.21.15.28:0/53409934 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0c1310 con 0x7fb62c0c29e0 2023-12-16T03:28:22.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb630d46640 1 --2- 172.21.15.28:0/53409934 >> v2:172.21.15.134:3300/0 conn(0x7fb62c0c63c0 0x7fb62c0c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:22.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb631547640 1 --2- 172.21.15.28:0/53409934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb62c0c29e0 0x7fb62c0a9680 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb62c06e000 tx=0x7fb62401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770d24c6239fb598 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:22.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb62b7fe640 1 -- 172.21.15.28:0/53409934 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c0aa3d0 con 0x7fb62c0c29e0 2023-12-16T03:28:22.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb62b7fe640 1 -- 172.21.15.28:0/53409934 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6240a5720 con 0x7fb62c0c29e0 2023-12-16T03:28:22.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.686+0000 7fb62b7fe640 1 -- 172.21.15.28:0/53409934 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240a5ab0 con 0x7fb62c0c29e0 2023-12-16T03:28:22.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 -- 172.21.15.28:0/53409934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb62c0c29e0 msgr2=0x7fb62c0a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:22.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 --2- 172.21.15.28:0/53409934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb62c0c29e0 0x7fb62c0a9680 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb62c06e000 tx=0x7fb62401c880 comp rx=0 tx=0).stop 2023-12-16T03:28:22.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 -- 172.21.15.28:0/53409934 shutdown_connections 2023-12-16T03:28:22.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 --2- 172.21.15.28:0/53409934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb62c0c29e0 0x7fb62c0a9680 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 --2- 172.21.15.28:0/53409934 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb62c0c4100 0x7fb62c0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 --2- 172.21.15.28:0/53409934 >> v2:172.21.15.134:3300/0 conn(0x7fb62c0c63c0 0x7fb62c0c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 -- 172.21.15.28:0/53409934 >> 172.21.15.28:0/53409934 conn(0x7fb62c06a5b0 msgr2=0x7fb62c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:22.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 -- 172.21.15.28:0/53409934 shutdown_connections 2023-12-16T03:28:22.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 -- 172.21.15.28:0/53409934 wait complete. 2023-12-16T03:28:22.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 Processor -- start 2023-12-16T03:28:22.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 -- start start 2023-12-16T03:28:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb62c0c29e0 0x7fb62c1581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb62c0c4100 0x7fb62c154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb62c0c63c0 0x7fb62c155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0a5950 con 0x7fb62c0c63c0 2023-12-16T03:28:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c15ac40 con 0x7fb62c0c4100 2023-12-16T03:28:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb632faa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0708e0 con 0x7fb62c0c29e0 2023-12-16T03:28:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb631547640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb62c0c63c0 0x7fb62c155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb631547640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb62c0c63c0 0x7fb62c155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47248/0 (socket says 172.21.15.28:47248) 2023-12-16T03:28:22.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb631547640 1 -- 172.21.15.28:0/1835783975 learned_addr learned my addr 172.21.15.28:0/1835783975 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:22.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb62bfff640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb62c0c4100 0x7fb62c154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb630d46640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb62c0c29e0 0x7fb62c1581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb631547640 1 -- 172.21.15.28:0/1835783975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb62c0c29e0 msgr2=0x7fb62c1581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:22.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb631547640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb62c0c29e0 0x7fb62c1581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb631547640 1 -- 172.21.15.28:0/1835783975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb62c0c4100 msgr2=0x7fb62c154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:22.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb631547640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb62c0c4100 0x7fb62c154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.690+0000 7fb631547640 1 -- 172.21.15.28:0/1835783975 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624009b30 con 0x7fb62c0c63c0 2023-12-16T03:28:22.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb62bfff640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb62c0c4100 0x7fb62c154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb631547640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb62c0c63c0 0x7fb62c155420 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb6240af040 tx=0x7fb624019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb6297fa640 1 -- 172.21.15.28:0/1835783975 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240b8670 con 0x7fb62c0c63c0 2023-12-16T03:28:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb6297fa640 1 -- 172.21.15.28:0/1835783975 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6240b87d0 con 0x7fb62c0c63c0 2023-12-16T03:28:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb632faa640 1 -- 172.21.15.28:0/1835783975 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c0c69b0 con 0x7fb62c0c63c0 2023-12-16T03:28:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb6297fa640 1 -- 172.21.15.28:0/1835783975 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240b8b80 con 0x7fb62c0c63c0 2023-12-16T03:28:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb632faa640 1 -- 172.21.15.28:0/1835783975 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c070600 con 0x7fb62c0c63c0 2023-12-16T03:28:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb632faa640 1 -- 172.21.15.28:0/1835783975 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c159c40 con 0x7fb62c0c63c0 2023-12-16T03:28:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb6297fa640 1 -- 172.21.15.28:0/1835783975 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb6240b8ce0 con 0x7fb62c0c63c0 2023-12-16T03:28:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb6297fa640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb610066470 0x7fb610068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb6297fa640 1 -- 172.21.15.28:0/1835783975 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb62411f7c0 con 0x7fb62c0c63c0 2023-12-16T03:28:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.694+0000 7fb630d46640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb610066470 0x7fb610068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:22.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.698+0000 7fb630d46640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb610066470 0x7fb610068930 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb62000ba10 tx=0x7fb620008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:22.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.698+0000 7fb6297fa640 1 -- 172.21.15.28:0/1835783975 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb62c159c40 con 0x7fb62c0c63c0 2023-12-16T03:28:22.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.862+0000 7fb632faa640 1 -- 172.21.15.28:0/1835783975 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb62c159c40 con 0x7fb62c0c63c0 2023-12-16T03:28:22.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.862+0000 7fb6297fa640 1 -- 172.21.15.28:0/1835783975 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20214 (secure 0 0 0) 0x7fb62c159c40 con 0x7fb62c0c63c0 2023-12-16T03:28:22.867 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:22.867 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:13.793649+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 -- 172.21.15.28:0/1835783975 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb610066470 msgr2=0x7fb610068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb610066470 0x7fb610068930 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb62000ba10 tx=0x7fb620008040 comp rx=0 tx=0).stop 2023-12-16T03:28:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 -- 172.21.15.28:0/1835783975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb62c0c63c0 msgr2=0x7fb62c155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb62c0c63c0 0x7fb62c155420 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb6240af040 tx=0x7fb624019620 comp rx=0 tx=0).stop 2023-12-16T03:28:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 -- 172.21.15.28:0/1835783975 shutdown_connections 2023-12-16T03:28:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb610066470 0x7fb610068930 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb62c0c63c0 0x7fb62c155420 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb62c0c4100 0x7fb62c154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 --2- 172.21.15.28:0/1835783975 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb62c0c29e0 0x7fb62c1581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:22.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 -- 172.21.15.28:0/1835783975 >> 172.21.15.28:0/1835783975 conn(0x7fb62c06a5b0 msgr2=0x7fb62c06fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:22.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 -- 172.21.15.28:0/1835783975 shutdown_connections 2023-12-16T03:28:22.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:22.866+0000 7fb632faa640 1 -- 172.21.15.28:0/1835783975 wait complete. 2023-12-16T03:28:22.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:27:56.894984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:27:58.090972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:28:10.280019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:28:11.167317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:28:22.889 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:28:23.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.030+0000 7fc84c468640 1 Processor -- start 2023-12-16T03:28:23.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.030+0000 7fc84c468640 1 -- start start 2023-12-16T03:28:23.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.030+0000 7fc84c468640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc844155de0 0x7fc844156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.030+0000 7fc84c468640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8440c2580 con 0x7fc8440c5640 2023-12-16T03:28:23.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.030+0000 7fc84c468640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8440c1a00 con 0x7fc8440c5260 2023-12-16T03:28:23.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.030+0000 7fc84c468640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc844153510 con 0x7fc844155de0 2023-12-16T03:28:23.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.034+0000 7fc849a03640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc8440c5640 0x7fc8440c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37562/0 (socket says 172.21.15.28:37562) 2023-12-16T03:28:23.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.034+0000 7fc849a03640 1 -- 172.21.15.28:0/574584584 learned_addr learned my addr 172.21.15.28:0/574584584 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:23.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.034+0000 7fc84aa05640 1 --2- 172.21.15.28:0/574584584 >> v2:172.21.15.134:3300/0 conn(0x7fc844155de0 0x7fc844156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.034+0000 7fc849202640 1 -- 172.21.15.28:0/574584584 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791859483 0 0) 0x7fc8440c2580 con 0x7fc8440c5640 2023-12-16T03:28:23.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.034+0000 7fc849202640 1 -- 172.21.15.28:0/574584584 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc830003530 con 0x7fc8440c5640 2023-12-16T03:28:23.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.034+0000 7fc84aa05640 1 -- 172.21.15.28:0/574584584 >> v1:172.21.15.134:6789/0 conn(0x7fc8440c5260 legacy=0x7fc84406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.034+0000 7fc84aa05640 1 -- 172.21.15.28:0/574584584 >> v1:172.21.15.28:6789/0 conn(0x7fc8440c5640 legacy=0x7fc8440c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.034+0000 7fc84aa05640 1 -- 172.21.15.28:0/574584584 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8440c1ce0 con 0x7fc844155de0 2023-12-16T03:28:23.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.034+0000 7fc84aa05640 1 --2- 172.21.15.28:0/574584584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc844155de0 0x7fc844156230 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009d90 tx=0x7fc83c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9db5045937ef65 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:23.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc849202640 1 -- 172.21.15.28:0/574584584 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0a5870 con 0x7fc844155de0 2023-12-16T03:28:23.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc849202640 1 -- 172.21.15.28:0/574584584 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c0a59d0 con 0x7fc844155de0 2023-12-16T03:28:23.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc849202640 1 -- 172.21.15.28:0/574584584 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0a5d40 con 0x7fc844155de0 2023-12-16T03:28:23.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 -- 172.21.15.28:0/574584584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc844155de0 msgr2=0x7fc844156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 --2- 172.21.15.28:0/574584584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc844155de0 0x7fc844156230 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009d90 tx=0x7fc83c01c8c0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 -- 172.21.15.28:0/574584584 shutdown_connections 2023-12-16T03:28:23.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 --2- 172.21.15.28:0/574584584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc844155de0 0x7fc844156230 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 -- 172.21.15.28:0/574584584 >> 172.21.15.28:0/574584584 conn(0x7fc84406a5b0 msgr2=0x7fc84406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:23.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 -- 172.21.15.28:0/574584584 shutdown_connections 2023-12-16T03:28:23.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 -- 172.21.15.28:0/574584584 wait complete. 2023-12-16T03:28:23.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 Processor -- start 2023-12-16T03:28:23.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 -- start start 2023-12-16T03:28:23.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8440c5260 0x7fc8440c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8440c5640 0x7fc844151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc844155de0 0x7fc844151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8441f0f40 con 0x7fc8440c5640 2023-12-16T03:28:23.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440a9a60 con 0x7fc844155de0 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.038+0000 7fc84c468640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8441f1200 con 0x7fc8440c5260 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc849a03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8440c5640 0x7fc844151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc849a03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8440c5640 0x7fc844151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47262/0 (socket says 172.21.15.28:47262) 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc849a03640 1 -- 172.21.15.28:0/2074498878 learned_addr learned my addr 172.21.15.28:0/2074498878 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc84aa05640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc844155de0 0x7fc844151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc84a204640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8440c5260 0x7fc8440c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc849a03640 1 -- 172.21.15.28:0/2074498878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8440c5260 msgr2=0x7fc8440c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc849a03640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8440c5260 0x7fc8440c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc849a03640 1 -- 172.21.15.28:0/2074498878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc844155de0 msgr2=0x7fc844151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc849a03640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc844155de0 0x7fc844151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc849a03640 1 -- 172.21.15.28:0/2074498878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c009a70 con 0x7fc8440c5640 2023-12-16T03:28:23.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc849a03640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8440c5640 0x7fc844151240 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c400 tx=0x7fc83400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:23.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc83affd640 1 -- 172.21.15.28:0/2074498878 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834005cf0 con 0x7fc8440c5640 2023-12-16T03:28:23.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc83affd640 1 -- 172.21.15.28:0/2074498878 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc834005e50 con 0x7fc8440c5640 2023-12-16T03:28:23.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc83affd640 1 -- 172.21.15.28:0/2074498878 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340072d0 con 0x7fc8440c5640 2023-12-16T03:28:23.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc84c468640 1 -- 172.21.15.28:0/2074498878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8441f14e0 con 0x7fc8440c5640 2023-12-16T03:28:23.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc84c468640 1 -- 172.21.15.28:0/2074498878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8440712a0 con 0x7fc8440c5640 2023-12-16T03:28:23.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc84c468640 1 -- 172.21.15.28:0/2074498878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc844068400 con 0x7fc8440c5640 2023-12-16T03:28:23.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.042+0000 7fc83affd640 1 -- 172.21.15.28:0/2074498878 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc834007430 con 0x7fc8440c5640 2023-12-16T03:28:23.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.046+0000 7fc83affd640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc828066470 0x7fc828068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.046+0000 7fc83affd640 1 -- 172.21.15.28:0/2074498878 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc8340832a0 con 0x7fc8440c5640 2023-12-16T03:28:23.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.046+0000 7fc84a204640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc828066470 0x7fc828068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.046+0000 7fc84a204640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc828066470 0x7fc828068930 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc840001770 tx=0x7fc840009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:23.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.050+0000 7fc83affd640 1 -- 172.21.15.28:0/2074498878 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc8340505c0 con 0x7fc8440c5640 2023-12-16T03:28:23.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 -- 172.21.15.28:0/2074498878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc84415db90 con 0x7fc8440c5640 2023-12-16T03:28:23.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc83affd640 1 -- 172.21.15.28:0/2074498878 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc834053be0 con 0x7fc8440c5640 2023-12-16T03:28:23.210 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:28:23.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 -- 172.21.15.28:0/2074498878 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc828066470 msgr2=0x7fc828068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc828066470 0x7fc828068930 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc840001770 tx=0x7fc840009040 comp rx=0 tx=0).stop 2023-12-16T03:28:23.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 -- 172.21.15.28:0/2074498878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8440c5640 msgr2=0x7fc844151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8440c5640 0x7fc844151240 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c400 tx=0x7fc83400c8c0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 -- 172.21.15.28:0/2074498878 shutdown_connections 2023-12-16T03:28:23.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc844155de0 0x7fc844151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc828066470 0x7fc828068930 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8440c5640 0x7fc844151240 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 --2- 172.21.15.28:0/2074498878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8440c5260 0x7fc8440c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 -- 172.21.15.28:0/2074498878 >> 172.21.15.28:0/2074498878 conn(0x7fc84406a5b0 msgr2=0x7fc84414f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:23.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 -- 172.21.15.28:0/2074498878 shutdown_connections 2023-12-16T03:28:23.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.206+0000 7fc84c468640 1 -- 172.21.15.28:0/2074498878 wait complete. 2023-12-16T03:28:23.230 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:28:23.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.370+0000 7f07e34c8640 1 Processor -- start 2023-12-16T03:28:23.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.370+0000 7f07e34c8640 1 -- start start 2023-12-16T03:28:23.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e34c8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc151bb0 0x7f07dc06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e34c8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f07dc0bd3c0 0x7f07dc0c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e34c8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc0c8400 con 0x7f07dc0c7c30 2023-12-16T03:28:23.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e34c8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc0c86e0 con 0x7f07dc0bd3c0 2023-12-16T03:28:23.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e34c8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1543e0 con 0x7f07dc151bb0 2023-12-16T03:28:23.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e1cc5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f07dc0bd3c0 0x7f07dc0c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e24c6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc151bb0 0x7f07dc06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e1cc5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f07dc0bd3c0 0x7f07dc0c46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:44302/0 (socket says 172.21.15.28:44302) 2023-12-16T03:28:23.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e1cc5640 1 -- 172.21.15.28:0/3206549973 learned_addr learned my addr 172.21.15.28:0/3206549973 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:23.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e1cc5640 1 -- 172.21.15.28:0/3206549973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc151bb0 msgr2=0x7f07dc06ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:23.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e1cc5640 1 --2- 172.21.15.28:0/3206549973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc151bb0 0x7f07dc06ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e1cc5640 1 -- 172.21.15.28:0/3206549973 >> v1:172.21.15.134:6789/0 conn(0x7f07dc0c7c30 legacy=0x7f07dc1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.374+0000 7f07e1cc5640 1 -- 172.21.15.28:0/3206549973 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc1545f0 con 0x7f07dc0bd3c0 2023-12-16T03:28:23.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e1cc5640 1 --2- 172.21.15.28:0/3206549973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0bd3c0 0x7f07dc0c46b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009870 tx=0x7f07cc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5de6c24fba24820b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:23.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e14c4640 1 -- 172.21.15.28:0/3206549973 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0ab5f0 con 0x7f07dc0bd3c0 2023-12-16T03:28:23.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e14c4640 1 -- 172.21.15.28:0/3206549973 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc0ab750 con 0x7f07dc0bd3c0 2023-12-16T03:28:23.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e14c4640 1 -- 172.21.15.28:0/3206549973 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0abae0 con 0x7f07dc0bd3c0 2023-12-16T03:28:23.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e34c8640 1 -- 172.21.15.28:0/3206549973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0bd3c0 msgr2=0x7f07dc0c46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e34c8640 1 --2- 172.21.15.28:0/3206549973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0bd3c0 0x7f07dc0c46b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009870 tx=0x7f07cc01c3f0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e34c8640 1 -- 172.21.15.28:0/3206549973 shutdown_connections 2023-12-16T03:28:23.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e34c8640 1 --2- 172.21.15.28:0/3206549973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0bd3c0 0x7f07dc0c46b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e34c8640 1 --2- 172.21.15.28:0/3206549973 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc151bb0 0x7f07dc06ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e34c8640 1 -- 172.21.15.28:0/3206549973 >> 172.21.15.28:0/3206549973 conn(0x7f07dc0abcc0 msgr2=0x7f07dc0ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:23.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e34c8640 1 -- 172.21.15.28:0/3206549973 shutdown_connections 2023-12-16T03:28:23.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e34c8640 1 -- 172.21.15.28:0/3206549973 wait complete. 2023-12-16T03:28:23.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e34c8640 1 Processor -- start 2023-12-16T03:28:23.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.378+0000 7f07e34c8640 1 -- start start 2023-12-16T03:28:23.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e34c8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0bd3c0 0x7f07dc146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e34c8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07dc0c7c30 0x7f07dc1ed030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e34c8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc151bb0 0x7f07dc1ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e34c8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1574b0 con 0x7f07dc0c7c30 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e34c8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc157110 con 0x7f07dc0bd3c0 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e34c8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1f05a0 con 0x7f07dc151bb0 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e1cc5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07dc0c7c30 0x7f07dc1ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e1cc5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07dc0c7c30 0x7f07dc1ed030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47270/0 (socket says 172.21.15.28:47270) 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e1cc5640 1 -- 172.21.15.28:0/2087202605 learned_addr learned my addr 172.21.15.28:0/2087202605 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e24c6640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0bd3c0 0x7f07dc146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e2cc7640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc151bb0 0x7f07dc1ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e1cc5640 1 -- 172.21.15.28:0/2087202605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc151bb0 msgr2=0x7f07dc1ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e1cc5640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc151bb0 0x7f07dc1ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e1cc5640 1 -- 172.21.15.28:0/2087202605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0bd3c0 msgr2=0x7f07dc146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e1cc5640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0bd3c0 0x7f07dc146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e1cc5640 1 -- 172.21.15.28:0/2087202605 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc0094d0 con 0x7f07dc0c7c30 2023-12-16T03:28:23.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e1cc5640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07dc0c7c30 0x7f07dc1ed030 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f07cc01a020 tx=0x7f07cc01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:23.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07d2ffd640 1 -- 172.21.15.28:0/2087202605 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0be5f0 con 0x7f07dc0c7c30 2023-12-16T03:28:23.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07d2ffd640 1 -- 172.21.15.28:0/2087202605 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc0be770 con 0x7f07dc0c7c30 2023-12-16T03:28:23.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07d2ffd640 1 -- 172.21.15.28:0/2087202605 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0beb20 con 0x7f07dc0c7c30 2023-12-16T03:28:23.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e34c8640 1 -- 172.21.15.28:0/2087202605 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc1f0e40 con 0x7f07dc0c7c30 2023-12-16T03:28:23.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e34c8640 1 -- 172.21.15.28:0/2087202605 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc1f07f0 con 0x7f07dc0c7c30 2023-12-16T03:28:23.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07e34c8640 1 -- 172.21.15.28:0/2087202605 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07dc067e90 con 0x7f07dc0c7c30 2023-12-16T03:28:23.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.382+0000 7f07d2ffd640 1 -- 172.21.15.28:0/2087202605 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f07cc0b43f0 con 0x7f07dc0c7c30 2023-12-16T03:28:23.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.386+0000 7f07d2ffd640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07c0066470 0x7f07c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.386+0000 7f07d2ffd640 1 -- 172.21.15.28:0/2087202605 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f07cc0a8050 con 0x7f07dc0c7c30 2023-12-16T03:28:23.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.386+0000 7f07e24c6640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07c0066470 0x7f07c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.386+0000 7f07e24c6640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07c0066470 0x7f07c0068930 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0c71c0 tx=0x7f07d8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:23.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.390+0000 7f07d2ffd640 1 -- 172.21.15.28:0/2087202605 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f07cc0ec110 con 0x7f07dc0c7c30 2023-12-16T03:28:23.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.546+0000 7f07e34c8640 1 -- 172.21.15.28:0/2087202605 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07dc04e850 con 0x7f07dc0c7c30 2023-12-16T03:28:23.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.546+0000 7f07d2ffd640 1 -- 172.21.15.28:0/2087202605 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f07cc0ef730 con 0x7f07dc0c7c30 2023-12-16T03:28:23.551 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 -- 172.21.15.28:0/2087202605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07c0066470 msgr2=0x7f07c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07c0066470 0x7f07c0068930 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0c71c0 tx=0x7f07d8009190 comp rx=0 tx=0).stop 2023-12-16T03:28:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 -- 172.21.15.28:0/2087202605 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07dc0c7c30 msgr2=0x7f07dc1ed030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07dc0c7c30 0x7f07dc1ed030 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f07cc01a020 tx=0x7f07cc01ac30 comp rx=0 tx=0).stop 2023-12-16T03:28:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 -- 172.21.15.28:0/2087202605 shutdown_connections 2023-12-16T03:28:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07dc151bb0 0x7f07dc1ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f07c0066470 0x7f07c0068930 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07dc0c7c30 0x7f07dc1ed030 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 --2- 172.21.15.28:0/2087202605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07dc0bd3c0 0x7f07dc146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 -- 172.21.15.28:0/2087202605 >> 172.21.15.28:0/2087202605 conn(0x7f07dc0abcc0 msgr2=0x7f07dc152d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 -- 172.21.15.28:0/2087202605 shutdown_connections 2023-12-16T03:28:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.550+0000 7f07e34c8640 1 -- 172.21.15.28:0/2087202605 wait complete. 2023-12-16T03:28:23.572 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:28:23.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.714+0000 7f1ad759e640 1 Processor -- start 2023-12-16T03:28:23.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.714+0000 7f1ad759e640 1 -- start start 2023-12-16T03:28:23.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad759e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1ad8151cd0 0x7f1ad80ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad759e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1ad80c7c50 0x7f1ad81544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad759e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad80c8160 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad759e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad8157b40 con 0x7f1ad8151cd0 2023-12-16T03:28:23.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad759e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad8157e20 con 0x7f1ad80c7c50 2023-12-16T03:28:23.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1ad8151cd0 0x7f1ad80ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad6d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1ad80ca9a0 0x7f1ad806b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37572/0 (socket says 172.21.15.28:37572) 2023-12-16T03:28:23.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad6d9d640 1 -- 172.21.15.28:0/1843790560 learned_addr learned my addr 172.21.15.28:0/1843790560 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:23.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad5d9b640 1 --2- 172.21.15.28:0/1843790560 >> v2:172.21.15.134:3300/0 conn(0x7f1ad80c7c50 0x7f1ad81544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad659c640 1 -- 172.21.15.28:0/1843790560 >> v2:172.21.15.134:3300/0 conn(0x7f1ad80c7c50 msgr2=0x7f1ad81544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:23.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad659c640 1 --2- 172.21.15.28:0/1843790560 >> v2:172.21.15.134:3300/0 conn(0x7f1ad80c7c50 0x7f1ad81544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad659c640 1 -- 172.21.15.28:0/1843790560 >> v1:172.21.15.28:6789/0 conn(0x7f1ad80ca9a0 legacy=0x7f1ad806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad659c640 1 -- 172.21.15.28:0/1843790560 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8158100 con 0x7f1ad8151cd0 2023-12-16T03:28:23.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.718+0000 7f1ad559a640 1 -- 172.21.15.28:0/1843790560 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777912862 0 0) 0x7f1ad80c8160 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad659c640 1 --2- 172.21.15.28:0/1843790560 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ad8151cd0 0x7f1ad80ca460 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80ac7a0 tx=0x7f1ac801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc68ea04a618097e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:23.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad559a640 1 -- 172.21.15.28:0/1843790560 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac80ab650 con 0x7f1ad8151cd0 2023-12-16T03:28:23.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad559a640 1 -- 172.21.15.28:0/1843790560 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac80ab7b0 con 0x7f1ad8151cd0 2023-12-16T03:28:23.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad559a640 1 -- 172.21.15.28:0/1843790560 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac80abb40 con 0x7f1ad8151cd0 2023-12-16T03:28:23.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad759e640 1 -- 172.21.15.28:0/1843790560 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ad8151cd0 msgr2=0x7f1ad80ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad759e640 1 --2- 172.21.15.28:0/1843790560 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ad8151cd0 0x7f1ad80ca460 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80ac7a0 tx=0x7f1ac801c430 comp rx=0 tx=0).stop 2023-12-16T03:28:23.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad759e640 1 -- 172.21.15.28:0/1843790560 shutdown_connections 2023-12-16T03:28:23.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad759e640 1 --2- 172.21.15.28:0/1843790560 >> v2:172.21.15.134:3300/0 conn(0x7f1ad80c7c50 0x7f1ad81544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad759e640 1 --2- 172.21.15.28:0/1843790560 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ad8151cd0 0x7f1ad80ca460 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad759e640 1 -- 172.21.15.28:0/1843790560 >> 172.21.15.28:0/1843790560 conn(0x7f1ad80abee0 msgr2=0x7f1ad80c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:23.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad759e640 1 -- 172.21.15.28:0/1843790560 shutdown_connections 2023-12-16T03:28:23.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad759e640 1 -- 172.21.15.28:0/1843790560 wait complete. 2023-12-16T03:28:23.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad759e640 1 Processor -- start 2023-12-16T03:28:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.722+0000 7f1ad759e640 1 -- start start 2023-12-16T03:28:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad759e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ad80c7c50 0x7f1ad814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ad80ca9a0 0x7f1ad80c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad759e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ad8151cd0 0x7f1ad80c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad759e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80c28f0 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad759e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80c3640 con 0x7f1ad80c7c50 2023-12-16T03:28:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad759e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad81f08a0 con 0x7f1ad8151cd0 2023-12-16T03:28:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad5d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ad80ca9a0 0x7f1ad80c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad5d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ad80ca9a0 0x7f1ad80c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47290/0 (socket says 172.21.15.28:47290) 2023-12-16T03:28:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad5d9b640 1 -- 172.21.15.28:0/1369557918 learned_addr learned my addr 172.21.15.28:0/1369557918 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:23.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad659c640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ad80c7c50 0x7f1ad814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad6d9d640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ad8151cd0 0x7f1ad80c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad5d9b640 1 -- 172.21.15.28:0/1369557918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ad8151cd0 msgr2=0x7f1ad80c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad5d9b640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ad8151cd0 0x7f1ad80c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad5d9b640 1 -- 172.21.15.28:0/1369557918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ad80c7c50 msgr2=0x7f1ad814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad5d9b640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ad80c7c50 0x7f1ad814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad5d9b640 1 -- 172.21.15.28:0/1369557918 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac8009420 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad5d9b640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ad80ca9a0 0x7f1ad80c8940 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00e930 tx=0x7f1acc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ac6ffd640 1 -- 172.21.15.28:0/1369557918 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc009690 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ac6ffd640 1 -- 172.21.15.28:0/1369557918 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc00ca00 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad759e640 1 -- 172.21.15.28:0/1369557918 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad814b900 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ac6ffd640 1 -- 172.21.15.28:0/1369557918 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc00cdb0 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad759e640 1 -- 172.21.15.28:0/1369557918 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad81f0250 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.726+0000 7f1ad759e640 1 -- 172.21.15.28:0/1369557918 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad814f6a0 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.730+0000 7f1ac6ffd640 1 -- 172.21.15.28:0/1369557918 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1acc013470 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.730+0000 7f1ac6ffd640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ab80664c0 0x7f1ab8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.730+0000 7f1ac6ffd640 1 -- 172.21.15.28:0/1369557918 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1acc084220 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.730+0000 7f1ad659c640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ab80664c0 0x7f1ab8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:23.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.730+0000 7f1ad659c640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ab80664c0 0x7f1ab8068980 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80af000 tx=0x7f1ac80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:23.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.734+0000 7f1ac6ffd640 1 -- 172.21.15.28:0/1369557918 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1acc051620 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.898+0000 7f1ad759e640 1 -- 172.21.15.28:0/1369557918 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ad804e850 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.898+0000 7f1ac6ffd640 1 -- 172.21.15.28:0/1369557918 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1acc054c40 con 0x7f1ad80ca9a0 2023-12-16T03:28:23.903 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 -- 172.21.15.28:0/1369557918 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ab80664c0 msgr2=0x7f1ab8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ab80664c0 0x7f1ab8068980 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80af000 tx=0x7f1ac80a7000 comp rx=0 tx=0).stop 2023-12-16T03:28:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 -- 172.21.15.28:0/1369557918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ad80ca9a0 msgr2=0x7f1ad80c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ad80ca9a0 0x7f1ad80c8940 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00e930 tx=0x7f1acc00edf0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 -- 172.21.15.28:0/1369557918 shutdown_connections 2023-12-16T03:28:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1ad8151cd0 0x7f1ad80c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ab80664c0 0x7f1ab8068980 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ad80ca9a0 0x7f1ad80c8940 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 --2- 172.21.15.28:0/1369557918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ad80c7c50 0x7f1ad814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 -- 172.21.15.28:0/1369557918 >> 172.21.15.28:0/1369557918 conn(0x7f1ad80abee0 msgr2=0x7f1ad806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 -- 172.21.15.28:0/1369557918 shutdown_connections 2023-12-16T03:28:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:23.902+0000 7f1ad759e640 1 -- 172.21.15.28:0/1369557918 wait complete. 2023-12-16T03:28:23.925 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:28:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f3930ff5640 1 Processor -- start 2023-12-16T03:28:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f3930ff5640 1 -- start start 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f3930ff5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f392c0c7ea0 0x7f392c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f3930ff5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f392c06b9e0 0x7f392c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f3930ff5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392c06c860 con 0x7f392c151e90 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f3930ff5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c0c8750 con 0x7f392c06b9e0 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f3930ff5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c1552d0 con 0x7f392c0c7ea0 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f392ad9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f392c06b9e0 0x7f392c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f392ad9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f392c06b9e0 0x7f392c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47292/0 (socket says 172.21.15.28:47292) 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f392ad9d640 1 -- 172.21.15.28:0/2429349888 learned_addr learned my addr 172.21.15.28:0/2429349888 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f3923fff640 1 --2- 172.21.15.28:0/2429349888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f392c0c7ea0 0x7f392c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f392ad9d640 1 -- 172.21.15.28:0/2429349888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f392c0c7ea0 msgr2=0x7f392c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f392ad9d640 1 --2- 172.21.15.28:0/2429349888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f392c0c7ea0 0x7f392c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f392ad9d640 1 -- 172.21.15.28:0/2429349888 >> v1:172.21.15.134:6789/0 conn(0x7f392c151e90 legacy=0x7f392c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.066+0000 7f392ad9d640 1 -- 172.21.15.28:0/2429349888 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c154930 con 0x7f392c06b9e0 2023-12-16T03:28:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f392ad9d640 1 --2- 172.21.15.28:0/2429349888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f392c06b9e0 0x7f392c15f0a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3924009e50 tx=0x7f392401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efeff033235456e server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f3929d9b640 1 -- 172.21.15.28:0/2429349888 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39240a55b0 con 0x7f392c06b9e0 2023-12-16T03:28:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f3929d9b640 1 -- 172.21.15.28:0/2429349888 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39240a5710 con 0x7f392c06b9e0 2023-12-16T03:28:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f3929d9b640 1 -- 172.21.15.28:0/2429349888 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39240a5aa0 con 0x7f392c06b9e0 2023-12-16T03:28:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f3930ff5640 1 -- 172.21.15.28:0/2429349888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f392c06b9e0 msgr2=0x7f392c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f3930ff5640 1 --2- 172.21.15.28:0/2429349888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f392c06b9e0 0x7f392c15f0a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3924009e50 tx=0x7f392401c8f0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f3930ff5640 1 -- 172.21.15.28:0/2429349888 shutdown_connections 2023-12-16T03:28:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f3930ff5640 1 --2- 172.21.15.28:0/2429349888 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f392c0c7ea0 0x7f392c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f3930ff5640 1 --2- 172.21.15.28:0/2429349888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f392c06b9e0 0x7f392c15f0a0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f3930ff5640 1 -- 172.21.15.28:0/2429349888 >> 172.21.15.28:0/2429349888 conn(0x7f392c0ca170 msgr2=0x7f392c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f3930ff5640 1 -- 172.21.15.28:0/2429349888 shutdown_connections 2023-12-16T03:28:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.070+0000 7f3930ff5640 1 -- 172.21.15.28:0/2429349888 wait complete. 2023-12-16T03:28:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3930ff5640 1 Processor -- start 2023-12-16T03:28:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3930ff5640 1 -- start start 2023-12-16T03:28:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3930ff5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f392c06b9e0 0x7f392c1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3930ff5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f392c0c7ea0 0x7f392c0bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3930ff5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f392c151e90 0x7f392c0c0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3930ff5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c1f1410 con 0x7f392c151e90 2023-12-16T03:28:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3930ff5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c0be8f0 con 0x7f392c06b9e0 2023-12-16T03:28:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3930ff5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c0be580 con 0x7f392c0c7ea0 2023-12-16T03:28:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f392ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f392c151e90 0x7f392c0c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f392ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f392c151e90 0x7f392c0c0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47308/0 (socket says 172.21.15.28:47308) 2023-12-16T03:28:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f392ad9d640 1 -- 172.21.15.28:0/1149009714 learned_addr learned my addr 172.21.15.28:0/1149009714 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3923fff640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f392c0c7ea0 0x7f392c0bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f392a59c640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f392c06b9e0 0x7f392c1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f392ad9d640 1 -- 172.21.15.28:0/1149009714 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f392c0c7ea0 msgr2=0x7f392c0bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f392ad9d640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f392c0c7ea0 0x7f392c0bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f392ad9d640 1 -- 172.21.15.28:0/1149009714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f392c06b9e0 msgr2=0x7f392c1527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f392ad9d640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f392c06b9e0 0x7f392c1527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f392ad9d640 1 -- 172.21.15.28:0/1149009714 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3924009b30 con 0x7f392c151e90 2023-12-16T03:28:24.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f392ad9d640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f392c151e90 0x7f392c0c0390 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3924009e50 tx=0x7f3924019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:24.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3922ffd640 1 -- 172.21.15.28:0/1149009714 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39240a55b0 con 0x7f392c151e90 2023-12-16T03:28:24.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3922ffd640 1 -- 172.21.15.28:0/1149009714 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39240b8670 con 0x7f392c151e90 2023-12-16T03:28:24.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3922ffd640 1 -- 172.21.15.28:0/1149009714 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39240b8a20 con 0x7f392c151e90 2023-12-16T03:28:24.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3930ff5640 1 -- 172.21.15.28:0/1149009714 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c0bdc50 con 0x7f392c151e90 2023-12-16T03:28:24.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.074+0000 7f3930ff5640 1 -- 172.21.15.28:0/1149009714 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c0be210 con 0x7f392c151e90 2023-12-16T03:28:24.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.078+0000 7f3930ff5640 1 -- 172.21.15.28:0/1149009714 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392c068400 con 0x7f392c151e90 2023-12-16T03:28:24.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.078+0000 7f3922ffd640 1 -- 172.21.15.28:0/1149009714 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f39240b8b80 con 0x7f392c151e90 2023-12-16T03:28:24.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.078+0000 7f3922ffd640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f390c066470 0x7f390c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.078+0000 7f3922ffd640 1 -- 172.21.15.28:0/1149009714 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f392411f440 con 0x7f392c151e90 2023-12-16T03:28:24.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.078+0000 7f392a59c640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f390c066470 0x7f390c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.078+0000 7f392a59c640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f390c066470 0x7f390c068930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f391c007fd0 tx=0x7f391c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:24.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.082+0000 7f3922ffd640 1 -- 172.21.15.28:0/1149009714 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f39240ec690 con 0x7f392c151e90 2023-12-16T03:28:24.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 -- 172.21.15.28:0/1149009714 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f392c14f4a0 con 0x7f392c151e90 2023-12-16T03:28:24.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3922ffd640 1 -- 172.21.15.28:0/1149009714 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f3924009510 con 0x7f392c151e90 2023-12-16T03:28:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:24.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 -- 172.21.15.28:0/1149009714 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f390c066470 msgr2=0x7f390c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f390c066470 0x7f390c068930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f391c007fd0 tx=0x7f391c009040 comp rx=0 tx=0).stop 2023-12-16T03:28:24.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 -- 172.21.15.28:0/1149009714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f392c151e90 msgr2=0x7f392c0c0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f392c151e90 0x7f392c0c0390 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3924009e50 tx=0x7f3924019690 comp rx=0 tx=0).stop 2023-12-16T03:28:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 -- 172.21.15.28:0/1149009714 shutdown_connections 2023-12-16T03:28:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f390c066470 0x7f390c068930 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f392c151e90 0x7f392c0c0390 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f392c0c7ea0 0x7f392c0bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 --2- 172.21.15.28:0/1149009714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f392c06b9e0 0x7f392c1527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 -- 172.21.15.28:0/1149009714 >> 172.21.15.28:0/1149009714 conn(0x7f392c0ca170 msgr2=0x7f392c153750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 -- 172.21.15.28:0/1149009714 shutdown_connections 2023-12-16T03:28:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.238+0000 7f3930ff5640 1 -- 172.21.15.28:0/1149009714 wait complete. 2023-12-16T03:28:24.262 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:28:24.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.402+0000 7f6787a6b640 1 Processor -- start 2023-12-16T03:28:24.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.402+0000 7f6787a6b640 1 -- start start 2023-12-16T03:28:24.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6787a6b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6780072090 0x7f6780150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6787a6b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67800c2760 con 0x7f67800a5370 2023-12-16T03:28:24.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6787a6b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67800a5750 con 0x7f67800725c0 2023-12-16T03:28:24.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6787a6b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800c3070 con 0x7f6780072090 2023-12-16T03:28:24.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6785807640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f67800a5370 0x7f67800c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37586/0 (socket says 172.21.15.28:37586) 2023-12-16T03:28:24.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6785807640 1 -- 172.21.15.28:0/1617577338 learned_addr learned my addr 172.21.15.28:0/1617577338 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:24.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6785006640 1 --2- 172.21.15.28:0/1617577338 >> v2:172.21.15.134:3300/0 conn(0x7f6780072090 0x7f6780150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856461920 0 0) 0x7f67800c2760 con 0x7f67800a5370 2023-12-16T03:28:24.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f676c003450 con 0x7f67800a5370 2023-12-16T03:28:24.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706946278 0 0) 0x7f67800a5750 con 0x7f67800725c0 2023-12-16T03:28:24.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67800c2760 con 0x7f67800725c0 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3471358998 0 0) 0x7f676c003450 con 0x7f67800a5370 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 >> v2:172.21.15.134:3300/0 conn(0x7f6780072090 msgr2=0x7f6780150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 --2- 172.21.15.28:0/1617577338 >> v2:172.21.15.134:3300/0 conn(0x7f6780072090 0x7f6780150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 >> v1:172.21.15.134:6789/0 conn(0x7f67800725c0 legacy=0x7f67801514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800aad20 con 0x7f67800a5370 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f677c001680 con 0x7f67800a5370 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 >> v1:172.21.15.28:6789/0 conn(0x7f67800a5370 legacy=0x7f67800c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 --2- 172.21.15.28:0/1617577338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f676c003c50 0x7f676c008860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 --2- 172.21.15.28:0/1617577338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f676c008da0 0x7f676c00b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 --2- 172.21.15.28:0/1617577338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f676c00b6d0 0x7f676c00dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800c3070 con 0x7f676c00b6d0 2023-12-16T03:28:24.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c00e3a0 con 0x7f676c003c50 2023-12-16T03:28:24.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676c00e560 con 0x7f676c008da0 2023-12-16T03:28:24.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6785807640 1 --2- 172.21.15.28:0/1617577338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f676c003c50 0x7f676c008860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6786008640 1 --2- 172.21.15.28:0/1617577338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f676c00b6d0 0x7f676c00dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6785006640 1 --2- 172.21.15.28:0/1617577338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f676c008da0 0x7f676c00b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6786008640 1 -- 172.21.15.28:0/1617577338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f676c008da0 msgr2=0x7f676c00b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:24.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6786008640 1 --2- 172.21.15.28:0/1617577338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f676c008da0 0x7f676c00b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6786008640 1 -- 172.21.15.28:0/1617577338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f676c003c50 msgr2=0x7f676c008860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:24.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6786008640 1 --2- 172.21.15.28:0/1617577338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f676c003c50 0x7f676c008860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.406+0000 7f6786008640 1 -- 172.21.15.28:0/1617577338 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c003450 con 0x7f676c00b6d0 2023-12-16T03:28:24.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6786008640 1 -- 172.21.15.28:0/1617577338 reap_dead start 2023-12-16T03:28:24.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6786008640 1 --2- 172.21.15.28:0/1617577338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f676c00b6d0 0x7f676c00dac0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f6778001fd0 tx=0x7f677801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f00fb1a76f111b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:24.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778003b80 con 0x7f676c00b6d0 2023-12-16T03:28:24.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778003ce0 con 0x7f676c00b6d0 2023-12-16T03:28:24.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6784805640 1 -- 172.21.15.28:0/1617577338 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778005310 con 0x7f676c00b6d0 2023-12-16T03:28:24.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6787a6b640 1 -- 172.21.15.28:0/1617577338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f676c00b6d0 msgr2=0x7f676c00dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6787a6b640 1 --2- 172.21.15.28:0/1617577338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f676c00b6d0 0x7f676c00dac0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f6778001fd0 tx=0x7f677801c8e0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6787a6b640 1 -- 172.21.15.28:0/1617577338 shutdown_connections 2023-12-16T03:28:24.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6787a6b640 1 --2- 172.21.15.28:0/1617577338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f676c00b6d0 0x7f676c00dac0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6787a6b640 1 -- 172.21.15.28:0/1617577338 >> 172.21.15.28:0/1617577338 conn(0x7f678006a5b0 msgr2=0x7f678006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:24.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6787a6b640 1 -- 172.21.15.28:0/1617577338 shutdown_connections 2023-12-16T03:28:24.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6787a6b640 1 -- 172.21.15.28:0/1617577338 wait complete. 2023-12-16T03:28:24.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.410+0000 7f6787a6b640 1 Processor -- start 2023-12-16T03:28:24.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6787a6b640 1 -- start start 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6787a6b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f676c00b6d0 0x7f678014a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6787a6b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f678014b320 0x7f67801ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6787a6b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6780150860 0x7f67801ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6787a6b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800a5e40 con 0x7f6780150860 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6787a6b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800a6650 con 0x7f676c00b6d0 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6787a6b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67801491b0 con 0x7f678014b320 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6786008640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6780150860 0x7f67801ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6786008640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6780150860 0x7f67801ed600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47338/0 (socket says 172.21.15.28:47338) 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6786008640 1 -- 172.21.15.28:0/2932682933 learned_addr learned my addr 172.21.15.28:0/2932682933 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6785006640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f678014b320 0x7f67801ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6785807640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f676c00b6d0 0x7f678014a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6786008640 1 -- 172.21.15.28:0/2932682933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f678014b320 msgr2=0x7f67801ed0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6786008640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f678014b320 0x7f67801ed0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6786008640 1 -- 172.21.15.28:0/2932682933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f676c00b6d0 msgr2=0x7f678014a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6786008640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f676c00b6d0 0x7f678014a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6786008640 1 -- 172.21.15.28:0/2932682933 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800a6090 con 0x7f6780150860 2023-12-16T03:28:24.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6785807640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f676c00b6d0 0x7f678014a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:24.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6786008640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6780150860 0x7f67801ed600 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f677801d180 tx=0x7f676c003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:24.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f67767fc640 1 -- 172.21.15.28:0/2932682933 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780ae070 con 0x7f6780150860 2023-12-16T03:28:24.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f67767fc640 1 -- 172.21.15.28:0/2932682933 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778005750 con 0x7f6780150860 2023-12-16T03:28:24.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f67767fc640 1 -- 172.21.15.28:0/2932682933 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778003b80 con 0x7f6780150860 2023-12-16T03:28:24.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6787a6b640 1 -- 172.21.15.28:0/2932682933 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67800a6370 con 0x7f6780150860 2023-12-16T03:28:24.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6787a6b640 1 -- 172.21.15.28:0/2932682933 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67800a7430 con 0x7f6780150860 2023-12-16T03:28:24.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.414+0000 7f6787a6b640 1 -- 172.21.15.28:0/2932682933 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67801eca00 con 0x7f6780150860 2023-12-16T03:28:24.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.418+0000 7f67767fc640 1 -- 172.21.15.28:0/2932682933 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6778006b60 con 0x7f6780150860 2023-12-16T03:28:24.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.418+0000 7f67767fc640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6764066470 0x7f6764068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.418+0000 7f67767fc640 1 -- 172.21.15.28:0/2932682933 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f677811c900 con 0x7f6780150860 2023-12-16T03:28:24.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.418+0000 7f6785807640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6764066470 0x7f6764068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.418+0000 7f6785807640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6764066470 0x7f6764068930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f677c000c10 tx=0x7f677c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:24.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.422+0000 7f67767fc640 1 -- 172.21.15.28:0/2932682933 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f67801eca00 con 0x7f6780150860 2023-12-16T03:28:24.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 -- 172.21.15.28:0/2932682933 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f67801eca00 con 0x7f6780150860 2023-12-16T03:28:24.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f67767fc640 1 -- 172.21.15.28:0/2932682933 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f67801eca00 con 0x7f6780150860 2023-12-16T03:28:24.583 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:24.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 -- 172.21.15.28:0/2932682933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6764066470 msgr2=0x7f6764068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6764066470 0x7f6764068930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f677c000c10 tx=0x7f677c009040 comp rx=0 tx=0).stop 2023-12-16T03:28:24.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 -- 172.21.15.28:0/2932682933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6780150860 msgr2=0x7f67801ed600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6780150860 0x7f67801ed600 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f677801d180 tx=0x7f676c003700 comp rx=0 tx=0).stop 2023-12-16T03:28:24.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 -- 172.21.15.28:0/2932682933 shutdown_connections 2023-12-16T03:28:24.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6764066470 0x7f6764068930 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6780150860 0x7f67801ed600 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f678014b320 0x7f67801ed0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 --2- 172.21.15.28:0/2932682933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f676c00b6d0 0x7f678014a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 -- 172.21.15.28:0/2932682933 >> 172.21.15.28:0/2932682933 conn(0x7f678006a5b0 msgr2=0x7f678006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:24.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 -- 172.21.15.28:0/2932682933 shutdown_connections 2023-12-16T03:28:24.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.578+0000 7f6787a6b640 1 -- 172.21.15.28:0/2932682933 wait complete. 2023-12-16T03:28:24.604 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:28:24.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.742+0000 7fe590157640 1 Processor -- start 2023-12-16T03:28:24.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.742+0000 7fe590157640 1 -- start start 2023-12-16T03:28:24.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe590157640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5881560e0 0x7fe58815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe590157640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5880bffc0 0x7fe5880c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe590157640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58815c600 con 0x7fe58806d520 2023-12-16T03:28:24.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe590157640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58815a5c0 con 0x7fe5881560e0 2023-12-16T03:28:24.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe590157640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5881594e0 con 0x7fe5880bffc0 2023-12-16T03:28:24.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe58def3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5881560e0 0x7fe58815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe58def3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5881560e0 0x7fe58815ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:44374/0 (socket says 172.21.15.28:44374) 2023-12-16T03:28:24.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe58def3640 1 -- 172.21.15.28:0/4171584355 learned_addr learned my addr 172.21.15.28:0/4171584355 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:24.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe58e6f4640 1 --2- 172.21.15.28:0/4171584355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5880bffc0 0x7fe5880c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe58d6f2640 1 --1- 172.21.15.28:0/4171584355 >> v1:172.21.15.134:6789/0 conn(0x7fe58806d520 0x7fe588159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:53488/0 (socket says 172.21.15.28:53488) 2023-12-16T03:28:24.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe58def3640 1 -- 172.21.15.28:0/4171584355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5880bffc0 msgr2=0x7fe5880c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:24.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe58def3640 1 --2- 172.21.15.28:0/4171584355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5880bffc0 0x7fe5880c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe58def3640 1 -- 172.21.15.28:0/4171584355 >> v1:172.21.15.134:6789/0 conn(0x7fe58806d520 legacy=0x7fe588159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe58def3640 1 -- 172.21.15.28:0/4171584355 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5881597c0 con 0x7fe5881560e0 2023-12-16T03:28:24.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.746+0000 7fe58cef1640 1 -- 172.21.15.28:0/4171584355 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780681900 0 0) 0x7fe58815c600 con 0x7fe58806d520 2023-12-16T03:28:24.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe58def3640 1 --2- 172.21.15.28:0/4171584355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5881560e0 0x7fe58815ca90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe584009870 tx=0x7fe58401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb84b445bc9f0dd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe58cef1640 1 -- 172.21.15.28:0/4171584355 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5840ab620 con 0x7fe5881560e0 2023-12-16T03:28:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe58cef1640 1 -- 172.21.15.28:0/4171584355 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5840ab780 con 0x7fe5881560e0 2023-12-16T03:28:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe58cef1640 1 -- 172.21.15.28:0/4171584355 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5840abb10 con 0x7fe5881560e0 2023-12-16T03:28:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 -- 172.21.15.28:0/4171584355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5881560e0 msgr2=0x7fe58815ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 --2- 172.21.15.28:0/4171584355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5881560e0 0x7fe58815ca90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe584009870 tx=0x7fe58401c510 comp rx=0 tx=0).stop 2023-12-16T03:28:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 -- 172.21.15.28:0/4171584355 shutdown_connections 2023-12-16T03:28:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 --2- 172.21.15.28:0/4171584355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5880bffc0 0x7fe5880c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 --2- 172.21.15.28:0/4171584355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5881560e0 0x7fe58815ca90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 -- 172.21.15.28:0/4171584355 >> 172.21.15.28:0/4171584355 conn(0x7fe58806a5b0 msgr2=0x7fe58806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 -- 172.21.15.28:0/4171584355 shutdown_connections 2023-12-16T03:28:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 -- 172.21.15.28:0/4171584355 wait complete. 2023-12-16T03:28:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 Processor -- start 2023-12-16T03:28:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 -- start start 2023-12-16T03:28:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe58806d520 0x7fe5881f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5880bffc0 0x7fe5880a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5881560e0 0x7fe5880a3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880c5b70 con 0x7fe58806d520 2023-12-16T03:28:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5881f5970 con 0x7fe5880bffc0 2023-12-16T03:28:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.750+0000 7fe590157640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880c51d0 con 0x7fe5881560e0 2023-12-16T03:28:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe58def3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe58806d520 0x7fe5881f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe58def3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe58806d520 0x7fe5881f4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47352/0 (socket says 172.21.15.28:47352) 2023-12-16T03:28:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe58def3640 1 -- 172.21.15.28:0/2913531661 learned_addr learned my addr 172.21.15.28:0/2913531661 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe58e6f4640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5881560e0 0x7fe5880a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe58d6f2640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5880bffc0 0x7fe5880a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe58def3640 1 -- 172.21.15.28:0/2913531661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5881560e0 msgr2=0x7fe5880a3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe58def3640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5881560e0 0x7fe5880a3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe58def3640 1 -- 172.21.15.28:0/2913531661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5880bffc0 msgr2=0x7fe5880a3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe58def3640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5880bffc0 0x7fe5880a3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe58def3640 1 -- 172.21.15.28:0/2913531661 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5840094d0 con 0x7fe58806d520 2023-12-16T03:28:24.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe58def3640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe58806d520 0x7fe5881f4ee0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe5840ad040 tx=0x7fe58401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe57e7fc640 1 -- 172.21.15.28:0/2913531661 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5840abe40 con 0x7fe58806d520 2023-12-16T03:28:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe57e7fc640 1 -- 172.21.15.28:0/2913531661 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5840be3f0 con 0x7fe58806d520 2023-12-16T03:28:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe57e7fc640 1 -- 172.21.15.28:0/2913531661 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5840be7a0 con 0x7fe58806d520 2023-12-16T03:28:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe590157640 1 -- 172.21.15.28:0/2913531661 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5880c54b0 con 0x7fe58806d520 2023-12-16T03:28:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe590157640 1 -- 172.21.15.28:0/2913531661 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5880c6b00 con 0x7fe58806d520 2023-12-16T03:28:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe590157640 1 -- 172.21.15.28:0/2913531661 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe588068400 con 0x7fe58806d520 2023-12-16T03:28:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.754+0000 7fe57e7fc640 1 -- 172.21.15.28:0/2913531661 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe5840b43f0 con 0x7fe58806d520 2023-12-16T03:28:24.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.758+0000 7fe57e7fc640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe56c066470 0x7fe56c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:24.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.758+0000 7fe57e7fc640 1 -- 172.21.15.28:0/2913531661 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe58411e440 con 0x7fe58806d520 2023-12-16T03:28:24.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.758+0000 7fe58d6f2640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe56c066470 0x7fe56c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:24.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.758+0000 7fe58d6f2640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe56c066470 0x7fe56c068930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe5880c1ed0 tx=0x7fe578007d60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:24.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.762+0000 7fe57e7fc640 1 -- 172.21.15.28:0/2913531661 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe5840eb600 con 0x7fe58806d520 2023-12-16T03:28:24.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.930+0000 7fe590157640 1 -- 172.21.15.28:0/2913531661 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe5880c2fc0 con 0x7fe58806d520 2023-12-16T03:28:24.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.930+0000 7fe57e7fc640 1 -- 172.21.15.28:0/2913531661 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe5840eec20 con 0x7fe58806d520 2023-12-16T03:28:24.936 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:28:24.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 -- 172.21.15.28:0/2913531661 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe56c066470 msgr2=0x7fe56c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe56c066470 0x7fe56c068930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe5880c1ed0 tx=0x7fe578007d60 comp rx=0 tx=0).stop 2023-12-16T03:28:24.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 -- 172.21.15.28:0/2913531661 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe58806d520 msgr2=0x7fe5881f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:24.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe58806d520 0x7fe5881f4ee0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe5840ad040 tx=0x7fe58401ad50 comp rx=0 tx=0).stop 2023-12-16T03:28:24.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 -- 172.21.15.28:0/2913531661 shutdown_connections 2023-12-16T03:28:24.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5881560e0 0x7fe5880a3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5880bffc0 0x7fe5880a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fe56c066470 0x7fe56c068930 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 --2- 172.21.15.28:0/2913531661 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe58806d520 0x7fe5881f4ee0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:24.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 -- 172.21.15.28:0/2913531661 >> 172.21.15.28:0/2913531661 conn(0x7fe58806a5b0 msgr2=0x7fe588152c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:24.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 -- 172.21.15.28:0/2913531661 shutdown_connections 2023-12-16T03:28:24.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:24.934+0000 7fe590157640 1 -- 172.21.15.28:0/2913531661 wait complete. 2023-12-16T03:28:24.957 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-16T03:28:24.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:24.957 DEBUG:teuthology.orchestra.run.smithi028:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-16T03:28:25.019 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:28:25.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:25.019 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-16T03:28:25.042 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:25.042 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:25.093 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7208 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-16T03:28:25.094 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:28:25.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f783351d640 1 Processor -- start 2023-12-16T03:28:25.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f783351d640 1 -- start start 2023-12-16T03:28:25.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f783351d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f782c06b270 0x7f782c155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:25.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f783351d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f782c0c8540 0x7f782c151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:25.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f783351d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0c56d0 con 0x7f782c0c6310 2023-12-16T03:28:25.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f783351d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0c9d30 con 0x7f782c06b270 2023-12-16T03:28:25.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f783351d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0c4da0 con 0x7f782c0c8540 2023-12-16T03:28:25.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f78312b9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f782c06b270 0x7f782c155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:25.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f78312b9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f782c06b270 0x7f782c155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47362/0 (socket says 172.21.15.28:47362) 2023-12-16T03:28:25.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f78312b9640 1 -- 172.21.15.28:0/2588919177 learned_addr learned my addr 172.21.15.28:0/2588919177 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:25.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f7831aba640 1 --2- 172.21.15.28:0/2588919177 >> v2:172.21.15.134:3300/0 conn(0x7f782c0c8540 0x7f782c151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:25.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f78312b9640 1 -- 172.21.15.28:0/2588919177 >> v2:172.21.15.134:3300/0 conn(0x7f782c0c8540 msgr2=0x7f782c151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:25.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f78312b9640 1 --2- 172.21.15.28:0/2588919177 >> v2:172.21.15.134:3300/0 conn(0x7f782c0c8540 0x7f782c151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:25.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f78312b9640 1 -- 172.21.15.28:0/2588919177 >> v1:172.21.15.134:6789/0 conn(0x7f782c0c6310 legacy=0x7f782c0c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:25.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.278+0000 7f78312b9640 1 -- 172.21.15.28:0/2588919177 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0c5080 con 0x7f782c06b270 2023-12-16T03:28:25.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f78312b9640 1 --2- 172.21.15.28:0/2588919177 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f782c06b270 0x7f782c155240 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7828009870 tx=0x7f782801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77d578f0e0d3bec server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:25.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f7823fff640 1 -- 172.21.15.28:0/2588919177 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280ab600 con 0x7f782c06b270 2023-12-16T03:28:25.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f7823fff640 1 -- 172.21.15.28:0/2588919177 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280a7050 con 0x7f782c06b270 2023-12-16T03:28:25.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f7823fff640 1 -- 172.21.15.28:0/2588919177 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280ab980 con 0x7f782c06b270 2023-12-16T03:28:25.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f783351d640 1 -- 172.21.15.28:0/2588919177 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f782c06b270 msgr2=0x7f782c155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:25.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f783351d640 1 --2- 172.21.15.28:0/2588919177 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f782c06b270 0x7f782c155240 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7828009870 tx=0x7f782801c470 comp rx=0 tx=0).stop 2023-12-16T03:28:25.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f783351d640 1 -- 172.21.15.28:0/2588919177 shutdown_connections 2023-12-16T03:28:25.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f783351d640 1 --2- 172.21.15.28:0/2588919177 >> v2:172.21.15.134:3300/0 conn(0x7f782c0c8540 0x7f782c151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:25.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f783351d640 1 --2- 172.21.15.28:0/2588919177 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f782c06b270 0x7f782c155240 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:25.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f783351d640 1 -- 172.21.15.28:0/2588919177 >> 172.21.15.28:0/2588919177 conn(0x7f782c0ca100 msgr2=0x7f782c0ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:25.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f783351d640 1 -- 172.21.15.28:0/2588919177 shutdown_connections 2023-12-16T03:28:25.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.282+0000 7f783351d640 1 -- 172.21.15.28:0/2588919177 wait complete. 2023-12-16T03:28:25.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f783351d640 1 Processor -- start 2023-12-16T03:28:25.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f783351d640 1 -- start start 2023-12-16T03:28:25.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f783351d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f782c06b270 0x7f782c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:25.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f783351d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f782c0c6310 0x7f782c14b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:25.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f783351d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f782c0c8540 0x7f782c14b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:25.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f783351d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c155fe0 con 0x7f782c06b270 2023-12-16T03:28:25.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f783351d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c158bf0 con 0x7f782c0c8540 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f783351d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c1561f0 con 0x7f782c0c6310 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f78312b9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f782c06b270 0x7f782c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f78312b9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f782c06b270 0x7f782c155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47368/0 (socket says 172.21.15.28:47368) 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f78312b9640 1 -- 172.21.15.28:0/1159438069 learned_addr learned my addr 172.21.15.28:0/1159438069 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f7831aba640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f782c0c8540 0x7f782c14b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f7830ab8640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f782c0c6310 0x7f782c14b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f78312b9640 1 -- 172.21.15.28:0/1159438069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f782c0c6310 msgr2=0x7f782c14b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f78312b9640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f782c0c6310 0x7f782c14b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f78312b9640 1 -- 172.21.15.28:0/1159438069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f782c0c8540 msgr2=0x7f782c14b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f78312b9640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f782c0c8540 0x7f782c14b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f78312b9640 1 -- 172.21.15.28:0/1159438069 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78280094d0 con 0x7f782c06b270 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f7830ab8640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f782c0c6310 0x7f782c14b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:25.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f78312b9640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f782c06b270 0x7f782c155aa0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f78280ae040 tx=0x7f7828019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:25.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f7821ffb640 1 -- 172.21.15.28:0/1159438069 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280b4420 con 0x7f782c06b270 2023-12-16T03:28:25.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f7821ffb640 1 -- 172.21.15.28:0/1159438069 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280b4580 con 0x7f782c06b270 2023-12-16T03:28:25.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f7821ffb640 1 -- 172.21.15.28:0/1159438069 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280b4930 con 0x7f782c06b270 2023-12-16T03:28:25.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f783351d640 1 -- 172.21.15.28:0/1159438069 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c14af70 con 0x7f782c06b270 2023-12-16T03:28:25.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.286+0000 7f783351d640 1 -- 172.21.15.28:0/1159438069 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c0adc30 con 0x7f782c06b270 2023-12-16T03:28:25.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.290+0000 7f783351d640 1 -- 172.21.15.28:0/1159438069 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c04e850 con 0x7f782c06b270 2023-12-16T03:28:25.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.290+0000 7f7821ffb640 1 -- 172.21.15.28:0/1159438069 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f78280b2070 con 0x7f782c06b270 2023-12-16T03:28:25.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.290+0000 7f7821ffb640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7810066470 0x7f7810068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:25.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.290+0000 7f7821ffb640 1 -- 172.21.15.28:0/1159438069 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f782811dd60 con 0x7f782c06b270 2023-12-16T03:28:25.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.290+0000 7f7830ab8640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7810066470 0x7f7810068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:25.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.290+0000 7f7830ab8640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7810066470 0x7f7810068930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f782c14c670 tx=0x7f781c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:25.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.294+0000 7f7821ffb640 1 -- 172.21.15.28:0/1159438069 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f78280eaf10 con 0x7f782c06b270 2023-12-16T03:28:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.486+0000 7f783351d640 1 -- 172.21.15.28:0/1159438069 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f782c068400 con 0x7f782c06b270 2023-12-16T03:28:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.486+0000 7f7821ffb640 1 -- 172.21.15.28:0/1159438069 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7f78280ee530 con 0x7f782c06b270 2023-12-16T03:28:25.493 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:28:25.493 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-16T03:28:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 -- 172.21.15.28:0/1159438069 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7810066470 msgr2=0x7f7810068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7810066470 0x7f7810068930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f782c14c670 tx=0x7f781c009040 comp rx=0 tx=0).stop 2023-12-16T03:28:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 -- 172.21.15.28:0/1159438069 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f782c06b270 msgr2=0x7f782c155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f782c06b270 0x7f782c155aa0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f78280ae040 tx=0x7f7828019210 comp rx=0 tx=0).stop 2023-12-16T03:28:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 -- 172.21.15.28:0/1159438069 shutdown_connections 2023-12-16T03:28:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f782c0c8540 0x7f782c14b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f782c0c6310 0x7f782c14b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7810066470 0x7f7810068930 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 --2- 172.21.15.28:0/1159438069 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f782c06b270 0x7f782c155aa0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 -- 172.21.15.28:0/1159438069 >> 172.21.15.28:0/1159438069 conn(0x7f782c0ca100 msgr2=0x7f782c14e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 -- 172.21.15.28:0/1159438069 shutdown_connections 2023-12-16T03:28:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:25.490+0000 7f783351d640 1 -- 172.21.15.28:0/1159438069 wait complete. 2023-12-16T03:28:25.513 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-16T03:28:25.514 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:28:25.514 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2023-12-16T03:28:25.514 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-16T03:28:25.514 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-16T03:28:25.514 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-16T03:28:25.514 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:28:25.514 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.cLk6fq0sXx 2023-12-16T03:28:25.514 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2023-12-16T03:28:25.523 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.zxNFEsYaxI 2023-12-16T03:28:25.523 DEBUG:teuthology.orchestra.run.smithi028:> sudo cp /tmp/tmp.cLk6fq0sXx /tmp/tmp.zxNFEsYaxI 2023-12-16T03:28:25.586 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.zxNFEsYaxI 2023-12-16T03:28:25.705 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.zxNFEsYaxI is 226B 2023-12-16T03:28:25.723 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.zxNFEsYaxI 2023-12-16T03:28:25.733 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBVGX1lwB4fNhAAjayc1Li38MQXtxCV86dMRg== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-16T03:28:25.733 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:28:25.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:25.733 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2023-12-16T03:28:25.786 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:28:25.786 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:28:25.786 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:28:25.786 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:25.786 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2023-12-16T03:28:25.786 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:25.786 INFO:teuthology.orchestra.run.smithi028.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:25.786 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:25.786 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2023-12-16T03:28:25.786 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:25.786 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42200sec preferred_lft 42200sec 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:28:25.787 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:9f:0c:41:28 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:28:25.788 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:25.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:25.789 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:28:25.847 INFO:teuthology.orchestra.run.smithi028.stdout:1 2023-12-16T03:28:25.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:25.850 DEBUG:teuthology.orchestra.run.smithi028:> route 2023-12-16T03:28:25.902 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2023-12-16T03:28:25.903 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:28:25.903 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-16T03:28:25.903 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:28:25.903 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-16T03:28:25.903 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:28:25.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:25.903 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec bash -c ' 2023-12-16T03:28:25.903 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2023-12-16T03:28:25.903 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-16T03:28:25.903 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-16T03:28:25.903 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-16T03:28:25.904 DEBUG:teuthology.orchestra.run.smithi028:> ') 2023-12-16T03:28:25.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:25.997 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2023-12-16T03:28:26.007 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T03:28:26.007 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:28:26.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:26.008 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2023-12-16T03:28:26.070 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:28:26.070 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-16T03:28:26.125 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-16T03:28:26.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:28:26.125 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:28:26.176 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:26.176 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/tmp/tmp.cLk6fq0sXx of=/dev/stdout 2023-12-16T03:28:26.233 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs=/ 2023-12-16T03:28:26.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:26.233 DEBUG:teuthology.orchestra.run.smithi028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQBVGX1lwB4fNhAAjayc1Li38MQXtxCV86dMRg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:26.332 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,secret=AQBVGX1lwB4fNhAAjayc1Li38MQXtxCV86dMRg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:26.333 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:28:26.333 INFO:teuthology.orchestra.run.smithi028.stdout:keyring.get_secret failed 2023-12-16T03:28:26.346 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,secret=AQBVGX1lwB4fNhAAjayc1Li38MQXtxCV86dMRg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:26.346 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:28:26.346 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:28:26.346 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: trying mount with new device syntax: testuser@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs=/ 2023-12-16T03:28:26.346 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:28:26.350 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:28:26.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:26.350 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-16T03:28:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2023-12-16T03:28:26.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:28:26.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:26.371 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:28:26.428 INFO:teuthology.orchestra.run.smithi028.stdout:client6867 2023-12-16T03:28:26.428 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:26.428 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:26.477 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2023-12-16T03:28:26.487 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.FKrwxPAgeu 2023-12-16T03:28:26.487 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:26.487 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/tmp/tmp.FKrwxPAgeu 2023-12-16T03:28:26.541 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:26.541 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:26.598 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:26.598 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:26.653 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.794+0000 7f201de67640 1 Processor -- start 2023-12-16T03:28:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.794+0000 7f201de67640 1 -- start start 2023-12-16T03:28:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f201de67640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f201814e2a0 0x7f20180723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f201de67640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f20181515a0 0x7f201806ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f201de67640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20180c4bf0 con 0x7f201806c9f0 2023-12-16T03:28:26.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f201de67640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201814e680 con 0x7f20181515a0 2023-12-16T03:28:26.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f201de67640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20181509d0 con 0x7f201814e2a0 2023-12-16T03:28:26.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f2017fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f201806c9f0 0x7f2018150e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37588/0 (socket says 172.21.15.28:37588) 2023-12-16T03:28:26.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f2017fff640 1 -- 172.21.15.28:0/1626490384 learned_addr learned my addr 172.21.15.28:0/1626490384 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:26.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f201d666640 1 --2- 172.21.15.28:0/1626490384 >> v2:172.21.15.134:3300/0 conn(0x7f20181515a0 0x7f201806ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:26.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f201ce65640 1 --2- 172.21.15.28:0/1626490384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f201814e2a0 0x7f20180723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:26.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f20177fe640 1 -- 172.21.15.28:0/1626490384 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992415206 0 0) 0x7f20180c4bf0 con 0x7f201806c9f0 2023-12-16T03:28:26.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f20177fe640 1 -- 172.21.15.28:0/1626490384 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2008005740 con 0x7f201806c9f0 2023-12-16T03:28:26.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f201ce65640 1 -- 172.21.15.28:0/1626490384 >> v2:172.21.15.134:3300/0 conn(0x7f20181515a0 msgr2=0x7f201806ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:26.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f201ce65640 1 --2- 172.21.15.28:0/1626490384 >> v2:172.21.15.134:3300/0 conn(0x7f20181515a0 0x7f201806ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:26.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f20177fe640 1 -- 172.21.15.28:0/1626490384 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2349548417 0 0) 0x7f2008005740 con 0x7f201806c9f0 2023-12-16T03:28:26.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f201ce65640 1 -- 172.21.15.28:0/1626490384 >> v1:172.21.15.28:6789/0 conn(0x7f201806c9f0 legacy=0x7f2018150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:26.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.798+0000 7f201ce65640 1 -- 172.21.15.28:0/1626490384 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20180c0450 con 0x7f201814e2a0 2023-12-16T03:28:26.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f201ce65640 1 --2- 172.21.15.28:0/1626490384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f201814e2a0 0x7f20180723f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f200c0097c0 tx=0x7f200c01c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2551471f611b79a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:26.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f20177fe640 1 -- 172.21.15.28:0/1626490384 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004001680 con 0x7f201814e2a0 2023-12-16T03:28:26.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f20177fe640 1 -- 172.21.15.28:0/1626490384 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c0a7050 con 0x7f201814e2a0 2023-12-16T03:28:26.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f20177fe640 1 -- 172.21.15.28:0/1626490384 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0ab620 con 0x7f201814e2a0 2023-12-16T03:28:26.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f201de67640 1 -- 172.21.15.28:0/1626490384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f201814e2a0 msgr2=0x7f20180723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:26.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f201de67640 1 --2- 172.21.15.28:0/1626490384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f201814e2a0 0x7f20180723f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f200c0097c0 tx=0x7f200c01c2e0 comp rx=0 tx=0).stop 2023-12-16T03:28:26.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f201de67640 1 -- 172.21.15.28:0/1626490384 shutdown_connections 2023-12-16T03:28:26.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f201de67640 1 --2- 172.21.15.28:0/1626490384 >> v2:172.21.15.134:3300/0 conn(0x7f20181515a0 0x7f201806ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:26.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f201de67640 1 --2- 172.21.15.28:0/1626490384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f201814e2a0 0x7f20180723f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:26.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f201de67640 1 -- 172.21.15.28:0/1626490384 >> 172.21.15.28:0/1626490384 conn(0x7f20180a7800 msgr2=0x7f20180a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:26.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f201de67640 1 -- 172.21.15.28:0/1626490384 shutdown_connections 2023-12-16T03:28:26.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f201de67640 1 -- 172.21.15.28:0/1626490384 wait complete. 2023-12-16T03:28:26.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f201de67640 1 Processor -- start 2023-12-16T03:28:26.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.802+0000 7f201de67640 1 -- start start 2023-12-16T03:28:26.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201de67640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f201806c9f0 0x7f20181ebad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:26.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201de67640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f201814e2a0 0x7f20181e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:26.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201de67640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20181515a0 0x7f20181e6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:26.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201de67640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20181557a0 con 0x7f201806c9f0 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201de67640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2018153f70 con 0x7f201814e2a0 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201de67640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20181ec560 con 0x7f20181515a0 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201ce65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f201806c9f0 0x7f20181ebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201ce65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f201806c9f0 0x7f20181ebad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47380/0 (socket says 172.21.15.28:47380) 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201ce65640 1 -- 172.21.15.28:0/1871353127 learned_addr learned my addr 172.21.15.28:0/1871353127 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f2017fff640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f201814e2a0 0x7f20181e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201d666640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20181515a0 0x7f20181e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201ce65640 1 -- 172.21.15.28:0/1871353127 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20181515a0 msgr2=0x7f20181e6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201ce65640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20181515a0 0x7f20181e6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201ce65640 1 -- 172.21.15.28:0/1871353127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f201814e2a0 msgr2=0x7f20181e62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201ce65640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f201814e2a0 0x7f20181e62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201ce65640 1 -- 172.21.15.28:0/1871353127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c009420 con 0x7f201806c9f0 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201d666640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20181515a0 0x7f20181e6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:26.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f2017fff640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f201814e2a0 0x7f20181e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:26.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201ce65640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f201806c9f0 0x7f20181ebad0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f200c01a990 tx=0x7f200c01ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:26.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f20157fa640 1 -- 172.21.15.28:0/1871353127 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0b7450 con 0x7f201806c9f0 2023-12-16T03:28:26.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f20157fa640 1 -- 172.21.15.28:0/1871353127 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c0b75d0 con 0x7f201806c9f0 2023-12-16T03:28:26.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f20157fa640 1 -- 172.21.15.28:0/1871353127 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0b7980 con 0x7f201806c9f0 2023-12-16T03:28:26.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201de67640 1 -- 172.21.15.28:0/1871353127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2018153920 con 0x7f201806c9f0 2023-12-16T03:28:26.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201de67640 1 -- 172.21.15.28:0/1871353127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2018155240 con 0x7f201806c9f0 2023-12-16T03:28:26.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f201de67640 1 -- 172.21.15.28:0/1871353127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201804e850 con 0x7f201806c9f0 2023-12-16T03:28:26.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.806+0000 7f20157fa640 1 -- 172.21.15.28:0/1871353127 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f200c0b7ae0 con 0x7f201806c9f0 2023-12-16T03:28:26.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.810+0000 7f20157fa640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ffc066470 0x7f1ffc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:26.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.810+0000 7f20157fa640 1 -- 172.21.15.28:0/1871353127 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f200c11ea10 con 0x7f201806c9f0 2023-12-16T03:28:26.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.810+0000 7f2017fff640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ffc066470 0x7f1ffc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:26.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.810+0000 7f2017fff640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ffc066470 0x7f1ffc068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f20180a8b30 tx=0x7f2004009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:26.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.814+0000 7f20157fa640 1 -- 172.21.15.28:0/1871353127 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f200c0ebc40 con 0x7f201806c9f0 2023-12-16T03:28:26.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.970+0000 7f201de67640 1 -- 172.21.15.28:0/1871353127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20180c5170 con 0x7f201806c9f0 2023-12-16T03:28:26.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f20157fa640 1 -- 172.21.15.28:0/1871353127 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20214 (secure 0 0 0) 0x7f200c0bb090 con 0x7f201806c9f0 2023-12-16T03:28:26.978 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:26.978 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:13.793649+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:26.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 -- 172.21.15.28:0/1871353127 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ffc066470 msgr2=0x7f1ffc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ffc066470 0x7f1ffc068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f20180a8b30 tx=0x7f2004009040 comp rx=0 tx=0).stop 2023-12-16T03:28:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 -- 172.21.15.28:0/1871353127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f201806c9f0 msgr2=0x7f20181ebad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f201806c9f0 0x7f20181ebad0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f200c01a990 tx=0x7f200c01ab20 comp rx=0 tx=0).stop 2023-12-16T03:28:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 -- 172.21.15.28:0/1871353127 shutdown_connections 2023-12-16T03:28:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20181515a0 0x7f20181e6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f201814e2a0 0x7f20181e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1ffc066470 0x7f1ffc068930 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 --2- 172.21.15.28:0/1871353127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f201806c9f0 0x7f20181ebad0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 -- 172.21.15.28:0/1871353127 >> 172.21.15.28:0/1871353127 conn(0x7f20180a7800 msgr2=0x7f2018150e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 -- 172.21.15.28:0/1871353127 shutdown_connections 2023-12-16T03:28:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:26.974+0000 7f201de67640 1 -- 172.21.15.28:0/1871353127 wait complete. 2023-12-16T03:28:26.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:27:56.894984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:27:58.090972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:28:10.280019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:28:11.167317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:28:26.999 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:28:27.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.138+0000 7f8a4f3aa640 1 Processor -- start 2023-12-16T03:28:27.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4f3aa640 1 -- start start 2023-12-16T03:28:27.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4f3aa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8a4814b010 0x7f8a480bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4f3aa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8a48073a70 0x7f8a4806b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4f3aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a4806b540 0x7f8a48157c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4f3aa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4806a5b0 con 0x7f8a4814b010 2023-12-16T03:28:27.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4f3aa640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a480c1d60 con 0x7f8a48073a70 2023-12-16T03:28:27.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4f3aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480c2040 con 0x7f8a4806b540 2023-12-16T03:28:27.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4d146640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8a4814b010 0x7f8a480bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4d146640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8a4814b010 0x7f8a480bf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47384/0 (socket says 172.21.15.28:47384) 2023-12-16T03:28:27.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4d146640 1 -- 172.21.15.28:0/1134595396 learned_addr learned my addr 172.21.15.28:0/1134595396 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:27.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4c945640 1 --2- 172.21.15.28:0/1134595396 >> v2:172.21.15.134:3300/0 conn(0x7f8a48073a70 0x7f8a4806b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4d947640 1 --2- 172.21.15.28:0/1134595396 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a4806b540 0x7f8a48157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4d146640 1 -- 172.21.15.28:0/1134595396 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a4806b540 msgr2=0x7f8a48157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:27.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4d146640 1 --2- 172.21.15.28:0/1134595396 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a4806b540 0x7f8a48157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4d146640 1 -- 172.21.15.28:0/1134595396 >> v2:172.21.15.134:3300/0 conn(0x7f8a48073a70 msgr2=0x7f8a4806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:27.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4d146640 1 --2- 172.21.15.28:0/1134595396 >> v2:172.21.15.134:3300/0 conn(0x7f8a48073a70 0x7f8a4806b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4d146640 1 -- 172.21.15.28:0/1134595396 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4806a800 con 0x7f8a4814b010 2023-12-16T03:28:27.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.142+0000 7f8a4c945640 1 --2- 172.21.15.28:0/1134595396 >> v2:172.21.15.134:3300/0 conn(0x7f8a48073a70 0x7f8a4806b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:27.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4d146640 1 --2- 172.21.15.28:0/1134595396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a4814b010 0x7f8a480bf9f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f8a4804ede0 tx=0x7f8a4401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e712fd8c833fef46 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:27.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a3ffff640 1 -- 172.21.15.28:0/1134595396 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440a89b0 con 0x7f8a4814b010 2023-12-16T03:28:27.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a3ffff640 1 -- 172.21.15.28:0/1134595396 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a440a8b10 con 0x7f8a4814b010 2023-12-16T03:28:27.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a3ffff640 1 -- 172.21.15.28:0/1134595396 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440a8ea0 con 0x7f8a4814b010 2023-12-16T03:28:27.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/1134595396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a4814b010 msgr2=0x7f8a480bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4f3aa640 1 --2- 172.21.15.28:0/1134595396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a4814b010 0x7f8a480bf9f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f8a4804ede0 tx=0x7f8a4401ecf0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/1134595396 shutdown_connections 2023-12-16T03:28:27.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4f3aa640 1 --2- 172.21.15.28:0/1134595396 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a4806b540 0x7f8a48157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4f3aa640 1 --2- 172.21.15.28:0/1134595396 >> v2:172.21.15.134:3300/0 conn(0x7f8a48073a70 0x7f8a4806b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4f3aa640 1 --2- 172.21.15.28:0/1134595396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a4814b010 0x7f8a480bf9f0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/1134595396 >> 172.21.15.28:0/1134595396 conn(0x7f8a480c30c0 msgr2=0x7f8a480c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:27.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/1134595396 shutdown_connections 2023-12-16T03:28:27.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/1134595396 wait complete. 2023-12-16T03:28:27.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4f3aa640 1 Processor -- start 2023-12-16T03:28:27.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.146+0000 7f8a4f3aa640 1 -- start start 2023-12-16T03:28:27.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4f3aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48073a70 0x7f8a481ed220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4f3aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a4814b010 0x7f8a4814eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4f3aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a481551b0 0x7f8a481507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4f3aa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a481eda50 con 0x7f8a48073a70 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4f3aa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a481edd30 con 0x7f8a4814b010 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4f3aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a481ee010 con 0x7f8a481551b0 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4d146640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48073a70 0x7f8a481ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4d146640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48073a70 0x7f8a481ed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47400/0 (socket says 172.21.15.28:47400) 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4d146640 1 -- 172.21.15.28:0/534175464 learned_addr learned my addr 172.21.15.28:0/534175464 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4d947640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a481551b0 0x7f8a481507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4c945640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a4814b010 0x7f8a4814eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4d146640 1 -- 172.21.15.28:0/534175464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a481551b0 msgr2=0x7f8a481507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4d146640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a481551b0 0x7f8a481507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4d146640 1 -- 172.21.15.28:0/534175464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a4814b010 msgr2=0x7f8a4814eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4d146640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a4814b010 0x7f8a4814eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4d146640 1 -- 172.21.15.28:0/534175464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a440094d0 con 0x7f8a48073a70 2023-12-16T03:28:27.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4c945640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a4814b010 0x7f8a4814eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:27.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4d947640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a481551b0 0x7f8a481507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:27.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4d146640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48073a70 0x7f8a481ed220 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8a4401d3a0 tx=0x7f8a4401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:27.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a3dffb640 1 -- 172.21.15.28:0/534175464 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440ba600 con 0x7f8a48073a70 2023-12-16T03:28:27.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a3dffb640 1 -- 172.21.15.28:0/534175464 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a440ba760 con 0x7f8a48073a70 2023-12-16T03:28:27.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a3dffb640 1 -- 172.21.15.28:0/534175464 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440bab10 con 0x7f8a48073a70 2023-12-16T03:28:27.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/534175464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a48155cf0 con 0x7f8a48073a70 2023-12-16T03:28:27.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/534175464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a481ed760 con 0x7f8a48073a70 2023-12-16T03:28:27.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.150+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/534175464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a48156210 con 0x7f8a48073a70 2023-12-16T03:28:27.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.154+0000 7f8a3dffb640 1 -- 172.21.15.28:0/534175464 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8a440bac70 con 0x7f8a48073a70 2023-12-16T03:28:27.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.154+0000 7f8a3dffb640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8a2c066470 0x7f8a2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.154+0000 7f8a3dffb640 1 -- 172.21.15.28:0/534175464 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8a44122850 con 0x7f8a48073a70 2023-12-16T03:28:27.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.154+0000 7f8a4c945640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8a2c066470 0x7f8a2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.154+0000 7f8a4c945640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8a2c066470 0x7f8a2c068930 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8a48145a60 tx=0x7f8a38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:27.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.158+0000 7f8a3dffb640 1 -- 172.21.15.28:0/534175464 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8a48156210 con 0x7f8a48073a70 2023-12-16T03:28:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.314+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/534175464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a48156210 con 0x7f8a48073a70 2023-12-16T03:28:27.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.314+0000 7f8a3dffb640 1 -- 172.21.15.28:0/534175464 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a440ef9f0 con 0x7f8a48073a70 2023-12-16T03:28:27.319 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:28:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/534175464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8a2c066470 msgr2=0x7f8a2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8a2c066470 0x7f8a2c068930 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8a48145a60 tx=0x7f8a38008040 comp rx=0 tx=0).stop 2023-12-16T03:28:27.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/534175464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48073a70 msgr2=0x7f8a481ed220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48073a70 0x7f8a481ed220 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8a4401d3a0 tx=0x7f8a4401ba90 comp rx=0 tx=0).stop 2023-12-16T03:28:27.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/534175464 shutdown_connections 2023-12-16T03:28:27.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8a481551b0 0x7f8a481507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a4814b010 0x7f8a4814eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f8a2c066470 0x7f8a2c068930 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 --2- 172.21.15.28:0/534175464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8a48073a70 0x7f8a481ed220 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/534175464 >> 172.21.15.28:0/534175464 conn(0x7f8a480c30c0 msgr2=0x7f8a481494c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:27.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/534175464 shutdown_connections 2023-12-16T03:28:27.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.318+0000 7f8a4f3aa640 1 -- 172.21.15.28:0/534175464 wait complete. 2023-12-16T03:28:27.340 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:28:27.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b7771d640 1 Processor -- start 2023-12-16T03:28:27.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b7771d640 1 -- start start 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b7771d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6b70152030 0x7f6b700c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b7771d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6b7006c470 0x7f6b70157c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b7771d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b70154ff0 0x7f6b700c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b7771d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b70152410 con 0x7f6b7006c470 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b7771d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b70154b60 con 0x7f6b70152030 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b7771d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700c1820 con 0x7f6b70154ff0 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b74cb8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6b7006c470 0x7f6b70157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b74cb8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6b7006c470 0x7f6b70157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47402/0 (socket says 172.21.15.28:47402) 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b74cb8640 1 -- 172.21.15.28:0/3759957274 learned_addr learned my addr 172.21.15.28:0/3759957274 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b75cba640 1 --2- 172.21.15.28:0/3759957274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b70154ff0 0x7f6b700c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b754b9640 1 --2- 172.21.15.28:0/3759957274 >> v2:172.21.15.134:3300/0 conn(0x7f6b70152030 0x7f6b700c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b74cb8640 1 -- 172.21.15.28:0/3759957274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b70154ff0 msgr2=0x7f6b700c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b74cb8640 1 --2- 172.21.15.28:0/3759957274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b70154ff0 0x7f6b700c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b74cb8640 1 -- 172.21.15.28:0/3759957274 >> v2:172.21.15.134:3300/0 conn(0x7f6b70152030 msgr2=0x7f6b700c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b74cb8640 1 --2- 172.21.15.28:0/3759957274 >> v2:172.21.15.134:3300/0 conn(0x7f6b70152030 0x7f6b700c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b74cb8640 1 -- 172.21.15.28:0/3759957274 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b700c1260 con 0x7f6b7006c470 2023-12-16T03:28:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.482+0000 7f6b75cba640 1 --2- 172.21.15.28:0/3759957274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b70154ff0 0x7f6b700c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b754b9640 1 --2- 172.21.15.28:0/3759957274 >> v2:172.21.15.134:3300/0 conn(0x7f6b70152030 0x7f6b700c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:27.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b74cb8640 1 --2- 172.21.15.28:0/3759957274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b7006c470 0x7f6b70157c90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f6b70067d90 tx=0x7f6b6001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33322295f431792c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:27.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b67fff640 1 -- 172.21.15.28:0/3759957274 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600a7070 con 0x7f6b7006c470 2023-12-16T03:28:27.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b67fff640 1 -- 172.21.15.28:0/3759957274 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b600ab430 con 0x7f6b7006c470 2023-12-16T03:28:27.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b67fff640 1 -- 172.21.15.28:0/3759957274 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600ab7c0 con 0x7f6b7006c470 2023-12-16T03:28:27.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b7771d640 1 -- 172.21.15.28:0/3759957274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b7006c470 msgr2=0x7f6b70157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b7771d640 1 --2- 172.21.15.28:0/3759957274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b7006c470 0x7f6b70157c90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f6b70067d90 tx=0x7f6b6001c470 comp rx=0 tx=0).stop 2023-12-16T03:28:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b7771d640 1 -- 172.21.15.28:0/3759957274 shutdown_connections 2023-12-16T03:28:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b7771d640 1 --2- 172.21.15.28:0/3759957274 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b70154ff0 0x7f6b700c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b7771d640 1 --2- 172.21.15.28:0/3759957274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b7006c470 0x7f6b70157c90 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b7771d640 1 --2- 172.21.15.28:0/3759957274 >> v2:172.21.15.134:3300/0 conn(0x7f6b70152030 0x7f6b700c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b7771d640 1 -- 172.21.15.28:0/3759957274 >> 172.21.15.28:0/3759957274 conn(0x7f6b7006a5b0 msgr2=0x7f6b7006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b7771d640 1 -- 172.21.15.28:0/3759957274 shutdown_connections 2023-12-16T03:28:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.486+0000 7f6b7771d640 1 -- 172.21.15.28:0/3759957274 wait complete. 2023-12-16T03:28:27.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b7771d640 1 Processor -- start 2023-12-16T03:28:27.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b7771d640 1 -- start start 2023-12-16T03:28:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b7771d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b7006c470 0x7f6b70070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b7771d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b70152030 0x7f6b70141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b7771d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b70154ff0 0x7f6b701ede80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b7771d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700718c0 con 0x7f6b70154ff0 2023-12-16T03:28:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b7771d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b70070890 con 0x7f6b70152030 2023-12-16T03:28:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b7771d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b70072940 con 0x7f6b7006c470 2023-12-16T03:28:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b75cba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b70154ff0 0x7f6b701ede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b75cba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b70154ff0 0x7f6b701ede80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47408/0 (socket says 172.21.15.28:47408) 2023-12-16T03:28:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b75cba640 1 -- 172.21.15.28:0/2943434886 learned_addr learned my addr 172.21.15.28:0/2943434886 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b754b9640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b7006c470 0x7f6b70070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b75cba640 1 -- 172.21.15.28:0/2943434886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b7006c470 msgr2=0x7f6b70070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b74cb8640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b70152030 0x7f6b70141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b75cba640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b7006c470 0x7f6b70070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b75cba640 1 -- 172.21.15.28:0/2943434886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b70152030 msgr2=0x7f6b70141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b75cba640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b70152030 0x7f6b70141840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b75cba640 1 -- 172.21.15.28:0/2943434886 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600094d0 con 0x7f6b70154ff0 2023-12-16T03:28:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b754b9640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b7006c470 0x7f6b70070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b74cb8640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b70152030 0x7f6b70141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b75cba640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b70154ff0 0x7f6b701ede80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800cd50 tx=0x7f6b6800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:27.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b65ffb640 1 -- 172.21.15.28:0/2943434886 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800f680 con 0x7f6b70154ff0 2023-12-16T03:28:27.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b65ffb640 1 -- 172.21.15.28:0/2943434886 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6800f800 con 0x7f6b70154ff0 2023-12-16T03:28:27.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b7771d640 1 -- 172.21.15.28:0/2943434886 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b70072380 con 0x7f6b70154ff0 2023-12-16T03:28:27.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b65ffb640 1 -- 172.21.15.28:0/2943434886 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800fbb0 con 0x7f6b70154ff0 2023-12-16T03:28:27.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.490+0000 7f6b7771d640 1 -- 172.21.15.28:0/2943434886 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b701ed680 con 0x7f6b70154ff0 2023-12-16T03:28:27.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.494+0000 7f6b7771d640 1 -- 172.21.15.28:0/2943434886 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7006d540 con 0x7f6b70154ff0 2023-12-16T03:28:27.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.494+0000 7f6b65ffb640 1 -- 172.21.15.28:0/2943434886 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6b6800b040 con 0x7f6b70154ff0 2023-12-16T03:28:27.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.494+0000 7f6b65ffb640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b54066470 0x7f6b54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.494+0000 7f6b65ffb640 1 -- 172.21.15.28:0/2943434886 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6b68084b90 con 0x7f6b70154ff0 2023-12-16T03:28:27.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.494+0000 7f6b754b9640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b54066470 0x7f6b54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.494+0000 7f6b754b9640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b54066470 0x7f6b54068930 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c008930 tx=0x7f6b6c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:27.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.498+0000 7f6b65ffb640 1 -- 172.21.15.28:0/2943434886 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6b68051cb0 con 0x7f6b70154ff0 2023-12-16T03:28:27.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.654+0000 7f6b7771d640 1 -- 172.21.15.28:0/2943434886 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b701ed4e0 con 0x7f6b70154ff0 2023-12-16T03:28:27.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b65ffb640 1 -- 172.21.15.28:0/2943434886 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b701ed4e0 con 0x7f6b70154ff0 2023-12-16T03:28:27.661 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:27.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 -- 172.21.15.28:0/2943434886 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b54066470 msgr2=0x7f6b54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b54066470 0x7f6b54068930 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c008930 tx=0x7f6b6c008040 comp rx=0 tx=0).stop 2023-12-16T03:28:27.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 -- 172.21.15.28:0/2943434886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b70154ff0 msgr2=0x7f6b701ede80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b70154ff0 0x7f6b701ede80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800cd50 tx=0x7f6b6800a650 comp rx=0 tx=0).stop 2023-12-16T03:28:27.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 -- 172.21.15.28:0/2943434886 shutdown_connections 2023-12-16T03:28:27.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b54066470 0x7f6b54068930 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b70154ff0 0x7f6b701ede80 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b70152030 0x7f6b70141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 --2- 172.21.15.28:0/2943434886 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b7006c470 0x7f6b70070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 -- 172.21.15.28:0/2943434886 >> 172.21.15.28:0/2943434886 conn(0x7f6b7006a5b0 msgr2=0x7f6b701582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:27.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 -- 172.21.15.28:0/2943434886 shutdown_connections 2023-12-16T03:28:27.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.658+0000 7f6b7771d640 1 -- 172.21.15.28:0/2943434886 wait complete. 2023-12-16T03:28:27.682 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:28:27.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.826+0000 7f5c2846b640 1 Processor -- start 2023-12-16T03:28:27.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.826+0000 7f5c2846b640 1 -- start start 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.826+0000 7f5c2846b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c20151e90 0x7f5c200c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.826+0000 7f5c2846b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5c200c7ea0 0x7f5c2006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.826+0000 7f5c2846b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2006c860 con 0x7f5c200c4e60 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.826+0000 7f5c2846b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c200c8750 con 0x7f5c200c7ea0 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.826+0000 7f5c2846b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c201552d0 con 0x7f5c20151e90 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.826+0000 7f5c25a06640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5c200c7ea0 0x7f5c2006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.826+0000 7f5c25a06640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5c200c7ea0 0x7f5c2006b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47420/0 (socket says 172.21.15.28:47420) 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.826+0000 7f5c25a06640 1 -- 172.21.15.28:0/1574036444 learned_addr learned my addr 172.21.15.28:0/1574036444 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.826+0000 7f5c26207640 1 --2- 172.21.15.28:0/1574036444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c20151e90 0x7f5c200c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.830+0000 7f5c25a06640 1 -- 172.21.15.28:0/1574036444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c20151e90 msgr2=0x7f5c200c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.830+0000 7f5c25a06640 1 --2- 172.21.15.28:0/1574036444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c20151e90 0x7f5c200c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.830+0000 7f5c25a06640 1 -- 172.21.15.28:0/1574036444 >> v1:172.21.15.134:6789/0 conn(0x7f5c200c4e60 legacy=0x7f5c2006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.830+0000 7f5c25a06640 1 -- 172.21.15.28:0/1574036444 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c20154930 con 0x7f5c200c7ea0 2023-12-16T03:28:27.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.830+0000 7f5c26207640 1 --2- 172.21.15.28:0/1574036444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c20151e90 0x7f5c200c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:27.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.830+0000 7f5c25a06640 1 --2- 172.21.15.28:0/1574036444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c200c7ea0 0x7f5c2006b4a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009870 tx=0x7f5c1001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde006fe865a179d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:27.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.830+0000 7f5c25205640 1 -- 172.21.15.28:0/1574036444 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c100ab600 con 0x7f5c200c7ea0 2023-12-16T03:28:27.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.830+0000 7f5c25205640 1 -- 172.21.15.28:0/1574036444 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c100a7050 con 0x7f5c200c7ea0 2023-12-16T03:28:27.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.830+0000 7f5c25205640 1 -- 172.21.15.28:0/1574036444 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c100ab980 con 0x7f5c200c7ea0 2023-12-16T03:28:27.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.830+0000 7f5c2846b640 1 -- 172.21.15.28:0/1574036444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c200c7ea0 msgr2=0x7f5c2006b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.830+0000 7f5c2846b640 1 --2- 172.21.15.28:0/1574036444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c200c7ea0 0x7f5c2006b4a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009870 tx=0x7f5c1001c420 comp rx=0 tx=0).stop 2023-12-16T03:28:27.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 -- 172.21.15.28:0/1574036444 shutdown_connections 2023-12-16T03:28:27.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 --2- 172.21.15.28:0/1574036444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c200c7ea0 0x7f5c2006b4a0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 --2- 172.21.15.28:0/1574036444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c20151e90 0x7f5c200c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 -- 172.21.15.28:0/1574036444 >> 172.21.15.28:0/1574036444 conn(0x7f5c200ca170 msgr2=0x7f5c200ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:27.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 -- 172.21.15.28:0/1574036444 shutdown_connections 2023-12-16T03:28:27.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 -- 172.21.15.28:0/1574036444 wait complete. 2023-12-16T03:28:27.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 Processor -- start 2023-12-16T03:28:27.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 -- start start 2023-12-16T03:28:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c200c4e60 0x7f5c200c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c200c7ea0 0x7f5c20158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c20151e90 0x7f5c201587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c200abe90 con 0x7f5c200c7ea0 2023-12-16T03:28:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c201f04d0 con 0x7f5c20151e90 2023-12-16T03:28:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c2846b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c200abaf0 con 0x7f5c200c4e60 2023-12-16T03:28:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c25a06640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c200c7ea0 0x7f5c20158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c25a06640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c200c7ea0 0x7f5c20158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47434/0 (socket says 172.21.15.28:47434) 2023-12-16T03:28:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c25a06640 1 -- 172.21.15.28:0/222663633 learned_addr learned my addr 172.21.15.28:0/222663633 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:27.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c26207640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c200c4e60 0x7f5c200c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c26a08640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c20151e90 0x7f5c201587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c25a06640 1 -- 172.21.15.28:0/222663633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c200c4e60 msgr2=0x7f5c200c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c25a06640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c200c4e60 0x7f5c200c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c25a06640 1 -- 172.21.15.28:0/222663633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c20151e90 msgr2=0x7f5c201587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:27.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c25a06640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c20151e90 0x7f5c201587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:27.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.834+0000 7f5c25a06640 1 -- 172.21.15.28:0/222663633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100094d0 con 0x7f5c200c7ea0 2023-12-16T03:28:27.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.838+0000 7f5c25a06640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c200c7ea0 0x7f5c20158290 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f5c1001aad0 tx=0x7f5c100191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:27.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.838+0000 7f5c16ffd640 1 -- 172.21.15.28:0/222663633 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c100b4420 con 0x7f5c200c7ea0 2023-12-16T03:28:27.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.838+0000 7f5c16ffd640 1 -- 172.21.15.28:0/222663633 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c100b4580 con 0x7f5c200c7ea0 2023-12-16T03:28:27.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.838+0000 7f5c2846b640 1 -- 172.21.15.28:0/222663633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c200a9d00 con 0x7f5c200c7ea0 2023-12-16T03:28:27.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.838+0000 7f5c16ffd640 1 -- 172.21.15.28:0/222663633 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c100b4930 con 0x7f5c200c7ea0 2023-12-16T03:28:27.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.838+0000 7f5c2846b640 1 -- 172.21.15.28:0/222663633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2014e430 con 0x7f5c200c7ea0 2023-12-16T03:28:27.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.838+0000 7f5c2846b640 1 -- 172.21.15.28:0/222663633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c200c4c30 con 0x7f5c200c7ea0 2023-12-16T03:28:27.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.838+0000 7f5c16ffd640 1 -- 172.21.15.28:0/222663633 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5c100b2070 con 0x7f5c200c7ea0 2023-12-16T03:28:27.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.838+0000 7f5c16ffd640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c04066470 0x7f5c04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:27.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.838+0000 7f5c16ffd640 1 -- 172.21.15.28:0/222663633 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5c1011dd50 con 0x7f5c200c7ea0 2023-12-16T03:28:27.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.838+0000 7f5c26207640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c04066470 0x7f5c04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:27.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.842+0000 7f5c26207640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c04066470 0x7f5c04068930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009950 tx=0x7f5c1c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:27.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:27.842+0000 7f5c16ffd640 1 -- 172.21.15.28:0/222663633 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5c100eaf10 con 0x7f5c200c7ea0 2023-12-16T03:28:28.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.002+0000 7f5c2846b640 1 -- 172.21.15.28:0/222663633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c20068400 con 0x7f5c200c7ea0 2023-12-16T03:28:28.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c16ffd640 1 -- 172.21.15.28:0/222663633 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c100b0020 con 0x7f5c200c7ea0 2023-12-16T03:28:28.009 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:28.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 -- 172.21.15.28:0/222663633 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c04066470 msgr2=0x7f5c04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c04066470 0x7f5c04068930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009950 tx=0x7f5c1c008040 comp rx=0 tx=0).stop 2023-12-16T03:28:28.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 -- 172.21.15.28:0/222663633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c200c7ea0 msgr2=0x7f5c20158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c200c7ea0 0x7f5c20158290 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f5c1001aad0 tx=0x7f5c100191c0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 -- 172.21.15.28:0/222663633 shutdown_connections 2023-12-16T03:28:28.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c20151e90 0x7f5c201587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5c04066470 0x7f5c04068930 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c200c7ea0 0x7f5c20158290 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 --2- 172.21.15.28:0/222663633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c200c4e60 0x7f5c200c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 -- 172.21.15.28:0/222663633 >> 172.21.15.28:0/222663633 conn(0x7f5c200ca170 msgr2=0x7f5c2014b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:28.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 -- 172.21.15.28:0/222663633 shutdown_connections 2023-12-16T03:28:28.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.006+0000 7f5c2846b640 1 -- 172.21.15.28:0/222663633 wait complete. 2023-12-16T03:28:28.030 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:28:28.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.170+0000 7f3dda996640 1 Processor -- start 2023-12-16T03:28:28.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dda996640 1 -- start start 2023-12-16T03:28:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dda996640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dd40c5260 0x7f3dd406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dda996640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3dd4155de0 0x7f3dd4156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dda996640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd40c2580 con 0x7f3dd40c5640 2023-12-16T03:28:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dda996640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd4153510 con 0x7f3dd4155de0 2023-12-16T03:28:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dda996640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40c17f0 con 0x7f3dd40c5260 2023-12-16T03:28:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dd37fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3dd40c5640 0x7f3dd40c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37596/0 (socket says 172.21.15.28:37596) 2023-12-16T03:28:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dd37fe640 1 -- 172.21.15.28:0/3411664884 learned_addr learned my addr 172.21.15.28:0/3411664884 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dd8f33640 1 --2- 172.21.15.28:0/3411664884 >> v2:172.21.15.134:3300/0 conn(0x7f3dd4155de0 0x7f3dd4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dd3fff640 1 --2- 172.21.15.28:0/3411664884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dd40c5260 0x7f3dd406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dd2ffd640 1 -- 172.21.15.28:0/3411664884 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072635467 0 0) 0x7f3dd40c2580 con 0x7f3dd40c5640 2023-12-16T03:28:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dd2ffd640 1 -- 172.21.15.28:0/3411664884 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dbc003530 con 0x7f3dd40c5640 2023-12-16T03:28:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dd8f33640 1 -- 172.21.15.28:0/3411664884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dd40c5260 msgr2=0x7f3dd406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dd8f33640 1 --2- 172.21.15.28:0/3411664884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dd40c5260 0x7f3dd406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dd2ffd640 1 -- 172.21.15.28:0/3411664884 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 126204342 0 0) 0x7f3dbc003530 con 0x7f3dd40c5640 2023-12-16T03:28:28.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dd8f33640 1 -- 172.21.15.28:0/3411664884 >> v1:172.21.15.28:6789/0 conn(0x7f3dd40c5640 legacy=0x7f3dd40c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.174+0000 7f3dd8f33640 1 -- 172.21.15.28:0/3411664884 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd40c1a00 con 0x7f3dd4155de0 2023-12-16T03:28:28.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dd8f33640 1 --2- 172.21.15.28:0/3411664884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd4155de0 0x7f3dd4156250 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40c1930 tx=0x7f3dcc01c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ccba8690a0cc88a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dd2ffd640 1 -- 172.21.15.28:0/3411664884 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8001680 con 0x7f3dd4155de0 2023-12-16T03:28:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dd2ffd640 1 -- 172.21.15.28:0/3411664884 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc0a5590 con 0x7f3dd4155de0 2023-12-16T03:28:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dd2ffd640 1 -- 172.21.15.28:0/3411664884 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0a5900 con 0x7f3dd4155de0 2023-12-16T03:28:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dda996640 1 -- 172.21.15.28:0/3411664884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd4155de0 msgr2=0x7f3dd4156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dda996640 1 --2- 172.21.15.28:0/3411664884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd4155de0 0x7f3dd4156250 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40c1930 tx=0x7f3dcc01c790 comp rx=0 tx=0).stop 2023-12-16T03:28:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dda996640 1 -- 172.21.15.28:0/3411664884 shutdown_connections 2023-12-16T03:28:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dda996640 1 --2- 172.21.15.28:0/3411664884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd4155de0 0x7f3dd4156250 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dda996640 1 --2- 172.21.15.28:0/3411664884 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dd40c5260 0x7f3dd406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dda996640 1 -- 172.21.15.28:0/3411664884 >> 172.21.15.28:0/3411664884 conn(0x7f3dd406a5b0 msgr2=0x7f3dd406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dda996640 1 -- 172.21.15.28:0/3411664884 shutdown_connections 2023-12-16T03:28:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dda996640 1 -- 172.21.15.28:0/3411664884 wait complete. 2023-12-16T03:28:28.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.178+0000 7f3dda996640 1 Processor -- start 2023-12-16T03:28:28.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dda996640 1 -- start start 2023-12-16T03:28:28.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dda996640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dd40c5260 0x7f3dd40a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dda996640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dd40c5640 0x7f3dd41ede80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dda996640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd4155de0 0x7f3dd41ee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dda996640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40be760 con 0x7f3dd40c5260 2023-12-16T03:28:28.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dda996640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40bf840 con 0x7f3dd4155de0 2023-12-16T03:28:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dda996640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd415c870 con 0x7f3dd40c5640 2023-12-16T03:28:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dd40c5260 0x7f3dd40a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dd40c5260 0x7f3dd40a5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47444/0 (socket says 172.21.15.28:47444) 2023-12-16T03:28:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd3fff640 1 -- 172.21.15.28:0/2830010117 learned_addr learned my addr 172.21.15.28:0/2830010117 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd3fff640 1 -- 172.21.15.28:0/2830010117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dd40c5640 msgr2=0x7f3dd41ede80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd3fff640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dd40c5640 0x7f3dd41ede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd3fff640 1 -- 172.21.15.28:0/2830010117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd4155de0 msgr2=0x7f3dd41ee3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd3fff640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd4155de0 0x7f3dd41ee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd3fff640 1 -- 172.21.15.28:0/2830010117 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc009a70 con 0x7f3dd40c5260 2023-12-16T03:28:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd3fff640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dd40c5260 0x7f3dd40a5120 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400e870 tx=0x7f3dc400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd0ff9640 1 -- 172.21.15.28:0/2830010117 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4009510 con 0x7f3dd40c5260 2023-12-16T03:28:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd0ff9640 1 -- 172.21.15.28:0/2830010117 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc400eec0 con 0x7f3dd40c5260 2023-12-16T03:28:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dd0ff9640 1 -- 172.21.15.28:0/2830010117 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400cb40 con 0x7f3dd40c5260 2023-12-16T03:28:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dda996640 1 -- 172.21.15.28:0/2830010117 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd40a82b0 con 0x7f3dd40c5260 2023-12-16T03:28:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dda996640 1 -- 172.21.15.28:0/2830010117 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd40bfd50 con 0x7f3dd40c5260 2023-12-16T03:28:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.182+0000 7f3dda996640 1 -- 172.21.15.28:0/2830010117 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd4068400 con 0x7f3dd40c5260 2023-12-16T03:28:28.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.186+0000 7f3dd0ff9640 1 -- 172.21.15.28:0/2830010117 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3dc400cca0 con 0x7f3dd40c5260 2023-12-16T03:28:28.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.186+0000 7f3dd0ff9640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3dc0066470 0x7f3dc0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.186+0000 7f3dd0ff9640 1 -- 172.21.15.28:0/2830010117 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3dc40843b0 con 0x7f3dd40c5260 2023-12-16T03:28:28.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.186+0000 7f3dd37fe640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3dc0066470 0x7f3dc0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.186+0000 7f3dd37fe640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3dc0066470 0x7f3dc0068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80011f0 tx=0x7f3dc8001a10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.190+0000 7f3dd0ff9640 1 -- 172.21.15.28:0/2830010117 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3dc4051430 con 0x7f3dd40c5260 2023-12-16T03:28:28.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.346+0000 7f3dda996640 1 -- 172.21.15.28:0/2830010117 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3dd406d390 con 0x7f3dd40c5260 2023-12-16T03:28:28.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.346+0000 7f3dd0ff9640 1 -- 172.21.15.28:0/2830010117 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f3dc4054a50 con 0x7f3dd40c5260 2023-12-16T03:28:28.351 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:28.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.346+0000 7f3dda996640 1 -- 172.21.15.28:0/2830010117 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3dc0066470 msgr2=0x7f3dc0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.346+0000 7f3dda996640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3dc0066470 0x7f3dc0068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80011f0 tx=0x7f3dc8001a10 comp rx=0 tx=0).stop 2023-12-16T03:28:28.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.350+0000 7f3dda996640 1 -- 172.21.15.28:0/2830010117 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dd40c5260 msgr2=0x7f3dd40a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.350+0000 7f3dda996640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dd40c5260 0x7f3dd40a5120 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400e870 tx=0x7f3dc400ec70 comp rx=0 tx=0).stop 2023-12-16T03:28:28.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.350+0000 7f3dda996640 1 -- 172.21.15.28:0/2830010117 shutdown_connections 2023-12-16T03:28:28.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.350+0000 7f3dda996640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd4155de0 0x7f3dd41ee3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.350+0000 7f3dda996640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dd40c5640 0x7f3dd41ede80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.350+0000 7f3dda996640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3dc0066470 0x7f3dc0068930 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.350+0000 7f3dda996640 1 --2- 172.21.15.28:0/2830010117 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dd40c5260 0x7f3dd40a5120 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.350+0000 7f3dda996640 1 -- 172.21.15.28:0/2830010117 >> 172.21.15.28:0/2830010117 conn(0x7f3dd406a5b0 msgr2=0x7f3dd40c38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:28.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.350+0000 7f3dda996640 1 -- 172.21.15.28:0/2830010117 shutdown_connections 2023-12-16T03:28:28.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.350+0000 7f3dda996640 1 -- 172.21.15.28:0/2830010117 wait complete. 2023-12-16T03:28:28.372 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:28:28.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.514+0000 7f22f7868640 1 Processor -- start 2023-12-16T03:28:28.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.514+0000 7f22f7868640 1 -- start start 2023-12-16T03:28:28.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22f7868640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22f006d520 0x7f22f015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22f7868640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f015c600 con 0x7f22f01560e0 2023-12-16T03:28:28.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22f7868640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f015a5c0 con 0x7f22f00bffc0 2023-12-16T03:28:28.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22f7868640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f01594e0 con 0x7f22f006d520 2023-12-16T03:28:28.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22f5604640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f22f01560e0 0x7f22f0159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37612/0 (socket says 172.21.15.28:37612) 2023-12-16T03:28:28.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22f5604640 1 -- 172.21.15.28:0/223695340 learned_addr learned my addr 172.21.15.28:0/223695340 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:28.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22f4e03640 1 --2- 172.21.15.28:0/223695340 >> v2:172.21.15.28:3300/0 conn(0x7f22f006d520 0x7f22f015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22e7fff640 1 -- 172.21.15.28:0/223695340 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572597372 0 0) 0x7f22f015c600 con 0x7f22f01560e0 2023-12-16T03:28:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22e7fff640 1 -- 172.21.15.28:0/223695340 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22dc003530 con 0x7f22f01560e0 2023-12-16T03:28:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22f4e03640 1 -- 172.21.15.28:0/223695340 >> v1:172.21.15.134:6789/0 conn(0x7f22f00bffc0 legacy=0x7f22f00c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22f4e03640 1 -- 172.21.15.28:0/223695340 >> v1:172.21.15.28:6789/0 conn(0x7f22f01560e0 legacy=0x7f22f0159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.518+0000 7f22f4e03640 1 -- 172.21.15.28:0/223695340 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f01597c0 con 0x7f22f006d520 2023-12-16T03:28:28.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22f4e03640 1 --2- 172.21.15.28:0/223695340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f006d520 0x7f22f015ca90 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f22e00097c0 tx=0x7f22e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0fa1c45c4d1135 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:28.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22e7fff640 1 -- 172.21.15.28:0/223695340 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e00ab650 con 0x7f22f006d520 2023-12-16T03:28:28.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22e7fff640 1 -- 172.21.15.28:0/223695340 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e00ab7b0 con 0x7f22f006d520 2023-12-16T03:28:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22e7fff640 1 -- 172.21.15.28:0/223695340 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e00abb40 con 0x7f22f006d520 2023-12-16T03:28:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22f7868640 1 -- 172.21.15.28:0/223695340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f006d520 msgr2=0x7f22f015ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22f7868640 1 --2- 172.21.15.28:0/223695340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f006d520 0x7f22f015ca90 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f22e00097c0 tx=0x7f22e001c450 comp rx=0 tx=0).stop 2023-12-16T03:28:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22f7868640 1 -- 172.21.15.28:0/223695340 shutdown_connections 2023-12-16T03:28:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22f7868640 1 --2- 172.21.15.28:0/223695340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f006d520 0x7f22f015ca90 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22f7868640 1 -- 172.21.15.28:0/223695340 >> 172.21.15.28:0/223695340 conn(0x7f22f006a5b0 msgr2=0x7f22f006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22f7868640 1 -- 172.21.15.28:0/223695340 shutdown_connections 2023-12-16T03:28:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22f7868640 1 -- 172.21.15.28:0/223695340 wait complete. 2023-12-16T03:28:28.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22f7868640 1 Processor -- start 2023-12-16T03:28:28.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.522+0000 7f22f7868640 1 -- start start 2023-12-16T03:28:28.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f7868640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f006d520 0x7f22f014b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f7868640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22f00bffc0 0x7f22f014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f7868640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f01560e0 0x7f22f0151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f7868640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f01f5260 con 0x7f22f01560e0 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f7868640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f0157f30 con 0x7f22f006d520 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f7868640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f01573c0 con 0x7f22f00bffc0 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f5e05640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f01560e0 0x7f22f0151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f5e05640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f01560e0 0x7f22f0151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47458/0 (socket says 172.21.15.28:47458) 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f5e05640 1 -- 172.21.15.28:0/1355831668 learned_addr learned my addr 172.21.15.28:0/1355831668 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f5604640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f006d520 0x7f22f014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f4e03640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22f00bffc0 0x7f22f014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f5e05640 1 -- 172.21.15.28:0/1355831668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22f00bffc0 msgr2=0x7f22f014e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f5e05640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22f00bffc0 0x7f22f014e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f5e05640 1 -- 172.21.15.28:0/1355831668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f006d520 msgr2=0x7f22f014b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f5e05640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f006d520 0x7f22f014b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f5e05640 1 -- 172.21.15.28:0/1355831668 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e0009420 con 0x7f22f01560e0 2023-12-16T03:28:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f5e05640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f01560e0 0x7f22f0151a00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f22e800c770 tx=0x7f22e800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22e5ffb640 1 -- 172.21.15.28:0/1355831668 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8003b80 con 0x7f22f01560e0 2023-12-16T03:28:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22e5ffb640 1 -- 172.21.15.28:0/1355831668 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e8003ce0 con 0x7f22f01560e0 2023-12-16T03:28:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f7868640 1 -- 172.21.15.28:0/1355831668 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f01576a0 con 0x7f22f01560e0 2023-12-16T03:28:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22e5ffb640 1 -- 172.21.15.28:0/1355831668 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e800aa90 con 0x7f22f01560e0 2023-12-16T03:28:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f7868640 1 -- 172.21.15.28:0/1355831668 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f014ee00 con 0x7f22f01560e0 2023-12-16T03:28:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22f7868640 1 -- 172.21.15.28:0/1355831668 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f006cf20 con 0x7f22f01560e0 2023-12-16T03:28:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.526+0000 7f22e5ffb640 1 -- 172.21.15.28:0/1355831668 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f22e800abf0 con 0x7f22f01560e0 2023-12-16T03:28:28.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.530+0000 7f22e5ffb640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f22d40664a0 0x7f22d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.530+0000 7f22e5ffb640 1 -- 172.21.15.28:0/1355831668 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f22e8083e90 con 0x7f22f01560e0 2023-12-16T03:28:28.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.530+0000 7f22f5604640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f22d40664a0 0x7f22d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.534 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.530+0000 7f22f5604640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f22d40664a0 0x7f22d4068960 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0011f0 tx=0x7f22ec007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:28.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.534+0000 7f22e5ffb640 1 -- 172.21.15.28:0/1355831668 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f22f006cf20 con 0x7f22f01560e0 2023-12-16T03:28:28.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.690+0000 7f22f7868640 1 -- 172.21.15.28:0/1355831668 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f22f006cf20 con 0x7f22f01560e0 2023-12-16T03:28:28.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.690+0000 7f22e5ffb640 1 -- 172.21.15.28:0/1355831668 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f22f006cf20 con 0x7f22f01560e0 2023-12-16T03:28:28.695 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:28.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 -- 172.21.15.28:0/1355831668 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f22d40664a0 msgr2=0x7f22d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f22d40664a0 0x7f22d4068960 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0011f0 tx=0x7f22ec007d40 comp rx=0 tx=0).stop 2023-12-16T03:28:28.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 -- 172.21.15.28:0/1355831668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f01560e0 msgr2=0x7f22f0151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f01560e0 0x7f22f0151a00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f22e800c770 tx=0x7f22e800cc30 comp rx=0 tx=0).stop 2023-12-16T03:28:28.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 -- 172.21.15.28:0/1355831668 shutdown_connections 2023-12-16T03:28:28.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f22d40664a0 0x7f22d4068960 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f01560e0 0x7f22f0151a00 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22f00bffc0 0x7f22f014e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 --2- 172.21.15.28:0/1355831668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22f006d520 0x7f22f014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 -- 172.21.15.28:0/1355831668 >> 172.21.15.28:0/1355831668 conn(0x7f22f006a5b0 msgr2=0x7f22f006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:28.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 -- 172.21.15.28:0/1355831668 shutdown_connections 2023-12-16T03:28:28.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.694+0000 7f22f7868640 1 -- 172.21.15.28:0/1355831668 wait complete. 2023-12-16T03:28:28.716 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:28:28.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6ba0d57640 1 Processor -- start 2023-12-16T03:28:28.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6ba0d57640 1 -- start start 2023-12-16T03:28:28.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6ba0d57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9c0c63c0 0x7f6b9c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6ba0d57640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9c0c31c0 con 0x7f6b9c0c4100 2023-12-16T03:28:28.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6ba0d57640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9c0c34a0 con 0x7f6b9c0c2bb0 2023-12-16T03:28:28.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6ba0d57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0c1030 con 0x7f6b9c0c63c0 2023-12-16T03:28:28.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6b93fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6b9c0c4100 0x7f6b9c0c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37616/0 (socket says 172.21.15.28:37616) 2023-12-16T03:28:28.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6b93fff640 1 -- 172.21.15.28:0/2594445733 learned_addr learned my addr 172.21.15.28:0/2594445733 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:28.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6b9a59c640 1 --2- 172.21.15.28:0/2594445733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9c0c63c0 0x7f6b9c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6b99d9b640 1 -- 172.21.15.28:0/2594445733 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98736144 0 0) 0x7f6b9c0c31c0 con 0x7f6b9c0c4100 2023-12-16T03:28:28.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6b99d9b640 1 -- 172.21.15.28:0/2594445733 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b88005740 con 0x7f6b9c0c4100 2023-12-16T03:28:28.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6b9a59c640 1 -- 172.21.15.28:0/2594445733 >> v1:172.21.15.134:6789/0 conn(0x7f6b9c0c2bb0 legacy=0x7f6b9c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6b99d9b640 1 -- 172.21.15.28:0/2594445733 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778388049 0 0) 0x7f6b9c0c34a0 con 0x7f6b9c0c2bb0 2023-12-16T03:28:28.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6b9a59c640 1 -- 172.21.15.28:0/2594445733 >> v1:172.21.15.28:6789/0 conn(0x7f6b9c0c4100 legacy=0x7f6b9c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.862+0000 7f6b9a59c640 1 -- 172.21.15.28:0/2594445733 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c0c1310 con 0x7f6b9c0c63c0 2023-12-16T03:28:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6b9a59c640 1 --2- 172.21.15.28:0/2594445733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9c0c63c0 0x7f6b9c0c06d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0097f0 tx=0x7f6b8c01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48fd2b4926562f91 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6b99d9b640 1 -- 172.21.15.28:0/2594445733 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0ab600 con 0x7f6b9c0c63c0 2023-12-16T03:28:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6b99d9b640 1 -- 172.21.15.28:0/2594445733 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c0a7050 con 0x7f6b9c0c63c0 2023-12-16T03:28:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6b99d9b640 1 -- 172.21.15.28:0/2594445733 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0ab980 con 0x7f6b9c0c63c0 2023-12-16T03:28:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6ba0d57640 1 -- 172.21.15.28:0/2594445733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9c0c63c0 msgr2=0x7f6b9c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6ba0d57640 1 --2- 172.21.15.28:0/2594445733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9c0c63c0 0x7f6b9c0c06d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0097f0 tx=0x7f6b8c01c370 comp rx=0 tx=0).stop 2023-12-16T03:28:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6ba0d57640 1 -- 172.21.15.28:0/2594445733 shutdown_connections 2023-12-16T03:28:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6ba0d57640 1 --2- 172.21.15.28:0/2594445733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9c0c63c0 0x7f6b9c0c06d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6ba0d57640 1 -- 172.21.15.28:0/2594445733 >> 172.21.15.28:0/2594445733 conn(0x7f6b9c06a5b0 msgr2=0x7f6b9c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6ba0d57640 1 -- 172.21.15.28:0/2594445733 shutdown_connections 2023-12-16T03:28:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6ba0d57640 1 -- 172.21.15.28:0/2594445733 wait complete. 2023-12-16T03:28:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.866+0000 7f6ba0d57640 1 Processor -- start 2023-12-16T03:28:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6ba0d57640 1 -- start start 2023-12-16T03:28:28.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6ba0d57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9c0c2bb0 0x7f6b9c09c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6ba0d57640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b9c0c4100 0x7f6b9c15b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6ba0d57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b9c0c63c0 0x7f6b9c15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6ba0d57640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c15ad00 con 0x7f6b9c0c4100 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6ba0d57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0bf790 con 0x7f6b9c0c63c0 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6ba0d57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0bfa70 con 0x7f6b9c0c2bb0 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b93fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b9c0c4100 0x7f6b9c15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b93fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b9c0c4100 0x7f6b9c15b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47462/0 (socket says 172.21.15.28:47462) 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b93fff640 1 -- 172.21.15.28:0/3724119294 learned_addr learned my addr 172.21.15.28:0/3724119294 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b9a59c640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9c0c2bb0 0x7f6b9c09c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b9ad9d640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b9c0c63c0 0x7f6b9c15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b93fff640 1 -- 172.21.15.28:0/3724119294 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9c0c2bb0 msgr2=0x7f6b9c09c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b93fff640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9c0c2bb0 0x7f6b9c09c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b93fff640 1 -- 172.21.15.28:0/3724119294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b9c0c63c0 msgr2=0x7f6b9c15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b93fff640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b9c0c63c0 0x7f6b9c15b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b93fff640 1 -- 172.21.15.28:0/3724119294 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c009420 con 0x7f6b9c0c4100 2023-12-16T03:28:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b93fff640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b9c0c4100 0x7f6b9c15b190 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400c450 tx=0x7f6b8400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b92ffd640 1 -- 172.21.15.28:0/3724119294 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84005cf0 con 0x7f6b9c0c4100 2023-12-16T03:28:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b92ffd640 1 -- 172.21.15.28:0/3724119294 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b84005e50 con 0x7f6b9c0c4100 2023-12-16T03:28:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6b92ffd640 1 -- 172.21.15.28:0/3724119294 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84007290 con 0x7f6b9c0c4100 2023-12-16T03:28:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6ba0d57640 1 -- 172.21.15.28:0/3724119294 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c0c69b0 con 0x7f6b9c0c4100 2023-12-16T03:28:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6ba0d57640 1 -- 172.21.15.28:0/3724119294 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9c0bfd50 con 0x7f6b9c0c4100 2023-12-16T03:28:28.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.870+0000 7f6ba0d57640 1 -- 172.21.15.28:0/3724119294 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9c15ae70 con 0x7f6b9c0c4100 2023-12-16T03:28:28.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.874+0000 7f6b92ffd640 1 -- 172.21.15.28:0/3724119294 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6b840073f0 con 0x7f6b9c0c4100 2023-12-16T03:28:28.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.874+0000 7f6b92ffd640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b7c066470 0x7f6b7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:28.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.874+0000 7f6b92ffd640 1 -- 172.21.15.28:0/3724119294 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6b84083710 con 0x7f6b9c0c4100 2023-12-16T03:28:28.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.874+0000 7f6b9a59c640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b7c066470 0x7f6b7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:28.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.874+0000 7f6b9a59c640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b7c066470 0x7f6b7c068930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0ad000 tx=0x7f6b8c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:28.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:28.878+0000 7f6b92ffd640 1 -- 172.21.15.28:0/3724119294 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6b840508d0 con 0x7f6b9c0c4100 2023-12-16T03:28:29.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 -- 172.21.15.28:0/3724119294 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6b9c068400 con 0x7f6b9c0c4100 2023-12-16T03:28:29.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6b92ffd640 1 -- 172.21.15.28:0/3724119294 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6b84017080 con 0x7f6b9c0c4100 2023-12-16T03:28:29.051 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:28:29.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 -- 172.21.15.28:0/3724119294 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b7c066470 msgr2=0x7f6b7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:29.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b7c066470 0x7f6b7c068930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0ad000 tx=0x7f6b8c0a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:29.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 -- 172.21.15.28:0/3724119294 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b9c0c4100 msgr2=0x7f6b9c15b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:29.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b9c0c4100 0x7f6b9c15b190 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400c450 tx=0x7f6b8400c910 comp rx=0 tx=0).stop 2023-12-16T03:28:29.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 -- 172.21.15.28:0/3724119294 shutdown_connections 2023-12-16T03:28:29.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b9c0c63c0 0x7f6b9c15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f6b7c066470 0x7f6b7c068930 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b9c0c4100 0x7f6b9c15b190 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 --2- 172.21.15.28:0/3724119294 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6b9c0c2bb0 0x7f6b9c09c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 -- 172.21.15.28:0/3724119294 >> 172.21.15.28:0/3724119294 conn(0x7f6b9c06a5b0 msgr2=0x7f6b9c0a7110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:29.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.046+0000 7f6ba0d57640 1 -- 172.21.15.28:0/3724119294 shutdown_connections 2023-12-16T03:28:29.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.050+0000 7f6ba0d57640 1 -- 172.21.15.28:0/3724119294 wait complete. 2023-12-16T03:28:29.072 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-16T03:28:29.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:29.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:29.132 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:28:29.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:29.132 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T03:28:29.154 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:29.154 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:29.209 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-16T03:28:29.209 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-16T03:28:29.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9ed8d6640 1 Processor -- start 2023-12-16T03:28:29.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9ed8d6640 1 -- start start 2023-12-16T03:28:29.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9ed8d6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff9e80bf660 0x7ff9e8158330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:29.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9ed8d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9e80c50e0 0x7ff9e80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:29.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9ed8d6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e80c4980 con 0x7ff9e8157f50 2023-12-16T03:28:29.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9ed8d6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e80bfd10 con 0x7ff9e80bf660 2023-12-16T03:28:29.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9ed8d6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8158870 con 0x7ff9e80c50e0 2023-12-16T03:28:29.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9dffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff9e80bf660 0x7ff9e8158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:29.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9e6ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff9e8157f50 0x7ff9e80c5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37630/0 (socket says 172.21.15.28:37630) 2023-12-16T03:28:29.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9e6ffd640 1 -- 172.21.15.28:0/1825804715 learned_addr learned my addr 172.21.15.28:0/1825804715 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:29.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9e77fe640 1 --2- 172.21.15.28:0/1825804715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9e80c50e0 0x7ff9e80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:29.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9dffff640 1 -- 172.21.15.28:0/1825804715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9e80c50e0 msgr2=0x7ff9e80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:29.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9dffff640 1 --2- 172.21.15.28:0/1825804715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9e80c50e0 0x7ff9e80c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9dffff640 1 -- 172.21.15.28:0/1825804715 >> v1:172.21.15.28:6789/0 conn(0x7ff9e8157f50 legacy=0x7ff9e80c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:29.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9e67fc640 1 -- 172.21.15.28:0/1825804715 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587929401 0 0) 0x7ff9e80c4980 con 0x7ff9e8157f50 2023-12-16T03:28:29.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.350+0000 7ff9dffff640 1 -- 172.21.15.28:0/1825804715 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e80c4eb0 con 0x7ff9e80bf660 2023-12-16T03:28:29.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9dffff640 1 --2- 172.21.15.28:0/1825804715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9e80bf660 0x7ff9e8158330 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00097f0 tx=0x7ff9d001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabc7c6d2e2b7103 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:29.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9e67fc640 1 -- 172.21.15.28:0/1825804715 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00ab600 con 0x7ff9e80bf660 2023-12-16T03:28:29.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9e67fc640 1 -- 172.21.15.28:0/1825804715 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d00a7050 con 0x7ff9e80bf660 2023-12-16T03:28:29.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9e67fc640 1 -- 172.21.15.28:0/1825804715 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00ab980 con 0x7ff9e80bf660 2023-12-16T03:28:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/1825804715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9e80bf660 msgr2=0x7ff9e8158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9ed8d6640 1 --2- 172.21.15.28:0/1825804715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9e80bf660 0x7ff9e8158330 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00097f0 tx=0x7ff9d001c360 comp rx=0 tx=0).stop 2023-12-16T03:28:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/1825804715 shutdown_connections 2023-12-16T03:28:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9ed8d6640 1 --2- 172.21.15.28:0/1825804715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9e80c50e0 0x7ff9e80c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9ed8d6640 1 --2- 172.21.15.28:0/1825804715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9e80bf660 0x7ff9e8158330 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/1825804715 >> 172.21.15.28:0/1825804715 conn(0x7ff9e80c6870 msgr2=0x7ff9e80c6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:29.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/1825804715 shutdown_connections 2023-12-16T03:28:29.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/1825804715 wait complete. 2023-12-16T03:28:29.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9ed8d6640 1 Processor -- start 2023-12-16T03:28:29.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.354+0000 7ff9ed8d6640 1 -- start start 2023-12-16T03:28:29.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9ed8d6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9e80bf660 0x7ff9e806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:29.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9ed8d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9e80c50e0 0x7ff9e81f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:29.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9ed8d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9e8157f50 0x7ff9e80aa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:29.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9ed8d6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e806ca40 con 0x7ff9e80bf660 2023-12-16T03:28:29.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9ed8d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e806b150 con 0x7ff9e8157f50 2023-12-16T03:28:29.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9ed8d6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e806c4c0 con 0x7ff9e80c50e0 2023-12-16T03:28:29.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9e80bf660 0x7ff9e806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:29.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9e80bf660 0x7ff9e806ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47470/0 (socket says 172.21.15.28:47470) 2023-12-16T03:28:29.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e6ffd640 1 -- 172.21.15.28:0/830501931 learned_addr learned my addr 172.21.15.28:0/830501931 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:29.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9dffff640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9e80c50e0 0x7ff9e81f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e77fe640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9e8157f50 0x7ff9e80aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e6ffd640 1 -- 172.21.15.28:0/830501931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9e80c50e0 msgr2=0x7ff9e81f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e6ffd640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9e80c50e0 0x7ff9e81f0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e6ffd640 1 -- 172.21.15.28:0/830501931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9e8157f50 msgr2=0x7ff9e80aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e6ffd640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9e8157f50 0x7ff9e80aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e6ffd640 1 -- 172.21.15.28:0/830501931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d0009420 con 0x7ff9e80bf660 2023-12-16T03:28:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e77fe640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9e8157f50 0x7ff9e80aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:29.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e6ffd640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9e80bf660 0x7ff9e806ac10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800c4b0 tx=0x7ff9d800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:29.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e4ff9640 1 -- 172.21.15.28:0/830501931 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80074e0 con 0x7ff9e80bf660 2023-12-16T03:28:29.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e4ff9640 1 -- 172.21.15.28:0/830501931 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d8007660 con 0x7ff9e80bf660 2023-12-16T03:28:29.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/830501931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e81493f0 con 0x7ff9e80bf660 2023-12-16T03:28:29.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e4ff9640 1 -- 172.21.15.28:0/830501931 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8004a30 con 0x7ff9e80bf660 2023-12-16T03:28:29.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/830501931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e81f0470 con 0x7ff9e80bf660 2023-12-16T03:28:29.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/830501931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e804e850 con 0x7ff9e80bf660 2023-12-16T03:28:29.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.358+0000 7ff9e4ff9640 1 -- 172.21.15.28:0/830501931 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff9d8004b90 con 0x7ff9e80bf660 2023-12-16T03:28:29.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.362+0000 7ff9e4ff9640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9c8066470 0x7ff9c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:29.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.362+0000 7ff9e4ff9640 1 -- 172.21.15.28:0/830501931 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff9d80836a0 con 0x7ff9e80bf660 2023-12-16T03:28:29.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.362+0000 7ff9dffff640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9c8066470 0x7ff9c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:29.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.362+0000 7ff9dffff640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9c8066470 0x7ff9c8068930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00ad000 tx=0x7ff9d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:29.369 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.366+0000 7ff9e4ff9640 1 -- 172.21.15.28:0/830501931 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff9d8054240 con 0x7ff9e80bf660 2023-12-16T03:28:29.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/830501931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff9e80bf2a0 con 0x7ff9e80bf660 2023-12-16T03:28:29.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9e4ff9640 1 -- 172.21.15.28:0/830501931 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+149 (secure 0 0 0) 0x7ff9d8053dd0 con 0x7ff9e80bf660 2023-12-16T03:28:29.563 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-16T03:28:29.563 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-16T03:28:29.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/830501931 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9c8066470 msgr2=0x7ff9c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:29.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9c8066470 0x7ff9c8068930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00ad000 tx=0x7ff9d0008040 comp rx=0 tx=0).stop 2023-12-16T03:28:29.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/830501931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9e80bf660 msgr2=0x7ff9e806ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:29.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9e80bf660 0x7ff9e806ac10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800c4b0 tx=0x7ff9d800c970 comp rx=0 tx=0).stop 2023-12-16T03:28:29.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/830501931 shutdown_connections 2023-12-16T03:28:29.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9e8157f50 0x7ff9e80aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9e80c50e0 0x7ff9e81f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff9c8066470 0x7ff9c8068930 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 --2- 172.21.15.28:0/830501931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9e80bf660 0x7ff9e806ac10 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:29.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/830501931 >> 172.21.15.28:0/830501931 conn(0x7ff9e80c6870 msgr2=0x7ff9e80c6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:29.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/830501931 shutdown_connections 2023-12-16T03:28:29.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:29.558+0000 7ff9ed8d6640 1 -- 172.21.15.28:0/830501931 wait complete. 2023-12-16T03:28:29.583 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-16T03:28:29.583 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-16T03:28:29.583 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-12-16T03:28:29.583 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-16T03:28:29.583 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:29.583 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-16T03:28:29.583 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-16T03:28:29.583 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.FKrwxPAgeu 2023-12-16T03:28:29.583 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2023-12-16T03:28:29.593 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.EEpOUX9UVR 2023-12-16T03:28:29.593 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /tmp/tmp.FKrwxPAgeu /tmp/tmp.EEpOUX9UVR 2023-12-16T03:28:29.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.EEpOUX9UVR 2023-12-16T03:28:29.787 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.EEpOUX9UVR is 226B 2023-12-16T03:28:29.803 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.EEpOUX9UVR 2023-12-16T03:28:29.812 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBVGX1lwB4fNhAAjayc1Li38MQXtxCV86dMRg== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-16T03:28:29.813 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:28:29.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:29.813 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-12-16T03:28:29.865 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-12-16T03:28:29.866 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-16T03:28:29.867 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:29.868 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-16T03:28:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-16T03:28:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42230sec preferred_lft 42230sec 2023-12-16T03:28:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-12-16T03:28:29.868 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:29.868 INFO:teuthology.orchestra.run.smithi134.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 02:42:8f:0f:48:af brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-16T03:28:29.869 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-16T03:28:29.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:29.871 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-16T03:28:29.933 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-12-16T03:28:29.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:29.935 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-12-16T03:28:29.988 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-12-16T03:28:29.988 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-16T03:28:29.988 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-16T03:28:29.988 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-16T03:28:29.988 INFO:teuthology.orchestra.run.smithi134.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-16T03:28:29.988 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-16T03:28:29.988 INFO:teuthology.orchestra.run.smithi134.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:28:29.988 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:28:29.988 INFO:teuthology.orchestra.run.smithi134.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-16T03:28:29.988 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-16T03:28:29.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:29.989 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-16T03:28:29.989 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-16T03:28:29.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-16T03:28:29.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-16T03:28:29.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-16T03:28:29.989 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-16T03:28:30.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:30.085 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-16T03:28:30.094 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T03:28:30.095 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:28:30.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:30.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-12-16T03:28:30.158 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:28:30.158 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:30.213 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-16T03:28:30.213 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-16T03:28:30.213 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:30.264 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:30.264 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/tmp/tmp.FKrwxPAgeu of=/dev/stdout 2023-12-16T03:28:30.313 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-16T03:28:30.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:30.313 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQBVGX1lwB4fNhAAjayc1Li38MQXtxCV86dMRg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:30.411 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,secret=AQBVGX1lwB4fNhAAjayc1Li38MQXtxCV86dMRg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:30.411 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:28:30.411 INFO:teuthology.orchestra.run.smithi134.stdout:keyring.get_secret failed 2023-12-16T03:28:30.424 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,secret=AQBVGX1lwB4fNhAAjayc1Li38MQXtxCV86dMRg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-16T03:28:30.424 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-16T03:28:30.424 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.134:3300,172.21.15.134:3301" 2023-12-16T03:28:30.424 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: testuser@96b65b79-be1d-4832-b923-85c874d6fb27.cephfs2=/ 2023-12-16T03:28:30.424 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.28:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2023-12-16T03:28:30.428 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-16T03:28:30.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:30.428 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2023-12-16T03:28:30.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:28:30.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:30.449 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-16T03:28:30.508 INFO:teuthology.orchestra.run.smithi134.stdout:client6718 2023-12-16T03:28:30.508 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:30.508 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:30.556 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2023-12-16T03:28:30.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:30.557 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2023-12-16T03:28:30.568 INFO:teuthology.orchestra.run.smithi028.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2023-12-16T03:28:30.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:28:30.569 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:30.569 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:30.622 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:30.622 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:30.674 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:30.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95ca6c9640 1 Processor -- start 2023-12-16T03:28:30.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95ca6c9640 1 -- start start 2023-12-16T03:28:30.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95ca6c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95c40c63c0 0x7f95c40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:30.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95ca6c9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f95c40c4100 0x7f95c40c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:30.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95ca6c9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c40c31c0 con 0x7f95c40c29e0 2023-12-16T03:28:30.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95ca6c9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c40c34a0 con 0x7f95c40c4100 2023-12-16T03:28:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95ca6c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40c1030 con 0x7f95c40c63c0 2023-12-16T03:28:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95c37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f95c40c4100 0x7f95c40c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95c8c66640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f95c40c29e0 0x7f95c40a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36566/0 (socket says 172.21.15.28:36566) 2023-12-16T03:28:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95c8c66640 1 -- 172.21.15.28:0/2054099011 learned_addr learned my addr 172.21.15.28:0/2054099011 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95c3fff640 1 --2- 172.21.15.28:0/2054099011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95c40c63c0 0x7f95c40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95c37fe640 1 -- 172.21.15.28:0/2054099011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95c40c63c0 msgr2=0x7f95c40c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95c37fe640 1 --2- 172.21.15.28:0/2054099011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95c40c63c0 0x7f95c40c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95c37fe640 1 -- 172.21.15.28:0/2054099011 >> v1:172.21.15.28:6789/0 conn(0x7f95c40c29e0 legacy=0x7f95c40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95c37fe640 1 -- 172.21.15.28:0/2054099011 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c40c1310 con 0x7f95c40c4100 2023-12-16T03:28:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.862+0000 7f95c2ffd640 1 -- 172.21.15.28:0/2054099011 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803898076 0 0) 0x7f95c40c31c0 con 0x7f95c40c29e0 2023-12-16T03:28:30.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95c37fe640 1 --2- 172.21.15.28:0/2054099011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95c40c4100 0x7f95c40c24a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f95b80097c0 tx=0x7f95b801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8505078607af24 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:30.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95c2ffd640 1 -- 172.21.15.28:0/2054099011 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8004230 con 0x7f95c40c4100 2023-12-16T03:28:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95c2ffd640 1 -- 172.21.15.28:0/2054099011 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b80a7050 con 0x7f95c40c4100 2023-12-16T03:28:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95c2ffd640 1 -- 172.21.15.28:0/2054099011 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8003620 con 0x7f95c40c4100 2023-12-16T03:28:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95ca6c9640 1 -- 172.21.15.28:0/2054099011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95c40c4100 msgr2=0x7f95c40c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95ca6c9640 1 --2- 172.21.15.28:0/2054099011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95c40c4100 0x7f95c40c24a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f95b80097c0 tx=0x7f95b801c330 comp rx=0 tx=0).stop 2023-12-16T03:28:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95ca6c9640 1 -- 172.21.15.28:0/2054099011 shutdown_connections 2023-12-16T03:28:30.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95ca6c9640 1 --2- 172.21.15.28:0/2054099011 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95c40c4100 0x7f95c40c24a0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:30.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95ca6c9640 1 --2- 172.21.15.28:0/2054099011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95c40c63c0 0x7f95c40c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:30.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95ca6c9640 1 -- 172.21.15.28:0/2054099011 >> 172.21.15.28:0/2054099011 conn(0x7f95c406a5b0 msgr2=0x7f95c406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:30.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95ca6c9640 1 -- 172.21.15.28:0/2054099011 shutdown_connections 2023-12-16T03:28:30.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.866+0000 7f95ca6c9640 1 -- 172.21.15.28:0/2054099011 wait complete. 2023-12-16T03:28:30.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95ca6c9640 1 Processor -- start 2023-12-16T03:28:30.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95ca6c9640 1 -- start start 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95ca6c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95c40c29e0 0x7f95c414b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95ca6c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c40c4100 0x7f95c414e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95ca6c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95c40c63c0 0x7f95c414bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95ca6c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c414df90 con 0x7f95c40c63c0 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95ca6c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c414b9a0 con 0x7f95c40c4100 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95ca6c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4154cc0 con 0x7f95c40c29e0 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c8c66640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95c40c63c0 0x7f95c414bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c8c66640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95c40c63c0 0x7f95c414bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42008/0 (socket says 172.21.15.28:42008) 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c8c66640 1 -- 172.21.15.28:0/3255463790 learned_addr learned my addr 172.21.15.28:0/3255463790 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c37fe640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c40c4100 0x7f95c414e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c3fff640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95c40c29e0 0x7f95c414b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c8c66640 1 -- 172.21.15.28:0/3255463790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95c40c29e0 msgr2=0x7f95c414b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c8c66640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95c40c29e0 0x7f95c414b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c8c66640 1 -- 172.21.15.28:0/3255463790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c40c4100 msgr2=0x7f95c414e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c8c66640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c40c4100 0x7f95c414e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c8c66640 1 -- 172.21.15.28:0/3255463790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8009420 con 0x7f95c40c63c0 2023-12-16T03:28:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c37fe640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c40c4100 0x7f95c414e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c3fff640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95c40c29e0 0x7f95c414b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c8c66640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95c40c63c0 0x7f95c414bfe0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00c810 tx=0x7f95bc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c0ff9640 1 -- 172.21.15.28:0/3255463790 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00a640 con 0x7f95c40c63c0 2023-12-16T03:28:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c0ff9640 1 -- 172.21.15.28:0/3255463790 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc00a7c0 con 0x7f95c40c63c0 2023-12-16T03:28:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95ca6c9640 1 -- 172.21.15.28:0/3255463790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c41559d0 con 0x7f95c40c63c0 2023-12-16T03:28:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.870+0000 7f95c0ff9640 1 -- 172.21.15.28:0/3255463790 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00ab70 con 0x7f95c40c63c0 2023-12-16T03:28:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.874+0000 7f95ca6c9640 1 -- 172.21.15.28:0/3255463790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c4154ef0 con 0x7f95c40c63c0 2023-12-16T03:28:30.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.874+0000 7f95ca6c9640 1 -- 172.21.15.28:0/3255463790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c40aa3b0 con 0x7f95c40c63c0 2023-12-16T03:28:30.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.874+0000 7f95c0ff9640 1 -- 172.21.15.28:0/3255463790 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f95bc00acd0 con 0x7f95c40c63c0 2023-12-16T03:28:30.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.874+0000 7f95c0ff9640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95b0066470 0x7f95b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:30.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.874+0000 7f95c0ff9640 1 -- 172.21.15.28:0/3255463790 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f95bc083ae0 con 0x7f95c40c63c0 2023-12-16T03:28:30.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.874+0000 7f95c3fff640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95b0066470 0x7f95b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:30.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.874+0000 7f95c3fff640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95b0066470 0x7f95b0068930 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f95c415ac20 tx=0x7f95b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:30.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:30.878+0000 7f95c0ff9640 1 -- 172.21.15.28:0/3255463790 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f95bc050b60 con 0x7f95c40c63c0 2023-12-16T03:28:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.038+0000 7f95ca6c9640 1 -- 172.21.15.28:0/3255463790 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95c4068400 con 0x7f95c40c63c0 2023-12-16T03:28:31.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.038+0000 7f95c0ff9640 1 -- 172.21.15.28:0/3255463790 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20214 (secure 0 0 0) 0x7f95bc018020 con 0x7f95c40c63c0 2023-12-16T03:28:31.044 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:31.044 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:13.793649+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:31.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 -- 172.21.15.28:0/3255463790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95b0066470 msgr2=0x7f95b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95b0066470 0x7f95b0068930 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f95c415ac20 tx=0x7f95b4008040 comp rx=0 tx=0).stop 2023-12-16T03:28:31.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 -- 172.21.15.28:0/3255463790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95c40c63c0 msgr2=0x7f95c414bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95c40c63c0 0x7f95c414bfe0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00c810 tx=0x7f95bc00ccd0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 -- 172.21.15.28:0/3255463790 shutdown_connections 2023-12-16T03:28:31.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95b0066470 0x7f95b0068930 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95c40c63c0 0x7f95c414bfe0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c40c4100 0x7f95c414e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 --2- 172.21.15.28:0/3255463790 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95c40c29e0 0x7f95c414b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 -- 172.21.15.28:0/3255463790 >> 172.21.15.28:0/3255463790 conn(0x7f95c406a5b0 msgr2=0x7f95c406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:31.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 -- 172.21.15.28:0/3255463790 shutdown_connections 2023-12-16T03:28:31.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.042+0000 7f95ca6c9640 1 -- 172.21.15.28:0/3255463790 wait complete. 2023-12-16T03:28:31.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:27:56.894984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:27:58.090972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:28:10.280019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:28:11.167317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:28:31.066 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:28:31.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.206+0000 7f9d9bfb8640 1 Processor -- start 2023-12-16T03:28:31.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.206+0000 7f9d9bfb8640 1 -- start start 2023-12-16T03:28:31.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9bfb8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d941560e0 0x7f9d9415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9bfb8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9d940bffc0 0x7f9d940c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9bfb8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9415c600 con 0x7f9d9406d520 2023-12-16T03:28:31.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9bfb8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9415a5c0 con 0x7f9d940bffc0 2023-12-16T03:28:31.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9bfb8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d941594e0 con 0x7f9d941560e0 2023-12-16T03:28:31.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9a555640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9d940bffc0 0x7f9d940c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9a555640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9d940bffc0 0x7f9d940c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42012/0 (socket says 172.21.15.28:42012) 2023-12-16T03:28:31.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9a555640 1 -- 172.21.15.28:0/3109247726 learned_addr learned my addr 172.21.15.28:0/3109247726 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:31.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d99553640 1 --1- 172.21.15.28:0/3109247726 >> v1:172.21.15.28:6789/0 conn(0x7f9d9406d520 0x7f9d94159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36570/0 (socket says 172.21.15.28:36570) 2023-12-16T03:28:31.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d99d54640 1 --2- 172.21.15.28:0/3109247726 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d941560e0 0x7f9d9415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9a555640 1 -- 172.21.15.28:0/3109247726 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d941560e0 msgr2=0x7f9d9415ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:31.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9a555640 1 --2- 172.21.15.28:0/3109247726 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d941560e0 0x7f9d9415ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9a555640 1 -- 172.21.15.28:0/3109247726 >> v1:172.21.15.28:6789/0 conn(0x7f9d9406d520 legacy=0x7f9d94159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.210+0000 7f9d9a555640 1 -- 172.21.15.28:0/3109247726 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d941597c0 con 0x7f9d940bffc0 2023-12-16T03:28:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d9a555640 1 --2- 172.21.15.28:0/3109247726 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d940bffc0 0x7f9d940c1bf0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009e50 tx=0x7f9d8c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f522bd61a6cd9a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d98d52640 1 -- 172.21.15.28:0/3109247726 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0a57c0 con 0x7f9d940bffc0 2023-12-16T03:28:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d98d52640 1 -- 172.21.15.28:0/3109247726 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c0a5920 con 0x7f9d940bffc0 2023-12-16T03:28:31.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d98d52640 1 -- 172.21.15.28:0/3109247726 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0a5cb0 con 0x7f9d940bffc0 2023-12-16T03:28:31.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3109247726 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d940bffc0 msgr2=0x7f9d940c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d9bfb8640 1 --2- 172.21.15.28:0/3109247726 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d940bffc0 0x7f9d940c1bf0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009e50 tx=0x7f9d8c01c9e0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3109247726 shutdown_connections 2023-12-16T03:28:31.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d9bfb8640 1 --2- 172.21.15.28:0/3109247726 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d940bffc0 0x7f9d940c1bf0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d9bfb8640 1 --2- 172.21.15.28:0/3109247726 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d941560e0 0x7f9d9415ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3109247726 >> 172.21.15.28:0/3109247726 conn(0x7f9d9406a5b0 msgr2=0x7f9d9406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:31.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3109247726 shutdown_connections 2023-12-16T03:28:31.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3109247726 wait complete. 2023-12-16T03:28:31.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d9bfb8640 1 Processor -- start 2023-12-16T03:28:31.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.214+0000 7f9d9bfb8640 1 -- start start 2023-12-16T03:28:31.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d9bfb8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d9406d520 0x7f9d940700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d9bfb8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d940bffc0 0x7f9d940a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d9bfb8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d941560e0 0x7f9d940a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d9bfb8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940aa260 con 0x7f9d9406d520 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d9bfb8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d941504a0 con 0x7f9d940bffc0 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d9bfb8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d941519e0 con 0x7f9d941560e0 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d99d54640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d9406d520 0x7f9d940700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d99d54640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d9406d520 0x7f9d940700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42024/0 (socket says 172.21.15.28:42024) 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d99d54640 1 -- 172.21.15.28:0/3556493635 learned_addr learned my addr 172.21.15.28:0/3556493635 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d99553640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d940bffc0 0x7f9d940a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d9a555640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d941560e0 0x7f9d940a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d99d54640 1 -- 172.21.15.28:0/3556493635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d941560e0 msgr2=0x7f9d940a9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d99d54640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d941560e0 0x7f9d940a9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d99d54640 1 -- 172.21.15.28:0/3556493635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d940bffc0 msgr2=0x7f9d940a97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d99d54640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d940bffc0 0x7f9d940a97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d99d54640 1 -- 172.21.15.28:0/3556493635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c009b30 con 0x7f9d9406d520 2023-12-16T03:28:31.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d99d54640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d9406d520 0x7f9d940700b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000d5f0 tx=0x7f9d9000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:31.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d8a7fc640 1 -- 172.21.15.28:0/3556493635 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d900125f0 con 0x7f9d9406d520 2023-12-16T03:28:31.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d8a7fc640 1 -- 172.21.15.28:0/3556493635 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d90012750 con 0x7f9d9406d520 2023-12-16T03:28:31.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3556493635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d941501c0 con 0x7f9d9406d520 2023-12-16T03:28:31.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d8a7fc640 1 -- 172.21.15.28:0/3556493635 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90012ae0 con 0x7f9d9406d520 2023-12-16T03:28:31.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3556493635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d940705f0 con 0x7f9d9406d520 2023-12-16T03:28:31.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3556493635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d94068400 con 0x7f9d9406d520 2023-12-16T03:28:31.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.218+0000 7f9d8a7fc640 1 -- 172.21.15.28:0/3556493635 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9d90012c40 con 0x7f9d9406d520 2023-12-16T03:28:31.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.222+0000 7f9d8a7fc640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d780664a0 0x7f9d78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.222+0000 7f9d8a7fc640 1 -- 172.21.15.28:0/3556493635 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9d90084510 con 0x7f9d9406d520 2023-12-16T03:28:31.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.222+0000 7f9d99553640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d780664a0 0x7f9d78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.222+0000 7f9d99553640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d780664a0 0x7f9d78068960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9d940a7940 tx=0x7f9d84007e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:31.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.226+0000 7f9d8a7fc640 1 -- 172.21.15.28:0/3556493635 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9d900516d0 con 0x7f9d9406d520 2023-12-16T03:28:31.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3556493635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d94071140 con 0x7f9d9406d520 2023-12-16T03:28:31.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d8a7fc640 1 -- 172.21.15.28:0/3556493635 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d9005b030 con 0x7f9d9406d520 2023-12-16T03:28:31.390 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:28:31.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3556493635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d780664a0 msgr2=0x7f9d78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d780664a0 0x7f9d78068960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9d940a7940 tx=0x7f9d84007e50 comp rx=0 tx=0).stop 2023-12-16T03:28:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3556493635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d9406d520 msgr2=0x7f9d940700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d9406d520 0x7f9d940700b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000d5f0 tx=0x7f9d9000dab0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3556493635 shutdown_connections 2023-12-16T03:28:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d941560e0 0x7f9d940a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d940bffc0 0x7f9d940a97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9d780664a0 0x7f9d78068960 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 --2- 172.21.15.28:0/3556493635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d9406d520 0x7f9d940700b0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3556493635 >> 172.21.15.28:0/3556493635 conn(0x7f9d9406a5b0 msgr2=0x7f9d9406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3556493635 shutdown_connections 2023-12-16T03:28:31.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.386+0000 7f9d9bfb8640 1 -- 172.21.15.28:0/3556493635 wait complete. 2023-12-16T03:28:31.411 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:28:31.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.554+0000 7f99384c9640 1 Processor -- start 2023-12-16T03:28:31.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.554+0000 7f99384c9640 1 -- start start 2023-12-16T03:28:31.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.554+0000 7f99384c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f99300a5370 0x7f99300c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.554+0000 7f99384c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99300c4110 0x7f9930150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.554+0000 7f99384c9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9930072090 0x7f99301514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.554+0000 7f99384c9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99300c3070 con 0x7f9930072090 2023-12-16T03:28:31.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.554+0000 7f99384c9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99300c2760 con 0x7f99300a5370 2023-12-16T03:28:31.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.554+0000 7f99384c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99300a5750 con 0x7f99300c4110 2023-12-16T03:28:31.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.554+0000 7f9936a66640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9930072090 0x7f99301514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9936a66640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9930072090 0x7f99301514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42036/0 (socket says 172.21.15.28:42036) 2023-12-16T03:28:31.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9936a66640 1 -- 172.21.15.28:0/614373495 learned_addr learned my addr 172.21.15.28:0/614373495 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:31.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9935a64640 1 --2- 172.21.15.28:0/614373495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99300c4110 0x7f9930150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9936265640 1 --2- 172.21.15.28:0/614373495 >> v2:172.21.15.134:3300/0 conn(0x7f99300a5370 0x7f99300c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9936a66640 1 -- 172.21.15.28:0/614373495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99300c4110 msgr2=0x7f9930150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:31.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9936a66640 1 --2- 172.21.15.28:0/614373495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99300c4110 0x7f9930150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9936a66640 1 -- 172.21.15.28:0/614373495 >> v2:172.21.15.134:3300/0 conn(0x7f99300a5370 msgr2=0x7f99300c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:31.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9936a66640 1 --2- 172.21.15.28:0/614373495 >> v2:172.21.15.134:3300/0 conn(0x7f99300a5370 0x7f99300c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9936a66640 1 -- 172.21.15.28:0/614373495 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99300aad20 con 0x7f9930072090 2023-12-16T03:28:31.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9936a66640 1 --2- 172.21.15.28:0/614373495 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9930072090 0x7f99301514e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f99300a8af0 tx=0x7f992801ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efdf9fcec58222b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:31.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9935263640 1 -- 172.21.15.28:0/614373495 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99280a7a90 con 0x7f9930072090 2023-12-16T03:28:31.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9935263640 1 -- 172.21.15.28:0/614373495 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99280ab070 con 0x7f9930072090 2023-12-16T03:28:31.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.558+0000 7f9935263640 1 -- 172.21.15.28:0/614373495 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99280a7e10 con 0x7f9930072090 2023-12-16T03:28:31.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 -- 172.21.15.28:0/614373495 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9930072090 msgr2=0x7f99301514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 --2- 172.21.15.28:0/614373495 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9930072090 0x7f99301514e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f99300a8af0 tx=0x7f992801ea80 comp rx=0 tx=0).stop 2023-12-16T03:28:31.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 -- 172.21.15.28:0/614373495 shutdown_connections 2023-12-16T03:28:31.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 --2- 172.21.15.28:0/614373495 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9930072090 0x7f99301514e0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 --2- 172.21.15.28:0/614373495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99300c4110 0x7f9930150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 --2- 172.21.15.28:0/614373495 >> v2:172.21.15.134:3300/0 conn(0x7f99300a5370 0x7f99300c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 -- 172.21.15.28:0/614373495 >> 172.21.15.28:0/614373495 conn(0x7f993006a5b0 msgr2=0x7f993006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:31.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 -- 172.21.15.28:0/614373495 shutdown_connections 2023-12-16T03:28:31.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 -- 172.21.15.28:0/614373495 wait complete. 2023-12-16T03:28:31.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 Processor -- start 2023-12-16T03:28:31.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 -- start start 2023-12-16T03:28:31.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9930072090 0x7f99300a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99300a5370 0x7f9930153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99300c4110 0x7f99301f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9930152780 con 0x7f99300c4110 2023-12-16T03:28:31.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99300a8460 con 0x7f99300a5370 2023-12-16T03:28:31.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f99384c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99300c0d70 con 0x7f9930072090 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f9936a66640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99300c4110 0x7f99301f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f9936a66640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99300c4110 0x7f99301f0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42038/0 (socket says 172.21.15.28:42038) 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f9936a66640 1 -- 172.21.15.28:0/126892939 learned_addr learned my addr 172.21.15.28:0/126892939 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f9936265640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9930072090 0x7f99300a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f9935a64640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99300a5370 0x7f9930153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f9936a66640 1 -- 172.21.15.28:0/126892939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9930072090 msgr2=0x7f99300a9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f9936a66640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9930072090 0x7f99300a9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f9936a66640 1 -- 172.21.15.28:0/126892939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99300a5370 msgr2=0x7f9930153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f9936a66640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99300a5370 0x7f9930153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.562+0000 7f9936a66640 1 -- 172.21.15.28:0/126892939 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992800bd40 con 0x7f99300c4110 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.566+0000 7f9936a66640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99300c4110 0x7f99301f0070 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f99280b3040 tx=0x7f992801d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.566+0000 7f9926ffd640 1 -- 172.21.15.28:0/126892939 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99280bf070 con 0x7f99300c4110 2023-12-16T03:28:31.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.566+0000 7f9926ffd640 1 -- 172.21.15.28:0/126892939 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992800b720 con 0x7f99300c4110 2023-12-16T03:28:31.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.566+0000 7f9926ffd640 1 -- 172.21.15.28:0/126892939 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99280bb430 con 0x7f99300c4110 2023-12-16T03:28:31.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.566+0000 7f99384c9640 1 -- 172.21.15.28:0/126892939 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99300a86b0 con 0x7f99300c4110 2023-12-16T03:28:31.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.566+0000 7f99384c9640 1 -- 172.21.15.28:0/126892939 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9930152170 con 0x7f99300c4110 2023-12-16T03:28:31.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.566+0000 7f99384c9640 1 -- 172.21.15.28:0/126892939 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9930152360 con 0x7f99300c4110 2023-12-16T03:28:31.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.566+0000 7f9926ffd640 1 -- 172.21.15.28:0/126892939 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f99280bb590 con 0x7f99300c4110 2023-12-16T03:28:31.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.566+0000 7f9926ffd640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9914066470 0x7f9914068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.566+0000 7f9926ffd640 1 -- 172.21.15.28:0/126892939 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f992811e610 con 0x7f99300c4110 2023-12-16T03:28:31.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.566+0000 7f9936265640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9914066470 0x7f9914068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.570+0000 7f9936265640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9914066470 0x7f9914068930 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f992c009ae0 tx=0x7f992c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:31.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.570+0000 7f9926ffd640 1 -- 172.21.15.28:0/126892939 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f99280eb7c0 con 0x7f99300c4110 2023-12-16T03:28:31.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 -- 172.21.15.28:0/126892939 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9930068400 con 0x7f99300c4110 2023-12-16T03:28:31.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f9926ffd640 1 -- 172.21.15.28:0/126892939 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99280eede0 con 0x7f99300c4110 2023-12-16T03:28:31.739 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:31.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 -- 172.21.15.28:0/126892939 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9914066470 msgr2=0x7f9914068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9914066470 0x7f9914068930 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f992c009ae0 tx=0x7f992c009190 comp rx=0 tx=0).stop 2023-12-16T03:28:31.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 -- 172.21.15.28:0/126892939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99300c4110 msgr2=0x7f99301f0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99300c4110 0x7f99301f0070 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f99280b3040 tx=0x7f992801d2c0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 -- 172.21.15.28:0/126892939 shutdown_connections 2023-12-16T03:28:31.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9914066470 0x7f9914068930 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99300c4110 0x7f99301f0070 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99300a5370 0x7f9930153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 --2- 172.21.15.28:0/126892939 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9930072090 0x7f99300a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 -- 172.21.15.28:0/126892939 >> 172.21.15.28:0/126892939 conn(0x7f993006a5b0 msgr2=0x7f993006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:31.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.734+0000 7f99384c9640 1 -- 172.21.15.28:0/126892939 shutdown_connections 2023-12-16T03:28:31.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.738+0000 7f99384c9640 1 -- 172.21.15.28:0/126892939 wait complete. 2023-12-16T03:28:31.760 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:28:31.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.902+0000 7fbbc6417640 1 Processor -- start 2023-12-16T03:28:31.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.902+0000 7fbbc6417640 1 -- start start 2023-12-16T03:28:31.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.902+0000 7fbbc6417640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbbc00c4100 0x7fbbc00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.902+0000 7fbbc6417640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc00c31c0 con 0x7fbbc00c06d0 2023-12-16T03:28:31.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.902+0000 7fbbc6417640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc00c34a0 con 0x7fbbc00c63c0 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.902+0000 7fbbc6417640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc00c1030 con 0x7fbbc00c4100 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.902+0000 7fbbc49b4640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbbc00c06d0 0x7fbbc00a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36584/0 (socket says 172.21.15.28:36584) 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.902+0000 7fbbc49b4640 1 -- 172.21.15.28:0/2127840604 learned_addr learned my addr 172.21.15.28:0/2127840604 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbf7fe640 1 --2- 172.21.15.28:0/2127840604 >> v2:172.21.15.134:3300/0 conn(0x7fbbc00c4100 0x7fbbc00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852360184 0 0) 0x7fbbc00c31c0 con 0x7fbbc00c06d0 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba8005740 con 0x7fbbc00c06d0 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269328028 0 0) 0x7fbbc00c34a0 con 0x7fbbc00c63c0 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc00c31c0 con 0x7fbbc00c63c0 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2289916436 0 0) 0x7fbba8005740 con 0x7fbbc00c06d0 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 >> v2:172.21.15.134:3300/0 conn(0x7fbbc00c4100 msgr2=0x7fbbc00c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 --2- 172.21.15.28:0/2127840604 >> v2:172.21.15.134:3300/0 conn(0x7fbbc00c4100 0x7fbbc00c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 >> v1:172.21.15.134:6789/0 conn(0x7fbbc00c63c0 legacy=0x7fbbc00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc00c1310 con 0x7fbbc00c06d0 2023-12-16T03:28:31.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fbbb8001a20 con 0x7fbbc00c06d0 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 >> v1:172.21.15.28:6789/0 conn(0x7fbbc00c06d0 legacy=0x7fbbc00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 --2- 172.21.15.28:0/2127840604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba8005d20 0x7fbba8006120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 --2- 172.21.15.28:0/2127840604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba80069e0 0x7fbba8006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 --2- 172.21.15.28:0/2127840604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba8007410 0x7fbba800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00c1030 con 0x7fbba80069e0 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba800e370 con 0x7fbba8007410 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba800e530 con 0x7fbba8005d20 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbf7fe640 1 --2- 172.21.15.28:0/2127840604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba80069e0 0x7fbba8006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbffff640 1 --2- 172.21.15.28:0/2127840604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba8005d20 0x7fbba8006120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbc49b4640 1 --2- 172.21.15.28:0/2127840604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba8007410 0x7fbba800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbf7fe640 1 -- 172.21.15.28:0/2127840604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba8005d20 msgr2=0x7fbba8006120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbf7fe640 1 --2- 172.21.15.28:0/2127840604 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba8005d20 0x7fbba8006120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbf7fe640 1 -- 172.21.15.28:0/2127840604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba8007410 msgr2=0x7fbba800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:31.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbf7fe640 1 --2- 172.21.15.28:0/2127840604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbba8007410 0x7fbba800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbbf7fe640 1 -- 172.21.15.28:0/2127840604 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8005740 con 0x7fbba80069e0 2023-12-16T03:28:31.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.906+0000 7fbbc49b4640 1 -- 172.21.15.28:0/2127840604 reap_dead start 2023-12-16T03:28:31.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbbf7fe640 1 --2- 172.21.15.28:0/2127840604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba80069e0 0x7fbba8006e60 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009ab0 tx=0x7fbbb401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd11451dbd79f01 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:31.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40a5510 con 0x7fbba80069e0 2023-12-16T03:28:31.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb40a5670 con 0x7fbba80069e0 2023-12-16T03:28:31.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbbeffd640 1 -- 172.21.15.28:0/2127840604 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40a5a20 con 0x7fbba80069e0 2023-12-16T03:28:31.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 -- 172.21.15.28:0/2127840604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba80069e0 msgr2=0x7fbba8006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 --2- 172.21.15.28:0/2127840604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba80069e0 0x7fbba8006e60 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009ab0 tx=0x7fbbb401ca30 comp rx=0 tx=0).stop 2023-12-16T03:28:31.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 -- 172.21.15.28:0/2127840604 shutdown_connections 2023-12-16T03:28:31.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 --2- 172.21.15.28:0/2127840604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbba80069e0 0x7fbba8006e60 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 -- 172.21.15.28:0/2127840604 >> 172.21.15.28:0/2127840604 conn(0x7fbbc006a5b0 msgr2=0x7fbbc006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:31.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 -- 172.21.15.28:0/2127840604 shutdown_connections 2023-12-16T03:28:31.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 -- 172.21.15.28:0/2127840604 wait complete. 2023-12-16T03:28:31.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 Processor -- start 2023-12-16T03:28:31.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 -- start start 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba80069e0 0x7fbbc0152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc01e2180 0x7fbbc0153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc0099a70 0x7fbbc01f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00a4cf0 con 0x7fbbc01e2180 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc01f1400 con 0x7fbbc0099a70 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.910+0000 7fbbc6417640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00a4730 con 0x7fbba80069e0 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbf7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc01e2180 0x7fbbc0153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbf7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc01e2180 0x7fbbc0153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42056/0 (socket says 172.21.15.28:42056) 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbf7fe640 1 -- 172.21.15.28:0/2930555424 learned_addr learned my addr 172.21.15.28:0/2930555424 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbffff640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba80069e0 0x7fbbc0152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbc49b4640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc0099a70 0x7fbbc01f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbf7fe640 1 -- 172.21.15.28:0/2930555424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba80069e0 msgr2=0x7fbbc0152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbf7fe640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba80069e0 0x7fbbc0152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbf7fe640 1 -- 172.21.15.28:0/2930555424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc0099a70 msgr2=0x7fbbc01f07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:31.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbf7fe640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc0099a70 0x7fbbc01f07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:31.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbf7fe640 1 -- 172.21.15.28:0/2930555424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc00a4a10 con 0x7fbbc01e2180 2023-12-16T03:28:31.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbf7fe640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc01e2180 0x7fbbc0153400 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009ab0 tx=0x7fbbb40197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:31.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbcff9640 1 -- 172.21.15.28:0/2930555424 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40a5510 con 0x7fbbc01e2180 2023-12-16T03:28:31.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbcff9640 1 -- 172.21.15.28:0/2930555424 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb40b6460 con 0x7fbbc01e2180 2023-12-16T03:28:31.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbcff9640 1 -- 172.21.15.28:0/2930555424 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40b6810 con 0x7fbbc01e2180 2023-12-16T03:28:31.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbc6417640 1 -- 172.21.15.28:0/2930555424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc006ff60 con 0x7fbbc01e2180 2023-12-16T03:28:31.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbc6417640 1 -- 172.21.15.28:0/2930555424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc01f0d20 con 0x7fbbc01e2180 2023-12-16T03:28:31.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbc6417640 1 -- 172.21.15.28:0/2930555424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc00700f0 con 0x7fbbc01e2180 2023-12-16T03:28:31.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.914+0000 7fbbbcff9640 1 -- 172.21.15.28:0/2930555424 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbbb40b4070 con 0x7fbbc01e2180 2023-12-16T03:28:31.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.918+0000 7fbbbcff9640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbac0664a0 0x7fbbac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:31.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.918+0000 7fbbbcff9640 1 -- 172.21.15.28:0/2930555424 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbbb411d9d0 con 0x7fbbc01e2180 2023-12-16T03:28:31.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.918+0000 7fbbbffff640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbac0664a0 0x7fbbac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:31.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.918+0000 7fbbbffff640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbac0664a0 0x7fbbac068960 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00010f0 tx=0x7fbbb0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:31.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:31.922+0000 7fbbbcff9640 1 -- 172.21.15.28:0/2930555424 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fbbb40eab90 con 0x7fbbc01e2180 2023-12-16T03:28:32.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 -- 172.21.15.28:0/2930555424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbbc0068400 con 0x7fbbc01e2180 2023-12-16T03:28:32.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbbcff9640 1 -- 172.21.15.28:0/2930555424 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbbb40bd0a0 con 0x7fbbc01e2180 2023-12-16T03:28:32.081 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:32.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 -- 172.21.15.28:0/2930555424 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbac0664a0 msgr2=0x7fbbac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbac0664a0 0x7fbbac068960 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00010f0 tx=0x7fbbb0009040 comp rx=0 tx=0).stop 2023-12-16T03:28:32.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 -- 172.21.15.28:0/2930555424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc01e2180 msgr2=0x7fbbc0153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc01e2180 0x7fbbc0153400 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009ab0 tx=0x7fbbb40197d0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 -- 172.21.15.28:0/2930555424 shutdown_connections 2023-12-16T03:28:32.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbc0099a70 0x7fbbc01f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbbac0664a0 0x7fbbac068960 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbc01e2180 0x7fbbc0153400 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 --2- 172.21.15.28:0/2930555424 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbba80069e0 0x7fbbc0152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 -- 172.21.15.28:0/2930555424 >> 172.21.15.28:0/2930555424 conn(0x7fbbc006a5b0 msgr2=0x7fbbc0155310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:32.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 -- 172.21.15.28:0/2930555424 shutdown_connections 2023-12-16T03:28:32.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.078+0000 7fbbc6417640 1 -- 172.21.15.28:0/2930555424 wait complete. 2023-12-16T03:28:32.103 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:28:32.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe7965640 1 Processor -- start 2023-12-16T03:28:32.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe7965640 1 -- start start 2023-12-16T03:28:32.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe7965640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbfe01560e0 0x7fbfe015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe7965640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbfe00bffc0 0x7fbfe00c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe7965640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe015c600 con 0x7fbfe006d520 2023-12-16T03:28:32.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe7965640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe015a5c0 con 0x7fbfe00bffc0 2023-12-16T03:28:32.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe7965640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe01594e0 con 0x7fbfe01560e0 2023-12-16T03:28:32.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe4f00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbfe006d520 0x7fbfe0159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36590/0 (socket says 172.21.15.28:36590) 2023-12-16T03:28:32.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe4f00640 1 -- 172.21.15.28:0/3299451835 learned_addr learned my addr 172.21.15.28:0/3299451835 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:32.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe5f02640 1 --2- 172.21.15.28:0/3299451835 >> v2:172.21.15.28:3300/0 conn(0x7fbfe00bffc0 0x7fbfe00c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe5701640 1 --2- 172.21.15.28:0/3299451835 >> v2:172.21.15.134:3300/0 conn(0x7fbfe01560e0 0x7fbfe015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfd7fff640 1 -- 172.21.15.28:0/3299451835 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596547010 0 0) 0x7fbfe015c600 con 0x7fbfe006d520 2023-12-16T03:28:32.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe5f02640 1 -- 172.21.15.28:0/3299451835 >> v2:172.21.15.134:3300/0 conn(0x7fbfe01560e0 msgr2=0x7fbfe015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:32.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe5f02640 1 --2- 172.21.15.28:0/3299451835 >> v2:172.21.15.134:3300/0 conn(0x7fbfe01560e0 0x7fbfe015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe5f02640 1 -- 172.21.15.28:0/3299451835 >> v1:172.21.15.28:6789/0 conn(0x7fbfe006d520 legacy=0x7fbfe0159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.246+0000 7fbfe5f02640 1 -- 172.21.15.28:0/3299451835 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe01597c0 con 0x7fbfe00bffc0 2023-12-16T03:28:32.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfe5f02640 1 --2- 172.21.15.28:0/3299451835 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00bffc0 0x7fbfe00c1bf0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fbfe006b390 tx=0x7fbfd801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61a96793eb37a33 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:32.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfd7fff640 1 -- 172.21.15.28:0/3299451835 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80a58b0 con 0x7fbfe00bffc0 2023-12-16T03:28:32.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfd7fff640 1 -- 172.21.15.28:0/3299451835 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd80a5a10 con 0x7fbfe00bffc0 2023-12-16T03:28:32.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfd7fff640 1 -- 172.21.15.28:0/3299451835 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80a5da0 con 0x7fbfe00bffc0 2023-12-16T03:28:32.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfe7965640 1 -- 172.21.15.28:0/3299451835 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00bffc0 msgr2=0x7fbfe00c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfe7965640 1 --2- 172.21.15.28:0/3299451835 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00bffc0 0x7fbfe00c1bf0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fbfe006b390 tx=0x7fbfd801c8e0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfe7965640 1 -- 172.21.15.28:0/3299451835 shutdown_connections 2023-12-16T03:28:32.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfe7965640 1 --2- 172.21.15.28:0/3299451835 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00bffc0 0x7fbfe00c1bf0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfe7965640 1 --2- 172.21.15.28:0/3299451835 >> v2:172.21.15.134:3300/0 conn(0x7fbfe01560e0 0x7fbfe015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfe7965640 1 -- 172.21.15.28:0/3299451835 >> 172.21.15.28:0/3299451835 conn(0x7fbfe006a5b0 msgr2=0x7fbfe006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:32.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfe7965640 1 -- 172.21.15.28:0/3299451835 shutdown_connections 2023-12-16T03:28:32.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.250+0000 7fbfe7965640 1 -- 172.21.15.28:0/3299451835 wait complete. 2023-12-16T03:28:32.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe7965640 1 Processor -- start 2023-12-16T03:28:32.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe7965640 1 -- start start 2023-12-16T03:28:32.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe7965640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe006d520 0x7fbfe01f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe7965640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe00bffc0 0x7fbfe00aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe7965640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe01560e0 0x7fbfe01f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe7965640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00a96e0 con 0x7fbfe01560e0 2023-12-16T03:28:32.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe7965640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00a91e0 con 0x7fbfe006d520 2023-12-16T03:28:32.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe7965640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00a8f00 con 0x7fbfe00bffc0 2023-12-16T03:28:32.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe5f02640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe01560e0 0x7fbfe01f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe5f02640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe01560e0 0x7fbfe01f4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42082/0 (socket says 172.21.15.28:42082) 2023-12-16T03:28:32.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe5f02640 1 -- 172.21.15.28:0/1781868816 learned_addr learned my addr 172.21.15.28:0/1781868816 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:32.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe4f00640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe00bffc0 0x7fbfe00aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe5701640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe006d520 0x7fbfe01f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe5f02640 1 -- 172.21.15.28:0/1781868816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe00bffc0 msgr2=0x7fbfe00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe5f02640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe00bffc0 0x7fbfe00aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe5f02640 1 -- 172.21.15.28:0/1781868816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe006d520 msgr2=0x7fbfe01f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe5f02640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe006d520 0x7fbfe01f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe5f02640 1 -- 172.21.15.28:0/1781868816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8009a70 con 0x7fbfe01560e0 2023-12-16T03:28:32.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe5f02640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe01560e0 0x7fbfe01f4b80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80194f0 tx=0x7fbfd8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:32.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfd5ffb640 1 -- 172.21.15.28:0/1781868816 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80b9860 con 0x7fbfe01560e0 2023-12-16T03:28:32.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfd5ffb640 1 -- 172.21.15.28:0/1781868816 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd80b99c0 con 0x7fbfe01560e0 2023-12-16T03:28:32.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfd5ffb640 1 -- 172.21.15.28:0/1781868816 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80b9d70 con 0x7fbfe01560e0 2023-12-16T03:28:32.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe7965640 1 -- 172.21.15.28:0/1781868816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe01f1720 con 0x7fbfe01560e0 2023-12-16T03:28:32.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.254+0000 7fbfe7965640 1 -- 172.21.15.28:0/1781868816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe01f1ce0 con 0x7fbfe01560e0 2023-12-16T03:28:32.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.258+0000 7fbfe7965640 1 -- 172.21.15.28:0/1781868816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe0068400 con 0x7fbfe01560e0 2023-12-16T03:28:32.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.258+0000 7fbfd5ffb640 1 -- 172.21.15.28:0/1781868816 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbfd80ad440 con 0x7fbfe01560e0 2023-12-16T03:28:32.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.258+0000 7fbfd5ffb640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 0x7fbfc4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.258+0000 7fbfd5ffb640 1 -- 172.21.15.28:0/1781868816 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbfd811f4e0 con 0x7fbfe01560e0 2023-12-16T03:28:32.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.258+0000 7fbfe5701640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 0x7fbfc4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.258+0000 7fbfe5701640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 0x7fbfc4068930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0079c0 tx=0x7fbfdc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:32.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.262+0000 7fbfd5ffb640 1 -- 172.21.15.28:0/1781868816 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fbfd80ec6a0 con 0x7fbfe01560e0 2023-12-16T03:28:32.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.418+0000 7fbfe7965640 1 -- 172.21.15.28:0/1781868816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbfe0164130 con 0x7fbfe01560e0 2023-12-16T03:28:32.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.418+0000 7fbfd5ffb640 1 -- 172.21.15.28:0/1781868816 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7fbfd80efcc0 con 0x7fbfe01560e0 2023-12-16T03:28:32.423 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 -- 172.21.15.28:0/1781868816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 msgr2=0x7fbfc4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 0x7fbfc4068930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0079c0 tx=0x7fbfdc008040 comp rx=0 tx=0).stop 2023-12-16T03:28:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 -- 172.21.15.28:0/1781868816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe01560e0 msgr2=0x7fbfe01f4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe01560e0 0x7fbfe01f4b80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80194f0 tx=0x7fbfd8019680 comp rx=0 tx=0).stop 2023-12-16T03:28:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 -- 172.21.15.28:0/1781868816 shutdown_connections 2023-12-16T03:28:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 0x7fbfc4068930 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe01560e0 0x7fbfe01f4b80 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe00bffc0 0x7fbfe00aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 --2- 172.21.15.28:0/1781868816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe006d520 0x7fbfe01f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 -- 172.21.15.28:0/1781868816 >> 172.21.15.28:0/1781868816 conn(0x7fbfe006a5b0 msgr2=0x7fbfe0070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:32.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 -- 172.21.15.28:0/1781868816 shutdown_connections 2023-12-16T03:28:32.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.422+0000 7fbfe7965640 1 -- 172.21.15.28:0/1781868816 wait complete. 2023-12-16T03:28:32.444 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:28:32.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.586+0000 7fed8359e640 1 Processor -- start 2023-12-16T03:28:32.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.586+0000 7fed8359e640 1 -- start start 2023-12-16T03:28:32.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed8359e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fed8414f800 0x7fed84072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed8359e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fed84072860 0x7fed8406fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed8359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed840c1010 0x7fed84155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed8359e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed84071e90 con 0x7fed84072860 2023-12-16T03:28:32.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed8359e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed840a5110 con 0x7fed8414f800 2023-12-16T03:28:32.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed8359e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed84152d70 con 0x7fed840c1010 2023-12-16T03:28:32.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed7bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fed84072860 0x7fed8406fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed7bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fed84072860 0x7fed8406fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42092/0 (socket says 172.21.15.28:42092) 2023-12-16T03:28:32.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed7bfff640 1 -- 172.21.15.28:0/3739259974 learned_addr learned my addr 172.21.15.28:0/3739259974 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:32.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed82d9d640 1 --2- 172.21.15.28:0/3739259974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed840c1010 0x7fed84155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed8259c640 1 --2- 172.21.15.28:0/3739259974 >> v2:172.21.15.134:3300/0 conn(0x7fed8414f800 0x7fed84072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed7bfff640 1 -- 172.21.15.28:0/3739259974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed840c1010 msgr2=0x7fed84155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:32.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed7bfff640 1 --2- 172.21.15.28:0/3739259974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed840c1010 0x7fed84155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed7bfff640 1 -- 172.21.15.28:0/3739259974 >> v2:172.21.15.134:3300/0 conn(0x7fed8414f800 msgr2=0x7fed84072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:32.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed7bfff640 1 --2- 172.21.15.28:0/3739259974 >> v2:172.21.15.134:3300/0 conn(0x7fed8414f800 0x7fed84072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed7bfff640 1 -- 172.21.15.28:0/3739259974 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84153050 con 0x7fed84072860 2023-12-16T03:28:32.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.590+0000 7fed82d9d640 1 --2- 172.21.15.28:0/3739259974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed840c1010 0x7fed84155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:32.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed7bfff640 1 --2- 172.21.15.28:0/3739259974 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed84072860 0x7fed8406fd40 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fed8406f8d0 tx=0x7fed6c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6674399717129bfc server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:32.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed81d9b640 1 -- 172.21.15.28:0/3739259974 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0ab620 con 0x7fed84072860 2023-12-16T03:28:32.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed81d9b640 1 -- 172.21.15.28:0/3739259974 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c0ab780 con 0x7fed84072860 2023-12-16T03:28:32.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed81d9b640 1 -- 172.21.15.28:0/3739259974 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0abb10 con 0x7fed84072860 2023-12-16T03:28:32.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 -- 172.21.15.28:0/3739259974 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed84072860 msgr2=0x7fed8406fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 --2- 172.21.15.28:0/3739259974 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed84072860 0x7fed8406fd40 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fed8406f8d0 tx=0x7fed6c01c440 comp rx=0 tx=0).stop 2023-12-16T03:28:32.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 -- 172.21.15.28:0/3739259974 shutdown_connections 2023-12-16T03:28:32.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 --2- 172.21.15.28:0/3739259974 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed840c1010 0x7fed84155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 --2- 172.21.15.28:0/3739259974 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed84072860 0x7fed8406fd40 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 --2- 172.21.15.28:0/3739259974 >> v2:172.21.15.134:3300/0 conn(0x7fed8414f800 0x7fed84072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 -- 172.21.15.28:0/3739259974 >> 172.21.15.28:0/3739259974 conn(0x7fed840a7800 msgr2=0x7fed840a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:32.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 -- 172.21.15.28:0/3739259974 shutdown_connections 2023-12-16T03:28:32.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 -- 172.21.15.28:0/3739259974 wait complete. 2023-12-16T03:28:32.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 Processor -- start 2023-12-16T03:28:32.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 -- start start 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed84072860 0x7fed840c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed840c1010 0x7fed841eadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8414f800 0x7fed841eb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed840ab6b0 con 0x7fed840c1010 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed841509b0 con 0x7fed8414f800 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.594+0000 7fed8359e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed84150240 con 0x7fed84072860 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed840c1010 0x7fed841eadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed840c1010 0x7fed841eadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42102/0 (socket says 172.21.15.28:42102) 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7bfff640 1 -- 172.21.15.28:0/195811286 learned_addr learned my addr 172.21.15.28:0/195811286 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed8259c640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed84072860 0x7fed840c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed82d9d640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8414f800 0x7fed841eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7bfff640 1 -- 172.21.15.28:0/195811286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed84072860 msgr2=0x7fed840c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7bfff640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed84072860 0x7fed840c2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7bfff640 1 -- 172.21.15.28:0/195811286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8414f800 msgr2=0x7fed841eb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7bfff640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8414f800 0x7fed841eb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7bfff640 1 -- 172.21.15.28:0/195811286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c0094d0 con 0x7fed840c1010 2023-12-16T03:28:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7bfff640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed840c1010 0x7fed841eadc0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fed6c01aaf0 tx=0x7fed6c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7affd640 1 -- 172.21.15.28:0/195811286 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0be3f0 con 0x7fed840c1010 2023-12-16T03:28:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7affd640 1 -- 172.21.15.28:0/195811286 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c0be550 con 0x7fed840c1010 2023-12-16T03:28:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed8359e640 1 -- 172.21.15.28:0/195811286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed840ab340 con 0x7fed840c1010 2023-12-16T03:28:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7affd640 1 -- 172.21.15.28:0/195811286 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0be900 con 0x7fed840c1010 2023-12-16T03:28:32.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed8359e640 1 -- 172.21.15.28:0/195811286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8414fdf0 con 0x7fed840c1010 2023-12-16T03:28:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed8359e640 1 -- 172.21.15.28:0/195811286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed840ab860 con 0x7fed840c1010 2023-12-16T03:28:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7affd640 1 -- 172.21.15.28:0/195811286 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fed6c0c7440 con 0x7fed840c1010 2023-12-16T03:28:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.598+0000 7fed7affd640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed640664a0 0x7fed64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.602+0000 7fed7affd640 1 -- 172.21.15.28:0/195811286 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fed6c11ea20 con 0x7fed840c1010 2023-12-16T03:28:32.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.602+0000 7fed8259c640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed640664a0 0x7fed64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.602+0000 7fed8259c640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed640664a0 0x7fed64068960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fed841499c0 tx=0x7fed74008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:32.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.602+0000 7fed7affd640 1 -- 172.21.15.28:0/195811286 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fed6c0ebbe0 con 0x7fed840c1010 2023-12-16T03:28:32.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 -- 172.21.15.28:0/195811286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fed840ab4d0 con 0x7fed840c1010 2023-12-16T03:28:32.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed7affd640 1 -- 172.21.15.28:0/195811286 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7fed6c0ef200 con 0x7fed840c1010 2023-12-16T03:28:32.767 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:32.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 -- 172.21.15.28:0/195811286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed640664a0 msgr2=0x7fed64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed640664a0 0x7fed64068960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fed841499c0 tx=0x7fed74008040 comp rx=0 tx=0).stop 2023-12-16T03:28:32.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 -- 172.21.15.28:0/195811286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed840c1010 msgr2=0x7fed841eadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed840c1010 0x7fed841eadc0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fed6c01aaf0 tx=0x7fed6c01ac80 comp rx=0 tx=0).stop 2023-12-16T03:28:32.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 -- 172.21.15.28:0/195811286 shutdown_connections 2023-12-16T03:28:32.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8414f800 0x7fed841eb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fed640664a0 0x7fed64068960 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed840c1010 0x7fed841eadc0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 --2- 172.21.15.28:0/195811286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fed84072860 0x7fed840c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 -- 172.21.15.28:0/195811286 >> 172.21.15.28:0/195811286 conn(0x7fed840a7800 msgr2=0x7fed840c47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:32.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 -- 172.21.15.28:0/195811286 shutdown_connections 2023-12-16T03:28:32.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.762+0000 7fed8359e640 1 -- 172.21.15.28:0/195811286 wait complete. 2023-12-16T03:28:32.788 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:28:32.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e88d5640 1 Processor -- start 2023-12-16T03:28:32.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e88d5640 1 -- start start 2023-12-16T03:28:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e88d5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa3e406c0c0 0x7fa3e415ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e88d5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e4151ff0 con 0x7fa3e40c82b0 2023-12-16T03:28:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e88d5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e4155160 con 0x7fa3e40c7ed0 2023-12-16T03:28:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e88d5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e40c8730 con 0x7fa3e406c0c0 2023-12-16T03:28:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e259c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa3e40c82b0 0x7fa3e406b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36600/0 (socket says 172.21.15.28:36600) 2023-12-16T03:28:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e259c640 1 -- 172.21.15.28:0/3461827382 learned_addr learned my addr 172.21.15.28:0/3461827382 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e359e640 1 --2- 172.21.15.28:0/3461827382 >> v2:172.21.15.134:3300/0 conn(0x7fa3e406c0c0 0x7fa3e415ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e1d9b640 1 -- 172.21.15.28:0/3461827382 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378130634 0 0) 0x7fa3d8001120 con 0x7fa3e40c82b0 2023-12-16T03:28:32.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e1d9b640 1 -- 172.21.15.28:0/3461827382 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3cc003530 con 0x7fa3e40c82b0 2023-12-16T03:28:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e1d9b640 1 -- 172.21.15.28:0/3461827382 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414742869 0 0) 0x7fa3e4155160 con 0x7fa3e40c7ed0 2023-12-16T03:28:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e1d9b640 1 -- 172.21.15.28:0/3461827382 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d8001120 con 0x7fa3e40c7ed0 2023-12-16T03:28:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e359e640 1 -- 172.21.15.28:0/3461827382 >> v1:172.21.15.134:6789/0 conn(0x7fa3e40c7ed0 legacy=0x7fa3e40c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e359e640 1 -- 172.21.15.28:0/3461827382 >> v1:172.21.15.28:6789/0 conn(0x7fa3e40c82b0 legacy=0x7fa3e406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.930+0000 7fa3e359e640 1 -- 172.21.15.28:0/3461827382 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40c7760 con 0x7fa3e406c0c0 2023-12-16T03:28:32.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.934+0000 7fa3e359e640 1 --2- 172.21.15.28:0/3461827382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e406c0c0 0x7fa3e415ff00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009d90 tx=0x7fa3dc01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab42f8cdc6afd0c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:32.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.934+0000 7fa3e1d9b640 1 -- 172.21.15.28:0/3461827382 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0a59a0 con 0x7fa3e406c0c0 2023-12-16T03:28:32.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.934+0000 7fa3e1d9b640 1 -- 172.21.15.28:0/3461827382 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc0a5b00 con 0x7fa3e406c0c0 2023-12-16T03:28:32.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.934+0000 7fa3e1d9b640 1 -- 172.21.15.28:0/3461827382 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0a5e90 con 0x7fa3e406c0c0 2023-12-16T03:28:32.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.934+0000 7fa3e88d5640 1 -- 172.21.15.28:0/3461827382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e406c0c0 msgr2=0x7fa3e415ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.934+0000 7fa3e88d5640 1 --2- 172.21.15.28:0/3461827382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e406c0c0 0x7fa3e415ff00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009d90 tx=0x7fa3dc01c8c0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.934+0000 7fa3e88d5640 1 -- 172.21.15.28:0/3461827382 shutdown_connections 2023-12-16T03:28:32.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.934+0000 7fa3e88d5640 1 --2- 172.21.15.28:0/3461827382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e406c0c0 0x7fa3e415ff00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.934+0000 7fa3e88d5640 1 -- 172.21.15.28:0/3461827382 >> 172.21.15.28:0/3461827382 conn(0x7fa3e40ab940 msgr2=0x7fa3e40abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:32.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.934+0000 7fa3e88d5640 1 -- 172.21.15.28:0/3461827382 shutdown_connections 2023-12-16T03:28:32.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.934+0000 7fa3e88d5640 1 -- 172.21.15.28:0/3461827382 wait complete. 2023-12-16T03:28:32.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e88d5640 1 Processor -- start 2023-12-16T03:28:32.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e88d5640 1 -- start start 2023-12-16T03:28:32.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e88d5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3e406c0c0 0x7fa3e4151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e88d5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e40c7ed0 0x7fa3e413cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e88d5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3e40c82b0 0x7fa3e40aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e88d5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e4150280 con 0x7fa3e40c82b0 2023-12-16T03:28:32.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e88d5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e414f790 con 0x7fa3e40c7ed0 2023-12-16T03:28:32.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e88d5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e414fd50 con 0x7fa3e406c0c0 2023-12-16T03:28:32.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3e40c82b0 0x7fa3e40aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3e40c82b0 0x7fa3e40aa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42112/0 (socket says 172.21.15.28:42112) 2023-12-16T03:28:32.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e359e640 1 -- 172.21.15.28:0/2250648403 learned_addr learned my addr 172.21.15.28:0/2250648403 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:32.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e2d9d640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3e406c0c0 0x7fa3e4151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e259c640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e40c7ed0 0x7fa3e413cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e359e640 1 -- 172.21.15.28:0/2250648403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3e406c0c0 msgr2=0x7fa3e4151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e359e640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3e406c0c0 0x7fa3e4151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e359e640 1 -- 172.21.15.28:0/2250648403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e40c7ed0 msgr2=0x7fa3e413cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:32.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e359e640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e40c7ed0 0x7fa3e413cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:32.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e359e640 1 -- 172.21.15.28:0/2250648403 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc009a70 con 0x7fa3e40c82b0 2023-12-16T03:28:32.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e359e640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3e40c82b0 0x7fa3e40aa870 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0b0040 tx=0x7fa3dc019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:32.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3cb7fe640 1 -- 172.21.15.28:0/2250648403 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0a59a0 con 0x7fa3e40c82b0 2023-12-16T03:28:32.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3cb7fe640 1 -- 172.21.15.28:0/2250648403 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc009450 con 0x7fa3e40c82b0 2023-12-16T03:28:32.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3cb7fe640 1 -- 172.21.15.28:0/2250648403 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0b9690 con 0x7fa3e40c82b0 2023-12-16T03:28:32.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e88d5640 1 -- 172.21.15.28:0/2250648403 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e41f0f20 con 0x7fa3e40c82b0 2023-12-16T03:28:32.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.938+0000 7fa3e88d5640 1 -- 172.21.15.28:0/2250648403 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e414f9e0 con 0x7fa3e40c82b0 2023-12-16T03:28:32.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.942+0000 7fa3e88d5640 1 -- 172.21.15.28:0/2250648403 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e41f13d0 con 0x7fa3e40c82b0 2023-12-16T03:28:32.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.942+0000 7fa3cb7fe640 1 -- 172.21.15.28:0/2250648403 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa3dc0b97f0 con 0x7fa3e40c82b0 2023-12-16T03:28:32.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.942+0000 7fa3cb7fe640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3d0066470 0x7fa3d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:32.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.942+0000 7fa3cb7fe640 1 -- 172.21.15.28:0/2250648403 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa3dc11f7c0 con 0x7fa3e40c82b0 2023-12-16T03:28:32.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.942+0000 7fa3e2d9d640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3d0066470 0x7fa3d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:32.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.942+0000 7fa3e2d9d640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3d0066470 0x7fa3d0068930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40011f0 tx=0x7fa3d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:32.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:32.946+0000 7fa3cb7fe640 1 -- 172.21.15.28:0/2250648403 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa3dc0eca20 con 0x7fa3e40c82b0 2023-12-16T03:28:33.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 -- 172.21.15.28:0/2250648403 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa3e41ecf50 con 0x7fa3e40c82b0 2023-12-16T03:28:33.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3cb7fe640 1 -- 172.21.15.28:0/2250648403 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa3dc0f0040 con 0x7fa3e40c82b0 2023-12-16T03:28:33.122 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:28:33.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 -- 172.21.15.28:0/2250648403 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3d0066470 msgr2=0x7fa3d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3d0066470 0x7fa3d0068930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40011f0 tx=0x7fa3d4009040 comp rx=0 tx=0).stop 2023-12-16T03:28:33.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 -- 172.21.15.28:0/2250648403 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3e40c82b0 msgr2=0x7fa3e40aa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3e40c82b0 0x7fa3e40aa870 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0b0040 tx=0x7fa3dc019660 comp rx=0 tx=0).stop 2023-12-16T03:28:33.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 -- 172.21.15.28:0/2250648403 shutdown_connections 2023-12-16T03:28:33.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa3d0066470 0x7fa3d0068930 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa3e40c82b0 0x7fa3e40aa870 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e40c7ed0 0x7fa3e413cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 --2- 172.21.15.28:0/2250648403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3e406c0c0 0x7fa3e4151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 -- 172.21.15.28:0/2250648403 >> 172.21.15.28:0/2250648403 conn(0x7fa3e40ab940 msgr2=0x7fa3e4153140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:33.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 -- 172.21.15.28:0/2250648403 shutdown_connections 2023-12-16T03:28:33.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.118+0000 7fa3e88d5640 1 -- 172.21.15.28:0/2250648403 wait complete. 2023-12-16T03:28:33.143 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-16T03:28:33.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:33.143 DEBUG:teuthology.orchestra.run.smithi028:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-16T03:28:33.170 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:28:33.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:33.170 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-16T03:28:33.222 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:33.222 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:33.232 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:33.232 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:33.285 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:33.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.422+0000 7f1723d01640 1 Processor -- start 2023-12-16T03:28:33.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.422+0000 7f1723d01640 1 -- start start 2023-12-16T03:28:33.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1723d01640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171c0c7ea0 0x7f171c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1723d01640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f171c06b9e0 0x7f171c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1723d01640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171c06c860 con 0x7f171c151e90 2023-12-16T03:28:33.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1723d01640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171c0c8750 con 0x7f171c06b9e0 2023-12-16T03:28:33.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1723d01640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171c1552d0 con 0x7f171c0c7ea0 2023-12-16T03:28:33.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1721a9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f171c151e90 0x7f171c0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36608/0 (socket says 172.21.15.28:36608) 2023-12-16T03:28:33.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1721a9d640 1 -- 172.21.15.28:0/4252640085 learned_addr learned my addr 172.21.15.28:0/4252640085 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:33.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f172129c640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171c0c7ea0 0x7f171c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357039920 0 0) 0x7f171c06c860 con 0x7f171c151e90 2023-12-16T03:28:33.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f172229e640 1 --2- 172.21.15.28:0/4252640085 >> v2:172.21.15.134:3300/0 conn(0x7f171c06b9e0 0x7f171c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1708003530 con 0x7f171c151e90 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3067731584 0 0) 0x7f1708003530 con 0x7f171c151e90 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171c0c7ea0 msgr2=0x7f171c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171c0c7ea0 0x7f171c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 >> v2:172.21.15.134:3300/0 conn(0x7f171c06b9e0 msgr2=0x7f171c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 --2- 172.21.15.28:0/4252640085 >> v2:172.21.15.134:3300/0 conn(0x7f171c06b9e0 0x7f171c15f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c154930 con 0x7f171c151e90 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f1718001680 con 0x7f171c151e90 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 >> v1:172.21.15.28:6789/0 conn(0x7f171c151e90 legacy=0x7f171c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171c0c7ea0 0x7f1708003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1708003f50 0x7f17080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1708004d10 0x7f1708005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c0c8750 con 0x7f1708004d10 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c1552d0 con 0x7f1708003f50 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170800bac0 con 0x7f171c0c7ea0 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f172229e640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1708004d10 0x7f1708005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f172129c640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1708003f50 0x7f17080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1721a9d640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171c0c7ea0 0x7f1708003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f172229e640 1 -- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171c0c7ea0 msgr2=0x7f1708003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f172229e640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171c0c7ea0 0x7f1708003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f172229e640 1 -- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1708003f50 msgr2=0x7f17080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f172229e640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1708003f50 0x7f17080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f172229e640 1 -- 172.21.15.28:0/4252640085 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1708003530 con 0x7f1708004d10 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f172129c640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1708003f50 0x7f17080047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:33.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.426+0000 7f1721a9d640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f171c0c7ea0 0x7f1708003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:33.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.430+0000 7f172229e640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1708004d10 0x7f1708005190 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f1714009fc0 tx=0x7f171401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbbf3bcdc0f80f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:33.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.430+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140a5a90 con 0x7f1708004d10 2023-12-16T03:28:33.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.430+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171400f040 con 0x7f1708004d10 2023-12-16T03:28:33.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.430+0000 7f1720a9b640 1 -- 172.21.15.28:0/4252640085 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140a5e30 con 0x7f1708004d10 2023-12-16T03:28:33.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.430+0000 7f1723d01640 1 -- 172.21.15.28:0/4252640085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1708004d10 msgr2=0x7f1708005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.430+0000 7f1723d01640 1 --2- 172.21.15.28:0/4252640085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1708004d10 0x7f1708005190 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f1714009fc0 tx=0x7f171401cca0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.430+0000 7f172229e640 1 -- 172.21.15.28:0/4252640085 reap_dead start 2023-12-16T03:28:33.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.430+0000 7f1723d01640 1 -- 172.21.15.28:0/4252640085 shutdown_connections 2023-12-16T03:28:33.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.430+0000 7f1723d01640 1 -- 172.21.15.28:0/4252640085 >> 172.21.15.28:0/4252640085 conn(0x7f171c0ca170 msgr2=0x7f171c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:33.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.430+0000 7f1723d01640 1 -- 172.21.15.28:0/4252640085 shutdown_connections 2023-12-16T03:28:33.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.430+0000 7f1723d01640 1 -- 172.21.15.28:0/4252640085 wait complete. 2023-12-16T03:28:33.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1723d01640 1 Processor -- start 2023-12-16T03:28:33.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1723d01640 1 -- start start 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1723d01640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1708004d10 0x7f171c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1723d01640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f171c0c3600 0x7f171c1f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1723d01640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f171c1f0830 0x7f171c145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1723d01640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c14f970 con 0x7f171c1f0830 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1723d01640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c0c16d0 con 0x7f171c0c3600 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1723d01640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171c0c3f60 con 0x7f1708004d10 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f172229e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f171c1f0830 0x7f171c145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f172229e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f171c1f0830 0x7f171c145490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42132/0 (socket says 172.21.15.28:42132) 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f172229e640 1 -- 172.21.15.28:0/583812025 learned_addr learned my addr 172.21.15.28:0/583812025 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f172129c640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f171c0c3600 0x7f171c1f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1721a9d640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1708004d10 0x7f171c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f172229e640 1 -- 172.21.15.28:0/583812025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1708004d10 msgr2=0x7f171c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f172229e640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1708004d10 0x7f171c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f172229e640 1 -- 172.21.15.28:0/583812025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f171c0c3600 msgr2=0x7f171c1f02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f172229e640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f171c0c3600 0x7f171c1f02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f172229e640 1 -- 172.21.15.28:0/583812025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c14f690 con 0x7f171c1f0830 2023-12-16T03:28:33.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f172229e640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f171c1f0830 0x7f171c145490 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1714002240 tx=0x7f1714009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:33.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f17127fc640 1 -- 172.21.15.28:0/583812025 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140039a0 con 0x7f171c1f0830 2023-12-16T03:28:33.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f17127fc640 1 -- 172.21.15.28:0/583812025 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1714003b00 con 0x7f171c1f0830 2023-12-16T03:28:33.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1723d01640 1 -- 172.21.15.28:0/583812025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171c0c1110 con 0x7f171c1f0830 2023-12-16T03:28:33.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f17127fc640 1 -- 172.21.15.28:0/583812025 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714003e90 con 0x7f171c1f0830 2023-12-16T03:28:33.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1723d01640 1 -- 172.21.15.28:0/583812025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171c154310 con 0x7f171c1f0830 2023-12-16T03:28:33.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.434+0000 7f1723d01640 1 -- 172.21.15.28:0/583812025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171c14f480 con 0x7f171c1f0830 2023-12-16T03:28:33.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.438+0000 7f17127fc640 1 -- 172.21.15.28:0/583812025 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f17140b4040 con 0x7f171c1f0830 2023-12-16T03:28:33.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.438+0000 7f17127fc640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1700066470 0x7f1700068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.438+0000 7f17127fc640 1 -- 172.21.15.28:0/583812025 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f171411dd40 con 0x7f171c1f0830 2023-12-16T03:28:33.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.438+0000 7f1721a9d640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1700066470 0x7f1700068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.438+0000 7f1721a9d640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1700066470 0x7f1700068930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1718000fc0 tx=0x7f1718009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:33.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.442+0000 7f17127fc640 1 -- 172.21.15.28:0/583812025 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f17140eae50 con 0x7f171c1f0830 2023-12-16T03:28:33.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.602+0000 7f1723d01640 1 -- 172.21.15.28:0/583812025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f171c068400 con 0x7f171c1f0830 2023-12-16T03:28:33.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.602+0000 7f17127fc640 1 -- 172.21.15.28:0/583812025 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20214 (secure 0 0 0) 0x7f17140b2090 con 0x7f171c1f0830 2023-12-16T03:28:33.607 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:33.607 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:13.793649+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:33.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 -- 172.21.15.28:0/583812025 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1700066470 msgr2=0x7f1700068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1700066470 0x7f1700068930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1718000fc0 tx=0x7f1718009040 comp rx=0 tx=0).stop 2023-12-16T03:28:33.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 -- 172.21.15.28:0/583812025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f171c1f0830 msgr2=0x7f171c145490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f171c1f0830 0x7f171c145490 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1714002240 tx=0x7f1714009750 comp rx=0 tx=0).stop 2023-12-16T03:28:33.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 -- 172.21.15.28:0/583812025 shutdown_connections 2023-12-16T03:28:33.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1700066470 0x7f1700068930 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f171c1f0830 0x7f171c145490 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f171c0c3600 0x7f171c1f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 --2- 172.21.15.28:0/583812025 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1708004d10 0x7f171c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 -- 172.21.15.28:0/583812025 >> 172.21.15.28:0/583812025 conn(0x7f171c0ca170 msgr2=0x7f171c1501d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:33.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 -- 172.21.15.28:0/583812025 shutdown_connections 2023-12-16T03:28:33.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.606+0000 7f1723d01640 1 -- 172.21.15.28:0/583812025 wait complete. 2023-12-16T03:28:33.628 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:27:56.894984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:27:58.090972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:28:10.280019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:28:11.167317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:28:33.629 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:28:33.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.770+0000 7f95e9596640 1 Processor -- start 2023-12-16T03:28:33.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.770+0000 7f95e9596640 1 -- start start 2023-12-16T03:28:33.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.770+0000 7f95e9596640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f95e40c4100 0x7f95e40c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.770+0000 7f95e9596640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f95e40c06d0 0x7f95e40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.770+0000 7f95e9596640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e40c31c0 con 0x7f95e40c63c0 2023-12-16T03:28:33.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.770+0000 7f95e9596640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e40c34a0 con 0x7f95e40c06d0 2023-12-16T03:28:33.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.770+0000 7f95e9596640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e40c1030 con 0x7f95e40c4100 2023-12-16T03:28:33.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.770+0000 7f95e2ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f95e40c63c0 0x7f95e40c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36610/0 (socket says 172.21.15.28:36610) 2023-12-16T03:28:33.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.770+0000 7f95e2ffd640 1 -- 172.21.15.28:0/1865535279 learned_addr learned my addr 172.21.15.28:0/1865535279 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:33.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.770+0000 7f95e37fe640 1 --2- 172.21.15.28:0/1865535279 >> v2:172.21.15.28:3300/0 conn(0x7f95e40c06d0 0x7f95e40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.770+0000 7f95dbfff640 1 --2- 172.21.15.28:0/1865535279 >> v2:172.21.15.134:3300/0 conn(0x7f95e40c4100 0x7f95e40c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.774+0000 7f95e37fe640 1 -- 172.21.15.28:0/1865535279 >> v2:172.21.15.134:3300/0 conn(0x7f95e40c4100 msgr2=0x7f95e40c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.774+0000 7f95e37fe640 1 --2- 172.21.15.28:0/1865535279 >> v2:172.21.15.134:3300/0 conn(0x7f95e40c4100 0x7f95e40c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.774+0000 7f95e37fe640 1 -- 172.21.15.28:0/1865535279 >> v1:172.21.15.28:6789/0 conn(0x7f95e40c63c0 legacy=0x7f95e40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.774+0000 7f95e37fe640 1 -- 172.21.15.28:0/1865535279 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e40c1310 con 0x7f95e40c06d0 2023-12-16T03:28:33.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.774+0000 7f95e27fc640 1 -- 172.21.15.28:0/1865535279 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484854906 0 0) 0x7f95e40c31c0 con 0x7f95e40c63c0 2023-12-16T03:28:33.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.774+0000 7f95e37fe640 1 --2- 172.21.15.28:0/1865535279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95e40c06d0 0x7f95e40a9680 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f95e40a8b40 tx=0x7f95dc01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f489a22e9dca79e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:33.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.774+0000 7f95e27fc640 1 -- 172.21.15.28:0/1865535279 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e40aa3d0 con 0x7f95e40c06d0 2023-12-16T03:28:33.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.774+0000 7f95e27fc640 1 -- 172.21.15.28:0/1865535279 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc0a57c0 con 0x7f95e40c06d0 2023-12-16T03:28:33.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.774+0000 7f95e27fc640 1 -- 172.21.15.28:0/1865535279 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0a5b50 con 0x7f95e40c06d0 2023-12-16T03:28:33.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 -- 172.21.15.28:0/1865535279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95e40c06d0 msgr2=0x7f95e40a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 --2- 172.21.15.28:0/1865535279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95e40c06d0 0x7f95e40a9680 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f95e40a8b40 tx=0x7f95dc01c7f0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 -- 172.21.15.28:0/1865535279 shutdown_connections 2023-12-16T03:28:33.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 --2- 172.21.15.28:0/1865535279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95e40c06d0 0x7f95e40a9680 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 --2- 172.21.15.28:0/1865535279 >> v2:172.21.15.134:3300/0 conn(0x7f95e40c4100 0x7f95e40c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 -- 172.21.15.28:0/1865535279 >> 172.21.15.28:0/1865535279 conn(0x7f95e406a5b0 msgr2=0x7f95e406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:33.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 -- 172.21.15.28:0/1865535279 shutdown_connections 2023-12-16T03:28:33.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 -- 172.21.15.28:0/1865535279 wait complete. 2023-12-16T03:28:33.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 Processor -- start 2023-12-16T03:28:33.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 -- start start 2023-12-16T03:28:33.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95e40c06d0 0x7f95e415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95e40c4100 0x7f95e41ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95e40c63c0 0x7f95e41ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e41ec990 con 0x7f95e40c06d0 2023-12-16T03:28:33.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40bb8b0 con 0x7f95e40c63c0 2023-12-16T03:28:33.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e9596640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40bbb90 con 0x7f95e40c4100 2023-12-16T03:28:33.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95e40c06d0 0x7f95e415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95e40c06d0 0x7f95e415a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42138/0 (socket says 172.21.15.28:42138) 2023-12-16T03:28:33.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e2ffd640 1 -- 172.21.15.28:0/2621897952 learned_addr learned my addr 172.21.15.28:0/2621897952 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:33.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e37fe640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95e40c63c0 0x7f95e41ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e2ffd640 1 -- 172.21.15.28:0/2621897952 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95e40c4100 msgr2=0x7f95e41ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95dbfff640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95e40c4100 0x7f95e41ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e2ffd640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95e40c4100 0x7f95e41ece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e2ffd640 1 -- 172.21.15.28:0/2621897952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95e40c63c0 msgr2=0x7f95e41ed360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e2ffd640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95e40c63c0 0x7f95e41ed360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e2ffd640 1 -- 172.21.15.28:0/2621897952 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc009a70 con 0x7f95e40c06d0 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e37fe640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95e40c63c0 0x7f95e41ed360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95dbfff640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95e40c4100 0x7f95e41ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.778+0000 7f95e2ffd640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95e40c06d0 0x7f95e415a420 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f95d4007fd0 tx=0x7f95d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.782+0000 7f95db7fe640 1 -- 172.21.15.28:0/2621897952 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4005cf0 con 0x7f95e40c06d0 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.782+0000 7f95db7fe640 1 -- 172.21.15.28:0/2621897952 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d4005e70 con 0x7f95e40c06d0 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.782+0000 7f95e9596640 1 -- 172.21.15.28:0/2621897952 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e40bbe70 con 0x7f95e40c06d0 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.782+0000 7f95db7fe640 1 -- 172.21.15.28:0/2621897952 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d40072f0 con 0x7f95e40c06d0 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.782+0000 7f95e9596640 1 -- 172.21.15.28:0/2621897952 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e415a960 con 0x7f95e40c06d0 2023-12-16T03:28:33.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.782+0000 7f95e9596640 1 -- 172.21.15.28:0/2621897952 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e4068400 con 0x7f95e40c06d0 2023-12-16T03:28:33.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.782+0000 7f95db7fe640 1 -- 172.21.15.28:0/2621897952 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f95d4007450 con 0x7f95e40c06d0 2023-12-16T03:28:33.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.782+0000 7f95db7fe640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95c4066470 0x7f95c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:33.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.782+0000 7f95db7fe640 1 -- 172.21.15.28:0/2621897952 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f95d40837e0 con 0x7f95e40c06d0 2023-12-16T03:28:33.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.782+0000 7f95dbfff640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95c4066470 0x7f95c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:33.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.782+0000 7f95dbfff640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95c4066470 0x7f95c4068930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f95e41ea630 tx=0x7f95cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:33.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.786+0000 7f95db7fe640 1 -- 172.21.15.28:0/2621897952 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f95d40508f0 con 0x7f95e40c06d0 2023-12-16T03:28:33.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 -- 172.21.15.28:0/2621897952 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95e40c3e70 con 0x7f95e40c06d0 2023-12-16T03:28:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95db7fe640 1 -- 172.21.15.28:0/2621897952 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95d4053f10 con 0x7f95e40c06d0 2023-12-16T03:28:33.953 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 -- 172.21.15.28:0/2621897952 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95c4066470 msgr2=0x7f95c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95c4066470 0x7f95c4068930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f95e41ea630 tx=0x7f95cc008040 comp rx=0 tx=0).stop 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 -- 172.21.15.28:0/2621897952 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95e40c06d0 msgr2=0x7f95e415a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95e40c06d0 0x7f95e415a420 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f95d4007fd0 tx=0x7f95d400c8e0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 -- 172.21.15.28:0/2621897952 shutdown_connections 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95e40c63c0 0x7f95e41ed360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95e40c4100 0x7f95e41ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f95c4066470 0x7f95c4068930 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 --2- 172.21.15.28:0/2621897952 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95e40c06d0 0x7f95e415a420 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 -- 172.21.15.28:0/2621897952 >> 172.21.15.28:0/2621897952 conn(0x7f95e406a5b0 msgr2=0x7f95e4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 -- 172.21.15.28:0/2621897952 shutdown_connections 2023-12-16T03:28:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:33.946+0000 7f95e9596640 1 -- 172.21.15.28:0/2621897952 wait complete. 2023-12-16T03:28:33.971 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:28:34.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f2432640 1 Processor -- start 2023-12-16T03:28:34.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f2432640 1 -- start start 2023-12-16T03:28:34.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f2432640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc2ec0c7ed0 0x7fc2ec154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f2432640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec0ac4f0 con 0x7fc2ec0bd660 2023-12-16T03:28:34.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f2432640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec158780 con 0x7fc2ec151dc0 2023-12-16T03:28:34.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f2432640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec158a60 con 0x7fc2ec0c7ed0 2023-12-16T03:28:34.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f09cf640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc2ec0bd660 0x7fc2ec154b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36614/0 (socket says 172.21.15.28:36614) 2023-12-16T03:28:34.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f09cf640 1 -- 172.21.15.28:0/1160504702 learned_addr learned my addr 172.21.15.28:0/1160504702 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:34.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eb7fe640 1 --2- 172.21.15.28:0/1160504702 >> v2:172.21.15.134:3300/0 conn(0x7fc2ec0c7ed0 0x7fc2ec154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498541994 0 0) 0x7fc2ec0ac4f0 con 0x7fc2ec0bd660 2023-12-16T03:28:34.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d4003530 con 0x7fc2ec0bd660 2023-12-16T03:28:34.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933647882 0 0) 0x7fc2ec158780 con 0x7fc2ec151dc0 2023-12-16T03:28:34.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2ec0ac4f0 con 0x7fc2ec151dc0 2023-12-16T03:28:34.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 325846980 0 0) 0x7fc2d4003530 con 0x7fc2ec0bd660 2023-12-16T03:28:34.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 >> v2:172.21.15.134:3300/0 conn(0x7fc2ec0c7ed0 msgr2=0x7fc2ec154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 --2- 172.21.15.28:0/1160504702 >> v2:172.21.15.134:3300/0 conn(0x7fc2ec0c7ed0 0x7fc2ec154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 >> v1:172.21.15.134:6789/0 conn(0x7fc2ec151dc0 legacy=0x7fc2ec0c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec0ac180 con 0x7fc2ec0bd660 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fc2e4001a00 con 0x7fc2ec0bd660 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 >> v1:172.21.15.28:6789/0 conn(0x7fc2ec0bd660 legacy=0x7fc2ec154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d4003b40 0x7fc2d4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d40047d0 0x7fc2d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d4005230 0x7fc2d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec158a60 con 0x7fc2d4005230 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d400c180 con 0x7fc2d4003b40 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d400c340 con 0x7fc2d40047d0 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2ebfff640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d4003b40 0x7fc2d4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f09cf640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d4005230 0x7fc2d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2eb7fe640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d40047d0 0x7fc2d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f09cf640 1 -- 172.21.15.28:0/1160504702 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d40047d0 msgr2=0x7fc2d4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:34.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f09cf640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2d40047d0 0x7fc2d4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f09cf640 1 -- 172.21.15.28:0/1160504702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d4003b40 msgr2=0x7fc2d4003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:34.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f09cf640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d4003b40 0x7fc2d4003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2f09cf640 1 -- 172.21.15.28:0/1160504702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4003530 con 0x7fc2d4005230 2023-12-16T03:28:34.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.114+0000 7fc2ebfff640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d4003b40 0x7fc2d4003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:34.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2f09cf640 1 -- 172.21.15.28:0/1160504702 reap_dead start 2023-12-16T03:28:34.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2f09cf640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d4005230 0x7fc2d400b990 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400a7a0 tx=0x7fc2e401d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c806983d3403ae server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:34.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40ac620 con 0x7fc2d4005230 2023-12-16T03:28:34.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e40a8070 con 0x7fc2d4005230 2023-12-16T03:28:34.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2eaffd640 1 -- 172.21.15.28:0/1160504702 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40ac9a0 con 0x7fc2d4005230 2023-12-16T03:28:34.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2f2432640 1 -- 172.21.15.28:0/1160504702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d4005230 msgr2=0x7fc2d400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2f2432640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d4005230 0x7fc2d400b990 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400a7a0 tx=0x7fc2e401d2a0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2f2432640 1 -- 172.21.15.28:0/1160504702 shutdown_connections 2023-12-16T03:28:34.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2f2432640 1 --2- 172.21.15.28:0/1160504702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d4005230 0x7fc2d400b990 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2f2432640 1 -- 172.21.15.28:0/1160504702 >> 172.21.15.28:0/1160504702 conn(0x7fc2ec071eb0 msgr2=0x7fc2ec0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:34.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2f2432640 1 -- 172.21.15.28:0/1160504702 shutdown_connections 2023-12-16T03:28:34.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.118+0000 7fc2f2432640 1 -- 172.21.15.28:0/1160504702 wait complete. 2023-12-16T03:28:34.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2f2432640 1 Processor -- start 2023-12-16T03:28:34.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2f2432640 1 -- start start 2023-12-16T03:28:34.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2f2432640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d4005230 0x7fc2ec1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2f2432640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2ec0bdb00 0x7fc2ec14b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2f2432640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2ec14b730 0x7fc2ec1ee950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2f2432640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec14bf90 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2f2432640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec1ee4c0 con 0x7fc2d4005230 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2f2432640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec0bee00 con 0x7fc2ec14b730 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2eb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2ec0bdb00 0x7fc2ec14b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2eb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2ec0bdb00 0x7fc2ec14b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42166/0 (socket says 172.21.15.28:42166) 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2eb7fe640 1 -- 172.21.15.28:0/4143529303 learned_addr learned my addr 172.21.15.28:0/4143529303 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2ebfff640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d4005230 0x7fc2ec1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2f09cf640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2ec14b730 0x7fc2ec1ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2eb7fe640 1 -- 172.21.15.28:0/4143529303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2ec14b730 msgr2=0x7fc2ec1ee950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2eb7fe640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2ec14b730 0x7fc2ec1ee950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2eb7fe640 1 -- 172.21.15.28:0/4143529303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d4005230 msgr2=0x7fc2ec1569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2eb7fe640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d4005230 0x7fc2ec1569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2eb7fe640 1 -- 172.21.15.28:0/4143529303 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec0bf0e0 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2eb7fe640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2ec0bdb00 0x7fc2ec14b1f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0011960 tx=0x7fc2e0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:34.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2e8ff9640 1 -- 172.21.15.28:0/4143529303 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e000faf0 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2e8ff9640 1 -- 172.21.15.28:0/4143529303 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e000fc50 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2e8ff9640 1 -- 172.21.15.28:0/4143529303 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0014440 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2f2432640 1 -- 172.21.15.28:0/4143529303 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec1ee150 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.122+0000 7fc2f2432640 1 -- 172.21.15.28:0/4143529303 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec1506f0 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.126+0000 7fc2f2432640 1 -- 172.21.15.28:0/4143529303 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec068400 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.126+0000 7fc2e8ff9640 1 -- 172.21.15.28:0/4143529303 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc2e00145a0 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.126+0000 7fc2e8ff9640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2d8066470 0x7fc2d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.126+0000 7fc2e8ff9640 1 -- 172.21.15.28:0/4143529303 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc2e00848f0 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.126+0000 7fc2ebfff640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2d8066470 0x7fc2d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.126+0000 7fc2ebfff640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2d8066470 0x7fc2d8068930 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc007fd0 tx=0x7fc2dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:34.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.130+0000 7fc2e8ff9640 1 -- 172.21.15.28:0/4143529303 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc2e0051ab0 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2f2432640 1 -- 172.21.15.28:0/4143529303 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2ec155080 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2e8ff9640 1 -- 172.21.15.28:0/4143529303 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2e00550d0 con 0x7fc2ec0bdb00 2023-12-16T03:28:34.291 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:34.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2f2432640 1 -- 172.21.15.28:0/4143529303 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2d8066470 msgr2=0x7fc2d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2f2432640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2d8066470 0x7fc2d8068930 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc007fd0 tx=0x7fc2dc009040 comp rx=0 tx=0).stop 2023-12-16T03:28:34.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2f2432640 1 -- 172.21.15.28:0/4143529303 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2ec0bdb00 msgr2=0x7fc2ec14b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2f2432640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2ec0bdb00 0x7fc2ec14b1f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0011960 tx=0x7fc2e0011e20 comp rx=0 tx=0).stop 2023-12-16T03:28:34.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2f2432640 1 -- 172.21.15.28:0/4143529303 shutdown_connections 2023-12-16T03:28:34.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2f2432640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc2ec14b730 0x7fc2ec1ee950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2f2432640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc2d8066470 0x7fc2d8068930 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2f2432640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2ec0bdb00 0x7fc2ec14b1f0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2f2432640 1 --2- 172.21.15.28:0/4143529303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2d4005230 0x7fc2ec1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.286+0000 7fc2f2432640 1 -- 172.21.15.28:0/4143529303 >> 172.21.15.28:0/4143529303 conn(0x7fc2ec071eb0 msgr2=0x7fc2ec15f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:34.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.290+0000 7fc2f2432640 1 -- 172.21.15.28:0/4143529303 shutdown_connections 2023-12-16T03:28:34.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.290+0000 7fc2f2432640 1 -- 172.21.15.28:0/4143529303 wait complete. 2023-12-16T03:28:34.311 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:28:34.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb3a6074640 1 Processor -- start 2023-12-16T03:28:34.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb3a6074640 1 -- start start 2023-12-16T03:28:34.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb3a6074640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb3a0071f60 0x7fb3a00c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb3a6074640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a00c3950 con 0x7fb3a00a8320 2023-12-16T03:28:34.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb3a6074640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a00c08b0 con 0x7fb3a01513f0 2023-12-16T03:28:34.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb3a6074640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a00c1950 con 0x7fb3a0071f60 2023-12-16T03:28:34.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb3a5072640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb3a00a8320 0x7fb3a006bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36624/0 (socket says 172.21.15.28:36624) 2023-12-16T03:28:34.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb3a5072640 1 -- 172.21.15.28:0/2279189279 learned_addr learned my addr 172.21.15.28:0/2279189279 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:34.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646567675 0 0) 0x7fb3a00c3950 con 0x7fb3a00a8320 2023-12-16T03:28:34.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb38c003530 con 0x7fb3a00a8320 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb3a5873640 1 --2- 172.21.15.28:0/2279189279 >> v2:172.21.15.134:3300/0 conn(0x7fb3a0071f60 0x7fb3a00c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 26417197 0 0) 0x7fb38c003530 con 0x7fb3a00a8320 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 >> v2:172.21.15.134:3300/0 conn(0x7fb3a0071f60 msgr2=0x7fb3a00c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 --2- 172.21.15.28:0/2279189279 >> v2:172.21.15.134:3300/0 conn(0x7fb3a0071f60 0x7fb3a00c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 >> v1:172.21.15.134:6789/0 conn(0x7fb3a01513f0 legacy=0x7fb3a00c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a00c1c30 con 0x7fb3a00a8320 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7fb39c001680 con 0x7fb3a00a8320 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb3a5873640 1 --2- 172.21.15.28:0/2279189279 >> v2:172.21.15.134:3300/0 conn(0x7fb3a0071f60 0x7fb3a00c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 >> v1:172.21.15.28:6789/0 conn(0x7fb3a00a8320 legacy=0x7fb3a006bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb38c003980 0x7fb38c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb38c0047d0 0x7fb38c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb38c005190 0x7fb38c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a00c1950 con 0x7fb38c003980 2023-12-16T03:28:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c00c0c0 con 0x7fb38c0047d0 2023-12-16T03:28:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.454+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c00c280 con 0x7fb38c005190 2023-12-16T03:28:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a5072640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb38c003980 0x7fb38c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a4871640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb38c0047d0 0x7fb38c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a5873640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb38c005190 0x7fb38c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a5072640 1 -- 172.21.15.28:0/2279189279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb38c005190 msgr2=0x7fb38c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a5072640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb38c005190 0x7fb38c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a5072640 1 -- 172.21.15.28:0/2279189279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb38c0047d0 msgr2=0x7fb38c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a5072640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb38c0047d0 0x7fb38c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a5072640 1 -- 172.21.15.28:0/2279189279 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c003530 con 0x7fb38c003980 2023-12-16T03:28:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a5873640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb38c005190 0x7fb38c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a5873640 1 -- 172.21.15.28:0/2279189279 reap_dead start 2023-12-16T03:28:34.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a5072640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb38c003980 0x7fb38c003da0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00c240 tx=0x7fb39c01f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b44c2bed189cee6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:34.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c005ae0 con 0x7fb38c003980 2023-12-16T03:28:34.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c0ab070 con 0x7fb38c003980 2023-12-16T03:28:34.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb397fff640 1 -- 172.21.15.28:0/2279189279 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c007070 con 0x7fb38c003980 2023-12-16T03:28:34.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a6074640 1 -- 172.21.15.28:0/2279189279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb38c003980 msgr2=0x7fb38c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.458+0000 7fb3a6074640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb38c003980 0x7fb38c003da0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00c240 tx=0x7fb39c01f370 comp rx=0 tx=0).stop 2023-12-16T03:28:34.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 -- 172.21.15.28:0/2279189279 shutdown_connections 2023-12-16T03:28:34.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 --2- 172.21.15.28:0/2279189279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb38c003980 0x7fb38c003da0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 -- 172.21.15.28:0/2279189279 >> 172.21.15.28:0/2279189279 conn(0x7fb3a00a7800 msgr2=0x7fb3a00a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:34.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 -- 172.21.15.28:0/2279189279 shutdown_connections 2023-12-16T03:28:34.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 -- 172.21.15.28:0/2279189279 wait complete. 2023-12-16T03:28:34.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 Processor -- start 2023-12-16T03:28:34.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 -- start start 2023-12-16T03:28:34.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb38c003980 0x7fb3a00bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a01eddb0 0x7fb3a01e9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3a00ab160 0x7fb3a01ea140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a01547e0 con 0x7fb3a00ab160 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a01ed310 con 0x7fb3a01eddb0 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a6074640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a0154240 con 0x7fb38c003980 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a5873640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3a00ab160 0x7fb3a01ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a5873640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3a00ab160 0x7fb3a01ea140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42186/0 (socket says 172.21.15.28:42186) 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a5873640 1 -- 172.21.15.28:0/2556798187 learned_addr learned my addr 172.21.15.28:0/2556798187 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a5072640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb38c003980 0x7fb3a00bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a4871640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a01eddb0 0x7fb3a01e9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a5873640 1 -- 172.21.15.28:0/2556798187 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb38c003980 msgr2=0x7fb3a00bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a5873640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb38c003980 0x7fb3a00bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a5873640 1 -- 172.21.15.28:0/2556798187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a01eddb0 msgr2=0x7fb3a01e9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a5873640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a01eddb0 0x7fb3a01e9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a5873640 1 -- 172.21.15.28:0/2556798187 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a0154500 con 0x7fb3a00ab160 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.462+0000 7fb3a5873640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3a00ab160 0x7fb3a01ea140 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00a87e0 tx=0x7fb398007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:34.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.466+0000 7fb395ffb640 1 -- 172.21.15.28:0/2556798187 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3980048a0 con 0x7fb3a00ab160 2023-12-16T03:28:34.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.466+0000 7fb395ffb640 1 -- 172.21.15.28:0/2556798187 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39800f050 con 0x7fb3a00ab160 2023-12-16T03:28:34.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.466+0000 7fb395ffb640 1 -- 172.21.15.28:0/2556798187 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb398014650 con 0x7fb3a00ab160 2023-12-16T03:28:34.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.466+0000 7fb3a6074640 1 -- 172.21.15.28:0/2556798187 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a01ed5b0 con 0x7fb3a00ab160 2023-12-16T03:28:34.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.466+0000 7fb3a6074640 1 -- 172.21.15.28:0/2556798187 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a00bf990 con 0x7fb3a00ab160 2023-12-16T03:28:34.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.466+0000 7fb3a6074640 1 -- 172.21.15.28:0/2556798187 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a01ed170 con 0x7fb3a00ab160 2023-12-16T03:28:34.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.466+0000 7fb395ffb640 1 -- 172.21.15.28:0/2556798187 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb3980147b0 con 0x7fb3a00ab160 2023-12-16T03:28:34.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.466+0000 7fb395ffb640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb3840664a0 0x7fb384068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.470+0000 7fb395ffb640 1 -- 172.21.15.28:0/2556798187 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb3980846e0 con 0x7fb3a00ab160 2023-12-16T03:28:34.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.470+0000 7fb3a5072640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb3840664a0 0x7fb384068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.470+0000 7fb3a5072640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb3840664a0 0x7fb384068960 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0af000 tx=0x7fb39c0aa000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:34.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.470+0000 7fb395ffb640 1 -- 172.21.15.28:0/2556798187 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb3a01ed170 con 0x7fb3a00ab160 2023-12-16T03:28:34.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 -- 172.21.15.28:0/2556798187 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3a01ed170 con 0x7fb3a00ab160 2023-12-16T03:28:34.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb395ffb640 1 -- 172.21.15.28:0/2556798187 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3a01ed170 con 0x7fb3a00ab160 2023-12-16T03:28:34.639 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:34.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 -- 172.21.15.28:0/2556798187 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb3840664a0 msgr2=0x7fb384068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb3840664a0 0x7fb384068960 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0af000 tx=0x7fb39c0aa000 comp rx=0 tx=0).stop 2023-12-16T03:28:34.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 -- 172.21.15.28:0/2556798187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3a00ab160 msgr2=0x7fb3a01ea140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3a00ab160 0x7fb3a01ea140 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00a87e0 tx=0x7fb398007700 comp rx=0 tx=0).stop 2023-12-16T03:28:34.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 -- 172.21.15.28:0/2556798187 shutdown_connections 2023-12-16T03:28:34.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb3840664a0 0x7fb384068960 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3a00ab160 0x7fb3a01ea140 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3a01eddb0 0x7fb3a01e9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 --2- 172.21.15.28:0/2556798187 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb38c003980 0x7fb3a00bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 -- 172.21.15.28:0/2556798187 >> 172.21.15.28:0/2556798187 conn(0x7fb3a00a7800 msgr2=0x7fb3a014fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:34.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.634+0000 7fb3a6074640 1 -- 172.21.15.28:0/2556798187 shutdown_connections 2023-12-16T03:28:34.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.638+0000 7fb3a6074640 1 -- 172.21.15.28:0/2556798187 wait complete. 2023-12-16T03:28:34.660 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:28:34.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4693c9a640 1 Processor -- start 2023-12-16T03:28:34.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4693c9a640 1 -- start start 2023-12-16T03:28:34.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4693c9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f468c0c5260 0x7f468c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4693c9a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f468c155de0 0x7f468c156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4693c9a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c0c2580 con 0x7f468c0c5640 2023-12-16T03:28:34.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4693c9a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468c153510 con 0x7f468c155de0 2023-12-16T03:28:34.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4693c9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c0c17f0 con 0x7f468c0c5260 2023-12-16T03:28:34.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4691235640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f468c0c5640 0x7f468c0c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36632/0 (socket says 172.21.15.28:36632) 2023-12-16T03:28:34.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4692237640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f468c155de0 0x7f468c156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4691235640 1 -- 172.21.15.28:0/2084893616 learned_addr learned my addr 172.21.15.28:0/2084893616 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:34.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4691a36640 1 --2- 172.21.15.28:0/2084893616 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f468c0c5260 0x7f468c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4690a34640 1 -- 172.21.15.28:0/2084893616 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023959564 0 0) 0x7f468c0c2580 con 0x7f468c0c5640 2023-12-16T03:28:34.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4692237640 1 -- 172.21.15.28:0/2084893616 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f468c0c5260 msgr2=0x7f468c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:34.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4692237640 1 --2- 172.21.15.28:0/2084893616 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f468c0c5260 0x7f468c06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4692237640 1 -- 172.21.15.28:0/2084893616 >> v1:172.21.15.28:6789/0 conn(0x7f468c0c5640 legacy=0x7f468c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.802+0000 7f4692237640 1 -- 172.21.15.28:0/2084893616 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0c1a00 con 0x7f468c155de0 2023-12-16T03:28:34.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4692237640 1 --2- 172.21.15.28:0/2084893616 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f468c155de0 0x7f468c156250 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f468c0c1930 tx=0x7f468401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb29734cd02a625 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:34.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4690a34640 1 -- 172.21.15.28:0/2084893616 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840a5930 con 0x7f468c155de0 2023-12-16T03:28:34.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4690a34640 1 -- 172.21.15.28:0/2084893616 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46840a5a90 con 0x7f468c155de0 2023-12-16T03:28:34.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4690a34640 1 -- 172.21.15.28:0/2084893616 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840a5e20 con 0x7f468c155de0 2023-12-16T03:28:34.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4693c9a640 1 -- 172.21.15.28:0/2084893616 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f468c155de0 msgr2=0x7f468c156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4693c9a640 1 --2- 172.21.15.28:0/2084893616 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f468c155de0 0x7f468c156250 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f468c0c1930 tx=0x7f468401c870 comp rx=0 tx=0).stop 2023-12-16T03:28:34.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4693c9a640 1 -- 172.21.15.28:0/2084893616 shutdown_connections 2023-12-16T03:28:34.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4693c9a640 1 --2- 172.21.15.28:0/2084893616 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f468c155de0 0x7f468c156250 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4693c9a640 1 --2- 172.21.15.28:0/2084893616 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f468c0c5260 0x7f468c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4693c9a640 1 -- 172.21.15.28:0/2084893616 >> 172.21.15.28:0/2084893616 conn(0x7f468c06a5b0 msgr2=0x7f468c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:34.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4693c9a640 1 -- 172.21.15.28:0/2084893616 shutdown_connections 2023-12-16T03:28:34.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.806+0000 7f4693c9a640 1 -- 172.21.15.28:0/2084893616 wait complete. 2023-12-16T03:28:34.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4693c9a640 1 Processor -- start 2023-12-16T03:28:34.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4693c9a640 1 -- start start 2023-12-16T03:28:34.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4693c9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f468c0c5260 0x7f468c1500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4693c9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f468c0c5640 0x7f468c0aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4693c9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f468c155de0 0x7f468c1f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4693c9a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c1f1100 con 0x7f468c155de0 2023-12-16T03:28:34.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4693c9a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c1f0e20 con 0x7f468c0c5260 2023-12-16T03:28:34.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4693c9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c156ff0 con 0x7f468c0c5640 2023-12-16T03:28:34.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4692237640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f468c155de0 0x7f468c1f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4692237640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f468c155de0 0x7f468c1f0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42200/0 (socket says 172.21.15.28:42200) 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4692237640 1 -- 172.21.15.28:0/1941313756 learned_addr learned my addr 172.21.15.28:0/1941313756 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4691235640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f468c0c5640 0x7f468c0aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4691a36640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f468c0c5260 0x7f468c1500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4692237640 1 -- 172.21.15.28:0/1941313756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f468c0c5640 msgr2=0x7f468c0aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4692237640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f468c0c5640 0x7f468c0aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4692237640 1 -- 172.21.15.28:0/1941313756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f468c0c5260 msgr2=0x7f468c1500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4692237640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f468c0c5260 0x7f468c1500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4692237640 1 -- 172.21.15.28:0/1941313756 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4684009a70 con 0x7f468c155de0 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4691235640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f468c0c5640 0x7f468c0aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4691a36640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f468c0c5260 0x7f468c1500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4692237640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f468c155de0 0x7f468c1f0420 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f468401a4a0 tx=0x7f4684019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f46827fc640 1 -- 172.21.15.28:0/1941313756 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840ade20 con 0x7f468c155de0 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f46827fc640 1 -- 172.21.15.28:0/1941313756 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4684009450 con 0x7f468c155de0 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f46827fc640 1 -- 172.21.15.28:0/1941313756 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840b9690 con 0x7f468c155de0 2023-12-16T03:28:34.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4693c9a640 1 -- 172.21.15.28:0/1941313756 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c1572d0 con 0x7f468c155de0 2023-12-16T03:28:34.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.810+0000 7f4693c9a640 1 -- 172.21.15.28:0/1941313756 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468c157640 con 0x7f468c155de0 2023-12-16T03:28:34.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.814+0000 7f4693c9a640 1 -- 172.21.15.28:0/1941313756 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468c0aa4b0 con 0x7f468c155de0 2023-12-16T03:28:34.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.814+0000 7f46827fc640 1 -- 172.21.15.28:0/1941313756 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f46840b97f0 con 0x7f468c155de0 2023-12-16T03:28:34.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.814+0000 7f46827fc640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46700664c0 0x7f4670068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:34.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.814+0000 7f46827fc640 1 -- 172.21.15.28:0/1941313756 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f468411fb30 con 0x7f468c155de0 2023-12-16T03:28:34.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.814+0000 7f4691a36640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46700664c0 0x7f4670068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:34.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.814+0000 7f4691a36640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46700664c0 0x7f4670068980 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f46880097a0 tx=0x7f4688008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:34.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.818+0000 7f46827fc640 1 -- 172.21.15.28:0/1941313756 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f468c0aa4b0 con 0x7f468c155de0 2023-12-16T03:28:34.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 -- 172.21.15.28:0/1941313756 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f468c0aa4b0 con 0x7f468c155de0 2023-12-16T03:28:34.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f46827fc640 1 -- 172.21.15.28:0/1941313756 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f468c0aa4b0 con 0x7f468c155de0 2023-12-16T03:28:34.982 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:34.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 -- 172.21.15.28:0/1941313756 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46700664c0 msgr2=0x7f4670068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46700664c0 0x7f4670068980 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f46880097a0 tx=0x7f4688008040 comp rx=0 tx=0).stop 2023-12-16T03:28:34.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 -- 172.21.15.28:0/1941313756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f468c155de0 msgr2=0x7f468c1f0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:34.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f468c155de0 0x7f468c1f0420 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f468401a4a0 tx=0x7f4684019610 comp rx=0 tx=0).stop 2023-12-16T03:28:34.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 -- 172.21.15.28:0/1941313756 shutdown_connections 2023-12-16T03:28:34.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46700664c0 0x7f4670068980 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f468c155de0 0x7f468c1f0420 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f468c0c5640 0x7f468c0aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 --2- 172.21.15.28:0/1941313756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f468c0c5260 0x7f468c1500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:34.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 -- 172.21.15.28:0/1941313756 >> 172.21.15.28:0/1941313756 conn(0x7f468c06a5b0 msgr2=0x7f468c15d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:34.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 -- 172.21.15.28:0/1941313756 shutdown_connections 2023-12-16T03:28:34.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:34.978+0000 7f4693c9a640 1 -- 172.21.15.28:0/1941313756 wait complete. 2023-12-16T03:28:35.002 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:28:35.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.142+0000 7f38055aa640 1 Processor -- start 2023-12-16T03:28:35.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.142+0000 7f38055aa640 1 -- start start 2023-12-16T03:28:35.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f38055aa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f380014b0d0 0x7f38001550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f38055aa640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380006ba80 con 0x7f38000c47f0 2023-12-16T03:28:35.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f38055aa640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380014b4b0 con 0x7f380006c4d0 2023-12-16T03:28:35.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f38055aa640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000c5ba0 con 0x7f380014b0d0 2023-12-16T03:28:35.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f37f7fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f38000c47f0 0x7f38000c7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36644/0 (socket says 172.21.15.28:36644) 2023-12-16T03:28:35.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f37f7fff640 1 -- 172.21.15.28:0/3836534277 learned_addr learned my addr 172.21.15.28:0/3836534277 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:35.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f37feffd640 1 --2- 172.21.15.28:0/3836534277 >> v2:172.21.15.134:3300/0 conn(0x7f380014b0d0 0x7f38001550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f37fe7fc640 1 -- 172.21.15.28:0/3836534277 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498858542 0 0) 0x7f380006ba80 con 0x7f38000c47f0 2023-12-16T03:28:35.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f37fe7fc640 1 -- 172.21.15.28:0/3836534277 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37ec003530 con 0x7f38000c47f0 2023-12-16T03:28:35.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f37feffd640 1 -- 172.21.15.28:0/3836534277 >> v1:172.21.15.134:6789/0 conn(0x7f380006c4d0 legacy=0x7f38000c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f37fe7fc640 1 -- 172.21.15.28:0/3836534277 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953329416 0 0) 0x7f380014b4b0 con 0x7f380006c4d0 2023-12-16T03:28:35.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f37feffd640 1 -- 172.21.15.28:0/3836534277 >> v1:172.21.15.28:6789/0 conn(0x7f38000c47f0 legacy=0x7f38000c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.146+0000 7f37feffd640 1 -- 172.21.15.28:0/3836534277 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380006d570 con 0x7f380014b0d0 2023-12-16T03:28:35.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f37feffd640 1 --2- 172.21.15.28:0/3836534277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380014b0d0 0x7f38001550b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097c0 tx=0x7f37f001c230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b18f9c9fd0cec9d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:35.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f37fe7fc640 1 -- 172.21.15.28:0/3836534277 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e8001680 con 0x7f380014b0d0 2023-12-16T03:28:35.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f37fe7fc640 1 -- 172.21.15.28:0/3836534277 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f00a7050 con 0x7f380014b0d0 2023-12-16T03:28:35.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f37fe7fc640 1 -- 172.21.15.28:0/3836534277 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00ab620 con 0x7f380014b0d0 2023-12-16T03:28:35.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f38055aa640 1 -- 172.21.15.28:0/3836534277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380014b0d0 msgr2=0x7f38001550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f38055aa640 1 --2- 172.21.15.28:0/3836534277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380014b0d0 0x7f38001550b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097c0 tx=0x7f37f001c230 comp rx=0 tx=0).stop 2023-12-16T03:28:35.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f38055aa640 1 -- 172.21.15.28:0/3836534277 shutdown_connections 2023-12-16T03:28:35.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f38055aa640 1 --2- 172.21.15.28:0/3836534277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380014b0d0 0x7f38001550b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f38055aa640 1 -- 172.21.15.28:0/3836534277 >> 172.21.15.28:0/3836534277 conn(0x7f38000aba00 msgr2=0x7f38000abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:35.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f38055aa640 1 -- 172.21.15.28:0/3836534277 shutdown_connections 2023-12-16T03:28:35.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f38055aa640 1 -- 172.21.15.28:0/3836534277 wait complete. 2023-12-16T03:28:35.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f38055aa640 1 Processor -- start 2023-12-16T03:28:35.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.150+0000 7f38055aa640 1 -- start start 2023-12-16T03:28:35.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f38055aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f380006c4d0 0x7f380015f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f38055aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38000c47f0 0x7f38000adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f38055aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380014b0d0 0x7f3800146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f38055aa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800156280 con 0x7f38000c47f0 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f38055aa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000c1180 con 0x7f380014b0d0 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f38055aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3800155990 con 0x7f380006c4d0 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38000c47f0 0x7f38000adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38000c47f0 0x7f38000adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42214/0 (socket says 172.21.15.28:42214) 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f7fff640 1 -- 172.21.15.28:0/2996144920 learned_addr learned my addr 172.21.15.28:0/2996144920 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37feffd640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f380006c4d0 0x7f380015f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37ff7fe640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380014b0d0 0x7f3800146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f7fff640 1 -- 172.21.15.28:0/2996144920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f380006c4d0 msgr2=0x7f380015f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f7fff640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f380006c4d0 0x7f380015f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f7fff640 1 -- 172.21.15.28:0/2996144920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380014b0d0 msgr2=0x7f3800146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f7fff640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380014b0d0 0x7f3800146540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f7fff640 1 -- 172.21.15.28:0/2996144920 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0009420 con 0x7f38000c47f0 2023-12-16T03:28:35.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37ff7fe640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380014b0d0 0x7f3800146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:35.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37feffd640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f380006c4d0 0x7f380015f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:35.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f7fff640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38000c47f0 0x7f38000adb40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f37e800cac0 tx=0x7f37e800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:35.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f77fe640 1 -- 172.21.15.28:0/2996144920 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e8005cf0 con 0x7f38000c47f0 2023-12-16T03:28:35.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f77fe640 1 -- 172.21.15.28:0/2996144920 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e8005e50 con 0x7f38000c47f0 2023-12-16T03:28:35.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f38055aa640 1 -- 172.21.15.28:0/2996144920 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3800155e80 con 0x7f38000c47f0 2023-12-16T03:28:35.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f77fe640 1 -- 172.21.15.28:0/2996144920 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e8007270 con 0x7f38000c47f0 2023-12-16T03:28:35.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f38055aa640 1 -- 172.21.15.28:0/2996144920 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3800155ba0 con 0x7f38000c47f0 2023-12-16T03:28:35.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f38055aa640 1 -- 172.21.15.28:0/2996144920 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380004e850 con 0x7f38000c47f0 2023-12-16T03:28:35.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.154+0000 7f37f77fe640 1 -- 172.21.15.28:0/2996144920 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f37e80073d0 con 0x7f38000c47f0 2023-12-16T03:28:35.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.158+0000 7f37f77fe640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f37e00664a0 0x7f37e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.158+0000 7f37f77fe640 1 -- 172.21.15.28:0/2996144920 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f37e8083a10 con 0x7f38000c47f0 2023-12-16T03:28:35.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.158+0000 7f37feffd640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f37e00664a0 0x7f37e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.158+0000 7f37feffd640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f37e00664a0 0x7f37e0068960 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f37f00ad000 tx=0x7f37f00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:35.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.162+0000 7f37f77fe640 1 -- 172.21.15.28:0/2996144920 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f37e8054720 con 0x7f38000c47f0 2023-12-16T03:28:35.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 -- 172.21.15.28:0/2996144920 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f380006d2e0 con 0x7f38000c47f0 2023-12-16T03:28:35.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f37f77fe640 1 -- 172.21.15.28:0/2996144920 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f37e80170a0 con 0x7f38000c47f0 2023-12-16T03:28:35.326 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:35.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 -- 172.21.15.28:0/2996144920 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f37e00664a0 msgr2=0x7f37e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f37e00664a0 0x7f37e0068960 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f37f00ad000 tx=0x7f37f00a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:35.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 -- 172.21.15.28:0/2996144920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38000c47f0 msgr2=0x7f38000adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38000c47f0 0x7f38000adb40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f37e800cac0 tx=0x7f37e800cf80 comp rx=0 tx=0).stop 2023-12-16T03:28:35.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 -- 172.21.15.28:0/2996144920 shutdown_connections 2023-12-16T03:28:35.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f380014b0d0 0x7f3800146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f37e00664a0 0x7f37e0068960 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f38000c47f0 0x7f38000adb40 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 --2- 172.21.15.28:0/2996144920 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f380006c4d0 0x7f380015f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 -- 172.21.15.28:0/2996144920 >> 172.21.15.28:0/2996144920 conn(0x7f38000aba00 msgr2=0x7f3800153f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:35.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 -- 172.21.15.28:0/2996144920 shutdown_connections 2023-12-16T03:28:35.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.322+0000 7f38055aa640 1 -- 172.21.15.28:0/2996144920 wait complete. 2023-12-16T03:28:35.347 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-16T03:28:35.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.486+0000 7f1a05fe6640 1 Processor -- start 2023-12-16T03:28:35.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.486+0000 7f1a05fe6640 1 -- start start 2023-12-16T03:28:35.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f1a05fe6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a000a6df0 0x7f1a000c1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f1a05fe6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a000c1ec0 con 0x7f1a000c61e0 2023-12-16T03:28:35.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f1a05fe6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a000c28e0 con 0x7f1a001555c0 2023-12-16T03:28:35.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f1a05fe6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c3680 con 0x7f1a000a6df0 2023-12-16T03:28:35.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19feffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1a000c61e0 0x7f1a000c1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36646/0 (socket says 172.21.15.28:36646) 2023-12-16T03:28:35.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19feffd640 1 -- 172.21.15.28:0/38101355 learned_addr learned my addr 172.21.15.28:0/38101355 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:35.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fffff640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a000a6df0 0x7f1a000c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665799613 0 0) 0x7f1a000c1ec0 con 0x7f1a000c61e0 2023-12-16T03:28:35.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19e8003530 con 0x7f1a000c61e0 2023-12-16T03:28:35.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184259155 0 0) 0x7f1a000c28e0 con 0x7f1a001555c0 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a000c1ec0 con 0x7f1a001555c0 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2946288207 0 0) 0x7f19e8003530 con 0x7f1a000c61e0 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a000a6df0 msgr2=0x7f1a000c1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a000a6df0 0x7f1a000c1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 >> v1:172.21.15.134:6789/0 conn(0x7f1a001555c0 legacy=0x7f1a000c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a000c2b80 con 0x7f1a000c61e0 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f19f4001680 con 0x7f1a000c61e0 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 >> v1:172.21.15.28:6789/0 conn(0x7f1a000c61e0 legacy=0x7f1a000c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e8003b40 0x7f19e8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a000a6df0 0x7f19e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 0x7f19e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c3680 con 0x7f19e8004d10 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e800ba70 con 0x7f19e8003b40 2023-12-16T03:28:35.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e800bc30 con 0x7f1a000a6df0 2023-12-16T03:28:35.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fffff640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 0x7f19e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19ff7fe640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e8003b40 0x7f19e8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19feffd640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a000a6df0 0x7f19e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fffff640 1 -- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a000a6df0 msgr2=0x7f19e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:35.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fffff640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a000a6df0 0x7f19e80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fffff640 1 -- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e8003b40 msgr2=0x7f19e8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:35.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fffff640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e8003b40 0x7f19e8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19fffff640 1 -- 172.21.15.28:0/38101355 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8003530 con 0x7f19e8004d10 2023-12-16T03:28:35.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.490+0000 7f19ff7fe640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e8003b40 0x7f19e8003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:35.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.494+0000 7f19fffff640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 0x7f19e8005190 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009fc0 tx=0x7f19f801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee36aa46d52c83a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:35.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80a5b60 con 0x7f19e8004d10 2023-12-16T03:28:35.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f800f040 con 0x7f19e8004d10 2023-12-16T03:28:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f19fe7fc640 1 -- 172.21.15.28:0/38101355 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80ad440 con 0x7f19e8004d10 2023-12-16T03:28:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f1a05fe6640 1 -- 172.21.15.28:0/38101355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 msgr2=0x7f19e8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f1a05fe6640 1 --2- 172.21.15.28:0/38101355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 0x7f19e8005190 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009fc0 tx=0x7f19f801cc60 comp rx=0 tx=0).stop 2023-12-16T03:28:35.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f19fffff640 1 -- 172.21.15.28:0/38101355 reap_dead start 2023-12-16T03:28:35.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f1a05fe6640 1 -- 172.21.15.28:0/38101355 shutdown_connections 2023-12-16T03:28:35.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f1a05fe6640 1 -- 172.21.15.28:0/38101355 >> 172.21.15.28:0/38101355 conn(0x7f1a000c7e40 msgr2=0x7f1a000c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:35.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f1a05fe6640 1 -- 172.21.15.28:0/38101355 shutdown_connections 2023-12-16T03:28:35.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f1a05fe6640 1 -- 172.21.15.28:0/38101355 wait complete. 2023-12-16T03:28:35.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f1a05fe6640 1 Processor -- start 2023-12-16T03:28:35.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.498+0000 7f1a05fe6640 1 -- start start 2023-12-16T03:28:35.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f1a05fe6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 0x7f1a00144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f1a05fe6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a00155e80 0x7f1a00149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f1a05fe6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a00153ec0 0x7f1a0014a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f1a05fe6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a00153a30 con 0x7f19e8004d10 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f1a05fe6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a001565f0 con 0x7f1a00155e80 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f1a05fe6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a00156310 con 0x7f1a00153ec0 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19ff7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 0x7f1a00144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19ff7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 0x7f1a00144570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42232/0 (socket says 172.21.15.28:42232) 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19ff7fe640 1 -- 172.21.15.28:0/139133586 learned_addr learned my addr 172.21.15.28:0/139133586 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19fffff640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a00153ec0 0x7f1a0014a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19feffd640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a00155e80 0x7f1a00149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19ff7fe640 1 -- 172.21.15.28:0/139133586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a00153ec0 msgr2=0x7f1a0014a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19ff7fe640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a00153ec0 0x7f1a0014a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19ff7fe640 1 -- 172.21.15.28:0/139133586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a00155e80 msgr2=0x7f1a00149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19ff7fe640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a00155e80 0x7f1a00149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19ff7fe640 1 -- 172.21.15.28:0/139133586 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a001533e0 con 0x7f19e8004d10 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19feffd640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a00155e80 0x7f1a00149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19ff7fe640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 0x7f1a00144570 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f19f000f8d0 tx=0x7f19f000fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:35.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19e7fff640 1 -- 172.21.15.28:0/139133586 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00052e0 con 0x7f19e8004d10 2023-12-16T03:28:35.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19e7fff640 1 -- 172.21.15.28:0/139133586 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f0005440 con 0x7f19e8004d10 2023-12-16T03:28:35.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f1a05fe6640 1 -- 172.21.15.28:0/139133586 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a001536c0 con 0x7f19e8004d10 2023-12-16T03:28:35.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19e7fff640 1 -- 172.21.15.28:0/139133586 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f000d950 con 0x7f19e8004d10 2023-12-16T03:28:35.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f1a05fe6640 1 -- 172.21.15.28:0/139133586 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a00144ab0 con 0x7f19e8004d10 2023-12-16T03:28:35.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f1a05fe6640 1 -- 172.21.15.28:0/139133586 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a00068400 con 0x7f19e8004d10 2023-12-16T03:28:35.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.502+0000 7f19e7fff640 1 -- 172.21.15.28:0/139133586 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f19f000dab0 con 0x7f19e8004d10 2023-12-16T03:28:35.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.506+0000 7f19e7fff640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19ec066470 0x7f19ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:35.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.506+0000 7f19e7fff640 1 -- 172.21.15.28:0/139133586 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f19f0084450 con 0x7f19e8004d10 2023-12-16T03:28:35.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.506+0000 7f19feffd640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19ec066470 0x7f19ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:35.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.506+0000 7f19feffd640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19ec066470 0x7f19ec068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f19f4001060 tx=0x7f19f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:35.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.510+0000 7f19e7fff640 1 -- 172.21.15.28:0/139133586 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f19f0054f60 con 0x7f19e8004d10 2023-12-16T03:28:35.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 -- 172.21.15.28:0/139133586 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1a000c5fc0 con 0x7f19e8004d10 2023-12-16T03:28:35.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f19e7fff640 1 -- 172.21.15.28:0/139133586 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f19f0054af0 con 0x7f19e8004d10 2023-12-16T03:28:35.683 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-12-16T03:28:35.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 -- 172.21.15.28:0/139133586 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19ec066470 msgr2=0x7f19ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19ec066470 0x7f19ec068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f19f4001060 tx=0x7f19f4009040 comp rx=0 tx=0).stop 2023-12-16T03:28:35.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 -- 172.21.15.28:0/139133586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 msgr2=0x7f1a00144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:35.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 0x7f1a00144570 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f19f000f8d0 tx=0x7f19f000fd90 comp rx=0 tx=0).stop 2023-12-16T03:28:35.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 -- 172.21.15.28:0/139133586 shutdown_connections 2023-12-16T03:28:35.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1a00153ec0 0x7f1a0014a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a00155e80 0x7f1a00149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f19ec066470 0x7f19ec068930 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 --2- 172.21.15.28:0/139133586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19e8004d10 0x7f1a00144570 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:35.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 -- 172.21.15.28:0/139133586 >> 172.21.15.28:0/139133586 conn(0x7f1a000c7e40 msgr2=0x7f1a000c6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:35.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 -- 172.21.15.28:0/139133586 shutdown_connections 2023-12-16T03:28:35.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:35.678+0000 7f1a05fe6640 1 -- 172.21.15.28:0/139133586 wait complete. 2023-12-16T03:28:35.703 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-16T03:28:35.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:35.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-16T03:28:35.733 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:28:35.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:35.733 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-16T03:28:35.792 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-16T03:28:35.792 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:28:35.899 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-16T03:28:35.987 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-16T03:28:35.987 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:35.987 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:35.997 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7208 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-16T03:28:35.997 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:35.997 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:36.010 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-16T03:28:36.010 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:28:36.155 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:28:36.159 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:28:36.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.178+0000 7fd212ebb640 1 Processor -- start 2023-12-16T03:28:36.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.178+0000 7fd212ebb640 1 -- start start 2023-12-16T03:28:36.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd212ebb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd20c155650 0x7fd20c0a6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd212ebb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd20c0c1550 0x7fd20c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd212ebb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c0c3980 con 0x7fd20c0c6250 2023-12-16T03:28:36.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd212ebb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c0c4360 con 0x7fd20c0c1550 2023-12-16T03:28:36.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd212ebb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0c2bb0 con 0x7fd20c155650 2023-12-16T03:28:36.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd211458640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd20c0c1550 0x7fd20c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd20bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd20c0c6250 0x7fd20c0c6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36656/0 (socket says 172.21.15.28:36656) 2023-12-16T03:28:36.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd20bfff640 1 -- 172.21.15.28:0/3778425257 learned_addr learned my addr 172.21.15.28:0/3778425257 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:36.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd210c57640 1 --2- 172.21.15.28:0/3778425257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd20c155650 0x7fd20c0a6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd211458640 1 -- 172.21.15.28:0/3778425257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd20c155650 msgr2=0x7fd20c0a6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:36.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd211458640 1 --2- 172.21.15.28:0/3778425257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd20c155650 0x7fd20c0a6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd211458640 1 -- 172.21.15.28:0/3778425257 >> v1:172.21.15.28:6789/0 conn(0x7fd20c0c6250 legacy=0x7fd20c0c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.182+0000 7fd211458640 1 -- 172.21.15.28:0/3778425257 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0c2e90 con 0x7fd20c0c1550 2023-12-16T03:28:36.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd211458640 1 --2- 172.21.15.28:0/3778425257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20c0c1550 0x7fd20c0c1a00 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd204009d90 tx=0x7fd20401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d440601e4bd744f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:36.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd20b7fe640 1 -- 172.21.15.28:0/3778425257 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040a5980 con 0x7fd20c0c1550 2023-12-16T03:28:36.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd20b7fe640 1 -- 172.21.15.28:0/3778425257 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2040a5ae0 con 0x7fd20c0c1550 2023-12-16T03:28:36.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd20b7fe640 1 -- 172.21.15.28:0/3778425257 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040a5e70 con 0x7fd20c0c1550 2023-12-16T03:28:36.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd212ebb640 1 -- 172.21.15.28:0/3778425257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20c0c1550 msgr2=0x7fd20c0c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd212ebb640 1 --2- 172.21.15.28:0/3778425257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20c0c1550 0x7fd20c0c1a00 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd204009d90 tx=0x7fd20401c8c0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd212ebb640 1 -- 172.21.15.28:0/3778425257 shutdown_connections 2023-12-16T03:28:36.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd212ebb640 1 --2- 172.21.15.28:0/3778425257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20c0c1550 0x7fd20c0c1a00 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd212ebb640 1 --2- 172.21.15.28:0/3778425257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd20c155650 0x7fd20c0a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd212ebb640 1 -- 172.21.15.28:0/3778425257 >> 172.21.15.28:0/3778425257 conn(0x7fd20c0c7e40 msgr2=0x7fd20c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:36.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd212ebb640 1 -- 172.21.15.28:0/3778425257 shutdown_connections 2023-12-16T03:28:36.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd212ebb640 1 -- 172.21.15.28:0/3778425257 wait complete. 2023-12-16T03:28:36.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd212ebb640 1 Processor -- start 2023-12-16T03:28:36.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.186+0000 7fd212ebb640 1 -- start start 2023-12-16T03:28:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd212ebb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd20c0c1550 0x7fd20c14abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd212ebb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20c0c6250 0x7fd20c154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd212ebb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd20c155650 0x7fd20c156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd212ebb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c158bf0 con 0x7fd20c0c6250 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd212ebb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0ab650 con 0x7fd20c0c1550 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd212ebb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c158630 con 0x7fd20c155650 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd20bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20c0c6250 0x7fd20c154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd20bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20c0c6250 0x7fd20c154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42260/0 (socket says 172.21.15.28:42260) 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd20bfff640 1 -- 172.21.15.28:0/3517733615 learned_addr learned my addr 172.21.15.28:0/3517733615 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd210c57640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd20c0c1550 0x7fd20c14abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd211458640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd20c155650 0x7fd20c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd20bfff640 1 -- 172.21.15.28:0/3517733615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd20c155650 msgr2=0x7fd20c156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd20bfff640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd20c155650 0x7fd20c156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd20bfff640 1 -- 172.21.15.28:0/3517733615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd20c0c1550 msgr2=0x7fd20c14abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd20bfff640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd20c0c1550 0x7fd20c14abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd20bfff640 1 -- 172.21.15.28:0/3517733615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204009a70 con 0x7fd20c0c6250 2023-12-16T03:28:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd211458640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd20c155650 0x7fd20c156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd20bfff640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20c0c6250 0x7fd20c154070 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c4d0 tx=0x7fd1f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd2097fa640 1 -- 172.21.15.28:0/3517733615 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8005cf0 con 0x7fd20c0c6250 2023-12-16T03:28:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd2097fa640 1 -- 172.21.15.28:0/3517733615 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f8005e50 con 0x7fd20c0c6250 2023-12-16T03:28:36.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd2097fa640 1 -- 172.21.15.28:0/3517733615 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8007270 con 0x7fd20c0c6250 2023-12-16T03:28:36.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd212ebb640 1 -- 172.21.15.28:0/3517733615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c158910 con 0x7fd20c0c6250 2023-12-16T03:28:36.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd212ebb640 1 -- 172.21.15.28:0/3517733615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c1f13c0 con 0x7fd20c0c6250 2023-12-16T03:28:36.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd212ebb640 1 -- 172.21.15.28:0/3517733615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c1f0f40 con 0x7fd20c0c6250 2023-12-16T03:28:36.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.190+0000 7fd2097fa640 1 -- 172.21.15.28:0/3517733615 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd1f80073d0 con 0x7fd20c0c6250 2023-12-16T03:28:36.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.194+0000 7fd2097fa640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1f0066470 0x7fd1f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.194+0000 7fd2097fa640 1 -- 172.21.15.28:0/3517733615 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd1f80835f0 con 0x7fd20c0c6250 2023-12-16T03:28:36.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.194+0000 7fd210c57640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1f0066470 0x7fd1f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.194+0000 7fd210c57640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1f0066470 0x7fd1f0068930 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd200009a50 tx=0x7fd200008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:36.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.198+0000 7fd2097fa640 1 -- 172.21.15.28:0/3517733615 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd20c1f0f40 con 0x7fd20c0c6250 2023-12-16T03:28:36.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.386+0000 7fd212ebb640 1 -- 172.21.15.28:0/3517733615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd20c1f0f40 con 0x7fd20c0c6250 2023-12-16T03:28:36.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd2097fa640 1 -- 172.21.15.28:0/3517733615 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6184 (secure 0 0 0) 0x7fd20c1f0f40 con 0x7fd20c0c6250 2023-12-16T03:28:36.393 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:36.393 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/651767003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":651767003},{"type":"v1","addr":"172.21.15.28:6837","nonce":651767003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4202659808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4202659808},{"type":"v1","addr":"172.21.15.134:6834","nonce":4202659808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:59.086495+0000","modified":"2023-12-16T03:28:02.105487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/2582425067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2582425067},{"type":"v1","addr":"172.21.15.28:6836","nonce":2582425067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:28:12.170094+0000","modified":"2023-12-16T03:28:15.197722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5729":{"gid":5729,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6835/931138884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":931138884},{"type":"v1","addr":"172.21.15.134:6835","nonce":931138884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-16T03:28:36.394 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 51 2023-12-16T03:28:36.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 -- 172.21.15.28:0/3517733615 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1f0066470 msgr2=0x7fd1f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1f0066470 0x7fd1f0068930 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd200009a50 tx=0x7fd200008040 comp rx=0 tx=0).stop 2023-12-16T03:28:36.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 -- 172.21.15.28:0/3517733615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20c0c6250 msgr2=0x7fd20c154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20c0c6250 0x7fd20c154070 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c4d0 tx=0x7fd1f800c990 comp rx=0 tx=0).stop 2023-12-16T03:28:36.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 -- 172.21.15.28:0/3517733615 shutdown_connections 2023-12-16T03:28:36.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd20c155650 0x7fd20c156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fd1f0066470 0x7fd1f0068930 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20c0c6250 0x7fd20c154070 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 --2- 172.21.15.28:0/3517733615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd20c0c1550 0x7fd20c14abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 -- 172.21.15.28:0/3517733615 >> 172.21.15.28:0/3517733615 conn(0x7fd20c0c7e40 msgr2=0x7fd20c06e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:36.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 -- 172.21.15.28:0/3517733615 shutdown_connections 2023-12-16T03:28:36.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.390+0000 7fd212ebb640 1 -- 172.21.15.28:0/3517733615 wait complete. 2023-12-16T03:28:36.415 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:36.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.554+0000 7fb364bc4640 1 Processor -- start 2023-12-16T03:28:36.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.554+0000 7fb364bc4640 1 -- start start 2023-12-16T03:28:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb364bc4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb360072090 0x7fb360150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb364bc4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3600725c0 0x7fb3601514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb364bc4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3600c2760 con 0x7fb3600a5370 2023-12-16T03:28:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb364bc4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3600c3070 con 0x7fb3600725c0 2023-12-16T03:28:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb364bc4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600a5750 con 0x7fb360072090 2023-12-16T03:28:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb35ed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3600725c0 0x7fb3601514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb35ed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3600725c0 0x7fb3601514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42274/0 (socket says 172.21.15.28:42274) 2023-12-16T03:28:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb35ed9d640 1 -- 172.21.15.28:0/3874892510 learned_addr learned my addr 172.21.15.28:0/3874892510 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb35dd9b640 1 --2- 172.21.15.28:0/3874892510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb360072090 0x7fb360150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb35ed9d640 1 -- 172.21.15.28:0/3874892510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb360072090 msgr2=0x7fb360150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb35ed9d640 1 --2- 172.21.15.28:0/3874892510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb360072090 0x7fb360150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb35ed9d640 1 -- 172.21.15.28:0/3874892510 >> v1:172.21.15.134:6789/0 conn(0x7fb3600a5370 legacy=0x7fb3600c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.558+0000 7fb35ed9d640 1 -- 172.21.15.28:0/3874892510 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3600aad20 con 0x7fb3600725c0 2023-12-16T03:28:36.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb35ed9d640 1 --2- 172.21.15.28:0/3874892510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600725c0 0x7fb3601514e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fb358009e50 tx=0x7fb35801d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c647ab057d3e9bf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:36.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb35d59a640 1 -- 172.21.15.28:0/3874892510 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580a6850 con 0x7fb3600725c0 2023-12-16T03:28:36.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb35d59a640 1 -- 172.21.15.28:0/3874892510 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3580a69b0 con 0x7fb3600725c0 2023-12-16T03:28:36.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb35d59a640 1 -- 172.21.15.28:0/3874892510 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580a6d40 con 0x7fb3600725c0 2023-12-16T03:28:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 -- 172.21.15.28:0/3874892510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600725c0 msgr2=0x7fb3601514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 --2- 172.21.15.28:0/3874892510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600725c0 0x7fb3601514e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fb358009e50 tx=0x7fb35801d9d0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 -- 172.21.15.28:0/3874892510 shutdown_connections 2023-12-16T03:28:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 --2- 172.21.15.28:0/3874892510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb360072090 0x7fb360150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 --2- 172.21.15.28:0/3874892510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600725c0 0x7fb3601514e0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 -- 172.21.15.28:0/3874892510 >> 172.21.15.28:0/3874892510 conn(0x7fb36006a5b0 msgr2=0x7fb36006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 -- 172.21.15.28:0/3874892510 shutdown_connections 2023-12-16T03:28:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 -- 172.21.15.28:0/3874892510 wait complete. 2023-12-16T03:28:36.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 Processor -- start 2023-12-16T03:28:36.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 -- start start 2023-12-16T03:28:36.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb360072090 0x7fb36014a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3600725c0 0x7fb3601f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600a5370 0x7fb36006d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600718d0 con 0x7fb3600a5370 2023-12-16T03:28:36.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36014aa20 con 0x7fb3600725c0 2023-12-16T03:28:36.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.562+0000 7fb364bc4640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3601501d0 con 0x7fb360072090 2023-12-16T03:28:36.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb35ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600a5370 0x7fb36006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb35ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600a5370 0x7fb36006d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42276/0 (socket says 172.21.15.28:42276) 2023-12-16T03:28:36.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb35ed9d640 1 -- 172.21.15.28:0/3054596094 learned_addr learned my addr 172.21.15.28:0/3054596094 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb35e59c640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb360072090 0x7fb36014a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb35dd9b640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3600725c0 0x7fb3601f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb35ed9d640 1 -- 172.21.15.28:0/3054596094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb360072090 msgr2=0x7fb36014a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb35ed9d640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb360072090 0x7fb36014a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb35ed9d640 1 -- 172.21.15.28:0/3054596094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3600725c0 msgr2=0x7fb3601f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb35ed9d640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3600725c0 0x7fb3601f0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb35ed9d640 1 -- 172.21.15.28:0/3054596094 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358009b30 con 0x7fb3600a5370 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb35ed9d640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600a5370 0x7fb36006d740 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb3580b0040 tx=0x7fb35801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb34effd640 1 -- 172.21.15.28:0/3054596094 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580b8600 con 0x7fb3600a5370 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb34effd640 1 -- 172.21.15.28:0/3054596094 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3580b8760 con 0x7fb3600a5370 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb364bc4640 1 -- 172.21.15.28:0/3054596094 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb360070320 con 0x7fb3600a5370 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb34effd640 1 -- 172.21.15.28:0/3054596094 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580b8b10 con 0x7fb3600a5370 2023-12-16T03:28:36.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb364bc4640 1 -- 172.21.15.28:0/3054596094 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36006fff0 con 0x7fb3600a5370 2023-12-16T03:28:36.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb364bc4640 1 -- 172.21.15.28:0/3054596094 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36006fe50 con 0x7fb3600a5370 2023-12-16T03:28:36.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.566+0000 7fb34effd640 1 -- 172.21.15.28:0/3054596094 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb3580b8c70 con 0x7fb3600a5370 2023-12-16T03:28:36.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.570+0000 7fb34effd640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb340066470 0x7fb340068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.570+0000 7fb34effd640 1 -- 172.21.15.28:0/3054596094 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb35811efd0 con 0x7fb3600a5370 2023-12-16T03:28:36.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.570+0000 7fb35e59c640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb340066470 0x7fb340068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.570+0000 7fb35e59c640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb340066470 0x7fb340068930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb350007fd0 tx=0x7fb350009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:36.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.574+0000 7fb34effd640 1 -- 172.21.15.28:0/3054596094 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb36006fe50 con 0x7fb3600a5370 2023-12-16T03:28:36.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.730+0000 7fb364bc4640 1 -- 172.21.15.28:0/3054596094 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb36006fe50 con 0x7fb3600a5370 2023-12-16T03:28:36.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.730+0000 7fb34effd640 1 -- 172.21.15.28:0/3054596094 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20214 (secure 0 0 0) 0x7fb36006fe50 con 0x7fb3600a5370 2023-12-16T03:28:36.736 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:36.736 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:13.793649+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 -- 172.21.15.28:0/3054596094 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb340066470 msgr2=0x7fb340068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb340066470 0x7fb340068930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb350007fd0 tx=0x7fb350009040 comp rx=0 tx=0).stop 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 -- 172.21.15.28:0/3054596094 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600a5370 msgr2=0x7fb36006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600a5370 0x7fb36006d740 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb3580b0040 tx=0x7fb35801c210 comp rx=0 tx=0).stop 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 -- 172.21.15.28:0/3054596094 shutdown_connections 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb340066470 0x7fb340068930 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600a5370 0x7fb36006d740 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3600725c0 0x7fb3601f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 --2- 172.21.15.28:0/3054596094 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb360072090 0x7fb36014a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 -- 172.21.15.28:0/3054596094 >> 172.21.15.28:0/3054596094 conn(0x7fb36006a5b0 msgr2=0x7fb3601541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 -- 172.21.15.28:0/3054596094 shutdown_connections 2023-12-16T03:28:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.734+0000 7fb364bc4640 1 -- 172.21.15.28:0/3054596094 wait complete. 2023-12-16T03:28:36.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-16T03:27:56.894984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-16T03:27:58.090972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:28:10.280019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:28:11.167317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:28:36.758 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:28:36.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.902+0000 7f4bf4209640 1 Processor -- start 2023-12-16T03:28:36.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.902+0000 7f4bf4209640 1 -- start start 2023-12-16T03:28:36.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.902+0000 7f4bf4209640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4bec06a5b0 0x7f4bec06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.902+0000 7f4bf4209640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bec06dfe0 0x7f4bec0c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.902+0000 7f4bf4209640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bec072500 con 0x7f4bec06b1e0 2023-12-16T03:28:36.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.902+0000 7f4bf4209640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec06ef50 con 0x7f4bec06a5b0 2023-12-16T03:28:36.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.902+0000 7f4bf4209640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0720b0 con 0x7f4bec06dfe0 2023-12-16T03:28:36.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf1fa5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4bec06a5b0 0x7f4bec06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf17a4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bec06dfe0 0x7f4bec0c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf1fa5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4bec06a5b0 0x7f4bec06a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:51038/0 (socket says 172.21.15.28:51038) 2023-12-16T03:28:36.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf27a6640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4bec06b1e0 0x7f4bec0c25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:51358/0 (socket says 172.21.15.28:51358) 2023-12-16T03:28:36.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf1fa5640 1 -- 172.21.15.28:0/3773252665 learned_addr learned my addr 172.21.15.28:0/3773252665 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:36.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf17a4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bec06dfe0 0x7f4bec0c2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:34600/0 (socket says 172.21.15.28:34600) 2023-12-16T03:28:36.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf1fa5640 1 -- 172.21.15.28:0/3773252665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bec06dfe0 msgr2=0x7f4bec0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:36.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf1fa5640 1 --2- 172.21.15.28:0/3773252665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bec06dfe0 0x7f4bec0c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf1fa5640 1 -- 172.21.15.28:0/3773252665 >> v1:172.21.15.134:6789/0 conn(0x7f4bec06b1e0 legacy=0x7f4bec0c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf1fa5640 1 -- 172.21.15.28:0/3773252665 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec070f60 con 0x7f4bec06a5b0 2023-12-16T03:28:36.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf0fa3640 1 -- 172.21.15.28:0/3773252665 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835628733 0 0) 0x7f4bec072500 con 0x7f4bec06b1e0 2023-12-16T03:28:36.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.906+0000 7f4bf1fa5640 1 --2- 172.21.15.28:0/3773252665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bec06a5b0 0x7f4bec06a990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009870 tx=0x7f4be801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfa6e2606c1836e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf0fa3640 1 -- 172.21.15.28:0/3773252665 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80ab600 con 0x7f4bec06a5b0 2023-12-16T03:28:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf0fa3640 1 -- 172.21.15.28:0/3773252665 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be80a7050 con 0x7f4bec06a5b0 2023-12-16T03:28:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf0fa3640 1 -- 172.21.15.28:0/3773252665 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80ab980 con 0x7f4bec06a5b0 2023-12-16T03:28:36.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 -- 172.21.15.28:0/3773252665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bec06a5b0 msgr2=0x7f4bec06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 --2- 172.21.15.28:0/3773252665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bec06a5b0 0x7f4bec06a990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009870 tx=0x7f4be801c4b0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 -- 172.21.15.28:0/3773252665 shutdown_connections 2023-12-16T03:28:36.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 --2- 172.21.15.28:0/3773252665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bec06dfe0 0x7f4bec0c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 --2- 172.21.15.28:0/3773252665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bec06a5b0 0x7f4bec06a990 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 -- 172.21.15.28:0/3773252665 >> 172.21.15.28:0/3773252665 conn(0x7f4bec0c6ef0 msgr2=0x7f4bec0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:36.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 -- 172.21.15.28:0/3773252665 shutdown_connections 2023-12-16T03:28:36.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 -- 172.21.15.28:0/3773252665 wait complete. 2023-12-16T03:28:36.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 Processor -- start 2023-12-16T03:28:36.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 -- start start 2023-12-16T03:28:36.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bec06a5b0 0x7f4bec0c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bec06b1e0 0x7f4bec1437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bec06dfe0 0x7f4bec1396c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec1444f0 con 0x7f4bec06a5b0 2023-12-16T03:28:36.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0c55a0 con 0x7f4bec06b1e0 2023-12-16T03:28:36.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf4209640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0c5840 con 0x7f4bec06dfe0 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf1fa5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bec06a5b0 0x7f4bec0c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf1fa5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bec06a5b0 0x7f4bec0c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42284/0 (socket says 172.21.15.28:42284) 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.910+0000 7f4bf1fa5640 1 -- 172.21.15.28:0/2896814215 learned_addr learned my addr 172.21.15.28:0/2896814215 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4bf17a4640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bec06b1e0 0x7f4bec1437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4bf27a6640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bec06dfe0 0x7f4bec1396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4bf1fa5640 1 -- 172.21.15.28:0/2896814215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bec06dfe0 msgr2=0x7f4bec1396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4bf1fa5640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bec06dfe0 0x7f4bec1396c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4bf1fa5640 1 -- 172.21.15.28:0/2896814215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bec06b1e0 msgr2=0x7f4bec1437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4bf1fa5640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bec06b1e0 0x7f4bec1437a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4bf1fa5640 1 -- 172.21.15.28:0/2896814215 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be80094d0 con 0x7f4bec06a5b0 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4bf1fa5640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bec06a5b0 0x7f4bec0c5060 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f4be80ae040 tx=0x7f4be801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4be27fc640 1 -- 172.21.15.28:0/2896814215 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80b6420 con 0x7f4bec06a5b0 2023-12-16T03:28:36.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4be27fc640 1 -- 172.21.15.28:0/2896814215 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be80b6580 con 0x7f4bec06a5b0 2023-12-16T03:28:36.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4be27fc640 1 -- 172.21.15.28:0/2896814215 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80b6910 con 0x7f4bec06a5b0 2023-12-16T03:28:36.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4bf4209640 1 -- 172.21.15.28:0/2896814215 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec0c5b20 con 0x7f4bec06a5b0 2023-12-16T03:28:36.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4bf4209640 1 -- 172.21.15.28:0/2896814215 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec0c60e0 con 0x7f4bec06a5b0 2023-12-16T03:28:36.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4bf4209640 1 -- 172.21.15.28:0/2896814215 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec0c62d0 con 0x7f4bec06a5b0 2023-12-16T03:28:36.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.914+0000 7f4be27fc640 1 -- 172.21.15.28:0/2896814215 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4be80b2040 con 0x7f4bec06a5b0 2023-12-16T03:28:36.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.918+0000 7f4be27fc640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4bd0066470 0x7f4bd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:36.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.918+0000 7f4be27fc640 1 -- 172.21.15.28:0/2896814215 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4be811e400 con 0x7f4bec06a5b0 2023-12-16T03:28:36.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.918+0000 7f4bf17a4640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4bd0066470 0x7f4bd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:36.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.918+0000 7f4bf17a4640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4bd0066470 0x7f4bd0068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4bec158870 tx=0x7f4bdc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:36.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:36.922+0000 7f4be27fc640 1 -- 172.21.15.28:0/2896814215 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4be80eb590 con 0x7f4bec06a5b0 2023-12-16T03:28:37.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 -- 172.21.15.28:0/2896814215 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4bec0c30d0 con 0x7f4bec06a5b0 2023-12-16T03:28:37.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4be27fc640 1 -- 172.21.15.28:0/2896814215 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bec0c30d0 con 0x7f4bec06a5b0 2023-12-16T03:28:37.082 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:28:37.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 -- 172.21.15.28:0/2896814215 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4bd0066470 msgr2=0x7f4bd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4bd0066470 0x7f4bd0068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4bec158870 tx=0x7f4bdc008040 comp rx=0 tx=0).stop 2023-12-16T03:28:37.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 -- 172.21.15.28:0/2896814215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bec06a5b0 msgr2=0x7f4bec0c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bec06a5b0 0x7f4bec0c5060 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f4be80ae040 tx=0x7f4be801acf0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 -- 172.21.15.28:0/2896814215 shutdown_connections 2023-12-16T03:28:37.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4bec06dfe0 0x7f4bec1396c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bec06b1e0 0x7f4bec1437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4bd0066470 0x7f4bd0068930 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 --2- 172.21.15.28:0/2896814215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bec06a5b0 0x7f4bec0c5060 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 -- 172.21.15.28:0/2896814215 >> 172.21.15.28:0/2896814215 conn(0x7f4bec0c6ef0 msgr2=0x7f4bec14c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:37.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 -- 172.21.15.28:0/2896814215 shutdown_connections 2023-12-16T03:28:37.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.078+0000 7f4bf4209640 1 -- 172.21.15.28:0/2896814215 wait complete. 2023-12-16T03:28:37.102 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-16T03:28:37.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.242+0000 7fced992a640 1 Processor -- start 2023-12-16T03:28:37.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.242+0000 7fced992a640 1 -- start start 2023-12-16T03:28:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced992a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fced40c5260 0x7fced406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced992a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fced4155de0 0x7fced4156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced992a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced40c2580 con 0x7fced40c5640 2023-12-16T03:28:37.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced992a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced4153510 con 0x7fced4155de0 2023-12-16T03:28:37.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced992a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced40c17f0 con 0x7fced40c5260 2023-12-16T03:28:37.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fced4155de0 0x7fced4156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fcecbfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fced40c5640 0x7fced40c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36664/0 (socket says 172.21.15.28:36664) 2023-12-16T03:28:37.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fcecbfff640 1 -- 172.21.15.28:0/5362933 learned_addr learned my addr 172.21.15.28:0/5362933 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:37.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced2ffd640 1 --2- 172.21.15.28:0/5362933 >> v2:172.21.15.134:3300/0 conn(0x7fced40c5260 0x7fced406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced37fe640 1 -- 172.21.15.28:0/5362933 >> v2:172.21.15.134:3300/0 conn(0x7fced40c5260 msgr2=0x7fced406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:37.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced37fe640 1 --2- 172.21.15.28:0/5362933 >> v2:172.21.15.134:3300/0 conn(0x7fced40c5260 0x7fced406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced37fe640 1 -- 172.21.15.28:0/5362933 >> v1:172.21.15.28:6789/0 conn(0x7fced40c5640 legacy=0x7fced40c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced37fe640 1 -- 172.21.15.28:0/5362933 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced40c1a00 con 0x7fced4155de0 2023-12-16T03:28:37.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.246+0000 7fced2ffd640 1 --2- 172.21.15.28:0/5362933 >> v2:172.21.15.134:3300/0 conn(0x7fced40c5260 0x7fced406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:37.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced37fe640 1 --2- 172.21.15.28:0/5362933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fced4155de0 0x7fced4156230 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fced40c6920 tx=0x7fcecc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebc08641aa63bbb server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:37.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced27fc640 1 -- 172.21.15.28:0/5362933 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0a5910 con 0x7fced4155de0 2023-12-16T03:28:37.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced27fc640 1 -- 172.21.15.28:0/5362933 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc0a5a70 con 0x7fced4155de0 2023-12-16T03:28:37.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced27fc640 1 -- 172.21.15.28:0/5362933 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0a5e00 con 0x7fced4155de0 2023-12-16T03:28:37.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced992a640 1 -- 172.21.15.28:0/5362933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fced4155de0 msgr2=0x7fced4156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced992a640 1 --2- 172.21.15.28:0/5362933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fced4155de0 0x7fced4156230 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fced40c6920 tx=0x7fcecc01c850 comp rx=0 tx=0).stop 2023-12-16T03:28:37.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced992a640 1 -- 172.21.15.28:0/5362933 shutdown_connections 2023-12-16T03:28:37.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced992a640 1 --2- 172.21.15.28:0/5362933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fced4155de0 0x7fced4156230 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced992a640 1 --2- 172.21.15.28:0/5362933 >> v2:172.21.15.134:3300/0 conn(0x7fced40c5260 0x7fced406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced992a640 1 -- 172.21.15.28:0/5362933 >> 172.21.15.28:0/5362933 conn(0x7fced406a5b0 msgr2=0x7fced406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:37.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced992a640 1 -- 172.21.15.28:0/5362933 shutdown_connections 2023-12-16T03:28:37.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced992a640 1 -- 172.21.15.28:0/5362933 wait complete. 2023-12-16T03:28:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced992a640 1 Processor -- start 2023-12-16T03:28:37.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.250+0000 7fced992a640 1 -- start start 2023-12-16T03:28:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced992a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced40c5260 0x7fced414eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced992a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fced40c5640 0x7fced40bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced992a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fced4155de0 0x7fced40a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced992a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced41f0ab0 con 0x7fced40c5640 2023-12-16T03:28:37.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced992a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced414f3f0 con 0x7fced40c5260 2023-12-16T03:28:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced992a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced414ebd0 con 0x7fced4155de0 2023-12-16T03:28:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fced40c5640 0x7fced40bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fced40c5640 0x7fced40bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42302/0 (socket says 172.21.15.28:42302) 2023-12-16T03:28:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fcecbfff640 1 -- 172.21.15.28:0/3956741431 learned_addr learned my addr 172.21.15.28:0/3956741431 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced2ffd640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced40c5260 0x7fced414eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fcecbfff640 1 -- 172.21.15.28:0/3956741431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fced4155de0 msgr2=0x7fced40a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fcecbfff640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fced4155de0 0x7fced40a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fcecbfff640 1 -- 172.21.15.28:0/3956741431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced40c5260 msgr2=0x7fced414eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fcecbfff640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced40c5260 0x7fced414eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fcecbfff640 1 -- 172.21.15.28:0/3956741431 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009a70 con 0x7fced40c5640 2023-12-16T03:28:37.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced2ffd640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced40c5260 0x7fced414eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:37.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fcecbfff640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fced40c5640 0x7fced40bfad0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fcebc001ec0 tx=0x7fcebc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced0ff9640 1 -- 172.21.15.28:0/3956741431 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc005cf0 con 0x7fced40c5640 2023-12-16T03:28:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced0ff9640 1 -- 172.21.15.28:0/3956741431 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc005e50 con 0x7fced40c5640 2023-12-16T03:28:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced992a640 1 -- 172.21.15.28:0/3956741431 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced40a6c40 con 0x7fced40c5640 2023-12-16T03:28:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced0ff9640 1 -- 172.21.15.28:0/3956741431 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc0072d0 con 0x7fced40c5640 2023-12-16T03:28:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced992a640 1 -- 172.21.15.28:0/3956741431 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced40c0010 con 0x7fced40c5640 2023-12-16T03:28:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced992a640 1 -- 172.21.15.28:0/3956741431 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced41f0c20 con 0x7fced40c5640 2023-12-16T03:28:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.254+0000 7fced0ff9640 1 -- 172.21.15.28:0/3956741431 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcebc007430 con 0x7fced40c5640 2023-12-16T03:28:37.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.258+0000 7fced0ff9640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fceb4066470 0x7fceb4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.258+0000 7fced0ff9640 1 -- 172.21.15.28:0/3956741431 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcebc083630 con 0x7fced40c5640 2023-12-16T03:28:37.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.258+0000 7fced2ffd640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fceb4066470 0x7fceb4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.258+0000 7fced2ffd640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fceb4066470 0x7fceb4068930 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fced40a5250 tx=0x7fcec4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:37.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.262+0000 7fced0ff9640 1 -- 172.21.15.28:0/3956741431 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fced41f0c20 con 0x7fced40c5640 2023-12-16T03:28:37.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.418+0000 7fced992a640 1 -- 172.21.15.28:0/3956741431 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fced41f0bf0 con 0x7fced40c5640 2023-12-16T03:28:37.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.418+0000 7fced0ff9640 1 -- 172.21.15.28:0/3956741431 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcebc0507f0 con 0x7fced40c5640 2023-12-16T03:28:37.423 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:37.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 -- 172.21.15.28:0/3956741431 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fceb4066470 msgr2=0x7fceb4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fceb4066470 0x7fceb4068930 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fced40a5250 tx=0x7fcec4008040 comp rx=0 tx=0).stop 2023-12-16T03:28:37.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 -- 172.21.15.28:0/3956741431 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fced40c5640 msgr2=0x7fced40bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fced40c5640 0x7fced40bfad0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fcebc001ec0 tx=0x7fcebc00c890 comp rx=0 tx=0).stop 2023-12-16T03:28:37.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 -- 172.21.15.28:0/3956741431 shutdown_connections 2023-12-16T03:28:37.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fced4155de0 0x7fced40a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fceb4066470 0x7fceb4068930 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fced40c5640 0x7fced40bfad0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 --2- 172.21.15.28:0/3956741431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced40c5260 0x7fced414eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 -- 172.21.15.28:0/3956741431 >> 172.21.15.28:0/3956741431 conn(0x7fced406a5b0 msgr2=0x7fced41561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:37.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 -- 172.21.15.28:0/3956741431 shutdown_connections 2023-12-16T03:28:37.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.422+0000 7fced992a640 1 -- 172.21.15.28:0/3956741431 wait complete. 2023-12-16T03:28:37.444 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-16T03:28:37.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.586+0000 7f97f4b5f640 1 Processor -- start 2023-12-16T03:28:37.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.586+0000 7f97f4b5f640 1 -- start start 2023-12-16T03:28:37.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97f4b5f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f97f0151bb0 0x7f97f006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97f4b5f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f97f00c7c30 0x7f97f015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97f4b5f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f00c8400 con 0x7f97f00bd3c0 2023-12-16T03:28:37.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97f4b5f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f00c86e0 con 0x7f97f0151bb0 2023-12-16T03:28:37.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97f4b5f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f01543e0 con 0x7f97f00c7c30 2023-12-16T03:28:37.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97ef7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f97f0151bb0 0x7f97f006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97ef7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f97f0151bb0 0x7f97f006ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42316/0 (socket says 172.21.15.28:42316) 2023-12-16T03:28:37.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97ef7fe640 1 -- 172.21.15.28:0/1445942338 learned_addr learned my addr 172.21.15.28:0/1445942338 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:37.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97effff640 1 --2- 172.21.15.28:0/1445942338 >> v2:172.21.15.134:3300/0 conn(0x7f97f00c7c30 0x7f97f015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97ef7fe640 1 -- 172.21.15.28:0/1445942338 >> v2:172.21.15.134:3300/0 conn(0x7f97f00c7c30 msgr2=0x7f97f015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:37.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97ef7fe640 1 --2- 172.21.15.28:0/1445942338 >> v2:172.21.15.134:3300/0 conn(0x7f97f00c7c30 0x7f97f015ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97ef7fe640 1 -- 172.21.15.28:0/1445942338 >> v1:172.21.15.134:6789/0 conn(0x7f97f00bd3c0 legacy=0x7f97f00c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:37.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97ef7fe640 1 -- 172.21.15.28:0/1445942338 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f01545f0 con 0x7f97f0151bb0 2023-12-16T03:28:37.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.590+0000 7f97effff640 1 --2- 172.21.15.28:0/1445942338 >> v2:172.21.15.134:3300/0 conn(0x7f97f00c7c30 0x7f97f015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:37.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97ef7fe640 1 --2- 172.21.15.28:0/1445942338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97f0151bb0 0x7f97f006ba40 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f97f0154520 tx=0x7f97e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22e040f0d639d4b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:37.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97ee7fc640 1 -- 172.21.15.28:0/1445942338 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e00ab600 con 0x7f97f0151bb0 2023-12-16T03:28:37.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97ee7fc640 1 -- 172.21.15.28:0/1445942338 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e00a7050 con 0x7f97f0151bb0 2023-12-16T03:28:37.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97ee7fc640 1 -- 172.21.15.28:0/1445942338 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e00ab980 con 0x7f97f0151bb0 2023-12-16T03:28:37.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1445942338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97f0151bb0 msgr2=0x7f97f006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 --2- 172.21.15.28:0/1445942338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97f0151bb0 0x7f97f006ba40 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f97f0154520 tx=0x7f97e001c370 comp rx=0 tx=0).stop 2023-12-16T03:28:37.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1445942338 shutdown_connections 2023-12-16T03:28:37.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 --2- 172.21.15.28:0/1445942338 >> v2:172.21.15.134:3300/0 conn(0x7f97f00c7c30 0x7f97f015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 --2- 172.21.15.28:0/1445942338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97f0151bb0 0x7f97f006ba40 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1445942338 >> 172.21.15.28:0/1445942338 conn(0x7f97f00abcc0 msgr2=0x7f97f00ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:37.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1445942338 shutdown_connections 2023-12-16T03:28:37.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1445942338 wait complete. 2023-12-16T03:28:37.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 Processor -- start 2023-12-16T03:28:37.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 -- start start 2023-12-16T03:28:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f00bd3c0 0x7f97f0158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97f00c7c30 0x7f97f01567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97f0151bb0 0x7f97f0147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f014bfa0 con 0x7f97f00c7c30 2023-12-16T03:28:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f01557d0 con 0x7f97f00bd3c0 2023-12-16T03:28:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97f4b5f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f0155a20 con 0x7f97f0151bb0 2023-12-16T03:28:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97eeffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97f00c7c30 0x7f97f01567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.594+0000 7f97eeffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97f00c7c30 0x7f97f01567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42330/0 (socket says 172.21.15.28:42330) 2023-12-16T03:28:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97eeffd640 1 -- 172.21.15.28:0/1387913755 learned_addr learned my addr 172.21.15.28:0/1387913755 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97effff640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97f0151bb0 0x7f97f0147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97ef7fe640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f00bd3c0 0x7f97f0158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97eeffd640 1 -- 172.21.15.28:0/1387913755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97f0151bb0 msgr2=0x7f97f0147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97eeffd640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97f0151bb0 0x7f97f0147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97eeffd640 1 -- 172.21.15.28:0/1387913755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f00bd3c0 msgr2=0x7f97f0158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97eeffd640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f00bd3c0 0x7f97f0158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97eeffd640 1 -- 172.21.15.28:0/1387913755 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e00094d0 con 0x7f97f00c7c30 2023-12-16T03:28:37.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97eeffd640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97f00c7c30 0x7f97f01567e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f97e400b3e0 tx=0x7f97e400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:37.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97d7fff640 1 -- 172.21.15.28:0/1387913755 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4011830 con 0x7f97f00c7c30 2023-12-16T03:28:37.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97d7fff640 1 -- 172.21.15.28:0/1387913755 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e40119b0 con 0x7f97f00c7c30 2023-12-16T03:28:37.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1387913755 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f0155d00 con 0x7f97f00c7c30 2023-12-16T03:28:37.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97d7fff640 1 -- 172.21.15.28:0/1387913755 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4011d60 con 0x7f97f00c7c30 2023-12-16T03:28:37.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1387913755 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f0158670 con 0x7f97f00c7c30 2023-12-16T03:28:37.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1387913755 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f00c57f0 con 0x7f97f00c7c30 2023-12-16T03:28:37.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97d7fff640 1 -- 172.21.15.28:0/1387913755 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f97e401a400 con 0x7f97f00c7c30 2023-12-16T03:28:37.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97d7fff640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97dc066470 0x7f97dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.598+0000 7f97d7fff640 1 -- 172.21.15.28:0/1387913755 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f97e4084260 con 0x7f97f00c7c30 2023-12-16T03:28:37.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.602+0000 7f97ef7fe640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97dc066470 0x7f97dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.602+0000 7f97ef7fe640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97dc066470 0x7f97dc068930 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f97e00ad000 tx=0x7f97e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:37.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.602+0000 7f97d7fff640 1 -- 172.21.15.28:0/1387913755 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f97e4051390 con 0x7f97f00c7c30 2023-12-16T03:28:37.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1387913755 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97f0067e90 con 0x7f97f00c7c30 2023-12-16T03:28:37.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97d7fff640 1 -- 172.21.15.28:0/1387913755 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97e40549b0 con 0x7f97f00c7c30 2023-12-16T03:28:37.766 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:37.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1387913755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97dc066470 msgr2=0x7f97dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97dc066470 0x7f97dc068930 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f97e00ad000 tx=0x7f97e0008040 comp rx=0 tx=0).stop 2023-12-16T03:28:37.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1387913755 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97f00c7c30 msgr2=0x7f97f01567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97f00c7c30 0x7f97f01567e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f97e400b3e0 tx=0x7f97e400b8a0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1387913755 shutdown_connections 2023-12-16T03:28:37.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f97f0151bb0 0x7f97f0147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f97dc066470 0x7f97dc068930 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97f00c7c30 0x7f97f01567e0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 --2- 172.21.15.28:0/1387913755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f00bd3c0 0x7f97f0158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1387913755 >> 172.21.15.28:0/1387913755 conn(0x7f97f00abcc0 msgr2=0x7f97f00ac0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:37.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1387913755 shutdown_connections 2023-12-16T03:28:37.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.762+0000 7f97f4b5f640 1 -- 172.21.15.28:0/1387913755 wait complete. 2023-12-16T03:28:37.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:28:37.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.930+0000 7f0ca7c9a640 1 Processor -- start 2023-12-16T03:28:37.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.930+0000 7f0ca7c9a640 1 -- start start 2023-12-16T03:28:37.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.930+0000 7f0ca7c9a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0ca00c4100 0x7f0ca00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.930+0000 7f0ca7c9a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca00c31c0 con 0x7f0ca00c63c0 2023-12-16T03:28:37.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.930+0000 7f0ca7c9a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca00c34a0 con 0x7f0ca00c06d0 2023-12-16T03:28:37.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.930+0000 7f0ca7c9a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00c1030 con 0x7f0ca00c4100 2023-12-16T03:28:37.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.930+0000 7f0ca5a36640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0ca00c63c0 0x7f0ca00c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36674/0 (socket says 172.21.15.28:36674) 2023-12-16T03:28:37.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.930+0000 7f0ca5a36640 1 -- 172.21.15.28:0/850306944 learned_addr learned my addr 172.21.15.28:0/850306944 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:37.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.930+0000 7f0ca5235640 1 --2- 172.21.15.28:0/850306944 >> v2:172.21.15.134:3300/0 conn(0x7f0ca00c4100 0x7f0ca00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.930+0000 7f0ca4a34640 1 -- 172.21.15.28:0/850306944 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787814349 0 0) 0x7f0ca00c31c0 con 0x7f0ca00c63c0 2023-12-16T03:28:37.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.934+0000 7f0ca4a34640 1 -- 172.21.15.28:0/850306944 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c8c005740 con 0x7f0ca00c63c0 2023-12-16T03:28:37.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.934+0000 7f0ca5235640 1 -- 172.21.15.28:0/850306944 >> v1:172.21.15.134:6789/0 conn(0x7f0ca00c06d0 legacy=0x7f0ca00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.934+0000 7f0ca5235640 1 -- 172.21.15.28:0/850306944 >> v1:172.21.15.28:6789/0 conn(0x7f0ca00c63c0 legacy=0x7f0ca00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.934+0000 7f0ca5235640 1 -- 172.21.15.28:0/850306944 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca00c1310 con 0x7f0ca00c4100 2023-12-16T03:28:37.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.934+0000 7f0ca5235640 1 --2- 172.21.15.28:0/850306944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca00c4100 0x7f0ca00c2bb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0c900097c0 tx=0x7f0c9001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93eac09e626f2c96 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:37.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.934+0000 7f0ca4a34640 1 -- 172.21.15.28:0/850306944 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900ab400 con 0x7f0ca00c4100 2023-12-16T03:28:37.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.934+0000 7f0ca4a34640 1 -- 172.21.15.28:0/850306944 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c900a7050 con 0x7f0ca00c4100 2023-12-16T03:28:37.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.934+0000 7f0ca4a34640 1 -- 172.21.15.28:0/850306944 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900ab780 con 0x7f0ca00c4100 2023-12-16T03:28:37.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.934+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/850306944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca00c4100 msgr2=0x7f0ca00c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.934+0000 7f0ca7c9a640 1 --2- 172.21.15.28:0/850306944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca00c4100 0x7f0ca00c2bb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0c900097c0 tx=0x7f0c9001c360 comp rx=0 tx=0).stop 2023-12-16T03:28:37.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/850306944 shutdown_connections 2023-12-16T03:28:37.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 --2- 172.21.15.28:0/850306944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca00c4100 0x7f0ca00c2bb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/850306944 >> 172.21.15.28:0/850306944 conn(0x7f0ca006a5b0 msgr2=0x7f0ca006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:37.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/850306944 shutdown_connections 2023-12-16T03:28:37.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/850306944 wait complete. 2023-12-16T03:28:37.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 Processor -- start 2023-12-16T03:28:37.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 -- start start 2023-12-16T03:28:37.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ca00c06d0 0x7f0ca014d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca00c4100 0x7f0ca00708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ca00c63c0 0x7f0ca0070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0072060 con 0x7f0ca00c06d0 2023-12-16T03:28:37.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0072340 con 0x7f0ca00c4100 2023-12-16T03:28:37.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca7c9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01e9860 con 0x7f0ca00c63c0 2023-12-16T03:28:37.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca5a36640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ca00c06d0 0x7f0ca014d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca5a36640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ca00c06d0 0x7f0ca014d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42346/0 (socket says 172.21.15.28:42346) 2023-12-16T03:28:37.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca5a36640 1 -- 172.21.15.28:0/4025637271 learned_addr learned my addr 172.21.15.28:0/4025637271 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:37.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca6237640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ca00c63c0 0x7f0ca0070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca5235640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca00c4100 0x7f0ca00708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca5a36640 1 -- 172.21.15.28:0/4025637271 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ca00c63c0 msgr2=0x7f0ca0070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca5a36640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ca00c63c0 0x7f0ca0070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca5a36640 1 -- 172.21.15.28:0/4025637271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca00c4100 msgr2=0x7f0ca00708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca5a36640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca00c4100 0x7f0ca00708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca5a36640 1 -- 172.21.15.28:0/4025637271 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90009420 con 0x7f0ca00c06d0 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.938+0000 7f0ca5a36640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ca00c06d0 0x7f0ca014d0a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c420 tx=0x7f0c9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.942+0000 7f0c967fc640 1 -- 172.21.15.28:0/4025637271 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c005cf0 con 0x7f0ca00c06d0 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.942+0000 7f0c967fc640 1 -- 172.21.15.28:0/4025637271 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c005e50 con 0x7f0ca00c06d0 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.942+0000 7f0c967fc640 1 -- 172.21.15.28:0/4025637271 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0072d0 con 0x7f0ca00c06d0 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.942+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/4025637271 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca01e9b40 con 0x7f0ca00c06d0 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.942+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/4025637271 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca0071350 con 0x7f0ca00c06d0 2023-12-16T03:28:37.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.942+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/4025637271 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca0068400 con 0x7f0ca00c06d0 2023-12-16T03:28:37.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.942+0000 7f0c967fc640 1 -- 172.21.15.28:0/4025637271 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0c9c007450 con 0x7f0ca00c06d0 2023-12-16T03:28:37.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.942+0000 7f0c967fc640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c84066470 0x7f0c84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:37.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.942+0000 7f0c967fc640 1 -- 172.21.15.28:0/4025637271 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0c9c0833d0 con 0x7f0ca00c06d0 2023-12-16T03:28:37.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.942+0000 7f0ca5235640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c84066470 0x7f0c84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:37.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.946+0000 7f0ca5235640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c84066470 0x7f0c84068930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0c900ad000 tx=0x7f0c90008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:37.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:37.946+0000 7f0c967fc640 1 -- 172.21.15.28:0/4025637271 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0c9c0540e0 con 0x7f0ca00c06d0 2023-12-16T03:28:38.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.102+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/4025637271 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ca00c3e70 con 0x7f0ca00c06d0 2023-12-16T03:28:38.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0c967fc640 1 -- 172.21.15.28:0/4025637271 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0c9c017020 con 0x7f0ca00c06d0 2023-12-16T03:28:38.109 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:38.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/4025637271 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c84066470 msgr2=0x7f0c84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c84066470 0x7f0c84068930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0c900ad000 tx=0x7f0c90008040 comp rx=0 tx=0).stop 2023-12-16T03:28:38.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/4025637271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ca00c06d0 msgr2=0x7f0ca014d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ca00c06d0 0x7f0ca014d0a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c420 tx=0x7f0c9c00c8e0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/4025637271 shutdown_connections 2023-12-16T03:28:38.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ca00c63c0 0x7f0ca0070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca00c4100 0x7f0ca00708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0c84066470 0x7f0c84068930 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 --2- 172.21.15.28:0/4025637271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ca00c06d0 0x7f0ca014d0a0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/4025637271 >> 172.21.15.28:0/4025637271 conn(0x7f0ca006a5b0 msgr2=0x7f0ca006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:38.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/4025637271 shutdown_connections 2023-12-16T03:28:38.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.106+0000 7f0ca7c9a640 1 -- 172.21.15.28:0/4025637271 wait complete. 2023-12-16T03:28:38.130 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:28:38.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.270+0000 7fde8eb2a640 1 Processor -- start 2023-12-16T03:28:38.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.270+0000 7fde8eb2a640 1 -- start start 2023-12-16T03:28:38.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.270+0000 7fde8eb2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fde880a5370 0x7fde880c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde8eb2a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde880c4110 0x7fde88150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde8eb2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde88072090 0x7fde881514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde8eb2a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde880c3070 con 0x7fde880c4110 2023-12-16T03:28:38.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde8eb2a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde880c2760 con 0x7fde880a5370 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde8eb2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde880a5750 con 0x7fde88072090 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde87fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde880c4110 0x7fde88150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde87fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde880c4110 0x7fde88150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42354/0 (socket says 172.21.15.28:42354) 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde87fff640 1 -- 172.21.15.28:0/2471179553 learned_addr learned my addr 172.21.15.28:0/2471179553 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde8c8c6640 1 --2- 172.21.15.28:0/2471179553 >> v2:172.21.15.134:3300/0 conn(0x7fde880a5370 0x7fde880c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde8d0c7640 1 --2- 172.21.15.28:0/2471179553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde88072090 0x7fde881514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde87fff640 1 -- 172.21.15.28:0/2471179553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde88072090 msgr2=0x7fde881514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde87fff640 1 --2- 172.21.15.28:0/2471179553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde88072090 0x7fde881514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde87fff640 1 -- 172.21.15.28:0/2471179553 >> v2:172.21.15.134:3300/0 conn(0x7fde880a5370 msgr2=0x7fde880c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde87fff640 1 --2- 172.21.15.28:0/2471179553 >> v2:172.21.15.134:3300/0 conn(0x7fde880a5370 0x7fde880c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde87fff640 1 -- 172.21.15.28:0/2471179553 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880aad20 con 0x7fde880c4110 2023-12-16T03:28:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde8d0c7640 1 --2- 172.21.15.28:0/2471179553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde88072090 0x7fde881514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:38.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde87fff640 1 --2- 172.21.15.28:0/2471179553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde880c4110 0x7fde88150fa0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fde880a8af0 tx=0x7fde7401d780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711dae95e2ecf5a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:38.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.274+0000 7fde877fe640 1 -- 172.21.15.28:0/2471179553 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740a6770 con 0x7fde880c4110 2023-12-16T03:28:38.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde877fe640 1 -- 172.21.15.28:0/2471179553 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde740a68d0 con 0x7fde880c4110 2023-12-16T03:28:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde877fe640 1 -- 172.21.15.28:0/2471179553 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740a6c60 con 0x7fde880c4110 2023-12-16T03:28:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 -- 172.21.15.28:0/2471179553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde880c4110 msgr2=0x7fde88150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 --2- 172.21.15.28:0/2471179553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde880c4110 0x7fde88150fa0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fde880a8af0 tx=0x7fde7401d780 comp rx=0 tx=0).stop 2023-12-16T03:28:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 -- 172.21.15.28:0/2471179553 shutdown_connections 2023-12-16T03:28:38.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 --2- 172.21.15.28:0/2471179553 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde88072090 0x7fde881514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 --2- 172.21.15.28:0/2471179553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde880c4110 0x7fde88150fa0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 --2- 172.21.15.28:0/2471179553 >> v2:172.21.15.134:3300/0 conn(0x7fde880a5370 0x7fde880c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 -- 172.21.15.28:0/2471179553 >> 172.21.15.28:0/2471179553 conn(0x7fde8806a5b0 msgr2=0x7fde8806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:38.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 -- 172.21.15.28:0/2471179553 shutdown_connections 2023-12-16T03:28:38.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 -- 172.21.15.28:0/2471179553 wait complete. 2023-12-16T03:28:38.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 Processor -- start 2023-12-16T03:28:38.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 -- start start 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde88072090 0x7fde881f0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde880a5370 0x7fde880717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde880c4110 0x7fde8815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde881f13d0 con 0x7fde880c4110 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde881ed1b0 con 0x7fde88072090 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8eb2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8814d680 con 0x7fde880a5370 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8d0c7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde880c4110 0x7fde8815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8d0c7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde880c4110 0x7fde8815a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42366/0 (socket says 172.21.15.28:42366) 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8d0c7640 1 -- 172.21.15.28:0/3844618439 learned_addr learned my addr 172.21.15.28:0/3844618439 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde8c8c6640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde88072090 0x7fde881f0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.278+0000 7fde87fff640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde880a5370 0x7fde880717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde8d0c7640 1 -- 172.21.15.28:0/3844618439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde880a5370 msgr2=0x7fde880717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde8d0c7640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde880a5370 0x7fde880717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde8d0c7640 1 -- 172.21.15.28:0/3844618439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde88072090 msgr2=0x7fde881f0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde8d0c7640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde88072090 0x7fde881f0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde8d0c7640 1 -- 172.21.15.28:0/3844618439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7400a670 con 0x7fde880c4110 2023-12-16T03:28:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde8d0c7640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde880c4110 0x7fde8815a720 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fde80007e10 tx=0x7fde8000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:38.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde857fa640 1 -- 172.21.15.28:0/3844618439 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80003ba0 con 0x7fde880c4110 2023-12-16T03:28:38.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde857fa640 1 -- 172.21.15.28:0/3844618439 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8000f040 con 0x7fde880c4110 2023-12-16T03:28:38.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde8eb2a640 1 -- 172.21.15.28:0/3844618439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde881ece60 con 0x7fde880c4110 2023-12-16T03:28:38.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde857fa640 1 -- 172.21.15.28:0/3844618439 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8000de80 con 0x7fde880c4110 2023-12-16T03:28:38.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde8eb2a640 1 -- 172.21.15.28:0/3844618439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8814dc00 con 0x7fde880c4110 2023-12-16T03:28:38.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde8eb2a640 1 -- 172.21.15.28:0/3844618439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde88154190 con 0x7fde880c4110 2023-12-16T03:28:38.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde857fa640 1 -- 172.21.15.28:0/3844618439 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fde80004030 con 0x7fde880c4110 2023-12-16T03:28:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde857fa640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde6c066470 0x7fde6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde857fa640 1 -- 172.21.15.28:0/3844618439 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fde80084480 con 0x7fde880c4110 2023-12-16T03:28:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.282+0000 7fde8c8c6640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde6c066470 0x7fde6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.286+0000 7fde8c8c6640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde6c066470 0x7fde6c068930 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009b60 tx=0x7fde7c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:38.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.286+0000 7fde857fa640 1 -- 172.21.15.28:0/3844618439 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fde80051640 con 0x7fde880c4110 2023-12-16T03:28:38.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 -- 172.21.15.28:0/3844618439 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fde88068400 con 0x7fde880c4110 2023-12-16T03:28:38.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde857fa640 1 -- 172.21.15.28:0/3844618439 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7fde80054c60 con 0x7fde880c4110 2023-12-16T03:28:38.449 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:38.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 -- 172.21.15.28:0/3844618439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde6c066470 msgr2=0x7fde6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde6c066470 0x7fde6c068930 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009b60 tx=0x7fde7c009190 comp rx=0 tx=0).stop 2023-12-16T03:28:38.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 -- 172.21.15.28:0/3844618439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde880c4110 msgr2=0x7fde8815a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde880c4110 0x7fde8815a720 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fde80007e10 tx=0x7fde8000d4a0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 -- 172.21.15.28:0/3844618439 shutdown_connections 2023-12-16T03:28:38.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde6c066470 0x7fde6c068930 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde880c4110 0x7fde8815a720 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde880a5370 0x7fde880717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 --2- 172.21.15.28:0/3844618439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde88072090 0x7fde881f0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 -- 172.21.15.28:0/3844618439 >> 172.21.15.28:0/3844618439 conn(0x7fde8806a5b0 msgr2=0x7fde880c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:38.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 -- 172.21.15.28:0/3844618439 shutdown_connections 2023-12-16T03:28:38.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.446+0000 7fde8eb2a640 1 -- 172.21.15.28:0/3844618439 wait complete. 2023-12-16T03:28:38.470 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:28:38.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471f557640 1 Processor -- start 2023-12-16T03:28:38.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471f557640 1 -- start start 2023-12-16T03:28:38.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471f557640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4718072090 0x7f4718150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471f557640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47180c2760 con 0x7f47180725c0 2023-12-16T03:28:38.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471f557640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47180a5750 con 0x7f47180a5370 2023-12-16T03:28:38.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471f557640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47180c3070 con 0x7f4718072090 2023-12-16T03:28:38.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471caf2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4718072090 0x7f4718150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471daf4640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f47180725c0 0x7f47181514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36684/0 (socket says 172.21.15.28:36684) 2023-12-16T03:28:38.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471daf4640 1 -- 172.21.15.28:0/4054577673 learned_addr learned my addr 172.21.15.28:0/4054577673 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:38.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471caf2640 1 -- 172.21.15.28:0/4054577673 >> v1:172.21.15.134:6789/0 conn(0x7f47180a5370 legacy=0x7f47180c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f470ffff640 1 -- 172.21.15.28:0/4054577673 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864394450 0 0) 0x7f47180c2760 con 0x7f47180725c0 2023-12-16T03:28:38.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471caf2640 1 -- 172.21.15.28:0/4054577673 >> v1:172.21.15.28:6789/0 conn(0x7f47180725c0 legacy=0x7f47181514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.610+0000 7f471caf2640 1 -- 172.21.15.28:0/4054577673 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47180aad20 con 0x7f4718072090 2023-12-16T03:28:38.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.614+0000 7f471caf2640 1 --2- 172.21.15.28:0/4054577673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4718072090 0x7f4718150fa0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f47080097c0 tx=0x7f470801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e6619270873465 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:38.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.614+0000 7f470ffff640 1 -- 172.21.15.28:0/4054577673 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47080ab600 con 0x7f4718072090 2023-12-16T03:28:38.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.614+0000 7f470ffff640 1 -- 172.21.15.28:0/4054577673 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47080a7050 con 0x7f4718072090 2023-12-16T03:28:38.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.614+0000 7f470ffff640 1 -- 172.21.15.28:0/4054577673 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47080ab980 con 0x7f4718072090 2023-12-16T03:28:38.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.614+0000 7f471f557640 1 -- 172.21.15.28:0/4054577673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4718072090 msgr2=0x7f4718150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.614+0000 7f471f557640 1 --2- 172.21.15.28:0/4054577673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4718072090 0x7f4718150fa0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f47080097c0 tx=0x7f470801c360 comp rx=0 tx=0).stop 2023-12-16T03:28:38.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.614+0000 7f471f557640 1 -- 172.21.15.28:0/4054577673 shutdown_connections 2023-12-16T03:28:38.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.614+0000 7f471f557640 1 --2- 172.21.15.28:0/4054577673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4718072090 0x7f4718150fa0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.614+0000 7f471f557640 1 -- 172.21.15.28:0/4054577673 >> 172.21.15.28:0/4054577673 conn(0x7f471806a5b0 msgr2=0x7f471806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:38.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.614+0000 7f471f557640 1 -- 172.21.15.28:0/4054577673 shutdown_connections 2023-12-16T03:28:38.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.614+0000 7f471f557640 1 -- 172.21.15.28:0/4054577673 wait complete. 2023-12-16T03:28:38.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471f557640 1 Processor -- start 2023-12-16T03:28:38.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471f557640 1 -- start start 2023-12-16T03:28:38.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471f557640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4718072090 0x7f47181500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471f557640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47180725c0 0x7f47180713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471f557640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47180a5370 0x7f4718149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471f557640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4718146ca0 con 0x7f47180725c0 2023-12-16T03:28:38.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471f557640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47181ef120 con 0x7f4718072090 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471f557640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47181eec90 con 0x7f47180a5370 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471caf2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47180725c0 0x7f47180713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471caf2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47180725c0 0x7f47180713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42382/0 (socket says 172.21.15.28:42382) 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471caf2640 1 -- 172.21.15.28:0/2039103985 learned_addr learned my addr 172.21.15.28:0/2039103985 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471d2f3640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4718072090 0x7f47181500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471daf4640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47180a5370 0x7f4718149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471caf2640 1 -- 172.21.15.28:0/2039103985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47180a5370 msgr2=0x7f4718149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471caf2640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47180a5370 0x7f4718149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471caf2640 1 -- 172.21.15.28:0/2039103985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4718072090 msgr2=0x7f47181500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471caf2640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4718072090 0x7f47181500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471caf2640 1 -- 172.21.15.28:0/2039103985 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4708009420 con 0x7f47180725c0 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471d2f3640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4718072090 0x7f47181500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471caf2640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47180725c0 0x7f47180713e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f470801c840 tx=0x7f4708019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:38.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f470dffb640 1 -- 172.21.15.28:0/2039103985 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4708004230 con 0x7f47180725c0 2023-12-16T03:28:38.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f470dffb640 1 -- 172.21.15.28:0/2039103985 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4708004390 con 0x7f47180725c0 2023-12-16T03:28:38.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f470dffb640 1 -- 172.21.15.28:0/2039103985 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4708003820 con 0x7f47180725c0 2023-12-16T03:28:38.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471f557640 1 -- 172.21.15.28:0/2039103985 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47181ee360 con 0x7f47180725c0 2023-12-16T03:28:38.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.618+0000 7f471f557640 1 -- 172.21.15.28:0/2039103985 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47181ee920 con 0x7f47180725c0 2023-12-16T03:28:38.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.622+0000 7f471f557640 1 -- 172.21.15.28:0/2039103985 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4718068400 con 0x7f47180725c0 2023-12-16T03:28:38.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.622+0000 7f470dffb640 1 -- 172.21.15.28:0/2039103985 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f47080b2040 con 0x7f47180725c0 2023-12-16T03:28:38.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.622+0000 7f470dffb640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46fc0664a0 0x7f46fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.622+0000 7f470dffb640 1 -- 172.21.15.28:0/2039103985 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f470811df90 con 0x7f47180725c0 2023-12-16T03:28:38.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.622+0000 7f471d2f3640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46fc0664a0 0x7f46fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.622+0000 7f471d2f3640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46fc0664a0 0x7f46fc068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4714000f70 tx=0x7f4714009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:38.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.626+0000 7f470dffb640 1 -- 172.21.15.28:0/2039103985 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f470814f290 con 0x7f47180725c0 2023-12-16T03:28:38.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 -- 172.21.15.28:0/2039103985 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47181eedd0 con 0x7f47180725c0 2023-12-16T03:28:38.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f470dffb640 1 -- 172.21.15.28:0/2039103985 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6184 (secure 0 0 0) 0x7f47080c2090 con 0x7f47180725c0 2023-12-16T03:28:38.822 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:38.823 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/651767003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":651767003},{"type":"v1","addr":"172.21.15.28:6837","nonce":651767003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4202659808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4202659808},{"type":"v1","addr":"172.21.15.134:6834","nonce":4202659808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:59.086495+0000","modified":"2023-12-16T03:28:02.105487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/2582425067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2582425067},{"type":"v1","addr":"172.21.15.28:6836","nonce":2582425067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:28:12.170094+0000","modified":"2023-12-16T03:28:15.197722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5729":{"gid":5729,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6835/931138884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":931138884},{"type":"v1","addr":"172.21.15.134:6835","nonce":931138884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-16T03:28:38.823 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 51 2023-12-16T03:28:38.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 -- 172.21.15.28:0/2039103985 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46fc0664a0 msgr2=0x7f46fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46fc0664a0 0x7f46fc068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4714000f70 tx=0x7f4714009040 comp rx=0 tx=0).stop 2023-12-16T03:28:38.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 -- 172.21.15.28:0/2039103985 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47180725c0 msgr2=0x7f47180713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47180725c0 0x7f47180713e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f470801c840 tx=0x7f4708019100 comp rx=0 tx=0).stop 2023-12-16T03:28:38.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 -- 172.21.15.28:0/2039103985 shutdown_connections 2023-12-16T03:28:38.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47180a5370 0x7f4718149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f46fc0664a0 0x7f46fc068960 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47180725c0 0x7f47180713e0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 --2- 172.21.15.28:0/2039103985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4718072090 0x7f47181500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 -- 172.21.15.28:0/2039103985 >> 172.21.15.28:0/2039103985 conn(0x7f471806a5b0 msgr2=0x7f47180c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:38.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 -- 172.21.15.28:0/2039103985 shutdown_connections 2023-12-16T03:28:38.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.818+0000 7f471f557640 1 -- 172.21.15.28:0/2039103985 wait complete. 2023-12-16T03:28:38.844 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:38.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.982+0000 7fcafa572640 1 Processor -- start 2023-12-16T03:28:38.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.982+0000 7fcafa572640 1 -- start start 2023-12-16T03:28:38.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.982+0000 7fcafa572640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcaf40a5370 0x7fcaf40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.982+0000 7fcafa572640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcaf4072090 0x7fcaf41516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.982+0000 7fcafa572640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf40c2760 con 0x7fcaf40c4110 2023-12-16T03:28:38.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.982+0000 7fcafa572640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf40c3070 con 0x7fcaf4072090 2023-12-16T03:28:38.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.982+0000 7fcafa572640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf4151bf0 con 0x7fcaf40a5370 2023-12-16T03:28:38.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.982+0000 7fcaf37fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcaf40c4110 0x7fcaf4150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36686/0 (socket says 172.21.15.28:36686) 2023-12-16T03:28:38.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.982+0000 7fcaf37fe640 1 -- 172.21.15.28:0/1822813518 learned_addr learned my addr 172.21.15.28:0/1822813518 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:38.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.982+0000 7fcaf8b0f640 1 --2- 172.21.15.28:0/1822813518 >> v2:172.21.15.28:3300/0 conn(0x7fcaf4072090 0x7fcaf41516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.982+0000 7fcaf3fff640 1 --2- 172.21.15.28:0/1822813518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcaf40a5370 0x7fcaf40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.986+0000 7fcaf2ffd640 1 -- 172.21.15.28:0/1822813518 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725630646 0 0) 0x7fcaf40c2760 con 0x7fcaf40c4110 2023-12-16T03:28:38.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.986+0000 7fcaf2ffd640 1 -- 172.21.15.28:0/1822813518 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcadc003530 con 0x7fcaf40c4110 2023-12-16T03:28:38.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.986+0000 7fcaf8b0f640 1 -- 172.21.15.28:0/1822813518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcaf40a5370 msgr2=0x7fcaf40c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:38.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.986+0000 7fcaf8b0f640 1 --2- 172.21.15.28:0/1822813518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcaf40a5370 0x7fcaf40c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.986+0000 7fcaf8b0f640 1 -- 172.21.15.28:0/1822813518 >> v1:172.21.15.28:6789/0 conn(0x7fcaf40c4110 legacy=0x7fcaf4150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.986+0000 7fcaf8b0f640 1 -- 172.21.15.28:0/1822813518 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40a5750 con 0x7fcaf4072090 2023-12-16T03:28:38.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.986+0000 7fcaf8b0f640 1 --2- 172.21.15.28:0/1822813518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaf4072090 0x7fcaf41516b0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00bfd0 tx=0x7fcaec01e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2279ee885c850c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:38.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.986+0000 7fcaf2ffd640 1 -- 172.21.15.28:0/1822813518 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec00b2d0 con 0x7fcaf4072090 2023-12-16T03:28:38.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.986+0000 7fcaf2ffd640 1 -- 172.21.15.28:0/1822813518 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec0a7830 con 0x7fcaf4072090 2023-12-16T03:28:38.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.986+0000 7fcaf2ffd640 1 -- 172.21.15.28:0/1822813518 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec0a7bc0 con 0x7fcaf4072090 2023-12-16T03:28:38.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 -- 172.21.15.28:0/1822813518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaf4072090 msgr2=0x7fcaf41516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 --2- 172.21.15.28:0/1822813518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaf4072090 0x7fcaf41516b0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00bfd0 tx=0x7fcaec01e9e0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 -- 172.21.15.28:0/1822813518 shutdown_connections 2023-12-16T03:28:38.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 --2- 172.21.15.28:0/1822813518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaf4072090 0x7fcaf41516b0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 --2- 172.21.15.28:0/1822813518 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcaf40a5370 0x7fcaf40c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 -- 172.21.15.28:0/1822813518 >> 172.21.15.28:0/1822813518 conn(0x7fcaf406a5b0 msgr2=0x7fcaf406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:38.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 -- 172.21.15.28:0/1822813518 shutdown_connections 2023-12-16T03:28:38.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 -- 172.21.15.28:0/1822813518 wait complete. 2023-12-16T03:28:38.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 Processor -- start 2023-12-16T03:28:38.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 -- start start 2023-12-16T03:28:38.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaf4072090 0x7fcaf4070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcaf40a5370 0x7fcaf40c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf40c4110 0x7fcaf41ee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:38.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf41ecf50 con 0x7fcaf4072090 2023-12-16T03:28:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf406fe50 con 0x7fcaf40c4110 2023-12-16T03:28:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcafa572640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf41ed140 con 0x7fcaf40a5370 2023-12-16T03:28:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcaf3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaf4072090 0x7fcaf4070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcaf3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaf4072090 0x7fcaf4070b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42404/0 (socket says 172.21.15.28:42404) 2023-12-16T03:28:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcaf3fff640 1 -- 172.21.15.28:0/554466231 learned_addr learned my addr 172.21.15.28:0/554466231 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcaf3fff640 1 -- 172.21.15.28:0/554466231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcaf40a5370 msgr2=0x7fcaf40c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcaf3fff640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcaf40a5370 0x7fcaf40c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcaf3fff640 1 -- 172.21.15.28:0/554466231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf40c4110 msgr2=0x7fcaf41ee3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcaf3fff640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf40c4110 0x7fcaf41ee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.990+0000 7fcaf3fff640 1 -- 172.21.15.28:0/554466231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec00bc80 con 0x7fcaf4072090 2023-12-16T03:28:38.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.994+0000 7fcaf3fff640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaf4072090 0x7fcaf4070b40 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fcae400e930 tx=0x7fcae400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.994+0000 7fcaf0ff9640 1 -- 172.21.15.28:0/554466231 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4009690 con 0x7fcaf4072090 2023-12-16T03:28:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.994+0000 7fcaf0ff9640 1 -- 172.21.15.28:0/554466231 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae400ca00 con 0x7fcaf4072090 2023-12-16T03:28:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.994+0000 7fcaf0ff9640 1 -- 172.21.15.28:0/554466231 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae400cd70 con 0x7fcaf4072090 2023-12-16T03:28:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.994+0000 7fcafa572640 1 -- 172.21.15.28:0/554466231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf4070060 con 0x7fcaf4072090 2023-12-16T03:28:38.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.994+0000 7fcafa572640 1 -- 172.21.15.28:0/554466231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf4070620 con 0x7fcaf4072090 2023-12-16T03:28:38.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.994+0000 7fcafa572640 1 -- 172.21.15.28:0/554466231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf4068400 con 0x7fcaf4072090 2023-12-16T03:28:38.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.994+0000 7fcaf0ff9640 1 -- 172.21.15.28:0/554466231 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcae4013470 con 0x7fcaf4072090 2023-12-16T03:28:39.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.994+0000 7fcaf0ff9640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcae0066470 0x7fcae0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.994+0000 7fcaf0ff9640 1 -- 172.21.15.28:0/554466231 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcae40844d0 con 0x7fcaf4072090 2023-12-16T03:28:39.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.994+0000 7fcaf37fe640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcae0066470 0x7fcae0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.998+0000 7fcaf37fe640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcae0066470 0x7fcae0068930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcae8007fd0 tx=0x7fcae8007940 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:39.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:38.998+0000 7fcaf0ff9640 1 -- 172.21.15.28:0/554466231 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcae4051610 con 0x7fcaf4072090 2023-12-16T03:28:39.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.162+0000 7fcafa572640 1 -- 172.21.15.28:0/554466231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcaf415a960 con 0x7fcaf4072090 2023-12-16T03:28:39.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.162+0000 7fcaf0ff9640 1 -- 172.21.15.28:0/554466231 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20214 (secure 0 0 0) 0x7fcae4054c30 con 0x7fcaf4072090 2023-12-16T03:28:39.167 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:39.168 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:13.793649+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:39.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 -- 172.21.15.28:0/554466231 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcae0066470 msgr2=0x7fcae0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcae0066470 0x7fcae0068930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcae8007fd0 tx=0x7fcae8007940 comp rx=0 tx=0).stop 2023-12-16T03:28:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 -- 172.21.15.28:0/554466231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaf4072090 msgr2=0x7fcaf4070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaf4072090 0x7fcaf4070b40 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fcae400e930 tx=0x7fcae400edf0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 -- 172.21.15.28:0/554466231 shutdown_connections 2023-12-16T03:28:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf40c4110 0x7fcaf41ee3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcaf40a5370 0x7fcaf40c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcae0066470 0x7fcae0068930 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 --2- 172.21.15.28:0/554466231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaf4072090 0x7fcaf4070b40 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 -- 172.21.15.28:0/554466231 >> 172.21.15.28:0/554466231 conn(0x7fcaf406a5b0 msgr2=0x7fcaf40bf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 -- 172.21.15.28:0/554466231 shutdown_connections 2023-12-16T03:28:39.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.166+0000 7fcafa572640 1 -- 172.21.15.28:0/554466231 wait complete. 2023-12-16T03:28:39.189 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-16T03:28:39.189 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:28:39.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.326+0000 7f3db6054640 1 Processor -- start 2023-12-16T03:28:39.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.326+0000 7f3db6054640 1 -- start start 2023-12-16T03:28:39.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3db6054640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3db00a5370 0x7f3db00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3db6054640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db00c4110 0x7f3db0150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3db6054640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db00c2760 con 0x7f3db0072090 2023-12-16T03:28:39.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3db6054640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db00c3070 con 0x7f3db00a5370 2023-12-16T03:28:39.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3db6054640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db0151bf0 con 0x7f3db00c4110 2023-12-16T03:28:39.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3daf7fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3db00a5370 0x7f3db00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3daeffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db00c4110 0x7f3db0150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3daffff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3db0072090 0x7f3db01514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:51398/0 (socket says 172.21.15.28:51398) 2023-12-16T03:28:39.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3daffff640 1 -- 172.21.15.28:0/609968010 learned_addr learned my addr 172.21.15.28:0/609968010 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:39.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3daeffd640 1 -- 172.21.15.28:0/609968010 >> v2:172.21.15.134:3300/0 conn(0x7f3db00a5370 msgr2=0x7f3db00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:39.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3daeffd640 1 --2- 172.21.15.28:0/609968010 >> v2:172.21.15.134:3300/0 conn(0x7f3db00a5370 0x7f3db00c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3daeffd640 1 -- 172.21.15.28:0/609968010 >> v1:172.21.15.134:6789/0 conn(0x7f3db0072090 legacy=0x7f3db01514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.330+0000 7f3daeffd640 1 -- 172.21.15.28:0/609968010 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db00a5750 con 0x7f3db00c4110 2023-12-16T03:28:39.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3daeffd640 1 --2- 172.21.15.28:0/609968010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db00c4110 0x7f3db0150fa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3da40097c0 tx=0x7f3da401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dc68f14369d399f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:39.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3dae7fc640 1 -- 172.21.15.28:0/609968010 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da40ab600 con 0x7f3db00c4110 2023-12-16T03:28:39.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3dae7fc640 1 -- 172.21.15.28:0/609968010 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da40a7050 con 0x7f3db00c4110 2023-12-16T03:28:39.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3dae7fc640 1 -- 172.21.15.28:0/609968010 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da40ab980 con 0x7f3db00c4110 2023-12-16T03:28:39.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3db6054640 1 -- 172.21.15.28:0/609968010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db00c4110 msgr2=0x7f3db0150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3db6054640 1 --2- 172.21.15.28:0/609968010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db00c4110 0x7f3db0150fa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3da40097c0 tx=0x7f3da401c330 comp rx=0 tx=0).stop 2023-12-16T03:28:39.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3db6054640 1 -- 172.21.15.28:0/609968010 shutdown_connections 2023-12-16T03:28:39.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3db6054640 1 --2- 172.21.15.28:0/609968010 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db00c4110 0x7f3db0150fa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3db6054640 1 --2- 172.21.15.28:0/609968010 >> v2:172.21.15.134:3300/0 conn(0x7f3db00a5370 0x7f3db00c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3db6054640 1 -- 172.21.15.28:0/609968010 >> 172.21.15.28:0/609968010 conn(0x7f3db006a5b0 msgr2=0x7f3db006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:39.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3db6054640 1 -- 172.21.15.28:0/609968010 shutdown_connections 2023-12-16T03:28:39.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3db6054640 1 -- 172.21.15.28:0/609968010 wait complete. 2023-12-16T03:28:39.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3db6054640 1 Processor -- start 2023-12-16T03:28:39.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.334+0000 7f3db6054640 1 -- start start 2023-12-16T03:28:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3db6054640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db0072090 0x7f3db014b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3db6054640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db00a5370 0x7f3db01f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3db6054640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3db00c4110 0x7f3db01f13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3db6054640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db0150c00 con 0x7f3db00c4110 2023-12-16T03:28:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3db6054640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db0148480 con 0x7f3db00a5370 2023-12-16T03:28:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3db6054640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db0150920 con 0x7f3db0072090 2023-12-16T03:28:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3daffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3db00c4110 0x7f3db01f13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3daf7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db0072090 0x7f3db014b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3daffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3db00c4110 0x7f3db01f13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42408/0 (socket says 172.21.15.28:42408) 2023-12-16T03:28:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3daffff640 1 -- 172.21.15.28:0/2509678301 learned_addr learned my addr 172.21.15.28:0/2509678301 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:39.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3daeffd640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db00a5370 0x7f3db01f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3daffff640 1 -- 172.21.15.28:0/2509678301 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db0072090 msgr2=0x7f3db014b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3daffff640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db0072090 0x7f3db014b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3daffff640 1 -- 172.21.15.28:0/2509678301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db00a5370 msgr2=0x7f3db01f0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3daffff640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db00a5370 0x7f3db01f0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3daffff640 1 -- 172.21.15.28:0/2509678301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da4009420 con 0x7f3db00c4110 2023-12-16T03:28:39.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3daffff640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3db00c4110 0x7f3db01f13e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3da800cbf0 tx=0x7f3da800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3d97fff640 1 -- 172.21.15.28:0/2509678301 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da800ad40 con 0x7f3db00c4110 2023-12-16T03:28:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3d97fff640 1 -- 172.21.15.28:0/2509678301 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da8012400 con 0x7f3db00c4110 2023-12-16T03:28:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3db6054640 1 -- 172.21.15.28:0/2509678301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db0147e30 con 0x7f3db00c4110 2023-12-16T03:28:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3d97fff640 1 -- 172.21.15.28:0/2509678301 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da800aea0 con 0x7f3db00c4110 2023-12-16T03:28:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3db6054640 1 -- 172.21.15.28:0/2509678301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db014bb10 con 0x7f3db00c4110 2023-12-16T03:28:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3db6054640 1 -- 172.21.15.28:0/2509678301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db0147c90 con 0x7f3db00c4110 2023-12-16T03:28:39.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.338+0000 7f3d97fff640 1 -- 172.21.15.28:0/2509678301 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3da8007070 con 0x7f3db00c4110 2023-12-16T03:28:39.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.342+0000 7f3d97fff640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3d9c0664a0 0x7f3d9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.342+0000 7f3d97fff640 1 -- 172.21.15.28:0/2509678301 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3da80841b0 con 0x7f3db00c4110 2023-12-16T03:28:39.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.342+0000 7f3daf7fe640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3d9c0664a0 0x7f3d9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.342+0000 7f3daf7fe640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3d9c0664a0 0x7f3d9c068960 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009b60 tx=0x7f3da0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:39.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.346+0000 7f3d97fff640 1 -- 172.21.15.28:0/2509678301 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3db0147c90 con 0x7f3db00c4110 2023-12-16T03:28:39.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.534+0000 7f3db6054640 1 -- 172.21.15.28:0/2509678301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3db0148630 con 0x7f3db00c4110 2023-12-16T03:28:39.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.534+0000 7f3d97fff640 1 -- 172.21.15.28:0/2509678301 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6184 (secure 0 0 0) 0x7f3db0148630 con 0x7f3db00c4110 2023-12-16T03:28:39.539 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:39.539 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/651767003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":651767003},{"type":"v1","addr":"172.21.15.28:6837","nonce":651767003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4202659808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4202659808},{"type":"v1","addr":"172.21.15.134:6834","nonce":4202659808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:59.086495+0000","modified":"2023-12-16T03:28:02.105487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/2582425067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2582425067},{"type":"v1","addr":"172.21.15.28:6836","nonce":2582425067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:28:12.170094+0000","modified":"2023-12-16T03:28:15.197722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5729":{"gid":5729,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6835/931138884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":931138884},{"type":"v1","addr":"172.21.15.134:6835","nonce":931138884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-16T03:28:39.540 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 51 2023-12-16T03:28:39.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 -- 172.21.15.28:0/2509678301 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3d9c0664a0 msgr2=0x7f3d9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3d9c0664a0 0x7f3d9c068960 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009b60 tx=0x7f3da0009190 comp rx=0 tx=0).stop 2023-12-16T03:28:39.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 -- 172.21.15.28:0/2509678301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3db00c4110 msgr2=0x7f3db01f13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3db00c4110 0x7f3db01f13e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3da800cbf0 tx=0x7f3da800a430 comp rx=0 tx=0).stop 2023-12-16T03:28:39.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 -- 172.21.15.28:0/2509678301 shutdown_connections 2023-12-16T03:28:39.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3d9c0664a0 0x7f3d9c068960 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3db00c4110 0x7f3db01f13e0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db00a5370 0x7f3db01f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 --2- 172.21.15.28:0/2509678301 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3db0072090 0x7f3db014b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.542 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 -- 172.21.15.28:0/2509678301 >> 172.21.15.28:0/2509678301 conn(0x7f3db006a5b0 msgr2=0x7f3db006ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:39.542 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 -- 172.21.15.28:0/2509678301 shutdown_connections 2023-12-16T03:28:39.542 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.538+0000 7f3db6054640 1 -- 172.21.15.28:0/2509678301 wait complete. 2023-12-16T03:28:39.560 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:28:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.698+0000 7f81b0bd8640 1 Processor -- start 2023-12-16T03:28:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.698+0000 7f81b0bd8640 1 -- start start 2023-12-16T03:28:39.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.698+0000 7f81b0bd8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f81ac072090 0x7f81ac150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.698+0000 7f81b0bd8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81ac0725c0 0x7f81ac1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.698+0000 7f81b0bd8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ac0c2760 con 0x7f81ac0a5370 2023-12-16T03:28:39.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.698+0000 7f81b0bd8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ac0c3070 con 0x7f81ac072090 2023-12-16T03:28:39.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.698+0000 7f81b0bd8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac0a5750 con 0x7f81ac0725c0 2023-12-16T03:28:39.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.698+0000 7f81a3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f81ac072090 0x7f81ac150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.698+0000 7f81aa59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f81ac0a5370 0x7f81ac0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39912/0 (socket says 172.21.15.28:39912) 2023-12-16T03:28:39.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.698+0000 7f81aa59c640 1 -- 172.21.15.28:0/3436064599 learned_addr learned my addr 172.21.15.28:0/3436064599 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:39.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.702+0000 7f81aad9d640 1 --2- 172.21.15.28:0/3436064599 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81ac0725c0 0x7f81ac1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.702+0000 7f81a3fff640 1 -- 172.21.15.28:0/3436064599 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81ac0725c0 msgr2=0x7f81ac1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:39.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.702+0000 7f81a3fff640 1 --2- 172.21.15.28:0/3436064599 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81ac0725c0 0x7f81ac1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.702+0000 7f81a3fff640 1 -- 172.21.15.28:0/3436064599 >> v1:172.21.15.28:6789/0 conn(0x7f81ac0a5370 legacy=0x7f81ac0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.702+0000 7f81a3fff640 1 -- 172.21.15.28:0/3436064599 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac0aad20 con 0x7f81ac072090 2023-12-16T03:28:39.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.702+0000 7f81a9d9b640 1 -- 172.21.15.28:0/3436064599 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614561899 0 0) 0x7f81ac0c2760 con 0x7f81ac0a5370 2023-12-16T03:28:39.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.702+0000 7f81a3fff640 1 --2- 172.21.15.28:0/3436064599 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81ac072090 0x7f81ac150fa0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f81940097c0 tx=0x7f819401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e497e215cf48c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:39.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.702+0000 7f81a9d9b640 1 -- 172.21.15.28:0/3436064599 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940ab600 con 0x7f81ac072090 2023-12-16T03:28:39.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.702+0000 7f81a9d9b640 1 -- 172.21.15.28:0/3436064599 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81940a7050 con 0x7f81ac072090 2023-12-16T03:28:39.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.702+0000 7f81a9d9b640 1 -- 172.21.15.28:0/3436064599 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940ab980 con 0x7f81ac072090 2023-12-16T03:28:39.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 -- 172.21.15.28:0/3436064599 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81ac072090 msgr2=0x7f81ac150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 --2- 172.21.15.28:0/3436064599 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81ac072090 0x7f81ac150fa0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f81940097c0 tx=0x7f819401c330 comp rx=0 tx=0).stop 2023-12-16T03:28:39.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 -- 172.21.15.28:0/3436064599 shutdown_connections 2023-12-16T03:28:39.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 --2- 172.21.15.28:0/3436064599 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81ac0725c0 0x7f81ac1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 --2- 172.21.15.28:0/3436064599 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81ac072090 0x7f81ac150fa0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 -- 172.21.15.28:0/3436064599 >> 172.21.15.28:0/3436064599 conn(0x7f81ac06a5b0 msgr2=0x7f81ac06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:39.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 -- 172.21.15.28:0/3436064599 shutdown_connections 2023-12-16T03:28:39.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 -- 172.21.15.28:0/3436064599 wait complete. 2023-12-16T03:28:39.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 Processor -- start 2023-12-16T03:28:39.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 -- start start 2023-12-16T03:28:39.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81ac072090 0x7f81ac146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81ac0725c0 0x7f81ac0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81ac0a5370 0x7f81ac1ec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac146810 con 0x7f81ac0a5370 2023-12-16T03:28:39.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac0a6620 con 0x7f81ac072090 2023-12-16T03:28:39.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81b0bd8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac0a6340 con 0x7f81ac0725c0 2023-12-16T03:28:39.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81aad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81ac0a5370 0x7f81ac1ec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81aad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81ac0a5370 0x7f81ac1ec9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34516/0 (socket says 172.21.15.28:34516) 2023-12-16T03:28:39.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81aa59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81ac072090 0x7f81ac146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81aad9d640 1 -- 172.21.15.28:0/2120585286 learned_addr learned my addr 172.21.15.28:0/2120585286 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:39.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81a3fff640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81ac0725c0 0x7f81ac0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81aad9d640 1 -- 172.21.15.28:0/2120585286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81ac0725c0 msgr2=0x7f81ac0bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81aad9d640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81ac0725c0 0x7f81ac0bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81aad9d640 1 -- 172.21.15.28:0/2120585286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81ac072090 msgr2=0x7f81ac146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81aad9d640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81ac072090 0x7f81ac146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.706+0000 7f81aad9d640 1 -- 172.21.15.28:0/2120585286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8194009420 con 0x7f81ac0a5370 2023-12-16T03:28:39.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.710+0000 7f81aad9d640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81ac0a5370 0x7f81ac1ec9f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f81a400efc0 tx=0x7f81a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:39.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.710+0000 7f81a2ffd640 1 -- 172.21.15.28:0/2120585286 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4014480 con 0x7f81ac0a5370 2023-12-16T03:28:39.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.710+0000 7f81a2ffd640 1 -- 172.21.15.28:0/2120585286 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a400f040 con 0x7f81ac0a5370 2023-12-16T03:28:39.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.710+0000 7f81a2ffd640 1 -- 172.21.15.28:0/2120585286 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4014820 con 0x7f81ac0a5370 2023-12-16T03:28:39.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.710+0000 7f81b0bd8640 1 -- 172.21.15.28:0/2120585286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ac1f0a10 con 0x7f81ac0a5370 2023-12-16T03:28:39.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.710+0000 7f81b0bd8640 1 -- 172.21.15.28:0/2120585286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ac0bf8a0 con 0x7f81ac0a5370 2023-12-16T03:28:39.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.710+0000 7f81b0bd8640 1 -- 172.21.15.28:0/2120585286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ac146980 con 0x7f81ac0a5370 2023-12-16T03:28:39.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.710+0000 7f81a2ffd640 1 -- 172.21.15.28:0/2120585286 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f81a4014980 con 0x7f81ac0a5370 2023-12-16T03:28:39.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.714+0000 7f81a2ffd640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f818c066470 0x7f818c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:39.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.714+0000 7f81a2ffd640 1 -- 172.21.15.28:0/2120585286 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f81a4084b50 con 0x7f81ac0a5370 2023-12-16T03:28:39.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.714+0000 7f81aa59c640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f818c066470 0x7f818c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:39.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.714+0000 7f81aa59c640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f818c066470 0x7f818c068930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f819c000f70 tx=0x7f819c007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:39.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.718+0000 7f81a2ffd640 1 -- 172.21.15.28:0/2120585286 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f81a4051db0 con 0x7f81ac0a5370 2023-12-16T03:28:39.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 -- 172.21.15.28:0/2120585286 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81ac068400 con 0x7f81ac0a5370 2023-12-16T03:28:39.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81a2ffd640 1 -- 172.21.15.28:0/2120585286 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+6184 (secure 0 0 0) 0x7f81a4018090 con 0x7f81ac0a5370 2023-12-16T03:28:39.914 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:39.915 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/651767003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":651767003},{"type":"v1","addr":"172.21.15.28:6837","nonce":651767003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4202659808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4202659808},{"type":"v1","addr":"172.21.15.134:6834","nonce":4202659808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:27:59.086495+0000","modified":"2023-12-16T03:28:02.105487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6836/2582425067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2582425067},{"type":"v1","addr":"172.21.15.28:6836","nonce":2582425067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:28:12.170094+0000","modified":"2023-12-16T03:28:15.197722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5729":{"gid":5729,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6835/931138884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":931138884},{"type":"v1","addr":"172.21.15.134:6835","nonce":931138884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-16T03:28:39.915 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 51 2023-12-16T03:28:39.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 -- 172.21.15.28:0/2120585286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f818c066470 msgr2=0x7f818c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f818c066470 0x7f818c068930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f819c000f70 tx=0x7f819c007df0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 -- 172.21.15.28:0/2120585286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81ac0a5370 msgr2=0x7f81ac1ec9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:39.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81ac0a5370 0x7f81ac1ec9f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f81a400efc0 tx=0x7f81a400c490 comp rx=0 tx=0).stop 2023-12-16T03:28:39.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 -- 172.21.15.28:0/2120585286 shutdown_connections 2023-12-16T03:28:39.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f818c066470 0x7f818c068930 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81ac0a5370 0x7f81ac1ec9f0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f81ac0725c0 0x7f81ac0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 --2- 172.21.15.28:0/2120585286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81ac072090 0x7f81ac146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:39.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 -- 172.21.15.28:0/2120585286 >> 172.21.15.28:0/2120585286 conn(0x7f81ac06a5b0 msgr2=0x7f81ac0c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:39.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 -- 172.21.15.28:0/2120585286 shutdown_connections 2023-12-16T03:28:39.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:39.910+0000 7f81b0bd8640 1 -- 172.21.15.28:0/2120585286 wait complete. 2023-12-16T03:28:39.935 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:40.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63db5aa640 1 Processor -- start 2023-12-16T03:28:40.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63db5aa640 1 -- start start 2023-12-16T03:28:40.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63db5aa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f63d4151e90 0x7f63d40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63db5aa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63d40c7ea0 0x7f63d406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63db5aa640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d406c860 con 0x7f63d40c4e60 2023-12-16T03:28:40.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63db5aa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d40c8750 con 0x7f63d4151e90 2023-12-16T03:28:40.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63db5aa640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d41552d0 con 0x7f63d40c7ea0 2023-12-16T03:28:40.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63d9346640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f63d4151e90 0x7f63d40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63d9346640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f63d4151e90 0x7f63d40c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34520/0 (socket says 172.21.15.28:34520) 2023-12-16T03:28:40.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63d9346640 1 -- 172.21.15.28:0/2114833064 learned_addr learned my addr 172.21.15.28:0/2114833064 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:40.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63d8b45640 1 --2- 172.21.15.28:0/2114833064 >> v2:172.21.15.134:3300/0 conn(0x7f63d40c7ea0 0x7f63d406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63d9346640 1 -- 172.21.15.28:0/2114833064 >> v2:172.21.15.134:3300/0 conn(0x7f63d40c7ea0 msgr2=0x7f63d406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:40.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63d9346640 1 --2- 172.21.15.28:0/2114833064 >> v2:172.21.15.134:3300/0 conn(0x7f63d40c7ea0 0x7f63d406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63d9346640 1 -- 172.21.15.28:0/2114833064 >> v1:172.21.15.134:6789/0 conn(0x7f63d40c4e60 legacy=0x7f63d406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63d9346640 1 -- 172.21.15.28:0/2114833064 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d4154930 con 0x7f63d4151e90 2023-12-16T03:28:40.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.074+0000 7f63d8b45640 1 --2- 172.21.15.28:0/2114833064 >> v2:172.21.15.134:3300/0 conn(0x7f63d40c7ea0 0x7f63d406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:40.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63d9346640 1 --2- 172.21.15.28:0/2114833064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d4151e90 0x7f63d40c4920 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f63d40a9a70 tx=0x7f63d001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46008c0e83d53618 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:40.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63cbfff640 1 -- 172.21.15.28:0/2114833064 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00ab600 con 0x7f63d4151e90 2023-12-16T03:28:40.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63cbfff640 1 -- 172.21.15.28:0/2114833064 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d00a7050 con 0x7f63d4151e90 2023-12-16T03:28:40.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63cbfff640 1 -- 172.21.15.28:0/2114833064 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00ab980 con 0x7f63d4151e90 2023-12-16T03:28:40.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63db5aa640 1 -- 172.21.15.28:0/2114833064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d4151e90 msgr2=0x7f63d40c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63db5aa640 1 --2- 172.21.15.28:0/2114833064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d4151e90 0x7f63d40c4920 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f63d40a9a70 tx=0x7f63d001c3e0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63db5aa640 1 -- 172.21.15.28:0/2114833064 shutdown_connections 2023-12-16T03:28:40.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63db5aa640 1 --2- 172.21.15.28:0/2114833064 >> v2:172.21.15.134:3300/0 conn(0x7f63d40c7ea0 0x7f63d406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63db5aa640 1 --2- 172.21.15.28:0/2114833064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d4151e90 0x7f63d40c4920 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63db5aa640 1 -- 172.21.15.28:0/2114833064 >> 172.21.15.28:0/2114833064 conn(0x7f63d40ca170 msgr2=0x7f63d40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:40.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63db5aa640 1 -- 172.21.15.28:0/2114833064 shutdown_connections 2023-12-16T03:28:40.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.078+0000 7f63db5aa640 1 -- 172.21.15.28:0/2114833064 wait complete. 2023-12-16T03:28:40.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63db5aa640 1 Processor -- start 2023-12-16T03:28:40.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63db5aa640 1 -- start start 2023-12-16T03:28:40.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63db5aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63d40c4e60 0x7f63d40adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63db5aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d40c7ea0 0x7f63d40bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63db5aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d4151e90 0x7f63d40c1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63db5aa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4150b50 con 0x7f63d4151e90 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63db5aa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40c0190 con 0x7f63d40c7ea0 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63db5aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d41edac0 con 0x7f63d40c4e60 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63d9b47640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d4151e90 0x7f63d40c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63d9b47640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d4151e90 0x7f63d40c1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34526/0 (socket says 172.21.15.28:34526) 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63d9b47640 1 -- 172.21.15.28:0/812499353 learned_addr learned my addr 172.21.15.28:0/812499353 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63d9346640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63d40c4e60 0x7f63d40adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63d8b45640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d40c7ea0 0x7f63d40bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63d9b47640 1 -- 172.21.15.28:0/812499353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63d40c4e60 msgr2=0x7f63d40adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63d9b47640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63d40c4e60 0x7f63d40adc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63d9b47640 1 -- 172.21.15.28:0/812499353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d40c7ea0 msgr2=0x7f63d40bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63d9b47640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d40c7ea0 0x7f63d40bf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63d9b47640 1 -- 172.21.15.28:0/812499353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d00094d0 con 0x7f63d4151e90 2023-12-16T03:28:40.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63d9b47640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d4151e90 0x7f63d40c1560 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00c760 tx=0x7f63cc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:40.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63c9ffb640 1 -- 172.21.15.28:0/812499353 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc003b80 con 0x7f63d4151e90 2023-12-16T03:28:40.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63c9ffb640 1 -- 172.21.15.28:0/812499353 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc003ce0 con 0x7f63d4151e90 2023-12-16T03:28:40.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63db5aa640 1 -- 172.21.15.28:0/812499353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d4150870 con 0x7f63d4151e90 2023-12-16T03:28:40.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63c9ffb640 1 -- 172.21.15.28:0/812499353 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc00aa30 con 0x7f63d4151e90 2023-12-16T03:28:40.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.082+0000 7f63db5aa640 1 -- 172.21.15.28:0/812499353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d40bdc50 con 0x7f63d4151e90 2023-12-16T03:28:40.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.086+0000 7f63db5aa640 1 -- 172.21.15.28:0/812499353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d4068400 con 0x7f63d4151e90 2023-12-16T03:28:40.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.086+0000 7f63c9ffb640 1 -- 172.21.15.28:0/812499353 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f63cc00ab90 con 0x7f63d4151e90 2023-12-16T03:28:40.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.086+0000 7f63c9ffb640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63b8066470 0x7f63b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.086+0000 7f63c9ffb640 1 -- 172.21.15.28:0/812499353 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f63cc083e40 con 0x7f63d4151e90 2023-12-16T03:28:40.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.086+0000 7f63d9346640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63b8066470 0x7f63b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.090+0000 7f63d9346640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63b8066470 0x7f63b8068930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f63d00ad000 tx=0x7f63d00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:40.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.090+0000 7f63c9ffb640 1 -- 172.21.15.28:0/812499353 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f63cc051000 con 0x7f63d4151e90 2023-12-16T03:28:40.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.250+0000 7f63db5aa640 1 -- 172.21.15.28:0/812499353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63d41edc00 con 0x7f63d4151e90 2023-12-16T03:28:40.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63c9ffb640 1 -- 172.21.15.28:0/812499353 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20214 (secure 0 0 0) 0x7f63cc054620 con 0x7f63d4151e90 2023-12-16T03:28:40.257 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:40.257 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":72,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:13.793649+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-16T03:27:56.894984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-16T03:27:58.090972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:40.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 -- 172.21.15.28:0/812499353 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63b8066470 msgr2=0x7f63b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63b8066470 0x7f63b8068930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f63d00ad000 tx=0x7f63d00a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:40.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 -- 172.21.15.28:0/812499353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d4151e90 msgr2=0x7f63d40c1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d4151e90 0x7f63d40c1560 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00c760 tx=0x7f63cc00cc20 comp rx=0 tx=0).stop 2023-12-16T03:28:40.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 -- 172.21.15.28:0/812499353 shutdown_connections 2023-12-16T03:28:40.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f63b8066470 0x7f63b8068930 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f63d4151e90 0x7f63d40c1560 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63d40c7ea0 0x7f63d40bf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 --2- 172.21.15.28:0/812499353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f63d40c4e60 0x7f63d40adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 -- 172.21.15.28:0/812499353 >> 172.21.15.28:0/812499353 conn(0x7f63d40ca170 msgr2=0x7f63d4157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:40.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 -- 172.21.15.28:0/812499353 shutdown_connections 2023-12-16T03:28:40.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.254+0000 7f63db5aa640 1 -- 172.21.15.28:0/812499353 wait complete. 2023-12-16T03:28:40.278 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-16T03:28:40.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b7565640 1 Processor -- start 2023-12-16T03:28:40.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b7565640 1 -- start start 2023-12-16T03:28:40.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b7565640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff8b006d520 0x7ff8b015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b7565640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b015c600 con 0x7ff8b01560e0 2023-12-16T03:28:40.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b7565640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b015a5c0 con 0x7ff8b00bffc0 2023-12-16T03:28:40.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b7565640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b01594e0 con 0x7ff8b006d520 2023-12-16T03:28:40.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b5301640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff8b01560e0 0x7ff8b0159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39914/0 (socket says 172.21.15.28:39914) 2023-12-16T03:28:40.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b5301640 1 -- 172.21.15.28:0/3449975895 learned_addr learned my addr 172.21.15.28:0/3449975895 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:40.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b4b00640 1 --2- 172.21.15.28:0/3449975895 >> v2:172.21.15.134:3300/0 conn(0x7ff8b006d520 0x7ff8b015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425654563 0 0) 0x7ff8b015c600 con 0x7ff8b01560e0 2023-12-16T03:28:40.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff89c003530 con 0x7ff8b01560e0 2023-12-16T03:28:40.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1772482169 0 0) 0x7ff89c003530 con 0x7ff8b01560e0 2023-12-16T03:28:40.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 >> v2:172.21.15.134:3300/0 conn(0x7ff8b006d520 msgr2=0x7ff8b015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:40.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 --2- 172.21.15.28:0/3449975895 >> v2:172.21.15.134:3300/0 conn(0x7ff8b006d520 0x7ff8b015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 >> v1:172.21.15.134:6789/0 conn(0x7ff8b00bffc0 legacy=0x7ff8b00c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b01597c0 con 0x7ff8b01560e0 2023-12-16T03:28:40.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7ff8ac001680 con 0x7ff8b01560e0 2023-12-16T03:28:40.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 >> v1:172.21.15.28:6789/0 conn(0x7ff8b01560e0 legacy=0x7ff8b0159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 --2- 172.21.15.28:0/3449975895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff89c0039d0 0x7ff89c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 --2- 172.21.15.28:0/3449975895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff89c0047d0 0x7ff89c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 --2- 172.21.15.28:0/3449975895 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff89c005190 0x7ff89c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01594e0 con 0x7ff89c0047d0 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c00c090 con 0x7ff89c0039d0 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c00c250 con 0x7ff89c005190 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b4b00640 1 --2- 172.21.15.28:0/3449975895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff89c0047d0 0x7ff89c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b5301640 1 --2- 172.21.15.28:0/3449975895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff89c0039d0 0x7ff89c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b5b02640 1 --2- 172.21.15.28:0/3449975895 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff89c005190 0x7ff89c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b4b00640 1 -- 172.21.15.28:0/3449975895 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff89c005190 msgr2=0x7ff89c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b4b00640 1 --2- 172.21.15.28:0/3449975895 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff89c005190 0x7ff89c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b4b00640 1 -- 172.21.15.28:0/3449975895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff89c0039d0 msgr2=0x7ff89c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b4b00640 1 --2- 172.21.15.28:0/3449975895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff89c0039d0 0x7ff89c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b4b00640 1 -- 172.21.15.28:0/3449975895 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c003530 con 0x7ff89c0047d0 2023-12-16T03:28:40.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.418+0000 7ff8b5b02640 1 -- 172.21.15.28:0/3449975895 reap_dead start 2023-12-16T03:28:40.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.422+0000 7ff8b4b00640 1 --2- 172.21.15.28:0/3449975895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff89c0047d0 0x7ff89c004c50 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009ab0 tx=0x7ff8a001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7062b4a57efaa3dd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:40.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.422+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00a5510 con 0x7ff89c0047d0 2023-12-16T03:28:40.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.422+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a00a5670 con 0x7ff89c0047d0 2023-12-16T03:28:40.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.422+0000 7ff8a7fff640 1 -- 172.21.15.28:0/3449975895 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00a5a20 con 0x7ff89c0047d0 2023-12-16T03:28:40.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.422+0000 7ff8b7565640 1 -- 172.21.15.28:0/3449975895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff89c0047d0 msgr2=0x7ff89c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.422+0000 7ff8b7565640 1 --2- 172.21.15.28:0/3449975895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff89c0047d0 0x7ff89c004c50 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009ab0 tx=0x7ff8a001ca30 comp rx=0 tx=0).stop 2023-12-16T03:28:40.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.422+0000 7ff8b7565640 1 -- 172.21.15.28:0/3449975895 shutdown_connections 2023-12-16T03:28:40.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.422+0000 7ff8b7565640 1 --2- 172.21.15.28:0/3449975895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff89c0047d0 0x7ff89c004c50 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.422+0000 7ff8b7565640 1 -- 172.21.15.28:0/3449975895 >> 172.21.15.28:0/3449975895 conn(0x7ff8b006a5b0 msgr2=0x7ff8b006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:40.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.422+0000 7ff8b7565640 1 -- 172.21.15.28:0/3449975895 shutdown_connections 2023-12-16T03:28:40.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.422+0000 7ff8b7565640 1 -- 172.21.15.28:0/3449975895 wait complete. 2023-12-16T03:28:40.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b7565640 1 Processor -- start 2023-12-16T03:28:40.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b7565640 1 -- start start 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b7565640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff89c0047d0 0x7ff8b01f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b7565640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b00aaf70 0x7ff8b00a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b7565640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8b00a9520 0x7ff8b00c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b7565640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b0152c90 con 0x7ff8b00a9520 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b7565640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01f27f0 con 0x7ff89c0047d0 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b7565640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00a99a0 con 0x7ff8b00aaf70 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b5b02640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8b00a9520 0x7ff8b00c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b5b02640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8b00a9520 0x7ff8b00c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34544/0 (socket says 172.21.15.28:34544) 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b5b02640 1 -- 172.21.15.28:0/2422573324 learned_addr learned my addr 172.21.15.28:0/2422573324 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b5301640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff89c0047d0 0x7ff8b01f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b4b00640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b00aaf70 0x7ff8b00a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b5b02640 1 -- 172.21.15.28:0/2422573324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b00aaf70 msgr2=0x7ff8b00a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b5b02640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b00aaf70 0x7ff8b00a8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b5b02640 1 -- 172.21.15.28:0/2422573324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff89c0047d0 msgr2=0x7ff8b01f22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b5b02640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff89c0047d0 0x7ff8b01f22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b5b02640 1 -- 172.21.15.28:0/2422573324 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00c51c0 con 0x7ff8b00a9520 2023-12-16T03:28:40.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b5301640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff89c0047d0 0x7ff8b01f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:40.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b5b02640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8b00a9520 0x7ff8b00c4030 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff8b006dec0 tx=0x7ff8a800fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:40.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8a5ffb640 1 -- 172.21.15.28:0/2422573324 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800fee0 con 0x7ff8b00a9520 2023-12-16T03:28:40.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8a5ffb640 1 -- 172.21.15.28:0/2422573324 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8003b90 con 0x7ff8b00a9520 2023-12-16T03:28:40.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8b7565640 1 -- 172.21.15.28:0/2422573324 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b00c5840 con 0x7ff8b00a9520 2023-12-16T03:28:40.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.426+0000 7ff8a5ffb640 1 -- 172.21.15.28:0/2422573324 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80050d0 con 0x7ff8b00a9520 2023-12-16T03:28:40.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.430+0000 7ff8b7565640 1 -- 172.21.15.28:0/2422573324 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b0152f00 con 0x7ff8b00a9520 2023-12-16T03:28:40.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.430+0000 7ff8b7565640 1 -- 172.21.15.28:0/2422573324 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b00c5d80 con 0x7ff8b00a9520 2023-12-16T03:28:40.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.430+0000 7ff8a5ffb640 1 -- 172.21.15.28:0/2422573324 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff8a8005230 con 0x7ff8b00a9520 2023-12-16T03:28:40.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.430+0000 7ff8a5ffb640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff894066470 0x7ff894068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.430+0000 7ff8a5ffb640 1 -- 172.21.15.28:0/2422573324 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff8a80840f0 con 0x7ff8b00a9520 2023-12-16T03:28:40.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.430+0000 7ff8b5301640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff894066470 0x7ff894068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.430+0000 7ff8b5301640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff894066470 0x7ff894068930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac007c20 tx=0x7ff8ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:40.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.434+0000 7ff8a5ffb640 1 -- 172.21.15.28:0/2422573324 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff8b00c5d80 con 0x7ff8b00a9520 2023-12-16T03:28:40.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.630+0000 7ff8b7565640 1 -- 172.21.15.28:0/2422573324 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff8b00c5d80 con 0x7ff8b00a9520 2023-12-16T03:28:40.637 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-12-16T03:28:40.634+0000 7f6a9e376640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T03:28:40.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.634+0000 7ff8a5ffb640 1 -- 172.21.15.28:0/2422573324 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff8b00c5d80 con 0x7ff8b00a9520 2023-12-16T03:28:40.639 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-16T03:28:40.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 -- 172.21.15.28:0/2422573324 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff894066470 msgr2=0x7ff894068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff894066470 0x7ff894068930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac007c20 tx=0x7ff8ac009040 comp rx=0 tx=0).stop 2023-12-16T03:28:40.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 -- 172.21.15.28:0/2422573324 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8b00a9520 msgr2=0x7ff8b00c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8b00a9520 0x7ff8b00c4030 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff8b006dec0 tx=0x7ff8a800fc90 comp rx=0 tx=0).stop 2023-12-16T03:28:40.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 -- 172.21.15.28:0/2422573324 shutdown_connections 2023-12-16T03:28:40.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff894066470 0x7ff894068930 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8b00a9520 0x7ff8b00c4030 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff8b00aaf70 0x7ff8b00a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 --2- 172.21.15.28:0/2422573324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff89c0047d0 0x7ff8b01f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 -- 172.21.15.28:0/2422573324 >> 172.21.15.28:0/2422573324 conn(0x7ff8b006a5b0 msgr2=0x7ff8b0159d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:40.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 -- 172.21.15.28:0/2422573324 shutdown_connections 2023-12-16T03:28:40.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.638+0000 7ff8b7565640 1 -- 172.21.15.28:0/2422573324 wait complete. 2023-12-16T03:28:40.652 INFO:tasks.ceph.mds.a.smithi028.stderr: -5154> 2023-12-16T03:28:04.667+0000 7f69ceed3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:28:40.664 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-16T03:28:40.705 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-12-16T03:28:40.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.806+0000 7fad015f5640 1 Processor -- start 2023-12-16T03:28:40.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.806+0000 7fad015f5640 1 -- start start 2023-12-16T03:28:40.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.806+0000 7fad015f5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7facfc14b0d0 0x7facfc1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.806+0000 7fad015f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facfc06c4d0 0x7facfc0c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.806+0000 7fad015f5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facfc06ba80 con 0x7facfc0c47f0 2023-12-16T03:28:40.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.806+0000 7fad015f5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facfc0c5ba0 con 0x7facfc14b0d0 2023-12-16T03:28:40.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.806+0000 7fad015f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc1555f0 con 0x7facfc06c4d0 2023-12-16T03:28:40.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facfaffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7facfc14b0d0 0x7facfc1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facfb7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facfc06c4d0 0x7facfc0c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facf3fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7facfc0c47f0 0x7facfc0c7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:51022/0 (socket says 172.21.15.28:51022) 2023-12-16T03:28:40.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facfaffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7facfc14b0d0 0x7facfc1550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:42948/0 (socket says 172.21.15.28:42948) 2023-12-16T03:28:40.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facf3fff640 1 -- 172.21.15.28:0/2284077119 learned_addr learned my addr 172.21.15.28:0/2284077119 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:40.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facfaffd640 1 -- 172.21.15.28:0/2284077119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facfc06c4d0 msgr2=0x7facfc0c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:40.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facfaffd640 1 --2- 172.21.15.28:0/2284077119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facfc06c4d0 0x7facfc0c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facfaffd640 1 -- 172.21.15.28:0/2284077119 >> v1:172.21.15.134:6789/0 conn(0x7facfc0c47f0 legacy=0x7facfc0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facfaffd640 1 -- 172.21.15.28:0/2284077119 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc14b4b0 con 0x7facfc14b0d0 2023-12-16T03:28:40.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facfaffd640 1 --2- 172.21.15.28:0/2284077119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facfc14b0d0 0x7facfc1550b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7facec0097c0 tx=0x7facec01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eefe7f4150c4019 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:40.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facfa7fc640 1 -- 172.21.15.28:0/2284077119 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec0ab600 con 0x7facfc14b0d0 2023-12-16T03:28:40.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facfa7fc640 1 -- 172.21.15.28:0/2284077119 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec0a7050 con 0x7facfc14b0d0 2023-12-16T03:28:40.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.810+0000 7facfa7fc640 1 -- 172.21.15.28:0/2284077119 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec0ab980 con 0x7facfc14b0d0 2023-12-16T03:28:40.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 -- 172.21.15.28:0/2284077119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facfc14b0d0 msgr2=0x7facfc1550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 --2- 172.21.15.28:0/2284077119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facfc14b0d0 0x7facfc1550b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7facec0097c0 tx=0x7facec01c3f0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 -- 172.21.15.28:0/2284077119 shutdown_connections 2023-12-16T03:28:40.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 --2- 172.21.15.28:0/2284077119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facfc06c4d0 0x7facfc0c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 --2- 172.21.15.28:0/2284077119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facfc14b0d0 0x7facfc1550b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 -- 172.21.15.28:0/2284077119 >> 172.21.15.28:0/2284077119 conn(0x7facfc0aba00 msgr2=0x7facfc0abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:40.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 -- 172.21.15.28:0/2284077119 shutdown_connections 2023-12-16T03:28:40.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 -- 172.21.15.28:0/2284077119 wait complete. 2023-12-16T03:28:40.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 Processor -- start 2023-12-16T03:28:40.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 -- start start 2023-12-16T03:28:40.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facfc06c4d0 0x7facfc0af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facfc0c47f0 0x7facfc149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facfc14b0d0 0x7facfc149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc14d100 con 0x7facfc14b0d0 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc14a200 con 0x7facfc0c47f0 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7fad015f5640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0adf30 con 0x7facfc06c4d0 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7facfb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facfc14b0d0 0x7facfc149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7facfb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facfc14b0d0 0x7facfc149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34560/0 (socket says 172.21.15.28:34560) 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7facfaffd640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facfc06c4d0 0x7facfc0af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7facfb7fe640 1 -- 172.21.15.28:0/185152649 learned_addr learned my addr 172.21.15.28:0/185152649 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7facf3fff640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facfc0c47f0 0x7facfc149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7facfb7fe640 1 -- 172.21.15.28:0/185152649 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facfc06c4d0 msgr2=0x7facfc0af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7facfb7fe640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facfc06c4d0 0x7facfc0af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7facfb7fe640 1 -- 172.21.15.28:0/185152649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facfc0c47f0 msgr2=0x7facfc149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7facfb7fe640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facfc0c47f0 0x7facfc149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7facfb7fe640 1 -- 172.21.15.28:0/185152649 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec009420 con 0x7facfc14b0d0 2023-12-16T03:28:40.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.814+0000 7facfaffd640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facfc06c4d0 0x7facfc0af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:40.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.818+0000 7facfb7fe640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facfc14b0d0 0x7facfc149cc0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7facf400efc0 tx=0x7facf400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:40.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.818+0000 7facf37fe640 1 -- 172.21.15.28:0/185152649 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400ced0 con 0x7facfc14b0d0 2023-12-16T03:28:40.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.818+0000 7facf37fe640 1 -- 172.21.15.28:0/185152649 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf400f040 con 0x7facfc14b0d0 2023-12-16T03:28:40.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.818+0000 7facf37fe640 1 -- 172.21.15.28:0/185152649 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf40146c0 con 0x7facfc14b0d0 2023-12-16T03:28:40.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.818+0000 7fad015f5640 1 -- 172.21.15.28:0/185152649 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc14d430 con 0x7facfc14b0d0 2023-12-16T03:28:40.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.818+0000 7fad015f5640 1 -- 172.21.15.28:0/185152649 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc14d9f0 con 0x7facfc14b0d0 2023-12-16T03:28:40.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.818+0000 7fad015f5640 1 -- 172.21.15.28:0/185152649 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facfc04e850 con 0x7facfc14b0d0 2023-12-16T03:28:40.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.818+0000 7facf37fe640 1 -- 172.21.15.28:0/185152649 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7facf4014820 con 0x7facfc14b0d0 2023-12-16T03:28:40.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.818+0000 7facf37fe640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7facdc0664a0 0x7facdc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:40.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.818+0000 7facf37fe640 1 -- 172.21.15.28:0/185152649 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6651+0+0 (secure 0 0 0) 0x7facf4084f10 con 0x7facfc14b0d0 2023-12-16T03:28:40.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.818+0000 7facfaffd640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7facdc0664a0 0x7facdc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:40.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.822+0000 7facfaffd640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7facdc0664a0 0x7facdc068960 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7facec0ad000 tx=0x7facec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:40.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:40.826+0000 7facf37fe640 1 -- 172.21.15.28:0/185152649 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7facf4052080 con 0x7facfc14b0d0 2023-12-16T03:28:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.014+0000 7fad015f5640 1 -- 172.21.15.28:0/185152649 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7facfc06d2e0 con 0x7facfc14b0d0 2023-12-16T03:28:41.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.638+0000 7facf37fe640 1 -- 172.21.15.28:0/185152649 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7facf40556a0 con 0x7facfc14b0d0 2023-12-16T03:28:41.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.638+0000 7fad015f5640 1 -- 172.21.15.28:0/185152649 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7facdc0664a0 msgr2=0x7facdc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:41.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.638+0000 7fad015f5640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7facdc0664a0 0x7facdc068960 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7facec0ad000 tx=0x7facec008040 comp rx=0 tx=0).stop 2023-12-16T03:28:41.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.638+0000 7fad015f5640 1 -- 172.21.15.28:0/185152649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facfc14b0d0 msgr2=0x7facfc149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:41.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.638+0000 7fad015f5640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facfc14b0d0 0x7facfc149cc0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7facf400efc0 tx=0x7facf400c490 comp rx=0 tx=0).stop 2023-12-16T03:28:41.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.638+0000 7fad015f5640 1 -- 172.21.15.28:0/185152649 shutdown_connections 2023-12-16T03:28:41.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.638+0000 7fad015f5640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7facdc0664a0 0x7facdc068960 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:41.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.638+0000 7fad015f5640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facfc14b0d0 0x7facfc149cc0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:41.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.638+0000 7fad015f5640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facfc0c47f0 0x7facfc149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:41.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.638+0000 7fad015f5640 1 --2- 172.21.15.28:0/185152649 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facfc06c4d0 0x7facfc0af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:41.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.638+0000 7fad015f5640 1 -- 172.21.15.28:0/185152649 >> 172.21.15.28:0/185152649 conn(0x7facfc0aba00 msgr2=0x7facfc0c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:41.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.642+0000 7fad015f5640 1 -- 172.21.15.28:0/185152649 shutdown_connections 2023-12-16T03:28:41.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.642+0000 7fad015f5640 1 -- 172.21.15.28:0/185152649 wait complete. 2023-12-16T03:28:41.669 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-16T03:28:41.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.862+0000 7f725da79640 1 Processor -- start 2023-12-16T03:28:41.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.862+0000 7f725da79640 1 -- start start 2023-12-16T03:28:41.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.862+0000 7f725da79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7258151e00 0x7f7258158580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:41.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f725da79640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7258073b70 con 0x7f72580c07f0 2023-12-16T03:28:41.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f725da79640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72580c0c80 con 0x7f72580c0370 2023-12-16T03:28:41.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f725da79640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7258158ac0 con 0x7f7258151e00 2023-12-16T03:28:41.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f7257fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f72580c07f0 0x7f72580c19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39918/0 (socket says 172.21.15.28:39918) 2023-12-16T03:28:41.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f7257fff640 1 -- 172.21.15.28:0/3718953363 learned_addr learned my addr 172.21.15.28:0/3718953363 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:41.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f72577fe640 1 --2- 172.21.15.28:0/3718953363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7258151e00 0x7f7258158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:41.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f72567fc640 1 -- 172.21.15.28:0/3718953363 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139522547 0 0) 0x7f7258073b70 con 0x7f72580c07f0 2023-12-16T03:28:41.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f72567fc640 1 -- 172.21.15.28:0/3718953363 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7240003530 con 0x7f72580c07f0 2023-12-16T03:28:41.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f72567fc640 1 -- 172.21.15.28:0/3718953363 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503492486 0 0) 0x7f72580c0c80 con 0x7f72580c0370 2023-12-16T03:28:41.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f72567fc640 1 -- 172.21.15.28:0/3718953363 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7258073b70 con 0x7f72580c0370 2023-12-16T03:28:41.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f72577fe640 1 -- 172.21.15.28:0/3718953363 >> v1:172.21.15.134:6789/0 conn(0x7f72580c0370 legacy=0x7f72580c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:41.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f72577fe640 1 -- 172.21.15.28:0/3718953363 >> v1:172.21.15.28:6789/0 conn(0x7f72580c07f0 legacy=0x7f72580c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:41.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.866+0000 7f72577fe640 1 -- 172.21.15.28:0/3718953363 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72580735b0 con 0x7f7258151e00 2023-12-16T03:28:41.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f72577fe640 1 --2- 172.21.15.28:0/3718953363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7258151e00 0x7f7258158580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f72480097f0 tx=0x7f724801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ca601bedae2f5e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:41.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f72567fc640 1 -- 172.21.15.28:0/3718953363 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480ab600 con 0x7f7258151e00 2023-12-16T03:28:41.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f72567fc640 1 -- 172.21.15.28:0/3718953363 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72480a7050 con 0x7f7258151e00 2023-12-16T03:28:41.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f72567fc640 1 -- 172.21.15.28:0/3718953363 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480ab980 con 0x7f7258151e00 2023-12-16T03:28:41.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 -- 172.21.15.28:0/3718953363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7258151e00 msgr2=0x7f7258158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:41.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 --2- 172.21.15.28:0/3718953363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7258151e00 0x7f7258158580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f72480097f0 tx=0x7f724801c3a0 comp rx=0 tx=0).stop 2023-12-16T03:28:41.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 -- 172.21.15.28:0/3718953363 shutdown_connections 2023-12-16T03:28:41.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 --2- 172.21.15.28:0/3718953363 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7258151e00 0x7f7258158580 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:41.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 -- 172.21.15.28:0/3718953363 >> 172.21.15.28:0/3718953363 conn(0x7f72580c31a0 msgr2=0x7f72580c35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:41.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 -- 172.21.15.28:0/3718953363 shutdown_connections 2023-12-16T03:28:41.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 -- 172.21.15.28:0/3718953363 wait complete. 2023-12-16T03:28:41.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 Processor -- start 2023-12-16T03:28:41.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 -- start start 2023-12-16T03:28:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72580c0370 0x7f72581f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72580c07f0 0x7f7258157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7258151e00 0x7f72581ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72581ece80 con 0x7f7258151e00 2023-12-16T03:28:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580aa6c0 con 0x7f72580c07f0 2023-12-16T03:28:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f725da79640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725814a380 con 0x7f72580c0370 2023-12-16T03:28:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f7257fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7258151e00 0x7f72581ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f7257fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7258151e00 0x7f72581ed2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34566/0 (socket says 172.21.15.28:34566) 2023-12-16T03:28:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.870+0000 7f7257fff640 1 -- 172.21.15.28:0/4269696155 learned_addr learned my addr 172.21.15.28:0/4269696155 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f72577fe640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72580c0370 0x7f72581f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f7256ffd640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72580c07f0 0x7f7258157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f7257fff640 1 -- 172.21.15.28:0/4269696155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72580c0370 msgr2=0x7f72581f0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f7257fff640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72580c0370 0x7f72581f0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f7257fff640 1 -- 172.21.15.28:0/4269696155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72580c07f0 msgr2=0x7f7258157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f7257fff640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72580c07f0 0x7f7258157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f7257fff640 1 -- 172.21.15.28:0/4269696155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7248009420 con 0x7f7258151e00 2023-12-16T03:28:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f7257fff640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7258151e00 0x7f72581ed2a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f725000caf0 tx=0x7f725000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f723ffff640 1 -- 172.21.15.28:0/4269696155 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725000aca0 con 0x7f7258151e00 2023-12-16T03:28:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f723ffff640 1 -- 172.21.15.28:0/4269696155 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725000ae00 con 0x7f7258151e00 2023-12-16T03:28:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f725da79640 1 -- 172.21.15.28:0/4269696155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725814a0a0 con 0x7f7258151e00 2023-12-16T03:28:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f723ffff640 1 -- 172.21.15.28:0/4269696155 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250012620 con 0x7f7258151e00 2023-12-16T03:28:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f725da79640 1 -- 172.21.15.28:0/4269696155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7258157ba0 con 0x7f7258151e00 2023-12-16T03:28:41.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f725da79640 1 -- 172.21.15.28:0/4269696155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72581ecfc0 con 0x7f7258151e00 2023-12-16T03:28:41.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f723ffff640 1 -- 172.21.15.28:0/4269696155 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7250007070 con 0x7f7258151e00 2023-12-16T03:28:41.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f723ffff640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f72440664a0 0x7f7244068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:41.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.874+0000 7f723ffff640 1 -- 172.21.15.28:0/4269696155 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f72500840c0 con 0x7f7258151e00 2023-12-16T03:28:41.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.878+0000 7f72577fe640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f72440664a0 0x7f7244068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:41.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.878+0000 7f72577fe640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f72440664a0 0x7f7244068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f72480ad000 tx=0x7f72480a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:41.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:41.878+0000 7f723ffff640 1 -- 172.21.15.28:0/4269696155 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f72581ecfc0 con 0x7f7258151e00 2023-12-16T03:28:42.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.038+0000 7f725da79640 1 -- 172.21.15.28:0/4269696155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f72581ecfc0 con 0x7f7258151e00 2023-12-16T03:28:42.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.642+0000 7f723ffff640 1 -- 172.21.15.28:0/4269696155 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7f72581ecfc0 con 0x7f7258151e00 2023-12-16T03:28:42.648 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2023-12-16T03:28:42.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 -- 172.21.15.28:0/4269696155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f72440664a0 msgr2=0x7f7244068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:42.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f72440664a0 0x7f7244068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f72480ad000 tx=0x7f72480a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:42.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 -- 172.21.15.28:0/4269696155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7258151e00 msgr2=0x7f72581ed2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:42.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7258151e00 0x7f72581ed2a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f725000caf0 tx=0x7f725000a060 comp rx=0 tx=0).stop 2023-12-16T03:28:42.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 -- 172.21.15.28:0/4269696155 shutdown_connections 2023-12-16T03:28:42.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f72440664a0 0x7f7244068960 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:42.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7258151e00 0x7f72581ed2a0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:42.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72580c07f0 0x7f7258157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:42.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 --2- 172.21.15.28:0/4269696155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72580c0370 0x7f72581f0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:42.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 -- 172.21.15.28:0/4269696155 >> 172.21.15.28:0/4269696155 conn(0x7f72580c31a0 msgr2=0x7f72580a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:42.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 -- 172.21.15.28:0/4269696155 shutdown_connections 2023-12-16T03:28:42.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.646+0000 7f725da79640 1 -- 172.21.15.28:0/4269696155 wait complete. 2023-12-16T03:28:42.676 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-16T03:28:42.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.826+0000 7fdeb111d640 1 Processor -- start 2023-12-16T03:28:42.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.826+0000 7fdeb111d640 1 -- start start 2023-12-16T03:28:42.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeb111d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac151c70 0x7fdeac06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:42.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeb111d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdeac0c8b90 0x7fdeac0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:42.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeb111d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac154e90 con 0x7fdeac155320 2023-12-16T03:28:42.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeb111d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac154630 con 0x7fdeac0c8b90 2023-12-16T03:28:42.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeb111d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0c5350 con 0x7fdeac151c70 2023-12-16T03:28:42.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeaad9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac151c70 0x7fdeac06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:42.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeab59e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdeac0c8b90 0x7fdeac0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:42.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeaad9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac151c70 0x7fdeac06ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:46030/0 (socket says 172.21.15.28:46030) 2023-12-16T03:28:42.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeaad9d640 1 -- 172.21.15.28:0/1298395640 learned_addr learned my addr 172.21.15.28:0/1298395640 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:42.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeaad9d640 1 -- 172.21.15.28:0/1298395640 >> v2:172.21.15.134:3300/0 conn(0x7fdeac0c8b90 msgr2=0x7fdeac0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:42.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeaad9d640 1 --2- 172.21.15.28:0/1298395640 >> v2:172.21.15.134:3300/0 conn(0x7fdeac0c8b90 0x7fdeac0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:42.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeaad9d640 1 -- 172.21.15.28:0/1298395640 >> v1:172.21.15.134:6789/0 conn(0x7fdeac155320 legacy=0x7fdeac0c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:42.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.830+0000 7fdeaad9d640 1 -- 172.21.15.28:0/1298395640 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac152050 con 0x7fdeac151c70 2023-12-16T03:28:42.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.834+0000 7fdeaad9d640 1 --2- 172.21.15.28:0/1298395640 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac151c70 0x7fdeac06ca40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009870 tx=0x7fde9c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b963b8a99e71e32 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:42.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdea9d9b640 1 -- 172.21.15.28:0/1298395640 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0ab400 con 0x7fdeac151c70 2023-12-16T03:28:42.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdea9d9b640 1 -- 172.21.15.28:0/1298395640 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c0ab560 con 0x7fdeac151c70 2023-12-16T03:28:42.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdea9d9b640 1 -- 172.21.15.28:0/1298395640 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0ab8f0 con 0x7fdeac151c70 2023-12-16T03:28:42.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdeb111d640 1 -- 172.21.15.28:0/1298395640 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac151c70 msgr2=0x7fdeac06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:42.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdeb111d640 1 --2- 172.21.15.28:0/1298395640 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac151c70 0x7fdeac06ca40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009870 tx=0x7fde9c01c440 comp rx=0 tx=0).stop 2023-12-16T03:28:42.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdeb111d640 1 -- 172.21.15.28:0/1298395640 shutdown_connections 2023-12-16T03:28:42.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdeb111d640 1 --2- 172.21.15.28:0/1298395640 >> v2:172.21.15.134:3300/0 conn(0x7fdeac0c8b90 0x7fdeac0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:42.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdeb111d640 1 --2- 172.21.15.28:0/1298395640 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac151c70 0x7fdeac06ca40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:42.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdeb111d640 1 -- 172.21.15.28:0/1298395640 >> 172.21.15.28:0/1298395640 conn(0x7fdeac0abcf0 msgr2=0x7fdeac0ac100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:42.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdeb111d640 1 -- 172.21.15.28:0/1298395640 shutdown_connections 2023-12-16T03:28:42.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdeb111d640 1 -- 172.21.15.28:0/1298395640 wait complete. 2023-12-16T03:28:42.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.838+0000 7fdeb111d640 1 Processor -- start 2023-12-16T03:28:42.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeb111d640 1 -- start start 2023-12-16T03:28:42.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeb111d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac0c8b90 0x7fdeac0acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:42.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeb111d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdeac151c70 0x7fdeac142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:42.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeb111d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac155320 0x7fdeac1431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:42.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeb111d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0ae550 con 0x7fdeac151c70 2023-12-16T03:28:42.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeb111d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac1edad0 con 0x7fdeac155320 2023-12-16T03:28:42.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeb111d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac1ecec0 con 0x7fdeac0c8b90 2023-12-16T03:28:42.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaa59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdeac151c70 0x7fdeac142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:42.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaad9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac0c8b90 0x7fdeac0acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:42.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaad9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac0c8b90 0x7fdeac0acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:46040/0 (socket says 172.21.15.28:46040) 2023-12-16T03:28:42.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaa59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdeac151c70 0x7fdeac142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34576/0 (socket says 172.21.15.28:34576) 2023-12-16T03:28:42.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaad9d640 1 -- 172.21.15.28:0/3360267610 learned_addr learned my addr 172.21.15.28:0/3360267610 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:42.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeab59e640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac155320 0x7fdeac1431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:42.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaad9d640 1 -- 172.21.15.28:0/3360267610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac155320 msgr2=0x7fdeac1431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:42.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaad9d640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac155320 0x7fdeac1431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:42.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaad9d640 1 -- 172.21.15.28:0/3360267610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdeac151c70 msgr2=0x7fdeac142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:42.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaad9d640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdeac151c70 0x7fdeac142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:42.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaad9d640 1 -- 172.21.15.28:0/3360267610 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c0094d0 con 0x7fdeac0c8b90 2023-12-16T03:28:42.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaa59c640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdeac151c70 0x7fdeac142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:42.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeaad9d640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac0c8b90 0x7fdeac0acd30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0ad040 tx=0x7fde9c01ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:42.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fde937fe640 1 -- 172.21.15.28:0/3360267610 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0ab400 con 0x7fdeac0c8b90 2023-12-16T03:28:42.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fde937fe640 1 -- 172.21.15.28:0/3360267610 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c0b4820 con 0x7fdeac0c8b90 2023-12-16T03:28:42.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fde937fe640 1 -- 172.21.15.28:0/3360267610 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0b4bd0 con 0x7fdeac0c8b90 2023-12-16T03:28:42.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeb111d640 1 -- 172.21.15.28:0/3360267610 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac1ed1a0 con 0x7fdeac0c8b90 2023-12-16T03:28:42.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeb111d640 1 -- 172.21.15.28:0/3360267610 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac1ed760 con 0x7fdeac0c8b90 2023-12-16T03:28:42.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.842+0000 7fdeb111d640 1 -- 172.21.15.28:0/3360267610 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac068400 con 0x7fdeac0c8b90 2023-12-16T03:28:42.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.846+0000 7fde937fe640 1 -- 172.21.15.28:0/3360267610 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fde9c0b4d30 con 0x7fdeac0c8b90 2023-12-16T03:28:42.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.846+0000 7fde937fe640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde980664a0 0x7fde98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:42.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.846+0000 7fde937fe640 1 -- 172.21.15.28:0/3360267610 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6213+0+0 (secure 0 0 0) 0x7fde9c11e6e0 con 0x7fdeac0c8b90 2023-12-16T03:28:42.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.846+0000 7fdeaa59c640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde980664a0 0x7fde98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:42.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.846+0000 7fdeaa59c640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde980664a0 0x7fde98068960 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0c9960 tx=0x7fdea0007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:42.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:42.850+0000 7fde937fe640 1 -- 172.21.15.28:0/3360267610 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fde9c0eb970 con 0x7fdeac0c8b90 2023-12-16T03:28:43.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.010+0000 7fdeb111d640 1 -- 172.21.15.28:0/3360267610 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdeac153560 con 0x7fdeac0c8b90 2023-12-16T03:28:43.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fde937fe640 1 -- 172.21.15.28:0/3360267610 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7fde9c0c40d0 con 0x7fdeac0c8b90 2023-12-16T03:28:43.657 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2023-12-16T03:28:43.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 -- 172.21.15.28:0/3360267610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde980664a0 msgr2=0x7fde98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:43.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde980664a0 0x7fde98068960 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0c9960 tx=0x7fdea0007e40 comp rx=0 tx=0).stop 2023-12-16T03:28:43.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 -- 172.21.15.28:0/3360267610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac0c8b90 msgr2=0x7fdeac0acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:43.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac0c8b90 0x7fdeac0acd30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0ad040 tx=0x7fde9c01ac80 comp rx=0 tx=0).stop 2023-12-16T03:28:43.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 -- 172.21.15.28:0/3360267610 shutdown_connections 2023-12-16T03:28:43.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdeac155320 0x7fdeac1431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:43.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde980664a0 0x7fde98068960 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:43.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdeac151c70 0x7fdeac142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:43.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 --2- 172.21.15.28:0/3360267610 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdeac0c8b90 0x7fdeac0acd30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:43.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 -- 172.21.15.28:0/3360267610 >> 172.21.15.28:0/3360267610 conn(0x7fdeac0abcf0 msgr2=0x7fdeac0c48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:43.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 -- 172.21.15.28:0/3360267610 shutdown_connections 2023-12-16T03:28:43.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.654+0000 7fdeb111d640 1 -- 172.21.15.28:0/3360267610 wait complete. 2023-12-16T03:28:43.684 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c2130f640 1 Processor -- start 2023-12-16T03:28:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c2130f640 1 -- start start 2023-12-16T03:28:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c2130f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4c1c06b270 0x7f4c1c155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c2130f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c1c0c8540 0x7f4c1c151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c2130f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0c56d0 con 0x7f4c1c0c6310 2023-12-16T03:28:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c2130f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0c9d30 con 0x7f4c1c06b270 2023-12-16T03:28:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c2130f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0c4da0 con 0x7f4c1c0c8540 2023-12-16T03:28:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c1affd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4c1c06b270 0x7f4c1c155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c1affd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4c1c06b270 0x7f4c1c155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34582/0 (socket says 172.21.15.28:34582) 2023-12-16T03:28:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c1affd640 1 -- 172.21.15.28:0/4044135481 learned_addr learned my addr 172.21.15.28:0/4044135481 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c1affd640 1 -- 172.21.15.28:0/4044135481 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c1c0c8540 msgr2=0x7f4c1c151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c1affd640 1 --2- 172.21.15.28:0/4044135481 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c1c0c8540 0x7f4c1c151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c1affd640 1 -- 172.21.15.28:0/4044135481 >> v1:172.21.15.134:6789/0 conn(0x7f4c1c0c6310 legacy=0x7f4c1c0c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.826+0000 7f4c1affd640 1 -- 172.21.15.28:0/4044135481 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0c5080 con 0x7f4c1c06b270 2023-12-16T03:28:43.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c1affd640 1 --2- 172.21.15.28:0/4044135481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c1c06b270 0x7f4c1c155240 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009870 tx=0x7f4c0c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43f0d457e07c061 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:43.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c19ffb640 1 -- 172.21.15.28:0/4044135481 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0ab600 con 0x7f4c1c06b270 2023-12-16T03:28:43.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c19ffb640 1 -- 172.21.15.28:0/4044135481 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c0a7050 con 0x7f4c1c06b270 2023-12-16T03:28:43.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c19ffb640 1 -- 172.21.15.28:0/4044135481 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0ab980 con 0x7f4c1c06b270 2023-12-16T03:28:43.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c2130f640 1 -- 172.21.15.28:0/4044135481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c1c06b270 msgr2=0x7f4c1c155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:43.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c2130f640 1 --2- 172.21.15.28:0/4044135481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c1c06b270 0x7f4c1c155240 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009870 tx=0x7f4c0c01c470 comp rx=0 tx=0).stop 2023-12-16T03:28:43.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c2130f640 1 -- 172.21.15.28:0/4044135481 shutdown_connections 2023-12-16T03:28:43.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c2130f640 1 --2- 172.21.15.28:0/4044135481 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c1c0c8540 0x7f4c1c151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:43.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c2130f640 1 --2- 172.21.15.28:0/4044135481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c1c06b270 0x7f4c1c155240 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:43.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c2130f640 1 -- 172.21.15.28:0/4044135481 >> 172.21.15.28:0/4044135481 conn(0x7f4c1c0ca100 msgr2=0x7f4c1c0ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:43.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c2130f640 1 -- 172.21.15.28:0/4044135481 shutdown_connections 2023-12-16T03:28:43.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.830+0000 7f4c2130f640 1 -- 172.21.15.28:0/4044135481 wait complete. 2023-12-16T03:28:43.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c2130f640 1 Processor -- start 2023-12-16T03:28:43.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c2130f640 1 -- start start 2023-12-16T03:28:43.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c2130f640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c1c06b270 0x7f4c1c156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:43.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c2130f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c1c0c6310 0x7f4c1c1edc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:43.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c2130f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c1c0c8540 0x7f4c1c1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:43.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c2130f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c157db0 con 0x7f4c1c0c6310 2023-12-16T03:28:43.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c2130f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0adf40 con 0x7f4c1c0c8540 2023-12-16T03:28:43.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c2130f640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0ad6e0 con 0x7f4c1c06b270 2023-12-16T03:28:43.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1a7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c1c0c6310 0x7f4c1c1edc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:43.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1a7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c1c0c6310 0x7f4c1c1edc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34592/0 (socket says 172.21.15.28:34592) 2023-12-16T03:28:43.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1a7fc640 1 -- 172.21.15.28:0/1310308704 learned_addr learned my addr 172.21.15.28:0/1310308704 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1affd640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c1c06b270 0x7f4c1c156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1b7fe640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c1c0c8540 0x7f4c1c1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1a7fc640 1 -- 172.21.15.28:0/1310308704 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c1c06b270 msgr2=0x7f4c1c156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1a7fc640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c1c06b270 0x7f4c1c156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1a7fc640 1 -- 172.21.15.28:0/1310308704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c1c0c8540 msgr2=0x7f4c1c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1a7fc640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c1c0c8540 0x7f4c1c1581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1a7fc640 1 -- 172.21.15.28:0/1310308704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c0094d0 con 0x7f4c1c0c6310 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1b7fe640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c1c0c8540 0x7f4c1c1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c1a7fc640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c1c0c6310 0x7f4c1c1edc50 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000c490 tx=0x7f4c10001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c037fe640 1 -- 172.21.15.28:0/1310308704 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10003600 con 0x7f4c1c0c6310 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c037fe640 1 -- 172.21.15.28:0/1310308704 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c10003780 con 0x7f4c1c0c6310 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c037fe640 1 -- 172.21.15.28:0/1310308704 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10003b70 con 0x7f4c1c0c6310 2023-12-16T03:28:43.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c2130f640 1 -- 172.21.15.28:0/1310308704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c1ed470 con 0x7f4c1c0c6310 2023-12-16T03:28:43.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.834+0000 7f4c2130f640 1 -- 172.21.15.28:0/1310308704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c0ad980 con 0x7f4c1c0c6310 2023-12-16T03:28:43.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.838+0000 7f4c2130f640 1 -- 172.21.15.28:0/1310308704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c04e850 con 0x7f4c1c0c6310 2023-12-16T03:28:43.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.838+0000 7f4c037fe640 1 -- 172.21.15.28:0/1310308704 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4c10003cd0 con 0x7f4c1c0c6310 2023-12-16T03:28:43.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.838+0000 7f4c037fe640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c08066470 0x7f4c08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:43.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.838+0000 7f4c037fe640 1 -- 172.21.15.28:0/1310308704 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f4c10083080 con 0x7f4c1c0c6310 2023-12-16T03:28:43.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.838+0000 7f4c1affd640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c08066470 0x7f4c08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:43.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.838+0000 7f4c1affd640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c08066470 0x7f4c08068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0ad000 tx=0x7f4c0c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:43.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:43.842+0000 7f4c037fe640 1 -- 172.21.15.28:0/1310308704 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4c100b4290 con 0x7f4c1c0c6310 2023-12-16T03:28:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 -- 172.21.15.28:0/1310308704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c1c067a00 con 0x7f4c1c0c6310 2023-12-16T03:28:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c037fe640 1 -- 172.21.15.28:0/1310308704 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f4c100504c0 con 0x7f4c1c0c6310 2023-12-16T03:28:44.006 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:44.007 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":75,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:43.647997+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6836/2582425067":"2023-12-17T03:28:40.636985+0000","172.21.15.28:6834/2582425067":"2023-12-17T03:28:40.636985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:44.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 -- 172.21.15.28:0/1310308704 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c08066470 msgr2=0x7f4c08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c08066470 0x7f4c08068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0ad000 tx=0x7f4c0c0a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:44.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 -- 172.21.15.28:0/1310308704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c1c0c6310 msgr2=0x7f4c1c1edc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c1c0c6310 0x7f4c1c1edc50 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000c490 tx=0x7f4c10001e80 comp rx=0 tx=0).stop 2023-12-16T03:28:44.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 -- 172.21.15.28:0/1310308704 shutdown_connections 2023-12-16T03:28:44.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c1c0c8540 0x7f4c1c1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c08066470 0x7f4c08068930 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c1c0c6310 0x7f4c1c1edc50 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 --2- 172.21.15.28:0/1310308704 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c1c06b270 0x7f4c1c156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 -- 172.21.15.28:0/1310308704 >> 172.21.15.28:0/1310308704 conn(0x7f4c1c0ca100 msgr2=0x7f4c1c0aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:44.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 -- 172.21.15.28:0/1310308704 shutdown_connections 2023-12-16T03:28:44.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.002+0000 7f4c2130f640 1 -- 172.21.15.28:0/1310308704 wait complete. 2023-12-16T03:28:44.028 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-16T03:25:03.856962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-16T03:28:10.280019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-16T03:28:11.167317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-16T03:28:44.029 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-16T03:28:44.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.186+0000 7f36fba9a640 1 Processor -- start 2023-12-16T03:28:44.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.186+0000 7f36fba9a640 1 -- start start 2023-12-16T03:28:44.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.186+0000 7f36fba9a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f36f4155de0 0x7f36f4156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36fba9a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f40c2580 con 0x7f36f40c5640 2023-12-16T03:28:44.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36fba9a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f40c1a00 con 0x7f36f40c5260 2023-12-16T03:28:44.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36fba9a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f4153510 con 0x7f36f4155de0 2023-12-16T03:28:44.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f9035640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f36f40c5640 0x7f36f40c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39932/0 (socket says 172.21.15.28:39932) 2023-12-16T03:28:44.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f9035640 1 -- 172.21.15.28:0/3188726245 learned_addr learned my addr 172.21.15.28:0/3188726245 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36fa037640 1 --2- 172.21.15.28:0/3188726245 >> v2:172.21.15.134:3300/0 conn(0x7f36f4155de0 0x7f36f4156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789639394 0 0) 0x7f36f40c2580 con 0x7f36f40c5640 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36e0003530 con 0x7f36f40c5640 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 900353929 0 0) 0x7f36e0003530 con 0x7f36f40c5640 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 >> v2:172.21.15.134:3300/0 conn(0x7f36f4155de0 msgr2=0x7f36f4156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 --2- 172.21.15.28:0/3188726245 >> v2:172.21.15.134:3300/0 conn(0x7f36f4155de0 0x7f36f4156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 >> v1:172.21.15.134:6789/0 conn(0x7f36f40c5260 legacy=0x7f36f406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40c1ce0 con 0x7f36f40c5640 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f36e4001680 con 0x7f36f40c5640 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 >> v1:172.21.15.28:6789/0 conn(0x7f36f40c5640 legacy=0x7f36f40c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e0003980 0x7f36e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e00047d0 0x7f36e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 0x7f36e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e000c100 con 0x7f36e0005190 2023-12-16T03:28:44.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e000c270 con 0x7f36e00047d0 2023-12-16T03:28:44.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e000c430 con 0x7f36e0003980 2023-12-16T03:28:44.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36fa037640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 0x7f36e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f9035640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e00047d0 0x7f36e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f9836640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e0003980 0x7f36e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36fa037640 1 -- 172.21.15.28:0/3188726245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e0003980 msgr2=0x7f36e0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:44.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36fa037640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36e0003980 0x7f36e0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36fa037640 1 -- 172.21.15.28:0/3188726245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e00047d0 msgr2=0x7f36e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:44.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36fa037640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e00047d0 0x7f36e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36fa037640 1 -- 172.21.15.28:0/3188726245 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e0003530 con 0x7f36e0005190 2023-12-16T03:28:44.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.190+0000 7f36f9035640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36e00047d0 0x7f36e0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:44.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36fa037640 1 -- 172.21.15.28:0/3188726245 reap_dead start 2023-12-16T03:28:44.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36fa037640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 0x7f36e000b990 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009fc0 tx=0x7f36ec01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5dd7e11498ce1d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:44.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec003ba0 con 0x7f36e0005190 2023-12-16T03:28:44.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec00f040 con 0x7f36e0005190 2023-12-16T03:28:44.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36f8834640 1 -- 172.21.15.28:0/3188726245 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0a59a0 con 0x7f36e0005190 2023-12-16T03:28:44.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36fba9a640 1 -- 172.21.15.28:0/3188726245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 msgr2=0x7f36e000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36fba9a640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 0x7f36e000b990 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009fc0 tx=0x7f36ec01cca0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36fba9a640 1 -- 172.21.15.28:0/3188726245 shutdown_connections 2023-12-16T03:28:44.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36fba9a640 1 --2- 172.21.15.28:0/3188726245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 0x7f36e000b990 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36fba9a640 1 -- 172.21.15.28:0/3188726245 >> 172.21.15.28:0/3188726245 conn(0x7f36f406a5b0 msgr2=0x7f36f406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:44.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36fba9a640 1 -- 172.21.15.28:0/3188726245 shutdown_connections 2023-12-16T03:28:44.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36fba9a640 1 -- 172.21.15.28:0/3188726245 wait complete. 2023-12-16T03:28:44.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36fba9a640 1 Processor -- start 2023-12-16T03:28:44.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.194+0000 7f36fba9a640 1 -- start start 2023-12-16T03:28:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36fba9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 0x7f36f41506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36fba9a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36f41dd6b0 0x7f36f4071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36fba9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f40a8bc0 0x7f36f40a9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36fba9a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f41dee40 con 0x7f36e0005190 2023-12-16T03:28:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36fba9a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f41de9b0 con 0x7f36f40a8bc0 2023-12-16T03:28:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36fba9a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f41ddb10 con 0x7f36f41dd6b0 2023-12-16T03:28:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36f9836640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 0x7f36f41506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36f9836640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 0x7f36f41506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34608/0 (socket says 172.21.15.28:34608) 2023-12-16T03:28:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36f9836640 1 -- 172.21.15.28:0/453873962 learned_addr learned my addr 172.21.15.28:0/453873962 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36f9035640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36f41dd6b0 0x7f36f4071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36fa037640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f40a8bc0 0x7f36f40a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36f9836640 1 -- 172.21.15.28:0/453873962 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36f41dd6b0 msgr2=0x7f36f4071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36f9836640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36f41dd6b0 0x7f36f4071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36f9836640 1 -- 172.21.15.28:0/453873962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f40a8bc0 msgr2=0x7f36f40a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36f9836640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f40a8bc0 0x7f36f40a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36f9836640 1 -- 172.21.15.28:0/453873962 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f41dddb0 con 0x7f36e0005190 2023-12-16T03:28:44.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36f9836640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 0x7f36f41506c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f36f000e440 tx=0x7f36f000e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:44.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36ea7fc640 1 -- 172.21.15.28:0/453873962 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f00052e0 con 0x7f36e0005190 2023-12-16T03:28:44.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36ea7fc640 1 -- 172.21.15.28:0/453873962 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f0005440 con 0x7f36e0005190 2023-12-16T03:28:44.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36ea7fc640 1 -- 172.21.15.28:0/453873962 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0003820 con 0x7f36e0005190 2023-12-16T03:28:44.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36fba9a640 1 -- 172.21.15.28:0/453873962 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f41de360 con 0x7f36e0005190 2023-12-16T03:28:44.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36fba9a640 1 -- 172.21.15.28:0/453873962 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f406dfd0 con 0x7f36e0005190 2023-12-16T03:28:44.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36fba9a640 1 -- 172.21.15.28:0/453873962 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f41de1c0 con 0x7f36e0005190 2023-12-16T03:28:44.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.198+0000 7f36ea7fc640 1 -- 172.21.15.28:0/453873962 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f36f0003980 con 0x7f36e0005190 2023-12-16T03:28:44.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.202+0000 7f36ea7fc640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36d80664a0 0x7f36d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.202+0000 7f36ea7fc640 1 -- 172.21.15.28:0/453873962 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f36f0083a40 con 0x7f36e0005190 2023-12-16T03:28:44.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.202+0000 7f36f9035640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36d80664a0 0x7f36d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.202+0000 7f36f9035640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36d80664a0 0x7f36d8068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f36f40c03e0 tx=0x7f36e4001cb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:44.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.206+0000 7f36ea7fc640 1 -- 172.21.15.28:0/453873962 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f36f41de1c0 con 0x7f36e0005190 2023-12-16T03:28:44.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.366+0000 7f36fba9a640 1 -- 172.21.15.28:0/453873962 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36f41de1c0 con 0x7f36e0005190 2023-12-16T03:28:44.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.366+0000 7f36ea7fc640 1 -- 172.21.15.28:0/453873962 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36f41de1c0 con 0x7f36e0005190 2023-12-16T03:28:44.371 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-12-16T03:28:44.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 -- 172.21.15.28:0/453873962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36d80664a0 msgr2=0x7f36d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36d80664a0 0x7f36d8068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f36f40c03e0 tx=0x7f36e4001cb0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 -- 172.21.15.28:0/453873962 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 msgr2=0x7f36f41506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 0x7f36f41506c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f36f000e440 tx=0x7f36f000e900 comp rx=0 tx=0).stop 2023-12-16T03:28:44.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 -- 172.21.15.28:0/453873962 shutdown_connections 2023-12-16T03:28:44.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f40a8bc0 0x7f36f40a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36f41dd6b0 0x7f36f4071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.373 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36d80664a0 0x7f36d8068960 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 --2- 172.21.15.28:0/453873962 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f36e0005190 0x7f36f41506c0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 -- 172.21.15.28:0/453873962 >> 172.21.15.28:0/453873962 conn(0x7f36f406a5b0 msgr2=0x7f36f40a80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:44.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 -- 172.21.15.28:0/453873962 shutdown_connections 2023-12-16T03:28:44.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.370+0000 7f36fba9a640 1 -- 172.21.15.28:0/453873962 wait complete. 2023-12-16T03:28:44.392 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-16T03:28:44.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.534+0000 7fc9e34bb640 1 Processor -- start 2023-12-16T03:28:44.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.534+0000 7fc9e34bb640 1 -- start start 2023-12-16T03:28:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.534+0000 7fc9e34bb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc9dc0a5370 0x7fc9dc0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.534+0000 7fc9e34bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9dc0c4110 0x7fc9dc150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.534+0000 7fc9e34bb640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9dc0c2760 con 0x7fc9dc072090 2023-12-16T03:28:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.534+0000 7fc9e34bb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9dc0c3070 con 0x7fc9dc0a5370 2023-12-16T03:28:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.534+0000 7fc9e34bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc151bf0 con 0x7fc9dc0c4110 2023-12-16T03:28:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.534+0000 7fc9e1257640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc9dc0a5370 0x7fc9dc0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.534+0000 7fc9e1257640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc9dc0a5370 0x7fc9dc0c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34618/0 (socket says 172.21.15.28:34618) 2023-12-16T03:28:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.534+0000 7fc9e1257640 1 -- 172.21.15.28:0/1268687338 learned_addr learned my addr 172.21.15.28:0/1268687338 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.534+0000 7fc9e0a56640 1 --2- 172.21.15.28:0/1268687338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9dc0c4110 0x7fc9dc150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9e1257640 1 -- 172.21.15.28:0/1268687338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9dc0c4110 msgr2=0x7fc9dc150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9e1257640 1 --2- 172.21.15.28:0/1268687338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9dc0c4110 0x7fc9dc150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9e1257640 1 -- 172.21.15.28:0/1268687338 >> v1:172.21.15.134:6789/0 conn(0x7fc9dc072090 legacy=0x7fc9dc1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9e1257640 1 -- 172.21.15.28:0/1268687338 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0a5750 con 0x7fc9dc0a5370 2023-12-16T03:28:44.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9e1257640 1 --2- 172.21.15.28:0/1268687338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9dc0a5370 0x7fc9dc0c3bd0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800bb40 tx=0x7fc9d801eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993175d19798abbd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:44.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9d3fff640 1 -- 172.21.15.28:0/1268687338 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80a7af0 con 0x7fc9dc0a5370 2023-12-16T03:28:44.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9d3fff640 1 -- 172.21.15.28:0/1268687338 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d80a7c50 con 0x7fc9dc0a5370 2023-12-16T03:28:44.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9d3fff640 1 -- 172.21.15.28:0/1268687338 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80af440 con 0x7fc9dc0a5370 2023-12-16T03:28:44.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9e34bb640 1 -- 172.21.15.28:0/1268687338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9dc0a5370 msgr2=0x7fc9dc0c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9e34bb640 1 --2- 172.21.15.28:0/1268687338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9dc0a5370 0x7fc9dc0c3bd0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800bb40 tx=0x7fc9d801eaa0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9e34bb640 1 -- 172.21.15.28:0/1268687338 shutdown_connections 2023-12-16T03:28:44.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9e34bb640 1 --2- 172.21.15.28:0/1268687338 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9dc0c4110 0x7fc9dc150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9e34bb640 1 --2- 172.21.15.28:0/1268687338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9dc0a5370 0x7fc9dc0c3bd0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.538+0000 7fc9e34bb640 1 -- 172.21.15.28:0/1268687338 >> 172.21.15.28:0/1268687338 conn(0x7fc9dc06a5b0 msgr2=0x7fc9dc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:44.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e34bb640 1 -- 172.21.15.28:0/1268687338 shutdown_connections 2023-12-16T03:28:44.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e34bb640 1 -- 172.21.15.28:0/1268687338 wait complete. 2023-12-16T03:28:44.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e34bb640 1 Processor -- start 2023-12-16T03:28:44.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e34bb640 1 -- start start 2023-12-16T03:28:44.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e34bb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9dc072090 0x7fc9dc1ecb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e34bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9dc0a5370 0x7fc9dc1e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e34bb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9dc0c4110 0x7fc9dc1494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e34bb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0a7f80 con 0x7fc9dc072090 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e34bb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc1ed080 con 0x7fc9dc0c4110 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e34bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0a7ca0 con 0x7fc9dc0a5370 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e1257640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9dc072090 0x7fc9dc1ecb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e1257640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9dc072090 0x7fc9dc1ecb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34630/0 (socket says 172.21.15.28:34630) 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e1257640 1 -- 172.21.15.28:0/463372243 learned_addr learned my addr 172.21.15.28:0/463372243 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e1a58640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9dc0c4110 0x7fc9dc1494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e0a56640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9dc0a5370 0x7fc9dc1e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e1257640 1 -- 172.21.15.28:0/463372243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9dc0a5370 msgr2=0x7fc9dc1e8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e1257640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9dc0a5370 0x7fc9dc1e8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e1257640 1 -- 172.21.15.28:0/463372243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9dc0c4110 msgr2=0x7fc9dc1494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e1257640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9dc0c4110 0x7fc9dc1494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e1257640 1 -- 172.21.15.28:0/463372243 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d800b770 con 0x7fc9dc072090 2023-12-16T03:28:44.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e0a56640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9dc0a5370 0x7fc9dc1e8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:44.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e1257640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9dc072090 0x7fc9dc1ecb40 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc9d801c6d0 tx=0x7fc9d801b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:44.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9d1ffb640 1 -- 172.21.15.28:0/463372243 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8006ee0 con 0x7fc9dc072090 2023-12-16T03:28:44.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9d1ffb640 1 -- 172.21.15.28:0/463372243 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d80afe50 con 0x7fc9dc072090 2023-12-16T03:28:44.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9e34bb640 1 -- 172.21.15.28:0/463372243 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc0a5a70 con 0x7fc9dc072090 2023-12-16T03:28:44.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.542+0000 7fc9d1ffb640 1 -- 172.21.15.28:0/463372243 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80b8640 con 0x7fc9dc072090 2023-12-16T03:28:44.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.546+0000 7fc9e34bb640 1 -- 172.21.15.28:0/463372243 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc1ec620 con 0x7fc9dc072090 2023-12-16T03:28:44.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.546+0000 7fc9e34bb640 1 -- 172.21.15.28:0/463372243 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9dc1ec810 con 0x7fc9dc072090 2023-12-16T03:28:44.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.546+0000 7fc9d1ffb640 1 -- 172.21.15.28:0/463372243 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc9d80b6040 con 0x7fc9dc072090 2023-12-16T03:28:44.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.546+0000 7fc9d1ffb640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9c00664a0 0x7fc9c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.546+0000 7fc9d1ffb640 1 -- 172.21.15.28:0/463372243 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc9d8120d80 con 0x7fc9dc072090 2023-12-16T03:28:44.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.546+0000 7fc9e0a56640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9c00664a0 0x7fc9c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.550+0000 7fc9e0a56640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9c00664a0 0x7fc9c0068960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc14e6a0 tx=0x7fc9cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.550+0000 7fc9d1ffb640 1 -- 172.21.15.28:0/463372243 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc9d80ee2b0 con 0x7fc9dc072090 2023-12-16T03:28:44.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 -- 172.21.15.28:0/463372243 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9dc068400 con 0x7fc9dc072090 2023-12-16T03:28:44.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9d1ffb640 1 -- 172.21.15.28:0/463372243 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v75) v1 ==== 105+0+11 (secure 0 0 0) 0x7fc9d80bc0b0 con 0x7fc9dc072090 2023-12-16T03:28:44.714 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-12-16T03:28:44.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 -- 172.21.15.28:0/463372243 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9c00664a0 msgr2=0x7fc9c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9c00664a0 0x7fc9c0068960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc14e6a0 tx=0x7fc9cc008040 comp rx=0 tx=0).stop 2023-12-16T03:28:44.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 -- 172.21.15.28:0/463372243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9dc072090 msgr2=0x7fc9dc1ecb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9dc072090 0x7fc9dc1ecb40 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc9d801c6d0 tx=0x7fc9d801b840 comp rx=0 tx=0).stop 2023-12-16T03:28:44.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 -- 172.21.15.28:0/463372243 shutdown_connections 2023-12-16T03:28:44.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9dc0c4110 0x7fc9dc1494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9dc0a5370 0x7fc9dc1e8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc9c00664a0 0x7fc9c0068960 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 --2- 172.21.15.28:0/463372243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9dc072090 0x7fc9dc1ecb40 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 -- 172.21.15.28:0/463372243 >> 172.21.15.28:0/463372243 conn(0x7fc9dc06a5b0 msgr2=0x7fc9dc150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:44.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 -- 172.21.15.28:0/463372243 shutdown_connections 2023-12-16T03:28:44.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.710+0000 7fc9e34bb640 1 -- 172.21.15.28:0/463372243 wait complete. 2023-12-16T03:28:44.736 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-16T03:28:44.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.878+0000 7f61f231d640 1 Processor -- start 2023-12-16T03:28:44.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.878+0000 7f61f231d640 1 -- start start 2023-12-16T03:28:44.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f231d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61ec06bbb0 0x7f61ec1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f231d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec06c860 con 0x7f61ec151e90 2023-12-16T03:28:44.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f231d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec06c000 con 0x7f61ec0c7ea0 2023-12-16T03:28:44.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f231d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec0c8750 con 0x7f61ec06bbb0 2023-12-16T03:28:44.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61ebfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f61ec151e90 0x7f61ec0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39938/0 (socket says 172.21.15.28:39938) 2023-12-16T03:28:44.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61ebfff640 1 -- 172.21.15.28:0/4144747050 learned_addr learned my addr 172.21.15.28:0/4144747050 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:44.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f08ba640 1 --2- 172.21.15.28:0/4144747050 >> v2:172.21.15.134:3300/0 conn(0x7f61ec06bbb0 0x7f61ec1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415868030 0 0) 0x7f61ec06c860 con 0x7f61ec151e90 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d4003530 con 0x7f61ec151e90 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362004185 0 0) 0x7f61ec06c000 con 0x7f61ec0c7ea0 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61ec06c860 con 0x7f61ec0c7ea0 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 394529927 0 0) 0x7f61d4003530 con 0x7f61ec151e90 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 >> v2:172.21.15.134:3300/0 conn(0x7f61ec06bbb0 msgr2=0x7f61ec1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 --2- 172.21.15.28:0/4144747050 >> v2:172.21.15.134:3300/0 conn(0x7f61ec06bbb0 0x7f61ec1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 >> v1:172.21.15.134:6789/0 conn(0x7f61ec0c7ea0 legacy=0x7f61ec06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec154930 con 0x7f61ec151e90 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f61dc001680 con 0x7f61ec151e90 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f08ba640 1 --2- 172.21.15.28:0/4144747050 >> v2:172.21.15.134:3300/0 conn(0x7f61ec06bbb0 0x7f61ec1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 >> v1:172.21.15.28:6789/0 conn(0x7f61ec151e90 legacy=0x7f61ec0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 --2- 172.21.15.28:0/4144747050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61d4003b10 0x7f61d4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 --2- 172.21.15.28:0/4144747050 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d40047d0 0x7f61d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 --2- 172.21.15.28:0/4144747050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61d4005200 0x7f61d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec0c8750 con 0x7f61d4005200 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d400c160 con 0x7f61d4003b10 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d400c320 con 0x7f61d40047d0 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f08ba640 1 --2- 172.21.15.28:0/4144747050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61d4005200 0x7f61d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61ebfff640 1 --2- 172.21.15.28:0/4144747050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61d4003b10 0x7f61d4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61eb7fe640 1 --2- 172.21.15.28:0/4144747050 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d40047d0 0x7f61d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f08ba640 1 -- 172.21.15.28:0/4144747050 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d40047d0 msgr2=0x7f61d4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f08ba640 1 --2- 172.21.15.28:0/4144747050 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d40047d0 0x7f61d4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f08ba640 1 -- 172.21.15.28:0/4144747050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61d4003b10 msgr2=0x7f61d4003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f08ba640 1 --2- 172.21.15.28:0/4144747050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61d4003b10 0x7f61d4003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.882+0000 7f61f08ba640 1 -- 172.21.15.28:0/4144747050 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4003530 con 0x7f61d4005200 2023-12-16T03:28:44.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61f08ba640 1 -- 172.21.15.28:0/4144747050 reap_dead start 2023-12-16T03:28:44.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61f08ba640 1 --2- 172.21.15.28:0/4144747050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61d4005200 0x7f61d400b990 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f61e400e350 tx=0x7f61e401ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1b5e240b1967c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:44.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e40a5c50 con 0x7f61d4005200 2023-12-16T03:28:44.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e400f040 con 0x7f61d4005200 2023-12-16T03:28:44.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61eaffd640 1 -- 172.21.15.28:0/4144747050 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e40039a0 con 0x7f61d4005200 2023-12-16T03:28:44.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61f231d640 1 -- 172.21.15.28:0/4144747050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61d4005200 msgr2=0x7f61d400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61f231d640 1 --2- 172.21.15.28:0/4144747050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61d4005200 0x7f61d400b990 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f61e400e350 tx=0x7f61e401ce60 comp rx=0 tx=0).stop 2023-12-16T03:28:44.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61f231d640 1 -- 172.21.15.28:0/4144747050 shutdown_connections 2023-12-16T03:28:44.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61f231d640 1 --2- 172.21.15.28:0/4144747050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61d4005200 0x7f61d400b990 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61f231d640 1 -- 172.21.15.28:0/4144747050 >> 172.21.15.28:0/4144747050 conn(0x7f61ec0ca170 msgr2=0x7f61ec0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:44.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61f231d640 1 -- 172.21.15.28:0/4144747050 shutdown_connections 2023-12-16T03:28:44.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61f231d640 1 -- 172.21.15.28:0/4144747050 wait complete. 2023-12-16T03:28:44.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.886+0000 7f61f231d640 1 Processor -- start 2023-12-16T03:28:44.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61f231d640 1 -- start start 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61f231d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d4005200 0x7f61ec13f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61f231d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61ec13f5e0 0x7f61ec1ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61f231d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61ec1ed510 0x7f61ec1ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61f231d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec1552d0 con 0x7f61ec13f5e0 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61f231d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec14f2b0 con 0x7f61ec1ed510 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61f231d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec1eded0 con 0x7f61d4005200 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61eb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61ec13f5e0 0x7f61ec1ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61eb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61ec13f5e0 0x7f61ec1ecfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34652/0 (socket says 172.21.15.28:34652) 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61eb7fe640 1 -- 172.21.15.28:0/235669590 learned_addr learned my addr 172.21.15.28:0/235669590 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61ebfff640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d4005200 0x7f61ec13f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61f08ba640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61ec1ed510 0x7f61ec1ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61eb7fe640 1 -- 172.21.15.28:0/235669590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d4005200 msgr2=0x7f61ec13f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61eb7fe640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d4005200 0x7f61ec13f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61eb7fe640 1 -- 172.21.15.28:0/235669590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61ec1ed510 msgr2=0x7f61ec1ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:44.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61eb7fe640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61ec1ed510 0x7f61ec1ed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:44.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61eb7fe640 1 -- 172.21.15.28:0/235669590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec13ec10 con 0x7f61ec13f5e0 2023-12-16T03:28:44.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61eb7fe640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61ec13f5e0 0x7f61ec1ecfd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f61e000f800 tx=0x7f61e000fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:44.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61e8ff9640 1 -- 172.21.15.28:0/235669590 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0005110 con 0x7f61ec13f5e0 2023-12-16T03:28:44.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61e8ff9640 1 -- 172.21.15.28:0/235669590 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e0005270 con 0x7f61ec13f5e0 2023-12-16T03:28:44.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61e8ff9640 1 -- 172.21.15.28:0/235669590 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e00067e0 con 0x7f61ec13f5e0 2023-12-16T03:28:44.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61f231d640 1 -- 172.21.15.28:0/235669590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ec1f12a0 con 0x7f61ec13f5e0 2023-12-16T03:28:44.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61f231d640 1 -- 172.21.15.28:0/235669590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ec1ee440 con 0x7f61ec13f5e0 2023-12-16T03:28:44.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.890+0000 7f61f231d640 1 -- 172.21.15.28:0/235669590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ec13eda0 con 0x7f61ec13f5e0 2023-12-16T03:28:44.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.894+0000 7f61e8ff9640 1 -- 172.21.15.28:0/235669590 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f61e0006940 con 0x7f61ec13f5e0 2023-12-16T03:28:44.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.894+0000 7f61e8ff9640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61d8066470 0x7f61d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:44.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.894+0000 7f61e8ff9640 1 -- 172.21.15.28:0/235669590 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f61e0083490 con 0x7f61ec13f5e0 2023-12-16T03:28:44.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.894+0000 7f61ebfff640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61d8066470 0x7f61d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:44.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.894+0000 7f61ebfff640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61d8066470 0x7f61d8068930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f61dc001ec0 tx=0x7f61dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:44.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:44.898+0000 7f61e8ff9640 1 -- 172.21.15.28:0/235669590 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f61e0050960 con 0x7f61ec13f5e0 2023-12-16T03:28:45.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 -- 172.21.15.28:0/235669590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f61ec0c8330 con 0x7f61ec13f5e0 2023-12-16T03:28:45.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61e8ff9640 1 -- 172.21.15.28:0/235669590 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v75) v1 ==== 101+0+11 (secure 0 0 0) 0x7f61e0053f80 con 0x7f61ec13f5e0 2023-12-16T03:28:45.058 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-12-16T03:28:45.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 -- 172.21.15.28:0/235669590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61d8066470 msgr2=0x7f61d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61d8066470 0x7f61d8068930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f61dc001ec0 tx=0x7f61dc009040 comp rx=0 tx=0).stop 2023-12-16T03:28:45.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 -- 172.21.15.28:0/235669590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61ec13f5e0 msgr2=0x7f61ec1ecfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61ec13f5e0 0x7f61ec1ecfd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f61e000f800 tx=0x7f61e000fcc0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 -- 172.21.15.28:0/235669590 shutdown_connections 2023-12-16T03:28:45.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61ec1ed510 0x7f61ec1ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f61d8066470 0x7f61d8068930 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61ec13f5e0 0x7f61ec1ecfd0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 --2- 172.21.15.28:0/235669590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61d4005200 0x7f61ec13f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 -- 172.21.15.28:0/235669590 >> 172.21.15.28:0/235669590 conn(0x7f61ec0ca170 msgr2=0x7f61ec143120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:45.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 -- 172.21.15.28:0/235669590 shutdown_connections 2023-12-16T03:28:45.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.054+0000 7f61f231d640 1 -- 172.21.15.28:0/235669590 wait complete. 2023-12-16T03:28:45.080 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:28:45.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.218+0000 7f9fd3d57640 1 Processor -- start 2023-12-16T03:28:45.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.218+0000 7f9fd3d57640 1 -- start start 2023-12-16T03:28:45.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.218+0000 7f9fd3d57640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9fcc06d520 0x7f9fcc15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.218+0000 7f9fd3d57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc0bffc0 0x7f9fcc0c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.218+0000 7f9fd3d57640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc15c600 con 0x7f9fcc1560e0 2023-12-16T03:28:45.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.218+0000 7f9fd3d57640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fcc15a5c0 con 0x7f9fcc06d520 2023-12-16T03:28:45.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.218+0000 7f9fd3d57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc1594e0 con 0x7f9fcc0bffc0 2023-12-16T03:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.218+0000 7f9fd12f2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9fcc06d520 0x7f9fcc15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.218+0000 7f9fd22f4640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc0bffc0 0x7f9fcc0c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.218+0000 7f9fd12f2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9fcc06d520 0x7f9fcc15ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:43070/0 (socket says 172.21.15.28:43070) 2023-12-16T03:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.218+0000 7f9fd12f2640 1 -- 172.21.15.28:0/2544045362 learned_addr learned my addr 172.21.15.28:0/2544045362 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd0af1640 1 -- 172.21.15.28:0/2544045362 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812986054 0 0) 0x7f9fcc15c600 con 0x7f9fcc1560e0 2023-12-16T03:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd0af1640 1 -- 172.21.15.28:0/2544045362 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb8003530 con 0x7f9fcc1560e0 2023-12-16T03:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd12f2640 1 -- 172.21.15.28:0/2544045362 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc0bffc0 msgr2=0x7f9fcc0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd12f2640 1 --2- 172.21.15.28:0/2544045362 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc0bffc0 0x7f9fcc0c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd12f2640 1 -- 172.21.15.28:0/2544045362 >> v1:172.21.15.134:6789/0 conn(0x7f9fcc1560e0 legacy=0x7f9fcc159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd12f2640 1 -- 172.21.15.28:0/2544045362 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc1597c0 con 0x7f9fcc06d520 2023-12-16T03:28:45.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd12f2640 1 --2- 172.21.15.28:0/2544045362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc06d520 0x7f9fcc15ca90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009870 tx=0x7f9fbc01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d872b995465ab1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:45.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd0af1640 1 -- 172.21.15.28:0/2544045362 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0ab620 con 0x7f9fcc06d520 2023-12-16T03:28:45.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd0af1640 1 -- 172.21.15.28:0/2544045362 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc0ab780 con 0x7f9fcc06d520 2023-12-16T03:28:45.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd0af1640 1 -- 172.21.15.28:0/2544045362 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0abb10 con 0x7f9fcc06d520 2023-12-16T03:28:45.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd3d57640 1 -- 172.21.15.28:0/2544045362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc06d520 msgr2=0x7f9fcc15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.222+0000 7f9fd3d57640 1 --2- 172.21.15.28:0/2544045362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc06d520 0x7f9fcc15ca90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009870 tx=0x7f9fbc01c510 comp rx=0 tx=0).stop 2023-12-16T03:28:45.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 -- 172.21.15.28:0/2544045362 shutdown_connections 2023-12-16T03:28:45.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 --2- 172.21.15.28:0/2544045362 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc0bffc0 0x7f9fcc0c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 --2- 172.21.15.28:0/2544045362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc06d520 0x7f9fcc15ca90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 -- 172.21.15.28:0/2544045362 >> 172.21.15.28:0/2544045362 conn(0x7f9fcc06a5b0 msgr2=0x7f9fcc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:45.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 -- 172.21.15.28:0/2544045362 shutdown_connections 2023-12-16T03:28:45.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 -- 172.21.15.28:0/2544045362 wait complete. 2023-12-16T03:28:45.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 Processor -- start 2023-12-16T03:28:45.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 -- start start 2023-12-16T03:28:45.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06d520 0x7f9fcc0c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0bffc0 0x7f9fcc1f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fcc1560e0 0x7f9fcc1f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0a44b0 con 0x7f9fcc1560e0 2023-12-16T03:28:45.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0c5fe0 con 0x7f9fcc0bffc0 2023-12-16T03:28:45.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd3d57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0c5a20 con 0x7f9fcc06d520 2023-12-16T03:28:45.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd22f4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fcc1560e0 0x7f9fcc1f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd22f4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fcc1560e0 0x7f9fcc1f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34656/0 (socket says 172.21.15.28:34656) 2023-12-16T03:28:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd22f4640 1 -- 172.21.15.28:0/4078410772 learned_addr learned my addr 172.21.15.28:0/4078410772 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd1af3640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06d520 0x7f9fcc0c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd12f2640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0bffc0 0x7f9fcc1f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd22f4640 1 -- 172.21.15.28:0/4078410772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06d520 msgr2=0x7f9fcc0c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd22f4640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06d520 0x7f9fcc0c51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd22f4640 1 -- 172.21.15.28:0/4078410772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0bffc0 msgr2=0x7f9fcc1f1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd22f4640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0bffc0 0x7f9fcc1f1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd22f4640 1 -- 172.21.15.28:0/4078410772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc0094d0 con 0x7f9fcc1560e0 2023-12-16T03:28:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.226+0000 7f9fd22f4640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fcc1560e0 0x7f9fcc1f1f40 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400efc0 tx=0x7f9fc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:45.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.230+0000 7f9fc27fc640 1 -- 172.21.15.28:0/4078410772 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4014480 con 0x7f9fcc1560e0 2023-12-16T03:28:45.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.230+0000 7f9fc27fc640 1 -- 172.21.15.28:0/4078410772 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc400f040 con 0x7f9fcc1560e0 2023-12-16T03:28:45.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.230+0000 7f9fc27fc640 1 -- 172.21.15.28:0/4078410772 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4014820 con 0x7f9fcc1560e0 2023-12-16T03:28:45.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.230+0000 7f9fd3d57640 1 -- 172.21.15.28:0/4078410772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc0c5d00 con 0x7f9fcc1560e0 2023-12-16T03:28:45.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.230+0000 7f9fd3d57640 1 -- 172.21.15.28:0/4078410772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc0a2b40 con 0x7f9fcc1560e0 2023-12-16T03:28:45.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.230+0000 7f9fd3d57640 1 -- 172.21.15.28:0/4078410772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fcc068400 con 0x7f9fcc1560e0 2023-12-16T03:28:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.230+0000 7f9fc27fc640 1 -- 172.21.15.28:0/4078410772 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9fc4014980 con 0x7f9fcc1560e0 2023-12-16T03:28:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.230+0000 7f9fc27fc640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9fb0066470 0x7f9fb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.230+0000 7f9fc27fc640 1 -- 172.21.15.28:0/4078410772 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9fc40848f0 con 0x7f9fcc1560e0 2023-12-16T03:28:45.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.230+0000 7f9fd1af3640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9fb0066470 0x7f9fb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.230+0000 7f9fd1af3640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9fb0066470 0x7f9fb0068930 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80011f0 tx=0x7f9fc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:45.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.234+0000 7f9fc27fc640 1 -- 172.21.15.28:0/4078410772 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9fc4051db0 con 0x7f9fcc1560e0 2023-12-16T03:28:45.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.426+0000 7f9fd3d57640 1 -- 172.21.15.28:0/4078410772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fcc0bfd40 con 0x7f9fcc1560e0 2023-12-16T03:28:45.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.426+0000 7f9fc27fc640 1 -- 172.21.15.28:0/4078410772 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f9fc4018090 con 0x7f9fcc1560e0 2023-12-16T03:28:45.432 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:45.432 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/651767003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":651767003},{"type":"v1","addr":"172.21.15.28:6837","nonce":651767003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4202659808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4202659808},{"type":"v1","addr":"172.21.15.134:6834","nonce":4202659808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7110,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/3025399368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3025399368},{"type":"v1","addr":"172.21.15.28:6836","nonce":3025399368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:28:12.170094+0000","modified":"2023-12-16T03:28:15.197722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5729":{"gid":5729,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6835/931138884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":931138884},{"type":"v1","addr":"172.21.15.134:6835","nonce":931138884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-16T03:28:45.432 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 53 2023-12-16T03:28:45.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 -- 172.21.15.28:0/4078410772 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9fb0066470 msgr2=0x7f9fb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9fb0066470 0x7f9fb0068930 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80011f0 tx=0x7f9fc8009040 comp rx=0 tx=0).stop 2023-12-16T03:28:45.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 -- 172.21.15.28:0/4078410772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fcc1560e0 msgr2=0x7f9fcc1f1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fcc1560e0 0x7f9fcc1f1f40 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400efc0 tx=0x7f9fc400c490 comp rx=0 tx=0).stop 2023-12-16T03:28:45.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 -- 172.21.15.28:0/4078410772 shutdown_connections 2023-12-16T03:28:45.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9fb0066470 0x7f9fb0068930 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fcc1560e0 0x7f9fcc1f1f40 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc0bffc0 0x7f9fcc1f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 --2- 172.21.15.28:0/4078410772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06d520 0x7f9fcc0c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 -- 172.21.15.28:0/4078410772 >> 172.21.15.28:0/4078410772 conn(0x7f9fcc06a5b0 msgr2=0x7f9fcc0a5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:45.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 -- 172.21.15.28:0/4078410772 shutdown_connections 2023-12-16T03:28:45.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.430+0000 7f9fd3d57640 1 -- 172.21.15.28:0/4078410772 wait complete. 2023-12-16T03:28:45.453 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:45.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde5046b640 1 Processor -- start 2023-12-16T03:28:45.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde5046b640 1 -- start start 2023-12-16T03:28:45.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde5046b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde480c7ea0 0x7fde4806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde5046b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde4806b9e0 0x7fde4815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde5046b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4806c860 con 0x7fde48151e90 2023-12-16T03:28:45.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde5046b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde480c8750 con 0x7fde4806b9e0 2023-12-16T03:28:45.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde5046b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde481552d0 con 0x7fde480c7ea0 2023-12-16T03:28:45.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde4ea08640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde4806b9e0 0x7fde4815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde4ea08640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde4806b9e0 0x7fde4815f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34668/0 (socket says 172.21.15.28:34668) 2023-12-16T03:28:45.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde4ea08640 1 -- 172.21.15.28:0/3231047317 learned_addr learned my addr 172.21.15.28:0/3231047317 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:45.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde4da06640 1 --2- 172.21.15.28:0/3231047317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde480c7ea0 0x7fde4806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde4ea08640 1 -- 172.21.15.28:0/3231047317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde480c7ea0 msgr2=0x7fde4806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:45.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde4ea08640 1 --2- 172.21.15.28:0/3231047317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde480c7ea0 0x7fde4806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde4ea08640 1 -- 172.21.15.28:0/3231047317 >> v1:172.21.15.134:6789/0 conn(0x7fde48151e90 legacy=0x7fde480c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.594+0000 7fde4ea08640 1 -- 172.21.15.28:0/3231047317 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48154930 con 0x7fde4806b9e0 2023-12-16T03:28:45.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde4ea08640 1 --2- 172.21.15.28:0/3231047317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde4806b9e0 0x7fde4815f0a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fde40009e50 tx=0x7fde4001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c839318f28e7a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:45.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde4d205640 1 -- 172.21.15.28:0/3231047317 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400a55b0 con 0x7fde4806b9e0 2023-12-16T03:28:45.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde4d205640 1 -- 172.21.15.28:0/3231047317 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde400a5710 con 0x7fde4806b9e0 2023-12-16T03:28:45.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde4d205640 1 -- 172.21.15.28:0/3231047317 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400a5aa0 con 0x7fde4806b9e0 2023-12-16T03:28:45.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde5046b640 1 -- 172.21.15.28:0/3231047317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde4806b9e0 msgr2=0x7fde4815f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde5046b640 1 --2- 172.21.15.28:0/3231047317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde4806b9e0 0x7fde4815f0a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fde40009e50 tx=0x7fde4001c8f0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde5046b640 1 -- 172.21.15.28:0/3231047317 shutdown_connections 2023-12-16T03:28:45.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde5046b640 1 --2- 172.21.15.28:0/3231047317 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde480c7ea0 0x7fde4806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde5046b640 1 --2- 172.21.15.28:0/3231047317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde4806b9e0 0x7fde4815f0a0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde5046b640 1 -- 172.21.15.28:0/3231047317 >> 172.21.15.28:0/3231047317 conn(0x7fde480ca170 msgr2=0x7fde480ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:45.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde5046b640 1 -- 172.21.15.28:0/3231047317 shutdown_connections 2023-12-16T03:28:45.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.598+0000 7fde5046b640 1 -- 172.21.15.28:0/3231047317 wait complete. 2023-12-16T03:28:45.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde5046b640 1 Processor -- start 2023-12-16T03:28:45.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde5046b640 1 -- start start 2023-12-16T03:28:45.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde5046b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde4806b9e0 0x7fde4814ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde5046b640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde480c7ea0 0x7fde481ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde5046b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde48151e90 0x7fde480ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde5046b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4814d3b0 con 0x7fde48151e90 2023-12-16T03:28:45.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde5046b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4814c370 con 0x7fde4806b9e0 2023-12-16T03:28:45.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde5046b640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde480afc70 con 0x7fde480c7ea0 2023-12-16T03:28:45.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde4ea08640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde48151e90 0x7fde480ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde4ea08640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde48151e90 0x7fde480ab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34678/0 (socket says 172.21.15.28:34678) 2023-12-16T03:28:45.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde4e207640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde4806b9e0 0x7fde4814ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde4ea08640 1 -- 172.21.15.28:0/1026437088 learned_addr learned my addr 172.21.15.28:0/1026437088 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:45.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde4da06640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde480c7ea0 0x7fde481ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde4ea08640 1 -- 172.21.15.28:0/1026437088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde480c7ea0 msgr2=0x7fde481ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde4ea08640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde480c7ea0 0x7fde481ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde4ea08640 1 -- 172.21.15.28:0/1026437088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde4806b9e0 msgr2=0x7fde4814ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde4ea08640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde4806b9e0 0x7fde4814ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde4ea08640 1 -- 172.21.15.28:0/1026437088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40009b30 con 0x7fde48151e90 2023-12-16T03:28:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde4ea08640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde48151e90 0x7fde480ab750 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fde400af040 tx=0x7fde40019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde3effd640 1 -- 172.21.15.28:0/1026437088 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400b8670 con 0x7fde48151e90 2023-12-16T03:28:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde3effd640 1 -- 172.21.15.28:0/1026437088 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde400b87d0 con 0x7fde48151e90 2023-12-16T03:28:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde3effd640 1 -- 172.21.15.28:0/1026437088 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400b8b80 con 0x7fde48151e90 2023-12-16T03:28:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde5046b640 1 -- 172.21.15.28:0/1026437088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde480af3d0 con 0x7fde48151e90 2023-12-16T03:28:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde5046b640 1 -- 172.21.15.28:0/1026437088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde480af990 con 0x7fde48151e90 2023-12-16T03:28:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.602+0000 7fde5046b640 1 -- 172.21.15.28:0/1026437088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4814c140 con 0x7fde48151e90 2023-12-16T03:28:45.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.606+0000 7fde3effd640 1 -- 172.21.15.28:0/1026437088 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fde400b8ce0 con 0x7fde48151e90 2023-12-16T03:28:45.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.606+0000 7fde3effd640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde2c066470 0x7fde2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.606+0000 7fde3effd640 1 -- 172.21.15.28:0/1026437088 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fde4011f3f0 con 0x7fde48151e90 2023-12-16T03:28:45.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.606+0000 7fde4e207640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde2c066470 0x7fde2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.606+0000 7fde4e207640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde2c066470 0x7fde2c068930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fde44007fd0 tx=0x7fde44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:45.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.610+0000 7fde3effd640 1 -- 172.21.15.28:0/1026437088 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fde400eca50 con 0x7fde48151e90 2023-12-16T03:28:45.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.770+0000 7fde5046b640 1 -- 172.21.15.28:0/1026437088 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde4814c4e0 con 0x7fde48151e90 2023-12-16T03:28:45.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.770+0000 7fde3effd640 1 -- 172.21.15.28:0/1026437088 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16641 (secure 0 0 0) 0x7fde4814c4e0 con 0x7fde48151e90 2023-12-16T03:28:45.775 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:45.776 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":75,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:43.647997+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6836/2582425067":"2023-12-17T03:28:40.636985+0000","172.21.15.28:6834/2582425067":"2023-12-17T03:28:40.636985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 -- 172.21.15.28:0/1026437088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde2c066470 msgr2=0x7fde2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde2c066470 0x7fde2c068930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fde44007fd0 tx=0x7fde44009040 comp rx=0 tx=0).stop 2023-12-16T03:28:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 -- 172.21.15.28:0/1026437088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde48151e90 msgr2=0x7fde480ab750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde48151e90 0x7fde480ab750 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fde400af040 tx=0x7fde40019690 comp rx=0 tx=0).stop 2023-12-16T03:28:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 -- 172.21.15.28:0/1026437088 shutdown_connections 2023-12-16T03:28:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde2c066470 0x7fde2c068930 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde48151e90 0x7fde480ab750 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde480c7ea0 0x7fde481ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 --2- 172.21.15.28:0/1026437088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde4806b9e0 0x7fde4814ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 -- 172.21.15.28:0/1026437088 >> 172.21.15.28:0/1026437088 conn(0x7fde480ca170 msgr2=0x7fde48153f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 -- 172.21.15.28:0/1026437088 shutdown_connections 2023-12-16T03:28:45.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.774+0000 7fde5046b640 1 -- 172.21.15.28:0/1026437088 wait complete. 2023-12-16T03:28:45.797 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-16T03:28:45.797 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:28:45.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.934+0000 7fc4f46d6640 1 Processor -- start 2023-12-16T03:28:45.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.934+0000 7fc4f46d6640 1 -- start start 2023-12-16T03:28:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f46d6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc4ec0a5370 0x7fc4ec0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f46d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ec0c4110 0x7fc4ec150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f46d6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec0c2760 con 0x7fc4ec072090 2023-12-16T03:28:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f46d6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec0c3070 con 0x7fc4ec0a5370 2023-12-16T03:28:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f46d6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec151bf0 con 0x7fc4ec0c4110 2023-12-16T03:28:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f2472640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc4ec0a5370 0x7fc4ec0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f2472640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc4ec0a5370 0x7fc4ec0c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34682/0 (socket says 172.21.15.28:34682) 2023-12-16T03:28:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f2472640 1 -- 172.21.15.28:0/3596316334 learned_addr learned my addr 172.21.15.28:0/3596316334 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:45.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f1c71640 1 --2- 172.21.15.28:0/3596316334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ec0c4110 0x7fc4ec150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f2472640 1 -- 172.21.15.28:0/3596316334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ec0c4110 msgr2=0x7fc4ec150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:45.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f2472640 1 --2- 172.21.15.28:0/3596316334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ec0c4110 0x7fc4ec150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f2472640 1 -- 172.21.15.28:0/3596316334 >> v1:172.21.15.134:6789/0 conn(0x7fc4ec072090 legacy=0x7fc4ec1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.938+0000 7fc4f2472640 1 -- 172.21.15.28:0/3596316334 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0a5750 con 0x7fc4ec0a5370 2023-12-16T03:28:45.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f2472640 1 --2- 172.21.15.28:0/3596316334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4ec0a5370 0x7fc4ec0c3bd0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800bb20 tx=0x7fc4e801e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89dcee91e82168f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f1470640 1 -- 172.21.15.28:0/3596316334 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8004230 con 0x7fc4ec0a5370 2023-12-16T03:28:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f1470640 1 -- 172.21.15.28:0/3596316334 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e80ab070 con 0x7fc4ec0a5370 2023-12-16T03:28:45.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f1470640 1 -- 172.21.15.28:0/3596316334 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80a76d0 con 0x7fc4ec0a5370 2023-12-16T03:28:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 -- 172.21.15.28:0/3596316334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4ec0a5370 msgr2=0x7fc4ec0c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 --2- 172.21.15.28:0/3596316334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4ec0a5370 0x7fc4ec0c3bd0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800bb20 tx=0x7fc4e801e880 comp rx=0 tx=0).stop 2023-12-16T03:28:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 -- 172.21.15.28:0/3596316334 shutdown_connections 2023-12-16T03:28:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 --2- 172.21.15.28:0/3596316334 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ec0c4110 0x7fc4ec150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 --2- 172.21.15.28:0/3596316334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4ec0a5370 0x7fc4ec0c3bd0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 -- 172.21.15.28:0/3596316334 >> 172.21.15.28:0/3596316334 conn(0x7fc4ec06a5b0 msgr2=0x7fc4ec06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 -- 172.21.15.28:0/3596316334 shutdown_connections 2023-12-16T03:28:45.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 -- 172.21.15.28:0/3596316334 wait complete. 2023-12-16T03:28:45.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 Processor -- start 2023-12-16T03:28:45.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 -- start start 2023-12-16T03:28:45.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ec072090 0x7fc4ec148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ec0a5370 0x7fc4ec0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4ec0c4110 0x7fc4ec0a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec148180 con 0x7fc4ec0c4110 2023-12-16T03:28:45.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec1f15a0 con 0x7fc4ec072090 2023-12-16T03:28:45.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.942+0000 7fc4f46d6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec14f910 con 0x7fc4ec0a5370 2023-12-16T03:28:45.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f2c73640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4ec0c4110 0x7fc4ec0a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f2c73640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4ec0c4110 0x7fc4ec0a6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34692/0 (socket says 172.21.15.28:34692) 2023-12-16T03:28:45.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f1c71640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ec0a5370 0x7fc4ec0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f2c73640 1 -- 172.21.15.28:0/2004141051 learned_addr learned my addr 172.21.15.28:0/2004141051 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:45.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f2472640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ec072090 0x7fc4ec148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f2c73640 1 -- 172.21.15.28:0/2004141051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ec0a5370 msgr2=0x7fc4ec0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f2c73640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ec0a5370 0x7fc4ec0700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f2c73640 1 -- 172.21.15.28:0/2004141051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ec072090 msgr2=0x7fc4ec148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f2c73640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ec072090 0x7fc4ec148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f2c73640 1 -- 172.21.15.28:0/2004141051 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e800b780 con 0x7fc4ec0c4110 2023-12-16T03:28:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f2c73640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4ec0c4110 0x7fc4ec0a6c80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400c770 tx=0x7fc4e400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4e2ffd640 1 -- 172.21.15.28:0/2004141051 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4003b80 con 0x7fc4ec0c4110 2023-12-16T03:28:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4e2ffd640 1 -- 172.21.15.28:0/2004141051 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e4003ce0 con 0x7fc4ec0c4110 2023-12-16T03:28:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f46d6640 1 -- 172.21.15.28:0/2004141051 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ec14fbf0 con 0x7fc4ec0c4110 2023-12-16T03:28:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4e2ffd640 1 -- 172.21.15.28:0/2004141051 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400aa90 con 0x7fc4ec0c4110 2023-12-16T03:28:45.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f46d6640 1 -- 172.21.15.28:0/2004141051 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec14eac0 con 0x7fc4ec0c4110 2023-12-16T03:28:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4f46d6640 1 -- 172.21.15.28:0/2004141051 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec148330 con 0x7fc4ec0c4110 2023-12-16T03:28:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4e2ffd640 1 -- 172.21.15.28:0/2004141051 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc4e400abf0 con 0x7fc4ec0c4110 2023-12-16T03:28:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.946+0000 7fc4e2ffd640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc4d00664a0 0x7fc4d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.950+0000 7fc4e2ffd640 1 -- 172.21.15.28:0/2004141051 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc4e4083b90 con 0x7fc4ec0c4110 2023-12-16T03:28:45.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.950+0000 7fc4f2472640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc4d00664a0 0x7fc4d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:45.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.950+0000 7fc4f2472640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc4d00664a0 0x7fc4d0068960 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80b1000 tx=0x7fc4e80a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:45.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:45.954+0000 7fc4e2ffd640 1 -- 172.21.15.28:0/2004141051 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc4ec148330 con 0x7fc4ec0c4110 2023-12-16T03:28:46.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 -- 172.21.15.28:0/2004141051 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4ec068400 con 0x7fc4ec0c4110 2023-12-16T03:28:46.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4e2ffd640 1 -- 172.21.15.28:0/2004141051 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4942 (secure 0 0 0) 0x7fc4e4051050 con 0x7fc4ec0c4110 2023-12-16T03:28:46.150 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:46.150 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/651767003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":651767003},{"type":"v1","addr":"172.21.15.28:6837","nonce":651767003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4202659808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4202659808},{"type":"v1","addr":"172.21.15.134:6834","nonce":4202659808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7110,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/3025399368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3025399368},{"type":"v1","addr":"172.21.15.28:6836","nonce":3025399368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:28:12.170094+0000","modified":"2023-12-16T03:28:15.197722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5729":{"gid":5729,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6835/931138884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":931138884},{"type":"v1","addr":"172.21.15.134:6835","nonce":931138884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-16T03:28:46.151 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 53 2023-12-16T03:28:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 -- 172.21.15.28:0/2004141051 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc4d00664a0 msgr2=0x7fc4d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc4d00664a0 0x7fc4d0068960 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80b1000 tx=0x7fc4e80a9070 comp rx=0 tx=0).stop 2023-12-16T03:28:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 -- 172.21.15.28:0/2004141051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4ec0c4110 msgr2=0x7fc4ec0a6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4ec0c4110 0x7fc4ec0a6c80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400c770 tx=0x7fc4e400cc30 comp rx=0 tx=0).stop 2023-12-16T03:28:46.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 -- 172.21.15.28:0/2004141051 shutdown_connections 2023-12-16T03:28:46.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fc4d00664a0 0x7fc4d0068960 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4ec0c4110 0x7fc4ec0a6c80 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ec0a5370 0x7fc4ec0700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 --2- 172.21.15.28:0/2004141051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ec072090 0x7fc4ec148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 -- 172.21.15.28:0/2004141051 >> 172.21.15.28:0/2004141051 conn(0x7fc4ec06a5b0 msgr2=0x7fc4ec0bf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:46.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 -- 172.21.15.28:0/2004141051 shutdown_connections 2023-12-16T03:28:46.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.146+0000 7fc4f46d6640 1 -- 172.21.15.28:0/2004141051 wait complete. 2023-12-16T03:28:46.172 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:28:46.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.310+0000 7f47be468640 1 Processor -- start 2023-12-16T03:28:46.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.310+0000 7f47be468640 1 -- start start 2023-12-16T03:28:46.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47be468640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f47b806b1e0 0x7f47b806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:46.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47be468640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b8072500 con 0x7f47b806dfe0 2023-12-16T03:28:46.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47be468640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b8070f60 con 0x7f47b806a5b0 2023-12-16T03:28:46.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47be468640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b806ef50 con 0x7f47b806b1e0 2023-12-16T03:28:46.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47bca05640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f47b806b1e0 0x7f47b806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:46.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47b77fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f47b806dfe0 0x7f47b815cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39950/0 (socket says 172.21.15.28:39950) 2023-12-16T03:28:46.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47b77fe640 1 -- 172.21.15.28:0/814756870 learned_addr learned my addr 172.21.15.28:0/814756870 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:46.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47bca05640 1 -- 172.21.15.28:0/814756870 >> v1:172.21.15.134:6789/0 conn(0x7f47b806a5b0 legacy=0x7f47b80c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47bca05640 1 -- 172.21.15.28:0/814756870 >> v1:172.21.15.28:6789/0 conn(0x7f47b806dfe0 legacy=0x7f47b815cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47b6ffd640 1 -- 172.21.15.28:0/814756870 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279037602 0 0) 0x7f47b8070f60 con 0x7f47b806a5b0 2023-12-16T03:28:46.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47bca05640 1 -- 172.21.15.28:0/814756870 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b814eda0 con 0x7f47b806b1e0 2023-12-16T03:28:46.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47bca05640 1 --2- 172.21.15.28:0/814756870 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b806b1e0 0x7f47b806a990 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009d90 tx=0x7f47b001c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853e89c0049365b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:46.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47b6ffd640 1 -- 172.21.15.28:0/814756870 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00b0600 con 0x7f47b806b1e0 2023-12-16T03:28:46.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47b6ffd640 1 -- 172.21.15.28:0/814756870 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b00b0760 con 0x7f47b806b1e0 2023-12-16T03:28:46.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.314+0000 7f47b6ffd640 1 -- 172.21.15.28:0/814756870 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00b0af0 con 0x7f47b806b1e0 2023-12-16T03:28:46.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 -- 172.21.15.28:0/814756870 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b806b1e0 msgr2=0x7f47b806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 --2- 172.21.15.28:0/814756870 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b806b1e0 0x7f47b806a990 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009d90 tx=0x7f47b001c750 comp rx=0 tx=0).stop 2023-12-16T03:28:46.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 -- 172.21.15.28:0/814756870 shutdown_connections 2023-12-16T03:28:46.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 --2- 172.21.15.28:0/814756870 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b806b1e0 0x7f47b806a990 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 -- 172.21.15.28:0/814756870 >> 172.21.15.28:0/814756870 conn(0x7f47b80c6ef0 msgr2=0x7f47b80c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:46.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 -- 172.21.15.28:0/814756870 shutdown_connections 2023-12-16T03:28:46.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 -- 172.21.15.28:0/814756870 wait complete. 2023-12-16T03:28:46.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 Processor -- start 2023-12-16T03:28:46.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 -- start start 2023-12-16T03:28:46.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b806a5b0 0x7f47b813c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:46.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b806b1e0 0x7f47b8137530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:46.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b806dfe0 0x7f47b8137a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:46.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c5120 con 0x7f47b806dfe0 2023-12-16T03:28:46.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b81ee3f0 con 0x7f47b806a5b0 2023-12-16T03:28:46.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47be468640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c5330 con 0x7f47b806b1e0 2023-12-16T03:28:46.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47bca05640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b806dfe0 0x7f47b8137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:46.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47bca05640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b806dfe0 0x7f47b8137a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34704/0 (socket says 172.21.15.28:34704) 2023-12-16T03:28:46.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.318+0000 7f47bca05640 1 -- 172.21.15.28:0/3770457644 learned_addr learned my addr 172.21.15.28:0/3770457644 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:46.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47b77fe640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b806b1e0 0x7f47b8137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:46.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47b7fff640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b806a5b0 0x7f47b813c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:46.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47bca05640 1 -- 172.21.15.28:0/3770457644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b806b1e0 msgr2=0x7f47b8137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47bca05640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b806b1e0 0x7f47b8137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47bca05640 1 -- 172.21.15.28:0/3770457644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b806a5b0 msgr2=0x7f47b813c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47bca05640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b806a5b0 0x7f47b813c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47bca05640 1 -- 172.21.15.28:0/3770457644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009a70 con 0x7f47b806dfe0 2023-12-16T03:28:46.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47b77fe640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b806b1e0 0x7f47b8137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:46.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47bca05640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b806dfe0 0x7f47b8137a70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009d90 tx=0x7f47b00194f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:46.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47b4ff9640 1 -- 172.21.15.28:0/3770457644 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00b6070 con 0x7f47b806dfe0 2023-12-16T03:28:46.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47b4ff9640 1 -- 172.21.15.28:0/3770457644 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b00b1960 con 0x7f47b806dfe0 2023-12-16T03:28:46.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47b4ff9640 1 -- 172.21.15.28:0/3770457644 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00b1d10 con 0x7f47b806dfe0 2023-12-16T03:28:46.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47be468640 1 -- 172.21.15.28:0/3770457644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b80c5610 con 0x7f47b806dfe0 2023-12-16T03:28:46.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47be468640 1 -- 172.21.15.28:0/3770457644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b8137fb0 con 0x7f47b806dfe0 2023-12-16T03:28:46.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47be468640 1 -- 172.21.15.28:0/3770457644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b80c5b30 con 0x7f47b806dfe0 2023-12-16T03:28:46.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.322+0000 7f47b4ff9640 1 -- 172.21.15.28:0/3770457644 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f47b00ba070 con 0x7f47b806dfe0 2023-12-16T03:28:46.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.326+0000 7f47b4ff9640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f47a4066470 0x7f47a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:46.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.326+0000 7f47b4ff9640 1 -- 172.21.15.28:0/3770457644 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f47b011e0f0 con 0x7f47b806dfe0 2023-12-16T03:28:46.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.326+0000 7f47b7fff640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f47a4066470 0x7f47a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:46.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.326+0000 7f47b7fff640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f47a4066470 0x7f47a4068930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f47a8000f70 tx=0x7f47a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:46.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.330+0000 7f47b4ff9640 1 -- 172.21.15.28:0/3770457644 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f47b80c5b30 con 0x7f47b806dfe0 2023-12-16T03:28:46.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 -- 172.21.15.28:0/3770457644 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47b80c5b30 con 0x7f47b806dfe0 2023-12-16T03:28:46.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47b4ff9640 1 -- 172.21.15.28:0/3770457644 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f47b80c5b30 con 0x7f47b806dfe0 2023-12-16T03:28:46.522 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:46.522 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/651767003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":651767003},{"type":"v1","addr":"172.21.15.28:6837","nonce":651767003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4202659808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4202659808},{"type":"v1","addr":"172.21.15.134:6834","nonce":4202659808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7110,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/3025399368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3025399368},{"type":"v1","addr":"172.21.15.28:6836","nonce":3025399368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-16T03:28:12.170094+0000","modified":"2023-12-16T03:28:15.197722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5729":{"gid":5729,"name":"b","rank":0,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.134:6835/931138884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":931138884},{"type":"v1","addr":"172.21.15.134:6835","nonce":931138884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-16T03:28:46.522 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 53 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 -- 172.21.15.28:0/3770457644 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f47a4066470 msgr2=0x7f47a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f47a4066470 0x7f47a4068930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f47a8000f70 tx=0x7f47a8009040 comp rx=0 tx=0).stop 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 -- 172.21.15.28:0/3770457644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b806dfe0 msgr2=0x7f47b8137a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b806dfe0 0x7f47b8137a70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009d90 tx=0x7f47b00194f0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 -- 172.21.15.28:0/3770457644 shutdown_connections 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f47a4066470 0x7f47a4068930 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b806dfe0 0x7f47b8137a70 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f47b806b1e0 0x7f47b8137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 --2- 172.21.15.28:0/3770457644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b806a5b0 0x7f47b813c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 -- 172.21.15.28:0/3770457644 >> 172.21.15.28:0/3770457644 conn(0x7f47b80c6ef0 msgr2=0x7f47b80c1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 -- 172.21.15.28:0/3770457644 shutdown_connections 2023-12-16T03:28:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.518+0000 7f47be468640 1 -- 172.21.15.28:0/3770457644 wait complete. 2023-12-16T03:28:46.544 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:46.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.682+0000 7f7469ac9640 1 Processor -- start 2023-12-16T03:28:46.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.682+0000 7f7469ac9640 1 -- start start 2023-12-16T03:28:46.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7469ac9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f746406b270 0x7f7464155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:46.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7469ac9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c8540 0x7f7464151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:46.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7469ac9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74640c56d0 con 0x7f74640c6310 2023-12-16T03:28:46.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7469ac9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74640c9d30 con 0x7f746406b270 2023-12-16T03:28:46.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7469ac9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74640c4da0 con 0x7f74640c8540 2023-12-16T03:28:46.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f74637fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f746406b270 0x7f7464155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:46.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7463fff640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c8540 0x7f7464151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:46.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7462ffd640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f74640c6310 0x7f74640c7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:51108/0 (socket says 172.21.15.28:51108) 2023-12-16T03:28:46.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f74637fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f746406b270 0x7f7464155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:43126/0 (socket says 172.21.15.28:43126) 2023-12-16T03:28:46.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7462ffd640 1 -- 172.21.15.28:0/3821604751 learned_addr learned my addr 172.21.15.28:0/3821604751 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:46.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7463fff640 1 -- 172.21.15.28:0/3821604751 >> v2:172.21.15.134:3300/0 conn(0x7f746406b270 msgr2=0x7f7464155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:46.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7463fff640 1 --2- 172.21.15.28:0/3821604751 >> v2:172.21.15.134:3300/0 conn(0x7f746406b270 0x7f7464155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7463fff640 1 -- 172.21.15.28:0/3821604751 >> v1:172.21.15.134:6789/0 conn(0x7f74640c6310 legacy=0x7f74640c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f7463fff640 1 -- 172.21.15.28:0/3821604751 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74640c5080 con 0x7f74640c8540 2023-12-16T03:28:46.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.686+0000 7f74637fe640 1 --2- 172.21.15.28:0/3821604751 >> v2:172.21.15.134:3300/0 conn(0x7f746406b270 0x7f7464155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:46.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7463fff640 1 --2- 172.21.15.28:0/3821604751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c8540 0x7f7464151610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f745c009d90 tx=0x7f745c01c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b6cf1614d041f79 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:46.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f74627fc640 1 -- 172.21.15.28:0/3821604751 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0a6670 con 0x7f74640c8540 2023-12-16T03:28:46.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f74627fc640 1 -- 172.21.15.28:0/3821604751 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c0a67d0 con 0x7f74640c8540 2023-12-16T03:28:46.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f74627fc640 1 -- 172.21.15.28:0/3821604751 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0a6b60 con 0x7f74640c8540 2023-12-16T03:28:46.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7469ac9640 1 -- 172.21.15.28:0/3821604751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c8540 msgr2=0x7f7464151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7469ac9640 1 --2- 172.21.15.28:0/3821604751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c8540 0x7f7464151610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f745c009d90 tx=0x7f745c01c750 comp rx=0 tx=0).stop 2023-12-16T03:28:46.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7469ac9640 1 -- 172.21.15.28:0/3821604751 shutdown_connections 2023-12-16T03:28:46.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7469ac9640 1 --2- 172.21.15.28:0/3821604751 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c8540 0x7f7464151610 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7469ac9640 1 --2- 172.21.15.28:0/3821604751 >> v2:172.21.15.134:3300/0 conn(0x7f746406b270 0x7f7464155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7469ac9640 1 -- 172.21.15.28:0/3821604751 >> 172.21.15.28:0/3821604751 conn(0x7f74640ca100 msgr2=0x7f74640ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:46.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7469ac9640 1 -- 172.21.15.28:0/3821604751 shutdown_connections 2023-12-16T03:28:46.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7469ac9640 1 -- 172.21.15.28:0/3821604751 wait complete. 2023-12-16T03:28:46.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7469ac9640 1 Processor -- start 2023-12-16T03:28:46.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7469ac9640 1 -- start start 2023-12-16T03:28:46.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.690+0000 7f7469ac9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746406b270 0x7f746414bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:46.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7469ac9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c6310 0x7f746414aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:46.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7469ac9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74640c8540 0x7f74641452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:46.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7469ac9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74641577b0 con 0x7f74640c8540 2023-12-16T03:28:46.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7469ac9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746414c900 con 0x7f746406b270 2023-12-16T03:28:46.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7469ac9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7464155cd0 con 0x7f74640c6310 2023-12-16T03:28:46.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7463fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74640c8540 0x7f74641452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:46.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7463fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74640c8540 0x7f74641452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34720/0 (socket says 172.21.15.28:34720) 2023-12-16T03:28:46.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7463fff640 1 -- 172.21.15.28:0/1160547183 learned_addr learned my addr 172.21.15.28:0/1160547183 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:46.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f74637fe640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746406b270 0x7f746414bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:46.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7462ffd640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c6310 0x7f746414aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7463fff640 1 -- 172.21.15.28:0/1160547183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c6310 msgr2=0x7f746414aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7463fff640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c6310 0x7f746414aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7463fff640 1 -- 172.21.15.28:0/1160547183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746406b270 msgr2=0x7f746414bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7463fff640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746406b270 0x7f746414bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7463fff640 1 -- 172.21.15.28:0/1160547183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7454009420 con 0x7f74640c8540 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7462ffd640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c6310 0x7f746414aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7463fff640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74640c8540 0x7f74641452a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f745c01ae00 tx=0x7f745c0194f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f744bfff640 1 -- 172.21.15.28:0/1160547183 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0b7070 con 0x7f74640c8540 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f744bfff640 1 -- 172.21.15.28:0/1160547183 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c0b1450 con 0x7f74640c8540 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f744bfff640 1 -- 172.21.15.28:0/1160547183 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0b17e0 con 0x7f74640c8540 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7469ac9640 1 -- 172.21.15.28:0/1160547183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c009a70 con 0x7f74640c8540 2023-12-16T03:28:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7469ac9640 1 -- 172.21.15.28:0/1160547183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7464156290 con 0x7f74640c8540 2023-12-16T03:28:46.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f7469ac9640 1 -- 172.21.15.28:0/1160547183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746404e850 con 0x7f74640c8540 2023-12-16T03:28:46.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.694+0000 7f744bfff640 1 -- 172.21.15.28:0/1160547183 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f745c0b1940 con 0x7f74640c8540 2023-12-16T03:28:46.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.698+0000 7f744bfff640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7450066470 0x7f7450068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:46.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.698+0000 7f744bfff640 1 -- 172.21.15.28:0/1160547183 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f745c11e5d0 con 0x7f74640c8540 2023-12-16T03:28:46.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.698+0000 7f74637fe640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7450066470 0x7f7450068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:46.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.698+0000 7f74637fe640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7450066470 0x7f7450068930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7454009cf0 tx=0x7f7454009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:46.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.702+0000 7f744bfff640 1 -- 172.21.15.28:0/1160547183 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f745c0eba90 con 0x7f74640c8540 2023-12-16T03:28:46.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.858+0000 7f7469ac9640 1 -- 172.21.15.28:0/1160547183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f746414ca70 con 0x7f74640c8540 2023-12-16T03:28:46.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f744bfff640 1 -- 172.21.15.28:0/1160547183 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f745c0ef0b0 con 0x7f74640c8540 2023-12-16T03:28:46.865 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:46.866 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":75,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:43.647997+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-16T03:28:10.280019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-16T03:28:11.167317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.28:6836/2582425067":"2023-12-17T03:28:40.636985+0000","172.21.15.28:6834/2582425067":"2023-12-17T03:28:40.636985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:46.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 -- 172.21.15.28:0/1160547183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7450066470 msgr2=0x7f7450068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7450066470 0x7f7450068930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7454009cf0 tx=0x7f7454009190 comp rx=0 tx=0).stop 2023-12-16T03:28:46.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 -- 172.21.15.28:0/1160547183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74640c8540 msgr2=0x7f74641452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:46.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74640c8540 0x7f74641452a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f745c01ae00 tx=0x7f745c0194f0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 -- 172.21.15.28:0/1160547183 shutdown_connections 2023-12-16T03:28:46.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7450066470 0x7f7450068930 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74640c8540 0x7f74641452a0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f74640c6310 0x7f746414aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 --2- 172.21.15.28:0/1160547183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f746406b270 0x7f746414bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:46.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 -- 172.21.15.28:0/1160547183 >> 172.21.15.28:0/1160547183 conn(0x7f74640ca100 msgr2=0x7f74640aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:46.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 -- 172.21.15.28:0/1160547183 shutdown_connections 2023-12-16T03:28:46.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:46.862+0000 7f7469ac9640 1 -- 172.21.15.28:0/1160547183 wait complete. 2023-12-16T03:28:46.887 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-16T03:28:47.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.026+0000 7f1d2c89c640 1 Processor -- start 2023-12-16T03:28:47.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.026+0000 7f1d2c89c640 1 -- start start 2023-12-16T03:28:47.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.026+0000 7f1d2c89c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1d280a5240 0x7f1d280bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:47.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.026+0000 7f1d2c89c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1d281561f0 0x7f1d28156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:47.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.026+0000 7f1d2c89c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d280c3bd0 con 0x7f1d280c01c0 2023-12-16T03:28:47.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.026+0000 7f1d2c89c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d280bf1e0 con 0x7f1d280a5240 2023-12-16T03:28:47.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.026+0000 7f1d2c89c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d280c3e20 con 0x7f1d281561f0 2023-12-16T03:28:47.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d2659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1d280a5240 0x7f1d280bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:47.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d2659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1d280a5240 0x7f1d280bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34722/0 (socket says 172.21.15.28:34722) 2023-12-16T03:28:47.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d2659c640 1 -- 172.21.15.28:0/3531350126 learned_addr learned my addr 172.21.15.28:0/3531350126 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:47.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d26d9d640 1 --2- 172.21.15.28:0/3531350126 >> v2:172.21.15.134:3300/0 conn(0x7f1d281561f0 0x7f1d28156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:47.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d2659c640 1 -- 172.21.15.28:0/3531350126 >> v2:172.21.15.134:3300/0 conn(0x7f1d281561f0 msgr2=0x7f1d28156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:47.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d2659c640 1 --2- 172.21.15.28:0/3531350126 >> v2:172.21.15.134:3300/0 conn(0x7f1d281561f0 0x7f1d28156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d2659c640 1 -- 172.21.15.28:0/3531350126 >> v1:172.21.15.134:6789/0 conn(0x7f1d280c01c0 legacy=0x7f1d280c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:47.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d2659c640 1 -- 172.21.15.28:0/3531350126 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d280c4100 con 0x7f1d280a5240 2023-12-16T03:28:47.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d2659c640 1 --2- 172.21.15.28:0/3531350126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d280a5240 0x7f1d280bfc80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f1d280729a0 tx=0x7f1d1801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6186bd9ca3fb9105 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:47.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d2559a640 1 -- 172.21.15.28:0/3531350126 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18004230 con 0x7f1d280a5240 2023-12-16T03:28:47.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d2559a640 1 -- 172.21.15.28:0/3531350126 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d180a7050 con 0x7f1d280a5240 2023-12-16T03:28:47.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.030+0000 7f1d2559a640 1 -- 172.21.15.28:0/3531350126 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18003620 con 0x7f1d280a5240 2023-12-16T03:28:47.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 -- 172.21.15.28:0/3531350126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d280a5240 msgr2=0x7f1d280bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:47.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 --2- 172.21.15.28:0/3531350126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d280a5240 0x7f1d280bfc80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f1d280729a0 tx=0x7f1d1801c440 comp rx=0 tx=0).stop 2023-12-16T03:28:47.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 -- 172.21.15.28:0/3531350126 shutdown_connections 2023-12-16T03:28:47.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 --2- 172.21.15.28:0/3531350126 >> v2:172.21.15.134:3300/0 conn(0x7f1d281561f0 0x7f1d28156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 --2- 172.21.15.28:0/3531350126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d280a5240 0x7f1d280bfc80 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 -- 172.21.15.28:0/3531350126 >> 172.21.15.28:0/3531350126 conn(0x7f1d2806a5b0 msgr2=0x7f1d2806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:47.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 -- 172.21.15.28:0/3531350126 shutdown_connections 2023-12-16T03:28:47.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 -- 172.21.15.28:0/3531350126 wait complete. 2023-12-16T03:28:47.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 Processor -- start 2023-12-16T03:28:47.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 -- start start 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d280a5240 0x7f1d281f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d280c01c0 0x7f1d2815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d281561f0 0x7f1d2815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28159dc0 con 0x7f1d281561f0 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2815c9b0 con 0x7f1d280a5240 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2c89c640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d281f1120 con 0x7f1d280c01c0 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d26d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d281561f0 0x7f1d2815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d26d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d281561f0 0x7f1d2815ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34736/0 (socket says 172.21.15.28:34736) 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d26d9d640 1 -- 172.21.15.28:0/1395898802 learned_addr learned my addr 172.21.15.28:0/1395898802 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d25d9b640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d280c01c0 0x7f1d2815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.034+0000 7f1d2659c640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d280a5240 0x7f1d281f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d26d9d640 1 -- 172.21.15.28:0/1395898802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d280c01c0 msgr2=0x7f1d2815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:47.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d26d9d640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d280c01c0 0x7f1d2815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d26d9d640 1 -- 172.21.15.28:0/1395898802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d280a5240 msgr2=0x7f1d281f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:47.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d26d9d640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d280a5240 0x7f1d281f08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d26d9d640 1 -- 172.21.15.28:0/1395898802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d180094d0 con 0x7f1d281561f0 2023-12-16T03:28:47.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d26d9d640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d281561f0 0x7f1d2815ad50 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000efc0 tx=0x7f1d2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:47.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d16ffd640 1 -- 172.21.15.28:0/1395898802 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20014480 con 0x7f1d281561f0 2023-12-16T03:28:47.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d16ffd640 1 -- 172.21.15.28:0/1395898802 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2000f040 con 0x7f1d281561f0 2023-12-16T03:28:47.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d2c89c640 1 -- 172.21.15.28:0/1395898802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d281f1400 con 0x7f1d281561f0 2023-12-16T03:28:47.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d16ffd640 1 -- 172.21.15.28:0/1395898802 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20014820 con 0x7f1d281561f0 2023-12-16T03:28:47.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d2c89c640 1 -- 172.21.15.28:0/1395898802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2815a2f0 con 0x7f1d281561f0 2023-12-16T03:28:47.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d2c89c640 1 -- 172.21.15.28:0/1395898802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d280c52e0 con 0x7f1d281561f0 2023-12-16T03:28:47.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.038+0000 7f1d16ffd640 1 -- 172.21.15.28:0/1395898802 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1d20014980 con 0x7f1d281561f0 2023-12-16T03:28:47.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.042+0000 7f1d16ffd640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d08066470 0x7f1d08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:47.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.042+0000 7f1d16ffd640 1 -- 172.21.15.28:0/1395898802 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f1d20084980 con 0x7f1d281561f0 2023-12-16T03:28:47.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.042+0000 7f1d2659c640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d08066470 0x7f1d08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:47.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.042+0000 7f1d2659c640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d08066470 0x7f1d08068930 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1d180ad000 tx=0x7f1d180a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:47.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.046+0000 7f1d16ffd640 1 -- 172.21.15.28:0/1395898802 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1d20051db0 con 0x7f1d281561f0 2023-12-16T03:28:47.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.238+0000 7f1d2c89c640 1 -- 172.21.15.28:0/1395898802 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f1d2815a4e0 con 0x7f1d281561f0 2023-12-16T03:28:47.244 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-12-16T03:28:47.242+0000 7f6a9e376640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-16T03:28:47.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.242+0000 7f1d16ffd640 1 -- 172.21.15.28:0/1395898802 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 163+0+0 (secure 0 0 0) 0x7f1d20018090 con 0x7f1d281561f0 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 -- 172.21.15.28:0/1395898802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d08066470 msgr2=0x7f1d08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d08066470 0x7f1d08068930 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1d180ad000 tx=0x7f1d180a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 -- 172.21.15.28:0/1395898802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d281561f0 msgr2=0x7f1d2815ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d281561f0 0x7f1d2815ad50 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000efc0 tx=0x7f1d2000c490 comp rx=0 tx=0).stop 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 -- 172.21.15.28:0/1395898802 shutdown_connections 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f1d08066470 0x7f1d08068930 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1d281561f0 0x7f1d2815ad50 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d280c01c0 0x7f1d2815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 --2- 172.21.15.28:0/1395898802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d280a5240 0x7f1d281f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 -- 172.21.15.28:0/1395898802 >> 172.21.15.28:0/1395898802 conn(0x7f1d2806a5b0 msgr2=0x7f1d2806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 -- 172.21.15.28:0/1395898802 shutdown_connections 2023-12-16T03:28:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.246+0000 7f1d2c89c640 1 -- 172.21.15.28:0/1395898802 wait complete. 2023-12-16T03:28:47.260 INFO:tasks.ceph.mds.b.smithi134.stderr: -4581> 2023-12-16T03:28:15.671+0000 7fb25d1fb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-16T03:28:47.269 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-16T03:28:47.308 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2023-12-16T03:28:47.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc5aefe640 1 Processor -- start 2023-12-16T03:28:47.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc5aefe640 1 -- start start 2023-12-16T03:28:47.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc5aefe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcc540bd660 0x7fcc54154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:47.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc5aefe640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc540ac4f0 con 0x7fcc540c7ed0 2023-12-16T03:28:47.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc5aefe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc54158780 con 0x7fcc54151dc0 2023-12-16T03:28:47.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc5aefe640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc54158a60 con 0x7fcc540bd660 2023-12-16T03:28:47.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc5949b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcc540bd660 0x7fcc54154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:47.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc53fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcc540c7ed0 0x7fcc54154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39962/0 (socket says 172.21.15.28:39962) 2023-12-16T03:28:47.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc53fff640 1 -- 172.21.15.28:0/1569149026 learned_addr learned my addr 172.21.15.28:0/1569149026 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:47.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc537fe640 1 -- 172.21.15.28:0/1569149026 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839830778 0 0) 0x7fcc540ac4f0 con 0x7fcc540c7ed0 2023-12-16T03:28:47.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc537fe640 1 -- 172.21.15.28:0/1569149026 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc44003530 con 0x7fcc540c7ed0 2023-12-16T03:28:47.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc5949b640 1 -- 172.21.15.28:0/1569149026 >> v1:172.21.15.134:6789/0 conn(0x7fcc54151dc0 legacy=0x7fcc540c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:47.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc5949b640 1 -- 172.21.15.28:0/1569149026 >> v1:172.21.15.28:6789/0 conn(0x7fcc540c7ed0 legacy=0x7fcc54154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:47.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.410+0000 7fcc5949b640 1 -- 172.21.15.28:0/1569149026 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc540ac180 con 0x7fcc540bd660 2023-12-16T03:28:47.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.414+0000 7fcc5949b640 1 --2- 172.21.15.28:0/1569149026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc540bd660 0x7fcc54154d60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009dc0 tx=0x7fcc4c01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b028458d873e4549 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:47.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.414+0000 7fcc537fe640 1 -- 172.21.15.28:0/1569149026 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c0a5760 con 0x7fcc540bd660 2023-12-16T03:28:47.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.414+0000 7fcc537fe640 1 -- 172.21.15.28:0/1569149026 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c0a58c0 con 0x7fcc540bd660 2023-12-16T03:28:47.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.414+0000 7fcc537fe640 1 -- 172.21.15.28:0/1569149026 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c0a5c30 con 0x7fcc540bd660 2023-12-16T03:28:47.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.414+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1569149026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc540bd660 msgr2=0x7fcc54154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:47.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.414+0000 7fcc5aefe640 1 --2- 172.21.15.28:0/1569149026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc540bd660 0x7fcc54154d60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009dc0 tx=0x7fcc4c01c810 comp rx=0 tx=0).stop 2023-12-16T03:28:47.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.414+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1569149026 shutdown_connections 2023-12-16T03:28:47.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.414+0000 7fcc5aefe640 1 --2- 172.21.15.28:0/1569149026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc540bd660 0x7fcc54154d60 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.414+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1569149026 >> 172.21.15.28:0/1569149026 conn(0x7fcc54071eb0 msgr2=0x7fcc540722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:47.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.414+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1569149026 shutdown_connections 2023-12-16T03:28:47.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.414+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1569149026 wait complete. 2023-12-16T03:28:47.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc5aefe640 1 Processor -- start 2023-12-16T03:28:47.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc5aefe640 1 -- start start 2023-12-16T03:28:47.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc5aefe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc540bd660 0x7fcc54153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:47.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc5aefe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc540c7ed0 0x7fcc5414afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:47.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc5aefe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc54151dc0 0x7fcc5414b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:47.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc5aefe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5414dec0 con 0x7fcc540bd660 2023-12-16T03:28:47.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc5aefe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5414ba50 con 0x7fcc54151dc0 2023-12-16T03:28:47.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc5aefe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5414f120 con 0x7fcc540c7ed0 2023-12-16T03:28:47.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc58c9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc540bd660 0x7fcc54153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:47.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc58c9a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc540bd660 0x7fcc54153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34764/0 (socket says 172.21.15.28:34764) 2023-12-16T03:28:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc58c9a640 1 -- 172.21.15.28:0/1159390744 learned_addr learned my addr 172.21.15.28:0/1159390744 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc53fff640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc540c7ed0 0x7fcc5414afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc5949b640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc54151dc0 0x7fcc5414b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc58c9a640 1 -- 172.21.15.28:0/1159390744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc540c7ed0 msgr2=0x7fcc5414afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc58c9a640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc540c7ed0 0x7fcc5414afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc58c9a640 1 -- 172.21.15.28:0/1159390744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc54151dc0 msgr2=0x7fcc5414b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc58c9a640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc54151dc0 0x7fcc5414b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc58c9a640 1 -- 172.21.15.28:0/1159390744 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c009a70 con 0x7fcc540bd660 2023-12-16T03:28:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc58c9a640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc540bd660 0x7fcc54153770 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800c450 tx=0x7fcc4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc517fa640 1 -- 172.21.15.28:0/1159390744 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc480052d0 con 0x7fcc540bd660 2023-12-16T03:28:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc517fa640 1 -- 172.21.15.28:0/1159390744 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc48005430 con 0x7fcc540bd660 2023-12-16T03:28:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1159390744 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc541ece90 con 0x7fcc540bd660 2023-12-16T03:28:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc517fa640 1 -- 172.21.15.28:0/1159390744 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc48007260 con 0x7fcc540bd660 2023-12-16T03:28:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.418+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1159390744 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc541ed450 con 0x7fcc540bd660 2023-12-16T03:28:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.422+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1159390744 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc541edaa0 con 0x7fcc540bd660 2023-12-16T03:28:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.422+0000 7fcc517fa640 1 -- 172.21.15.28:0/1159390744 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcc480073c0 con 0x7fcc540bd660 2023-12-16T03:28:47.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.422+0000 7fcc517fa640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcc38066470 0x7fcc38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.422+0000 7fcc517fa640 1 -- 172.21.15.28:0/1159390744 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fcc48083810 con 0x7fcc540bd660 2023-12-16T03:28:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.422+0000 7fcc53fff640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcc38066470 0x7fcc38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.422+0000 7fcc53fff640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcc38066470 0x7fcc38068930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcc541ea980 tx=0x7fcc40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.426+0000 7fcc517fa640 1 -- 172.21.15.28:0/1159390744 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcc48050bd0 con 0x7fcc540bd660 2023-12-16T03:28:47.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:47.618+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1159390744 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcc54157a00 con 0x7fcc540bd660 2023-12-16T03:28:48.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc517fa640 1 -- 172.21.15.28:0/1159390744 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 105+0+0 (secure 0 0 0) 0x7fcc480541f0 con 0x7fcc540bd660 2023-12-16T03:28:48.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1159390744 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcc38066470 msgr2=0x7fcc38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcc38066470 0x7fcc38068930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcc541ea980 tx=0x7fcc40009040 comp rx=0 tx=0).stop 2023-12-16T03:28:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1159390744 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc540bd660 msgr2=0x7fcc54153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc540bd660 0x7fcc54153770 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800c450 tx=0x7fcc4800c910 comp rx=0 tx=0).stop 2023-12-16T03:28:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1159390744 shutdown_connections 2023-12-16T03:28:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc54151dc0 0x7fcc5414b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcc540c7ed0 0x7fcc5414afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fcc38066470 0x7fcc38068930 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 --2- 172.21.15.28:0/1159390744 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc540bd660 0x7fcc54153770 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1159390744 >> 172.21.15.28:0/1159390744 conn(0x7fcc54071eb0 msgr2=0x7fcc5414f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1159390744 shutdown_connections 2023-12-16T03:28:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.246+0000 7fcc5aefe640 1 -- 172.21.15.28:0/1159390744 wait complete. 2023-12-16T03:28:48.276 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-16T03:28:48.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95c0de6640 1 Processor -- start 2023-12-16T03:28:48.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95c0de6640 1 -- start start 2023-12-16T03:28:48.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95c0de6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f95bc151f40 0x7f95bc155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:48.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95c0de6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f95bc0c64b0 0x7f95bc0c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95c0de6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc0c2020 con 0x7f95bc0c8310 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95c0de6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc0c25e0 con 0x7f95bc0c64b0 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95c0de6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc0c2300 con 0x7f95bc151f40 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95b9d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f95bc0c64b0 0x7f95bc0c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95bad9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f95bc0c8310 0x7f95bc158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39964/0 (socket says 172.21.15.28:39964) 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95bad9d640 1 -- 172.21.15.28:0/1398619797 learned_addr learned my addr 172.21.15.28:0/1398619797 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95ba59c640 1 --2- 172.21.15.28:0/1398619797 >> v2:172.21.15.134:3300/0 conn(0x7f95bc151f40 0x7f95bc155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95b9d9b640 1 -- 172.21.15.28:0/1398619797 >> v2:172.21.15.134:3300/0 conn(0x7f95bc151f40 msgr2=0x7f95bc155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95b9d9b640 1 --2- 172.21.15.28:0/1398619797 >> v2:172.21.15.134:3300/0 conn(0x7f95bc151f40 0x7f95bc155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95b9d9b640 1 -- 172.21.15.28:0/1398619797 >> v1:172.21.15.28:6789/0 conn(0x7f95bc0c8310 legacy=0x7f95bc158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95b959a640 1 -- 172.21.15.28:0/1398619797 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823348308 0 0) 0x7f95bc0c2020 con 0x7f95bc0c8310 2023-12-16T03:28:48.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.422+0000 7f95b9d9b640 1 -- 172.21.15.28:0/1398619797 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc157e30 con 0x7f95bc0c64b0 2023-12-16T03:28:48.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95b9d9b640 1 --2- 172.21.15.28:0/1398619797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95bc0c64b0 0x7f95bc0c7dd0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0c8e30 tx=0x7f95b001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9034a4369f41bab7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95b959a640 1 -- 172.21.15.28:0/1398619797 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b00ab600 con 0x7f95bc0c64b0 2023-12-16T03:28:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95b959a640 1 -- 172.21.15.28:0/1398619797 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b00a7050 con 0x7f95bc0c64b0 2023-12-16T03:28:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95b959a640 1 -- 172.21.15.28:0/1398619797 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b00ab980 con 0x7f95bc0c64b0 2023-12-16T03:28:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95c0de6640 1 -- 172.21.15.28:0/1398619797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95bc0c64b0 msgr2=0x7f95bc0c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95c0de6640 1 --2- 172.21.15.28:0/1398619797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95bc0c64b0 0x7f95bc0c7dd0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0c8e30 tx=0x7f95b001c3d0 comp rx=0 tx=0).stop 2023-12-16T03:28:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95c0de6640 1 -- 172.21.15.28:0/1398619797 shutdown_connections 2023-12-16T03:28:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95c0de6640 1 --2- 172.21.15.28:0/1398619797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95bc0c64b0 0x7f95bc0c7dd0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95c0de6640 1 --2- 172.21.15.28:0/1398619797 >> v2:172.21.15.134:3300/0 conn(0x7f95bc151f40 0x7f95bc155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95c0de6640 1 -- 172.21.15.28:0/1398619797 >> 172.21.15.28:0/1398619797 conn(0x7f95bc06a5b0 msgr2=0x7f95bc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95c0de6640 1 -- 172.21.15.28:0/1398619797 shutdown_connections 2023-12-16T03:28:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.426+0000 7f95c0de6640 1 -- 172.21.15.28:0/1398619797 wait complete. 2023-12-16T03:28:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95c0de6640 1 Processor -- start 2023-12-16T03:28:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95c0de6640 1 -- start start 2023-12-16T03:28:48.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95c0de6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95bc0c64b0 0x7f95bc146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:48.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95c0de6640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95bc0c8310 0x7f95bc1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:48.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95c0de6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95bc151f40 0x7f95bc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:48.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95c0de6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc156570 con 0x7f95bc151f40 2023-12-16T03:28:48.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95c0de6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc06bc00 con 0x7f95bc0c64b0 2023-12-16T03:28:48.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95c0de6640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc1ed360 con 0x7f95bc0c8310 2023-12-16T03:28:48.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95bad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95bc151f40 0x7f95bc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:48.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95bad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95bc151f40 0x7f95bc06b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34784/0 (socket says 172.21.15.28:34784) 2023-12-16T03:28:48.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95bad9d640 1 -- 172.21.15.28:0/3832149671 learned_addr learned my addr 172.21.15.28:0/3832149671 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:48.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95ba59c640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95bc0c64b0 0x7f95bc146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:48.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95b9d9b640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95bc0c8310 0x7f95bc1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:48.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95bad9d640 1 -- 172.21.15.28:0/3832149671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95bc0c8310 msgr2=0x7f95bc1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95bad9d640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95bc0c8310 0x7f95bc1570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95bad9d640 1 -- 172.21.15.28:0/3832149671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95bc0c64b0 msgr2=0x7f95bc146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95bad9d640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95bc0c64b0 0x7f95bc146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95bad9d640 1 -- 172.21.15.28:0/3832149671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0009420 con 0x7f95bc151f40 2023-12-16T03:28:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95bad9d640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95bc151f40 0x7f95bc06b6c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f95b4001570 tx=0x7f95b400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95aaffd640 1 -- 172.21.15.28:0/3832149671 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b400a640 con 0x7f95bc151f40 2023-12-16T03:28:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95aaffd640 1 -- 172.21.15.28:0/3832149671 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b400a7c0 con 0x7f95bc151f40 2023-12-16T03:28:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95c0de6640 1 -- 172.21.15.28:0/3832149671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc143f20 con 0x7f95bc151f40 2023-12-16T03:28:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95aaffd640 1 -- 172.21.15.28:0/3832149671 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b400ab70 con 0x7f95bc151f40 2023-12-16T03:28:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.430+0000 7f95c0de6640 1 -- 172.21.15.28:0/3832149671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc1576a0 con 0x7f95bc151f40 2023-12-16T03:28:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.434+0000 7f95c0de6640 1 -- 172.21.15.28:0/3832149671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc068400 con 0x7f95bc151f40 2023-12-16T03:28:48.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.434+0000 7f95aaffd640 1 -- 172.21.15.28:0/3832149671 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f95b400acd0 con 0x7f95bc151f40 2023-12-16T03:28:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.434+0000 7f95aaffd640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f959c066470 0x7f959c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.434+0000 7f95aaffd640 1 -- 172.21.15.28:0/3832149671 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f95b4083720 con 0x7f95bc151f40 2023-12-16T03:28:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.434+0000 7f95ba59c640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f959c066470 0x7f959c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.434+0000 7f95ba59c640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f959c066470 0x7f959c068930 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f95bc14f490 tx=0x7f95ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:48.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.438+0000 7f95aaffd640 1 -- 172.21.15.28:0/3832149671 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f95b4050b00 con 0x7f95bc151f40 2023-12-16T03:28:48.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:48.594+0000 7f95c0de6640 1 -- 172.21.15.28:0/3832149671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f95bc1ed4a0 con 0x7f95bc151f40 2023-12-16T03:28:49.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.246+0000 7f95aaffd640 1 -- 172.21.15.28:0/3832149671 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v77) v1 ==== 184+0+0 (secure 0 0 0) 0x7f95b4054120 con 0x7f95bc151f40 2023-12-16T03:28:49.251 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_metadata' removed 2023-12-16T03:28:49.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 -- 172.21.15.28:0/3832149671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f959c066470 msgr2=0x7f959c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:49.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f959c066470 0x7f959c068930 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f95bc14f490 tx=0x7f95ac008040 comp rx=0 tx=0).stop 2023-12-16T03:28:49.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 -- 172.21.15.28:0/3832149671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95bc151f40 msgr2=0x7f95bc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:49.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95bc151f40 0x7f95bc06b6c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f95b4001570 tx=0x7f95b400cca0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 -- 172.21.15.28:0/3832149671 shutdown_connections 2023-12-16T03:28:49.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f959c066470 0x7f959c068930 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f95bc151f40 0x7f95bc06b6c0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95bc0c8310 0x7f95bc1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 --2- 172.21.15.28:0/3832149671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95bc0c64b0 0x7f95bc146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 -- 172.21.15.28:0/3832149671 >> 172.21.15.28:0/3832149671 conn(0x7f95bc06a5b0 msgr2=0x7f95bc0c72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:49.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 -- 172.21.15.28:0/3832149671 shutdown_connections 2023-12-16T03:28:49.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.250+0000 7f95c0de6640 1 -- 172.21.15.28:0/3832149671 wait complete. 2023-12-16T03:28:49.281 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-16T03:28:49.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.426+0000 7ff04cb65640 1 Processor -- start 2023-12-16T03:28:49.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.426+0000 7ff04cb65640 1 -- start start 2023-12-16T03:28:49.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff04cb65640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0480c4fb0 0x7ff0480c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:49.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff04cb65640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff04806db90 0x7ff04806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:49.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff04cb65640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff04806c840 0x7ff04806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:49.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff04cb65640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04806e530 con 0x7ff04806db90 2023-12-16T03:28:49.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff04cb65640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0480aa750 con 0x7ff04806c840 2023-12-16T03:28:49.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff04cb65640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480a8f90 con 0x7ff0480c4fb0 2023-12-16T03:28:49.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff03ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff04806db90 0x7ff04806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:49.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff03ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff04806db90 0x7ff04806dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34786/0 (socket says 172.21.15.28:34786) 2023-12-16T03:28:49.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff03ffff640 1 -- 172.21.15.28:0/3242149634 learned_addr learned my addr 172.21.15.28:0/3242149634 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:49.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff04659c640 1 --2- 172.21.15.28:0/3242149634 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0480c4fb0 0x7ff0480c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:49.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff046d9d640 1 --2- 172.21.15.28:0/3242149634 >> v2:172.21.15.134:3300/0 conn(0x7ff04806c840 0x7ff04806ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:49.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff03ffff640 1 -- 172.21.15.28:0/3242149634 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0480c4fb0 msgr2=0x7ff0480c1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:49.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff03ffff640 1 --2- 172.21.15.28:0/3242149634 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0480c4fb0 0x7ff0480c1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff03ffff640 1 -- 172.21.15.28:0/3242149634 >> v2:172.21.15.134:3300/0 conn(0x7ff04806c840 msgr2=0x7ff04806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:49.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff03ffff640 1 --2- 172.21.15.28:0/3242149634 >> v2:172.21.15.134:3300/0 conn(0x7ff04806c840 0x7ff04806ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff03ffff640 1 -- 172.21.15.28:0/3242149634 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480a9270 con 0x7ff04806db90 2023-12-16T03:28:49.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff04659c640 1 --2- 172.21.15.28:0/3242149634 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0480c4fb0 0x7ff0480c1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:49.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.430+0000 7ff046d9d640 1 --2- 172.21.15.28:0/3242149634 >> v2:172.21.15.134:3300/0 conn(0x7ff04806c840 0x7ff04806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:49.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff03ffff640 1 --2- 172.21.15.28:0/3242149634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff04806db90 0x7ff04806dff0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff04806c340 tx=0x7ff03001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8169babc834cdbd server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:49.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff045d9b640 1 -- 172.21.15.28:0/3242149634 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300ac600 con 0x7ff04806db90 2023-12-16T03:28:49.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff045d9b640 1 -- 172.21.15.28:0/3242149634 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0300a8050 con 0x7ff04806db90 2023-12-16T03:28:49.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff045d9b640 1 -- 172.21.15.28:0/3242149634 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300ac980 con 0x7ff04806db90 2023-12-16T03:28:49.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff04cb65640 1 -- 172.21.15.28:0/3242149634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff04806db90 msgr2=0x7ff04806dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:49.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff04cb65640 1 --2- 172.21.15.28:0/3242149634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff04806db90 0x7ff04806dff0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff04806c340 tx=0x7ff03001c3e0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff04cb65640 1 -- 172.21.15.28:0/3242149634 shutdown_connections 2023-12-16T03:28:49.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff04cb65640 1 --2- 172.21.15.28:0/3242149634 >> v2:172.21.15.134:3300/0 conn(0x7ff04806c840 0x7ff04806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff04cb65640 1 --2- 172.21.15.28:0/3242149634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff04806db90 0x7ff04806dff0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff04cb65640 1 --2- 172.21.15.28:0/3242149634 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff0480c4fb0 0x7ff0480c1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff04cb65640 1 -- 172.21.15.28:0/3242149634 >> 172.21.15.28:0/3242149634 conn(0x7ff0480c5d40 msgr2=0x7ff0480c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:49.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff04cb65640 1 -- 172.21.15.28:0/3242149634 shutdown_connections 2023-12-16T03:28:49.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff04cb65640 1 -- 172.21.15.28:0/3242149634 wait complete. 2023-12-16T03:28:49.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff04cb65640 1 Processor -- start 2023-12-16T03:28:49.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.434+0000 7ff04cb65640 1 -- start start 2023-12-16T03:28:49.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04cb65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff04806c840 0x7ff04815a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:49.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04cb65640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff04806db90 0x7ff048154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:49.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04cb65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0480c4fb0 0x7ff048155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:49.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04cb65640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff048155a60 con 0x7ff04806c840 2023-12-16T03:28:49.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04cb65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff048099de0 con 0x7ff0480c4fb0 2023-12-16T03:28:49.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04cb65640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480a65f0 con 0x7ff04806db90 2023-12-16T03:28:49.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff04806c840 0x7ff04815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:49.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff04806c840 0x7ff04815a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34790/0 (socket says 172.21.15.28:34790) 2023-12-16T03:28:49.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04659c640 1 -- 172.21.15.28:0/3775784085 learned_addr learned my addr 172.21.15.28:0/3775784085 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:49.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff03ffff640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff04806db90 0x7ff048154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:49.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff046d9d640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0480c4fb0 0x7ff048155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:49.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04659c640 1 -- 172.21.15.28:0/3775784085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff04806db90 msgr2=0x7ff048154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:49.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04659c640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff04806db90 0x7ff048154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04659c640 1 -- 172.21.15.28:0/3775784085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0480c4fb0 msgr2=0x7ff048155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:49.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04659c640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0480c4fb0 0x7ff048155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:49.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04659c640 1 -- 172.21.15.28:0/3775784085 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300094d0 con 0x7ff04806c840 2023-12-16T03:28:49.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04659c640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff04806c840 0x7ff04815a490 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c7f0 tx=0x7ff03800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:49.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff03effd640 1 -- 172.21.15.28:0/3775784085 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038007820 con 0x7ff04806c840 2023-12-16T03:28:49.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff03effd640 1 -- 172.21.15.28:0/3775784085 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff038007980 con 0x7ff04806c840 2023-12-16T03:28:49.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff03effd640 1 -- 172.21.15.28:0/3775784085 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038007d30 con 0x7ff04806c840 2023-12-16T03:28:49.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04cb65640 1 -- 172.21.15.28:0/3775784085 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0480a68d0 con 0x7ff04806c840 2023-12-16T03:28:49.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04cb65640 1 -- 172.21.15.28:0/3775784085 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04815a9d0 con 0x7ff04806c840 2023-12-16T03:28:49.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff04cb65640 1 -- 172.21.15.28:0/3775784085 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0480a6450 con 0x7ff04806c840 2023-12-16T03:28:49.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.438+0000 7ff03effd640 1 -- 172.21.15.28:0/3775784085 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff0380113f0 con 0x7ff04806c840 2023-12-16T03:28:49.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.442+0000 7ff03effd640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff028066470 0x7ff028068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:49.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.442+0000 7ff03effd640 1 -- 172.21.15.28:0/3775784085 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5445+0+0 (secure 0 0 0) 0x7ff038083fb0 con 0x7ff04806c840 2023-12-16T03:28:49.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.442+0000 7ff03ffff640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff028066470 0x7ff028068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:49.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.442+0000 7ff03ffff640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff028066470 0x7ff028068930 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff0300ae000 tx=0x7ff0300a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:49.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.446+0000 7ff03effd640 1 -- 172.21.15.28:0/3775784085 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff0380b5290 con 0x7ff04806c840 2023-12-16T03:28:49.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:49.602+0000 7ff04cb65640 1 -- 172.21.15.28:0/3775784085 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff048068400 con 0x7ff04806c840 2023-12-16T03:28:50.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.249+0000 7ff03effd640 1 -- 172.21.15.28:0/3775784085 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v78) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff03801f0d0 con 0x7ff04806c840 2023-12-16T03:28:50.254 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs2_data' removed 2023-12-16T03:28:50.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.249+0000 7ff04cb65640 1 -- 172.21.15.28:0/3775784085 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff028066470 msgr2=0x7ff028068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.249+0000 7ff04cb65640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff028066470 0x7ff028068930 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff0300ae000 tx=0x7ff0300a7000 comp rx=0 tx=0).stop 2023-12-16T03:28:50.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.249+0000 7ff04cb65640 1 -- 172.21.15.28:0/3775784085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff04806c840 msgr2=0x7ff04815a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.249+0000 7ff04cb65640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff04806c840 0x7ff04815a490 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c7f0 tx=0x7ff03800ccb0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.253+0000 7ff04cb65640 1 -- 172.21.15.28:0/3775784085 shutdown_connections 2023-12-16T03:28:50.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.253+0000 7ff04cb65640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0480c4fb0 0x7ff048155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.253+0000 7ff04cb65640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff04806db90 0x7ff048154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.253+0000 7ff04cb65640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ff028066470 0x7ff028068930 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.253+0000 7ff04cb65640 1 --2- 172.21.15.28:0/3775784085 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff04806c840 0x7ff04815a490 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.253+0000 7ff04cb65640 1 -- 172.21.15.28:0/3775784085 >> 172.21.15.28:0/3775784085 conn(0x7ff0480c5d40 msgr2=0x7ff0480c6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:50.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.253+0000 7ff04cb65640 1 -- 172.21.15.28:0/3775784085 shutdown_connections 2023-12-16T03:28:50.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.253+0000 7ff04cb65640 1 -- 172.21.15.28:0/3775784085 wait complete. 2023-12-16T03:28:50.283 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-16T03:28:50.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.441+0000 7f5e0849a640 1 Processor -- start 2023-12-16T03:28:50.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.441+0000 7f5e0849a640 1 -- start start 2023-12-16T03:28:50.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e0849a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e000c2bb0 0x7f5e000c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:50.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e0849a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e000c31c0 con 0x7f5e000c4100 2023-12-16T03:28:50.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e0849a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e000c34a0 con 0x7f5e000c63c0 2023-12-16T03:28:50.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e0849a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e000c1030 con 0x7f5e000c2bb0 2023-12-16T03:28:50.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e05a35640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5e000c4100 0x7f5e000a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44016/0 (socket says 172.21.15.28:44016) 2023-12-16T03:28:50.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e05a35640 1 -- 172.21.15.28:0/1616706395 learned_addr learned my addr 172.21.15.28:0/1616706395 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:50.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e06a37640 1 --2- 172.21.15.28:0/1616706395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e000c2bb0 0x7f5e000c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:50.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e05234640 1 -- 172.21.15.28:0/1616706395 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263013159 0 0) 0x7f5e000c31c0 con 0x7f5e000c4100 2023-12-16T03:28:50.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e05234640 1 -- 172.21.15.28:0/1616706395 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dec003530 con 0x7f5e000c4100 2023-12-16T03:28:50.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e05234640 1 -- 172.21.15.28:0/1616706395 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240749764 0 0) 0x7f5e000c34a0 con 0x7f5e000c63c0 2023-12-16T03:28:50.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e05234640 1 -- 172.21.15.28:0/1616706395 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e000c31c0 con 0x7f5e000c63c0 2023-12-16T03:28:50.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e06a37640 1 -- 172.21.15.28:0/1616706395 >> v1:172.21.15.134:6789/0 conn(0x7f5e000c63c0 legacy=0x7f5e000c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e06a37640 1 -- 172.21.15.28:0/1616706395 >> v1:172.21.15.28:6789/0 conn(0x7f5e000c4100 legacy=0x7f5e000a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.445+0000 7f5e06a37640 1 -- 172.21.15.28:0/1616706395 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e000c1310 con 0x7f5e000c2bb0 2023-12-16T03:28:50.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e06a37640 1 --2- 172.21.15.28:0/1616706395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e000c2bb0 0x7f5e000c06d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009dc0 tx=0x7f5df801c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f02c5e8aa137fc07 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:50.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e05234640 1 -- 172.21.15.28:0/1616706395 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df80a5900 con 0x7f5e000c2bb0 2023-12-16T03:28:50.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e05234640 1 -- 172.21.15.28:0/1616706395 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df80a5a60 con 0x7f5e000c2bb0 2023-12-16T03:28:50.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e05234640 1 -- 172.21.15.28:0/1616706395 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df80a5dd0 con 0x7f5e000c2bb0 2023-12-16T03:28:50.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e0849a640 1 -- 172.21.15.28:0/1616706395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e000c2bb0 msgr2=0x7f5e000c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e0849a640 1 --2- 172.21.15.28:0/1616706395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e000c2bb0 0x7f5e000c06d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009dc0 tx=0x7f5df801c820 comp rx=0 tx=0).stop 2023-12-16T03:28:50.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e0849a640 1 -- 172.21.15.28:0/1616706395 shutdown_connections 2023-12-16T03:28:50.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e0849a640 1 --2- 172.21.15.28:0/1616706395 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e000c2bb0 0x7f5e000c06d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e0849a640 1 -- 172.21.15.28:0/1616706395 >> 172.21.15.28:0/1616706395 conn(0x7f5e0006a5b0 msgr2=0x7f5e0006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:50.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e0849a640 1 -- 172.21.15.28:0/1616706395 shutdown_connections 2023-12-16T03:28:50.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e0849a640 1 -- 172.21.15.28:0/1616706395 wait complete. 2023-12-16T03:28:50.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.449+0000 7f5e0849a640 1 Processor -- start 2023-12-16T03:28:50.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e0849a640 1 -- start start 2023-12-16T03:28:50.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e0849a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e000c2bb0 0x7f5e000bd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:50.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e0849a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e000c4100 0x7f5e000bde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:50.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e0849a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e000c63c0 0x7f5e00154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:50.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e0849a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0009a860 con 0x7f5e000c4100 2023-12-16T03:28:50.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e0849a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0009ab40 con 0x7f5e000c2bb0 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e0849a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e000bc920 con 0x7f5e000c63c0 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e05a35640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e000c4100 0x7f5e000bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e05a35640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e000c4100 0x7f5e000bde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43622/0 (socket says 172.21.15.28:43622) 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e05a35640 1 -- 172.21.15.28:0/332142339 learned_addr learned my addr 172.21.15.28:0/332142339 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e06236640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e000c2bb0 0x7f5e000bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e06a37640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e000c63c0 0x7f5e00154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e05a35640 1 -- 172.21.15.28:0/332142339 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e000c63c0 msgr2=0x7f5e00154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e05a35640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e000c63c0 0x7f5e00154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e05a35640 1 -- 172.21.15.28:0/332142339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e000c2bb0 msgr2=0x7f5e000bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e05a35640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e000c2bb0 0x7f5e000bd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e05a35640 1 -- 172.21.15.28:0/332142339 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df8009a70 con 0x7f5e000c4100 2023-12-16T03:28:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e05a35640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e000c4100 0x7f5e000bde60 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c4d0 tx=0x7f5df000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:50.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5df6ffd640 1 -- 172.21.15.28:0/332142339 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0005cf0 con 0x7f5e000c4100 2023-12-16T03:28:50.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5df6ffd640 1 -- 172.21.15.28:0/332142339 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0005e50 con 0x7f5e000c4100 2023-12-16T03:28:50.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5df6ffd640 1 -- 172.21.15.28:0/332142339 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0007270 con 0x7f5e000c4100 2023-12-16T03:28:50.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e0849a640 1 -- 172.21.15.28:0/332142339 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e000c69b0 con 0x7f5e000c4100 2023-12-16T03:28:50.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e0849a640 1 -- 172.21.15.28:0/332142339 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e000bcee0 con 0x7f5e000c4100 2023-12-16T03:28:50.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.453+0000 7f5e0849a640 1 -- 172.21.15.28:0/332142339 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e000bd100 con 0x7f5e000c4100 2023-12-16T03:28:50.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.457+0000 7f5df6ffd640 1 -- 172.21.15.28:0/332142339 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5df00073d0 con 0x7f5e000c4100 2023-12-16T03:28:50.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.457+0000 7f5df6ffd640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5de4066470 0x7f5de4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:50.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.457+0000 7f5df6ffd640 1 -- 172.21.15.28:0/332142339 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5df00830e0 con 0x7f5e000c4100 2023-12-16T03:28:50.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.457+0000 7f5e06236640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5de4066470 0x7f5de4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:50.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.457+0000 7f5e06236640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5de4066470 0x7f5de4068930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0011f0 tx=0x7f5dfc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:50.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.461+0000 7f5df6ffd640 1 -- 172.21.15.28:0/332142339 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5df00508c0 con 0x7f5e000c4100 2023-12-16T03:28:50.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.621+0000 7f5e0849a640 1 -- 172.21.15.28:0/332142339 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5e00068400 con 0x7f5e000c4100 2023-12-16T03:28:50.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5df6ffd640 1 -- 172.21.15.28:0/332142339 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5df0053ee0 con 0x7f5e000c4100 2023-12-16T03:28:50.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 -- 172.21.15.28:0/332142339 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5de4066470 msgr2=0x7f5de4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5de4066470 0x7f5de4068930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0011f0 tx=0x7f5dfc009040 comp rx=0 tx=0).stop 2023-12-16T03:28:50.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 -- 172.21.15.28:0/332142339 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e000c4100 msgr2=0x7f5e000bde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e000c4100 0x7f5e000bde60 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c4d0 tx=0x7f5df000c990 comp rx=0 tx=0).stop 2023-12-16T03:28:50.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 -- 172.21.15.28:0/332142339 shutdown_connections 2023-12-16T03:28:50.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5e000c63c0 0x7f5e00154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5de4066470 0x7f5de4068930 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5e000c4100 0x7f5e000bde60 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 --2- 172.21.15.28:0/332142339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e000c2bb0 0x7f5e000bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 -- 172.21.15.28:0/332142339 >> 172.21.15.28:0/332142339 conn(0x7f5e0006a5b0 msgr2=0x7f5e0006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:50.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 -- 172.21.15.28:0/332142339 shutdown_connections 2023-12-16T03:28:50.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.625+0000 7f5e0849a640 1 -- 172.21.15.28:0/332142339 wait complete. 2023-12-16T03:28:50.651 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-16T03:28:50.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.789+0000 7f4c8651d640 1 Processor -- start 2023-12-16T03:28:50.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.789+0000 7f4c8651d640 1 -- start start 2023-12-16T03:28:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c8651d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4c8014b010 0x7f4c800bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c8651d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4c80157c20 0x7f4c80158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c8651d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8006a5b0 con 0x7f4c80073a70 2023-12-16T03:28:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c8651d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8006b710 con 0x7f4c80157c20 2023-12-16T03:28:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c8651d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c800c1d60 con 0x7f4c8014b010 2023-12-16T03:28:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c84aba640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4c80157c20 0x7f4c80158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c7f7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4c80073a70 0x7f4c8006b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44032/0 (socket says 172.21.15.28:44032) 2023-12-16T03:28:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c7f7fe640 1 -- 172.21.15.28:0/197041009 learned_addr learned my addr 172.21.15.28:0/197041009 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c7ffff640 1 --2- 172.21.15.28:0/197041009 >> v2:172.21.15.134:3300/0 conn(0x7f4c8014b010 0x7f4c800bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c84aba640 1 -- 172.21.15.28:0/197041009 >> v2:172.21.15.134:3300/0 conn(0x7f4c8014b010 msgr2=0x7f4c800bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c84aba640 1 --2- 172.21.15.28:0/197041009 >> v2:172.21.15.134:3300/0 conn(0x7f4c8014b010 0x7f4c800bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c84aba640 1 -- 172.21.15.28:0/197041009 >> v1:172.21.15.28:6789/0 conn(0x7f4c80073a70 legacy=0x7f4c8006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c84aba640 1 -- 172.21.15.28:0/197041009 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c800c2040 con 0x7f4c80157c20 2023-12-16T03:28:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.793+0000 7f4c7effd640 1 -- 172.21.15.28:0/197041009 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892783017 0 0) 0x7f4c8006a5b0 con 0x7f4c80073a70 2023-12-16T03:28:50.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c84aba640 1 --2- 172.21.15.28:0/197041009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c80157c20 0x7f4c80158070 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f4c80070140 tx=0x7f4c7801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbea4281d200299 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:50.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c7effd640 1 -- 172.21.15.28:0/197041009 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c780b0440 con 0x7f4c80157c20 2023-12-16T03:28:50.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c7effd640 1 -- 172.21.15.28:0/197041009 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c780b05a0 con 0x7f4c80157c20 2023-12-16T03:28:50.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c7effd640 1 -- 172.21.15.28:0/197041009 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c780b0930 con 0x7f4c80157c20 2023-12-16T03:28:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 -- 172.21.15.28:0/197041009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c80157c20 msgr2=0x7f4c80158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 --2- 172.21.15.28:0/197041009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c80157c20 0x7f4c80158070 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f4c80070140 tx=0x7f4c7801f0f0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 -- 172.21.15.28:0/197041009 shutdown_connections 2023-12-16T03:28:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 --2- 172.21.15.28:0/197041009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c80157c20 0x7f4c80158070 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 --2- 172.21.15.28:0/197041009 >> v2:172.21.15.134:3300/0 conn(0x7f4c8014b010 0x7f4c800bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 -- 172.21.15.28:0/197041009 >> 172.21.15.28:0/197041009 conn(0x7f4c800c30c0 msgr2=0x7f4c800c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 -- 172.21.15.28:0/197041009 shutdown_connections 2023-12-16T03:28:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 -- 172.21.15.28:0/197041009 wait complete. 2023-12-16T03:28:50.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 Processor -- start 2023-12-16T03:28:50.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 -- start start 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c80073a70 0x7f4c801470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c8014b010 0x7f4c80147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.797+0000 7f4c8651d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c80157c20 0x7f4c801ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c8651d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8014c0c0 con 0x7f4c80157c20 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c8651d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c801eb200 con 0x7f4c8014b010 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c8651d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c80147b40 con 0x7f4c80073a70 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c84aba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c80157c20 0x7f4c801ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c84aba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c80157c20 0x7f4c801ed050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43646/0 (socket says 172.21.15.28:43646) 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c84aba640 1 -- 172.21.15.28:0/2771610141 learned_addr learned my addr 172.21.15.28:0/2771610141 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c7f7fe640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c8014b010 0x7f4c80147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c7ffff640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c80073a70 0x7f4c801470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:50.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c84aba640 1 -- 172.21.15.28:0/2771610141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c80073a70 msgr2=0x7f4c801470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c84aba640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c80073a70 0x7f4c801470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c84aba640 1 -- 172.21.15.28:0/2771610141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c8014b010 msgr2=0x7f4c80147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c84aba640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c8014b010 0x7f4c80147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c84aba640 1 -- 172.21.15.28:0/2771610141 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78009a70 con 0x7f4c80157c20 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c7f7fe640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c8014b010 0x7f4c80147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c7ffff640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c80073a70 0x7f4c801470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c84aba640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c80157c20 0x7f4c801ed050 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f4c7801bd00 tx=0x7f4c7801be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c7cff9640 1 -- 172.21.15.28:0/2771610141 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c780b0440 con 0x7f4c80157c20 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c7cff9640 1 -- 172.21.15.28:0/2771610141 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c780bc860 con 0x7f4c80157c20 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c7cff9640 1 -- 172.21.15.28:0/2771610141 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c780bcc10 con 0x7f4c80157c20 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c8651d640 1 -- 172.21.15.28:0/2771610141 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8014b820 con 0x7f4c80157c20 2023-12-16T03:28:50.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c8651d640 1 -- 172.21.15.28:0/2771610141 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8014bde0 con 0x7f4c80157c20 2023-12-16T03:28:50.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c8651d640 1 -- 172.21.15.28:0/2771610141 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c80068400 con 0x7f4c80157c20 2023-12-16T03:28:50.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.801+0000 7f4c7cff9640 1 -- 172.21.15.28:0/2771610141 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4c780c7460 con 0x7f4c80157c20 2023-12-16T03:28:50.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.805+0000 7f4c7cff9640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c6c0664c0 0x7f4c6c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:50.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.805+0000 7f4c7cff9640 1 -- 172.21.15.28:0/2771610141 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4c78122760 con 0x7f4c80157c20 2023-12-16T03:28:50.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.805+0000 7f4c7ffff640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c6c0664c0 0x7f4c6c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:50.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.805+0000 7f4c7ffff640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c6c0664c0 0x7f4c6c068980 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4c70007a70 tx=0x7f4c70008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:50.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:50.809+0000 7f4c7cff9640 1 -- 172.21.15.28:0/2771610141 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4c780eff60 con 0x7f4c80157c20 2023-12-16T03:28:51.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.021+0000 7f4c8651d640 1 -- 172.21.15.28:0/2771610141 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f4c801eb340 con 0x7f4c80157c20 2023-12-16T03:28:51.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.249+0000 7f4c7cff9640 1 -- 172.21.15.28:0/2771610141 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v230) v1 ==== 159+0+0 (secure 0 0 0) 0x7f4c780b50e0 con 0x7f4c80157c20 2023-12-16T03:28:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 -- 172.21.15.28:0/2771610141 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c6c0664c0 msgr2=0x7f4c6c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c6c0664c0 0x7f4c6c068980 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4c70007a70 tx=0x7f4c70008040 comp rx=0 tx=0).stop 2023-12-16T03:28:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 -- 172.21.15.28:0/2771610141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c80157c20 msgr2=0x7f4c801ed050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c80157c20 0x7f4c801ed050 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f4c7801bd00 tx=0x7f4c7801be90 comp rx=0 tx=0).stop 2023-12-16T03:28:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 -- 172.21.15.28:0/2771610141 shutdown_connections 2023-12-16T03:28:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4c6c0664c0 0x7f4c6c068980 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c80157c20 0x7f4c801ed050 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c8014b010 0x7f4c80147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 --2- 172.21.15.28:0/2771610141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c80073a70 0x7f4c801470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:51.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 -- 172.21.15.28:0/2771610141 >> 172.21.15.28:0/2771610141 conn(0x7f4c800c30c0 msgr2=0x7f4c800c5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:51.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 -- 172.21.15.28:0/2771610141 shutdown_connections 2023-12-16T03:28:51.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:51.253+0000 7f4c8651d640 1 -- 172.21.15.28:0/2771610141 wait complete. 2023-12-16T03:28:51.280 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2023-12-16T03:28:51.280 INFO:tasks.cephfs_test_runner: 2023-12-16T03:28:51.281 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-16T03:28:51.281 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-16T03:28:51.282 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi028 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner: 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner:Ran 3 tests in 190.009s 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner: 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner: 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-16T03:28:51.283 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-16T03:28:51.284 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi028 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-16T03:28:51.285 INFO:tasks.cephfs_test_runner: 2023-12-16T03:28:51.285 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-16T03:28:51.412 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8ffa7b838dc1454293881bdab00e1eed Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6d933094a156ec7587742e5aa25fba5ba27ec678/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-16T03:28:51.414 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-16T03:28:51.423 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-16T03:28:51.464 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-16T03:28:51.465 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-12-16T03:28:51.465 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:51.488 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7208 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-16T03:28:51.488 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-16T03:28:51.488 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-16T03:28:51.498 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-16T03:28:51.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:51.499 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2023-12-16T03:28:51.538 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-16T03:28:51.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:51.538 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-16T03:28:51.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:51.603 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link delete ceph-brx 2023-12-16T03:28:51.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:51.859 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-16T03:28:51.869 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-16T03:28:51.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:51.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-16T03:28:51.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-16T03:28:51.940 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2023-12-16T03:28:52.167 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-16T03:28:52.177 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-16T03:28:52.177 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:28:52.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a769a640 1 Processor -- start 2023-12-16T03:28:52.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a769a640 1 -- start start 2023-12-16T03:28:52.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a769a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006a5b0 0x7f73a006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a769a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f73a006b1e0 0x7f73a00c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a769a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a0072500 con 0x7f73a006dfe0 2023-12-16T03:28:52.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a769a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a006ef50 con 0x7f73a006b1e0 2023-12-16T03:28:52.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a769a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00720b0 con 0x7f73a006a5b0 2023-12-16T03:28:52.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a4c35640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f73a006dfe0 0x7f73a00c2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44048/0 (socket says 172.21.15.28:44048) 2023-12-16T03:28:52.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a4c35640 1 -- 172.21.15.28:0/1605993011 learned_addr learned my addr 172.21.15.28:0/1605993011 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:52.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a5436640 1 --2- 172.21.15.28:0/1605993011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006a5b0 0x7f73a006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a5c37640 1 --2- 172.21.15.28:0/1605993011 >> v2:172.21.15.134:3300/0 conn(0x7f73a006b1e0 0x7f73a00c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f7397fff640 1 -- 172.21.15.28:0/1605993011 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791398616 0 0) 0x7f73a0072500 con 0x7f73a006dfe0 2023-12-16T03:28:52.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f7397fff640 1 -- 172.21.15.28:0/1605993011 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f738c003530 con 0x7f73a006dfe0 2023-12-16T03:28:52.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a5436640 1 -- 172.21.15.28:0/1605993011 >> v2:172.21.15.134:3300/0 conn(0x7f73a006b1e0 msgr2=0x7f73a00c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:52.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a5436640 1 --2- 172.21.15.28:0/1605993011 >> v2:172.21.15.134:3300/0 conn(0x7f73a006b1e0 0x7f73a00c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a5436640 1 -- 172.21.15.28:0/1605993011 >> v1:172.21.15.28:6789/0 conn(0x7f73a006dfe0 legacy=0x7f73a00c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.317+0000 7f73a5436640 1 -- 172.21.15.28:0/1605993011 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a0070f60 con 0x7f73a006a5b0 2023-12-16T03:28:52.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f73a5436640 1 --2- 172.21.15.28:0/1605993011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006a5b0 0x7f73a006a990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f739c0097c0 tx=0x7f739c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d7ba6db6c213fe7 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:52.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f7397fff640 1 -- 172.21.15.28:0/1605993011 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c0ab600 con 0x7f73a006a5b0 2023-12-16T03:28:52.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f7397fff640 1 -- 172.21.15.28:0/1605993011 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c0a7050 con 0x7f73a006a5b0 2023-12-16T03:28:52.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f7397fff640 1 -- 172.21.15.28:0/1605993011 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c0ab980 con 0x7f73a006a5b0 2023-12-16T03:28:52.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f73a769a640 1 -- 172.21.15.28:0/1605993011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006a5b0 msgr2=0x7f73a006a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f73a769a640 1 --2- 172.21.15.28:0/1605993011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006a5b0 0x7f73a006a990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f739c0097c0 tx=0x7f739c01c3f0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f73a769a640 1 -- 172.21.15.28:0/1605993011 shutdown_connections 2023-12-16T03:28:52.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f73a769a640 1 --2- 172.21.15.28:0/1605993011 >> v2:172.21.15.134:3300/0 conn(0x7f73a006b1e0 0x7f73a00c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f73a769a640 1 --2- 172.21.15.28:0/1605993011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006a5b0 0x7f73a006a990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f73a769a640 1 -- 172.21.15.28:0/1605993011 >> 172.21.15.28:0/1605993011 conn(0x7f73a00c6ef0 msgr2=0x7f73a00c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:52.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f73a769a640 1 -- 172.21.15.28:0/1605993011 shutdown_connections 2023-12-16T03:28:52.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.321+0000 7f73a769a640 1 -- 172.21.15.28:0/1605993011 wait complete. 2023-12-16T03:28:52.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a769a640 1 Processor -- start 2023-12-16T03:28:52.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a769a640 1 -- start start 2023-12-16T03:28:52.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a769a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73a006a5b0 0x7f73a0139a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a769a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006b1e0 0x7f73a0142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a769a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a006dfe0 0x7f73a01ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a769a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0143e90 con 0x7f73a006a5b0 2023-12-16T03:28:52.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a769a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a01ecf10 con 0x7f73a006dfe0 2023-12-16T03:28:52.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a769a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0144130 con 0x7f73a006b1e0 2023-12-16T03:28:52.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a5436640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73a006a5b0 0x7f73a0139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a5436640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73a006a5b0 0x7f73a0139a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43656/0 (socket says 172.21.15.28:43656) 2023-12-16T03:28:52.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a5436640 1 -- 172.21.15.28:0/18073003 learned_addr learned my addr 172.21.15.28:0/18073003 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:52.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a4c35640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006b1e0 0x7f73a0142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a5c37640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a006dfe0 0x7f73a01ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a5436640 1 -- 172.21.15.28:0/18073003 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006b1e0 msgr2=0x7f73a0142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a5436640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006b1e0 0x7f73a0142f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a5436640 1 -- 172.21.15.28:0/18073003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a006dfe0 msgr2=0x7f73a01ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a5436640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a006dfe0 0x7f73a01ed410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a5436640 1 -- 172.21.15.28:0/18073003 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c009420 con 0x7f73a006a5b0 2023-12-16T03:28:52.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a4c35640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006b1e0 0x7f73a0142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:52.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a5c37640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a006dfe0 0x7f73a01ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:52.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a5436640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73a006a5b0 0x7f73a0139a70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f739c01a020 tx=0x7f739c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:52.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f7395ffb640 1 -- 172.21.15.28:0/18073003 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c0b7450 con 0x7f73a006a5b0 2023-12-16T03:28:52.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f7395ffb640 1 -- 172.21.15.28:0/18073003 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c0b75d0 con 0x7f73a006a5b0 2023-12-16T03:28:52.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a769a640 1 -- 172.21.15.28:0/18073003 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a0144410 con 0x7f73a006a5b0 2023-12-16T03:28:52.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f7395ffb640 1 -- 172.21.15.28:0/18073003 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c0b7980 con 0x7f73a006a5b0 2023-12-16T03:28:52.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.325+0000 7f73a769a640 1 -- 172.21.15.28:0/18073003 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a0139fb0 con 0x7f73a006a5b0 2023-12-16T03:28:52.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.329+0000 7f73a769a640 1 -- 172.21.15.28:0/18073003 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a01ed130 con 0x7f73a006a5b0 2023-12-16T03:28:52.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.329+0000 7f7395ffb640 1 -- 172.21.15.28:0/18073003 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f739c0b7ae0 con 0x7f73a006a5b0 2023-12-16T03:28:52.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.329+0000 7f7395ffb640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73840664a0 0x7f7384068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.329+0000 7f7395ffb640 1 -- 172.21.15.28:0/18073003 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f739c11e2b0 con 0x7f73a006a5b0 2023-12-16T03:28:52.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.329+0000 7f73a4c35640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73840664a0 0x7f7384068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.329+0000 7f73a4c35640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73840664a0 0x7f7384068960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f73900011f0 tx=0x7f7390009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:52.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.333+0000 7f7395ffb640 1 -- 172.21.15.28:0/18073003 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f73a01ed130 con 0x7f73a006a5b0 2023-12-16T03:28:52.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.489+0000 7f73a769a640 1 -- 172.21.15.28:0/18073003 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73a0071490 con 0x7f73840664a0 2023-12-16T03:28:52.497 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f7395ffb640 1 -- 172.21.15.28:0/18073003 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50901 (secure 0 0 0) 0x7f7390001480 con 0x7f73840664a0 2023-12-16T03:28:52.498 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:52.499 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:28:52.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 -- 172.21.15.28:0/18073003 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73840664a0 msgr2=0x7f7384068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73840664a0 0x7f7384068960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f73900011f0 tx=0x7f7390009040 comp rx=0 tx=0).stop 2023-12-16T03:28:52.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 -- 172.21.15.28:0/18073003 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73a006a5b0 msgr2=0x7f73a0139a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.499 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73a006a5b0 0x7f73a0139a70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f739c01a020 tx=0x7f739c01ac30 comp rx=0 tx=0).stop 2023-12-16T03:28:52.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 -- 172.21.15.28:0/18073003 shutdown_connections 2023-12-16T03:28:52.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a006dfe0 0x7f73a01ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f73a006b1e0 0x7f73a0142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f73840664a0 0x7f7384068960 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 --2- 172.21.15.28:0/18073003 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73a006a5b0 0x7f73a0139a70 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 -- 172.21.15.28:0/18073003 >> 172.21.15.28:0/18073003 conn(0x7f73a00c6ef0 msgr2=0x7f73a00c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:52.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 -- 172.21.15.28:0/18073003 shutdown_connections 2023-12-16T03:28:52.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.493+0000 7f73a769a640 1 -- 172.21.15.28:0/18073003 wait complete. 2023-12-16T03:28:52.518 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-12-16T03:28:51.842149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":251,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257992,"kb_used_data":8548,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716728,"statfs":{"total":773094113280,"available":772829929472,"internally_reserved":0,"allocated":8753152,"data_stored":4527991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001179"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":215,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-16T03:28:44.069009+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:28:44.069009+0000","last_peered":"2023-12-16T03:28:44.069009+0000","last_clean":"2023-12-16T03:28:44.069009+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:28:44.069009+0000","last_undegraded":"2023-12-16T03:28:44.069009+0000","last_fullsized":"2023-12-16T03:28:44.069009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1544192,"data_stored":1009724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85899999999999999,"5min":1.155,"15min":1.155},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70099999999999996,"15min":0.71099999999999997},"min":{"1min":0.51500000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89400000000000002,"5min":1.585,"15min":1.585},"last":0.64900000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.75800000000000001,"15min":0.78700000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95099999999999996,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.82599999999999996},"min":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84099999999999997,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99399999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.67500000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.871,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2370000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.499},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.38500000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78900000000000003,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.746,"15min":0.76100000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":937984,"data_stored":413725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.77100000000000002,"15min":0.81899999999999995},"min":{"1min":0.44700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.502,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.84099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.93200000000000005,"15min":1.046},"min":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85699999999999998,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.89900000000000002,"15min":1.002},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.51500000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.131,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91800000000000004,"5min":4.242,"15min":4.242},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.85999999999999999,"15min":0.92000000000000004},"min":{"1min":0.57399999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.873,"5min":1.111,"15min":1.111},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86099999999999999,"5min":1.073,"15min":1.073},"last":0.78300000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92800000000000005,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.89700000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.246,"15min":1.246},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80000000000000004,"15min":0.80800000000000005},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.88}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":419314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86699999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":1.111,"15min":1.111},"last":0.60299999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92500000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.75600000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.77000000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.51000000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71399999999999997,"15min":0.70699999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93999999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.622,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.71599999999999997},"min":{"1min":0.48199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63600000000000001,"15min":0.65100000000000002},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71199999999999997,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63100000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.81599999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.022,"5min":1.105,"15min":1.105},"last":0.74199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":424340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.751,"15min":0.79900000000000004},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":4.194,"15min":4.194},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.034,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.621,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95199999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.628}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.84899999999999998,"15min":0.93100000000000005},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0700000000000001,"5min":1.288,"15min":1.288},"last":0.70799999999999996}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84699999999999998,"15min":0.91800000000000004},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91200000000000003,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.878,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.70199999999999996,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.746},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73399999999999999,"15min":0.76200000000000001},"min":{"1min":0.47399999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85599999999999998,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.75,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92400000000000004,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93100000000000005,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85699999999999998,"5min":1.881,"15min":1.881},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80300000000000005,"15min":0.83499999999999996},"min":{"1min":0.53600000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.95599999999999996,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":430409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.66200000000000003,"15min":0.77600000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.375},{"interface":"front","average":{"1min":0.433,"5min":0.71599999999999997,"15min":0.83999999999999997},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.58699999999999997,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.64700000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60699999999999998,"15min":0.68500000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.57999999999999996,"15min":0.622},"min":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63700000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.628,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.82199999999999995,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.67600000000000005,"15min":0.747},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73799999999999999,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81100000000000005,"15min":0.85399999999999998},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.871,"15min":0.92100000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.016,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.84199999999999997,"15min":0.88800000000000001},"min":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.99199999999999999,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.85799999999999998,"15min":0.91000000000000003},"min":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.88800000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.82199999999999995}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84799999999999998,"15min":0.88400000000000001},"min":{"1min":0.60299999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.94799999999999995,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.88100000000000001,"15min":0.93899999999999995},"min":{"1min":0.60099999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98399999999999999,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.624}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97699999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90900000000000003,"15min":0.96499999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":3.375,"15min":3.375},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.436,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47799999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.42999999999999999},"min":{"1min":0.318,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.627,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.377}]},{"osd":3,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70699999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":1.022,"15min":1.022},"last":0.44500000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93700000000000006,"5min":1.587,"15min":1.587},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.76600000000000001,"15min":0.79900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90500000000000003,"5min":1.913,"15min":1.913},"last":0.73399999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.86899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.78000000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97599999999999998,"5min":1.018,"15min":1.018},"last":0.66000000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93200000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.77600000000000002,"15min":0.78700000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92600000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.81000000000000005,"15min":0.83999999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94999999999999996,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.97999999999999998,"5min":1.212,"15min":1.212},"last":0.55300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":413211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.55900000000000005,"15min":0.625},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61199999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.63600000000000001,"15min":0.70099999999999996},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70599999999999996,"5min":4.476,"15min":4.476},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.71399999999999997,"15min":0.83099999999999996},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66400000000000003,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.68100000000000005,"15min":0.77100000000000002},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.755,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.69899999999999995}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.66000000000000003,"15min":0.71999999999999997},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.68400000000000005},"min":{"1min":0.318,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81799999999999995,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.64300000000000002}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.94899999999999995,"15min":1.0549999999999999},"min":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86699999999999999,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.872,"15min":0.94999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98299999999999998,"5min":4.984,"15min":4.984},"last":0.999}]},{"osd":5,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.84699999999999998,"15min":0.92100000000000004},"min":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.98699999999999999,"15min":1.113},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":1.022}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.88700000000000001,"15min":0.96699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92000000000000004,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.99199999999999999,"15min":1.115},"min":{"1min":0.56200000000000006,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96599999999999997,"5min":7.681,"15min":7.681},"last":1.119}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.96099999999999997,"15min":1.0509999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94499999999999995,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":1.149},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.93200000000000005,"15min":1.0129999999999999},"min":{"1min":0.58899999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.042,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":1.135}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1004023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.67100000000000004,"15min":0.78300000000000003},"min":{"1min":0.30499999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.434},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.78900000000000003,"15min":0.92500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.82199999999999995,"15min":0.96299999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.499},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90100000000000002,"15min":1.0680000000000001},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79200000000000004,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.45800000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.80000000000000004,"15min":0.96799999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89800000000000002,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.71599999999999997,"15min":0.80400000000000005},"min":{"1min":0.36899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77000000000000002,"5min":3.254,"15min":3.254},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89400000000000002,"15min":0.96699999999999997},"min":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0660000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.92200000000000004,"15min":1.002},"min":{"1min":0.56499999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.82199999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.98999999999999999,"15min":1.1180000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.90500000000000003,"15min":1.0089999999999999},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.748}]},{"osd":6,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.90900000000000003,"15min":1.002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84499999999999997,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.056,"15min":1.206},"min":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.999,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.874}]},{"osd":7,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":1.0760000000000001,"15min":1.214},"min":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0980000000000001,"5min":4.444,"15min":4.444},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96299999999999997,"15min":1.056},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.94899999999999995,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.88800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:28:52.520 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:28:52.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7f068640 1 Processor -- start 2023-12-16T03:28:52.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7f068640 1 -- start start 2023-12-16T03:28:52.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7f068640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0b780c5260 0x7f0b7806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7f068640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b78155de0 0x7f0b78156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7f068640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b780c2580 con 0x7f0b780c5640 2023-12-16T03:28:52.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7f068640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b78153510 con 0x7f0b780c5260 2023-12-16T03:28:52.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7f068640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780c17f0 con 0x7f0b78155de0 2023-12-16T03:28:52.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7ce04640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0b780c5260 0x7f0b7806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7ce04640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0b780c5260 0x7f0b7806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43672/0 (socket says 172.21.15.28:43672) 2023-12-16T03:28:52.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7ce04640 1 -- 172.21.15.28:0/3870949764 learned_addr learned my addr 172.21.15.28:0/3870949764 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:52.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7d605640 1 --2- 172.21.15.28:0/3870949764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b78155de0 0x7f0b78156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7ce04640 1 -- 172.21.15.28:0/3870949764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b78155de0 msgr2=0x7f0b78156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:52.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7ce04640 1 --2- 172.21.15.28:0/3870949764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b78155de0 0x7f0b78156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7ce04640 1 -- 172.21.15.28:0/3870949764 >> v1:172.21.15.134:6789/0 conn(0x7f0b780c5640 legacy=0x7f0b780c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.657+0000 7f0b7ce04640 1 -- 172.21.15.28:0/3870949764 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b780c1a00 con 0x7f0b780c5260 2023-12-16T03:28:52.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b7ce04640 1 --2- 172.21.15.28:0/3870949764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b780c5260 0x7f0b7806d5b0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0b780c1930 tx=0x7f0b6c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27af1e1215029335 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:52.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b777fe640 1 -- 172.21.15.28:0/3870949764 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0ab660 con 0x7f0b780c5260 2023-12-16T03:28:52.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b777fe640 1 -- 172.21.15.28:0/3870949764 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c0ab7c0 con 0x7f0b780c5260 2023-12-16T03:28:52.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b777fe640 1 -- 172.21.15.28:0/3870949764 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0abb50 con 0x7f0b780c5260 2023-12-16T03:28:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b7f068640 1 -- 172.21.15.28:0/3870949764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b780c5260 msgr2=0x7f0b7806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b7f068640 1 --2- 172.21.15.28:0/3870949764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b780c5260 0x7f0b7806d5b0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0b780c1930 tx=0x7f0b6c01c460 comp rx=0 tx=0).stop 2023-12-16T03:28:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b7f068640 1 -- 172.21.15.28:0/3870949764 shutdown_connections 2023-12-16T03:28:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b7f068640 1 --2- 172.21.15.28:0/3870949764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b78155de0 0x7f0b78156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b7f068640 1 --2- 172.21.15.28:0/3870949764 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b780c5260 0x7f0b7806d5b0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b7f068640 1 -- 172.21.15.28:0/3870949764 >> 172.21.15.28:0/3870949764 conn(0x7f0b7806a5b0 msgr2=0x7f0b7806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b7f068640 1 -- 172.21.15.28:0/3870949764 shutdown_connections 2023-12-16T03:28:52.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.661+0000 7f0b7f068640 1 -- 172.21.15.28:0/3870949764 wait complete. 2023-12-16T03:28:52.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7f068640 1 Processor -- start 2023-12-16T03:28:52.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7f068640 1 -- start start 2023-12-16T03:28:52.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7f068640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b780c5260 0x7f0b780a8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7f068640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b780c5640 0x7f0b78156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7f068640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b78155de0 0x7f0b7814dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7f068640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b781579c0 con 0x7f0b780c5260 2023-12-16T03:28:52.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7f068640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780a9210 con 0x7f0b780c5640 2023-12-16T03:28:52.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7f068640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7814ea10 con 0x7f0b78155de0 2023-12-16T03:28:52.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7ce04640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b780c5260 0x7f0b780a8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7ce04640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b780c5260 0x7f0b780a8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43688/0 (socket says 172.21.15.28:43688) 2023-12-16T03:28:52.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7ce04640 1 -- 172.21.15.28:0/2923137284 learned_addr learned my addr 172.21.15.28:0/2923137284 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:52.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7d605640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b78155de0 0x7f0b7814dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b77fff640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b780c5640 0x7f0b78156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7ce04640 1 -- 172.21.15.28:0/2923137284 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b78155de0 msgr2=0x7f0b7814dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7ce04640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b78155de0 0x7f0b7814dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7ce04640 1 -- 172.21.15.28:0/2923137284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b780c5640 msgr2=0x7f0b78156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7ce04640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b780c5640 0x7f0b78156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7ce04640 1 -- 172.21.15.28:0/2923137284 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0094d0 con 0x7f0b780c5260 2023-12-16T03:28:52.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b77fff640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b780c5640 0x7f0b78156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:52.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b7ce04640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b780c5260 0x7f0b780a8210 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0ad040 tx=0x7f0b6c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:52.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.665+0000 7f0b757fa640 1 -- 172.21.15.28:0/2923137284 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0b4800 con 0x7f0b780c5260 2023-12-16T03:28:52.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.669+0000 7f0b757fa640 1 -- 172.21.15.28:0/2923137284 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c0b4980 con 0x7f0b780c5260 2023-12-16T03:28:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.669+0000 7f0b757fa640 1 -- 172.21.15.28:0/2923137284 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0b4d30 con 0x7f0b780c5260 2023-12-16T03:28:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.669+0000 7f0b7f068640 1 -- 172.21.15.28:0/2923137284 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7814ec60 con 0x7f0b780c5260 2023-12-16T03:28:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.669+0000 7f0b7f068640 1 -- 172.21.15.28:0/2923137284 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b780a8cf0 con 0x7f0b780c5260 2023-12-16T03:28:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.669+0000 7f0b7f068640 1 -- 172.21.15.28:0/2923137284 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b781f0da0 con 0x7f0b780c5260 2023-12-16T03:28:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.669+0000 7f0b757fa640 1 -- 172.21.15.28:0/2923137284 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0b6c0a9070 con 0x7f0b780c5260 2023-12-16T03:28:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.669+0000 7f0b757fa640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0b5c0664a0 0x7f0b5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:52.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.669+0000 7f0b757fa640 1 -- 172.21.15.28:0/2923137284 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0b6c11e500 con 0x7f0b780c5260 2023-12-16T03:28:52.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.669+0000 7f0b77fff640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0b5c0664a0 0x7f0b5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:52.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.673+0000 7f0b77fff640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0b5c0664a0 0x7f0b5c068960 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0b78071e10 tx=0x7f0b64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:52.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.673+0000 7f0b757fa640 1 -- 172.21.15.28:0/2923137284 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0b6c0ebd60 con 0x7f0b780c5260 2023-12-16T03:28:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.829+0000 7f0b7f068640 1 -- 172.21.15.28:0/2923137284 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b780a8b70 con 0x7f0b5c0664a0 2023-12-16T03:28:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b757fa640 1 -- 172.21.15.28:0/2923137284 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50901 (secure 0 0 0) 0x7f0b640013f0 con 0x7f0b5c0664a0 2023-12-16T03:28:52.838 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:52.839 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:28:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 -- 172.21.15.28:0/2923137284 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0b5c0664a0 msgr2=0x7f0b5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0b5c0664a0 0x7f0b5c068960 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0b78071e10 tx=0x7f0b64009040 comp rx=0 tx=0).stop 2023-12-16T03:28:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 -- 172.21.15.28:0/2923137284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b780c5260 msgr2=0x7f0b780a8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b780c5260 0x7f0b780a8210 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0ad040 tx=0x7f0b6c01aca0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 -- 172.21.15.28:0/2923137284 shutdown_connections 2023-12-16T03:28:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0b78155de0 0x7f0b7814dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b780c5640 0x7f0b78156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0b5c0664a0 0x7f0b5c068960 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 --2- 172.21.15.28:0/2923137284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b780c5260 0x7f0b780a8210 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 -- 172.21.15.28:0/2923137284 >> 172.21.15.28:0/2923137284 conn(0x7f0b7806a5b0 msgr2=0x7f0b780a5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 -- 172.21.15.28:0/2923137284 shutdown_connections 2023-12-16T03:28:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:52.833+0000 7f0b7f068640 1 -- 172.21.15.28:0/2923137284 wait complete. 2023-12-16T03:28:52.860 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-12-16T03:28:51.842149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":251,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257992,"kb_used_data":8548,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716728,"statfs":{"total":773094113280,"available":772829929472,"internally_reserved":0,"allocated":8753152,"data_stored":4527991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001179"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":215,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-16T03:28:44.069009+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:28:44.069009+0000","last_peered":"2023-12-16T03:28:44.069009+0000","last_clean":"2023-12-16T03:28:44.069009+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:28:44.069009+0000","last_undegraded":"2023-12-16T03:28:44.069009+0000","last_fullsized":"2023-12-16T03:28:44.069009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1544192,"data_stored":1009724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85899999999999999,"5min":1.155,"15min":1.155},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70099999999999996,"15min":0.71099999999999997},"min":{"1min":0.51500000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89400000000000002,"5min":1.585,"15min":1.585},"last":0.64900000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.75800000000000001,"15min":0.78700000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95099999999999996,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.82599999999999996},"min":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84099999999999997,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99399999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.67500000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.871,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2370000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.499},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.38500000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78900000000000003,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.746,"15min":0.76100000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":937984,"data_stored":413725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.77100000000000002,"15min":0.81899999999999995},"min":{"1min":0.44700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.502,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.84099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.93200000000000005,"15min":1.046},"min":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85699999999999998,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.89900000000000002,"15min":1.002},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.51500000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.131,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91800000000000004,"5min":4.242,"15min":4.242},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.85999999999999999,"15min":0.92000000000000004},"min":{"1min":0.57399999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.873,"5min":1.111,"15min":1.111},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86099999999999999,"5min":1.073,"15min":1.073},"last":0.78300000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92800000000000005,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.89700000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.246,"15min":1.246},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80000000000000004,"15min":0.80800000000000005},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.88}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":419314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86699999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":1.111,"15min":1.111},"last":0.60299999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92500000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.75600000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.77000000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.51000000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71399999999999997,"15min":0.70699999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93999999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.622,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.71599999999999997},"min":{"1min":0.48199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63600000000000001,"15min":0.65100000000000002},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71199999999999997,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63100000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.81599999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.022,"5min":1.105,"15min":1.105},"last":0.74199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":424340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.751,"15min":0.79900000000000004},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":4.194,"15min":4.194},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.034,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.621,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95199999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.628}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.84899999999999998,"15min":0.93100000000000005},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0700000000000001,"5min":1.288,"15min":1.288},"last":0.70799999999999996}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84699999999999998,"15min":0.91800000000000004},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91200000000000003,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.878,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.70199999999999996,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.746},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73399999999999999,"15min":0.76200000000000001},"min":{"1min":0.47399999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85599999999999998,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.75,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92400000000000004,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93100000000000005,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85699999999999998,"5min":1.881,"15min":1.881},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80300000000000005,"15min":0.83499999999999996},"min":{"1min":0.53600000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.95599999999999996,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":430409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.66200000000000003,"15min":0.77600000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.375},{"interface":"front","average":{"1min":0.433,"5min":0.71599999999999997,"15min":0.83999999999999997},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.58699999999999997,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.64700000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60699999999999998,"15min":0.68500000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.57999999999999996,"15min":0.622},"min":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63700000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.628,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.82199999999999995,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.67600000000000005,"15min":0.747},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73799999999999999,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81100000000000005,"15min":0.85399999999999998},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.871,"15min":0.92100000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.016,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.84199999999999997,"15min":0.88800000000000001},"min":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.99199999999999999,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.85799999999999998,"15min":0.91000000000000003},"min":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.88800000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.82199999999999995}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84799999999999998,"15min":0.88400000000000001},"min":{"1min":0.60299999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.94799999999999995,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.88100000000000001,"15min":0.93899999999999995},"min":{"1min":0.60099999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98399999999999999,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.624}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97699999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90900000000000003,"15min":0.96499999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":3.375,"15min":3.375},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.436,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47799999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.42999999999999999},"min":{"1min":0.318,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.627,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.377}]},{"osd":3,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70699999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":1.022,"15min":1.022},"last":0.44500000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93700000000000006,"5min":1.587,"15min":1.587},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.76600000000000001,"15min":0.79900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90500000000000003,"5min":1.913,"15min":1.913},"last":0.73399999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.86899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.78000000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97599999999999998,"5min":1.018,"15min":1.018},"last":0.66000000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93200000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.77600000000000002,"15min":0.78700000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92600000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.81000000000000005,"15min":0.83999999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94999999999999996,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.97999999999999998,"5min":1.212,"15min":1.212},"last":0.55300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":413211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.55900000000000005,"15min":0.625},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61199999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.63600000000000001,"15min":0.70099999999999996},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70599999999999996,"5min":4.476,"15min":4.476},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.71399999999999997,"15min":0.83099999999999996},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66400000000000003,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.68100000000000005,"15min":0.77100000000000002},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.755,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.69899999999999995}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.66000000000000003,"15min":0.71999999999999997},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.68400000000000005},"min":{"1min":0.318,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81799999999999995,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.64300000000000002}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.94899999999999995,"15min":1.0549999999999999},"min":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86699999999999999,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.872,"15min":0.94999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98299999999999998,"5min":4.984,"15min":4.984},"last":0.999}]},{"osd":5,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.84699999999999998,"15min":0.92100000000000004},"min":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.98699999999999999,"15min":1.113},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":1.022}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.88700000000000001,"15min":0.96699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92000000000000004,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.99199999999999999,"15min":1.115},"min":{"1min":0.56200000000000006,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96599999999999997,"5min":7.681,"15min":7.681},"last":1.119}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.96099999999999997,"15min":1.0509999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94499999999999995,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":1.149},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.93200000000000005,"15min":1.0129999999999999},"min":{"1min":0.58899999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.042,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":1.135}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1004023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.67100000000000004,"15min":0.78300000000000003},"min":{"1min":0.30499999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.434},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.78900000000000003,"15min":0.92500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.82199999999999995,"15min":0.96299999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.499},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90100000000000002,"15min":1.0680000000000001},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79200000000000004,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.45800000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.80000000000000004,"15min":0.96799999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89800000000000002,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.71599999999999997,"15min":0.80400000000000005},"min":{"1min":0.36899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77000000000000002,"5min":3.254,"15min":3.254},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89400000000000002,"15min":0.96699999999999997},"min":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0660000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.92200000000000004,"15min":1.002},"min":{"1min":0.56499999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.82199999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.98999999999999999,"15min":1.1180000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.90500000000000003,"15min":1.0089999999999999},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.748}]},{"osd":6,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.90900000000000003,"15min":1.002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84499999999999997,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.056,"15min":1.206},"min":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.999,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.874}]},{"osd":7,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":1.0760000000000001,"15min":1.214},"min":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0980000000000001,"5min":4.444,"15min":4.444},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96299999999999997,"15min":1.056},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.94899999999999995,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.88800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:28:52.862 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-16T03:28:52.862 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:28:53.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f2312a640 1 Processor -- start 2023-12-16T03:28:53.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f2312a640 1 -- start start 2023-12-16T03:28:53.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f2312a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7f1c14b010 0x7f7f1c0bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f2312a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7f1c073a70 0x7f7f1c06b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f2312a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f1c06b540 0x7f7f1c157c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f2312a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1c06a5b0 con 0x7f7f1c14b010 2023-12-16T03:28:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f2312a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1c0c1d60 con 0x7f7f1c073a70 2023-12-16T03:28:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f2312a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c0c2040 con 0x7f7f1c06b540 2023-12-16T03:28:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f20ec6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7f1c14b010 0x7f7f1c0bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f20ec6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7f1c14b010 0x7f7f1c0bf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43700/0 (socket says 172.21.15.28:43700) 2023-12-16T03:28:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f20ec6640 1 -- 172.21.15.28:0/1346943881 learned_addr learned my addr 172.21.15.28:0/1346943881 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f216c7640 1 --2- 172.21.15.28:0/1346943881 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f1c06b540 0x7f7f1c157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f1bfff640 1 --2- 172.21.15.28:0/1346943881 >> v2:172.21.15.134:3300/0 conn(0x7f7f1c073a70 0x7f7f1c06b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f20ec6640 1 -- 172.21.15.28:0/1346943881 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f1c06b540 msgr2=0x7f7f1c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f20ec6640 1 --2- 172.21.15.28:0/1346943881 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f1c06b540 0x7f7f1c157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f20ec6640 1 -- 172.21.15.28:0/1346943881 >> v2:172.21.15.134:3300/0 conn(0x7f7f1c073a70 msgr2=0x7f7f1c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f20ec6640 1 --2- 172.21.15.28:0/1346943881 >> v2:172.21.15.134:3300/0 conn(0x7f7f1c073a70 0x7f7f1c06b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.001+0000 7f7f20ec6640 1 -- 172.21.15.28:0/1346943881 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c06a800 con 0x7f7f1c14b010 2023-12-16T03:28:53.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f20ec6640 1 --2- 172.21.15.28:0/1346943881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f1c14b010 0x7f7f1c0bf9f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c04ede0 tx=0x7f7f1001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c64f3acfe0e0ba server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:53.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f1b7fe640 1 -- 172.21.15.28:0/1346943881 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100a89b0 con 0x7f7f1c14b010 2023-12-16T03:28:53.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f1b7fe640 1 -- 172.21.15.28:0/1346943881 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f100a8b10 con 0x7f7f1c14b010 2023-12-16T03:28:53.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f1b7fe640 1 -- 172.21.15.28:0/1346943881 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100a8ea0 con 0x7f7f1c14b010 2023-12-16T03:28:53.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f2312a640 1 -- 172.21.15.28:0/1346943881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f1c14b010 msgr2=0x7f7f1c0bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:53.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f2312a640 1 --2- 172.21.15.28:0/1346943881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f1c14b010 0x7f7f1c0bf9f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c04ede0 tx=0x7f7f1001ecf0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f2312a640 1 -- 172.21.15.28:0/1346943881 shutdown_connections 2023-12-16T03:28:53.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f2312a640 1 --2- 172.21.15.28:0/1346943881 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f1c06b540 0x7f7f1c157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f2312a640 1 --2- 172.21.15.28:0/1346943881 >> v2:172.21.15.134:3300/0 conn(0x7f7f1c073a70 0x7f7f1c06b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f2312a640 1 --2- 172.21.15.28:0/1346943881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f1c14b010 0x7f7f1c0bf9f0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f2312a640 1 -- 172.21.15.28:0/1346943881 >> 172.21.15.28:0/1346943881 conn(0x7f7f1c0c30c0 msgr2=0x7f7f1c0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:53.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f2312a640 1 -- 172.21.15.28:0/1346943881 shutdown_connections 2023-12-16T03:28:53.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.005+0000 7f7f2312a640 1 -- 172.21.15.28:0/1346943881 wait complete. 2023-12-16T03:28:53.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f2312a640 1 Processor -- start 2023-12-16T03:28:53.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f2312a640 1 -- start start 2023-12-16T03:28:53.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f2312a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f1c073a70 0x7f7f1c1ed220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f2312a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f1c14b010 0x7f7f1c14eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f2312a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f1c1551b0 0x7f7f1c1507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f2312a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c1eda50 con 0x7f7f1c073a70 2023-12-16T03:28:53.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f2312a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c1edd30 con 0x7f7f1c1551b0 2023-12-16T03:28:53.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f2312a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c1ee010 con 0x7f7f1c14b010 2023-12-16T03:28:53.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f20ec6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f1c073a70 0x7f7f1c1ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f20ec6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f1c073a70 0x7f7f1c1ed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43712/0 (socket says 172.21.15.28:43712) 2023-12-16T03:28:53.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f20ec6640 1 -- 172.21.15.28:0/1439722109 learned_addr learned my addr 172.21.15.28:0/1439722109 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:53.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f216c7640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f1c1551b0 0x7f7f1c1507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f1bfff640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f1c14b010 0x7f7f1c14eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f20ec6640 1 -- 172.21.15.28:0/1439722109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f1c14b010 msgr2=0x7f7f1c14eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:53.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f20ec6640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f1c14b010 0x7f7f1c14eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f20ec6640 1 -- 172.21.15.28:0/1439722109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f1c1551b0 msgr2=0x7f7f1c1507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:53.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f20ec6640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f1c1551b0 0x7f7f1c1507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f20ec6640 1 -- 172.21.15.28:0/1439722109 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100094d0 con 0x7f7f1c073a70 2023-12-16T03:28:53.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f216c7640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f1c1551b0 0x7f7f1c1507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:53.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f20ec6640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f1c073a70 0x7f7f1c1ed220 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f7f1001d3a0 tx=0x7f7f1001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:53.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f197fa640 1 -- 172.21.15.28:0/1439722109 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100ba600 con 0x7f7f1c073a70 2023-12-16T03:28:53.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f197fa640 1 -- 172.21.15.28:0/1439722109 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f100ba760 con 0x7f7f1c073a70 2023-12-16T03:28:53.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f197fa640 1 -- 172.21.15.28:0/1439722109 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100bab10 con 0x7f7f1c073a70 2023-12-16T03:28:53.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f2312a640 1 -- 172.21.15.28:0/1439722109 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c155cf0 con 0x7f7f1c073a70 2023-12-16T03:28:53.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f2312a640 1 -- 172.21.15.28:0/1439722109 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c1ed760 con 0x7f7f1c073a70 2023-12-16T03:28:53.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.009+0000 7f7f2312a640 1 -- 172.21.15.28:0/1439722109 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c068400 con 0x7f7f1c073a70 2023-12-16T03:28:53.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.013+0000 7f7f197fa640 1 -- 172.21.15.28:0/1439722109 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7f100bac70 con 0x7f7f1c073a70 2023-12-16T03:28:53.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.013+0000 7f7f197fa640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f00066470 0x7f7f00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.013+0000 7f7f197fa640 1 -- 172.21.15.28:0/1439722109 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7f101221b0 con 0x7f7f1c073a70 2023-12-16T03:28:53.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.013+0000 7f7f1bfff640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f00066470 0x7f7f00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.013+0000 7f7f1bfff640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f00066470 0x7f7f00068930 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c145a60 tx=0x7f7f08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:53.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.017+0000 7f7f197fa640 1 -- 172.21.15.28:0/1439722109 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7f100ef8d0 con 0x7f7f1c073a70 2023-12-16T03:28:53.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.169+0000 7f7f2312a640 1 -- 172.21.15.28:0/1439722109 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f1c0735f0 con 0x7f7f00066470 2023-12-16T03:28:53.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.173+0000 7f7f197fa640 1 -- 172.21.15.28:0/1439722109 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50901 (secure 0 0 0) 0x7f7f0800b670 con 0x7f7f00066470 2023-12-16T03:28:53.179 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:53.179 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:28:53.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.173+0000 7f7f2312a640 1 -- 172.21.15.28:0/1439722109 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f00066470 msgr2=0x7f7f00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.173+0000 7f7f2312a640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f00066470 0x7f7f00068930 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c145a60 tx=0x7f7f08008040 comp rx=0 tx=0).stop 2023-12-16T03:28:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.173+0000 7f7f2312a640 1 -- 172.21.15.28:0/1439722109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f1c073a70 msgr2=0x7f7f1c1ed220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.173+0000 7f7f2312a640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f1c073a70 0x7f7f1c1ed220 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f7f1001d3a0 tx=0x7f7f1001ba90 comp rx=0 tx=0).stop 2023-12-16T03:28:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.177+0000 7f7f2312a640 1 -- 172.21.15.28:0/1439722109 shutdown_connections 2023-12-16T03:28:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.177+0000 7f7f2312a640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f1c1551b0 0x7f7f1c1507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.177+0000 7f7f2312a640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f1c14b010 0x7f7f1c14eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.177+0000 7f7f2312a640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f7f00066470 0x7f7f00068930 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.177+0000 7f7f2312a640 1 --2- 172.21.15.28:0/1439722109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f1c073a70 0x7f7f1c1ed220 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.177+0000 7f7f2312a640 1 -- 172.21.15.28:0/1439722109 >> 172.21.15.28:0/1439722109 conn(0x7f7f1c0c30c0 msgr2=0x7f7f1c1494c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:53.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.177+0000 7f7f2312a640 1 -- 172.21.15.28:0/1439722109 shutdown_connections 2023-12-16T03:28:53.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.177+0000 7f7f2312a640 1 -- 172.21.15.28:0/1439722109 wait complete. 2023-12-16T03:28:53.199 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-12-16T03:28:51.842149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":251,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257992,"kb_used_data":8548,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716728,"statfs":{"total":773094113280,"available":772829929472,"internally_reserved":0,"allocated":8753152,"data_stored":4527991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001179"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":215,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-16T03:28:44.069009+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:28:44.069009+0000","last_peered":"2023-12-16T03:28:44.069009+0000","last_clean":"2023-12-16T03:28:44.069009+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:28:44.069009+0000","last_undegraded":"2023-12-16T03:28:44.069009+0000","last_fullsized":"2023-12-16T03:28:44.069009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1544192,"data_stored":1009724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85899999999999999,"5min":1.155,"15min":1.155},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70099999999999996,"15min":0.71099999999999997},"min":{"1min":0.51500000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89400000000000002,"5min":1.585,"15min":1.585},"last":0.64900000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.75800000000000001,"15min":0.78700000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95099999999999996,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.82599999999999996},"min":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84099999999999997,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99399999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.67500000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.871,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2370000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.499},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.38500000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78900000000000003,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.746,"15min":0.76100000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":937984,"data_stored":413725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.77100000000000002,"15min":0.81899999999999995},"min":{"1min":0.44700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.502,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.84099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.93200000000000005,"15min":1.046},"min":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85699999999999998,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.89900000000000002,"15min":1.002},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.51500000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.131,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91800000000000004,"5min":4.242,"15min":4.242},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.85999999999999999,"15min":0.92000000000000004},"min":{"1min":0.57399999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.873,"5min":1.111,"15min":1.111},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86099999999999999,"5min":1.073,"15min":1.073},"last":0.78300000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92800000000000005,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.89700000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.246,"15min":1.246},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80000000000000004,"15min":0.80800000000000005},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.88}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":419314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86699999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":1.111,"15min":1.111},"last":0.60299999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92500000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.75600000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.77000000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.51000000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71399999999999997,"15min":0.70699999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93999999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.622,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.71599999999999997},"min":{"1min":0.48199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63600000000000001,"15min":0.65100000000000002},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71199999999999997,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63100000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.81599999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.022,"5min":1.105,"15min":1.105},"last":0.74199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":424340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.751,"15min":0.79900000000000004},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":4.194,"15min":4.194},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.034,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.621,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95199999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.628}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.84899999999999998,"15min":0.93100000000000005},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0700000000000001,"5min":1.288,"15min":1.288},"last":0.70799999999999996}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84699999999999998,"15min":0.91800000000000004},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91200000000000003,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.878,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.70199999999999996,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.746},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73399999999999999,"15min":0.76200000000000001},"min":{"1min":0.47399999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85599999999999998,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.75,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92400000000000004,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93100000000000005,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85699999999999998,"5min":1.881,"15min":1.881},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80300000000000005,"15min":0.83499999999999996},"min":{"1min":0.53600000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.95599999999999996,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":430409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.66200000000000003,"15min":0.77600000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.375},{"interface":"front","average":{"1min":0.433,"5min":0.71599999999999997,"15min":0.83999999999999997},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.58699999999999997,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.64700000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60699999999999998,"15min":0.68500000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.57999999999999996,"15min":0.622},"min":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63700000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.628,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.82199999999999995,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.67600000000000005,"15min":0.747},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73799999999999999,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81100000000000005,"15min":0.85399999999999998},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.871,"15min":0.92100000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.016,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.84199999999999997,"15min":0.88800000000000001},"min":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.99199999999999999,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.85799999999999998,"15min":0.91000000000000003},"min":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.88800000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.82199999999999995}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84799999999999998,"15min":0.88400000000000001},"min":{"1min":0.60299999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.94799999999999995,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.88100000000000001,"15min":0.93899999999999995},"min":{"1min":0.60099999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98399999999999999,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.624}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97699999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90900000000000003,"15min":0.96499999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":3.375,"15min":3.375},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.436,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47799999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.42999999999999999},"min":{"1min":0.318,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.627,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.377}]},{"osd":3,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70699999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":1.022,"15min":1.022},"last":0.44500000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93700000000000006,"5min":1.587,"15min":1.587},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.76600000000000001,"15min":0.79900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90500000000000003,"5min":1.913,"15min":1.913},"last":0.73399999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.86899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.78000000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97599999999999998,"5min":1.018,"15min":1.018},"last":0.66000000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93200000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.77600000000000002,"15min":0.78700000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92600000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.81000000000000005,"15min":0.83999999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94999999999999996,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.97999999999999998,"5min":1.212,"15min":1.212},"last":0.55300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":413211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.55900000000000005,"15min":0.625},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61199999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.63600000000000001,"15min":0.70099999999999996},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70599999999999996,"5min":4.476,"15min":4.476},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.71399999999999997,"15min":0.83099999999999996},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66400000000000003,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.68100000000000005,"15min":0.77100000000000002},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.755,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.69899999999999995}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.66000000000000003,"15min":0.71999999999999997},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.68400000000000005},"min":{"1min":0.318,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81799999999999995,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.64300000000000002}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.94899999999999995,"15min":1.0549999999999999},"min":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86699999999999999,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.872,"15min":0.94999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98299999999999998,"5min":4.984,"15min":4.984},"last":0.999}]},{"osd":5,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.84699999999999998,"15min":0.92100000000000004},"min":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.98699999999999999,"15min":1.113},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":1.022}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.88700000000000001,"15min":0.96699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92000000000000004,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.99199999999999999,"15min":1.115},"min":{"1min":0.56200000000000006,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96599999999999997,"5min":7.681,"15min":7.681},"last":1.119}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.96099999999999997,"15min":1.0509999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94499999999999995,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":1.149},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.93200000000000005,"15min":1.0129999999999999},"min":{"1min":0.58899999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.042,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":1.135}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1004023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.67100000000000004,"15min":0.78300000000000003},"min":{"1min":0.30499999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.434},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.78900000000000003,"15min":0.92500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.82199999999999995,"15min":0.96299999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.499},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90100000000000002,"15min":1.0680000000000001},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79200000000000004,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.45800000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.80000000000000004,"15min":0.96799999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89800000000000002,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.71599999999999997,"15min":0.80400000000000005},"min":{"1min":0.36899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77000000000000002,"5min":3.254,"15min":3.254},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89400000000000002,"15min":0.96699999999999997},"min":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0660000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.92200000000000004,"15min":1.002},"min":{"1min":0.56499999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.82199999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.98999999999999999,"15min":1.1180000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.90500000000000003,"15min":1.0089999999999999},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.748}]},{"osd":6,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.90900000000000003,"15min":1.002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84499999999999997,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.056,"15min":1.206},"min":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.999,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.874}]},{"osd":7,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":1.0760000000000001,"15min":1.214},"min":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0980000000000001,"5min":4.444,"15min":4.444},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96299999999999997,"15min":1.056},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.94899999999999995,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.88800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:28:53.201 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-16T03:28:53.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.337+0000 7f16cae17640 1 Processor -- start 2023-12-16T03:28:53.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.337+0000 7f16cae17640 1 -- start start 2023-12-16T03:28:53.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16cae17640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f16c414b010 0x7f16c40bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16cae17640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f16c4073a70 0x7f16c406b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16cae17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16c406b540 0x7f16c4157c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16cae17640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c406a5b0 con 0x7f16c414b010 2023-12-16T03:28:53.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16cae17640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c40c1d60 con 0x7f16c4073a70 2023-12-16T03:28:53.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16cae17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40c2040 con 0x7f16c406b540 2023-12-16T03:28:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16c8bb3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f16c414b010 0x7f16c40bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16c8bb3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f16c414b010 0x7f16c40bf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43716/0 (socket says 172.21.15.28:43716) 2023-12-16T03:28:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16c8bb3640 1 -- 172.21.15.28:0/4023983414 learned_addr learned my addr 172.21.15.28:0/4023983414 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16c93b4640 1 --2- 172.21.15.28:0/4023983414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16c406b540 0x7f16c4157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16c3fff640 1 --2- 172.21.15.28:0/4023983414 >> v2:172.21.15.134:3300/0 conn(0x7f16c4073a70 0x7f16c406b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16c8bb3640 1 -- 172.21.15.28:0/4023983414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16c406b540 msgr2=0x7f16c4157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16c8bb3640 1 --2- 172.21.15.28:0/4023983414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16c406b540 0x7f16c4157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16c8bb3640 1 -- 172.21.15.28:0/4023983414 >> v2:172.21.15.134:3300/0 conn(0x7f16c4073a70 msgr2=0x7f16c406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16c8bb3640 1 --2- 172.21.15.28:0/4023983414 >> v2:172.21.15.134:3300/0 conn(0x7f16c4073a70 0x7f16c406b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.341+0000 7f16c8bb3640 1 -- 172.21.15.28:0/4023983414 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c406a800 con 0x7f16c414b010 2023-12-16T03:28:53.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16c8bb3640 1 --2- 172.21.15.28:0/4023983414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c414b010 0x7f16c40bf9f0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f16c404ede0 tx=0x7f16b801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7fdeded60776b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:53.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16c37fe640 1 -- 172.21.15.28:0/4023983414 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80a89b0 con 0x7f16c414b010 2023-12-16T03:28:53.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16c37fe640 1 -- 172.21.15.28:0/4023983414 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b80a8b10 con 0x7f16c414b010 2023-12-16T03:28:53.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16c37fe640 1 -- 172.21.15.28:0/4023983414 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80a8ea0 con 0x7f16c414b010 2023-12-16T03:28:53.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16cae17640 1 -- 172.21.15.28:0/4023983414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c414b010 msgr2=0x7f16c40bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:53.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16cae17640 1 --2- 172.21.15.28:0/4023983414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c414b010 0x7f16c40bf9f0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f16c404ede0 tx=0x7f16b801ecf0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16cae17640 1 -- 172.21.15.28:0/4023983414 shutdown_connections 2023-12-16T03:28:53.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16cae17640 1 --2- 172.21.15.28:0/4023983414 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16c406b540 0x7f16c4157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16cae17640 1 --2- 172.21.15.28:0/4023983414 >> v2:172.21.15.134:3300/0 conn(0x7f16c4073a70 0x7f16c406b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16cae17640 1 --2- 172.21.15.28:0/4023983414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c414b010 0x7f16c40bf9f0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16cae17640 1 -- 172.21.15.28:0/4023983414 >> 172.21.15.28:0/4023983414 conn(0x7f16c40c30c0 msgr2=0x7f16c40c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:53.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16cae17640 1 -- 172.21.15.28:0/4023983414 shutdown_connections 2023-12-16T03:28:53.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16cae17640 1 -- 172.21.15.28:0/4023983414 wait complete. 2023-12-16T03:28:53.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16cae17640 1 Processor -- start 2023-12-16T03:28:53.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.345+0000 7f16cae17640 1 -- start start 2023-12-16T03:28:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16cae17640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16c4073a70 0x7f16c41ed220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16cae17640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16c414b010 0x7f16c414eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16cae17640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c41551b0 0x7f16c41507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16cae17640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c41eda50 con 0x7f16c41551b0 2023-12-16T03:28:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16cae17640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c41edd30 con 0x7f16c414b010 2023-12-16T03:28:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16cae17640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c41ee010 con 0x7f16c4073a70 2023-12-16T03:28:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c93b4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c41551b0 0x7f16c41507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c93b4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c41551b0 0x7f16c41507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43726/0 (socket says 172.21.15.28:43726) 2023-12-16T03:28:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c93b4640 1 -- 172.21.15.28:0/4290881073 learned_addr learned my addr 172.21.15.28:0/4290881073 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c3fff640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16c414b010 0x7f16c414eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c8bb3640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16c4073a70 0x7f16c41ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c93b4640 1 -- 172.21.15.28:0/4290881073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16c4073a70 msgr2=0x7f16c41ed220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c93b4640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16c4073a70 0x7f16c41ed220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c93b4640 1 -- 172.21.15.28:0/4290881073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16c414b010 msgr2=0x7f16c414eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c93b4640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16c414b010 0x7f16c414eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c93b4640 1 -- 172.21.15.28:0/4290881073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b80094d0 con 0x7f16c41551b0 2023-12-16T03:28:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c3fff640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16c414b010 0x7f16c414eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c93b4640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c41551b0 0x7f16c41507f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f16bc007e30 tx=0x7f16bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c17fa640 1 -- 172.21.15.28:0/4290881073 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc014420 con 0x7f16c41551b0 2023-12-16T03:28:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c17fa640 1 -- 172.21.15.28:0/4290881073 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc014580 con 0x7f16c41551b0 2023-12-16T03:28:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16cae17640 1 -- 172.21.15.28:0/4290881073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c4155cf0 con 0x7f16c41551b0 2023-12-16T03:28:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c17fa640 1 -- 172.21.15.28:0/4290881073 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc014930 con 0x7f16c41551b0 2023-12-16T03:28:53.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16cae17640 1 -- 172.21.15.28:0/4290881073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c41ed760 con 0x7f16c41551b0 2023-12-16T03:28:53.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16cae17640 1 -- 172.21.15.28:0/4290881073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c4156210 con 0x7f16c41551b0 2023-12-16T03:28:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.349+0000 7f16c17fa640 1 -- 172.21.15.28:0/4290881073 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f16bc014a90 con 0x7f16c41551b0 2023-12-16T03:28:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.353+0000 7f16c17fa640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f16a8066470 0x7f16a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.353+0000 7f16c17fa640 1 -- 172.21.15.28:0/4290881073 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f16bc0844b0 con 0x7f16c41551b0 2023-12-16T03:28:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.353+0000 7f16c8bb3640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f16a8066470 0x7f16a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.353+0000 7f16c8bb3640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f16a8066470 0x7f16a8068930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f16b80b2000 tx=0x7f16b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:53.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.357+0000 7f16c17fa640 1 -- 172.21.15.28:0/4290881073 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f16c4156210 con 0x7f16c41551b0 2023-12-16T03:28:53.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.513+0000 7f16cae17640 1 -- 172.21.15.28:0/4290881073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16c4156210 con 0x7f16c41551b0 2023-12-16T03:28:53.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16c17fa640 1 -- 172.21.15.28:0/4290881073 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+13117 (secure 0 0 0) 0x7f16c4156210 con 0x7f16c41551b0 2023-12-16T03:28:53.521 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:53.521 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":78,"fsid":"96b65b79-be1d-4832-b923-85c874d6fb27","created":"2023-12-16T03:24:50.630212+0000","modified":"2023-12-16T03:28:50.251325+0000","last_up_change":"2023-12-16T03:25:02.630801+0000","last_in_change":"2023-12-16T03:24:53.224642+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-16T03:25:03.856962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c758861-c64f-484f-80c0-31e01bc6e9e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6809","nonce":3810367397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6811","nonce":3810367397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6815","nonce":3810367397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3810367397},{"type":"v1","addr":"172.21.15.28:6813","nonce":3810367397}]},"public_addr":"172.21.15.28:6809/3810367397","cluster_addr":"172.21.15.28:6811/3810367397","heartbeat_back_addr":"172.21.15.28:6815/3810367397","heartbeat_front_addr":"172.21.15.28:6813/3810367397","state":["exists","up"]},{"osd":1,"uuid":"2c08dd20-c5b5-42fb-bc67-460a3767ff2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6817","nonce":3014445182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6819","nonce":3014445182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6823","nonce":3014445182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3014445182},{"type":"v1","addr":"172.21.15.28:6821","nonce":3014445182}]},"public_addr":"172.21.15.28:6817/3014445182","cluster_addr":"172.21.15.28:6819/3014445182","heartbeat_back_addr":"172.21.15.28:6823/3014445182","heartbeat_front_addr":"172.21.15.28:6821/3014445182","state":["exists","up"]},{"osd":2,"uuid":"5b3ff722-6a02-495f-a5a9-9804cfb03c73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6825","nonce":1763403352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6827","nonce":1763403352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6831","nonce":1763403352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1763403352},{"type":"v1","addr":"172.21.15.28:6829","nonce":1763403352}]},"public_addr":"172.21.15.28:6825/1763403352","cluster_addr":"172.21.15.28:6827/1763403352","heartbeat_back_addr":"172.21.15.28:6831/1763403352","heartbeat_front_addr":"172.21.15.28:6829/1763403352","state":["exists","up"]},{"osd":3,"uuid":"16f8408f-46b5-4722-b43b-97e37f042433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6801","nonce":886705045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6803","nonce":886705045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6807","nonce":886705045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":886705045},{"type":"v1","addr":"172.21.15.28:6805","nonce":886705045}]},"public_addr":"172.21.15.28:6801/886705045","cluster_addr":"172.21.15.28:6803/886705045","heartbeat_back_addr":"172.21.15.28:6807/886705045","heartbeat_front_addr":"172.21.15.28:6805/886705045","state":["exists","up"]},{"osd":4,"uuid":"d354bb87-427d-4acb-b08f-15f068397edd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6817","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6819","nonce":2998678416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6821","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6823","nonce":2998678416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6829","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6831","nonce":2998678416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6825","nonce":2998678416},{"type":"v1","addr":"172.21.15.134:6827","nonce":2998678416}]},"public_addr":"172.21.15.134:6819/2998678416","cluster_addr":"172.21.15.134:6823/2998678416","heartbeat_back_addr":"172.21.15.134:6831/2998678416","heartbeat_front_addr":"172.21.15.134:6827/2998678416","state":["exists","up"]},{"osd":5,"uuid":"707772ca-b702-40ed-891c-f03b89d7256e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6801","nonce":3318283846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6803","nonce":3318283846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6807","nonce":3318283846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3318283846},{"type":"v1","addr":"172.21.15.134:6805","nonce":3318283846}]},"public_addr":"172.21.15.134:6801/3318283846","cluster_addr":"172.21.15.134:6803/3318283846","heartbeat_back_addr":"172.21.15.134:6807/3318283846","heartbeat_front_addr":"172.21.15.134:6805/3318283846","state":["exists","up"]},{"osd":6,"uuid":"c19b5836-4a60-4c30-8e28-6cf6cdbc88af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6818","nonce":1740691046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6822","nonce":1740691046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6830","nonce":1740691046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1740691046},{"type":"v1","addr":"172.21.15.134:6826","nonce":1740691046}]},"public_addr":"172.21.15.134:6818/1740691046","cluster_addr":"172.21.15.134:6822/1740691046","heartbeat_back_addr":"172.21.15.134:6830/1740691046","heartbeat_front_addr":"172.21.15.134:6826/1740691046","state":["exists","up"]},{"osd":7,"uuid":"d4633ecb-f56c-4e72-9bda-63405bdee774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6809","nonce":1504886822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6811","nonce":1504886822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6815","nonce":1504886822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1504886822},{"type":"v1","addr":"172.21.15.134:6813","nonce":1504886822}]},"public_addr":"172.21.15.134:6809/1504886822","cluster_addr":"172.21.15.134:6811/1504886822","heartbeat_back_addr":"172.21.15.134:6815/1504886822","heartbeat_front_addr":"172.21.15.134:6813/1504886822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.954153+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.790730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.991783+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.911024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.886708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.854864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:59.002373+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-16T03:24:58.988130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/931138884":"2023-12-17T03:28:47.244819+0000","172.21.15.134:6833/931138884":"2023-12-17T03:28:47.244819+0000","172.21.15.28:6836/2582425067":"2023-12-17T03:28:40.636985+0000","172.21.15.28:6834/2582425067":"2023-12-17T03:28:40.636985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-16T03:28:53.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 -- 172.21.15.28:0/4290881073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f16a8066470 msgr2=0x7f16a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:53.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f16a8066470 0x7f16a8068930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f16b80b2000 tx=0x7f16b8009040 comp rx=0 tx=0).stop 2023-12-16T03:28:53.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 -- 172.21.15.28:0/4290881073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c41551b0 msgr2=0x7f16c41507f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:53.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c41551b0 0x7f16c41507f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f16bc007e30 tx=0x7f16bc00e4b0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 -- 172.21.15.28:0/4290881073 shutdown_connections 2023-12-16T03:28:53.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f16a8066470 0x7f16a8068930 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16c41551b0 0x7f16c41507f0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16c414b010 0x7f16c414eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 --2- 172.21.15.28:0/4290881073 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16c4073a70 0x7f16c41ed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:53.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 -- 172.21.15.28:0/4290881073 >> 172.21.15.28:0/4290881073 conn(0x7f16c40c30c0 msgr2=0x7f16c41494c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:53.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 -- 172.21.15.28:0/4290881073 shutdown_connections 2023-12-16T03:28:53.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:53.517+0000 7f16cae17640 1 -- 172.21.15.28:0/4290881073 wait complete. 2023-12-16T03:28:54.543 INFO:tasks.ceph:Scrubbing osd.0 2023-12-16T03:28:54.543 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-16T03:28:54.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24da555640 1 Processor -- start 2023-12-16T03:28:54.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24da555640 1 -- start start 2023-12-16T03:28:54.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24da555640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f24d406e2a0 0x7f24d40c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24da555640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24d40c32a0 0x7f24d406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24da555640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d40aa750 con 0x7f24d40c4fb0 2023-12-16T03:28:54.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24da555640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d40a8f90 con 0x7f24d406e2a0 2023-12-16T03:28:54.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24da555640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40a9270 con 0x7f24d40c32a0 2023-12-16T03:28:54.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d3fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f24d40c4fb0 0x7f24d406db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44054/0 (socket says 172.21.15.28:44054) 2023-12-16T03:28:54.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d3fff640 1 -- 172.21.15.28:0/1666487707 learned_addr learned my addr 172.21.15.28:0/1666487707 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:54.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d8af2640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24d40c32a0 0x7f24d406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d37fe640 1 --2- 172.21.15.28:0/1666487707 >> v2:172.21.15.134:3300/0 conn(0x7f24d406e2a0 0x7f24d40c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65765979 0 0) 0x7f24d40aa750 con 0x7f24d40c4fb0 2023-12-16T03:28:54.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24bc003530 con 0x7f24d40c4fb0 2023-12-16T03:28:54.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1275500403 0 0) 0x7f24bc003530 con 0x7f24d40c4fb0 2023-12-16T03:28:54.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24d40c32a0 msgr2=0x7f24d406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:54.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d2ffd640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24d40c32a0 0x7f24d406c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 >> v2:172.21.15.134:3300/0 conn(0x7f24d406e2a0 msgr2=0x7f24d40c1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:54.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d2ffd640 1 --2- 172.21.15.28:0/1666487707 >> v2:172.21.15.134:3300/0 conn(0x7f24d406e2a0 0x7f24d40c1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d40a9550 con 0x7f24d40c4fb0 2023-12-16T03:28:54.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f24c40016a0 con 0x7f24d40c4fb0 2023-12-16T03:28:54.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.697+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 >> v1:172.21.15.28:6789/0 conn(0x7f24d40c4fb0 legacy=0x7f24d406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:54.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d2ffd640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24bc003980 0x7f24bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d2ffd640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24bc0047d0 0x7f24bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d2ffd640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24d40c32a0 0x7f24bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40a8f90 con 0x7f24bc0047d0 2023-12-16T03:28:54.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40a9270 con 0x7f24bc003980 2023-12-16T03:28:54.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc00ba70 con 0x7f24d40c32a0 2023-12-16T03:28:54.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d37fe640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24bc0047d0 0x7f24bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d3fff640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24bc003980 0x7f24bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d8af2640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24d40c32a0 0x7f24bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d37fe640 1 -- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24d40c32a0 msgr2=0x7f24bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:54.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d37fe640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24d40c32a0 0x7f24bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d37fe640 1 -- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24bc003980 msgr2=0x7f24bc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:54.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d37fe640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24bc003980 0x7f24bc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d37fe640 1 -- 172.21.15.28:0/1666487707 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc003530 con 0x7f24bc0047d0 2023-12-16T03:28:54.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d8af2640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24d40c32a0 0x7f24bc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:54.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d37fe640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24bc0047d0 0x7f24bc004c50 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f24d406e680 tx=0x7f24c801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1bd4571bb53de4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:54.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a5600 con 0x7f24bc0047d0 2023-12-16T03:28:54.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c80a5760 con 0x7f24bc0047d0 2023-12-16T03:28:54.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.701+0000 7f24d2ffd640 1 -- 172.21.15.28:0/1666487707 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a5b10 con 0x7f24bc0047d0 2023-12-16T03:28:54.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 -- 172.21.15.28:0/1666487707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24bc0047d0 msgr2=0x7f24bc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:54.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 --2- 172.21.15.28:0/1666487707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24bc0047d0 0x7f24bc004c50 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f24d406e680 tx=0x7f24c801ca10 comp rx=0 tx=0).stop 2023-12-16T03:28:54.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24d8af2640 1 -- 172.21.15.28:0/1666487707 reap_dead start 2023-12-16T03:28:54.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 -- 172.21.15.28:0/1666487707 shutdown_connections 2023-12-16T03:28:54.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 -- 172.21.15.28:0/1666487707 >> 172.21.15.28:0/1666487707 conn(0x7f24d40c5d40 msgr2=0x7f24d40c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:54.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 -- 172.21.15.28:0/1666487707 shutdown_connections 2023-12-16T03:28:54.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 -- 172.21.15.28:0/1666487707 wait complete. 2023-12-16T03:28:54.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 Processor -- start 2023-12-16T03:28:54.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 -- start start 2023-12-16T03:28:54.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24bc0047d0 0x7f24d4071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d4099a70 0x7f24d40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24d40a3bb0 0x7f24d40a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40a4970 con 0x7f24d40a3bb0 2023-12-16T03:28:54.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d4158a70 con 0x7f24d4099a70 2023-12-16T03:28:54.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24da555640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d409ad60 con 0x7f24bc0047d0 2023-12-16T03:28:54.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24d8af2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24d40a3bb0 0x7f24d40a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24d8af2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24d40a3bb0 0x7f24d40a5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43748/0 (socket says 172.21.15.28:43748) 2023-12-16T03:28:54.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24d8af2640 1 -- 172.21.15.28:0/961465587 learned_addr learned my addr 172.21.15.28:0/961465587 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:54.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24d3fff640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24bc0047d0 0x7f24d4071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.705+0000 7f24d37fe640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d4099a70 0x7f24d40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d8af2640 1 -- 172.21.15.28:0/961465587 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24bc0047d0 msgr2=0x7f24d4071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d8af2640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24bc0047d0 0x7f24d4071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d8af2640 1 -- 172.21.15.28:0/961465587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d4099a70 msgr2=0x7f24d40a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d8af2640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24d4099a70 0x7f24d40a3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d8af2640 1 -- 172.21.15.28:0/961465587 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d406d9c0 con 0x7f24d40a3bb0 2023-12-16T03:28:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d8af2640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24d40a3bb0 0x7f24d40a5a60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f24d40c10d0 tx=0x7f24cc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d0ff9640 1 -- 172.21.15.28:0/961465587 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc00e050 con 0x7f24d40a3bb0 2023-12-16T03:28:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d0ff9640 1 -- 172.21.15.28:0/961465587 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc00f040 con 0x7f24d40a3bb0 2023-12-16T03:28:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d0ff9640 1 -- 172.21.15.28:0/961465587 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc003be0 con 0x7f24d40a3bb0 2023-12-16T03:28:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24da555640 1 -- 172.21.15.28:0/961465587 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d4158740 con 0x7f24d40a3bb0 2023-12-16T03:28:54.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24da555640 1 -- 172.21.15.28:0/961465587 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d41ed8b0 con 0x7f24d40a3bb0 2023-12-16T03:28:54.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24da555640 1 -- 172.21.15.28:0/961465587 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24d415be50 con 0x7f24d40a3bb0 2023-12-16T03:28:54.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d0ff9640 1 -- 172.21.15.28:0/961465587 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f24cc015440 con 0x7f24d40a3bb0 2023-12-16T03:28:54.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d0ff9640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f24c0066470 0x7f24c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d0ff9640 1 -- 172.21.15.28:0/961465587 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f24cc084060 con 0x7f24d40a3bb0 2023-12-16T03:28:54.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d0ff9640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] conn(0x7f24c006c370 0x7f24c006e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d0ff9640 1 -- 172.21.15.28:0/961465587 --> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24c006ee40 con 0x7f24c006c370 2023-12-16T03:28:54.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d0ff9640 1 -- 172.21.15.28:0/961465587 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24cc0865e0 con 0x7f24d40a3bb0 2023-12-16T03:28:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.709+0000 7f24d3fff640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f24c0066470 0x7f24c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.713+0000 7f24d37fe640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] conn(0x7f24c006c370 0x7f24c006e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.713+0000 7f24d3fff640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f24c0066470 0x7f24c0068930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f24c4001130 tx=0x7f24c4001df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.713+0000 7f24d37fe640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] conn(0x7f24c006c370 0x7f24c006e790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.713+0000 7f24d0ff9640 1 -- 172.21.15.28:0/961465587 <== osd.0 v2:172.21.15.28:6808/3810367397 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f24c006ee40 con 0x7f24c006c370 2023-12-16T03:28:54.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.725+0000 7f24da555640 1 -- 172.21.15.28:0/961465587 --> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f24d4068400 con 0x7f24c006c370 2023-12-16T03:28:54.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.725+0000 7f24d0ff9640 1 -- 172.21.15.28:0/961465587 <== osd.0 v2:172.21.15.28:6808/3810367397 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f24d4068400 con 0x7f24c006c370 2023-12-16T03:28:54.732 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:28:54.733 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T03:28:54.733 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:28:54.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.725+0000 7f24da555640 1 -- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] conn(0x7f24c006c370 msgr2=0x7f24c006e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:54.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.725+0000 7f24da555640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:6808/3810367397,v1:172.21.15.28:6809/3810367397] conn(0x7f24c006c370 0x7f24c006e790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.725+0000 7f24da555640 1 -- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f24c0066470 msgr2=0x7f24c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:54.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.725+0000 7f24da555640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f24c0066470 0x7f24c0068930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f24c4001130 tx=0x7f24c4001df0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.725+0000 7f24da555640 1 -- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24d40a3bb0 msgr2=0x7f24d40a5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:54.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.725+0000 7f24da555640 1 --2- 172.21.15.28:0/961465587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24d40a3bb0 0x7f24d40a5a60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f24d40c10d0 tx=0x7f24cc009f90 comp rx=0 tx=0).stop 2023-12-16T03:28:54.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.725+0000 7f24d8af2640 1 -- 172.21.15.28:0/961465587 reap_dead start 2023-12-16T03:28:54.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.725+0000 7f24da555640 1 -- 172.21.15.28:0/961465587 shutdown_connections 2023-12-16T03:28:54.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.725+0000 7f24da555640 1 -- 172.21.15.28:0/961465587 >> 172.21.15.28:0/961465587 conn(0x7f24d40c5d40 msgr2=0x7f24d40c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:54.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.729+0000 7f24da555640 1 -- 172.21.15.28:0/961465587 shutdown_connections 2023-12-16T03:28:54.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.729+0000 7f24da555640 1 -- 172.21.15.28:0/961465587 wait complete. 2023-12-16T03:28:54.751 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-16T03:28:54.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.889+0000 7f2847b3e640 1 Processor -- start 2023-12-16T03:28:54.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.889+0000 7f2847b3e640 1 -- start start 2023-12-16T03:28:54.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.889+0000 7f2847b3e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28401560e0 0x7f284015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.889+0000 7f2847b3e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f284006d520 0x7f2840159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.889+0000 7f2847b3e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284015c600 con 0x7f28400bffc0 2023-12-16T03:28:54.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.889+0000 7f2847b3e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28401594e0 con 0x7f284006d520 2023-12-16T03:28:54.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.889+0000 7f2847b3e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28401597c0 con 0x7f28401560e0 2023-12-16T03:28:54.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28450d9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f284006d520 0x7f2840159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28460db640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f28400bffc0 0x7f28400c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44056/0 (socket says 172.21.15.28:44056) 2023-12-16T03:28:54.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28460db640 1 -- 172.21.15.28:0/3813772530 learned_addr learned my addr 172.21.15.28:0/3813772530 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:54.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28458da640 1 --2- 172.21.15.28:0/3813772530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28401560e0 0x7f284015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28450d9640 1 -- 172.21.15.28:0/3813772530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28401560e0 msgr2=0x7f284015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:54.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28450d9640 1 --2- 172.21.15.28:0/3813772530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28401560e0 0x7f284015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28450d9640 1 -- 172.21.15.28:0/3813772530 >> v1:172.21.15.28:6789/0 conn(0x7f28400bffc0 legacy=0x7f28400c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:54.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28450d9640 1 -- 172.21.15.28:0/3813772530 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284015bfb0 con 0x7f284006d520 2023-12-16T03:28:54.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28450d9640 1 --2- 172.21.15.28:0/3813772530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f284006d520 0x7f2840159eb0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f28300097c0 tx=0x7f283001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a7dd89bee6c074 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:54.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28448d8640 1 -- 172.21.15.28:0/3813772530 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28401566d0 con 0x7f284006d520 2023-12-16T03:28:54.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28448d8640 1 -- 172.21.15.28:0/3813772530 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28300ab670 con 0x7f284006d520 2023-12-16T03:28:54.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.893+0000 7f28448d8640 1 -- 172.21.15.28:0/3813772530 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28300aba00 con 0x7f284006d520 2023-12-16T03:28:54.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 -- 172.21.15.28:0/3813772530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f284006d520 msgr2=0x7f2840159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:54.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 --2- 172.21.15.28:0/3813772530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f284006d520 0x7f2840159eb0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f28300097c0 tx=0x7f283001c450 comp rx=0 tx=0).stop 2023-12-16T03:28:54.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 -- 172.21.15.28:0/3813772530 shutdown_connections 2023-12-16T03:28:54.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 --2- 172.21.15.28:0/3813772530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f284006d520 0x7f2840159eb0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 --2- 172.21.15.28:0/3813772530 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28401560e0 0x7f284015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 -- 172.21.15.28:0/3813772530 >> 172.21.15.28:0/3813772530 conn(0x7f284006a5b0 msgr2=0x7f284006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:54.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 -- 172.21.15.28:0/3813772530 shutdown_connections 2023-12-16T03:28:54.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 -- 172.21.15.28:0/3813772530 wait complete. 2023-12-16T03:28:54.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 Processor -- start 2023-12-16T03:28:54.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 -- start start 2023-12-16T03:28:54.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f284006d520 0x7f2840153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28400bffc0 0x7f2840157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28401560e0 0x7f28400bef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28400bea90 con 0x7f28401560e0 2023-12-16T03:28:54.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28400a7870 con 0x7f284006d520 2023-12-16T03:28:54.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f2847b3e640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28401f1b50 con 0x7f28400bffc0 2023-12-16T03:28:54.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f28460db640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28401560e0 0x7f28400bef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f28460db640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28401560e0 0x7f28400bef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43760/0 (socket says 172.21.15.28:43760) 2023-12-16T03:28:54.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f28460db640 1 -- 172.21.15.28:0/91055591 learned_addr learned my addr 172.21.15.28:0/91055591 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:54.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f28458da640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f284006d520 0x7f2840153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f28450d9640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28400bffc0 0x7f2840157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f28460db640 1 -- 172.21.15.28:0/91055591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28400bffc0 msgr2=0x7f2840157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:54.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f28460db640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28400bffc0 0x7f2840157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f28460db640 1 -- 172.21.15.28:0/91055591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f284006d520 msgr2=0x7f2840153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:54.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f28460db640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f284006d520 0x7f2840153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f28460db640 1 -- 172.21.15.28:0/91055591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2830009420 con 0x7f28401560e0 2023-12-16T03:28:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.897+0000 7f28460db640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28401560e0 0x7f28400bef00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f283800cbc0 tx=0x7f283800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.901+0000 7f28367fc640 1 -- 172.21.15.28:0/91055591 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283800ad40 con 0x7f28401560e0 2023-12-16T03:28:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.901+0000 7f28367fc640 1 -- 172.21.15.28:0/91055591 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2838012400 con 0x7f28401560e0 2023-12-16T03:28:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.901+0000 7f28367fc640 1 -- 172.21.15.28:0/91055591 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283800aea0 con 0x7f28401560e0 2023-12-16T03:28:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.901+0000 7f2847b3e640 1 -- 172.21.15.28:0/91055591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28401f2080 con 0x7f28401560e0 2023-12-16T03:28:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.901+0000 7f2847b3e640 1 -- 172.21.15.28:0/91055591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28401554e0 con 0x7f28401560e0 2023-12-16T03:28:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.901+0000 7f2847b3e640 1 -- 172.21.15.28:0/91055591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28400bec20 con 0x7f28401560e0 2023-12-16T03:28:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.901+0000 7f28367fc640 1 -- 172.21.15.28:0/91055591 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2838007070 con 0x7f28401560e0 2023-12-16T03:28:54.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.901+0000 7f28367fc640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2824066470 0x7f2824068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:54.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.901+0000 7f28367fc640 1 -- 172.21.15.28:0/91055591 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2838083a00 con 0x7f28401560e0 2023-12-16T03:28:54.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.901+0000 7f28458da640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2824066470 0x7f2824068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:54.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.901+0000 7f28458da640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2824066470 0x7f2824068930 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2840158e80 tx=0x7f283c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:54.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:54.905+0000 7f28367fc640 1 -- 172.21.15.28:0/91055591 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f28400bec20 con 0x7f28401560e0 2023-12-16T03:28:55.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.065+0000 7f2847b3e640 1 -- 172.21.15.28:0/91055591 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f284015a3f0 con 0x7f2824066470 2023-12-16T03:28:55.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f28367fc640 1 -- 172.21.15.28:0/91055591 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f283c011a60 con 0x7f2824066470 2023-12-16T03:28:55.073 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 0 to deep-scrub 2023-12-16T03:28:55.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 -- 172.21.15.28:0/91055591 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2824066470 msgr2=0x7f2824068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2824066470 0x7f2824068930 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2840158e80 tx=0x7f283c009190 comp rx=0 tx=0).stop 2023-12-16T03:28:55.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 -- 172.21.15.28:0/91055591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28401560e0 msgr2=0x7f28400bef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28401560e0 0x7f28400bef00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f283800cbc0 tx=0x7f283800a430 comp rx=0 tx=0).stop 2023-12-16T03:28:55.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 -- 172.21.15.28:0/91055591 shutdown_connections 2023-12-16T03:28:55.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f2824066470 0x7f2824068930 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f28401560e0 0x7f28400bef00 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28400bffc0 0x7f2840157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 --2- 172.21.15.28:0/91055591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f284006d520 0x7f2840153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 -- 172.21.15.28:0/91055591 >> 172.21.15.28:0/91055591 conn(0x7f284006a5b0 msgr2=0x7f2840072680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:55.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 -- 172.21.15.28:0/91055591 shutdown_connections 2023-12-16T03:28:55.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.069+0000 7f2847b3e640 1 -- 172.21.15.28:0/91055591 wait complete. 2023-12-16T03:28:55.093 INFO:tasks.ceph:Scrubbing osd.1 2023-12-16T03:28:55.094 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-16T03:28:55.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.233+0000 7f537bd9d640 1 Processor -- start 2023-12-16T03:28:55.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f537bd9d640 1 -- start start 2023-12-16T03:28:55.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f537bd9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5374151e00 0x7f5374158580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f537bd9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53740c07f0 0x7f53740c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f537bd9d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5374073b70 con 0x7f53740c0370 2023-12-16T03:28:55.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f537bd9d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53740c0c80 con 0x7f5374151e00 2023-12-16T03:28:55.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f537bd9d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5374158ac0 con 0x7f53740c07f0 2023-12-16T03:28:55.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f5379b39640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5374151e00 0x7f5374158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f5379b39640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5374151e00 0x7f5374158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43776/0 (socket says 172.21.15.28:43776) 2023-12-16T03:28:55.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f5379b39640 1 -- 172.21.15.28:0/1684091645 learned_addr learned my addr 172.21.15.28:0/1684091645 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:55.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f537a33a640 1 --2- 172.21.15.28:0/1684091645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53740c07f0 0x7f53740c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f5379b39640 1 -- 172.21.15.28:0/1684091645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53740c07f0 msgr2=0x7f53740c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:55.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f5379b39640 1 --2- 172.21.15.28:0/1684091645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53740c07f0 0x7f53740c19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f5379b39640 1 -- 172.21.15.28:0/1684091645 >> v1:172.21.15.134:6789/0 conn(0x7f53740c0370 legacy=0x7f53740c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f5379b39640 1 -- 172.21.15.28:0/1684091645 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740735b0 con 0x7f5374151e00 2023-12-16T03:28:55.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.237+0000 7f537a33a640 1 --2- 172.21.15.28:0/1684091645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53740c07f0 0x7f53740c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:55.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f5379b39640 1 --2- 172.21.15.28:0/1684091645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5374151e00 0x7f5374158580 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f5370009870 tx=0x7f537001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd6d14ce134b2a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f5378b37640 1 -- 172.21.15.28:0/1684091645 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53700ab600 con 0x7f5374151e00 2023-12-16T03:28:55.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f5378b37640 1 -- 172.21.15.28:0/1684091645 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53700a7050 con 0x7f5374151e00 2023-12-16T03:28:55.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f5378b37640 1 -- 172.21.15.28:0/1684091645 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53700ab980 con 0x7f5374151e00 2023-12-16T03:28:55.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f537bd9d640 1 -- 172.21.15.28:0/1684091645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5374151e00 msgr2=0x7f5374158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f537bd9d640 1 --2- 172.21.15.28:0/1684091645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5374151e00 0x7f5374158580 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f5370009870 tx=0x7f537001c420 comp rx=0 tx=0).stop 2023-12-16T03:28:55.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f537bd9d640 1 -- 172.21.15.28:0/1684091645 shutdown_connections 2023-12-16T03:28:55.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f537bd9d640 1 --2- 172.21.15.28:0/1684091645 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53740c07f0 0x7f53740c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f537bd9d640 1 --2- 172.21.15.28:0/1684091645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5374151e00 0x7f5374158580 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f537bd9d640 1 -- 172.21.15.28:0/1684091645 >> 172.21.15.28:0/1684091645 conn(0x7f53740c31a0 msgr2=0x7f53740c35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:55.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f537bd9d640 1 -- 172.21.15.28:0/1684091645 shutdown_connections 2023-12-16T03:28:55.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f537bd9d640 1 -- 172.21.15.28:0/1684091645 wait complete. 2023-12-16T03:28:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f537bd9d640 1 Processor -- start 2023-12-16T03:28:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.241+0000 7f537bd9d640 1 -- start start 2023-12-16T03:28:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537bd9d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53740c0370 0x7f53741ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537bd9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53740c07f0 0x7f53741ecca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537bd9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5374151e00 0x7f53740c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537bd9d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53740c4e30 con 0x7f5374151e00 2023-12-16T03:28:55.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537bd9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53741ed1e0 con 0x7f53740c07f0 2023-12-16T03:28:55.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537bd9d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5374142430 con 0x7f53740c0370 2023-12-16T03:28:55.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537a33a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5374151e00 0x7f53740c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537a33a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5374151e00 0x7f53740c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43780/0 (socket says 172.21.15.28:43780) 2023-12-16T03:28:55.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537a33a640 1 -- 172.21.15.28:0/1630740143 learned_addr learned my addr 172.21.15.28:0/1630740143 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:55.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f5379338640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53740c07f0 0x7f53741ecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f5379b39640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53740c0370 0x7f53741ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537a33a640 1 -- 172.21.15.28:0/1630740143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53740c0370 msgr2=0x7f53741ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537a33a640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53740c0370 0x7f53741ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537a33a640 1 -- 172.21.15.28:0/1630740143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53740c07f0 msgr2=0x7f53741ecca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537a33a640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53740c07f0 0x7f53741ecca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537a33a640 1 -- 172.21.15.28:0/1630740143 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700094d0 con 0x7f5374151e00 2023-12-16T03:28:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f5379b39640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f53740c0370 0x7f53741ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537a33a640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5374151e00 0x7f53740c5e80 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f536c007ea0 tx=0x7f536c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f536a7fc640 1 -- 172.21.15.28:0/1630740143 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c003ba0 con 0x7f5374151e00 2023-12-16T03:28:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f536a7fc640 1 -- 172.21.15.28:0/1630740143 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536c00f040 con 0x7f5374151e00 2023-12-16T03:28:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f536a7fc640 1 -- 172.21.15.28:0/1630740143 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c00de70 con 0x7f5374151e00 2023-12-16T03:28:55.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537bd9d640 1 -- 172.21.15.28:0/1630740143 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5374141530 con 0x7f5374151e00 2023-12-16T03:28:55.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537bd9d640 1 -- 172.21.15.28:0/1630740143 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5374141810 con 0x7f5374151e00 2023-12-16T03:28:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f537bd9d640 1 -- 172.21.15.28:0/1630740143 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5374070df0 con 0x7f5374151e00 2023-12-16T03:28:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.245+0000 7f536a7fc640 1 -- 172.21.15.28:0/1630740143 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f536c004030 con 0x7f5374151e00 2023-12-16T03:28:55.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.249+0000 7f536a7fc640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5358066470 0x7f5358068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.249+0000 7f536a7fc640 1 -- 172.21.15.28:0/1630740143 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f536c084490 con 0x7f5374151e00 2023-12-16T03:28:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.249+0000 7f5379b39640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5358066470 0x7f5358068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.249+0000 7f536a7fc640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] conn(0x7f535806c370 0x7f535806e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.249+0000 7f536a7fc640 1 -- 172.21.15.28:0/1630740143 --> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f535806ee40 con 0x7f535806c370 2023-12-16T03:28:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.249+0000 7f536a7fc640 1 -- 172.21.15.28:0/1630740143 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f536c0848e0 con 0x7f5374151e00 2023-12-16T03:28:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.249+0000 7f5379338640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] conn(0x7f535806c370 0x7f535806e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.249+0000 7f5379b39640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5358066470 0x7f5358068930 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f53700ad000 tx=0x7f53700a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.249+0000 7f5379338640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] conn(0x7f535806c370 0x7f535806e790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.249+0000 7f536a7fc640 1 -- 172.21.15.28:0/1630740143 <== osd.1 v2:172.21.15.28:6816/3014445182 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f535806ee40 con 0x7f535806c370 2023-12-16T03:28:55.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.261+0000 7f537bd9d640 1 -- 172.21.15.28:0/1630740143 --> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f537406d340 con 0x7f535806c370 2023-12-16T03:28:55.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f536a7fc640 1 -- 172.21.15.28:0/1630740143 <== osd.1 v2:172.21.15.28:6816/3014445182 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f537406d340 con 0x7f535806c370 2023-12-16T03:28:55.270 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:28:55.270 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T03:28:55.270 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:28:55.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f537bd9d640 1 -- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] conn(0x7f535806c370 msgr2=0x7f535806e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f537bd9d640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:6816/3014445182,v1:172.21.15.28:6817/3014445182] conn(0x7f535806c370 0x7f535806e790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f537bd9d640 1 -- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5358066470 msgr2=0x7f5358068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f537bd9d640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f5358066470 0x7f5358068930 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f53700ad000 tx=0x7f53700a6000 comp rx=0 tx=0).stop 2023-12-16T03:28:55.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f537bd9d640 1 -- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5374151e00 msgr2=0x7f53740c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f537bd9d640 1 --2- 172.21.15.28:0/1630740143 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5374151e00 0x7f53740c5e80 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f536c007ea0 tx=0x7f536c007f90 comp rx=0 tx=0).stop 2023-12-16T03:28:55.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f537a33a640 1 -- 172.21.15.28:0/1630740143 reap_dead start 2023-12-16T03:28:55.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f537bd9d640 1 -- 172.21.15.28:0/1630740143 shutdown_connections 2023-12-16T03:28:55.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f537bd9d640 1 -- 172.21.15.28:0/1630740143 >> 172.21.15.28:0/1630740143 conn(0x7f53740c31a0 msgr2=0x7f53740c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:55.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f537bd9d640 1 -- 172.21.15.28:0/1630740143 shutdown_connections 2023-12-16T03:28:55.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.265+0000 7f537bd9d640 1 -- 172.21.15.28:0/1630740143 wait complete. 2023-12-16T03:28:55.288 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-16T03:28:55.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c9b2a640 1 Processor -- start 2023-12-16T03:28:55.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c9b2a640 1 -- start start 2023-12-16T03:28:55.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c9b2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85c40c5260 0x7f85c406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c9b2a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f85c40c5640 0x7f85c40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c9b2a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c40c2580 con 0x7f85c40c60f0 2023-12-16T03:28:55.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c9b2a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c4153510 con 0x7f85c40c5640 2023-12-16T03:28:55.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c9b2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c40c17f0 con 0x7f85c40c5260 2023-12-16T03:28:55.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c37fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85c40c5260 0x7f85c406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c2ffd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f85c40c5640 0x7f85c40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c3fff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f85c40c60f0 0x7f85c4155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:33190/0 (socket says 172.21.15.28:33190) 2023-12-16T03:28:55.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c3fff640 1 -- 172.21.15.28:0/1077445686 learned_addr learned my addr 172.21.15.28:0/1077445686 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c2ffd640 1 -- 172.21.15.28:0/1077445686 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85c40c5260 msgr2=0x7f85c406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c2ffd640 1 --2- 172.21.15.28:0/1077445686 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85c40c5260 0x7f85c406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c2ffd640 1 -- 172.21.15.28:0/1077445686 >> v1:172.21.15.134:6789/0 conn(0x7f85c40c60f0 legacy=0x7f85c4155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c2ffd640 1 -- 172.21.15.28:0/1077445686 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c40c1a00 con 0x7f85c40c5640 2023-12-16T03:28:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c27fc640 1 -- 172.21.15.28:0/1077445686 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553961101 0 0) 0x7f85c40c2580 con 0x7f85c40c60f0 2023-12-16T03:28:55.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.429+0000 7f85c37fe640 1 --2- 172.21.15.28:0/1077445686 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85c40c5260 0x7f85c406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:55.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c2ffd640 1 --2- 172.21.15.28:0/1077445686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c40c5640 0x7f85c40c5bb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f85c40c1930 tx=0x7f85b801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ef5f26fee2817d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c27fc640 1 -- 172.21.15.28:0/1077445686 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80ac640 con 0x7f85c40c5640 2023-12-16T03:28:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c27fc640 1 -- 172.21.15.28:0/1077445686 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b80ac7a0 con 0x7f85c40c5640 2023-12-16T03:28:55.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c27fc640 1 -- 172.21.15.28:0/1077445686 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80acb30 con 0x7f85c40c5640 2023-12-16T03:28:55.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c9b2a640 1 -- 172.21.15.28:0/1077445686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c40c5640 msgr2=0x7f85c40c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c9b2a640 1 --2- 172.21.15.28:0/1077445686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c40c5640 0x7f85c40c5bb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f85c40c1930 tx=0x7f85b801c3c0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c9b2a640 1 -- 172.21.15.28:0/1077445686 shutdown_connections 2023-12-16T03:28:55.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c9b2a640 1 --2- 172.21.15.28:0/1077445686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c40c5640 0x7f85c40c5bb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c9b2a640 1 --2- 172.21.15.28:0/1077445686 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85c40c5260 0x7f85c406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c9b2a640 1 -- 172.21.15.28:0/1077445686 >> 172.21.15.28:0/1077445686 conn(0x7f85c406a5b0 msgr2=0x7f85c406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:55.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c9b2a640 1 -- 172.21.15.28:0/1077445686 shutdown_connections 2023-12-16T03:28:55.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c9b2a640 1 -- 172.21.15.28:0/1077445686 wait complete. 2023-12-16T03:28:55.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.433+0000 7f85c9b2a640 1 Processor -- start 2023-12-16T03:28:55.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c9b2a640 1 -- start start 2023-12-16T03:28:55.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c9b2a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c40c5260 0x7f85c4155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c9b2a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85c40c5640 0x7f85c41eccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c9b2a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c40c60f0 0x7f85c415d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c9b2a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4156320 con 0x7f85c40c60f0 2023-12-16T03:28:55.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c9b2a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c41571d0 con 0x7f85c40c5260 2023-12-16T03:28:55.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c9b2a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c41f0e00 con 0x7f85c40c5640 2023-12-16T03:28:55.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c40c60f0 0x7f85c415d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c40c60f0 0x7f85c415d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43792/0 (socket says 172.21.15.28:43792) 2023-12-16T03:28:55.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c3fff640 1 -- 172.21.15.28:0/298938510 learned_addr learned my addr 172.21.15.28:0/298938510 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:55.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c37fe640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c40c5260 0x7f85c4155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c3fff640 1 -- 172.21.15.28:0/298938510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85c40c5640 msgr2=0x7f85c41eccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c3fff640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85c40c5640 0x7f85c41eccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c3fff640 1 -- 172.21.15.28:0/298938510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c40c5260 msgr2=0x7f85c4155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c3fff640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c40c5260 0x7f85c4155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c3fff640 1 -- 172.21.15.28:0/298938510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4009420 con 0x7f85c40c60f0 2023-12-16T03:28:55.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c3fff640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c40c60f0 0x7f85c415d240 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f85bc001570 tx=0x7f85bc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85abfff640 1 -- 172.21.15.28:0/298938510 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc00a640 con 0x7f85c40c60f0 2023-12-16T03:28:55.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85abfff640 1 -- 172.21.15.28:0/298938510 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc00a7c0 con 0x7f85c40c60f0 2023-12-16T03:28:55.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85abfff640 1 -- 172.21.15.28:0/298938510 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc00ab70 con 0x7f85c40c60f0 2023-12-16T03:28:55.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c9b2a640 1 -- 172.21.15.28:0/298938510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b8009420 con 0x7f85c40c60f0 2023-12-16T03:28:55.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c9b2a640 1 -- 172.21.15.28:0/298938510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c414f540 con 0x7f85c40c60f0 2023-12-16T03:28:55.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.437+0000 7f85c9b2a640 1 -- 172.21.15.28:0/298938510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c4068400 con 0x7f85c40c60f0 2023-12-16T03:28:55.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.441+0000 7f85abfff640 1 -- 172.21.15.28:0/298938510 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f85bc00acd0 con 0x7f85c40c60f0 2023-12-16T03:28:55.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.441+0000 7f85abfff640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85b0066470 0x7f85b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.441+0000 7f85abfff640 1 -- 172.21.15.28:0/298938510 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f85bc0831c0 con 0x7f85c40c60f0 2023-12-16T03:28:55.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.441+0000 7f85c37fe640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85b0066470 0x7f85b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.441+0000 7f85c37fe640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85b0066470 0x7f85b0068930 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f85c4151b80 tx=0x7f85b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.445+0000 7f85abfff640 1 -- 172.21.15.28:0/298938510 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f85bc0508d0 con 0x7f85c40c60f0 2023-12-16T03:28:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.601+0000 7f85c9b2a640 1 -- 172.21.15.28:0/298938510 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f85c406daf0 con 0x7f85b0066470 2023-12-16T03:28:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85abfff640 1 -- 172.21.15.28:0/298938510 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f85b4010940 con 0x7f85b0066470 2023-12-16T03:28:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 1 to deep-scrub 2023-12-16T03:28:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 -- 172.21.15.28:0/298938510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85b0066470 msgr2=0x7f85b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85b0066470 0x7f85b0068930 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f85c4151b80 tx=0x7f85b4008040 comp rx=0 tx=0).stop 2023-12-16T03:28:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 -- 172.21.15.28:0/298938510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c40c60f0 msgr2=0x7f85c415d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c40c60f0 0x7f85c415d240 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f85bc001570 tx=0x7f85bc00cca0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 -- 172.21.15.28:0/298938510 shutdown_connections 2023-12-16T03:28:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f85b0066470 0x7f85b0068930 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85c40c60f0 0x7f85c415d240 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f85c40c5640 0x7f85c41eccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 --2- 172.21.15.28:0/298938510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85c40c5260 0x7f85c4155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 -- 172.21.15.28:0/298938510 >> 172.21.15.28:0/298938510 conn(0x7f85c406a5b0 msgr2=0x7f85c4151cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:55.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 -- 172.21.15.28:0/298938510 shutdown_connections 2023-12-16T03:28:55.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.605+0000 7f85c9b2a640 1 -- 172.21.15.28:0/298938510 wait complete. 2023-12-16T03:28:55.630 INFO:tasks.ceph:Scrubbing osd.2 2023-12-16T03:28:55.631 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-16T03:28:55.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.773+0000 7f2723cbb640 1 Processor -- start 2023-12-16T03:28:55.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.773+0000 7f2723cbb640 1 -- start start 2023-12-16T03:28:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2723cbb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c0c4fb0 0x7f271c0c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2723cbb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271c0aa750 con 0x7f271c06db90 2023-12-16T03:28:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2723cbb640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271c0a8f90 con 0x7f271c0c32a0 2023-12-16T03:28:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2723cbb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0a9270 con 0x7f271c0c4fb0 2023-12-16T03:28:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2721256640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f271c06db90 0x7f271c06c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44058/0 (socket says 172.21.15.28:44058) 2023-12-16T03:28:55.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2721256640 1 -- 172.21.15.28:0/3070662557 learned_addr learned my addr 172.21.15.28:0/3070662557 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2721a57640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c0c4fb0 0x7f271c0c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351970002 0 0) 0x7f271c0aa750 con 0x7f271c06db90 2023-12-16T03:28:55.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2708003530 con 0x7f271c06db90 2023-12-16T03:28:55.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3265152066 0 0) 0x7f2708003530 con 0x7f271c06db90 2023-12-16T03:28:55.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c0c4fb0 msgr2=0x7f271c0c1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:55.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c0c4fb0 0x7f271c0c1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 >> v1:172.21.15.134:6789/0 conn(0x7f271c0c32a0 legacy=0x7f271c06cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c0a9550 con 0x7f271c06db90 2023-12-16T03:28:55.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f270c001680 con 0x7f271c06db90 2023-12-16T03:28:55.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 >> v1:172.21.15.28:6789/0 conn(0x7f271c06db90 legacy=0x7f271c06c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27080039b0 0x7f2708003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27080047d0 0x7f2708004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c0c4fb0 0x7f2708005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0a9270 con 0x7f27080039b0 2023-12-16T03:28:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270800bb50 con 0x7f27080047d0 2023-12-16T03:28:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270800df20 con 0x7f271c0c4fb0 2023-12-16T03:28:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2721a57640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27080039b0 0x7f2708003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2722258640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c0c4fb0 0x7f2708005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2721256640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27080047d0 0x7f2708004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2721a57640 1 -- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c0c4fb0 msgr2=0x7f2708005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2721a57640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c0c4fb0 0x7f2708005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2721a57640 1 -- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27080047d0 msgr2=0x7f2708004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2721a57640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27080047d0 0x7f2708004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2721a57640 1 -- 172.21.15.28:0/3070662557 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708003530 con 0x7f27080039b0 2023-12-16T03:28:55.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.777+0000 7f2722258640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c0c4fb0 0x7f2708005260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2721a57640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27080039b0 0x7f2708003dd0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2718009ae0 tx=0x7f271801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5edd8354c7a66c server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27180a64e0 con 0x7f27080039b0 2023-12-16T03:28:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27180a6640 con 0x7f27080039b0 2023-12-16T03:28:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2720a55640 1 -- 172.21.15.28:0/3070662557 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27180a69f0 con 0x7f27080039b0 2023-12-16T03:28:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2723cbb640 1 -- 172.21.15.28:0/3070662557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27080039b0 msgr2=0x7f2708003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2723cbb640 1 --2- 172.21.15.28:0/3070662557 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27080039b0 0x7f2708003dd0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2718009ae0 tx=0x7f271801ca20 comp rx=0 tx=0).stop 2023-12-16T03:28:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2722258640 1 -- 172.21.15.28:0/3070662557 reap_dead start 2023-12-16T03:28:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2723cbb640 1 -- 172.21.15.28:0/3070662557 shutdown_connections 2023-12-16T03:28:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2723cbb640 1 -- 172.21.15.28:0/3070662557 >> 172.21.15.28:0/3070662557 conn(0x7f271c0c5d40 msgr2=0x7f271c0c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:55.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2723cbb640 1 -- 172.21.15.28:0/3070662557 shutdown_connections 2023-12-16T03:28:55.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2723cbb640 1 -- 172.21.15.28:0/3070662557 wait complete. 2023-12-16T03:28:55.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2723cbb640 1 Processor -- start 2023-12-16T03:28:55.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.781+0000 7f2723cbb640 1 -- start start 2023-12-16T03:28:55.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2723cbb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27080039b0 0x7f271c1e1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2723cbb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c1eea50 0x7f271c1e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2723cbb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f271c14f080 0x7f271c14f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2723cbb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c1eeeb0 con 0x7f271c14f080 2023-12-16T03:28:55.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2723cbb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c14fa40 con 0x7f27080039b0 2023-12-16T03:28:55.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2723cbb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c1e1b50 con 0x7f271c1eea50 2023-12-16T03:28:55.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2722258640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f271c14f080 0x7f271c14f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2722258640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f271c14f080 0x7f271c14f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43806/0 (socket says 172.21.15.28:43806) 2023-12-16T03:28:55.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2722258640 1 -- 172.21.15.28:0/3151203797 learned_addr learned my addr 172.21.15.28:0/3151203797 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:55.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2721a57640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27080039b0 0x7f271c1e1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2721256640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c1eea50 0x7f271c1e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2722258640 1 -- 172.21.15.28:0/3151203797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c1eea50 msgr2=0x7f271c1e2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2722258640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c1eea50 0x7f271c1e2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2722258640 1 -- 172.21.15.28:0/3151203797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27080039b0 msgr2=0x7f271c1e1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2722258640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27080039b0 0x7f271c1e1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2722258640 1 -- 172.21.15.28:0/3151203797 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c1e1e30 con 0x7f271c14f080 2023-12-16T03:28:55.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2721a57640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27080039b0 0x7f271c1e1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:55.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2721256640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f271c1eea50 0x7f271c1e2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:55.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2722258640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f271c14f080 0x7f271c14f500 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2714000f90 tx=0x7f271400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f27127fc640 1 -- 172.21.15.28:0/3151203797 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2714017070 con 0x7f271c14f080 2023-12-16T03:28:55.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f27127fc640 1 -- 172.21.15.28:0/3151203797 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2714006b60 con 0x7f271c14f080 2023-12-16T03:28:55.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f27127fc640 1 -- 172.21.15.28:0/3151203797 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2714006d10 con 0x7f271c14f080 2023-12-16T03:28:55.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2723cbb640 1 -- 172.21.15.28:0/3151203797 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271c1e2110 con 0x7f271c14f080 2023-12-16T03:28:55.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2723cbb640 1 -- 172.21.15.28:0/3151203797 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271c1e26d0 con 0x7f271c14f080 2023-12-16T03:28:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f2723cbb640 1 -- 172.21.15.28:0/3151203797 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f271c0c4450 con 0x7f271c14f080 2023-12-16T03:28:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.785+0000 7f27127fc640 1 -- 172.21.15.28:0/3151203797 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2714003980 con 0x7f271c14f080 2023-12-16T03:28:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.789+0000 7f27127fc640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f27000664a0 0x7f2700068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.789+0000 7f27127fc640 1 -- 172.21.15.28:0/3151203797 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2714083490 con 0x7f271c14f080 2023-12-16T03:28:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.789+0000 7f27127fc640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] conn(0x7f270006c3a0 0x7f270006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.789+0000 7f2721a57640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f27000664a0 0x7f2700068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.789+0000 7f27127fc640 1 -- 172.21.15.28:0/3151203797 --> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f270006ee70 con 0x7f270006c3a0 2023-12-16T03:28:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.789+0000 7f27127fc640 1 -- 172.21.15.28:0/3151203797 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2714085a70 con 0x7f271c14f080 2023-12-16T03:28:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.789+0000 7f2721256640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] conn(0x7f270006c3a0 0x7f270006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.789+0000 7f2721a57640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f27000664a0 0x7f2700068960 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f27180af000 tx=0x7f27180046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.789+0000 7f2721256640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] conn(0x7f270006c3a0 0x7f270006e7c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.789+0000 7f27127fc640 1 -- 172.21.15.28:0/3151203797 <== osd.2 v2:172.21.15.28:6824/1763403352 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f270006ee70 con 0x7f270006c3a0 2023-12-16T03:28:55.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.801+0000 7f2723cbb640 1 -- 172.21.15.28:0/3151203797 --> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f271c068400 con 0x7f270006c3a0 2023-12-16T03:28:55.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.801+0000 7f27127fc640 1 -- 172.21.15.28:0/3151203797 <== osd.2 v2:172.21.15.28:6824/1763403352 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f271c068400 con 0x7f270006c3a0 2023-12-16T03:28:55.808 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:28:55.809 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T03:28:55.809 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:28:55.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.805+0000 7f2723cbb640 1 -- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] conn(0x7f270006c3a0 msgr2=0x7f270006e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.805+0000 7f2723cbb640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:6824/1763403352,v1:172.21.15.28:6825/1763403352] conn(0x7f270006c3a0 0x7f270006e7c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.805+0000 7f2723cbb640 1 -- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f27000664a0 msgr2=0x7f2700068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.805+0000 7f2723cbb640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f27000664a0 0x7f2700068960 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f27180af000 tx=0x7f27180046d0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.805+0000 7f2723cbb640 1 -- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f271c14f080 msgr2=0x7f271c14f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.805+0000 7f2723cbb640 1 --2- 172.21.15.28:0/3151203797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f271c14f080 0x7f271c14f500 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2714000f90 tx=0x7f271400eb90 comp rx=0 tx=0).stop 2023-12-16T03:28:55.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.805+0000 7f2722258640 1 -- 172.21.15.28:0/3151203797 reap_dead start 2023-12-16T03:28:55.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.805+0000 7f2723cbb640 1 -- 172.21.15.28:0/3151203797 shutdown_connections 2023-12-16T03:28:55.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.805+0000 7f2723cbb640 1 -- 172.21.15.28:0/3151203797 >> 172.21.15.28:0/3151203797 conn(0x7f271c0c5d40 msgr2=0x7f271c154830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:55.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.805+0000 7f2723cbb640 1 -- 172.21.15.28:0/3151203797 shutdown_connections 2023-12-16T03:28:55.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.805+0000 7f2723cbb640 1 -- 172.21.15.28:0/3151203797 wait complete. 2023-12-16T03:28:55.829 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-16T03:28:55.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad7b57640 1 Processor -- start 2023-12-16T03:28:55.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad7b57640 1 -- start start 2023-12-16T03:28:55.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad7b57640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffad00a5370 0x7ffad00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad7b57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad00c4110 0x7ffad0150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad7b57640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ffad0072090 0x7ffad01514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad7b57640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad00c3070 con 0x7ffad00a5370 2023-12-16T03:28:55.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad7b57640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad00c2760 con 0x7ffad0072090 2023-12-16T03:28:55.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad7b57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00a5750 con 0x7ffad00c4110 2023-12-16T03:28:55.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad58f3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffad00a5370 0x7ffad00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad58f3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffad00a5370 0x7ffad00c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43810/0 (socket says 172.21.15.28:43810) 2023-12-16T03:28:55.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad58f3640 1 -- 172.21.15.28:0/1169888869 learned_addr learned my addr 172.21.15.28:0/1169888869 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:55.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad50f2640 1 --2- 172.21.15.28:0/1169888869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad00c4110 0x7ffad0150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad60f4640 1 --2- 172.21.15.28:0/1169888869 >> v2:172.21.15.134:3300/0 conn(0x7ffad0072090 0x7ffad01514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad58f3640 1 -- 172.21.15.28:0/1169888869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad00c4110 msgr2=0x7ffad0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:55.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad58f3640 1 --2- 172.21.15.28:0/1169888869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad00c4110 0x7ffad0150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad58f3640 1 -- 172.21.15.28:0/1169888869 >> v2:172.21.15.134:3300/0 conn(0x7ffad0072090 msgr2=0x7ffad01514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:55.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad58f3640 1 --2- 172.21.15.28:0/1169888869 >> v2:172.21.15.134:3300/0 conn(0x7ffad0072090 0x7ffad01514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.969+0000 7ffad58f3640 1 -- 172.21.15.28:0/1169888869 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad00aad20 con 0x7ffad00a5370 2023-12-16T03:28:55.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad58f3640 1 --2- 172.21.15.28:0/1169888869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad00a5370 0x7ffad00c3bd0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7ffad00c4590 tx=0x7ffacc01e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd1f9af1d797705 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad48f1640 1 -- 172.21.15.28:0/1169888869 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc004230 con 0x7ffad00a5370 2023-12-16T03:28:55.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad48f1640 1 -- 172.21.15.28:0/1169888869 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc0ab070 con 0x7ffad00a5370 2023-12-16T03:28:55.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad48f1640 1 -- 172.21.15.28:0/1169888869 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0a7670 con 0x7ffad00a5370 2023-12-16T03:28:55.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad7b57640 1 -- 172.21.15.28:0/1169888869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad00a5370 msgr2=0x7ffad00c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad7b57640 1 --2- 172.21.15.28:0/1169888869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad00a5370 0x7ffad00c3bd0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7ffad00c4590 tx=0x7ffacc01e860 comp rx=0 tx=0).stop 2023-12-16T03:28:55.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad7b57640 1 -- 172.21.15.28:0/1169888869 shutdown_connections 2023-12-16T03:28:55.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad7b57640 1 --2- 172.21.15.28:0/1169888869 >> v2:172.21.15.134:3300/0 conn(0x7ffad0072090 0x7ffad01514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad7b57640 1 --2- 172.21.15.28:0/1169888869 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad00c4110 0x7ffad0150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad7b57640 1 --2- 172.21.15.28:0/1169888869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad00a5370 0x7ffad00c3bd0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad7b57640 1 -- 172.21.15.28:0/1169888869 >> 172.21.15.28:0/1169888869 conn(0x7ffad006a5b0 msgr2=0x7ffad006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:55.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad7b57640 1 -- 172.21.15.28:0/1169888869 shutdown_connections 2023-12-16T03:28:55.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.973+0000 7ffad7b57640 1 -- 172.21.15.28:0/1169888869 wait complete. 2023-12-16T03:28:55.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad7b57640 1 Processor -- start 2023-12-16T03:28:55.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad7b57640 1 -- start start 2023-12-16T03:28:55.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad7b57640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad0072090 0x7ffad01eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad7b57640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad00a5370 0x7ffad00c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad7b57640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad00c4110 0x7ffad006fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad7b57640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad0152aa0 con 0x7ffad00c4110 2023-12-16T03:28:55.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad7b57640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad01ed670 con 0x7ffad0072090 2023-12-16T03:28:55.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad7b57640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad01ecfb0 con 0x7ffad00a5370 2023-12-16T03:28:55.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad60f4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad00c4110 0x7ffad006fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad60f4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad00c4110 0x7ffad006fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43812/0 (socket says 172.21.15.28:43812) 2023-12-16T03:28:55.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad60f4640 1 -- 172.21.15.28:0/2131764331 learned_addr learned my addr 172.21.15.28:0/2131764331 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:55.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad58f3640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad0072090 0x7ffad01eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad50f2640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad00a5370 0x7ffad00c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad60f4640 1 -- 172.21.15.28:0/2131764331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad00a5370 msgr2=0x7ffad00c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad60f4640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad00a5370 0x7ffad00c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad60f4640 1 -- 172.21.15.28:0/2131764331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad0072090 msgr2=0x7ffad01eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:55.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad60f4640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad0072090 0x7ffad01eda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:55.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad60f4640 1 -- 172.21.15.28:0/2131764331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc00b780 con 0x7ffad00c4110 2023-12-16T03:28:55.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad60f4640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad00c4110 0x7ffad006fe50 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7ffac8007e60 tx=0x7ffac800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffac67fc640 1 -- 172.21.15.28:0/2131764331 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8014620 con 0x7ffad00c4110 2023-12-16T03:28:55.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffac67fc640 1 -- 172.21.15.28:0/2131764331 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac800ee90 con 0x7ffad00c4110 2023-12-16T03:28:55.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffac67fc640 1 -- 172.21.15.28:0/2131764331 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac80149e0 con 0x7ffad00c4110 2023-12-16T03:28:55.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad7b57640 1 -- 172.21.15.28:0/2131764331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad01ed290 con 0x7ffad00c4110 2023-12-16T03:28:55.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.977+0000 7ffad7b57640 1 -- 172.21.15.28:0/2131764331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad0153ef0 con 0x7ffad00c4110 2023-12-16T03:28:55.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.981+0000 7ffad7b57640 1 -- 172.21.15.28:0/2131764331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad01ed7b0 con 0x7ffad00c4110 2023-12-16T03:28:55.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.981+0000 7ffac67fc640 1 -- 172.21.15.28:0/2131764331 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ffac8014b40 con 0x7ffad00c4110 2023-12-16T03:28:55.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.981+0000 7ffac67fc640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffab40664a0 0x7ffab4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:55.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.981+0000 7ffac67fc640 1 -- 172.21.15.28:0/2131764331 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ffac8084380 con 0x7ffad00c4110 2023-12-16T03:28:55.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.981+0000 7ffad58f3640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffab40664a0 0x7ffab4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:55.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.981+0000 7ffad58f3640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffab40664a0 0x7ffab4068960 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0b1000 tx=0x7ffacc0a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:55.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:55.985+0000 7ffac67fc640 1 -- 172.21.15.28:0/2131764331 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ffad01ed7b0 con 0x7ffad00c4110 2023-12-16T03:28:56.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.141+0000 7ffad7b57640 1 -- 172.21.15.28:0/2131764331 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ffad00c6c10 con 0x7ffab40664a0 2023-12-16T03:28:56.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.141+0000 7ffac67fc640 1 -- 172.21.15.28:0/2131764331 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffad00c6c10 con 0x7ffab40664a0 2023-12-16T03:28:56.148 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 2 to deep-scrub 2023-12-16T03:28:56.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 -- 172.21.15.28:0/2131764331 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffab40664a0 msgr2=0x7ffab4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffab40664a0 0x7ffab4068960 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0b1000 tx=0x7ffacc0a9070 comp rx=0 tx=0).stop 2023-12-16T03:28:56.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 -- 172.21.15.28:0/2131764331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad00c4110 msgr2=0x7ffad006fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad00c4110 0x7ffad006fe50 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7ffac8007e60 tx=0x7ffac800e4b0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 -- 172.21.15.28:0/2131764331 shutdown_connections 2023-12-16T03:28:56.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7ffab40664a0 0x7ffab4068960 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffad00c4110 0x7ffad006fe50 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad00a5370 0x7ffad00c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 --2- 172.21.15.28:0/2131764331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad0072090 0x7ffad01eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 -- 172.21.15.28:0/2131764331 >> 172.21.15.28:0/2131764331 conn(0x7ffad006a5b0 msgr2=0x7ffad00bf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:56.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 -- 172.21.15.28:0/2131764331 shutdown_connections 2023-12-16T03:28:56.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.145+0000 7ffad7b57640 1 -- 172.21.15.28:0/2131764331 wait complete. 2023-12-16T03:28:56.169 INFO:tasks.ceph:Scrubbing osd.3 2023-12-16T03:28:56.169 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-16T03:28:56.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.309+0000 7f37208bb640 1 Processor -- start 2023-12-16T03:28:56.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.309+0000 7f37208bb640 1 -- start start 2023-12-16T03:28:56.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f37208bb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f371c0c07b0 0x7f371c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f37208bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f371c0724c0 0x7f371c06dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f37208bb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371c0c5ba0 con 0x7f371c14f9f0 2023-12-16T03:28:56.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f37208bb640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371c06c160 con 0x7f371c0c07b0 2023-12-16T03:28:56.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f37208bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c0c5410 con 0x7f371c0724c0 2023-12-16T03:28:56.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f371a59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f371c14f9f0 0x7f371c0c27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44062/0 (socket says 172.21.15.28:44062) 2023-12-16T03:28:56.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f371a59c640 1 -- 172.21.15.28:0/3138828878 learned_addr learned my addr 172.21.15.28:0/3138828878 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:56.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f371ad9d640 1 --2- 172.21.15.28:0/3138828878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f371c0724c0 0x7f371c06dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f3713fff640 1 --2- 172.21.15.28:0/3138828878 >> v2:172.21.15.134:3300/0 conn(0x7f371c0c07b0 0x7f371c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f3719d9b640 1 -- 172.21.15.28:0/3138828878 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803849652 0 0) 0x7f370c001120 con 0x7f371c14f9f0 2023-12-16T03:28:56.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f3719d9b640 1 -- 172.21.15.28:0/3138828878 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3708003530 con 0x7f371c14f9f0 2023-12-16T03:28:56.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f3719d9b640 1 -- 172.21.15.28:0/3138828878 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 594715390 0 0) 0x7f3708003530 con 0x7f371c14f9f0 2023-12-16T03:28:56.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f371ad9d640 1 -- 172.21.15.28:0/3138828878 >> v2:172.21.15.134:3300/0 conn(0x7f371c0c07b0 msgr2=0x7f371c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:56.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f371ad9d640 1 --2- 172.21.15.28:0/3138828878 >> v2:172.21.15.134:3300/0 conn(0x7f371c0c07b0 0x7f371c06d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f371ad9d640 1 -- 172.21.15.28:0/3138828878 >> v1:172.21.15.28:6789/0 conn(0x7f371c14f9f0 legacy=0x7f371c0c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.313+0000 7f371ad9d640 1 -- 172.21.15.28:0/3138828878 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c0c2210 con 0x7f371c0724c0 2023-12-16T03:28:56.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f371ad9d640 1 --2- 172.21.15.28:0/3138828878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f371c0724c0 0x7f371c06dc10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3714009dc0 tx=0x7f371401c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6627cc6fe88ad1 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:56.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f3719d9b640 1 -- 172.21.15.28:0/3138828878 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c001810 con 0x7f371c0724c0 2023-12-16T03:28:56.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f3719d9b640 1 -- 172.21.15.28:0/3138828878 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37140a55f0 con 0x7f371c0724c0 2023-12-16T03:28:56.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f3719d9b640 1 -- 172.21.15.28:0/3138828878 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37140a5980 con 0x7f371c0724c0 2023-12-16T03:28:56.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f37208bb640 1 -- 172.21.15.28:0/3138828878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f371c0724c0 msgr2=0x7f371c06dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f37208bb640 1 --2- 172.21.15.28:0/3138828878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f371c0724c0 0x7f371c06dc10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3714009dc0 tx=0x7f371401c790 comp rx=0 tx=0).stop 2023-12-16T03:28:56.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f37208bb640 1 -- 172.21.15.28:0/3138828878 shutdown_connections 2023-12-16T03:28:56.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f37208bb640 1 --2- 172.21.15.28:0/3138828878 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f371c0724c0 0x7f371c06dc10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f37208bb640 1 --2- 172.21.15.28:0/3138828878 >> v2:172.21.15.134:3300/0 conn(0x7f371c0c07b0 0x7f371c06d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f37208bb640 1 -- 172.21.15.28:0/3138828878 >> 172.21.15.28:0/3138828878 conn(0x7f371c0c5d40 msgr2=0x7f371c0c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:56.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f37208bb640 1 -- 172.21.15.28:0/3138828878 shutdown_connections 2023-12-16T03:28:56.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f37208bb640 1 -- 172.21.15.28:0/3138828878 wait complete. 2023-12-16T03:28:56.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f37208bb640 1 Processor -- start 2023-12-16T03:28:56.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.317+0000 7f37208bb640 1 -- start start 2023-12-16T03:28:56.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f37208bb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f371c0724c0 0x7f371c14d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f37208bb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f371c0c07b0 0x7f371c1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f37208bb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f371c14f9f0 0x7f371c152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f37208bb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c14d500 con 0x7f371c0c07b0 2023-12-16T03:28:56.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f37208bb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c14d220 con 0x7f371c0724c0 2023-12-16T03:28:56.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f37208bb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c14ea80 con 0x7f371c14f9f0 2023-12-16T03:28:56.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3713fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f371c0c07b0 0x7f371c1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3713fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f371c0c07b0 0x7f371c1523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43816/0 (socket says 172.21.15.28:43816) 2023-12-16T03:28:56.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3713fff640 1 -- 172.21.15.28:0/3026767995 learned_addr learned my addr 172.21.15.28:0/3026767995 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:56.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f371ad9d640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f371c14f9f0 0x7f371c152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f371a59c640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f371c0724c0 0x7f371c14d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3713fff640 1 -- 172.21.15.28:0/3026767995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f371c14f9f0 msgr2=0x7f371c152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3713fff640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f371c14f9f0 0x7f371c152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3713fff640 1 -- 172.21.15.28:0/3026767995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f371c0724c0 msgr2=0x7f371c14d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3713fff640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f371c0724c0 0x7f371c14d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3713fff640 1 -- 172.21.15.28:0/3026767995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714009a70 con 0x7f371c0c07b0 2023-12-16T03:28:56.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f371ad9d640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f371c14f9f0 0x7f371c152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:56.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3713fff640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f371c0c07b0 0x7f371c1523d0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f370400e870 tx=0x7f370400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:56.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3712ffd640 1 -- 172.21.15.28:0/3026767995 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704009510 con 0x7f371c0c07b0 2023-12-16T03:28:56.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3712ffd640 1 -- 172.21.15.28:0/3026767995 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370400eec0 con 0x7f371c0c07b0 2023-12-16T03:28:56.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f37208bb640 1 -- 172.21.15.28:0/3026767995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c14e420 con 0x7f371c0c07b0 2023-12-16T03:28:56.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3712ffd640 1 -- 172.21.15.28:0/3026767995 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370400cb40 con 0x7f371c0c07b0 2023-12-16T03:28:56.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f37208bb640 1 -- 172.21.15.28:0/3026767995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c14e130 con 0x7f371c0c07b0 2023-12-16T03:28:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f37208bb640 1 -- 172.21.15.28:0/3026767995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f371c06e150 con 0x7f371c0c07b0 2023-12-16T03:28:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.321+0000 7f3712ffd640 1 -- 172.21.15.28:0/3026767995 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f370400cca0 con 0x7f371c0c07b0 2023-12-16T03:28:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.325+0000 7f3712ffd640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36fc066470 0x7f36fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.325+0000 7f3712ffd640 1 -- 172.21.15.28:0/3026767995 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f37040840c0 con 0x7f371c0c07b0 2023-12-16T03:28:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.325+0000 7f3712ffd640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] conn(0x7f36fc06c370 0x7f36fc06e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.325+0000 7f371a59c640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36fc066470 0x7f36fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.325+0000 7f3712ffd640 1 -- 172.21.15.28:0/3026767995 --> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36fc06ee40 con 0x7f36fc06c370 2023-12-16T03:28:56.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.325+0000 7f3712ffd640 1 -- 172.21.15.28:0/3026767995 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3704084430 con 0x7f371c0c07b0 2023-12-16T03:28:56.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.325+0000 7f371ad9d640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] conn(0x7f36fc06c370 0x7f36fc06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.325+0000 7f371a59c640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36fc066470 0x7f36fc068930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f370c001940 tx=0x7f370c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:56.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.325+0000 7f371ad9d640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] conn(0x7f36fc06c370 0x7f36fc06e790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:56.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.325+0000 7f3712ffd640 1 -- 172.21.15.28:0/3026767995 <== osd.3 v2:172.21.15.28:6800/886705045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f36fc06ee40 con 0x7f36fc06c370 2023-12-16T03:28:56.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.337+0000 7f37208bb640 1 -- 172.21.15.28:0/3026767995 --> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f371c068400 con 0x7f36fc06c370 2023-12-16T03:28:56.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f3712ffd640 1 -- 172.21.15.28:0/3026767995 <== osd.3 v2:172.21.15.28:6800/886705045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f371c068400 con 0x7f36fc06c370 2023-12-16T03:28:56.345 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:28:56.345 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T03:28:56.345 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:28:56.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f37208bb640 1 -- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] conn(0x7f36fc06c370 msgr2=0x7f36fc06e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f37208bb640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:6800/886705045,v1:172.21.15.28:6801/886705045] conn(0x7f36fc06c370 0x7f36fc06e790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f37208bb640 1 -- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36fc066470 msgr2=0x7f36fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f37208bb640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f36fc066470 0x7f36fc068930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f370c001940 tx=0x7f370c009040 comp rx=0 tx=0).stop 2023-12-16T03:28:56.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f37208bb640 1 -- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f371c0c07b0 msgr2=0x7f371c1523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f37208bb640 1 --2- 172.21.15.28:0/3026767995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f371c0c07b0 0x7f371c1523d0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f370400e870 tx=0x7f370400ec70 comp rx=0 tx=0).stop 2023-12-16T03:28:56.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f371ad9d640 1 -- 172.21.15.28:0/3026767995 reap_dead start 2023-12-16T03:28:56.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f37208bb640 1 -- 172.21.15.28:0/3026767995 shutdown_connections 2023-12-16T03:28:56.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f37208bb640 1 -- 172.21.15.28:0/3026767995 >> 172.21.15.28:0/3026767995 conn(0x7f371c0c5d40 msgr2=0x7f371c0c1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:56.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f37208bb640 1 -- 172.21.15.28:0/3026767995 shutdown_connections 2023-12-16T03:28:56.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.341+0000 7f37208bb640 1 -- 172.21.15.28:0/3026767995 wait complete. 2023-12-16T03:28:56.363 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-16T03:28:56.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.501+0000 7fbfe852a640 1 Processor -- start 2023-12-16T03:28:56.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.501+0000 7fbfe852a640 1 -- start start 2023-12-16T03:28:56.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe852a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe0072090 0x7fbfe00a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe852a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbfe00725c0 0x7fbfe00c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe852a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe00c2760 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe852a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe00c3070 con 0x7fbfe00725c0 2023-12-16T03:28:56.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe852a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00aad20 con 0x7fbfe0072090 2023-12-16T03:28:56.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe5ac5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbfe00725c0 0x7fbfe00c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe5ac5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbfe00725c0 0x7fbfe00c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43824/0 (socket says 172.21.15.28:43824) 2023-12-16T03:28:56.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe5ac5640 1 -- 172.21.15.28:0/648213462 learned_addr learned my addr 172.21.15.28:0/648213462 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:56.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe6ac7640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbfe00c3bd0 0x7fbfe0150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44072/0 (socket says 172.21.15.28:44072) 2023-12-16T03:28:56.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe62c6640 1 --2- 172.21.15.28:0/648213462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe0072090 0x7fbfe00a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe5ac5640 1 -- 172.21.15.28:0/648213462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe0072090 msgr2=0x7fbfe00a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:56.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe5ac5640 1 --2- 172.21.15.28:0/648213462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe0072090 0x7fbfe00a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe5ac5640 1 -- 172.21.15.28:0/648213462 >> v1:172.21.15.28:6789/0 conn(0x7fbfe00c3bd0 legacy=0x7fbfe0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe5ac5640 1 -- 172.21.15.28:0/648213462 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe00ab000 con 0x7fbfe00725c0 2023-12-16T03:28:56.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.505+0000 7fbfe52c4640 1 -- 172.21.15.28:0/648213462 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587999749 0 0) 0x7fbfe00c2760 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe5ac5640 1 --2- 172.21.15.28:0/648213462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00725c0 0x7fbfe00c5cd0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00098a0 tx=0x7fbfd001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f265e27a346112b server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:56.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe52c4640 1 -- 172.21.15.28:0/648213462 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00ac640 con 0x7fbfe00725c0 2023-12-16T03:28:56.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe52c4640 1 -- 172.21.15.28:0/648213462 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd00ac7a0 con 0x7fbfe00725c0 2023-12-16T03:28:56.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe52c4640 1 -- 172.21.15.28:0/648213462 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00acb30 con 0x7fbfe00725c0 2023-12-16T03:28:56.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe852a640 1 -- 172.21.15.28:0/648213462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00725c0 msgr2=0x7fbfe00c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe852a640 1 --2- 172.21.15.28:0/648213462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00725c0 0x7fbfe00c5cd0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00098a0 tx=0x7fbfd001c400 comp rx=0 tx=0).stop 2023-12-16T03:28:56.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe852a640 1 -- 172.21.15.28:0/648213462 shutdown_connections 2023-12-16T03:28:56.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe852a640 1 --2- 172.21.15.28:0/648213462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00725c0 0x7fbfe00c5cd0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe852a640 1 --2- 172.21.15.28:0/648213462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe0072090 0x7fbfe00a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe852a640 1 -- 172.21.15.28:0/648213462 >> 172.21.15.28:0/648213462 conn(0x7fbfe006a5b0 msgr2=0x7fbfe006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:56.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe852a640 1 -- 172.21.15.28:0/648213462 shutdown_connections 2023-12-16T03:28:56.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe852a640 1 -- 172.21.15.28:0/648213462 wait complete. 2023-12-16T03:28:56.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe852a640 1 Processor -- start 2023-12-16T03:28:56.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.509+0000 7fbfe852a640 1 -- start start 2023-12-16T03:28:56.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe852a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe0072090 0x7fbfe015d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe852a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe00725c0 0x7fbfe00a7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe852a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00c3bd0 0x7fbfe00a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe852a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe01ee030 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe852a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe00a75c0 con 0x7fbfe0072090 2023-12-16T03:28:56.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe852a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe014cf60 con 0x7fbfe00725c0 2023-12-16T03:28:56.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe6ac7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00c3bd0 0x7fbfe00a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe6ac7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00c3bd0 0x7fbfe00a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43832/0 (socket says 172.21.15.28:43832) 2023-12-16T03:28:56.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe6ac7640 1 -- 172.21.15.28:0/632342201 learned_addr learned my addr 172.21.15.28:0/632342201 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:56.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe5ac5640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe00725c0 0x7fbfe00a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe62c6640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe0072090 0x7fbfe015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe6ac7640 1 -- 172.21.15.28:0/632342201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe00725c0 msgr2=0x7fbfe00a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe6ac7640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe00725c0 0x7fbfe00a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe6ac7640 1 -- 172.21.15.28:0/632342201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe0072090 msgr2=0x7fbfe015d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe6ac7640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe0072090 0x7fbfe015d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe6ac7640 1 -- 172.21.15.28:0/632342201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd00094d0 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe62c6640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe0072090 0x7fbfe015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:56.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe6ac7640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00c3bd0 0x7fbfe00a6200 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800c700 tx=0x7fbfd800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:56.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfd6ffd640 1 -- 172.21.15.28:0/632342201 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800ce10 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfd6ffd640 1 -- 172.21.15.28:0/632342201 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd800a640 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfd6ffd640 1 -- 172.21.15.28:0/632342201 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800aa70 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe852a640 1 -- 172.21.15.28:0/632342201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe014d240 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe852a640 1 -- 172.21.15.28:0/632342201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe01edc90 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfe852a640 1 -- 172.21.15.28:0/632342201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe01ede80 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.513+0000 7fbfd6ffd640 1 -- 172.21.15.28:0/632342201 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbfd800abd0 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.517+0000 7fbfd6ffd640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 0x7fbfc4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.517+0000 7fbfd6ffd640 1 -- 172.21.15.28:0/632342201 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbfd8083030 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.517+0000 7fbfe62c6640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 0x7fbfc4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.517+0000 7fbfe62c6640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 0x7fbfc4068930 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009840 tx=0x7fbfdc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:56.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.521+0000 7fbfd6ffd640 1 -- 172.21.15.28:0/632342201 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fbfd80507e0 con 0x7fbfe00c3bd0 2023-12-16T03:28:56.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.673+0000 7fbfe852a640 1 -- 172.21.15.28:0/632342201 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfe00a4f30 con 0x7fbfc4066470 2023-12-16T03:28:56.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfd6ffd640 1 -- 172.21.15.28:0/632342201 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbfe00a4f30 con 0x7fbfc4066470 2023-12-16T03:28:56.681 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 3 to deep-scrub 2023-12-16T03:28:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 -- 172.21.15.28:0/632342201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 msgr2=0x7fbfc4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 0x7fbfc4068930 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009840 tx=0x7fbfdc008040 comp rx=0 tx=0).stop 2023-12-16T03:28:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 -- 172.21.15.28:0/632342201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00c3bd0 msgr2=0x7fbfe00a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00c3bd0 0x7fbfe00a6200 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800c700 tx=0x7fbfd800cbc0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 -- 172.21.15.28:0/632342201 shutdown_connections 2023-12-16T03:28:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fbfc4066470 0x7fbfc4068930 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbfe00c3bd0 0x7fbfe00a6200 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe00725c0 0x7fbfe00a7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 --2- 172.21.15.28:0/632342201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe0072090 0x7fbfe015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 -- 172.21.15.28:0/632342201 >> 172.21.15.28:0/632342201 conn(0x7fbfe006a5b0 msgr2=0x7fbfe00a9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:56.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 -- 172.21.15.28:0/632342201 shutdown_connections 2023-12-16T03:28:56.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.677+0000 7fbfe852a640 1 -- 172.21.15.28:0/632342201 wait complete. 2023-12-16T03:28:56.705 INFO:tasks.ceph:Scrubbing osd.4 2023-12-16T03:28:56.705 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-16T03:28:56.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc3d1f8640 1 Processor -- start 2023-12-16T03:28:56.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc3d1f8640 1 -- start start 2023-12-16T03:28:56.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc3d1f8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efc380c4fb0 0x7efc380c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc3d1f8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc380aa750 con 0x7efc380c32a0 2023-12-16T03:28:56.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc3d1f8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc380a8f90 con 0x7efc3806db90 2023-12-16T03:28:56.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc3d1f8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc380a9270 con 0x7efc380c4fb0 2023-12-16T03:28:56.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc3759e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efc380c32a0 0x7efc3806cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44086/0 (socket says 172.21.15.28:44086) 2023-12-16T03:28:56.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc3759e640 1 -- 172.21.15.28:0/4051833979 learned_addr learned my addr 172.21.15.28:0/4051833979 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:56.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc36d9d640 1 --2- 172.21.15.28:0/4051833979 >> v2:172.21.15.134:3300/0 conn(0x7efc380c4fb0 0x7efc380c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc3659c640 1 -- 172.21.15.28:0/4051833979 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812175368 0 0) 0x7efc380aa750 con 0x7efc380c32a0 2023-12-16T03:28:56.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc3659c640 1 -- 172.21.15.28:0/4051833979 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc24003530 con 0x7efc380c32a0 2023-12-16T03:28:56.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc36d9d640 1 -- 172.21.15.28:0/4051833979 >> v1:172.21.15.134:6789/0 conn(0x7efc3806db90 legacy=0x7efc3806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc36d9d640 1 -- 172.21.15.28:0/4051833979 >> v1:172.21.15.28:6789/0 conn(0x7efc380c32a0 legacy=0x7efc3806cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.849+0000 7efc36d9d640 1 -- 172.21.15.28:0/4051833979 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380a9550 con 0x7efc380c4fb0 2023-12-16T03:28:56.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.853+0000 7efc36d9d640 1 --2- 172.21.15.28:0/4051833979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc380c4fb0 0x7efc380c1320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc280097c0 tx=0x7efc2801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5676e405d54ae01 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:56.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.853+0000 7efc3659c640 1 -- 172.21.15.28:0/4051833979 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc280ad680 con 0x7efc380c4fb0 2023-12-16T03:28:56.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.853+0000 7efc3659c640 1 -- 172.21.15.28:0/4051833979 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc280ad7e0 con 0x7efc380c4fb0 2023-12-16T03:28:56.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.853+0000 7efc3659c640 1 -- 172.21.15.28:0/4051833979 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc280adb70 con 0x7efc380c4fb0 2023-12-16T03:28:56.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.853+0000 7efc3d1f8640 1 -- 172.21.15.28:0/4051833979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc380c4fb0 msgr2=0x7efc380c1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.853+0000 7efc3d1f8640 1 --2- 172.21.15.28:0/4051833979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc380c4fb0 0x7efc380c1320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc280097c0 tx=0x7efc2801c360 comp rx=0 tx=0).stop 2023-12-16T03:28:56.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.853+0000 7efc3d1f8640 1 -- 172.21.15.28:0/4051833979 shutdown_connections 2023-12-16T03:28:56.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.853+0000 7efc3d1f8640 1 --2- 172.21.15.28:0/4051833979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc380c4fb0 0x7efc380c1320 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.853+0000 7efc3d1f8640 1 -- 172.21.15.28:0/4051833979 >> 172.21.15.28:0/4051833979 conn(0x7efc380c5d40 msgr2=0x7efc380c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:56.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.853+0000 7efc3d1f8640 1 -- 172.21.15.28:0/4051833979 shutdown_connections 2023-12-16T03:28:56.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.853+0000 7efc3d1f8640 1 -- 172.21.15.28:0/4051833979 wait complete. 2023-12-16T03:28:56.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3d1f8640 1 Processor -- start 2023-12-16T03:28:56.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3d1f8640 1 -- start start 2023-12-16T03:28:56.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3d1f8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3806db90 0x7efc380a7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3d1f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc380c32a0 0x7efc38148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3d1f8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc380c4fb0 0x7efc381493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3d1f8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc38151f40 con 0x7efc380c4fb0 2023-12-16T03:28:56.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3d1f8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc381ec9e0 con 0x7efc380c32a0 2023-12-16T03:28:56.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3d1f8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc38149930 con 0x7efc3806db90 2023-12-16T03:28:56.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc380c4fb0 0x7efc381493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc380c4fb0 0x7efc381493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43846/0 (socket says 172.21.15.28:43846) 2023-12-16T03:28:56.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3759e640 1 -- 172.21.15.28:0/2396193679 learned_addr learned my addr 172.21.15.28:0/2396193679 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:56.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc2ffff640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc380c32a0 0x7efc38148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc36d9d640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3806db90 0x7efc380a7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3759e640 1 -- 172.21.15.28:0/2396193679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3806db90 msgr2=0x7efc380a7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3759e640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efc3806db90 0x7efc380a7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3759e640 1 -- 172.21.15.28:0/2396193679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc380c32a0 msgr2=0x7efc38148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3759e640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc380c32a0 0x7efc38148eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3759e640 1 -- 172.21.15.28:0/2396193679 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc28009420 con 0x7efc380c4fb0 2023-12-16T03:28:56.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3759e640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc380c4fb0 0x7efc381493f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7efc3000cb70 tx=0x7efc3000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:56.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc2f7fe640 1 -- 172.21.15.28:0/2396193679 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000ad40 con 0x7efc380c4fb0 2023-12-16T03:28:56.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc2f7fe640 1 -- 172.21.15.28:0/2396193679 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc30012400 con 0x7efc380c4fb0 2023-12-16T03:28:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc2f7fe640 1 -- 172.21.15.28:0/2396193679 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000aea0 con 0x7efc380c4fb0 2023-12-16T03:28:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3d1f8640 1 -- 172.21.15.28:0/2396193679 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc381ebdd0 con 0x7efc380c4fb0 2023-12-16T03:28:56.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3d1f8640 1 -- 172.21.15.28:0/2396193679 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc381ec390 con 0x7efc380c4fb0 2023-12-16T03:28:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.857+0000 7efc3d1f8640 1 -- 172.21.15.28:0/2396193679 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc380c0790 con 0x7efc380c4fb0 2023-12-16T03:28:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.861+0000 7efc2f7fe640 1 -- 172.21.15.28:0/2396193679 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7efc30007070 con 0x7efc380c4fb0 2023-12-16T03:28:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.861+0000 7efc2f7fe640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc18066470 0x7efc18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.861+0000 7efc2f7fe640 1 -- 172.21.15.28:0/2396193679 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7efc30083c50 con 0x7efc380c4fb0 2023-12-16T03:28:56.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.861+0000 7efc36d9d640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc18066470 0x7efc18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.861+0000 7efc2f7fe640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] conn(0x7efc1806c370 0x7efc1806e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:56.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.861+0000 7efc2f7fe640 1 -- 172.21.15.28:0/2396193679 --> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc1806ee40 con 0x7efc1806c370 2023-12-16T03:28:56.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.861+0000 7efc2f7fe640 1 -- 172.21.15.28:0/2396193679 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc300882a0 con 0x7efc380c4fb0 2023-12-16T03:28:56.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.861+0000 7efc2ffff640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] conn(0x7efc1806c370 0x7efc1806e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:56.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.861+0000 7efc36d9d640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc18066470 0x7efc18068930 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efc280af000 tx=0x7efc28008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:56.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.861+0000 7efc2ffff640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] conn(0x7efc1806c370 0x7efc1806e790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:56.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.861+0000 7efc2f7fe640 1 -- 172.21.15.28:0/2396193679 <== osd.4 v2:172.21.15.134:6817/2998678416 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efc1806ee40 con 0x7efc1806c370 2023-12-16T03:28:56.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3d1f8640 1 -- 172.21.15.28:0/2396193679 --> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efc381ecb90 con 0x7efc1806c370 2023-12-16T03:28:56.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc2f7fe640 1 -- 172.21.15.28:0/2396193679 <== osd.4 v2:172.21.15.134:6817/2998678416 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efc381ecb90 con 0x7efc1806c370 2023-12-16T03:28:56.882 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:28:56.882 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T03:28:56.882 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:28:56.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3d1f8640 1 -- 172.21.15.28:0/2396193679 >> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] conn(0x7efc1806c370 msgr2=0x7efc1806e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3d1f8640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.134:6817/2998678416,v1:172.21.15.134:6819/2998678416] conn(0x7efc1806c370 0x7efc1806e790 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:56.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3d1f8640 1 -- 172.21.15.28:0/2396193679 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc18066470 msgr2=0x7efc18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3d1f8640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7efc18066470 0x7efc18068930 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efc280af000 tx=0x7efc28008040 comp rx=0 tx=0).stop 2023-12-16T03:28:56.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3d1f8640 1 -- 172.21.15.28:0/2396193679 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc380c4fb0 msgr2=0x7efc381493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:56.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3d1f8640 1 --2- 172.21.15.28:0/2396193679 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc380c4fb0 0x7efc381493f0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7efc3000cb70 tx=0x7efc3000a430 comp rx=0 tx=0).stop 2023-12-16T03:28:56.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3759e640 1 -- 172.21.15.28:0/2396193679 reap_dead start 2023-12-16T03:28:56.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3d1f8640 1 -- 172.21.15.28:0/2396193679 shutdown_connections 2023-12-16T03:28:56.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3d1f8640 1 -- 172.21.15.28:0/2396193679 >> 172.21.15.28:0/2396193679 conn(0x7efc380c5d40 msgr2=0x7efc380c6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:56.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3d1f8640 1 -- 172.21.15.28:0/2396193679 shutdown_connections 2023-12-16T03:28:56.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:56.877+0000 7efc3d1f8640 1 -- 172.21.15.28:0/2396193679 wait complete. 2023-12-16T03:28:56.900 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-16T03:28:57.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.037+0000 7f07b1c32640 1 Processor -- start 2023-12-16T03:28:57.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07b1c32640 1 -- start start 2023-12-16T03:28:57.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07b1c32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07ac0c5260 0x7f07ac06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07b1c32640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f07ac155de0 0x7f07ac156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07b1c32640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ac0c2580 con 0x7f07ac0c5640 2023-12-16T03:28:57.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07b1c32640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ac153510 con 0x7f07ac155de0 2023-12-16T03:28:57.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07b1c32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0c17f0 con 0x7f07ac0c5260 2023-12-16T03:28:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07ab7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07ac0c5260 0x7f07ac06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07abfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f07ac155de0 0x7f07ac156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07abfff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f07ac155de0 0x7f07ac156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:56128/0 (socket says 172.21.15.28:56128) 2023-12-16T03:28:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07ab7fe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07ac0c5260 0x7f07ac06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:34570/0 (socket says 172.21.15.28:34570) 2023-12-16T03:28:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07abfff640 1 -- 172.21.15.28:0/3393243951 learned_addr learned my addr 172.21.15.28:0/3393243951 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07abfff640 1 -- 172.21.15.28:0/3393243951 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07ac0c5260 msgr2=0x7f07ac06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07abfff640 1 --2- 172.21.15.28:0/3393243951 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07ac0c5260 0x7f07ac06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07abfff640 1 -- 172.21.15.28:0/3393243951 >> v1:172.21.15.134:6789/0 conn(0x7f07ac0c5640 legacy=0x7f07ac0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.041+0000 7f07abfff640 1 -- 172.21.15.28:0/3393243951 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac0c1a00 con 0x7f07ac155de0 2023-12-16T03:28:57.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07abfff640 1 --2- 172.21.15.28:0/3393243951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07ac155de0 0x7f07ac156250 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0c1930 tx=0x7f07a401c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=713b2c5982ce5ac3 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07aa7fc640 1 -- 172.21.15.28:0/3393243951 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a40a57f0 con 0x7f07ac155de0 2023-12-16T03:28:57.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07aa7fc640 1 -- 172.21.15.28:0/3393243951 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a40a5950 con 0x7f07ac155de0 2023-12-16T03:28:57.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07aa7fc640 1 -- 172.21.15.28:0/3393243951 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a40a5ce0 con 0x7f07ac155de0 2023-12-16T03:28:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07b1c32640 1 -- 172.21.15.28:0/3393243951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07ac155de0 msgr2=0x7f07ac156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07b1c32640 1 --2- 172.21.15.28:0/3393243951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07ac155de0 0x7f07ac156250 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0c1930 tx=0x7f07a401c930 comp rx=0 tx=0).stop 2023-12-16T03:28:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07b1c32640 1 -- 172.21.15.28:0/3393243951 shutdown_connections 2023-12-16T03:28:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07b1c32640 1 --2- 172.21.15.28:0/3393243951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07ac155de0 0x7f07ac156250 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07b1c32640 1 --2- 172.21.15.28:0/3393243951 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07ac0c5260 0x7f07ac06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07b1c32640 1 -- 172.21.15.28:0/3393243951 >> 172.21.15.28:0/3393243951 conn(0x7f07ac06a5b0 msgr2=0x7f07ac06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07b1c32640 1 -- 172.21.15.28:0/3393243951 shutdown_connections 2023-12-16T03:28:57.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07b1c32640 1 -- 172.21.15.28:0/3393243951 wait complete. 2023-12-16T03:28:57.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.045+0000 7f07b1c32640 1 Processor -- start 2023-12-16T03:28:57.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07b1c32640 1 -- start start 2023-12-16T03:28:57.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07b1c32640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07ac0c5260 0x7f07ac070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07b1c32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07ac0c5640 0x7f07ac153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07b1c32640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07ac155de0 0x7f07ac154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07b1c32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac151be0 con 0x7f07ac0c5640 2023-12-16T03:28:57.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07b1c32640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac150940 con 0x7f07ac0c5260 2023-12-16T03:28:57.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07b1c32640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac153a30 con 0x7f07ac155de0 2023-12-16T03:28:57.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07aaffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07ac0c5640 0x7f07ac153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07ab7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07ac0c5260 0x7f07ac070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07ab7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07ac0c5260 0x7f07ac070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.28:56130/0 (socket says 172.21.15.28:56130) 2023-12-16T03:28:57.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07aaffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07ac0c5640 0x7f07ac153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43852/0 (socket says 172.21.15.28:43852) 2023-12-16T03:28:57.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07ab7fe640 1 -- 172.21.15.28:0/1224160162 learned_addr learned my addr 172.21.15.28:0/1224160162 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:57.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07abfff640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07ac155de0 0x7f07ac154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07ab7fe640 1 -- 172.21.15.28:0/1224160162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07ac155de0 msgr2=0x7f07ac154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07ab7fe640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07ac155de0 0x7f07ac154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07ab7fe640 1 -- 172.21.15.28:0/1224160162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07ac0c5640 msgr2=0x7f07ac153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07ab7fe640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07ac0c5640 0x7f07ac153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07ab7fe640 1 -- 172.21.15.28:0/1224160162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4009b30 con 0x7f07ac0c5260 2023-12-16T03:28:57.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07aaffd640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07ac0c5640 0x7f07ac153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:28:57.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07ab7fe640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07ac0c5260 0x7f07ac070be0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f079c00e870 tx=0x7f079c00ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f0793fff640 1 -- 172.21.15.28:0/1224160162 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c009510 con 0x7f07ac0c5260 2023-12-16T03:28:57.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f0793fff640 1 -- 172.21.15.28:0/1224160162 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c00eec0 con 0x7f07ac0c5260 2023-12-16T03:28:57.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f0793fff640 1 -- 172.21.15.28:0/1224160162 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c00cb40 con 0x7f07ac0c5260 2023-12-16T03:28:57.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07b1c32640 1 -- 172.21.15.28:0/1224160162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ac151900 con 0x7f07ac0c5260 2023-12-16T03:28:57.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07b1c32640 1 -- 172.21.15.28:0/1224160162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac150b90 con 0x7f07ac0c5260 2023-12-16T03:28:57.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.049+0000 7f07b1c32640 1 -- 172.21.15.28:0/1224160162 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ac0a5390 con 0x7f07ac0c5260 2023-12-16T03:28:57.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.053+0000 7f0793fff640 1 -- 172.21.15.28:0/1224160162 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f079c00ccc0 con 0x7f07ac0c5260 2023-12-16T03:28:57.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.053+0000 7f0793fff640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0798066470 0x7f0798068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.053+0000 7f0793fff640 1 -- 172.21.15.28:0/1224160162 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f079c083c20 con 0x7f07ac0c5260 2023-12-16T03:28:57.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.053+0000 7f07aaffd640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0798066470 0x7f0798068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.053+0000 7f07aaffd640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0798066470 0x7f0798068930 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0ab0a0 tx=0x7f07a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.057+0000 7f0793fff640 1 -- 172.21.15.28:0/1224160162 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f079c0513e0 con 0x7f07ac0c5260 2023-12-16T03:28:57.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 -- 172.21.15.28:0/1224160162 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f07ac06daf0 con 0x7f0798066470 2023-12-16T03:28:57.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f0793fff640 1 -- 172.21.15.28:0/1224160162 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f07a00018e0 con 0x7f0798066470 2023-12-16T03:28:57.218 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 4 to deep-scrub 2023-12-16T03:28:57.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 -- 172.21.15.28:0/1224160162 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0798066470 msgr2=0x7f0798068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0798066470 0x7f0798068930 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0ab0a0 tx=0x7f07a0009040 comp rx=0 tx=0).stop 2023-12-16T03:28:57.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 -- 172.21.15.28:0/1224160162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07ac0c5260 msgr2=0x7f07ac070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07ac0c5260 0x7f07ac070be0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f079c00e870 tx=0x7f079c00ec70 comp rx=0 tx=0).stop 2023-12-16T03:28:57.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 -- 172.21.15.28:0/1224160162 shutdown_connections 2023-12-16T03:28:57.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07ac155de0 0x7f07ac154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f0798066470 0x7f0798068930 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07ac0c5640 0x7f07ac153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 --2- 172.21.15.28:0/1224160162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07ac0c5260 0x7f07ac070be0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 -- 172.21.15.28:0/1224160162 >> 172.21.15.28:0/1224160162 conn(0x7f07ac06a5b0 msgr2=0x7f07ac0a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:57.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 -- 172.21.15.28:0/1224160162 shutdown_connections 2023-12-16T03:28:57.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.213+0000 7f07b1c32640 1 -- 172.21.15.28:0/1224160162 wait complete. 2023-12-16T03:28:57.240 INFO:tasks.ceph:Scrubbing osd.5 2023-12-16T03:28:57.240 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-16T03:28:57.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.381+0000 7fde91f96640 1 Processor -- start 2023-12-16T03:28:57.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.381+0000 7fde91f96640 1 -- start start 2023-12-16T03:28:57.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.381+0000 7fde91f96640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde8c14f9f0 0x7fde8c0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.381+0000 7fde91f96640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8c0c07b0 0x7fde8c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.381+0000 7fde91f96640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8c0c5ba0 con 0x7fde8c0c2d10 2023-12-16T03:28:57.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.381+0000 7fde91f96640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8c06e320 con 0x7fde8c14f9f0 2023-12-16T03:28:57.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.381+0000 7fde91f96640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c06c160 con 0x7fde8c0c07b0 2023-12-16T03:28:57.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde8c14f9f0 0x7fde8c0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fde8c0c2d10 0x7fde8c06dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:44098/0 (socket says 172.21.15.28:44098) 2023-12-16T03:28:57.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde8c14f9f0 0x7fde8c0c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43862/0 (socket says 172.21.15.28:43862) 2023-12-16T03:28:57.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8bfff640 1 -- 172.21.15.28:0/2016739799 learned_addr learned my addr 172.21.15.28:0/2016739799 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:28:57.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde83fff640 1 --2- 172.21.15.28:0/2016739799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8c0c07b0 0x7fde8c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8b7fe640 1 -- 172.21.15.28:0/2016739799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8c0c07b0 msgr2=0x7fde8c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:57.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8b7fe640 1 --2- 172.21.15.28:0/2016739799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8c0c07b0 0x7fde8c06d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8b7fe640 1 -- 172.21.15.28:0/2016739799 >> v1:172.21.15.28:6789/0 conn(0x7fde8c0c2d10 legacy=0x7fde8c06dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8b7fe640 1 -- 172.21.15.28:0/2016739799 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c0c5410 con 0x7fde8c14f9f0 2023-12-16T03:28:57.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8b7fe640 1 --2- 172.21.15.28:0/2016739799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8c14f9f0 0x7fde8c0c27d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0097c0 tx=0x7fde7c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1f84e2761d0395 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8affd640 1 -- 172.21.15.28:0/2016739799 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0ac620 con 0x7fde8c14f9f0 2023-12-16T03:28:57.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8affd640 1 -- 172.21.15.28:0/2016739799 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c0ac780 con 0x7fde8c14f9f0 2023-12-16T03:28:57.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.385+0000 7fde8affd640 1 -- 172.21.15.28:0/2016739799 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0acb10 con 0x7fde8c14f9f0 2023-12-16T03:28:57.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 -- 172.21.15.28:0/2016739799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8c14f9f0 msgr2=0x7fde8c0c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 --2- 172.21.15.28:0/2016739799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8c14f9f0 0x7fde8c0c27d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0097c0 tx=0x7fde7c01c3c0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 -- 172.21.15.28:0/2016739799 shutdown_connections 2023-12-16T03:28:57.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 --2- 172.21.15.28:0/2016739799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8c0c07b0 0x7fde8c06d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 --2- 172.21.15.28:0/2016739799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8c14f9f0 0x7fde8c0c27d0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 -- 172.21.15.28:0/2016739799 >> 172.21.15.28:0/2016739799 conn(0x7fde8c0c5d40 msgr2=0x7fde8c0c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:57.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 -- 172.21.15.28:0/2016739799 shutdown_connections 2023-12-16T03:28:57.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 -- 172.21.15.28:0/2016739799 wait complete. 2023-12-16T03:28:57.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 Processor -- start 2023-12-16T03:28:57.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 -- start start 2023-12-16T03:28:57.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8c0c07b0 0x7fde8c1f1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8c0c2d10 0x7fde8c0aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8c14f9f0 0x7fde8c1ee490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c14e960 con 0x7fde8c0c07b0 2023-12-16T03:28:57.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c1f0c80 con 0x7fde8c0c2d10 2023-12-16T03:28:57.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde91f96640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c1f0630 con 0x7fde8c14f9f0 2023-12-16T03:28:57.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde8b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8c0c07b0 0x7fde8c1f1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde8b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8c0c07b0 0x7fde8c1f1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43876/0 (socket says 172.21.15.28:43876) 2023-12-16T03:28:57.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde8b7fe640 1 -- 172.21.15.28:0/2733449735 learned_addr learned my addr 172.21.15.28:0/2733449735 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:57.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde83fff640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8c0c2d10 0x7fde8c0aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde8bfff640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8c14f9f0 0x7fde8c1ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde8b7fe640 1 -- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8c14f9f0 msgr2=0x7fde8c1ee490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde8b7fe640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8c14f9f0 0x7fde8c1ee490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde8b7fe640 1 -- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8c0c2d10 msgr2=0x7fde8c0aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde8b7fe640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8c0c2d10 0x7fde8c0aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde8b7fe640 1 -- 172.21.15.28:0/2733449735 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c009420 con 0x7fde8c0c07b0 2023-12-16T03:28:57.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.389+0000 7fde83fff640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8c0c2d10 0x7fde8c0aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:57.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde8b7fe640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8c0c07b0 0x7fde8c1f1110 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0097c0 tx=0x7fde7c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde88ff9640 1 -- 172.21.15.28:0/2733449735 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0b5410 con 0x7fde8c0c07b0 2023-12-16T03:28:57.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde88ff9640 1 -- 172.21.15.28:0/2733449735 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c0b5570 con 0x7fde8c0c07b0 2023-12-16T03:28:57.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde91f96640 1 -- 172.21.15.28:0/2733449735 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c1f0910 con 0x7fde8c0c07b0 2023-12-16T03:28:57.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde88ff9640 1 -- 172.21.15.28:0/2733449735 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0b5920 con 0x7fde8c0c07b0 2023-12-16T03:28:57.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde91f96640 1 -- 172.21.15.28:0/2733449735 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c0aa980 con 0x7fde8c0c07b0 2023-12-16T03:28:57.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde91f96640 1 -- 172.21.15.28:0/2733449735 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde8c072940 con 0x7fde8c0c07b0 2023-12-16T03:28:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde88ff9640 1 -- 172.21.15.28:0/2733449735 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fde7c0b3040 con 0x7fde8c0c07b0 2023-12-16T03:28:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde88ff9640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde6c066470 0x7fde6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde88ff9640 1 -- 172.21.15.28:0/2733449735 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fde7c11e210 con 0x7fde8c0c07b0 2023-12-16T03:28:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde83fff640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde6c066470 0x7fde6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde88ff9640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] conn(0x7fde6c06c370 0x7fde6c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde88ff9640 1 -- 172.21.15.28:0/2733449735 --> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde6c06ee40 con 0x7fde6c06c370 2023-12-16T03:28:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde88ff9640 1 -- 172.21.15.28:0/2733449735 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde7c11e660 con 0x7fde8c0c07b0 2023-12-16T03:28:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde8bfff640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] conn(0x7fde6c06c370 0x7fde6c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.393+0000 7fde83fff640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde6c066470 0x7fde6c068930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fde8c14e4b0 tx=0x7fde74008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.397+0000 7fde8bfff640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] conn(0x7fde6c06c370 0x7fde6c06e790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.397+0000 7fde88ff9640 1 -- 172.21.15.28:0/2733449735 <== osd.5 v2:172.21.15.134:6800/3318283846 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fde6c06ee40 con 0x7fde6c06c370 2023-12-16T03:28:57.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.409+0000 7fde91f96640 1 -- 172.21.15.28:0/2733449735 --> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fde8c0a5970 con 0x7fde6c06c370 2023-12-16T03:28:57.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.409+0000 7fde88ff9640 1 -- 172.21.15.28:0/2733449735 <== osd.5 v2:172.21.15.134:6800/3318283846 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fde8c0a5970 con 0x7fde6c06c370 2023-12-16T03:28:57.416 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:28:57.416 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T03:28:57.416 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:28:57.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.409+0000 7fde91f96640 1 -- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] conn(0x7fde6c06c370 msgr2=0x7fde6c06e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.409+0000 7fde91f96640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.134:6800/3318283846,v1:172.21.15.134:6801/3318283846] conn(0x7fde6c06c370 0x7fde6c06e790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.409+0000 7fde91f96640 1 -- 172.21.15.28:0/2733449735 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde6c066470 msgr2=0x7fde6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.409+0000 7fde91f96640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fde6c066470 0x7fde6c068930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fde8c14e4b0 tx=0x7fde74008040 comp rx=0 tx=0).stop 2023-12-16T03:28:57.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.409+0000 7fde91f96640 1 -- 172.21.15.28:0/2733449735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8c0c07b0 msgr2=0x7fde8c1f1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.409+0000 7fde91f96640 1 --2- 172.21.15.28:0/2733449735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde8c0c07b0 0x7fde8c1f1110 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0097c0 tx=0x7fde7c019160 comp rx=0 tx=0).stop 2023-12-16T03:28:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.409+0000 7fde8bfff640 1 -- 172.21.15.28:0/2733449735 reap_dead start 2023-12-16T03:28:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.409+0000 7fde91f96640 1 -- 172.21.15.28:0/2733449735 shutdown_connections 2023-12-16T03:28:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.413+0000 7fde91f96640 1 -- 172.21.15.28:0/2733449735 >> 172.21.15.28:0/2733449735 conn(0x7fde8c0c5d40 msgr2=0x7fde8c149350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.413+0000 7fde91f96640 1 -- 172.21.15.28:0/2733449735 shutdown_connections 2023-12-16T03:28:57.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.413+0000 7fde91f96640 1 -- 172.21.15.28:0/2733449735 wait complete. 2023-12-16T03:28:57.434 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-16T03:28:57.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.573+0000 7fa884efe640 1 Processor -- start 2023-12-16T03:28:57.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.573+0000 7fa884efe640 1 -- start start 2023-12-16T03:28:57.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.573+0000 7fa884efe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa8800c61e0 0x7fa8800a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.573+0000 7fa884efe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa8800c1270 0x7fa8800c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.573+0000 7fa884efe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8800c28e0 con 0x7fa8801555c0 2023-12-16T03:28:57.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.573+0000 7fa884efe640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8800c3680 con 0x7fa8800c1270 2023-12-16T03:28:57.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.573+0000 7fa884efe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800c2b80 con 0x7fa8800c61e0 2023-12-16T03:28:57.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.573+0000 7fa87ed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa8800c1270 0x7fa8800c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.573+0000 7fa87ed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa8800c1270 0x7fa8800c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43878/0 (socket says 172.21.15.28:43878) 2023-12-16T03:28:57.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.573+0000 7fa87ed9d640 1 -- 172.21.15.28:0/3545896310 learned_addr learned my addr 172.21.15.28:0/3545896310 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:57.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.573+0000 7fa877fff640 1 --2- 172.21.15.28:0/3545896310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa8800c61e0 0x7fa8800a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.577+0000 7fa87ed9d640 1 -- 172.21.15.28:0/3545896310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa8800c61e0 msgr2=0x7fa8800a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:57.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.577+0000 7fa87ed9d640 1 --2- 172.21.15.28:0/3545896310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa8800c61e0 0x7fa8800a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.577+0000 7fa87ed9d640 1 -- 172.21.15.28:0/3545896310 >> v1:172.21.15.134:6789/0 conn(0x7fa8801555c0 legacy=0x7fa8800c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.577+0000 7fa87ed9d640 1 -- 172.21.15.28:0/3545896310 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8800c32a0 con 0x7fa8800c1270 2023-12-16T03:28:57.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.577+0000 7fa87ed9d640 1 --2- 172.21.15.28:0/3545896310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8800c1270 0x7fa8800c1700 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fa878009e50 tx=0x7fa87801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ceda4c7d81ef43 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.577+0000 7fa87dd9b640 1 -- 172.21.15.28:0/3545896310 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780a57f0 con 0x7fa8800c1270 2023-12-16T03:28:57.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.577+0000 7fa87dd9b640 1 -- 172.21.15.28:0/3545896310 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8780a5950 con 0x7fa8800c1270 2023-12-16T03:28:57.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.577+0000 7fa87dd9b640 1 -- 172.21.15.28:0/3545896310 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780a5ce0 con 0x7fa8800c1270 2023-12-16T03:28:57.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.577+0000 7fa884efe640 1 -- 172.21.15.28:0/3545896310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8800c1270 msgr2=0x7fa8800c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.577+0000 7fa884efe640 1 --2- 172.21.15.28:0/3545896310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8800c1270 0x7fa8800c1700 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fa878009e50 tx=0x7fa87801ca10 comp rx=0 tx=0).stop 2023-12-16T03:28:57.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 -- 172.21.15.28:0/3545896310 shutdown_connections 2023-12-16T03:28:57.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 --2- 172.21.15.28:0/3545896310 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa8800c61e0 0x7fa8800a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 --2- 172.21.15.28:0/3545896310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8800c1270 0x7fa8800c1700 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 -- 172.21.15.28:0/3545896310 >> 172.21.15.28:0/3545896310 conn(0x7fa8800c7e40 msgr2=0x7fa8800c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:57.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 -- 172.21.15.28:0/3545896310 shutdown_connections 2023-12-16T03:28:57.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 -- 172.21.15.28:0/3545896310 wait complete. 2023-12-16T03:28:57.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 Processor -- start 2023-12-16T03:28:57.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 -- start start 2023-12-16T03:28:57.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa8800c1270 0x7fa8801f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8800c61e0 0x7fa880150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8801555c0 0x7fa88014ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88015c8e0 con 0x7fa8800c61e0 2023-12-16T03:28:57.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88015b450 con 0x7fa8801555c0 2023-12-16T03:28:57.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa884efe640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa880153380 con 0x7fa8800c1270 2023-12-16T03:28:57.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa877fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8800c61e0 0x7fa880150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa877fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8800c61e0 0x7fa880150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43884/0 (socket says 172.21.15.28:43884) 2023-12-16T03:28:57.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa877fff640 1 -- 172.21.15.28:0/1070503786 learned_addr learned my addr 172.21.15.28:0/1070503786 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:57.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa87e59c640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa8800c1270 0x7fa8801f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa87ed9d640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8801555c0 0x7fa88014ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa877fff640 1 -- 172.21.15.28:0/1070503786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa8800c1270 msgr2=0x7fa8801f0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa877fff640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa8800c1270 0x7fa8801f0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa877fff640 1 -- 172.21.15.28:0/1070503786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8801555c0 msgr2=0x7fa88014ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa877fff640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8801555c0 0x7fa88014ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa877fff640 1 -- 172.21.15.28:0/1070503786 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878009b30 con 0x7fa8800c61e0 2023-12-16T03:28:57.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa87e59c640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa8800c1270 0x7fa8801f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:57.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa87ed9d640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8801555c0 0x7fa88014ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:57.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.581+0000 7fa877fff640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8800c61e0 0x7fa880150970 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa86800e930 tx=0x7fa86800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.585+0000 7fa876ffd640 1 -- 172.21.15.28:0/1070503786 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868009690 con 0x7fa8800c61e0 2023-12-16T03:28:57.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.585+0000 7fa876ffd640 1 -- 172.21.15.28:0/1070503786 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86800ca00 con 0x7fa8800c61e0 2023-12-16T03:28:57.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.585+0000 7fa876ffd640 1 -- 172.21.15.28:0/1070503786 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86800cd70 con 0x7fa8800c61e0 2023-12-16T03:28:57.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.585+0000 7fa884efe640 1 -- 172.21.15.28:0/1070503786 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa880153660 con 0x7fa8800c61e0 2023-12-16T03:28:57.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.585+0000 7fa884efe640 1 -- 172.21.15.28:0/1070503786 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa880153c20 con 0x7fa8800c61e0 2023-12-16T03:28:57.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.585+0000 7fa884efe640 1 -- 172.21.15.28:0/1070503786 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa880068400 con 0x7fa8800c61e0 2023-12-16T03:28:57.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.585+0000 7fa876ffd640 1 -- 172.21.15.28:0/1070503786 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa868013470 con 0x7fa8800c61e0 2023-12-16T03:28:57.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.585+0000 7fa876ffd640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa860066470 0x7fa860068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.585+0000 7fa876ffd640 1 -- 172.21.15.28:0/1070503786 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa868083f00 con 0x7fa8800c61e0 2023-12-16T03:28:57.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.585+0000 7fa87e59c640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa860066470 0x7fa860068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.589+0000 7fa87e59c640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa860066470 0x7fa860068930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa870000f70 tx=0x7fa870009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.589+0000 7fa876ffd640 1 -- 172.21.15.28:0/1070503786 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa868051640 con 0x7fa8800c61e0 2023-12-16T03:28:57.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 -- 172.21.15.28:0/1070503786 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa880161ae0 con 0x7fa860066470 2023-12-16T03:28:57.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa876ffd640 1 -- 172.21.15.28:0/1070503786 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa8700013f0 con 0x7fa860066470 2023-12-16T03:28:57.754 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 5 to deep-scrub 2023-12-16T03:28:57.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 -- 172.21.15.28:0/1070503786 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa860066470 msgr2=0x7fa860068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa860066470 0x7fa860068930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa870000f70 tx=0x7fa870009040 comp rx=0 tx=0).stop 2023-12-16T03:28:57.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 -- 172.21.15.28:0/1070503786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8800c61e0 msgr2=0x7fa880150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8800c61e0 0x7fa880150970 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa86800e930 tx=0x7fa86800edf0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 -- 172.21.15.28:0/1070503786 shutdown_connections 2023-12-16T03:28:57.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8801555c0 0x7fa88014ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fa860066470 0x7fa860068930 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8800c61e0 0x7fa880150970 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 --2- 172.21.15.28:0/1070503786 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa8800c1270 0x7fa8801f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 -- 172.21.15.28:0/1070503786 >> 172.21.15.28:0/1070503786 conn(0x7fa8800c7e40 msgr2=0x7fa8800c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:57.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 -- 172.21.15.28:0/1070503786 shutdown_connections 2023-12-16T03:28:57.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.749+0000 7fa884efe640 1 -- 172.21.15.28:0/1070503786 wait complete. 2023-12-16T03:28:57.776 INFO:tasks.ceph:Scrubbing osd.6 2023-12-16T03:28:57.776 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-16T03:28:57.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.917+0000 7f078f6c9640 1 Processor -- start 2023-12-16T03:28:57.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078f6c9640 1 -- start start 2023-12-16T03:28:57.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078f6c9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f078814f9f0 0x7f07880c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078f6c9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f07880c2d10 0x7f078806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078f6c9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07880c5ba0 con 0x7f07880c07b0 2023-12-16T03:28:57.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078f6c9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078806e320 con 0x7f07880c2d10 2023-12-16T03:28:57.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078f6c9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078806c160 con 0x7f078814f9f0 2023-12-16T03:28:57.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078dc66640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f07880c2d10 0x7f078806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078dc66640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f07880c2d10 0x7f078806dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43892/0 (socket says 172.21.15.28:43892) 2023-12-16T03:28:57.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078dc66640 1 -- 172.21.15.28:0/1005187009 learned_addr learned my addr 172.21.15.28:0/1005187009 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:57.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078d465640 1 --2- 172.21.15.28:0/1005187009 >> v2:172.21.15.134:3300/0 conn(0x7f078814f9f0 0x7f07880c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078dc66640 1 -- 172.21.15.28:0/1005187009 >> v2:172.21.15.134:3300/0 conn(0x7f078814f9f0 msgr2=0x7f07880c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:57.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078dc66640 1 --2- 172.21.15.28:0/1005187009 >> v2:172.21.15.134:3300/0 conn(0x7f078814f9f0 0x7f07880c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078dc66640 1 -- 172.21.15.28:0/1005187009 >> v1:172.21.15.134:6789/0 conn(0x7f07880c07b0 legacy=0x7f078806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.921+0000 7f078dc66640 1 -- 172.21.15.28:0/1005187009 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880c5410 con 0x7f07880c2d10 2023-12-16T03:28:57.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f078dc66640 1 --2- 172.21.15.28:0/1005187009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07880c2d10 0x7f078806dde0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f0780009e50 tx=0x7f078001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2094eb63a1e8d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f077ffff640 1 -- 172.21.15.28:0/1005187009 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800a57d0 con 0x7f07880c2d10 2023-12-16T03:28:57.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f077ffff640 1 -- 172.21.15.28:0/1005187009 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07800a5930 con 0x7f07880c2d10 2023-12-16T03:28:57.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f077ffff640 1 -- 172.21.15.28:0/1005187009 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800a5cc0 con 0x7f07880c2d10 2023-12-16T03:28:57.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f078f6c9640 1 -- 172.21.15.28:0/1005187009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07880c2d10 msgr2=0x7f078806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f078f6c9640 1 --2- 172.21.15.28:0/1005187009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07880c2d10 0x7f078806dde0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f0780009e50 tx=0x7f078001c910 comp rx=0 tx=0).stop 2023-12-16T03:28:57.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f078f6c9640 1 -- 172.21.15.28:0/1005187009 shutdown_connections 2023-12-16T03:28:57.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f078f6c9640 1 --2- 172.21.15.28:0/1005187009 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07880c2d10 0x7f078806dde0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f078f6c9640 1 --2- 172.21.15.28:0/1005187009 >> v2:172.21.15.134:3300/0 conn(0x7f078814f9f0 0x7f07880c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f078f6c9640 1 -- 172.21.15.28:0/1005187009 >> 172.21.15.28:0/1005187009 conn(0x7f07880c5d40 msgr2=0x7f07880c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:57.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f078f6c9640 1 -- 172.21.15.28:0/1005187009 shutdown_connections 2023-12-16T03:28:57.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f078f6c9640 1 -- 172.21.15.28:0/1005187009 wait complete. 2023-12-16T03:28:57.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f078f6c9640 1 Processor -- start 2023-12-16T03:28:57.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.925+0000 7f078f6c9640 1 -- start start 2023-12-16T03:28:57.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078f6c9640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07880c07b0 0x7f0788150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078f6c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07880c2d10 0x7f078814e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078f6c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f078814f9f0 0x7f07881f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078f6c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0788151230 con 0x7f07880c2d10 2023-12-16T03:28:57.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078f6c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0788152750 con 0x7f078814f9f0 2023-12-16T03:28:57.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078f6c9640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07881532b0 con 0x7f07880c07b0 2023-12-16T03:28:57.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078cc64640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07880c2d10 0x7f078814e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078cc64640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07880c2d10 0x7f078814e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43904/0 (socket says 172.21.15.28:43904) 2023-12-16T03:28:57.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078cc64640 1 -- 172.21.15.28:0/1159338173 learned_addr learned my addr 172.21.15.28:0/1159338173 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:57.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078d465640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07880c07b0 0x7f0788150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078dc66640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f078814f9f0 0x7f07881f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078cc64640 1 -- 172.21.15.28:0/1159338173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07880c07b0 msgr2=0x7f0788150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078cc64640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07880c07b0 0x7f0788150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078cc64640 1 -- 172.21.15.28:0/1159338173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f078814f9f0 msgr2=0x7f07881f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078cc64640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f078814f9f0 0x7f07881f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078cc64640 1 -- 172.21.15.28:0/1159338173 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0780009b30 con 0x7f07880c2d10 2023-12-16T03:28:57.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078cc64640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07880c2d10 0x7f078814e600 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f077800c3c0 tx=0x7f077800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f077dffb640 1 -- 172.21.15.28:0/1159338173 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07780052d0 con 0x7f07880c2d10 2023-12-16T03:28:57.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f077dffb640 1 -- 172.21.15.28:0/1159338173 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0778005430 con 0x7f07880c2d10 2023-12-16T03:28:57.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078f6c9640 1 -- 172.21.15.28:0/1159338173 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07880aaeb0 con 0x7f07880c2d10 2023-12-16T03:28:57.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f077dffb640 1 -- 172.21.15.28:0/1159338173 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778003840 con 0x7f07880c2d10 2023-12-16T03:28:57.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078f6c9640 1 -- 172.21.15.28:0/1159338173 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0788152c60 con 0x7f07880c2d10 2023-12-16T03:28:57.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f078f6c9640 1 -- 172.21.15.28:0/1159338173 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07880bf170 con 0x7f07880c2d10 2023-12-16T03:28:57.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.929+0000 7f077dffb640 1 -- 172.21.15.28:0/1159338173 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f07780039a0 con 0x7f07880c2d10 2023-12-16T03:28:57.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.933+0000 7f077dffb640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f076c066470 0x7f076c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.933+0000 7f077dffb640 1 -- 172.21.15.28:0/1159338173 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0778082ec0 con 0x7f07880c2d10 2023-12-16T03:28:57.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.933+0000 7f078d465640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f076c066470 0x7f076c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.933+0000 7f077dffb640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] conn(0x7f076c06c370 0x7f076c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:57.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.933+0000 7f077dffb640 1 -- 172.21.15.28:0/1159338173 --> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f076c06ee40 con 0x7f076c06c370 2023-12-16T03:28:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.933+0000 7f077dffb640 1 -- 172.21.15.28:0/1159338173 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07780854a0 con 0x7f07880c2d10 2023-12-16T03:28:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.933+0000 7f078dc66640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] conn(0x7f076c06c370 0x7f076c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.933+0000 7f078d465640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f076c066470 0x7f076c068930 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0784006aa0 tx=0x7f0784008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.933+0000 7f078dc66640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] conn(0x7f076c06c370 0x7f076c06e790 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:57.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.933+0000 7f077dffb640 1 -- 172.21.15.28:0/1159338173 <== osd.6 v2:172.21.15.134:6816/1740691046 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f076c06ee40 con 0x7f076c06c370 2023-12-16T03:28:57.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078f6c9640 1 -- 172.21.15.28:0/1159338173 --> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0788153420 con 0x7f076c06c370 2023-12-16T03:28:57.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f077dffb640 1 -- 172.21.15.28:0/1159338173 <== osd.6 v2:172.21.15.134:6816/1740691046 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0788153420 con 0x7f076c06c370 2023-12-16T03:28:57.954 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:28:57.954 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T03:28:57.954 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:28:57.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078f6c9640 1 -- 172.21.15.28:0/1159338173 >> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] conn(0x7f076c06c370 msgr2=0x7f076c06e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078f6c9640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.134:6816/1740691046,v1:172.21.15.134:6818/1740691046] conn(0x7f076c06c370 0x7f076c06e790 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:57.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078f6c9640 1 -- 172.21.15.28:0/1159338173 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f076c066470 msgr2=0x7f076c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078f6c9640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f076c066470 0x7f076c068930 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0784006aa0 tx=0x7f0784008040 comp rx=0 tx=0).stop 2023-12-16T03:28:57.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078f6c9640 1 -- 172.21.15.28:0/1159338173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07880c2d10 msgr2=0x7f078814e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:57.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078f6c9640 1 --2- 172.21.15.28:0/1159338173 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07880c2d10 0x7f078814e600 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f077800c3c0 tx=0x7f077800c880 comp rx=0 tx=0).stop 2023-12-16T03:28:57.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078dc66640 1 -- 172.21.15.28:0/1159338173 reap_dead start 2023-12-16T03:28:57.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078f6c9640 1 -- 172.21.15.28:0/1159338173 shutdown_connections 2023-12-16T03:28:57.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078f6c9640 1 -- 172.21.15.28:0/1159338173 >> 172.21.15.28:0/1159338173 conn(0x7f07880c5d40 msgr2=0x7f07880c0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:57.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078f6c9640 1 -- 172.21.15.28:0/1159338173 shutdown_connections 2023-12-16T03:28:57.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:57.949+0000 7f078f6c9640 1 -- 172.21.15.28:0/1159338173 wait complete. 2023-12-16T03:28:57.972 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-16T03:28:58.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.109+0000 7f9f3f5aa640 1 Processor -- start 2023-12-16T03:28:58.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.109+0000 7f9f3f5aa640 1 -- start start 2023-12-16T03:28:58.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3f5aa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f380c4100 0x7f9f380c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3f5aa640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9f380c06d0 0x7f9f380a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3f5aa640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f380c31c0 con 0x7f9f380c63c0 2023-12-16T03:28:58.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3f5aa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f380c34a0 con 0x7f9f380c4100 2023-12-16T03:28:58.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3f5aa640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f380c1030 con 0x7f9f380c06d0 2023-12-16T03:28:58.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3cb45640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f380c4100 0x7f9f380c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3cb45640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f380c4100 0x7f9f380c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43912/0 (socket says 172.21.15.28:43912) 2023-12-16T03:28:58.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3cb45640 1 -- 172.21.15.28:0/976097856 learned_addr learned my addr 172.21.15.28:0/976097856 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:58.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3db47640 1 --2- 172.21.15.28:0/976097856 >> v2:172.21.15.134:3300/0 conn(0x7f9f380c06d0 0x7f9f380a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3cb45640 1 -- 172.21.15.28:0/976097856 >> v2:172.21.15.134:3300/0 conn(0x7f9f380c06d0 msgr2=0x7f9f380a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:58.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3cb45640 1 --2- 172.21.15.28:0/976097856 >> v2:172.21.15.134:3300/0 conn(0x7f9f380c06d0 0x7f9f380a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3cb45640 1 -- 172.21.15.28:0/976097856 >> v1:172.21.15.134:6789/0 conn(0x7f9f380c63c0 legacy=0x7f9f380c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.113+0000 7f9f3cb45640 1 -- 172.21.15.28:0/976097856 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380c1310 con 0x7f9f380c4100 2023-12-16T03:28:58.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f3cb45640 1 --2- 172.21.15.28:0/976097856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f380c4100 0x7f9f380c2bb0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9f380c0ee0 tx=0x7f9f2801eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a752332b6e0b98a server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:58.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f2ffff640 1 -- 172.21.15.28:0/976097856 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f380aa3d0 con 0x7f9f380c4100 2023-12-16T03:28:58.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f2ffff640 1 -- 172.21.15.28:0/976097856 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f280a7a90 con 0x7f9f380c4100 2023-12-16T03:28:58.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f2ffff640 1 -- 172.21.15.28:0/976097856 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f280a7e20 con 0x7f9f380c4100 2023-12-16T03:28:58.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/976097856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f380c4100 msgr2=0x7f9f380c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f3f5aa640 1 --2- 172.21.15.28:0/976097856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f380c4100 0x7f9f380c2bb0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9f380c0ee0 tx=0x7f9f2801eab0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/976097856 shutdown_connections 2023-12-16T03:28:58.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f3f5aa640 1 --2- 172.21.15.28:0/976097856 >> v2:172.21.15.134:3300/0 conn(0x7f9f380c06d0 0x7f9f380a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f3f5aa640 1 --2- 172.21.15.28:0/976097856 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f380c4100 0x7f9f380c2bb0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/976097856 >> 172.21.15.28:0/976097856 conn(0x7f9f3806a5b0 msgr2=0x7f9f3806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:58.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/976097856 shutdown_connections 2023-12-16T03:28:58.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/976097856 wait complete. 2023-12-16T03:28:58.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f3f5aa640 1 Processor -- start 2023-12-16T03:28:58.124 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.117+0000 7f9f3f5aa640 1 -- start start 2023-12-16T03:28:58.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3f5aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f380c06d0 0x7f9f381525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3f5aa640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f380c4100 0x7f9f3814feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3f5aa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f380c63c0 0x7f9f381503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3f5aa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381567a0 con 0x7f9f380c06d0 2023-12-16T03:28:58.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3f5aa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381f1080 con 0x7f9f380c63c0 2023-12-16T03:28:58.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3f5aa640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38150cc0 con 0x7f9f380c4100 2023-12-16T03:28:58.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3d346640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f380c06d0 0x7f9f381525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3d346640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f380c06d0 0x7f9f381525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43928/0 (socket says 172.21.15.28:43928) 2023-12-16T03:28:58.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3d346640 1 -- 172.21.15.28:0/3707244065 learned_addr learned my addr 172.21.15.28:0/3707244065 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:58.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3db47640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f380c63c0 0x7f9f381503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3cb45640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f380c4100 0x7f9f3814feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3d346640 1 -- 172.21.15.28:0/3707244065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f380c4100 msgr2=0x7f9f3814feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3d346640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f380c4100 0x7f9f3814feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3d346640 1 -- 172.21.15.28:0/3707244065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f380c63c0 msgr2=0x7f9f381503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3d346640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f380c63c0 0x7f9f381503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3d346640 1 -- 172.21.15.28:0/3707244065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2800b770 con 0x7f9f380c06d0 2023-12-16T03:28:58.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3db47640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f380c63c0 0x7f9f381503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3d346640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f380c06d0 0x7f9f381525d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400c3d0 tx=0x7f9f3400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f2dffb640 1 -- 172.21.15.28:0/3707244065 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f340052d0 con 0x7f9f380c06d0 2023-12-16T03:28:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f2dffb640 1 -- 172.21.15.28:0/3707244065 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f34005450 con 0x7f9f380c06d0 2023-12-16T03:28:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/3707244065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f38150930 con 0x7f9f380c06d0 2023-12-16T03:28:58.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f2dffb640 1 -- 172.21.15.28:0/3707244065 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34003860 con 0x7f9f380c06d0 2023-12-16T03:28:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/3707244065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f38156c60 con 0x7f9f380c06d0 2023-12-16T03:28:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/3707244065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f38068400 con 0x7f9f380c06d0 2023-12-16T03:28:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.121+0000 7f9f2dffb640 1 -- 172.21.15.28:0/3707244065 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9f340039c0 con 0x7f9f380c06d0 2023-12-16T03:28:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.125+0000 7f9f2dffb640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f1c066470 0x7f9f1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.125+0000 7f9f2dffb640 1 -- 172.21.15.28:0/3707244065 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9f34083090 con 0x7f9f380c06d0 2023-12-16T03:28:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.125+0000 7f9f3cb45640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f1c066470 0x7f9f1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.125+0000 7f9f3cb45640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f1c066470 0x7f9f1c068930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9f280b1000 tx=0x7f9f28008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:58.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.129+0000 7f9f2dffb640 1 -- 172.21.15.28:0/3707244065 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9f34050850 con 0x7f9f380c06d0 2023-12-16T03:28:58.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/3707244065 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f380c5140 con 0x7f9f1c066470 2023-12-16T03:28:58.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f2dffb640 1 -- 172.21.15.28:0/3707244065 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9f380c5140 con 0x7f9f1c066470 2023-12-16T03:28:58.291 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 6 to deep-scrub 2023-12-16T03:28:58.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/3707244065 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f1c066470 msgr2=0x7f9f1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f3f5aa640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f1c066470 0x7f9f1c068930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9f280b1000 tx=0x7f9f28008040 comp rx=0 tx=0).stop 2023-12-16T03:28:58.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/3707244065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f380c06d0 msgr2=0x7f9f381525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f3f5aa640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f380c06d0 0x7f9f381525d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400c3d0 tx=0x7f9f3400c890 comp rx=0 tx=0).stop 2023-12-16T03:28:58.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/3707244065 shutdown_connections 2023-12-16T03:28:58.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f3f5aa640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f380c63c0 0x7f9f381503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f3f5aa640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9f380c4100 0x7f9f3814feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f3f5aa640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f9f1c066470 0x7f9f1c068930 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f3f5aa640 1 --2- 172.21.15.28:0/3707244065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f380c06d0 0x7f9f381525d0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.285+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/3707244065 >> 172.21.15.28:0/3707244065 conn(0x7f9f3806a5b0 msgr2=0x7f9f3806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:58.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.289+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/3707244065 shutdown_connections 2023-12-16T03:28:58.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.289+0000 7f9f3f5aa640 1 -- 172.21.15.28:0/3707244065 wait complete. 2023-12-16T03:28:58.311 INFO:tasks.ceph:Scrubbing osd.7 2023-12-16T03:28:58.312 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-16T03:28:58.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.453+0000 7f431d11d640 1 Processor -- start 2023-12-16T03:28:58.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.453+0000 7f431d11d640 1 -- start start 2023-12-16T03:28:58.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.453+0000 7f431d11d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4318151c30 0x7f43181551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.453+0000 7f431d11d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f431806c8c0 0x7f43180c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.453+0000 7f431d11d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4318154d40 con 0x7f431806b2c0 2023-12-16T03:28:58.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.453+0000 7f431d11d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43180c6440 con 0x7f4318151c30 2023-12-16T03:28:58.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.453+0000 7f431d11d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4318152010 con 0x7f431806c8c0 2023-12-16T03:28:58.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.453+0000 7f4316d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4318151c30 0x7f43181551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.457+0000 7f4316d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4318151c30 0x7f43181551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43936/0 (socket says 172.21.15.28:43936) 2023-12-16T03:28:58.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.457+0000 7f4316d9d640 1 -- 172.21.15.28:0/3181558552 learned_addr learned my addr 172.21.15.28:0/3181558552 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:58.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.457+0000 7f430ffff640 1 --2- 172.21.15.28:0/3181558552 >> v2:172.21.15.134:3300/0 conn(0x7f431806c8c0 0x7f43180c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.457+0000 7f4316d9d640 1 -- 172.21.15.28:0/3181558552 >> v2:172.21.15.134:3300/0 conn(0x7f431806c8c0 msgr2=0x7f43180c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:58.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.457+0000 7f4316d9d640 1 --2- 172.21.15.28:0/3181558552 >> v2:172.21.15.134:3300/0 conn(0x7f431806c8c0 0x7f43180c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.457+0000 7f4316d9d640 1 -- 172.21.15.28:0/3181558552 >> v1:172.21.15.134:6789/0 conn(0x7f431806b2c0 legacy=0x7f43180c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.457+0000 7f4316d9d640 1 -- 172.21.15.28:0/3181558552 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43180c4f50 con 0x7f4318151c30 2023-12-16T03:28:58.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.457+0000 7f4316d9d640 1 --2- 172.21.15.28:0/3181558552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4318151c30 0x7f43181551d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f43180acb50 tx=0x7f430801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd797fb331a711f server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:58.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.457+0000 7f431659c640 1 -- 172.21.15.28:0/3181558552 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43080ab600 con 0x7f4318151c30 2023-12-16T03:28:58.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.457+0000 7f431659c640 1 -- 172.21.15.28:0/3181558552 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43080a7050 con 0x7f4318151c30 2023-12-16T03:28:58.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.457+0000 7f431659c640 1 -- 172.21.15.28:0/3181558552 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43080ab980 con 0x7f4318151c30 2023-12-16T03:28:58.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 -- 172.21.15.28:0/3181558552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4318151c30 msgr2=0x7f43181551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 --2- 172.21.15.28:0/3181558552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4318151c30 0x7f43181551d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f43180acb50 tx=0x7f430801c3b0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 -- 172.21.15.28:0/3181558552 shutdown_connections 2023-12-16T03:28:58.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 --2- 172.21.15.28:0/3181558552 >> v2:172.21.15.134:3300/0 conn(0x7f431806c8c0 0x7f43180c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 --2- 172.21.15.28:0/3181558552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4318151c30 0x7f43181551d0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 -- 172.21.15.28:0/3181558552 >> 172.21.15.28:0/3181558552 conn(0x7f43180ca360 msgr2=0x7f43180ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:58.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 -- 172.21.15.28:0/3181558552 shutdown_connections 2023-12-16T03:28:58.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 -- 172.21.15.28:0/3181558552 wait complete. 2023-12-16T03:28:58.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 Processor -- start 2023-12-16T03:28:58.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 -- start start 2023-12-16T03:28:58.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f431806b2c0 0x7f431814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f431806c8c0 0x7f43181f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4318151c30 0x7f431814d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431814ce80 con 0x7f431806c8c0 2023-12-16T03:28:58.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43180a9c50 con 0x7f431806b2c0 2023-12-16T03:28:58.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431d11d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431814d090 con 0x7f4318151c30 2023-12-16T03:28:58.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f430ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f431806c8c0 0x7f43181f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f4316d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f431806b2c0 0x7f431814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f430ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f431806c8c0 0x7f43181f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43948/0 (socket says 172.21.15.28:43948) 2023-12-16T03:28:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f430ffff640 1 -- 172.21.15.28:0/928235950 learned_addr learned my addr 172.21.15.28:0/928235950 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f431759e640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4318151c30 0x7f431814d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f430ffff640 1 -- 172.21.15.28:0/928235950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4318151c30 msgr2=0x7f431814d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f430ffff640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4318151c30 0x7f431814d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f430ffff640 1 -- 172.21.15.28:0/928235950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f431806b2c0 msgr2=0x7f431814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f430ffff640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f431806b2c0 0x7f431814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.461+0000 7f430ffff640 1 -- 172.21.15.28:0/928235950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43080094d0 con 0x7f431806c8c0 2023-12-16T03:28:58.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f430ffff640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f431806c8c0 0x7f43181f0f20 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f430000d5f0 tx=0x7f430000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f430f7fe640 1 -- 172.21.15.28:0/928235950 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43000125f0 con 0x7f431806c8c0 2023-12-16T03:28:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f430f7fe640 1 -- 172.21.15.28:0/928235950 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4300012750 con 0x7f431806c8c0 2023-12-16T03:28:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f431d11d640 1 -- 172.21.15.28:0/928235950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4318142740 con 0x7f431806c8c0 2023-12-16T03:28:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f430f7fe640 1 -- 172.21.15.28:0/928235950 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300012ae0 con 0x7f431806c8c0 2023-12-16T03:28:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f431d11d640 1 -- 172.21.15.28:0/928235950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43181f1a20 con 0x7f431806c8c0 2023-12-16T03:28:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f431d11d640 1 -- 172.21.15.28:0/928235950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4318161780 con 0x7f431806c8c0 2023-12-16T03:28:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f430f7fe640 1 -- 172.21.15.28:0/928235950 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4300012c40 con 0x7f431806c8c0 2023-12-16T03:28:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f430f7fe640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f42f8066470 0x7f42f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f430f7fe640 1 -- 172.21.15.28:0/928235950 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4300083f70 con 0x7f431806c8c0 2023-12-16T03:28:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f4316d9d640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f42f8066470 0x7f42f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f430f7fe640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] conn(0x7f42f806c370 0x7f42f806e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f430f7fe640 1 -- 172.21.15.28:0/928235950 --> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f42f806ee40 con 0x7f42f806c370 2023-12-16T03:28:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.465+0000 7f430f7fe640 1 -- 172.21.15.28:0/928235950 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4300086630 con 0x7f431806c8c0 2023-12-16T03:28:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.469+0000 7f431759e640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] conn(0x7f42f806c370 0x7f42f806e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.469+0000 7f4316d9d640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f42f8066470 0x7f42f8068930 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f43080ad000 tx=0x7f4308008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.469+0000 7f431759e640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] conn(0x7f42f806c370 0x7f42f806e790 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:58.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.469+0000 7f430f7fe640 1 -- 172.21.15.28:0/928235950 <== osd.7 v2:172.21.15.134:6808/1504886822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f42f806ee40 con 0x7f42f806c370 2023-12-16T03:28:58.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.481+0000 7f431d11d640 1 -- 172.21.15.28:0/928235950 --> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4318068400 con 0x7f42f806c370 2023-12-16T03:28:58.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.481+0000 7f430f7fe640 1 -- 172.21.15.28:0/928235950 <== osd.7 v2:172.21.15.134:6808/1504886822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4318068400 con 0x7f42f806c370 2023-12-16T03:28:58.488 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-12-16T03:28:58.488 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-16T03:28:58.488 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-12-16T03:28:58.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.481+0000 7f431d11d640 1 -- 172.21.15.28:0/928235950 >> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] conn(0x7f42f806c370 msgr2=0x7f42f806e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.481+0000 7f431d11d640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.134:6808/1504886822,v1:172.21.15.134:6809/1504886822] conn(0x7f42f806c370 0x7f42f806e790 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.485+0000 7f431d11d640 1 -- 172.21.15.28:0/928235950 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f42f8066470 msgr2=0x7f42f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.485+0000 7f431d11d640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f42f8066470 0x7f42f8068930 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f43080ad000 tx=0x7f4308008040 comp rx=0 tx=0).stop 2023-12-16T03:28:58.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.485+0000 7f431d11d640 1 -- 172.21.15.28:0/928235950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f431806c8c0 msgr2=0x7f43181f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.485+0000 7f431d11d640 1 --2- 172.21.15.28:0/928235950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f431806c8c0 0x7f43181f0f20 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f430000d5f0 tx=0x7f430000dab0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.485+0000 7f431759e640 1 -- 172.21.15.28:0/928235950 reap_dead start 2023-12-16T03:28:58.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.485+0000 7f431d11d640 1 -- 172.21.15.28:0/928235950 shutdown_connections 2023-12-16T03:28:58.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.485+0000 7f431d11d640 1 -- 172.21.15.28:0/928235950 >> 172.21.15.28:0/928235950 conn(0x7f43180ca360 msgr2=0x7f43180c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:58.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.485+0000 7f431d11d640 1 -- 172.21.15.28:0/928235950 shutdown_connections 2023-12-16T03:28:58.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.485+0000 7f431d11d640 1 -- 172.21.15.28:0/928235950 wait complete. 2023-12-16T03:28:58.507 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-16T03:28:58.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.645+0000 7f4d8c9b8640 1 Processor -- start 2023-12-16T03:28:58.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.645+0000 7f4d8c9b8640 1 -- start start 2023-12-16T03:28:58.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.645+0000 7f4d8c9b8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d880a5370 0x7f4d880c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.645+0000 7f4d8c9b8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d88072090 0x7f4d881516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.645+0000 7f4d8c9b8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d880c2760 con 0x7f4d880c4110 2023-12-16T03:28:58.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.645+0000 7f4d8c9b8640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d880c3070 con 0x7f4d88072090 2023-12-16T03:28:58.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.645+0000 7f4d8c9b8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d88151bf0 con 0x7f4d880a5370 2023-12-16T03:28:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d8659c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d880a5370 0x7f4d880c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d8659c640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d880a5370 0x7f4d880c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.28:34652/0 (socket says 172.21.15.28:34652) 2023-12-16T03:28:58.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d86d9d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d88072090 0x7f4d881516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d8659c640 1 -- 172.21.15.28:0/1702096423 learned_addr learned my addr 172.21.15.28:0/1702096423 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:58.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d85d9b640 1 --1- 172.21.15.28:0/1702096423 >> v1:172.21.15.134:6789/0 conn(0x7f4d880c4110 0x7f4d88150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.28:33286/0 (socket says 172.21.15.28:33286) 2023-12-16T03:28:58.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d8659c640 1 -- 172.21.15.28:0/1702096423 >> v2:172.21.15.134:3300/0 conn(0x7f4d88072090 msgr2=0x7f4d881516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:58.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d8659c640 1 --2- 172.21.15.28:0/1702096423 >> v2:172.21.15.134:3300/0 conn(0x7f4d88072090 0x7f4d881516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d8659c640 1 -- 172.21.15.28:0/1702096423 >> v1:172.21.15.134:6789/0 conn(0x7f4d880c4110 legacy=0x7f4d88150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d8659c640 1 -- 172.21.15.28:0/1702096423 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d880a5750 con 0x7f4d880a5370 2023-12-16T03:28:58.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d8659c640 1 --2- 172.21.15.28:0/1702096423 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d880a5370 0x7f4d880c3bd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009870 tx=0x7f4d7801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49361c28da0e2ee6 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:58.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d8559a640 1 -- 172.21.15.28:0/1702096423 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780ab5f0 con 0x7f4d880a5370 2023-12-16T03:28:58.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d8559a640 1 -- 172.21.15.28:0/1702096423 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d780ab750 con 0x7f4d880a5370 2023-12-16T03:28:58.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.649+0000 7f4d8559a640 1 -- 172.21.15.28:0/1702096423 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780abae0 con 0x7f4d880a5370 2023-12-16T03:28:58.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/1702096423 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d880a5370 msgr2=0x7f4d880c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 --2- 172.21.15.28:0/1702096423 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d880a5370 0x7f4d880c3bd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009870 tx=0x7f4d7801c3f0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/1702096423 shutdown_connections 2023-12-16T03:28:58.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 --2- 172.21.15.28:0/1702096423 >> v2:172.21.15.134:3300/0 conn(0x7f4d88072090 0x7f4d881516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 --2- 172.21.15.28:0/1702096423 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d880a5370 0x7f4d880c3bd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/1702096423 >> 172.21.15.28:0/1702096423 conn(0x7f4d8806a5b0 msgr2=0x7f4d8806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:58.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/1702096423 shutdown_connections 2023-12-16T03:28:58.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/1702096423 wait complete. 2023-12-16T03:28:58.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 Processor -- start 2023-12-16T03:28:58.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 -- start start 2023-12-16T03:28:58.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d88072090 0x7f4d8814f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d880a5370 0x7f4d88150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d880c4110 0x7f4d88070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d881550f0 con 0x7f4d880c4110 2023-12-16T03:28:58.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8814ef00 con 0x7f4d880a5370 2023-12-16T03:28:58.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d8c9b8640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d881509b0 con 0x7f4d88072090 2023-12-16T03:28:58.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d86d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d880c4110 0x7f4d88070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d86d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d880c4110 0x7f4d88070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43960/0 (socket says 172.21.15.28:43960) 2023-12-16T03:28:58.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d86d9d640 1 -- 172.21.15.28:0/3380776281 learned_addr learned my addr 172.21.15.28:0/3380776281 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:58.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d8659c640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d88072090 0x7f4d8814f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d86d9d640 1 -- 172.21.15.28:0/3380776281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d88072090 msgr2=0x7f4d8814f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.653+0000 7f4d85d9b640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d880a5370 0x7f4d88150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d86d9d640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d88072090 0x7f4d8814f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d86d9d640 1 -- 172.21.15.28:0/3380776281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d880a5370 msgr2=0x7f4d88150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d86d9d640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d880a5370 0x7f4d88150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d86d9d640 1 -- 172.21.15.28:0/3380776281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d780094d0 con 0x7f4d880c4110 2023-12-16T03:28:58.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d8659c640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d88072090 0x7f4d8814f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:58.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d85d9b640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d880a5370 0x7f4d88150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-16T03:28:58.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d86d9d640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d880c4110 0x7f4d88070cb0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000efc0 tx=0x7f4d8000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:58.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d76ffd640 1 -- 172.21.15.28:0/3380776281 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80014480 con 0x7f4d880c4110 2023-12-16T03:28:58.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d76ffd640 1 -- 172.21.15.28:0/3380776281 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8000f040 con 0x7f4d880c4110 2023-12-16T03:28:58.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d76ffd640 1 -- 172.21.15.28:0/3380776281 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80014820 con 0x7f4d880c4110 2023-12-16T03:28:58.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/3380776281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8814ec20 con 0x7f4d880c4110 2023-12-16T03:28:58.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/3380776281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d880711f0 con 0x7f4d880c4110 2023-12-16T03:28:58.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/3380776281 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8814f440 con 0x7f4d880c4110 2023-12-16T03:28:58.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d76ffd640 1 -- 172.21.15.28:0/3380776281 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4d80014980 con 0x7f4d880c4110 2023-12-16T03:28:58.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d76ffd640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d680664a0 0x7f4d68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d76ffd640 1 -- 172.21.15.28:0/3380776281 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4d80084730 con 0x7f4d880c4110 2023-12-16T03:28:58.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.657+0000 7f4d8659c640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d680664a0 0x7f4d68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.661+0000 7f4d8659c640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d680664a0 0x7f4d68068960 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009870 tx=0x7f4d78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:58.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.661+0000 7f4d76ffd640 1 -- 172.21.15.28:0/3380776281 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4d8814f440 con 0x7f4d880c4110 2023-12-16T03:28:58.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.817+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/3380776281 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d880c2c90 con 0x7f4d680664a0 2023-12-16T03:28:58.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.817+0000 7f4d76ffd640 1 -- 172.21.15.28:0/3380776281 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4d780bb090 con 0x7f4d680664a0 2023-12-16T03:28:58.824 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 7 to deep-scrub 2023-12-16T03:28:58.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/3380776281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d680664a0 msgr2=0x7f4d68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d680664a0 0x7f4d68068960 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009870 tx=0x7f4d78008040 comp rx=0 tx=0).stop 2023-12-16T03:28:58.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/3380776281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d880c4110 msgr2=0x7f4d88070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d880c4110 0x7f4d88070cb0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000efc0 tx=0x7f4d8000c490 comp rx=0 tx=0).stop 2023-12-16T03:28:58.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/3380776281 shutdown_connections 2023-12-16T03:28:58.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f4d680664a0 0x7f4d68068960 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d880c4110 0x7f4d88070cb0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d880a5370 0x7f4d88150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 --2- 172.21.15.28:0/3380776281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4d88072090 0x7f4d8814f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/3380776281 >> 172.21.15.28:0/3380776281 conn(0x7f4d8806a5b0 msgr2=0x7f4d8806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:58.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/3380776281 shutdown_connections 2023-12-16T03:28:58.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.821+0000 7f4d8c9b8640 1 -- 172.21.15.28:0/3380776281 wait complete. 2023-12-16T03:28:58.845 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:28:58.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8d14ea640 1 Processor -- start 2023-12-16T03:28:58.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8d14ea640 1 -- start start 2023-12-16T03:28:58.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8d14ea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8cc0a6c60 0x7fb8cc0c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8d14ea640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb8cc0c2840 0x7fb8cc0c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8d14ea640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc157cd0 con 0x7fb8cc1578f0 2023-12-16T03:28:58.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8d14ea640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c2e00 con 0x7fb8cc0c2840 2023-12-16T03:28:58.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8d14ea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc158850 con 0x7fb8cc0a6c60 2023-12-16T03:28:58.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8cb7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb8cc0c2840 0x7fb8cc0c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8cb7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb8cc0c2840 0x7fb8cc0c17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43972/0 (socket says 172.21.15.28:43972) 2023-12-16T03:28:58.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8cb7fe640 1 -- 172.21.15.28:0/4123085831 learned_addr learned my addr 172.21.15.28:0/4123085831 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:58.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8c3fff640 1 --2- 172.21.15.28:0/4123085831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8cc0a6c60 0x7fb8cc0c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8cb7fe640 1 -- 172.21.15.28:0/4123085831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8cc0a6c60 msgr2=0x7fb8cc0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:58.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8cb7fe640 1 --2- 172.21.15.28:0/4123085831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8cc0a6c60 0x7fb8cc0c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8cb7fe640 1 -- 172.21.15.28:0/4123085831 >> v1:172.21.15.134:6789/0 conn(0x7fb8cc1578f0 legacy=0x7fb8cc0c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:28:58.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.985+0000 7fb8cb7fe640 1 -- 172.21.15.28:0/4123085831 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc157f20 con 0x7fb8cc0c2840 2023-12-16T03:28:58.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8cb7fe640 1 --2- 172.21.15.28:0/4123085831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc0c2840 0x7fb8cc0c17b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009e50 tx=0x7fb8c401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be726e699ba3485 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:58.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8ca7fc640 1 -- 172.21.15.28:0/4123085831 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40a56b0 con 0x7fb8cc0c2840 2023-12-16T03:28:58.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8ca7fc640 1 -- 172.21.15.28:0/4123085831 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c40a5810 con 0x7fb8cc0c2840 2023-12-16T03:28:58.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8ca7fc640 1 -- 172.21.15.28:0/4123085831 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40a5ba0 con 0x7fb8cc0c2840 2023-12-16T03:28:58.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8d14ea640 1 -- 172.21.15.28:0/4123085831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc0c2840 msgr2=0x7fb8cc0c17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:58.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8d14ea640 1 --2- 172.21.15.28:0/4123085831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc0c2840 0x7fb8cc0c17b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009e50 tx=0x7fb8c401c940 comp rx=0 tx=0).stop 2023-12-16T03:28:58.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8d14ea640 1 -- 172.21.15.28:0/4123085831 shutdown_connections 2023-12-16T03:28:58.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8d14ea640 1 --2- 172.21.15.28:0/4123085831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8cc0a6c60 0x7fb8cc0c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8d14ea640 1 --2- 172.21.15.28:0/4123085831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc0c2840 0x7fb8cc0c17b0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:58.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8d14ea640 1 -- 172.21.15.28:0/4123085831 >> 172.21.15.28:0/4123085831 conn(0x7fb8cc0c7e40 msgr2=0x7fb8cc0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:58.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8d14ea640 1 -- 172.21.15.28:0/4123085831 shutdown_connections 2023-12-16T03:28:58.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8d14ea640 1 -- 172.21.15.28:0/4123085831 wait complete. 2023-12-16T03:28:58.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8d14ea640 1 Processor -- start 2023-12-16T03:28:58.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.989+0000 7fb8d14ea640 1 -- start start 2023-12-16T03:28:58.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8d14ea640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc0a6c60 0x7fb8cc06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8d14ea640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8cc0c2840 0x7fb8cc146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8d14ea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8cc1578f0 0x7fb8cc06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:58.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8d14ea640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc1475d0 con 0x7fb8cc0a6c60 2023-12-16T03:28:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8d14ea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0aa8a0 con 0x7fb8cc1578f0 2023-12-16T03:28:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8d14ea640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc06f050 con 0x7fb8cc0c2840 2023-12-16T03:28:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8caffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc0a6c60 0x7fb8cc06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8caffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc0a6c60 0x7fb8cc06fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:43984/0 (socket says 172.21.15.28:43984) 2023-12-16T03:28:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8caffd640 1 -- 172.21.15.28:0/3705888360 learned_addr learned my addr 172.21.15.28:0/3705888360 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:28:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8c3fff640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8cc0c2840 0x7fb8cc146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8cb7fe640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8cc1578f0 0x7fb8cc06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8caffd640 1 -- 172.21.15.28:0/3705888360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8cc0c2840 msgr2=0x7fb8cc146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:59.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8caffd640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8cc0c2840 0x7fb8cc146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:59.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8caffd640 1 -- 172.21.15.28:0/3705888360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8cc1578f0 msgr2=0x7fb8cc06e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:59.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8caffd640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8cc1578f0 0x7fb8cc06e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:59.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8caffd640 1 -- 172.21.15.28:0/3705888360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c4009b30 con 0x7fb8cc0a6c60 2023-12-16T03:28:59.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8c3fff640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8cc0c2840 0x7fb8cc146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:28:59.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8caffd640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc0a6c60 0x7fb8cc06fb40 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00c450 tx=0x7fb8bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:59.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8c37fe640 1 -- 172.21.15.28:0/3705888360 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc012830 con 0x7fb8cc0a6c60 2023-12-16T03:28:59.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8c37fe640 1 -- 172.21.15.28:0/3705888360 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc0129b0 con 0x7fb8cc0a6c60 2023-12-16T03:28:59.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8d14ea640 1 -- 172.21.15.28:0/3705888360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc06f330 con 0x7fb8cc0a6c60 2023-12-16T03:28:59.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8c37fe640 1 -- 172.21.15.28:0/3705888360 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc012d60 con 0x7fb8cc0a6c60 2023-12-16T03:28:59.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8d14ea640 1 -- 172.21.15.28:0/3705888360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc146560 con 0x7fb8cc0a6c60 2023-12-16T03:28:59.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8d14ea640 1 -- 172.21.15.28:0/3705888360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc06f570 con 0x7fb8cc0a6c60 2023-12-16T03:28:59.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.993+0000 7fb8c37fe640 1 -- 172.21.15.28:0/3705888360 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb8bc01c460 con 0x7fb8cc0a6c60 2023-12-16T03:28:59.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.997+0000 7fb8c37fe640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8ac066470 0x7fb8ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:28:59.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.997+0000 7fb8c37fe640 1 -- 172.21.15.28:0/3705888360 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb8bc0839d0 con 0x7fb8cc0a6c60 2023-12-16T03:28:59.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.997+0000 7fb8c3fff640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8ac066470 0x7fb8ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:28:59.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:58.997+0000 7fb8c3fff640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8ac066470 0x7fb8ac068930 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0ae150 tx=0x7fb8b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:28:59.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.001+0000 7fb8c37fe640 1 -- 172.21.15.28:0/3705888360 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb8cc06f570 con 0x7fb8cc0a6c60 2023-12-16T03:28:59.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.153+0000 7fb8d14ea640 1 -- 172.21.15.28:0/3705888360 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8cc06d700 con 0x7fb8ac066470 2023-12-16T03:28:59.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8c37fe640 1 -- 172.21.15.28:0/3705888360 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50925 (secure 0 0 0) 0x7fb8b400b200 con 0x7fb8ac066470 2023-12-16T03:28:59.163 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:28:59.164 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:28:59.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 -- 172.21.15.28:0/3705888360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8ac066470 msgr2=0x7fb8ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:59.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8ac066470 0x7fb8ac068930 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0ae150 tx=0x7fb8b4008040 comp rx=0 tx=0).stop 2023-12-16T03:28:59.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 -- 172.21.15.28:0/3705888360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc0a6c60 msgr2=0x7fb8cc06fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:28:59.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc0a6c60 0x7fb8cc06fb40 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00c450 tx=0x7fb8bc00c910 comp rx=0 tx=0).stop 2023-12-16T03:28:59.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 -- 172.21.15.28:0/3705888360 shutdown_connections 2023-12-16T03:28:59.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8cc1578f0 0x7fb8cc06e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:59.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb8cc0c2840 0x7fb8cc146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:59.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7fb8ac066470 0x7fb8ac068930 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:59.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 --2- 172.21.15.28:0/3705888360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8cc0a6c60 0x7fb8cc06fb40 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:28:59.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 -- 172.21.15.28:0/3705888360 >> 172.21.15.28:0/3705888360 conn(0x7fb8cc0c7e40 msgr2=0x7fb8cc14cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:28:59.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 -- 172.21.15.28:0/3705888360 shutdown_connections 2023-12-16T03:28:59.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:28:59.157+0000 7fb8d14ea640 1 -- 172.21.15.28:0/3705888360 wait complete. 2023-12-16T03:28:59.183 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2023-12-16T03:28:57.843191+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258224,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716496,"statfs":{"total":773094113280,"available":772829691904,"internally_reserved":0,"allocated":8986624,"data_stored":4628656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-138,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.590676"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":217,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-16T03:28:49.255472+0000","last_change":"2023-12-16T03:25:04.918758+0000","last_active":"2023-12-16T03:28:49.255472+0000","last_peered":"2023-12-16T03:28:49.255472+0000","last_clean":"2023-12-16T03:28:49.255472+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:28:49.255472+0000","last_undegraded":"2023-12-16T03:28:49.255472+0000","last_fullsized":"2023-12-16T03:28:49.255472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-16T03:25:03.857708+0000","last_clean_scrub_stamp":"2023-12-16T03:25:03.857708+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T14:26:21.330967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1568768,"data_stored":1021358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85899999999999999,"5min":1.155,"15min":1.155},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70099999999999996,"15min":0.71099999999999997},"min":{"1min":0.51500000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89400000000000002,"5min":1.585,"15min":1.585},"last":0.53100000000000003}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.75800000000000001,"15min":0.78700000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95099999999999996,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78600000000000003,"15min":0.82599999999999996},"min":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84099999999999997,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.78200000000000003},"min":{"1min":0.495,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.77300000000000002,"15min":0.80300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99399999999999999,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.76500000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.73799999999999999,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.871,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2370000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.73799999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.71299999999999997}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78900000000000003,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.753},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.746,"15min":0.76100000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92900000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.77100000000000002,"15min":0.81899999999999995},"min":{"1min":0.44700000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.502,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.69099999999999995}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.78900000000000003,"15min":0.84099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95299999999999996,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.93200000000000005,"15min":1.046},"min":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85699999999999998,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.872}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.89900000000000002,"15min":1.002},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.51500000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.131,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.82599999999999996,"15min":0.88200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91800000000000004,"5min":4.242,"15min":4.242},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.85999999999999999,"15min":0.92000000000000004},"min":{"1min":0.57399999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.95799999999999996,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.57899999999999996}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.873,"5min":1.111,"15min":1.111},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86099999999999999,"5min":1.073,"15min":1.073},"last":0.55100000000000005}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.52300000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92800000000000005,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.82399999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0009999999999999,"5min":1.246,"15min":1.246},"last":0.624},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80000000000000004,"15min":0.80800000000000005},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86699999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":1.111,"15min":1.111},"last":0.79300000000000004}]},{"osd":1,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92500000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89800000000000002,"5min":1,"15min":1},"last":0.90500000000000003}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.48499999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":1.044}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.51000000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71399999999999997,"15min":0.70699999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93999999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.98799999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.622,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.71599999999999997},"min":{"1min":0.48199999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.69299999999999995}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63600000000000001,"15min":0.65100000000000002},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71199999999999997,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.76700000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.81599999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.022,"5min":1.105,"15min":1.105},"last":0.95799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.751,"15min":0.79900000000000004},"min":{"1min":0.436,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":4.194,"15min":4.194},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.034,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.72499999999999998}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.621,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95199999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.84899999999999998,"15min":0.93100000000000005},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96899999999999997,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.622},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0700000000000001,"5min":1.288,"15min":1.288},"last":0.64100000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84699999999999998,"15min":0.91800000000000004},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91200000000000003,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.878,"15min":0.94599999999999995},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.504}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.70199999999999996,"15min":0.72299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89500000000000002,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73399999999999999,"15min":0.76200000000000001},"min":{"1min":0.47399999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85599999999999998,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.53700000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.75,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92400000000000004,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.80600000000000005,"15min":0.83999999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93100000000000005,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.753}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.59299999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85699999999999998,"5min":1.881,"15min":1.881},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80300000000000005,"15min":0.83499999999999996},"min":{"1min":0.53600000000000003,"5min":0.501,"15min":0.501},"max":{"1min":0.95599999999999996,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.65900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.66200000000000003,"15min":0.77600000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.71599999999999997,"15min":0.83999999999999997},"min":{"1min":0.32100000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.58699999999999997,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.32300000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60699999999999998,"15min":0.68500000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.57999999999999996,"15min":0.622},"min":{"1min":0.34300000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63700000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.628,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.82199999999999995,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.372},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.67600000000000005,"15min":0.747},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73799999999999999,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.44}]},{"osd":4,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81100000000000005,"15min":0.85399999999999998},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.503},"max":{"1min":0.94399999999999995,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.871,"15min":0.92100000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.016,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.92500000000000004}]},{"osd":5,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.84199999999999997,"15min":0.88800000000000001},"min":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.99199999999999999,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.85799999999999998,"15min":0.91000000000000003},"min":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.88800000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.95299999999999996}]},{"osd":6,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.84799999999999998,"15min":0.88400000000000001},"min":{"1min":0.60299999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.94799999999999995,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.88100000000000001,"15min":0.93899999999999995},"min":{"1min":0.60099999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98399999999999999,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.97499999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:28:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.89300000000000002,"15min":0.94999999999999996},"min":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97699999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.90900000000000003,"15min":0.96499999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.996,"5min":3.375,"15min":3.375},"last":0.89300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.436,"15min":0.45200000000000001},"min":{"1min":0.27100000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54200000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.47799999999999998,"15min":0.48299999999999998},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.42999999999999999},"min":{"1min":0.318,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.627,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80000000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.35299999999999998}]},{"osd":3,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70699999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.37},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73099999999999998,"5min":1.022,"15min":1.022},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93700000000000006,"5min":1.587,"15min":1.587},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.76600000000000001,"15min":0.79900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90500000000000003,"5min":1.913,"15min":1.913},"last":0.60699999999999998}]},{"osd":5,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75700000000000001,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.86899999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76700000000000002,"15min":0.78000000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97599999999999998,"5min":1.018,"15min":1.018},"last":0.751}]},{"osd":6,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93200000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.77600000000000002,"15min":0.78700000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92600000000000005,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.76900000000000002}]},{"osd":7,"last update":"Sat Dec 16 03:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.81000000000000005,"15min":0.83999999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.94999999999999996,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.97999999999999998,"5min":1.212,"15min":1.212},"last":0.56599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.55900000000000005,"15min":0.625},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.61199999999999999,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.63600000000000001,"15min":0.70099999999999996},"min":{"1min":0.371,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70599999999999996,"5min":4.476,"15min":4.476},"last":0.65900000000000003}]},{"osd":2,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.71399999999999997,"15min":0.83099999999999996},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.66400000000000003,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.68100000000000005,"15min":0.77100000000000002},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.755,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.69299999999999995}]},{"osd":3,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.66000000000000003,"15min":0.71999999999999997},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79800000000000004,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.68400000000000005},"min":{"1min":0.318,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.81799999999999995,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.60399999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.94899999999999995,"15min":1.0549999999999999},"min":{"1min":0.50800000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86699999999999999,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.872,"15min":0.94999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98299999999999998,"5min":4.984,"15min":4.984},"last":0.90800000000000003}]},{"osd":5,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.84699999999999998,"15min":0.92100000000000004},"min":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.98699999999999999,"15min":1.113},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89700000000000002,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":1.0109999999999999}]},{"osd":6,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.88700000000000001,"15min":0.96699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92000000000000004,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":1.038},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.99199999999999999,"15min":1.115},"min":{"1min":0.56200000000000006,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96599999999999997,"5min":7.681,"15min":7.681},"last":0.92200000000000004}]},{"osd":7,"last update":"Sat Dec 16 03:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.96099999999999997,"15min":1.0509999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94499999999999995,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.93200000000000005,"15min":1.0129999999999999},"min":{"1min":0.58899999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.042,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.996}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1568768,"data_stored":1021358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.67100000000000004,"15min":0.78300000000000003},"min":{"1min":0.30499999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.78900000000000003,"15min":0.92500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.38500000000000001}]},{"osd":2,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.82199999999999995,"15min":0.96299999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.90100000000000002,"15min":1.0680000000000001},"min":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79200000000000004,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.80000000000000004,"15min":0.96799999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89800000000000002,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.71599999999999997,"15min":0.80400000000000005},"min":{"1min":0.36899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77000000000000002,"5min":3.254,"15min":3.254},"last":0.33500000000000002}]},{"osd":4,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89400000000000002,"15min":0.96699999999999997},"min":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0660000000000001,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.92200000000000004,"15min":1.002},"min":{"1min":0.56499999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":3.327,"15min":3.327},"last":0.84399999999999997}]},{"osd":5,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.98999999999999999,"15min":1.1180000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.90500000000000003,"15min":1.0089999999999999},"min":{"1min":0.46500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84699999999999998,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.90900000000000003,"15min":1.002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84499999999999997,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.056,"15min":1.206},"min":{"1min":0.53700000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.999,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.90600000000000003}]},{"osd":7,"last update":"Sat Dec 16 03:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":1.0760000000000001,"15min":1.214},"min":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0980000000000001,"5min":4.444,"15min":4.444},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.96299999999999997,"15min":1.056},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.94899999999999995,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.877}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:28:59.186 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-16T03:25:03.857708+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=3, tm_min=25, tm_sec=3, tm_wday=5, tm_yday=350, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=16, tm_hour=3, tm_min=28, tm_sec=53, tm_wday=5, tm_yday=350, tm_isdst=0) 2023-12-16T03:28:59.187 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-16T03:29:06.212 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:29:06.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:29:19.188 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-16T03:29:19.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf4911d640 1 Processor -- start 2023-12-16T03:29:19.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf4911d640 1 -- start start 2023-12-16T03:29:19.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf4911d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faf440c7ea0 0x7faf4406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf4911d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf4406b9e0 0x7faf4415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf4911d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4406c860 con 0x7faf44151e90 2023-12-16T03:29:19.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf4911d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf440c8750 con 0x7faf440c7ea0 2023-12-16T03:29:19.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf4911d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf441552d0 con 0x7faf4406b9e0 2023-12-16T03:29:19.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf3bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faf440c7ea0 0x7faf4406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf3bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faf440c7ea0 0x7faf4406b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47556/0 (socket says 172.21.15.28:47556) 2023-12-16T03:29:19.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf3bfff640 1 -- 172.21.15.28:0/2595496182 learned_addr learned my addr 172.21.15.28:0/2595496182 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:29:19.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf4359e640 1 --2- 172.21.15.28:0/2595496182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf4406b9e0 0x7faf4415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf3bfff640 1 -- 172.21.15.28:0/2595496182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf4406b9e0 msgr2=0x7faf4415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:29:19.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf3bfff640 1 --2- 172.21.15.28:0/2595496182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf4406b9e0 0x7faf4415f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf3bfff640 1 -- 172.21.15.28:0/2595496182 >> v1:172.21.15.134:6789/0 conn(0x7faf44151e90 legacy=0x7faf440c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.340+0000 7faf3bfff640 1 -- 172.21.15.28:0/2595496182 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf44154930 con 0x7faf440c7ea0 2023-12-16T03:29:19.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf3bfff640 1 --2- 172.21.15.28:0/2595496182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf440c7ea0 0x7faf4406b4a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009870 tx=0x7faf2c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfd8f1e8b8ab9fa server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:29:19.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf4259c640 1 -- 172.21.15.28:0/2595496182 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0ab600 con 0x7faf440c7ea0 2023-12-16T03:29:19.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf4259c640 1 -- 172.21.15.28:0/2595496182 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0a7050 con 0x7faf440c7ea0 2023-12-16T03:29:19.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf4259c640 1 -- 172.21.15.28:0/2595496182 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0ab980 con 0x7faf440c7ea0 2023-12-16T03:29:19.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf4911d640 1 -- 172.21.15.28:0/2595496182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf440c7ea0 msgr2=0x7faf4406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf4911d640 1 --2- 172.21.15.28:0/2595496182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf440c7ea0 0x7faf4406b4a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009870 tx=0x7faf2c01c420 comp rx=0 tx=0).stop 2023-12-16T03:29:19.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf4911d640 1 -- 172.21.15.28:0/2595496182 shutdown_connections 2023-12-16T03:29:19.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf4911d640 1 --2- 172.21.15.28:0/2595496182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf4406b9e0 0x7faf4415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf4911d640 1 --2- 172.21.15.28:0/2595496182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf440c7ea0 0x7faf4406b4a0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf4911d640 1 -- 172.21.15.28:0/2595496182 >> 172.21.15.28:0/2595496182 conn(0x7faf440ca170 msgr2=0x7faf440ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:29:19.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf4911d640 1 -- 172.21.15.28:0/2595496182 shutdown_connections 2023-12-16T03:29:19.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.344+0000 7faf4911d640 1 -- 172.21.15.28:0/2595496182 wait complete. 2023-12-16T03:29:19.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4911d640 1 Processor -- start 2023-12-16T03:29:19.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4911d640 1 -- start start 2023-12-16T03:29:19.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4911d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf4406b9e0 0x7faf4414e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4911d640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf440c7ea0 0x7faf440aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4911d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf44151e90 0x7faf441f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4911d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf441483b0 con 0x7faf44151e90 2023-12-16T03:29:19.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4911d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf44147ba0 con 0x7faf4406b9e0 2023-12-16T03:29:19.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4911d640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4414ee20 con 0x7faf440c7ea0 2023-12-16T03:29:19.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf44151e90 0x7faf441f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf44151e90 0x7faf441f0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47558/0 (socket says 172.21.15.28:47558) 2023-12-16T03:29:19.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4359e640 1 -- 172.21.15.28:0/3412937004 learned_addr learned my addr 172.21.15.28:0/3412937004 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:29:19.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf3bfff640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf440c7ea0 0x7faf440aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf42d9d640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf4406b9e0 0x7faf4414e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4359e640 1 -- 172.21.15.28:0/3412937004 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf440c7ea0 msgr2=0x7faf440aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4359e640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf440c7ea0 0x7faf440aa020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4359e640 1 -- 172.21.15.28:0/3412937004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf4406b9e0 msgr2=0x7faf4414e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4359e640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf4406b9e0 0x7faf4414e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4359e640 1 -- 172.21.15.28:0/3412937004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0094d0 con 0x7faf44151e90 2023-12-16T03:29:19.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf42d9d640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf4406b9e0 0x7faf4414e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-16T03:29:19.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4359e640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf44151e90 0x7faf441f0910 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00efc0 tx=0x7faf3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:29:19.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf3b7fe640 1 -- 172.21.15.28:0/3412937004 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c009ba0 con 0x7faf44151e90 2023-12-16T03:29:19.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf3b7fe640 1 -- 172.21.15.28:0/3412937004 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c00f040 con 0x7faf44151e90 2023-12-16T03:29:19.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf3b7fe640 1 -- 172.21.15.28:0/3412937004 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0146c0 con 0x7faf44151e90 2023-12-16T03:29:19.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4911d640 1 -- 172.21.15.28:0/3412937004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf44147df0 con 0x7faf44151e90 2023-12-16T03:29:19.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.348+0000 7faf4911d640 1 -- 172.21.15.28:0/3412937004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4414e3c0 con 0x7faf44151e90 2023-12-16T03:29:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.352+0000 7faf4911d640 1 -- 172.21.15.28:0/3412937004 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4414e220 con 0x7faf44151e90 2023-12-16T03:29:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.352+0000 7faf3b7fe640 1 -- 172.21.15.28:0/3412937004 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7faf3c014820 con 0x7faf44151e90 2023-12-16T03:29:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.352+0000 7faf3b7fe640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf24066470 0x7faf24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.352+0000 7faf3b7fe640 1 -- 172.21.15.28:0/3412937004 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7faf3c0845c0 con 0x7faf44151e90 2023-12-16T03:29:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.352+0000 7faf42d9d640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf24066470 0x7faf24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.352+0000 7faf42d9d640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf24066470 0x7faf24068930 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7faf34000f70 tx=0x7faf34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:29:19.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.356+0000 7faf3b7fe640 1 -- 172.21.15.28:0/3412937004 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7faf4414e220 con 0x7faf44151e90 2023-12-16T03:29:19.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.508+0000 7faf4911d640 1 -- 172.21.15.28:0/3412937004 --> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf440c9a20 con 0x7faf24066470 2023-12-16T03:29:19.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.512+0000 7faf3b7fe640 1 -- 172.21.15.28:0/3412937004 <== mgr.4102 v2:172.21.15.28:6832/2582326308 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50825 (secure 0 0 0) 0x7faf440c9a20 con 0x7faf24066470 2023-12-16T03:29:19.515 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:29:19.516 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-12-16T03:29:19.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 -- 172.21.15.28:0/3412937004 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf24066470 msgr2=0x7faf24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf24066470 0x7faf24068930 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7faf34000f70 tx=0x7faf34009040 comp rx=0 tx=0).stop 2023-12-16T03:29:19.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 -- 172.21.15.28:0/3412937004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf44151e90 msgr2=0x7faf441f0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf44151e90 0x7faf441f0910 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00efc0 tx=0x7faf3c00c490 comp rx=0 tx=0).stop 2023-12-16T03:29:19.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 -- 172.21.15.28:0/3412937004 shutdown_connections 2023-12-16T03:29:19.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7faf24066470 0x7faf24068930 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faf44151e90 0x7faf441f0910 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf440c7ea0 0x7faf440aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 --2- 172.21.15.28:0/3412937004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf4406b9e0 0x7faf4414e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 -- 172.21.15.28:0/3412937004 >> 172.21.15.28:0/3412937004 conn(0x7faf440ca170 msgr2=0x7faf441442e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:29:19.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 -- 172.21.15.28:0/3412937004 shutdown_connections 2023-12-16T03:29:19.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.516+0000 7faf4911d640 1 -- 172.21.15.28:0/3412937004 wait complete. 2023-12-16T03:29:19.536 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-12-16T03:29:17.847328+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258216,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716504,"statfs":{"total":773094113280,"available":772829700096,"internally_reserved":0,"allocated":8986624,"data_stored":4628656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002627"},"pg_stats":[{"pgid":"1.0","version":"78'119","reported_seq":229,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-16T03:29:01.830944+0000","last_change":"2023-12-16T03:29:01.830944+0000","last_active":"2023-12-16T03:29:01.830944+0000","last_peered":"2023-12-16T03:29:01.830944+0000","last_clean":"2023-12-16T03:29:01.830944+0000","last_became_active":"2023-12-16T03:25:04.917774+0000","last_became_peered":"2023-12-16T03:25:04.917774+0000","last_unstale":"2023-12-16T03:29:01.830944+0000","last_undegraded":"2023-12-16T03:29:01.830944+0000","last_fullsized":"2023-12-16T03:29:01.830944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"78'119","last_scrub_stamp":"2023-12-16T03:29:01.830803+0000","last_deep_scrub":"78'119","last_deep_scrub_stamp":"2023-12-16T03:29:01.830803+0000","last_clean_scrub_stamp":"2023-12-16T03:29:01.830803+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-17T11:12:54.961098+0000","scrub_duration":0.0065282550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1568768,"data_stored":1021358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93999999999999995,"5min":1.155,"15min":1.155},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.70699999999999996},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93799999999999994,"5min":1.585,"15min":1.585},"last":0.76300000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.78100000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.016,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.871},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.755,"15min":0.81599999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92800000000000005,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.81799999999999995}]},{"osd":2,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72899999999999998,"15min":0.77600000000000002},"min":{"1min":0.47699999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93799999999999994,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.755,"15min":0.79700000000000004},"min":{"1min":0.51100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92100000000000004,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.63900000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72599999999999998,"15min":0.75900000000000001},"min":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.91000000000000003,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77300000000000002,"15min":0.80000000000000004},"min":{"1min":0.54700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.052,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64100000000000001,"15min":0.66400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93799999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67500000000000004,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69299999999999995,"15min":0.71099999999999997},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.012,"5min":1.101,"15min":1.101},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72499999999999998,"15min":0.73499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.77200000000000002,"15min":0.79700000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98999999999999999,"5min":1.147,"15min":1.147},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73299999999999998,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0329999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.69999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.748,"15min":0.81200000000000006},"min":{"1min":0.41199999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0720000000000001,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.73399999999999999,"15min":0.79900000000000004},"min":{"1min":0.497,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":4.1890000000000001,"15min":4.1890000000000001},"last":0.627}]},{"osd":1,"last update":"Sat Dec 16 03:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.82999999999999996},"min":{"1min":0.45500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.105,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.85799999999999998,"15min":1.0209999999999999},"min":{"1min":0.55500000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.125,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Sat Dec 16 03:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.82499999999999996,"15min":0.97699999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97099999999999997,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78700000000000003,"15min":0.85099999999999998},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.054,"5min":4.2210000000000001,"15min":4.2210000000000001},"last":0.66100000000000003}]},{"osd":3,"last update":"Sat Dec 16 03:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79200000000000004,"15min":0.871},"min":{"1min":0.53200000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1719999999999999,"5min":4.242,"15min":4.242},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.81799999999999995,"15min":0.90600000000000003},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92100000000000004,"5min":4.2560000000000002,"15min":4.2560000000000002},"last":0.56999999999999995}]},{"osd":4,"last update":"Sat Dec 16 03:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69099999999999995,"15min":0.70599999999999996},"min":{"1min":0.46899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.91500000000000004,"5min":1.111,"15min":1.111},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71699999999999997,"15min":0.73399999999999999},"min":{"1min":0.42399999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.022,"5min":1.073,"15min":1.073},"last":0.41699999999999998}]},{"osd":5,"last update":"Sat Dec 16 03:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96999999999999997,"5min":1.075,"15min":1.075},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.48099999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:29:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.81499999999999995},"min":{"1min":0.50700000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.875,"5min":1.246,"15min":1.246},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0620000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.502}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63800000000000001,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89600000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64300000000000002,"15min":0.63900000000000001},"min":{"1min":0.42399999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1000000000000001,"5min":1.111,"15min":1.111},"last":0.75700000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.52600000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1859999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90500000000000003,"5min":1,"15min":1},"last":0.73599999999999999}]},{"osd":2,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65600000000000003,"15min":0.64800000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.81299999999999994,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.52600000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.79100000000000004}]},{"osd":3,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83899999999999997,"5min":1.129,"15min":1.129},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72699999999999998,"15min":0.71099999999999997},"min":{"1min":0.52000000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.044,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60799999999999998,"15min":0.65000000000000002},"min":{"1min":0.39200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.622},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67900000000000005,"15min":0.71199999999999997},"min":{"1min":0.45200000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.625,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79800000000000004,"5min":0.879,"15min":0.879},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69499999999999995,"15min":0.73299999999999998},"min":{"1min":0.496,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.58099999999999996}]},{"osd":7,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78700000000000003,"15min":0.81200000000000006},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0169999999999999,"5min":1.105,"15min":1.105},"last":0.77200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.71399999999999997,"15min":0.78700000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84699999999999998,"5min":4.194,"15min":4.194},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71199999999999997,"15min":0.73999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98399999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.76800000000000002}]},{"osd":1,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71499999999999997,"15min":0.73399999999999999},"min":{"1min":0.50600000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.85599999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82799999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.78600000000000003,"15min":0.91000000000000003},"min":{"1min":0.48699999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97599999999999998,"5min":4.1689999999999996,"15min":4.1689999999999996},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.746,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89200000000000002,"5min":1.288,"15min":1.288},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.79700000000000004,"15min":0.90100000000000002},"min":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92800000000000005,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.82499999999999996,"15min":0.92900000000000005},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92300000000000004,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.74199999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.42199999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70799999999999996,"15min":0.754},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96499999999999997,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72599999999999998,"15min":0.78100000000000003},"min":{"1min":0.436,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85799999999999998,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78000000000000003,"15min":0.83099999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94699999999999995,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.71299999999999997}]},{"osd":7,"last update":"Sat Dec 16 03:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.747,"15min":0.79700000000000004},"min":{"1min":0.47699999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.014,"5min":1.881,"15min":1.881},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.78400000000000003,"15min":0.82799999999999996},"min":{"1min":0.56899999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.98799999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.84199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.58299999999999996,"15min":0.749},"min":{"1min":0.34300000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63300000000000001,"5min":5.4710000000000001,"15min":5.4710000000000001},"last":0.503},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.629,"15min":0.81100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67300000000000004,"5min":6.1189999999999998,"15min":6.1189999999999998},"last":0.44700000000000001}]},{"osd":1,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.54900000000000004,"15min":0.66500000000000004},"min":{"1min":0.32100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.57099999999999995,"5min":3.7890000000000001,"15min":3.7890000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.54500000000000004,"15min":0.60999999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70299999999999996,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.58599999999999997,"15min":0.65800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.59999999999999998,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.626,"15min":0.72999999999999998},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67200000000000004,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.60299999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78400000000000003,"15min":0.84499999999999997},"min":{"1min":0.625,"5min":0.503,"15min":0.503},"max":{"1min":0.93999999999999995,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.88},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.82499999999999996,"15min":0.90500000000000003},"min":{"1min":0.57799999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0189999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.80300000000000005,"15min":0.875},"min":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.93700000000000006,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.81899999999999995,"15min":0.89700000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.95299999999999996,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.81299999999999994,"15min":0.872},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.88300000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":0.751},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.83099999999999996,"15min":0.92200000000000004},"min":{"1min":0.60099999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97499999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.97399999999999998}]},{"osd":7,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.93300000000000005},"min":{"1min":0.57599999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.90700000000000003,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.86399999999999999,"15min":0.94999999999999996},"min":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97099999999999997,"5min":3.375,"15min":3.375},"last":0.94599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.41899999999999998,"15min":0.44600000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.59099999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.44,"5min":0.46800000000000003,"15min":0.47999999999999998},"min":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.628,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Dec 16 03:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.439,"15min":0.42899999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.50600000000000001,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.495,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.76200000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.499},"min":{"1min":0.37,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70399999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.628},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73999999999999999,"5min":1.022,"15min":1.022},"last":0.72199999999999998}]},{"osd":4,"last update":"Sat Dec 16 03:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73999999999999999,"15min":0.76600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":1.587,"15min":1.587},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.74199999999999999,"15min":0.79100000000000004},"min":{"1min":0.45200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95399999999999996,"5min":1.913,"15min":1.913},"last":0.81499999999999995}]},{"osd":5,"last update":"Sat Dec 16 03:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.745,"15min":0.76200000000000001},"min":{"1min":0.55800000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76100000000000001,"15min":0.77800000000000002},"min":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.90400000000000003}]},{"osd":6,"last update":"Sat Dec 16 03:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.751,"15min":0.78200000000000003},"min":{"1min":0.55300000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.0489999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.78400000000000003},"min":{"1min":0.55600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90000000000000002,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.88500000000000001}]},{"osd":7,"last update":"Sat Dec 16 03:29:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.99299999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.995,"5min":1.212,"15min":1.212},"last":0.79600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.51800000000000002,"15min":0.61199999999999999},"min":{"1min":0.29099999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.98299999999999998,"5min":4.3479999999999999,"15min":4.3479999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59499999999999997,"15min":0.68700000000000006},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71999999999999997,"5min":4.476,"15min":4.476},"last":0.53900000000000003}]},{"osd":2,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.63100000000000001,"15min":0.80300000000000005},"min":{"1min":0.33900000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.0669999999999999,"5min":7.4269999999999996,"15min":7.4269999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.623,"15min":0.751},"min":{"1min":0.36399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80700000000000005,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":0.44400000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":4.6319999999999997,"15min":4.6319999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.57299999999999995,"15min":0.67000000000000004},"min":{"1min":0.34899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.86399999999999999,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.51100000000000001}]},{"osd":4,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.88300000000000001,"15min":1.0329999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5640000000000001,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.82999999999999996,"15min":0.93600000000000005},"min":{"1min":0.53700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.657,"5min":4.984,"15min":4.984},"last":0.82999999999999996}]},{"osd":5,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81599999999999995,"15min":0.91100000000000003},"min":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.3980000000000001,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.92300000000000004,"15min":1.091},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.6699999999999999,"5min":7.6109999999999998,"15min":7.6109999999999998},"last":0.77000000000000002}]},{"osd":6,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.84099999999999997,"15min":0.95199999999999996},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0920000000000001,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.91900000000000004,"15min":1.091},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2230000000000001,"5min":7.681,"15min":7.681},"last":0.81399999999999995}]},{"osd":7,"last update":"Sat Dec 16 03:29:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.90400000000000003,"15min":1.032},"min":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.286,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":0.752},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.88700000000000001,"15min":0.998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3160000000000001,"5min":4.8609999999999998,"15min":4.8609999999999998},"last":0.85899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1568768,"data_stored":1021358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Dec 16 03:29:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.57999999999999996,"15min":0.752},"min":{"1min":0.25700000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.59299999999999997,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.68100000000000005,"15min":0.88900000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.61099999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Dec 16 03:29:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.70599999999999996,"15min":0.92400000000000004},"min":{"1min":0.32400000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60199999999999998,"5min":4.1719999999999997,"15min":4.1719999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.77000000000000002,"15min":1.024},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.57299999999999995,"5min":4.2350000000000003,"15min":4.2350000000000003},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Dec 16 03:29:13 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.67400000000000004,"15min":0.92600000000000005},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.65400000000000003,"5min":4.0970000000000004,"15min":4.0970000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.64300000000000002,"15min":0.78000000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63200000000000001,"5min":3.254,"15min":3.254},"last":0.48599999999999999}]},{"osd":4,"last update":"Sat Dec 16 03:29:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.83699999999999997,"15min":0.94799999999999995},"min":{"1min":0.55700000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92400000000000004,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.86099999999999999,"15min":0.98099999999999998},"min":{"1min":0.58999999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92700000000000005,"5min":3.327,"15min":3.327},"last":0.72599999999999998}]},{"osd":5,"last update":"Sat Dec 16 03:29:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.89800000000000002,"15min":1.087},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90200000000000002,"5min":4.4859999999999998,"15min":4.4859999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.82499999999999996,"15min":0.98299999999999998},"min":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82699999999999996,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Dec 16 03:29:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.83599999999999997,"15min":0.97799999999999998},"min":{"1min":0.55100000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86899999999999999,"5min":3.3650000000000002,"15min":3.3650000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.94899999999999995,"15min":1.171},"min":{"1min":0.56999999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95199999999999996,"5min":4.3979999999999997,"15min":4.3979999999999997},"last":0.69999999999999996}]},{"osd":7,"last update":"Sat Dec 16 03:29:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.97099999999999997,"15min":1.179},"min":{"1min":0.58999999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90900000000000003,"5min":4.444,"15min":4.444},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.89600000000000002,"15min":1.034},"min":{"1min":0.60999999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-16T03:29:19.538 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-16T03:29:19.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3ae672a640 1 Processor -- start 2023-12-16T03:29:19.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3ae672a640 1 -- start start 2023-12-16T03:29:19.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3ae672a640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3ae00a5240 0x7f3ae00bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3ae672a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ae00c01c0 0x7f3ae00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3ae672a640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae00c3bd0 con 0x7f3ae00c61a0 2023-12-16T03:29:19.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3ae672a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae00bf1e0 con 0x7f3ae00c01c0 2023-12-16T03:29:19.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3ae672a640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae00c3e20 con 0x7f3ae00a5240 2023-12-16T03:29:19.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3adf7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ae00c01c0 0x7f3ae00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3adf7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ae00c01c0 0x7f3ae00c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36822/0 (socket says 172.21.15.28:36822) 2023-12-16T03:29:19.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3adf7fe640 1 -- 172.21.15.28:0/3057891322 learned_addr learned my addr 172.21.15.28:0/3057891322 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:29:19.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3adffff640 1 --2- 172.21.15.28:0/3057891322 >> v2:172.21.15.134:3300/0 conn(0x7f3ae00a5240 0x7f3ae00bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3adf7fe640 1 -- 172.21.15.28:0/3057891322 >> v2:172.21.15.134:3300/0 conn(0x7f3ae00a5240 msgr2=0x7f3ae00bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:29:19.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3adf7fe640 1 --2- 172.21.15.28:0/3057891322 >> v2:172.21.15.134:3300/0 conn(0x7f3ae00a5240 0x7f3ae00bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3adf7fe640 1 -- 172.21.15.28:0/3057891322 >> v1:172.21.15.134:6789/0 conn(0x7f3ae00c61a0 legacy=0x7f3ae01561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.676+0000 7f3adf7fe640 1 -- 172.21.15.28:0/3057891322 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00c4100 con 0x7f3ae00c01c0 2023-12-16T03:29:19.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3adf7fe640 1 --2- 172.21.15.28:0/3057891322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae00c01c0 0x7f3ae00c5c60 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00bf530 tx=0x7f3ad401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a64370d8925463 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:29:19.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3adeffd640 1 -- 172.21.15.28:0/3057891322 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40ab640 con 0x7f3ae00c01c0 2023-12-16T03:29:19.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3adeffd640 1 -- 172.21.15.28:0/3057891322 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad40a7070 con 0x7f3ae00c01c0 2023-12-16T03:29:19.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3adeffd640 1 -- 172.21.15.28:0/3057891322 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40ab9c0 con 0x7f3ae00c01c0 2023-12-16T03:29:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3ae672a640 1 -- 172.21.15.28:0/3057891322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae00c01c0 msgr2=0x7f3ae00c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3ae672a640 1 --2- 172.21.15.28:0/3057891322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae00c01c0 0x7f3ae00c5c60 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00bf530 tx=0x7f3ad401c440 comp rx=0 tx=0).stop 2023-12-16T03:29:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3ae672a640 1 -- 172.21.15.28:0/3057891322 shutdown_connections 2023-12-16T03:29:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3ae672a640 1 --2- 172.21.15.28:0/3057891322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae00c01c0 0x7f3ae00c5c60 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3ae672a640 1 --2- 172.21.15.28:0/3057891322 >> v2:172.21.15.134:3300/0 conn(0x7f3ae00a5240 0x7f3ae00bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3ae672a640 1 -- 172.21.15.28:0/3057891322 >> 172.21.15.28:0/3057891322 conn(0x7f3ae006a5b0 msgr2=0x7f3ae006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:29:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3ae672a640 1 -- 172.21.15.28:0/3057891322 shutdown_connections 2023-12-16T03:29:19.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.680+0000 7f3ae672a640 1 -- 172.21.15.28:0/3057891322 wait complete. 2023-12-16T03:29:19.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae672a640 1 Processor -- start 2023-12-16T03:29:19.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae672a640 1 -- start start 2023-12-16T03:29:19.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae672a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00a5240 0x7f3ae01f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae672a640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae00c01c0 0x7f3ae0155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae672a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae00c61a0 0x7f3ae0148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae672a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0071ba0 con 0x7f3ae00c61a0 2023-12-16T03:29:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae672a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0070260 con 0x7f3ae00a5240 2023-12-16T03:29:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae672a640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae014ec70 con 0x7f3ae00c01c0 2023-12-16T03:29:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae4cc7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae00c61a0 0x7f3ae0148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae4cc7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae00c61a0 0x7f3ae0148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36828/0 (socket says 172.21.15.28:36828) 2023-12-16T03:29:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae4cc7640 1 -- 172.21.15.28:0/613208702 learned_addr learned my addr 172.21.15.28:0/613208702 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:29:19.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3adffff640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00a5240 0x7f3ae01f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3adf7fe640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae00c01c0 0x7f3ae0155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae4cc7640 1 -- 172.21.15.28:0/613208702 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae00c01c0 msgr2=0x7f3ae0155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae4cc7640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae00c01c0 0x7f3ae0155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae4cc7640 1 -- 172.21.15.28:0/613208702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00a5240 msgr2=0x7f3ae01f0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae4cc7640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00a5240 0x7f3ae01f0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae4cc7640 1 -- 172.21.15.28:0/613208702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad40094d0 con 0x7f3ae00c61a0 2023-12-16T03:29:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae4cc7640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae00c61a0 0x7f3ae0148d90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800c730 tx=0x7f3ad800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:29:19.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3adcff9640 1 -- 172.21.15.28:0/613208702 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8003b80 con 0x7f3ae00c61a0 2023-12-16T03:29:19.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3adcff9640 1 -- 172.21.15.28:0/613208702 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad8003ce0 con 0x7f3ae00c61a0 2023-12-16T03:29:19.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae672a640 1 -- 172.21.15.28:0/613208702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae014ef50 con 0x7f3ae00c61a0 2023-12-16T03:29:19.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3adcff9640 1 -- 172.21.15.28:0/613208702 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8005310 con 0x7f3ae00c61a0 2023-12-16T03:29:19.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.684+0000 7f3ae672a640 1 -- 172.21.15.28:0/613208702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae01557b0 con 0x7f3ae00c61a0 2023-12-16T03:29:19.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.688+0000 7f3ae672a640 1 -- 172.21.15.28:0/613208702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae00c52e0 con 0x7f3ae00c61a0 2023-12-16T03:29:19.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.688+0000 7f3adcff9640 1 -- 172.21.15.28:0/613208702 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3ad8005680 con 0x7f3ae00c61a0 2023-12-16T03:29:19.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.688+0000 7f3adcff9640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3acc066470 0x7f3acc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:19.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.688+0000 7f3adcff9640 1 -- 172.21.15.28:0/613208702 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3ad8083a90 con 0x7f3ae00c61a0 2023-12-16T03:29:19.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.688+0000 7f3adffff640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3acc066470 0x7f3acc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:19.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.688+0000 7f3adffff640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3acc066470 0x7f3acc068930 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009b60 tx=0x7f3ad0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:29:19.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.692+0000 7f3adcff9640 1 -- 172.21.15.28:0/613208702 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3ad80511c0 con 0x7f3ae00c61a0 2023-12-16T03:29:19.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.848+0000 7f3ae672a640 1 -- 172.21.15.28:0/613208702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3ae0068400 con 0x7f3ae00c61a0 2023-12-16T03:29:19.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.852+0000 7f3adcff9640 1 -- 172.21.15.28:0/613208702 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3ad80547e0 con 0x7f3ae00c61a0 2023-12-16T03:29:19.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3adcff9640 1 -- 172.21.15.28:0/613208702 <== mon.0 v2:172.21.15.28:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3ad80511c0 con 0x7f3ae00c61a0 2023-12-16T03:29:19.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 -- 172.21.15.28:0/613208702 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3acc066470 msgr2=0x7f3acc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3acc066470 0x7f3acc068930 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009b60 tx=0x7f3ad0009190 comp rx=0 tx=0).stop 2023-12-16T03:29:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 -- 172.21.15.28:0/613208702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae00c61a0 msgr2=0x7f3ae0148d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae00c61a0 0x7f3ae0148d90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800c730 tx=0x7f3ad800cbf0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 -- 172.21.15.28:0/613208702 shutdown_connections 2023-12-16T03:29:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3acc066470 0x7f3acc068930 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ae00c61a0 0x7f3ae0148d90 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ae00c01c0 0x7f3ae0155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 --2- 172.21.15.28:0/613208702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae00a5240 0x7f3ae01f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 -- 172.21.15.28:0/613208702 >> 172.21.15.28:0/613208702 conn(0x7f3ae006a5b0 msgr2=0x7f3ae00a6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:29:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 -- 172.21.15.28:0/613208702 shutdown_connections 2023-12-16T03:29:19.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:19.856+0000 7f3ae672a640 1 -- 172.21.15.28:0/613208702 wait complete. 2023-12-16T03:29:19.879 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-16T03:29:19.880 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-16T03:29:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b8cebb640 1 Processor -- start 2023-12-16T03:29:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b8cebb640 1 -- start start 2023-12-16T03:29:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b8cebb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b880c4750 0x7f3b880c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b8cebb640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3b881544c0 0x7f3b88154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b8cebb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8806c660 con 0x7f3b880af5c0 2023-12-16T03:29:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b8cebb640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8806ba50 con 0x7f3b881544c0 2023-12-16T03:29:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b8cebb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8806bd30 con 0x7f3b880c4750 2023-12-16T03:29:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b877fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3b880af5c0 0x7f3b880c7d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:51352/0 (socket says 172.21.15.28:51352) 2023-12-16T03:29:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b877fe640 1 -- 172.21.15.28:0/3504889351 learned_addr learned my addr 172.21.15.28:0/3504889351 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-12-16T03:29:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b87fff640 1 --2- 172.21.15.28:0/3504889351 >> v2:172.21.15.134:3300/0 conn(0x7f3b881544c0 0x7f3b88154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b86ffd640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b880c4750 0x7f3b880c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234632882 0 0) 0x7f3b8806c660 con 0x7f3b880af5c0 2023-12-16T03:29:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b70003530 con 0x7f3b880af5c0 2023-12-16T03:29:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2054953610 0 0) 0x7f3b70003530 con 0x7f3b880af5c0 2023-12-16T03:29:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b880c4750 msgr2=0x7f3b880c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:29:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b880c4750 0x7f3b880c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 >> v2:172.21.15.134:3300/0 conn(0x7f3b881544c0 msgr2=0x7f3b88154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:29:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 --2- 172.21.15.28:0/3504889351 >> v2:172.21.15.134:3300/0 conn(0x7f3b881544c0 0x7f3b88154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8806c010 con 0x7f3b880af5c0 2023-12-16T03:29:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 933073842 0 0) 0x7f3b78001680 con 0x7f3b880af5c0 2023-12-16T03:29:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 >> v1:172.21.15.28:6789/0 conn(0x7f3b880af5c0 legacy=0x7f3b880c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b70003980 0x7f3b70003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b700047d0 0x7f3b70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b880c4750 0x7f3b70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8806ba50 con 0x7f3b700047d0 2023-12-16T03:29:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8806bd30 con 0x7f3b70003980 2023-12-16T03:29:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7000b990 con 0x7f3b880c4750 2023-12-16T03:29:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b87fff640 1 --2- 172.21.15.28:0/3504889351 >> v2:172.21.15.134:3300/0 conn(0x7f3b881544c0 0x7f3b88154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-16T03:29:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b86ffd640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b700047d0 0x7f3b70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b877fe640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b70003980 0x7f3b70003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b87fff640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b880c4750 0x7f3b70005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b86ffd640 1 -- 172.21.15.28:0/3504889351 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b880c4750 msgr2=0x7f3b70005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:29:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b86ffd640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b880c4750 0x7f3b70005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b86ffd640 1 -- 172.21.15.28:0/3504889351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b70003980 msgr2=0x7f3b70003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-16T03:29:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b86ffd640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b70003980 0x7f3b70003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.024+0000 7f3b86ffd640 1 -- 172.21.15.28:0/3504889351 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b70003530 con 0x7f3b700047d0 2023-12-16T03:29:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.028+0000 7f3b86ffd640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b700047d0 0x7f3b70004c50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009b10 tx=0x7f3b7c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107b871af9d8315d server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:29:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.028+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0a6460 con 0x7f3b700047d0 2023-12-16T03:29:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.028+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3b7c0a65c0 con 0x7f3b700047d0 2023-12-16T03:29:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.028+0000 7f3b867fc640 1 -- 172.21.15.28:0/3504889351 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0a6990 con 0x7f3b700047d0 2023-12-16T03:29:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.028+0000 7f3b8cebb640 1 -- 172.21.15.28:0/3504889351 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b700047d0 msgr2=0x7f3b70004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.028+0000 7f3b8cebb640 1 --2- 172.21.15.28:0/3504889351 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b700047d0 0x7f3b70004c50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009b10 tx=0x7f3b7c01ca50 comp rx=0 tx=0).stop 2023-12-16T03:29:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.028+0000 7f3b87fff640 1 -- 172.21.15.28:0/3504889351 reap_dead start 2023-12-16T03:29:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.028+0000 7f3b8cebb640 1 -- 172.21.15.28:0/3504889351 shutdown_connections 2023-12-16T03:29:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.028+0000 7f3b8cebb640 1 -- 172.21.15.28:0/3504889351 >> 172.21.15.28:0/3504889351 conn(0x7f3b880ab960 msgr2=0x7f3b880abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:29:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.028+0000 7f3b8cebb640 1 -- 172.21.15.28:0/3504889351 shutdown_connections 2023-12-16T03:29:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.028+0000 7f3b8cebb640 1 -- 172.21.15.28:0/3504889351 wait complete. 2023-12-16T03:29:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b8cebb640 1 Processor -- start 2023-12-16T03:29:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b8cebb640 1 -- start start 2023-12-16T03:29:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b8cebb640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b700047d0 0x7f3b881f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b8cebb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b881f1d40 0x7f3b8814fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b8cebb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b88150110 0x7f3b8814aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b8cebb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8814d420 con 0x7f3b88150110 2023-12-16T03:29:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b8cebb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8814f740 con 0x7f3b881f1d40 2023-12-16T03:29:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b8cebb640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8814d670 con 0x7f3b700047d0 2023-12-16T03:29:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b88150110 0x7f3b8814aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b88150110 0x7f3b8814aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36852/0 (socket says 172.21.15.28:36852) 2023-12-16T03:29:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b87fff640 1 -- 172.21.15.28:0/543382176 learned_addr learned my addr 172.21.15.28:0/543382176 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-12-16T03:29:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b877fe640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b700047d0 0x7f3b881f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b86ffd640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b881f1d40 0x7f3b8814fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b87fff640 1 -- 172.21.15.28:0/543382176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b700047d0 msgr2=0x7f3b881f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b87fff640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b700047d0 0x7f3b881f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b87fff640 1 -- 172.21.15.28:0/543382176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b881f1d40 msgr2=0x7f3b8814fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b87fff640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b881f1d40 0x7f3b8814fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b87fff640 1 -- 172.21.15.28:0/543382176 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b880c4f40 con 0x7f3b88150110 2023-12-16T03:29:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b87fff640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b88150110 0x7f3b8814aba0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f3b880c5f70 tx=0x7f3b80009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:29:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b6ffff640 1 -- 172.21.15.28:0/543382176 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000e070 con 0x7f3b88150110 2023-12-16T03:29:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b6ffff640 1 -- 172.21.15.28:0/543382176 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3b80011e90 con 0x7f3b88150110 2023-12-16T03:29:20.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b6ffff640 1 -- 172.21.15.28:0/543382176 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b800039a0 con 0x7f3b88150110 2023-12-16T03:29:20.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b8cebb640 1 -- 172.21.15.28:0/543382176 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8814d950 con 0x7f3b88150110 2023-12-16T03:29:20.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.032+0000 7f3b8cebb640 1 -- 172.21.15.28:0/543382176 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8814df10 con 0x7f3b88150110 2023-12-16T03:29:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.036+0000 7f3b8cebb640 1 -- 172.21.15.28:0/543382176 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8815dcc0 con 0x7f3b88150110 2023-12-16T03:29:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.036+0000 7f3b6ffff640 1 -- 172.21.15.28:0/543382176 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3b80003b00 con 0x7f3b88150110 2023-12-16T03:29:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.036+0000 7f3b6ffff640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3b740664a0 0x7f3b74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-16T03:29:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.036+0000 7f3b6ffff640 1 -- 172.21.15.28:0/543382176 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3b800845a0 con 0x7f3b88150110 2023-12-16T03:29:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.036+0000 7f3b877fe640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3b740664a0 0x7f3b74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-16T03:29:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.036+0000 7f3b877fe640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3b740664a0 0x7f3b74068960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3b78001520 tx=0x7f3b78007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-16T03:29:20.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.040+0000 7f3b6ffff640 1 -- 172.21.15.28:0/543382176 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3b80055760 con 0x7f3b88150110 2023-12-16T03:29:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.228+0000 7f3b8cebb640 1 -- 172.21.15.28:0/543382176 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b8804e850 con 0x7f3b88150110 2023-12-16T03:29:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.228+0000 7f3b6ffff640 1 -- 172.21.15.28:0/543382176 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f3b800552f0 con 0x7f3b88150110 2023-12-16T03:29:20.232 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-12-16T03:29:20.232 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5714,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/651767003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":651767003},{"type":"v1","addr":"172.21.15.28:6837","nonce":651767003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5726,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/4202659808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":4202659808},{"type":"v1","addr":"172.21.15.134:6834","nonce":4202659808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/2857078107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":2857078107},{"type":"v1","addr":"172.21.15.134:6835","nonce":2857078107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":7110,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/3025399368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":3025399368},{"type":"v1","addr":"172.21.15.28:6836","nonce":3025399368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[]} 2023-12-16T03:29:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 55 2023-12-16T03:29:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 -- 172.21.15.28:0/543382176 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3b740664a0 msgr2=0x7f3b74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3b740664a0 0x7f3b74068960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3b78001520 tx=0x7f3b78007900 comp rx=0 tx=0).stop 2023-12-16T03:29:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 -- 172.21.15.28:0/543382176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b88150110 msgr2=0x7f3b8814aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-16T03:29:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b88150110 0x7f3b8814aba0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f3b880c5f70 tx=0x7f3b80009f90 comp rx=0 tx=0).stop 2023-12-16T03:29:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 -- 172.21.15.28:0/543382176 shutdown_connections 2023-12-16T03:29:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.28:6832/2582326308,v1:172.21.15.28:6833/2582326308] conn(0x7f3b740664a0 0x7f3b74068960 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3b88150110 0x7f3b8814aba0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b881f1d40 0x7f3b8814fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 --2- 172.21.15.28:0/543382176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b700047d0 0x7f3b881f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-16T03:29:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 -- 172.21.15.28:0/543382176 >> 172.21.15.28:0/543382176 conn(0x7f3b880ab960 msgr2=0x7f3b8815d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-16T03:29:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 -- 172.21.15.28:0/543382176 shutdown_connections 2023-12-16T03:29:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-12-16T03:29:20.232+0000 7f3b8cebb640 1 -- 172.21.15.28:0/543382176 wait complete. 2023-12-16T03:29:20.253 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-16T03:29:20.253 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-16T03:29:20.253 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-16T03:29:20.253 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:20.266 INFO:tasks.ceph.mds.a:Stopped 2023-12-16T03:29:20.266 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-16T03:29:20.266 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:20.325 INFO:tasks.ceph.mds.c:Stopped 2023-12-16T03:29:20.325 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-16T03:29:20.326 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:20.341 INFO:tasks.ceph.mds.b:Stopped 2023-12-16T03:29:20.342 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-16T03:29:20.342 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:20.398 INFO:tasks.ceph.mds.d:Stopped 2023-12-16T03:29:20.399 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-16T03:29:20.399 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-16T03:29:20.399 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:20.480 INFO:tasks.ceph.osd.0:Stopped 2023-12-16T03:29:20.481 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-16T03:29:20.481 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:20.580 INFO:tasks.ceph.osd.1:Stopped 2023-12-16T03:29:20.580 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-16T03:29:20.580 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:20.676 INFO:tasks.ceph.osd.2:Stopped 2023-12-16T03:29:20.676 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-16T03:29:20.677 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:20.776 INFO:tasks.ceph.osd.3:Stopped 2023-12-16T03:29:20.776 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-16T03:29:20.776 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:20.849 INFO:tasks.ceph.osd.4:Stopped 2023-12-16T03:29:20.849 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-16T03:29:20.849 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:22.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-16T03:29:26.951 INFO:tasks.ceph.osd.5:Stopped 2023-12-16T03:29:26.952 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-16T03:29:26.952 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:27.013 INFO:tasks.ceph.osd.6:Stopped 2023-12-16T03:29:27.014 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-16T03:29:27.014 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:27.098 INFO:tasks.ceph.osd.7:Stopped 2023-12-16T03:29:27.098 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-16T03:29:27.099 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-16T03:29:27.099 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:27.158 INFO:tasks.ceph.mgr.y:Stopped 2023-12-16T03:29:27.159 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-16T03:29:27.159 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:27.210 INFO:tasks.ceph.mgr.x:Stopped 2023-12-16T03:29:27.210 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-16T03:29:27.210 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-16T03:29:27.210 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:27.232 INFO:tasks.ceph.mon.a:Stopped 2023-12-16T03:29:27.232 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-16T03:29:27.232 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:27.248 INFO:tasks.ceph.mon.b:Stopped 2023-12-16T03:29:27.249 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-16T03:29:27.249 INFO:teuthology.orchestra.run:waiting for 300 2023-12-16T03:29:27.308 INFO:tasks.ceph.mon.c:Stopped 2023-12-16T03:29:27.309 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-16T03:29:27.309 DEBUG:teuthology.orchestra.run.smithi028:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-16T03:29:27.342 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:29:27.342 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-16T03:29:27.606 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:29:27.606 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-16T03:29:27.777 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:29:27.778 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-16T03:29:27.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-16T03:29:27.969 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:29:27.969 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-16T03:29:28.160 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:29:28.160 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-16T03:29:28.363 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:29:28.363 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-16T03:29:28.535 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:29:28.535 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-16T03:29:28.735 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:29:28.735 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-16T03:29:28.937 INFO:tasks.ceph:Archiving mon data... 2023-12-16T03:29:28.938 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532/data/mon.a.tgz 2023-12-16T03:29:28.938 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2023-12-16T03:29:28.948 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.shIEaWldQL 2023-12-16T03:29:28.949 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.shIEaWldQL 2023-12-16T03:29:29.111 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.shIEaWldQL 2023-12-16T03:29:29.190 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.shIEaWldQL is 447KB 2023-12-16T03:29:29.255 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.shIEaWldQL 2023-12-16T03:29:29.264 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532/data/mon.b.tgz 2023-12-16T03:29:29.264 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2023-12-16T03:29:29.273 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.SU9bJamllF 2023-12-16T03:29:29.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SU9bJamllF 2023-12-16T03:29:29.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.SU9bJamllF 2023-12-16T03:29:29.533 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.SU9bJamllF is 571KB 2023-12-16T03:29:29.603 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.SU9bJamllF 2023-12-16T03:29:29.611 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532/data/mon.c.tgz 2023-12-16T03:29:29.611 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2023-12-16T03:29:29.664 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.i1nprDtzsy 2023-12-16T03:29:29.664 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.i1nprDtzsy 2023-12-16T03:29:29.847 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.i1nprDtzsy 2023-12-16T03:29:29.924 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.i1nprDtzsy is 572KB 2023-12-16T03:29:29.990 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.i1nprDtzsy 2023-12-16T03:29:29.999 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-16T03:29:29.999 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T03:29:30.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-16T03:29:30.074 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-16T03:29:30.108 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-16T03:29:30.108 INFO:tasks.ceph:Archiving crash dumps... 2023-12-16T03:29:30.110 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532/remote/smithi028/crash 2023-12-16T03:29:30.111 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T03:29:30.138 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532/remote/smithi134/crash 2023-12-16T03:29:30.139 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-16T03:29:30.171 INFO:tasks.ceph:Shutting down logrotate 2023-12-16T03:29:30.171 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:29:30.192 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-16T03:29:30.301 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-16T03:29:30.323 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-16T03:29:30.343 INFO:tasks.ceph:Compressing logs... 2023-12-16T03:29:30.343 DEBUG:teuthology.orchestra.run.smithi028:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T03:29:30.368 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-16T03:29:30.401 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43287.log 2023-12-16T03:29:30.406 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2023-12-16T03:29:30.406 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47745.log 2023-12-16T03:29:30.406 INFO:teuthology.orchestra.run.smithi028.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43287.log.gz 2023-12-16T03:29:30.407 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43087.log 2023-12-16T03:29:30.407 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2023-12-16T03:29:30.407 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51533.log 2023-12-16T03:29:30.407 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47745.log.gz 2023-12-16T03:29:30.407 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43087.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.47903.log 2023-12-16T03:29:30.407 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43087.log.gz 2023-12-16T03:29:30.408 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44991.log 2023-12-16T03:29:30.408 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51533.log.gz 2023-12-16T03:29:30.408 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.50586.log 2023-12-16T03:29:30.408 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47903.log.gz 2023-12-16T03:29:30.409 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48902.log 2023-12-16T03:29:30.409 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44991.log.gz 2023-12-16T03:29:30.410 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.testuser.50586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.50586.log.gz 2023-12-16T03:29:30.410 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54891.log 2023-12-16T03:29:30.411 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53125.log 2023-12-16T03:29:30.411 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48902.log.gz 2023-12-16T03:29:30.412 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54411.log 2023-12-16T03:29:30.412 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54891.log.gz 2023-12-16T03:29:30.413 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46959.log 2023-12-16T03:29:30.413 INFO:teuthology.orchestra.run.smithi028.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53125.log.gz 2023-12-16T03:29:30.414 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38377.log 2023-12-16T03:29:30.414 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44787.log 2023-12-16T03:29:30.415 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45394.log 2023-12-16T03:29:30.415 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54411.log.gz 2023-12-16T03:29:30.415 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50235.log 2023-12-16T03:29:30.416 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46959.log.gz 2023-12-16T03:29:30.417 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52120.log 2023-12-16T03:29:30.417 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45394.log.gz 2023-12-16T03:29:30.418 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38377.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-16T03:29:30.418 INFO:teuthology.orchestra.run.smithi134.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38377.log.gz 2023-12-16T03:29:30.418 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.1.44787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44787.log.gz 2023-12-16T03:29:30.418 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-16T03:29:30.418 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44841.log 2023-12-16T03:29:30.418 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38425.log 2023-12-16T03:29:30.420 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.1.44841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44841.log.gz 2023-12-16T03:29:30.420 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38353.log 2023-12-16T03:29:30.421 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50235.log: gzip -5 --verbose 89.5% -- -- replaced with /var/log/ceph/ceph-client.admin.50235.log.gz /var/log/ceph/ceph-mgr.y.log 2023-12-16T03:29:30.421 INFO:teuthology.orchestra.run.smithi028.stderr: 2023-12-16T03:29:30.421 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44705.log 2023-12-16T03:29:30.421 INFO:teuthology.orchestra.run.smithi028.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52120.log.gz 2023-12-16T03:29:30.421 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51247.log 2023-12-16T03:29:30.421 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44705.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44705.log.gz 2023-12-16T03:29:30.421 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46393.log 2023-12-16T03:29:30.424 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55282.log 2023-12-16T03:29:30.424 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51247.log.gz 2023-12-16T03:29:30.424 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53781.log 2023-12-16T03:29:30.424 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46393.log.gz 2023-12-16T03:29:30.424 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43089.log 2023-12-16T03:29:30.424 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55282.log.gz 2023-12-16T03:29:30.426 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38449.log 2023-12-16T03:29:30.426 INFO:teuthology.orchestra.run.smithi134.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38425.log.gz 2023-12-16T03:29:30.426 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38353.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38353.log.gz 2023-12-16T03:29:30.426 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44966.log 2023-12-16T03:29:30.426 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38449.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-16T03:29:30.426 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38449.log.gz 2023-12-16T03:29:30.426 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.1.44966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44966.log.gz 2023-12-16T03:29:30.426 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44638.log 2023-12-16T03:29:30.426 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.45077.log 2023-12-16T03:29:30.427 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.1.44638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44638.log.gz 2023-12-16T03:29:30.429 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-16T03:29:30.429 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.testuser.45077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.45077.log.gz 2023-12-16T03:29:30.429 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38473.log 2023-12-16T03:29:30.429 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-16T03:29:30.431 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51273.log 2023-12-16T03:29:30.431 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53781.log.gz 2023-12-16T03:29:30.432 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49475.log 2023-12-16T03:29:30.432 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43089.log.gz 2023-12-16T03:29:30.432 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51273.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51273.log.gz 2023-12-16T03:29:30.432 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.53424.log 2023-12-16T03:29:30.432 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49475.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49475.log.gz 2023-12-16T03:29:30.432 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48007.log 2023-12-16T03:29:30.432 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.testuser.53424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.53424.log.gz 2023-12-16T03:29:30.433 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43510.log 2023-12-16T03:29:30.433 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48007.log: gzip -5 --verbose 88.3% -- -- replaced with /var/log/ceph/ceph-client.admin.48007.log.gz /var/log/ceph/ceph-client.admin.52706.log 2023-12-16T03:29:30.433 INFO:teuthology.orchestra.run.smithi028.stderr: 2023-12-16T03:29:30.433 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43510.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.43510.log.gz 2023-12-16T03:29:30.433 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55386.log 2023-12-16T03:29:30.437 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38497.log 2023-12-16T03:29:30.437 INFO:teuthology.orchestra.run.smithi134.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38473.log.gz 2023-12-16T03:29:30.438 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-16T03:29:30.438 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38497.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-16T03:29:30.438 INFO:teuthology.orchestra.run.smithi134.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38497.log.gz 93.6% 2023-12-16T03:29:30.438 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-16T03:29:30.438 INFO:teuthology.orchestra.run.smithi134.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-16T03:29:30.438 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44682.log 2023-12-16T03:29:30.438 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38401.log 2023-12-16T03:29:30.438 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.1.44682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44682.log.gz 2023-12-16T03:29:30.438 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-16T03:29:30.439 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50105.log 2023-12-16T03:29:30.440 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52706.log.gz 2023-12-16T03:29:30.440 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55125.log 2023-12-16T03:29:30.440 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55386.log.gz 2023-12-16T03:29:30.440 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50105.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.50105.log.gz -- 2023-12-16T03:29:30.440 INFO:teuthology.orchestra.run.smithi028.stderr: /var/log/ceph/ceph-client.admin.53151.log 2023-12-16T03:29:30.440 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46181.log 2023-12-16T03:29:30.440 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55125.log.gz 2023-12-16T03:29:30.440 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49897.log 2023-12-16T03:29:30.440 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53151.log.gz 2023-12-16T03:29:30.441 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46181.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.46181.log.gz -- 2023-12-16T03:29:30.441 INFO:teuthology.orchestra.run.smithi028.stderr: /var/log/ceph/ceph-client.admin.55151.log 2023-12-16T03:29:30.441 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49897.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49897.log.gz 2023-12-16T03:29:30.441 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53621.log 2023-12-16T03:29:30.441 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55151.log: gzip -5 88.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.55151.log.gz -- 2023-12-16T03:29:30.441 INFO:teuthology.orchestra.run.smithi028.stderr: /var/log/ceph/ceph-client.admin.45987.log 2023-12-16T03:29:30.444 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47537.log 2023-12-16T03:29:30.444 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53621.log.gz 2023-12-16T03:29:30.444 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45987.log: gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.54340.log 2023-12-16T03:29:30.444 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45987.log.gz 2023-12-16T03:29:30.444 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47537.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.47537.log.gz 2023-12-16T03:29:30.444 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.48591.log 2023-12-16T03:29:30.444 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47407.log 2023-12-16T03:29:30.444 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54340.log.gz 2023-12-16T03:29:30.445 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38401.log: gzip -5 89.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38401.log.gz /var/log/ceph/ceph-client.1.44506.log 2023-12-16T03:29:30.445 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-16T03:29:30.445 INFO:teuthology.orchestra.run.smithi134.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-16T03:29:30.445 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38521.log 2023-12-16T03:29:30.445 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.1.44506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44506.log.gz 2023-12-16T03:29:30.445 INFO:teuthology.orchestra.run.smithi134.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-16T03:29:30.445 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-16T03:29:30.445 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.38521.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38521.log.gz 2023-12-16T03:29:30.445 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-16T03:29:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-16T03:29:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45020.log 2023-12-16T03:29:30.448 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52966.log 2023-12-16T03:29:30.448 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48591.log.gz 2023-12-16T03:29:30.448 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44575.log 2023-12-16T03:29:30.448 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47407.log.gz 2023-12-16T03:29:30.448 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52966.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52966.log.gz 2023-12-16T03:29:30.449 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49793.log 2023-12-16T03:29:30.449 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45069.log 2023-12-16T03:29:30.449 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44575.log.gz 2023-12-16T03:29:30.449 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.1.45020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45020.log.gz 2023-12-16T03:29:30.450 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49793.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49793.log.gz 2023-12-16T03:29:30.450 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49767.log 2023-12-16T03:29:30.450 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54463.log 2023-12-16T03:29:30.450 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45069.log.gz 2023-12-16T03:29:30.451 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48494.log 2023-12-16T03:29:30.451 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49767.log.gz 2023-12-16T03:29:30.451 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54463.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-16T03:29:30.452 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54463.log.gz 2023-12-16T03:29:30.454 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48494.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48494.log.gz 2023-12-16T03:29:30.454 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47117.log 2023-12-16T03:29:30.455 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47013.log 2023-12-16T03:29:30.456 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47117.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.47117.log.gz 2023-12-16T03:29:30.456 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45103.log 2023-12-16T03:29:30.456 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49124.log 2023-12-16T03:29:30.456 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47013.log.gz 2023-12-16T03:29:30.457 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45103.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45103.log.gz 2023-12-16T03:29:30.457 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46315.log 2023-12-16T03:29:30.458 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45909.log 2023-12-16T03:29:30.459 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49124.log.gz 2023-12-16T03:29:30.460 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46315.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46315.log.gz 2023-12-16T03:29:30.460 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48442.log 2023-12-16T03:29:30.461 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43726.log 2023-12-16T03:29:30.461 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45909.log.gz 2023-12-16T03:29:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48442.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48442.log.gz 2023-12-16T03:29:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44495.log 2023-12-16T03:29:30.464 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43726.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43726.log.gz 2023-12-16T03:29:30.464 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43727.log 2023-12-16T03:29:30.464 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44495.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44495.log.gz 2023-12-16T03:29:30.464 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43499.log 2023-12-16T03:29:30.465 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43727.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43727.log.gz 2023-12-16T03:29:30.466 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46289.log 2023-12-16T03:29:30.467 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43499.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43499.log.gz 2023-12-16T03:29:30.467 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50209.log 2023-12-16T03:29:30.468 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54288.log 2023-12-16T03:29:30.468 INFO:teuthology.orchestra.run.smithi028.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46289.log.gz 2023-12-16T03:29:30.469 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50209.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50209.log.gz 2023-12-16T03:29:30.469 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50343.log 2023-12-16T03:29:30.470 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52810.log 2023-12-16T03:29:30.471 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54288.log.gz 2023-12-16T03:29:30.471 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50343.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50343.log.gz 2023-12-16T03:29:30.472 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45368.log 2023-12-16T03:29:30.473 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52810.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52810.log.gz 2023-12-16T03:29:30.474 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52572.log 2023-12-16T03:29:30.474 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43517.log 2023-12-16T03:29:30.475 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45368.log.gz 2023-12-16T03:29:30.475 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52654.log 2023-12-16T03:29:30.476 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52572.log.gz 2023-12-16T03:29:30.477 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43517.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43517.log.gz 2023-12-16T03:29:30.477 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48416.log 2023-12-16T03:29:30.477 INFO:teuthology.orchestra.run.smithi028.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-16T03:29:30.478 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54697.log 2023-12-16T03:29:30.478 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52654.log.gz 2023-12-16T03:29:30.479 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48416.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48416.log.gz 2023-12-16T03:29:30.480 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52400.log 2023-12-16T03:29:30.481 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49008.log 2023-12-16T03:29:30.481 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54697.log.gz 2023-12-16T03:29:30.481 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.52400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52400.log.gz 2023-12-16T03:29:30.482 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55464.log 2023-12-16T03:29:30.483 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49008.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49008.log.gzgzip 2023-12-16T03:29:30.483 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45446.log 2023-12-16T03:29:30.484 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53207.log 2023-12-16T03:29:30.484 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55464.log.gz 2023-12-16T03:29:30.485 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45446.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45446.log.gz 2023-12-16T03:29:30.485 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54132.log 2023-12-16T03:29:30.486 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49975.log 2023-12-16T03:29:30.486 INFO:teuthology.orchestra.run.smithi028.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53207.log.gz 2023-12-16T03:29:30.487 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54132.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54132.log.gz 2023-12-16T03:29:30.487 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54515.log 2023-12-16T03:29:30.488 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50053.log 2023-12-16T03:29:30.488 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49975.log.gz 2023-12-16T03:29:30.489 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46121.log 2023-12-16T03:29:30.489 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54515.log.gz 2023-12-16T03:29:30.490 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55229.log 2023-12-16T03:29:30.490 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50053.log.gz 2023-12-16T03:29:30.491 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45472.log 2023-12-16T03:29:30.491 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46121.log.gz 2023-12-16T03:29:30.493 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48982.log 2023-12-16T03:29:30.493 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55229.log.gz 2023-12-16T03:29:30.494 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45472.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.45472.log.gz --verbose 2023-12-16T03:29:30.494 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.53595.log 2023-12-16T03:29:30.494 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48111.log 2023-12-16T03:29:30.495 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48982.log.gz 2023-12-16T03:29:30.495 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53595.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53595.log.gz 2023-12-16T03:29:30.495 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52732.log 2023-12-16T03:29:30.496 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46933.log 2023-12-16T03:29:30.496 INFO:teuthology.orchestra.run.smithi028.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48111.log.gz 2023-12-16T03:29:30.497 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50261.log 2023-12-16T03:29:30.497 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52732.log.gz 2023-12-16T03:29:30.498 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45017.log 2023-12-16T03:29:30.498 INFO:teuthology.orchestra.run.smithi028.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46933.log.gz 2023-12-16T03:29:30.499 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42485.log 2023-12-16T03:29:30.499 INFO:teuthology.orchestra.run.smithi028.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50261.log.gz 2023-12-16T03:29:30.500 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46235.log 2023-12-16T03:29:30.500 INFO:teuthology.orchestra.run.smithi028.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45017.log.gz 2023-12-16T03:29:30.501 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49741.log 2023-12-16T03:29:30.501 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42485.log.gz 2023-12-16T03:29:30.502 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46235.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46235.log.gz 2023-12-16T03:29:30.502 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42945.log 2023-12-16T03:29:30.503 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48779.log 2023-12-16T03:29:30.503 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49741.log.gz 2023-12-16T03:29:30.504 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45316.log 2023-12-16T03:29:30.504 INFO:teuthology.orchestra.run.smithi028.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42945.log.gz 2023-12-16T03:29:30.505 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48286.log 2023-12-16T03:29:30.506 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48779.log.gz 2023-12-16T03:29:30.506 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45316.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.45316.log.gz /var/log/ceph/ceph-client.admin.45883.log 2023-12-16T03:29:30.506 INFO:teuthology.orchestra.run.smithi028.stderr: 2023-12-16T03:29:30.508 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51949.log 2023-12-16T03:29:30.508 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48286.log.gz 2023-12-16T03:29:30.508 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45883.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45883.log.gz 2023-12-16T03:29:30.509 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48234.log 2023-12-16T03:29:30.509 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50838.log 2023-12-16T03:29:30.510 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51949.log.gz 2023-12-16T03:29:30.511 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43311.log 2023-12-16T03:29:30.511 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48234.log.gz 2023-12-16T03:29:30.513 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50628.log 2023-12-16T03:29:30.513 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50838.log.gz 2023-12-16T03:29:30.513 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43311.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43311.log.gz 2023-12-16T03:29:30.513 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54671.log 2023-12-16T03:29:30.514 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51377.log 2023-12-16T03:29:30.514 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50628.log.gz 2023-12-16T03:29:30.515 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43307.log 2023-12-16T03:29:30.515 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54671.log.gz 2023-12-16T03:29:30.515 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51046.log 2023-12-16T03:29:30.516 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51377.log.gz 2023-12-16T03:29:30.516 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53838.log 2023-12-16T03:29:30.517 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43307.log.gz 2023-12-16T03:29:30.517 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47247.log 2023-12-16T03:29:30.517 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51046.log.gz 2023-12-16T03:29:30.519 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53864.log 2023-12-16T03:29:30.519 INFO:teuthology.orchestra.run.smithi028.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53838.log.gz 2023-12-16T03:29:30.520 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49150.log 2023-12-16T03:29:30.520 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47247.log.gz 2023-12-16T03:29:30.520 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55360.log 2023-12-16T03:29:30.521 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53864.log.gz 2023-12-16T03:29:30.521 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49150.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49150.log.gz 2023-12-16T03:29:30.522 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-16T03:29:30.523 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50157.log 2023-12-16T03:29:30.523 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55360.log.gz 2023-12-16T03:29:30.523 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49553.log 2023-12-16T03:29:30.524 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42971.log 2023-12-16T03:29:30.525 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50157.log.gz 2023-12-16T03:29:30.525 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54314.log 2023-12-16T03:29:30.526 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49553.log.gz 2023-12-16T03:29:30.526 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42971.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2023-12-16T03:29:30.527 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43509.log 2023-12-16T03:29:30.529 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43985.log 2023-12-16T03:29:30.529 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54314.log.gz 2023-12-16T03:29:30.530 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43509.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43509.log.gz 2023-12-16T03:29:30.530 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49657.log 2023-12-16T03:29:30.532 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48747.log 2023-12-16T03:29:30.532 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43985.log.gz 2023-12-16T03:29:30.533 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49657.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49657.log.gz 2023-12-16T03:29:30.533 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47325.log 2023-12-16T03:29:30.534 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49204.log 2023-12-16T03:29:30.535 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48747.log.gz 2023-12-16T03:29:30.535 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47325.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47325.log.gz 2023-12-16T03:29:30.535 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48208.log 2023-12-16T03:29:30.537 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45290.log 2023-12-16T03:29:30.537 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49204.log.gz 2023-12-16T03:29:30.537 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48208.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48208.log.gz 2023-12-16T03:29:30.538 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43292.log 2023-12-16T03:29:30.539 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45290.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45290.log.gz 2023-12-16T03:29:30.540 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54995.log 2023-12-16T03:29:30.540 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43292.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43292.log.gz 2023-12-16T03:29:30.540 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2023-12-16T03:29:30.542 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54995.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-16T03:29:30.543 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54995.log.gz 2023-12-16T03:29:30.543 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42550.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2023-12-16T03:29:30.543 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49687.log 2023-12-16T03:29:30.543 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43519.log 2023-12-16T03:29:30.544 INFO:teuthology.orchestra.run.smithi134.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-16T03:29:30.546 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49687.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49687.log.gz 2023-12-16T03:29:30.546 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51325.log 2023-12-16T03:29:30.547 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43519.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43519.log.gz 2023-12-16T03:29:30.547 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54645.log 2023-12-16T03:29:30.548 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43096.log 2023-12-16T03:29:30.548 INFO:teuthology.orchestra.run.smithi028.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51325.log.gz 2023-12-16T03:29:30.548 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54645.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54645.log.gz 2023-12-16T03:29:30.548 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44601.log 2023-12-16T03:29:30.549 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43096.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43096.log.gz 2023-12-16T03:29:30.550 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48811.log 2023-12-16T03:29:30.550 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44601.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44601.log.gz 2023-12-16T03:29:30.551 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51429.log 2023-12-16T03:29:30.552 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51351.log 2023-12-16T03:29:30.553 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48811.log.gz 2023-12-16T03:29:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46155.log 2023-12-16T03:29:30.554 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51429.log.gz 2023-12-16T03:29:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46013.log 2023-12-16T03:29:30.555 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51351.log.gz 2023-12-16T03:29:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46155.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46155.log.gz 2023-12-16T03:29:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42629.log 2023-12-16T03:29:30.559 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46013.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46013.log.gz 2023-12-16T03:29:30.559 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48669.log 2023-12-16T03:29:30.560 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42629.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42629.log.gz 2023-12-16T03:29:30.561 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46687.log 2023-12-16T03:29:30.561 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48669.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48669.log.gz 2023-12-16T03:29:30.562 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52006.log 2023-12-16T03:29:30.563 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53311.log 2023-12-16T03:29:30.563 INFO:teuthology.orchestra.run.smithi028.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46687.log.gz 2023-12-16T03:29:30.564 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52006.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52006.log.gz 2023-12-16T03:29:30.565 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50706.log 2023-12-16T03:29:30.566 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53311.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53311.log.gz 2023-12-16T03:29:30.566 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50680.log 2023-12-16T03:29:30.567 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50706.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50706.log.gz 2023-12-16T03:29:30.568 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55255.log 2023-12-16T03:29:30.569 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50864.log 2023-12-16T03:29:30.569 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50680.log.gz 2023-12-16T03:29:30.570 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55255.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55255.log.gz 2023-12-16T03:29:30.570 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49845.log 2023-12-16T03:29:30.572 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50864.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50864.log.gz 2023-12-16T03:29:30.572 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47799.log 2023-12-16T03:29:30.574 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49845.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49845.log.gz 2023-12-16T03:29:30.574 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47851.log 2023-12-16T03:29:30.575 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47799.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47799.log.gz 2023-12-16T03:29:30.575 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44219.log 2023-12-16T03:29:30.576 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47851.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47851.log.gz 2023-12-16T03:29:30.577 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43049.log 2023-12-16T03:29:30.578 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53651.log 2023-12-16T03:29:30.579 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44219.log.gz 2023-12-16T03:29:30.580 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43049.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43049.log.gz 2023-12-16T03:29:30.580 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51507.log 2023-12-16T03:29:30.581 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46713.log 2023-12-16T03:29:30.581 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53651.log.gz 2023-12-16T03:29:30.582 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51507.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51507.log.gz 2023-12-16T03:29:30.582 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2023-12-16T03:29:30.584 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46713.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46713.log.gz 2023-12-16T03:29:30.584 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52224.log 2023-12-16T03:29:30.585 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48033.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2023-12-16T03:29:30.586 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46661.log 2023-12-16T03:29:30.587 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52224.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52224.log.gz 2023-12-16T03:29:30.587 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53491.log 2023-12-16T03:29:30.588 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46661.log: gzip -5 --verbose 89.0% -- -- replaced with /var/log/ceph/ceph-client.admin.46661.log.gz 2023-12-16T03:29:30.589 INFO:teuthology.orchestra.run.smithi028.stderr: /var/log/ceph/ceph-client.admin.51098.log 2023-12-16T03:29:30.590 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54775.log 2023-12-16T03:29:30.590 INFO:teuthology.orchestra.run.smithi028.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.53491.log.gz 2023-12-16T03:29:30.591 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51098.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51098.log.gz 2023-12-16T03:29:30.592 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48468.log 2023-12-16T03:29:30.592 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46065.log 2023-12-16T03:29:30.593 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54775.log.gz 2023-12-16T03:29:30.594 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48468.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48468.log.gz 2023-12-16T03:29:30.594 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47273.log 2023-12-16T03:29:30.595 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46065.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46065.log.gz 2023-12-16T03:29:30.596 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43491.log 2023-12-16T03:29:30.596 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44466.log 2023-12-16T03:29:30.597 INFO:teuthology.orchestra.run.smithi028.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47273.log.gz 2023-12-16T03:29:30.598 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43491.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43491.log.gz 2023-12-16T03:29:30.598 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49098.log 2023-12-16T03:29:30.599 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.44466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50001.log 2023-12-16T03:29:30.600 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44466.log.gz 2023-12-16T03:29:30.601 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49098.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49098.log.gz 2023-12-16T03:29:30.601 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50499.log 2023-12-16T03:29:30.602 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50001.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50001.log.gz 2023-12-16T03:29:30.602 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47511.log 2023-12-16T03:29:30.603 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44549.log 2023-12-16T03:29:30.604 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50499.log.gz 2023-12-16T03:29:30.605 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47511.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47511.log.gz 2023-12-16T03:29:30.605 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-16T03:29:30.606 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44549.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44549.log.gz 2023-12-16T03:29:30.606 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51753.log 2023-12-16T03:29:30.608 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53942.log 2023-12-16T03:29:30.610 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51753.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51753.log.gz -5 2023-12-16T03:29:30.610 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52836.log 2023-12-16T03:29:30.611 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52172.log 2023-12-16T03:29:30.611 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53942.log.gz 2023-12-16T03:29:30.612 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52836.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52836.log.gz -5 2023-12-16T03:29:30.613 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43299.log 2023-12-16T03:29:30.614 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49949.log 2023-12-16T03:29:30.614 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52172.log.gz 2023-12-16T03:29:30.615 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52888.log 2023-12-16T03:29:30.616 INFO:teuthology.orchestra.run.smithi028.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43299.log.gz 2023-12-16T03:29:30.616 INFO:teuthology.orchestra.run.smithi134.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-16T03:29:30.617 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48059.log 2023-12-16T03:29:30.617 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49949.log.gz 2023-12-16T03:29:30.619 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52198.log 2023-12-16T03:29:30.619 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52888.log.gz 2023-12-16T03:29:30.620 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48059.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz -- 2023-12-16T03:29:30.620 INFO:teuthology.orchestra.run.smithi028.stderr: /var/log/ceph/ceph-client.admin.47221.log 2023-12-16T03:29:30.621 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50131.log 2023-12-16T03:29:30.621 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52198.log.gz 2023-12-16T03:29:30.623 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48390.log 2023-12-16T03:29:30.623 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47221.log.gz 2023-12-16T03:29:30.624 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50131.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.50131.log.gz -5 2023-12-16T03:29:30.624 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48721.log 2023-12-16T03:29:30.626 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49413.log 2023-12-16T03:29:30.626 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48390.log.gz 2023-12-16T03:29:30.627 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42735.log 2023-12-16T03:29:30.627 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48721.log.gz 2023-12-16T03:29:30.629 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49413.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49413.log.gz 2023-12-16T03:29:30.629 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51870.log 2023-12-16T03:29:30.630 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53755.log 2023-12-16T03:29:30.630 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42735.log.gz 2023-12-16T03:29:30.632 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52784.log 2023-12-16T03:29:30.632 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51870.log.gz 2023-12-16T03:29:30.633 INFO:teuthology.orchestra.run.smithi134.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-16T03:29:30.633 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45935.log 2023-12-16T03:29:30.634 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53755.log.gz 2023-12-16T03:29:30.634 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51299.log 2023-12-16T03:29:30.635 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52784.log.gz 2023-12-16T03:29:30.636 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45935.log: gzip -5 87.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.45935.log.gz /var/log/ceph/ceph-client.admin.52302.log 2023-12-16T03:29:30.636 INFO:teuthology.orchestra.run.smithi028.stderr: 2023-12-16T03:29:30.638 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46341.log 2023-12-16T03:29:30.638 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51299.log.gz 2023-12-16T03:29:30.639 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.47625.log 2023-12-16T03:29:30.639 INFO:teuthology.orchestra.run.smithi028.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.52302.log.gz 2023-12-16T03:29:30.641 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46341.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.47091.log 2023-12-16T03:29:30.641 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46341.log.gz 2023-12-16T03:29:30.641 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.testuser.47625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.47625.log.gz 2023-12-16T03:29:30.642 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44245.log 2023-12-16T03:29:30.643 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54917.log 2023-12-16T03:29:30.644 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47091.log.gz 2023-12-16T03:29:30.645 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53916.log 2023-12-16T03:29:30.645 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44245.log.gz 2023-12-16T03:29:30.646 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53517.log 2023-12-16T03:29:30.647 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54917.log.gz 2023-12-16T03:29:30.648 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43298.log 2023-12-16T03:29:30.648 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53916.log.gz 2023-12-16T03:29:30.649 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45342.log 2023-12-16T03:29:30.650 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53517.log.gz 2023-12-16T03:29:30.651 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47485.log 2023-12-16T03:29:30.651 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43298.log.gz 2023-12-16T03:29:30.652 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53677.log 2023-12-16T03:29:30.652 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45342.log.gz 2023-12-16T03:29:30.654 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46039.log 2023-12-16T03:29:30.654 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47485.log.gz 2023-12-16T03:29:30.655 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50942.log 2023-12-16T03:29:30.655 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53677.log.gz 2023-12-16T03:29:30.657 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46039.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46039.log.gz 2023-12-16T03:29:30.657 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44887.log 2023-12-16T03:29:30.658 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49363.log 2023-12-16T03:29:30.658 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50942.log.gz 2023-12-16T03:29:30.660 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52520.log 2023-12-16T03:29:30.660 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44887.log.gz 2023-12-16T03:29:30.661 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54943.log 2023-12-16T03:29:30.662 INFO:teuthology.orchestra.run.smithi028.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49363.log.gz 2023-12-16T03:29:30.663 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48312.log 2023-12-16T03:29:30.663 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52520.log.gz 2023-12-16T03:29:30.664 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52468.log 2023-12-16T03:29:30.664 INFO:teuthology.orchestra.run.smithi028.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54943.log.gz 2023-12-16T03:29:30.666 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38155.log 2023-12-16T03:29:30.666 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48312.log.gz 2023-12-16T03:29:30.667 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45804.log 2023-12-16T03:29:30.667 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52468.log.gz 2023-12-16T03:29:30.669 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54541.log 2023-12-16T03:29:30.669 INFO:teuthology.orchestra.run.smithi028.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.38155.log.gz 2023-12-16T03:29:30.670 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45804.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-16T03:29:30.671 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45804.log.gz 2023-12-16T03:29:30.672 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53369.log 2023-12-16T03:29:30.672 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54541.log.gz 2023-12-16T03:29:30.673 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45830.log 2023-12-16T03:29:30.675 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53369.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53369.log.gz 2023-12-16T03:29:30.675 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43708.log 2023-12-16T03:29:30.676 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54827.log 2023-12-16T03:29:30.676 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45830.log.gz 2023-12-16T03:29:30.678 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46263.log 2023-12-16T03:29:30.678 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43708.log.gz 2023-12-16T03:29:30.679 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53233.log 2023-12-16T03:29:30.679 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54827.log.gz 2023-12-16T03:29:30.681 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48260.log 2023-12-16T03:29:30.681 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46263.log.gz 2023-12-16T03:29:30.682 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53569.log 2023-12-16T03:29:30.682 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53233.log.gz 2023-12-16T03:29:30.684 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48260.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48260.log.gz 2023-12-16T03:29:30.684 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44835.log 2023-12-16T03:29:30.685 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53569.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53569.log.gz 2023-12-16T03:29:30.686 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49715.log 2023-12-16T03:29:30.687 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45524.log 2023-12-16T03:29:30.687 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz 2023-12-16T03:29:30.689 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49715.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33319.log 2023-12-16T03:29:30.689 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49715.log.gz 2023-12-16T03:29:30.690 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45524.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45524.log.gz 2023-12-16T03:29:30.690 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52276.log 2023-12-16T03:29:30.691 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.tmp-client.admin.33319.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33319.log.gz 2023-12-16T03:29:30.692 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46093.log 2023-12-16T03:29:30.693 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47351.log 2023-12-16T03:29:30.693 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52276.log.gz 2023-12-16T03:29:30.695 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51403.log 2023-12-16T03:29:30.695 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46093.log.gz 2023-12-16T03:29:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47351.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47351.log.gz 2023-12-16T03:29:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51818.log 2023-12-16T03:29:30.697 INFO:teuthology.orchestra.run.smithi134.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-16T03:29:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51403.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51403.log.gz 2023-12-16T03:29:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2023-12-16T03:29:30.699 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44965.log 2023-12-16T03:29:30.700 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51818.log.gz 2023-12-16T03:29:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2023-12-16T03:29:30.701 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2023-12-16T03:29:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44965.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.44965.log.gz -5 2023-12-16T03:29:30.702 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54593.log 2023-12-16T03:29:30.704 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52066.log 2023-12-16T03:29:30.704 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2023-12-16T03:29:30.705 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54262.log 2023-12-16T03:29:30.705 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54593.log.gz 2023-12-16T03:29:30.707 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52066.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52066.log.gz -5 2023-12-16T03:29:30.707 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55438.log 2023-12-16T03:29:30.708 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48163.log 2023-12-16T03:29:30.709 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54262.log.gz 2023-12-16T03:29:30.710 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42867.log 2023-12-16T03:29:30.710 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55438.log.gz 2023-12-16T03:29:30.711 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48163.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50602.log 2023-12-16T03:29:30.711 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48163.log.gz 2023-12-16T03:29:30.713 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42867.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42867.log.gz 2023-12-16T03:29:30.713 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54106.log 2023-12-16T03:29:30.714 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50602.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50602.log.gz 2023-12-16T03:29:30.715 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44115.log 2023-12-16T03:29:30.716 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42815.log 2023-12-16T03:29:30.716 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54106.log.gz 2023-12-16T03:29:30.718 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44115.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.44115.log.gz -5 2023-12-16T03:29:30.718 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44193.log 2023-12-16T03:29:30.719 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45207.log 2023-12-16T03:29:30.719 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42815.log.gz 2023-12-16T03:29:30.721 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45181.log 2023-12-16T03:29:30.721 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44193.log.gz 2023-12-16T03:29:30.722 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44939.log 2023-12-16T03:29:30.722 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45207.log.gz 2023-12-16T03:29:30.723 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45181.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45181.log.gz 2023-12-16T03:29:30.724 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54026.log 2023-12-16T03:29:30.725 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44939.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44939.log.gz 2023-12-16T03:29:30.725 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44063.log 2023-12-16T03:29:30.726 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54026.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54026.log.gz 2023-12-16T03:29:30.727 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51721.log 2023-12-16T03:29:30.729 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44653.log 2023-12-16T03:29:30.729 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44063.log.gz 2023-12-16T03:29:30.730 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51721.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51721.log.gz -5 2023-12-16T03:29:30.730 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53096.log 2023-12-16T03:29:30.731 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44653.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44653.log.gz 2023-12-16T03:29:30.732 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53018.log 2023-12-16T03:29:30.733 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53096.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53096.log.gz 2023-12-16T03:29:30.733 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52626.log 2023-12-16T03:29:30.735 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53968.log 2023-12-16T03:29:30.735 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53018.log.gz 2023-12-16T03:29:30.736 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52940.log 2023-12-16T03:29:30.736 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52626.log.gz 2023-12-16T03:29:30.737 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53968.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53968.log.gz 2023-12-16T03:29:30.738 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53807.log 2023-12-16T03:29:30.739 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52940.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52940.log.gz 2023-12-16T03:29:30.739 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47667.log 2023-12-16T03:29:30.741 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45706.log 2023-12-16T03:29:30.741 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53807.log.gz 2023-12-16T03:29:30.743 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47667.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47667.log.gz 2023-12-16T03:29:30.744 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45706.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45706.log.gz 2023-12-16T03:29:30.744 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49501.log 2023-12-16T03:29:30.746 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55073.log 2023-12-16T03:29:30.748 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51844.log 2023-12-16T03:29:30.748 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49501.log.gz 2023-12-16T03:29:30.749 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50531.log 2023-12-16T03:29:30.749 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55073.log.gz 2023-12-16T03:29:30.751 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45550.log 2023-12-16T03:29:30.751 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51844.log.gz 2023-12-16T03:29:30.752 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50531.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50531.log.gz 2023-12-16T03:29:30.753 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44352.log 2023-12-16T03:29:30.753 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45550.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45550.log.gz 2023-12-16T03:29:30.754 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47039.log 2023-12-16T03:29:30.755 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51585.log 2023-12-16T03:29:30.756 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44352.log.gz 2023-12-16T03:29:30.757 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55334.log 2023-12-16T03:29:30.757 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47039.log.gz 2023-12-16T03:29:30.758 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51585.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51585.log.gz 2023-12-16T03:29:30.758 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50784.log 2023-12-16T03:29:30.760 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53285.log 2023-12-16T03:29:30.760 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55334.log.gz 2023-12-16T03:29:30.761 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50784.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-16T03:29:30.761 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50784.log.gz 2023-12-16T03:29:30.762 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53285.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53285.log.gz 2023-12-16T03:29:30.764 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53994.log 2023-12-16T03:29:30.765 INFO:teuthology.orchestra.run.smithi028.stderr: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-16T03:29:30.766 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52598.log 2023-12-16T03:29:30.768 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47641.log 2023-12-16T03:29:30.768 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53994.log.gz 2023-12-16T03:29:30.769 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52598.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52598.log.gz 2023-12-16T03:29:30.769 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43959.log 2023-12-16T03:29:30.771 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47641.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.47641.log.gz 2023-12-16T03:29:30.771 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52094.log 2023-12-16T03:29:30.772 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46817.log 2023-12-16T03:29:30.772 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43959.log.gz 2023-12-16T03:29:30.774 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49230.log 2023-12-16T03:29:30.774 INFO:teuthology.orchestra.run.smithi028.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52094.log.gz 2023-12-16T03:29:30.775 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42789.log 2023-12-16T03:29:30.775 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46817.log.gz 2023-12-16T03:29:30.777 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43293.log 2023-12-16T03:29:30.777 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49230.log.gz 2023-12-16T03:29:30.778 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46497.log 2023-12-16T03:29:30.778 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42789.log.gz 2023-12-16T03:29:30.779 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43293.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43293.log.gz 2023-12-16T03:29:30.780 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47169.log 2023-12-16T03:29:30.781 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54054.log 2023-12-16T03:29:30.781 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46497.log.gz 2023-12-16T03:29:30.782 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47169.log: gzip -5 --verbose 88.7% -- /var/log/ceph/ceph-client.admin.45043.log -- replaced with /var/log/ceph/ceph-client.admin.47169.log.gz 2023-12-16T03:29:30.783 INFO:teuthology.orchestra.run.smithi028.stderr: 2023-12-16T03:29:30.784 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54054.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54054.log.gz 2023-12-16T03:29:30.784 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50758.log 2023-12-16T03:29:30.785 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51221.log 2023-12-16T03:29:30.786 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45043.log.gz 2023-12-16T03:29:30.787 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54749.log 2023-12-16T03:29:30.787 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50758.log.gz 2023-12-16T03:29:30.788 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47299.log 2023-12-16T03:29:30.789 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51221.log.gz 2023-12-16T03:29:30.792 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43098.log 2023-12-16T03:29:30.792 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54749.log.gz 2023-12-16T03:29:30.792 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47299.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45264.log 2023-12-16T03:29:30.792 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47299.log.gz 2023-12-16T03:29:30.793 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43098.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43098.log.gz 2023-12-16T03:29:30.794 INFO:teuthology.orchestra.run.smithi134.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-16T03:29:30.794 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46635.log 2023-12-16T03:29:30.794 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45264.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45264.log.gz 2023-12-16T03:29:30.795 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42919.log 2023-12-16T03:29:30.796 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51169.log 2023-12-16T03:29:30.797 INFO:teuthology.orchestra.run.smithi028.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46635.log.gz 2023-12-16T03:29:30.797 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42919.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42919.log.gz 2023-12-16T03:29:30.798 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51637.log 2023-12-16T03:29:30.800 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54080.log 2023-12-16T03:29:30.800 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51169.log.gz 2023-12-16T03:29:30.801 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42841.log 2023-12-16T03:29:30.801 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51637.log.gz 2023-12-16T03:29:30.803 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46471.log 2023-12-16T03:29:30.803 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54080.log.gz 2023-12-16T03:29:30.804 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49064.log 2023-12-16T03:29:30.804 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42841.log.gz 2023-12-16T03:29:30.805 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52862.log 2023-12-16T03:29:30.806 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46471.log.gz 2023-12-16T03:29:30.807 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52546.log 89.2% 2023-12-16T03:29:30.807 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49064.log.gz 2023-12-16T03:29:30.809 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46987.log 2023-12-16T03:29:30.809 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52862.log.gz 2023-12-16T03:29:30.809 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52546.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52546.log.gz 2023-12-16T03:29:30.810 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51559.log 2023-12-16T03:29:30.812 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47065.log 2023-12-16T03:29:30.812 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46987.log.gz 2023-12-16T03:29:30.813 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51559.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51559.log.gz 2023-12-16T03:29:30.813 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46445.log 2023-12-16T03:29:30.815 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55203.log 2023-12-16T03:29:30.817 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47065.log.gz 2023-12-16T03:29:30.818 INFO:teuthology.orchestra.run.smithi134.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-16T03:29:30.819 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44167.log 2023-12-16T03:29:30.819 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46445.log.gz 2023-12-16T03:29:30.819 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55203.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55203.log.gz 2023-12-16T03:29:30.819 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49178.log 2023-12-16T03:29:30.819 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46873.log 2023-12-16T03:29:30.820 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44167.log.gz 2023-12-16T03:29:30.821 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49923.log 2023-12-16T03:29:30.821 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49178.log.gz 2023-12-16T03:29:30.822 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51611.log 2023-12-16T03:29:30.823 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46873.log.gz 2023-12-16T03:29:30.823 INFO:teuthology.orchestra.run.smithi134.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-16T03:29:30.824 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54567.log 2023-12-16T03:29:30.824 INFO:teuthology.orchestra.run.smithi028.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49923.log.gz 2023-12-16T03:29:30.825 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51611.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.43511.log 2023-12-16T03:29:30.825 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51611.log.gz 2023-12-16T03:29:30.827 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-16T03:29:30.827 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m0.436s 2023-12-16T03:29:30.827 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m1.776s 2023-12-16T03:29:30.827 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.223s 2023-12-16T03:29:30.827 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48364.log 2023-12-16T03:29:30.828 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54567.log.gz 2023-12-16T03:29:30.828 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43511.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43511.log.gz 2023-12-16T03:29:30.828 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52416.log 2023-12-16T03:29:30.830 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48364.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.48364.log.gz --verbose 2023-12-16T03:29:30.830 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.51072.log 2023-12-16T03:29:30.831 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52416.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52416.log.gz 2023-12-16T03:29:30.832 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43306.log 2023-12-16T03:29:30.833 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51072.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51072.log.gz 2023-12-16T03:29:30.833 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46573.log 2023-12-16T03:29:30.836 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43306.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43306.log.gzgzip 2023-12-16T03:29:30.836 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.46619.log 2023-12-16T03:29:30.837 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54437.log 2023-12-16T03:29:30.837 INFO:teuthology.orchestra.run.smithi028.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46573.log.gz 2023-12-16T03:29:30.838 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.46619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46619.log.gz 2023-12-16T03:29:30.838 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53543.log 2023-12-16T03:29:30.839 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51124.log 2023-12-16T03:29:30.840 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54437.log.gz 2023-12-16T03:29:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50916.log 2023-12-16T03:29:30.841 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53543.log.gz 2023-12-16T03:29:30.843 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51124.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51124.log.gz 2023-12-16T03:29:30.843 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55414.log 2023-12-16T03:29:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50916.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50916.log.gz 2023-12-16T03:29:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47195.log 2023-12-16T03:29:30.846 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45628.log 2023-12-16T03:29:30.846 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55414.log.gz 2023-12-16T03:29:30.848 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44141.log 2023-12-16T03:29:30.848 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47195.log.gz 2023-12-16T03:29:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45628.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45628.log.gz 2023-12-16T03:29:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52040.log 2023-12-16T03:29:30.851 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44141.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44141.log.gz 2023-12-16T03:29:30.851 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43085.log 2023-12-16T03:29:30.853 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52040.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52040.log.gz 2023-12-16T03:29:30.853 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-16T03:29:30.853 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45680.log 2023-12-16T03:29:30.854 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43085.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43085.log.gz 2023-12-16T03:29:30.854 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48085.log 2023-12-16T03:29:30.856 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45680.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45680.log.gz 2023-12-16T03:29:30.856 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47981.log 2023-12-16T03:29:30.858 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48085.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48085.log.gz 2023-12-16T03:29:30.858 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52758.log 2023-12-16T03:29:30.860 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48956.log 2023-12-16T03:29:30.860 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47981.log.gz 2023-12-16T03:29:30.860 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52758.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52758.log.gz 2023-12-16T03:29:30.861 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49527.log 2023-12-16T03:29:30.862 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48643.log 2023-12-16T03:29:30.862 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48956.log.gz 2023-12-16T03:29:30.863 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49527.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49527.log.gz 2023-12-16T03:29:30.864 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43907.log 2023-12-16T03:29:30.865 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48643.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48643.log.gz 2023-12-16T03:29:30.865 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2023-12-16T03:29:30.866 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53465.log 2023-12-16T03:29:30.867 INFO:teuthology.orchestra.run.smithi028.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43907.log.gz 2023-12-16T03:29:30.868 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46207.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2023-12-16T03:29:30.868 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50395.log 2023-12-16T03:29:30.869 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53465.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53465.log.gz 2023-12-16T03:29:30.870 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42655.log 2023-12-16T03:29:30.871 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50395.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50395.log.gz 2023-12-16T03:29:30.872 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52442.log 2023-12-16T03:29:30.873 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42655.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42655.log.gz 2023-12-16T03:29:30.873 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44037.log 2023-12-16T03:29:30.873 INFO:teuthology.orchestra.run.smithi028.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-16T03:29:30.874 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52442.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52442.log.gz 2023-12-16T03:29:30.874 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44783.log 2023-12-16T03:29:30.875 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44037.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44037.log.gz 2023-12-16T03:29:30.876 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43504.log 2023-12-16T03:29:30.876 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44783.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44783.log.gz 2023-12-16T03:29:30.876 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-16T03:29:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43504.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43504.log.gz 2023-12-16T03:29:30.877 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49605.log 2023-12-16T03:29:30.878 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55047.log 2023-12-16T03:29:30.880 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49605.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-16T03:29:30.880 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49605.log.gz 2023-12-16T03:29:30.880 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47143.log 2023-12-16T03:29:30.881 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55047.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55047.log.gz 2023-12-16T03:29:30.881 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-16T03:29:30.882 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47143.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47143.log.gz 2023-12-16T03:29:30.882 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54158.log 2023-12-16T03:29:30.883 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53729.log 2023-12-16T03:29:30.884 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54158.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54158.log.gz 2023-12-16T03:29:30.885 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43722.log 2023-12-16T03:29:30.886 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44913.log 2023-12-16T03:29:30.886 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53729.log.gz 2023-12-16T03:29:30.888 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43722.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43722.log.gz 2023-12-16T03:29:30.888 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43101.log 2023-12-16T03:29:30.889 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44913.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44913.log.gz 2023-12-16T03:29:30.889 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-16T03:29:30.891 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43101.log: gzip -5 88.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.43101.log.gz -- 2023-12-16T03:29:30.891 INFO:teuthology.orchestra.run.smithi028.stderr: /var/log/ceph/ceph-client.admin.47825.log 2023-12-16T03:29:30.892 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38390.log 2023-12-16T03:29:30.894 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53439.log 2023-12-16T03:29:30.894 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47825.log.gz 2023-12-16T03:29:30.895 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49337.log 2023-12-16T03:29:30.896 INFO:teuthology.orchestra.run.smithi028.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38390.log.gz 2023-12-16T03:29:30.897 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53439.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.53439.log.gz --verbose 2023-12-16T03:29:30.897 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.44271.log 2023-12-16T03:29:30.898 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51455.log 2023-12-16T03:29:30.899 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49337.log.gz 2023-12-16T03:29:30.900 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44271.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.44271.log.gz -5 2023-12-16T03:29:30.900 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42763.log 2023-12-16T03:29:30.901 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51455.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51455.log.gz 2023-12-16T03:29:30.902 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46845.log 2023-12-16T03:29:30.903 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42763.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.42763.log.gz -5 2023-12-16T03:29:30.903 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2023-12-16T03:29:30.905 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49036.log 2023-12-16T03:29:30.905 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46845.log.gz 2023-12-16T03:29:30.906 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47459.log 2023-12-16T03:29:30.906 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2023-12-16T03:29:30.908 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54489.log 2023-12-16T03:29:30.908 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49036.log.gz 2023-12-16T03:29:30.909 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47459.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47459.log.gz 2023-12-16T03:29:30.910 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44521.log 2023-12-16T03:29:30.910 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54489.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54489.log.gz 2023-12-16T03:29:30.911 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50447.log 2023-12-16T03:29:30.913 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44521.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.54184.log 2023-12-16T03:29:30.913 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44521.log.gz 2023-12-16T03:29:30.914 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50447.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50447.log.gz 2023-12-16T03:29:30.914 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46523.log 2023-12-16T03:29:30.915 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54184.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54184.log.gz 2023-12-16T03:29:30.917 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51020.log 2023-12-16T03:29:30.918 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44861.log 2023-12-16T03:29:30.918 INFO:teuthology.orchestra.run.smithi028.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46523.log.gz 2023-12-16T03:29:30.919 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51020.log: gzip 88.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.49311.log 2023-12-16T03:29:30.919 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51020.log.gz 2023-12-16T03:29:30.921 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44627.log 2023-12-16T03:29:30.921 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44861.log.gz 2023-12-16T03:29:30.922 INFO:teuthology.orchestra.run.smithi028.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-16T03:29:30.922 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49283.log 2023-12-16T03:29:30.923 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49311.log.gz 2023-12-16T03:29:30.923 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44627.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44627.log.gz 2023-12-16T03:29:30.923 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51978.log 2023-12-16T03:29:30.924 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46765.log 2023-12-16T03:29:30.925 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49283.log.gz 2023-12-16T03:29:30.926 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51978.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51978.log.gz 2023-12-16T03:29:30.926 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50369.log 2023-12-16T03:29:30.927 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46791.log 2023-12-16T03:29:30.927 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46765.log.gz 2023-12-16T03:29:30.928 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50369.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50369.log.gz 2023-12-16T03:29:30.928 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51481.log 2023-12-16T03:29:30.929 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42383.log 2023-12-16T03:29:30.930 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46791.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46791.log.gz 2023-12-16T03:29:30.930 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51481.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51481.log.gz 2023-12-16T03:29:30.931 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55177.log 2023-12-16T03:29:30.932 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53044.log 2023-12-16T03:29:30.932 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42383.log.gz 2023-12-16T03:29:30.933 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55177.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55177.log.gz 2023-12-16T03:29:30.933 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2023-12-16T03:29:30.934 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53337.log 2023-12-16T03:29:30.935 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53044.log.gz 2023-12-16T03:29:30.935 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43933.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2023-12-16T03:29:30.936 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54969.log 2023-12-16T03:29:30.937 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45420.log 2023-12-16T03:29:30.937 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53337.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53337.log.gz 2023-12-16T03:29:30.938 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54969.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54969.log.gz 2023-12-16T03:29:30.939 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54619.log 2023-12-16T03:29:30.939 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48520.log 2023-12-16T03:29:30.940 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45420.log.gz 2023-12-16T03:29:30.940 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54619.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54619.log.gz 2023-12-16T03:29:30.941 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48565.log 2023-12-16T03:29:30.942 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44757.log 2023-12-16T03:29:30.942 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48520.log.gz 2023-12-16T03:29:30.943 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48565.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48565.log.gz 2023-12-16T03:29:30.943 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50890.log 2023-12-16T03:29:30.944 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43103.log 2023-12-16T03:29:30.945 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44757.log.gz 2023-12-16T03:29:30.946 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52992.log 2023-12-16T03:29:30.946 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50890.log.gz 2023-12-16T03:29:30.947 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43103.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43103.log.gz 2023-12-16T03:29:30.947 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2023-12-16T03:29:30.948 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50287.log 2023-12-16T03:29:30.949 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52992.log.gz 2023-12-16T03:29:30.950 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49819.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2023-12-16T03:29:30.950 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47693.log 2023-12-16T03:29:30.951 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50287.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50287.log.gz 2023-12-16T03:29:30.951 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43709.log 2023-12-16T03:29:30.952 INFO:teuthology.orchestra.run.smithi028.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-16T03:29:30.952 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52352.log 2023-12-16T03:29:30.953 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47693.log.gz 2023-12-16T03:29:30.953 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43709.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43709.log.gz 2023-12-16T03:29:30.954 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51897.log 2023-12-16T03:29:30.955 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52352.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52352.log.gz 2023-12-16T03:29:30.955 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45654.log 2023-12-16T03:29:30.956 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51897.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51897.log.gz 2023-12-16T03:29:30.956 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55021.log 2023-12-16T03:29:30.957 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45654.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45654.log.gz 2023-12-16T03:29:30.957 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50183.log 2023-12-16T03:29:30.958 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55021.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55021.log.gz 2023-12-16T03:29:30.958 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49579.log 2023-12-16T03:29:30.959 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50183.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50183.log.gz 2023-12-16T03:29:30.959 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2023-12-16T03:29:30.960 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49579.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49579.log.gz 2023-12-16T03:29:30.961 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54366.log 2023-12-16T03:29:30.962 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47955.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2023-12-16T03:29:30.962 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44731.log 2023-12-16T03:29:30.963 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2023-12-16T03:29:30.963 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54366.log.gz 2023-12-16T03:29:30.964 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44731.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44731.log.gz 2023-12-16T03:29:30.964 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48617.log 2023-12-16T03:29:30.965 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47433.log 2023-12-16T03:29:30.965 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2023-12-16T03:29:30.966 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48617.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48617.log.gz 2023-12-16T03:29:30.966 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52250.log 2023-12-16T03:29:30.968 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47433.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.47433.log.gz -5 2023-12-16T03:29:30.968 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50994.log 2023-12-16T03:29:30.968 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52250.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52250.log.gz 2023-12-16T03:29:30.969 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55308.log 2023-12-16T03:29:30.970 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50994.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50994.log.gz 2023-12-16T03:29:30.970 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50654.log 2023-12-16T03:29:30.971 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55308.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55308.log.gz 2023-12-16T03:29:30.971 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48695.log 2023-12-16T03:29:30.972 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50654.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50654.log.gz 2023-12-16T03:29:30.972 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47381.log 2023-12-16T03:29:30.973 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48695.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48695.log.gz 2023-12-16T03:29:30.974 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47877.log 2023-12-16T03:29:30.975 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47381.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47381.log.gz 2023-12-16T03:29:30.975 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50968.log 2023-12-16T03:29:30.976 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47877.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47877.log.gz 2023-12-16T03:29:30.976 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2023-12-16T03:29:30.977 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50968.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50968.log.gz 2023-12-16T03:29:30.977 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49459.log 2023-12-16T03:29:30.978 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50313.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2023-12-16T03:29:30.978 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43711.log 2023-12-16T03:29:30.979 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.49459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49459.log.gz 2023-12-16T03:29:30.979 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50473.log 2023-12-16T03:29:30.980 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43711.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43711.log.gz 2023-12-16T03:29:30.981 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51663.log 2023-12-16T03:29:30.981 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50473.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50473.log.gz 2023-12-16T03:29:30.982 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43724.log 2023-12-16T03:29:30.983 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51663.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51663.log.gz 2023-12-16T03:29:30.983 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45576.log 2023-12-16T03:29:30.984 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43724.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43724.log.gz 2023-12-16T03:29:30.984 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42576.log 2023-12-16T03:29:30.985 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45576.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2023-12-16T03:29:30.985 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48876.log 2023-12-16T03:29:30.986 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42576.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42576.log.gz 2023-12-16T03:29:30.986 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50421.log 2023-12-16T03:29:30.987 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48876.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48876.log.gz 2023-12-16T03:29:30.988 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52494.log 2023-12-16T03:29:30.988 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50421.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50421.log.gz 2023-12-16T03:29:30.989 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45961.log 2023-12-16T03:29:30.989 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52494.log: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-16T03:29:30.990 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42452.log 2023-12-16T03:29:30.990 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52494.log.gz 2023-12-16T03:29:30.991 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38273.log 2023-12-16T03:29:30.991 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45961.log.gz 2023-12-16T03:29:30.992 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53181.log 2023-12-16T03:29:30.992 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42452.log.gz 2023-12-16T03:29:30.993 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38273.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38273.log.gz 2023-12-16T03:29:30.993 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50810.log 2023-12-16T03:29:30.994 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49871.log 2023-12-16T03:29:30.994 INFO:teuthology.orchestra.run.smithi028.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53181.log.gz 2023-12-16T03:29:30.995 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43102.log 2023-12-16T03:29:30.995 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50810.log.gz 2023-12-16T03:29:30.996 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42997.log 2023-12-16T03:29:30.996 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49871.log.gz 2023-12-16T03:29:30.997 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43102.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43102.log.gz 2023-12-16T03:29:30.997 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50027.log 2023-12-16T03:29:30.998 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55099.log 2023-12-16T03:29:30.998 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42997.log.gz 2023-12-16T03:29:30.999 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47719.log 2023-12-16T03:29:30.999 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50027.log.gz 2023-12-16T03:29:31.000 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51195.log 2023-12-16T03:29:31.000 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55099.log.gz 2023-12-16T03:29:31.001 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43023.log 2023-12-16T03:29:31.001 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47719.log.gz 2023-12-16T03:29:31.002 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46419.log 2023-12-16T03:29:31.002 INFO:teuthology.orchestra.run.smithi028.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51195.log.gz 2023-12-16T03:29:31.003 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46367.log 2023-12-16T03:29:31.004 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43023.log.gz 2023-12-16T03:29:31.004 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46419.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46419.log.gz 2023-12-16T03:29:31.004 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47771.log 2023-12-16T03:29:31.005 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49631.log 2023-12-16T03:29:31.006 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46367.log.gz 2023-12-16T03:29:31.006 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54210.log 2023-12-16T03:29:31.006 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47771.log.gz 2023-12-16T03:29:31.008 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43699.log 2023-12-16T03:29:31.008 INFO:teuthology.orchestra.run.smithi028.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49631.log.gz 2023-12-16T03:29:31.008 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54210.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54210.log.gz 2023-12-16T03:29:31.009 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54801.log 2023-12-16T03:29:31.009 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.43699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51689.log 2023-12-16T03:29:31.010 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43699.log.gz 2023-12-16T03:29:31.010 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44679.log 87.8% 2023-12-16T03:29:31.010 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54801.log.gz 2023-12-16T03:29:31.012 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48338.log 2023-12-16T03:29:31.012 INFO:teuthology.orchestra.run.smithi028.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51689.log.gz 2023-12-16T03:29:31.012 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44679.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44679.log.gz 2023-12-16T03:29:31.013 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44011.log 2023-12-16T03:29:31.014 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47570.log 2023-12-16T03:29:31.014 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48338.log.gz 2023-12-16T03:29:31.015 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42681.log 89.4% 2023-12-16T03:29:31.015 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44011.log.gz 2023-12-16T03:29:31.016 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47570.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.46739.log -- replaced with /var/log/ceph/ceph-client.admin.47570.log.gz 2023-12-16T03:29:31.016 INFO:teuthology.orchestra.run.smithi028.stderr: 2023-12-16T03:29:31.017 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49256.log 2023-12-16T03:29:31.017 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42681.log.gz 2023-12-16T03:29:31.022 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42893.log 2023-12-16T03:29:31.022 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46739.log.gz 2023-12-16T03:29:31.022 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47929.log 2023-12-16T03:29:31.022 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49256.log.gz 2023-12-16T03:29:31.022 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42893.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.42893.log.gz /var/log/ceph/ceph-client.admin.53259.log 2023-12-16T03:29:31.023 INFO:teuthology.orchestra.run.smithi028.stderr: 2023-12-16T03:29:31.023 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52146.log 2023-12-16T03:29:31.023 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47929.log.gz 2023-12-16T03:29:31.023 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54236.log 2023-12-16T03:29:31.023 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53259.log.gz 2023-12-16T03:29:31.024 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52146.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52146.log.gz 2023-12-16T03:29:31.024 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44089.log 2023-12-16T03:29:31.024 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51923.log 2023-12-16T03:29:31.024 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54236.log.gz 2023-12-16T03:29:31.025 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48137.log 2023-12-16T03:29:31.025 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44089.log.gz 2023-12-16T03:29:31.026 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54723.log 2023-12-16T03:29:31.026 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51923.log.gz 2023-12-16T03:29:31.027 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44809.log 2023-12-16T03:29:31.027 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48137.log.gz 2023-12-16T03:29:31.027 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54723.log: gzip -5 87.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.54723.log.gz 2023-12-16T03:29:31.028 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.45238.log 2023-12-16T03:29:31.028 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44809.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44809.log.gz 2023-12-16T03:29:31.029 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53703.log 2023-12-16T03:29:31.030 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42707.log 2023-12-16T03:29:31.030 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2023-12-16T03:29:31.031 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53703.log: gzip -5 89.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.53703.log.gz -- 2023-12-16T03:29:31.031 INFO:teuthology.orchestra.run.smithi028.stderr: /var/log/ceph/ceph-client.admin.54865.log 2023-12-16T03:29:31.032 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.42707.log: gzip -5 --verbose 89.3% -- -- replaced with /var/log/ceph/ceph-client.admin.42707.log.gz 2023-12-16T03:29:31.032 INFO:teuthology.orchestra.run.smithi028.stderr: /var/log/ceph/ceph-client.admin.52680.log 2023-12-16T03:29:31.033 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45498.log 2023-12-16T03:29:31.033 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54865.log.gz 2023-12-16T03:29:31.034 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52680.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.52680.log.gz 2023-12-16T03:29:31.034 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53070.log 2023-12-16T03:29:31.035 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48928.log 2023-12-16T03:29:31.035 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45498.log.gz 2023-12-16T03:29:31.036 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50732.log 2023-12-16T03:29:31.036 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53070.log.gz 2023-12-16T03:29:31.037 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45856.log 2023-12-16T03:29:31.037 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48928.log.gz 2023-12-16T03:29:31.038 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50732.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50732.log.gz 2023-12-16T03:29:31.038 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52914.log 2023-12-16T03:29:31.039 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53890.log 2023-12-16T03:29:31.039 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45856.log.gz 2023-12-16T03:29:31.040 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52914.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52914.log.gz 2023-12-16T03:29:31.040 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44297.log 2023-12-16T03:29:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46907.log 2023-12-16T03:29:31.042 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53890.log.gz 2023-12-16T03:29:31.042 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.44297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45738.log 2023-12-16T03:29:31.043 INFO:teuthology.orchestra.run.smithi028.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44297.log.gz 2023-12-16T03:29:31.043 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.46907.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46907.log.gz 2023-12-16T03:29:31.044 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45738.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45738.log.gz 2023-12-16T03:29:31.075 INFO:teuthology.orchestra.run.smithi028.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-16T03:29:31.124 INFO:teuthology.orchestra.run.smithi028.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-16T03:29:31.126 INFO:teuthology.orchestra.run.smithi028.stderr: 2023-12-16T03:29:31.126 INFO:teuthology.orchestra.run.smithi028.stderr:real 0m0.754s 2023-12-16T03:29:31.126 INFO:teuthology.orchestra.run.smithi028.stderr:user 0m2.613s 2023-12-16T03:29:31.126 INFO:teuthology.orchestra.run.smithi028.stderr:sys 0m1.090s 2023-12-16T03:29:31.127 INFO:tasks.ceph:Archiving logs... 2023-12-16T03:29:31.127 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532/remote/smithi028/log 2023-12-16T03:29:31.128 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T03:29:31.797 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532/remote/smithi134/log 2023-12-16T03:29:31.798 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-16T03:29:32.059 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-16T03:29:32.068 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-16T03:29:32.069 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T03:29:32.073 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-16T03:29:32.152 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-16T03:29:32.161 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-16T03:29:32.162 DEBUG:teuthology.orchestra.run.smithi028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T03:29:32.166 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-16T03:29:32.178 INFO:teuthology.orchestra.run.smithi028.stdout: remote refid st t when poll reach delay offset jitter 2023-12-16T03:29:32.178 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================== 2023-12-16T03:29:32.178 INFO:teuthology.orchestra.run.smithi028.stdout:*hv01.front.sepi 44.4.53.2 2 u 32 64 377 0.111 -1.709 1.190 2023-12-16T03:29:32.178 INFO:teuthology.orchestra.run.smithi028.stdout:+hv02.front.sepi 63.231.80.2 3 u 33 64 377 0.157 -1.497 1.012 2023-12-16T03:29:32.179 INFO:teuthology.orchestra.run.smithi028.stdout:+hv03.front.sepi 74.6.168.72 3 u 30 64 377 0.107 -1.690 1.125 2023-12-16T03:29:32.179 INFO:teuthology.orchestra.run.smithi028.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-16T03:29:32.180 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2023-12-16T03:29:32.181 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2023-12-16T03:29:32.181 INFO:teuthology.orchestra.run.smithi134.stdout:*hv01.front.sepi 44.4.53.2 2 u 33 64 377 0.256 -1.202 0.841 2023-12-16T03:29:32.181 INFO:teuthology.orchestra.run.smithi134.stdout:+hv02.front.sepi 63.231.80.2 3 u 28 64 377 0.182 -0.888 0.874 2023-12-16T03:29:32.181 INFO:teuthology.orchestra.run.smithi134.stdout:+hv03.front.sepi 74.6.168.72 3 u 32 64 377 0.092 -1.079 0.899 2023-12-16T03:29:32.181 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-16T03:29:32.182 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-16T03:29:32.191 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-16T03:29:32.191 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-16T03:29:32.217 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-16T03:29:32.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-16T03:29:32.284 INFO:teuthology.task.internal:Duration was 1019.887575 seconds 2023-12-16T03:29:32.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-16T03:29:32.318 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-16T03:29:32.318 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T03:29:32.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-16T03:29:32.422 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-16T03:29:32.422 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi028.front.sepia.ceph.com 2023-12-16T03:29:32.422 DEBUG:teuthology.orchestra.run.smithi028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T03:29:32.446 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2023-12-16T03:29:32.446 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-16T03:29:32.468 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-16T03:29:32.469 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T03:29:32.496 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-16T03:29:32.550 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-16T03:29:32.550 DEBUG:teuthology.orchestra.run.smithi028:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T03:29:32.580 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-16T03:29:32.657 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-16T03:29:32.669 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-16T03:29:32.669 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T03:29:32.690 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-16T03:29:32.711 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-16T03:29:32.725 DEBUG:teuthology.orchestra.run.smithi028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T03:29:32.736 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-16T03:29:32.751 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = core 2023-12-16T03:29:32.770 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2023-12-16T03:29:32.788 DEBUG:teuthology.orchestra.run.smithi028:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T03:29:32.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:29:32.820 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-16T03:29:32.838 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-16T03:29:32.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-16T03:29:32.850 INFO:teuthology.task.internal:Transferring archived files... 2023-12-16T03:29:32.850 DEBUG:teuthology.misc:Transferring archived files from smithi028:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532/remote/smithi028 2023-12-16T03:29:32.851 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T03:29:32.886 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532/remote/smithi134 2023-12-16T03:29:32.886 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-16T03:29:32.912 INFO:teuthology.task.internal:Removing archive directory... 2023-12-16T03:29:32.912 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T03:29:32.927 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-16T03:29:32.962 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-16T03:29:32.972 INFO:teuthology.task.internal:Not uploading archives. 2023-12-16T03:29:32.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-16T03:29:32.995 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-16T03:29:32.995 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T03:29:32.998 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-16T03:29:33.004 INFO:teuthology.orchestra.run.smithi028.stdout: 658056 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 03:29 /home/ubuntu/cephtest 2023-12-16T03:29:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: 655432 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 16 03:29 /home/ubuntu/cephtest 2023-12-16T03:29:33.018 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-16T03:29:33.028 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-16T03:29:33.106 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T03:29:33.133 DEBUG:teuthology.nuke:shortname: smithi028 2023-12-16T03:29:33.133 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T03:29:33.158 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 03:02:32.179988', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFln36APw+xm15YbhTjWav4mY1GGbpxKLumHaIcAY4YUneS0m9dZQrrSXn+/OXxU2hT9f3WsPFrKlunQRPqBKYQ='} 2023-12-16T03:29:33.162 DEBUG:teuthology.nuke:shortname: smithi134 2023-12-16T03:29:33.162 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T03:29:33.188 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493532', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 03:02:32.181744', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCZ0b5AAnhOimDpW28qjtqag5ceUU7/3lI05yIiYwjCzJ7qAd3w3LcEyXtNru1afyXKvWELQFzRTL06rEgO5MHA='} 2023-12-16T03:29:33.217 INFO:teuthology.orchestra.console.smithi028:Power off 2023-12-16T03:29:33.218 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T03:29:33.245 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off 2023-12-16T03:29:33.246 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:29:33.266 INFO:teuthology.orchestra.console.smithi134:Power off 2023-12-16T03:29:33.267 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T03:29:33.279 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2023-12-16T03:29:33.293 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-12-16T03:29:33.293 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:29:33.319 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-16T03:29:37.280 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:29:37.320 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:29:37.393 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2023-12-16T03:29:37.431 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-16T03:29:41.397 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:29:41.432 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T03:29:41.510 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2023-12-16T03:29:41.544 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-12-16T03:29:41.611 INFO:teuthology.orchestra.console.smithi028:Power off completed 2023-12-16T03:29:41.645 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-12-16T03:29:41.750 INFO:teuthology.run:Summary data: client.0-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c client.1-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 1019.887574672699 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8ffa7b838dc1454293881bdab00e1eed status: fail success: false 2023-12-16T03:29:41.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T03:29:41.833 INFO:teuthology.run:FAIL